law
Use law to build complex and large-scale task workflows.
Use law to build complex and large-scale task workflows.
To install this package, run one of the following:
Use law to build complex and large-scale task workflows. It is build on top of luigi and adds abstractions for run locations, storage locations and software environments. Law strictly disentangles these building blocks and ensures they remain interchangeable and resource-opportunistic.
Key features: - CLI with auto-completion and interactive status and dependency inspection. - Remote targets with automatic retries and local caching: WebDAV, HTTP, Dropbox, SFTP, all WLCG protocols (srm, xrootd, rfio, dcap, gsiftp, ...) - Automatic submission to batch systems from within tasks: HTCondor, LSF, gLite, ARC - Environment sandboxing, configurable on task level: Docker, Singularity, Sub-Shells
Summary
Use law to build complex and large-scale task workflows.
Last Updated
Dec 24, 2024 at 10:15
License
BSD-3-Clause
Total Downloads
100.1K
Supported Platforms
Unsupported Platforms
GitHub Repository
https://github.com/riga/lawDocumentation
https://law.readthedocs.io/