dask-setup

Community

HPC-aware Dask setup for PBS (NCI Gadi) and SLURM clusters.

Copied fromcf-post-staging / dask-setup

Versions

Installation

To install this package, run one of the following:

Conda

$conda install conda-forge::dask-setup

Try This Package Beta

Choose a pre-made example or create your own:

Usage Tracking

Version

2 / 8 versions selected

Downloads (Last 6 months): 0

Description

Wraps dask.distributed with HPC-aware defaults: resource detection from PBS/SLURM environment variables, spill routing to node-local storage, workload-shaped worker topology, profile-based configuration, and multi-node clusters via dask-jobqueue.

About

Summary

HPC-aware Dask setup for PBS (NCI Gadi) and SLURM clusters.

Last Updated

Oct 1, 2026 at 11:53

License

Apache-2.0

Supported Platforms

noarch

Home

https://github.com/21centuryweather/dask_setup

GitHub Repository

https://github.com/21centuryweather/dask_setup