Lightweight pipelining: using Python functions as pipeline jobs.
"A set of tools to provide lightweight pipelining in Python. In particular: transparent disk-caching of functions and lazy re-evaluation (memoize pattern), easy simple parallel computing. Joblib is optimized to be fast and robust on large data in particular and has specific optimizations for numpy arrays."
