Lightweight pipelining - using Python functions as pipeline jobs.
A set of tools to provide lightweight pipelining in Python. In particular: transparent disk-caching of functions and lazy re-evaluation (memoize pattern), easy, simple parallel computing. Joblib is optimized to be fast and robust on large data in particular and has specific optimizations for numpy arrays.
