library for streaming large files
conda install free::smart_open
smart_open is a Python library for efficient streaming of very large files from/to S3, HDFS, WebHDFS or local (compressed) files.