Python library for efficient streaming of large files
conda install conda-forge::smart-open-with-s3
smart_open is a Python 3 library for efficient streaming of very large files from/to S3, HDFS, WebHDFS or local (compressed) files.