smart_open
Utils for streaming large files (S3, HDFS, GCS, SFTP, Azure Blob Storage, gzip, bz2, zst...)
Utils for streaming large files (S3, HDFS, GCS, SFTP, Azure Blob Storage, gzip, bz2, zst...)
To install this package, run one of the following:
smart_open is a Python 3 library for efficient streaming of very large files from/to S3, HDFS, WebHDFS or local (compressed) files.
Summary
Utils for streaming large files (S3, HDFS, GCS, SFTP, Azure Blob Storage, gzip, bz2, zst...)
Last Updated
Jul 15, 2026 at 17:50
License
MIT
Supported Platforms
Unsupported Platforms
GitHub Repository
https://github.com/RaRe-Technologies/smart_open