smart_open
Utils for streaming large files (S3, HDFS, GCS, SFTP, Azure Blob Storage, gzip, bz2, zst...)
Installation
To install this package, run one of the following:
Usage Tracking
7.3.1
7.3.0.post1
5.2.1
5.1.0
5.0.0
5 / 8 versions selected
Downloads (Last 6 months): 0
Description
smart_open is a Python 3 library for efficient streaming of very large files from/to storages such as S3, GCS, Azure Blob Storage, HDFS, WebHDFS, HTTP, HTTPS, SFTP, or local filesystem. It supports transparent, on-the-fly (de-)compression for a variety of different formats
About
Summary
Utils for streaming large files (S3, HDFS, GCS, SFTP, Azure Blob Storage, gzip, bz2, zst...)
Last Updated
Sep 11, 2025 at 09:36
License
MIT
Total Downloads
8.2K
Supported Platforms
macOS-arm64
linux-64
linux-aarch64
win-64
Unsupported Platforms
linux-ppc64le Last supported version: 5.2.1
win-32 Last supported version: 5.2.1
noarch Last supported version: 5.1.0
linux-s390x Last supported version: 5.2.1
macOS-64 Last supported version: 5.2.1
linux-32 Last supported version: 1.7.1
GitHub Repository
https://github.com/RaRe-Technologies/smart_open