Utils for streaming large files (S3, HDFS, gzip, bz2...)
☆3,443May 1, 2026Updated this week
Alternatives and similar repositories for smart_open
Users that are interested in smart_open are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per s…☆8,505Apr 1, 2026Updated last month
- Retrying library for Python☆8,582Updated this week
- Parallel computing with task scheduling☆13,819Apr 28, 2026Updated last week
- A library that allows you to easily mock out tests based on AWS infrastructure.☆8,460Updated this week
- Modin: Scale your Pandas workflows by changing a single line of code☆10,384Feb 10, 2026Updated 2 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Python datetimes made easy☆6,662Mar 30, 2026Updated last month
- Efficient Counter that uses a limited (bounded) amount of memory regardless of data size.☆932Nov 20, 2022Updated 3 years ago
- 🔩 Like builtins, but boltons. 250+ constructs, recipes, and snippets which extend (and rely on nothing but) the Python standard library.…☆6,882Mar 6, 2026Updated last month
- Python Fire is a library for automatically generating command line interfaces (CLIs) from absolutely any Python object.☆28,183Apr 1, 2026Updated last month
- the portable Python dataframe library☆6,521Updated this week
- Python Stream Processing☆6,823Jul 27, 2024Updated last year
- A functional standard library for Python.☆5,140Jan 1, 2026Updated 4 months ago
- S3 Filesystem☆1,024Updated this week
- Always know what to expect from your data.☆11,458Updated this week
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- A specification that python filesystems should adhere to.☆1,308Updated this week
- Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, vis…☆18,712Apr 10, 2026Updated 3 weeks ago
- 💫 Industrial-strength Natural Language Processing (NLP) in Python☆33,528Mar 28, 2026Updated last month
- 🦉 Data Versioning and ML Experiments☆15,576Apr 28, 2026Updated last week
- More routines for operating on iterables, beyond itertools☆4,061Apr 23, 2026Updated last week
- Prefect is a workflow orchestration framework for building resilient data pipelines in Python.☆22,283Updated this week
- Python logging made (stupidly) simple☆23,852Apr 6, 2026Updated 3 weeks ago
- Sampling profiler for Python programs☆15,147Apr 25, 2026Updated last week
- Fast, correct Python JSON library supporting dataclasses, datetimes, and numpy☆8,050Apr 17, 2026Updated 2 weeks ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoD…☆4,107Updated this week
- Persistent dict, backed by sqlite3 and pickle, multithread-safe.☆1,247Dec 7, 2022Updated 3 years ago
- Data validation using Python type hints☆27,645Updated this week
- Typer, build great CLIs. Easy to code. Based on Python type hints.☆19,338Updated this week
- Serverless Python☆11,842Mar 23, 2023Updated 3 years ago
- Topic Modelling for Humans☆16,403Nov 1, 2025Updated 6 months ago
- Declarative visualization library for Python☆10,355Apr 27, 2026Updated last week
- Simple, powerful, and fast logging for Python.☆4,755Updated this week
- A next generation HTTP client for Python. 🦋☆15,251Mar 29, 2026Updated last month
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- A fast and reliable background task processing library for Python 3.☆5,217Apr 26, 2026Updated last week
- Approximate Nearest Neighbors in C++/Python optimized for memory usage and loading/saving to disk☆14,230Oct 29, 2025Updated 6 months ago
- Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.☆42,373Updated this week
- An orchestration platform for the development, production, and observation of data assets.☆15,425Updated this week
- The property-based testing library for Python☆8,597Apr 27, 2026Updated last week
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆45,231Updated this week
- 📚 Parameterize, execute, and analyze notebooks☆6,439Apr 6, 2026Updated 3 weeks ago