Utils for streaming large files (S3, HDFS, gzip, bz2...)
☆3,459Sep 5, 2026Updated 2 weeks ago
Alternatives and similar repositories for smart_open
Users that are interested in smart_open are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per s…☆8,509Apr 1, 2026Updated 5 months ago
- Retrying library for Python☆8,790Sep 1, 2026Updated 3 weeks ago
- Parallel computing with task scheduling☆13,924Aug 24, 2026Updated 3 weeks ago
- A library that allows you to easily mock out tests based on AWS infrastructure.☆8,670Updated this week
- Modin: Scale your Pandas workflows by changing a single line of code☆10,389Feb 10, 2026Updated 7 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Efficient Counter that uses a limited (bounded) amount of memory regardless of data size.☆930Nov 20, 2022Updated 3 years ago
- Python datetimes made easy☆6,674Updated this week
- 🔩 Like builtins, but boltons. 250+ constructs, recipes, and snippets which extend (and rely on nothing but) the Python standard library.…☆6,925Sep 8, 2026Updated 2 weeks ago
- Python Fire is a library for automatically generating command line interfaces (CLIs) from absolutely any Python object.☆28,225Jul 1, 2026Updated 2 months ago
- Python Stream Processing☆6,824Jul 27, 2024Updated 2 years ago
- the portable Python dataframe library☆6,662Updated this week
- A functional standard library for Python.☆5,157Updated this week
- S3 Filesystem☆1,044Updated this week
- Always know what to expect from your data.☆11,833Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A specification that python filesystems should adhere to.☆1,354Updated this week
- Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, vis…☆18,777Jul 18, 2026Updated 2 months ago
- 🦉 Data Versioning and ML Experiments☆15,884Updated this week
- 💫 Industrial-strength Natural Language Processing (NLP) in Python☆33,916Aug 24, 2026Updated last month
- More routines for operating on iterables, beyond itertools☆4,095Updated this week
- Python logging made (stupidly) simple☆24,126Aug 30, 2026Updated 3 weeks ago
- Prefect is a workflow orchestration framework for building resilient data pipelines in Python.☆23,907Updated this week
- Fast, correct Python JSON library supporting dataclasses, datetimes, and numpy☆8,233Sep 14, 2026Updated last week
- Sampling profiler for Python programs☆15,512Aug 14, 2026Updated last month
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Persistent dict, backed by sqlite3 and pickle, multithread-safe.☆1,245Dec 7, 2022Updated 3 years ago
- Data validation using Python type hints☆28,854Updated this week
- pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoD…☆4,119Updated this week
- Typer, build great CLIs. Easy to code. Based on Python type hints.☆20,015Updated this week
- Topic Modelling for Humans☆16,488Nov 1, 2025Updated 10 months ago
- Serverless Python☆11,819Mar 23, 2023Updated 3 years ago
- Simple, powerful, and fast logging for Python.☆4,962Sep 5, 2026Updated 2 weeks ago
- Declarative visualization library for Python☆10,483Updated this week
- A next generation HTTP client for Python. 🦋☆15,501Mar 29, 2026Updated 5 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Approximate Nearest Neighbors in C++/Python optimized for memory usage and loading/saving to disk☆14,302Oct 29, 2025Updated 10 months ago
- A fast and reliable background task processing library for Python 3.☆5,312Sep 14, 2026Updated last week
- Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.☆43,911Updated this week
- An orchestration platform for the development, production, and observation of data assets.☆16,197Updated this week
- The property-based testing library for Python☆9,006Updated this week
- Apache Airflow - A platform to programmatically author, schedule, and monitor workflows☆46,953Updated this week
- Memray is a memory profiler for Python☆15,242Updated this week