fsspec / s3fsLinks
S3 Filesystem
☆996Updated 3 weeks ago
Alternatives and similar repositories for s3fs
Users that are interested in s3fs are comparing it to the libraries listed below
Sorting:
- python implementation of the parquet columnar file format.☆872Updated last week
- A specification that python filesystems should adhere to.☆1,263Updated last week
- PyAthena is a Python DB API 2.0 (PEP 249) client for Amazon Athena.☆489Updated last month
- Python pathlib-style classes for cloud storage services such as Amazon S3, Azure Blob Storage, and Google Cloud Storage.☆600Updated last month
- Pythonic file-system interface for Google Cloud Storage☆380Updated last week
- Extended pickling support for Python objects☆1,869Updated last month
- Fast Avro for Python☆690Updated last month
- Wrapper to use boto3 resources with the aiobotocore async backend☆953Updated last week
- Intake is a lightweight package for finding, investigating, loading and disseminating data.☆1,063Updated last month
- asyncio support for botocore library using aiohttp☆1,366Updated last week
- Native Kubernetes integration for Dask☆323Updated 2 months ago
- s3path is a pathlib extension for AWS S3 Service☆224Updated 6 months ago
- Docker images for dask☆244Updated last week
- Type annotations builder for boto3 compatible with VSCode, PyCharm, Emacs, Sublime Text, pyright and mypy.☆650Updated 3 weeks ago
- Robust and reusable Executor for joblib☆600Updated 3 months ago
- Utils for streaming large files (S3, HDFS, gzip, bz2...)☆3,419Updated 3 weeks ago
- SQLAlchemy dialect for BigQuery☆488Updated last week
- A distributed task scheduler for Dask☆1,662Updated this week
- A Python memory profiler for data processing and scientific computing applications☆891Updated last year
- Turbodbc is a Python module to access relational databases via the Open Database Connectivity (ODBC) interface. The module complies with …☆650Updated last week
- Immutable and statically-typeable DataFrames with runtime type and data validation☆476Updated last week
- Iterative JSON parser with Pythonic interfaces☆1,035Updated last week
- Cloud provider cluster managers for Dask. Supports AWS, Google Cloud Azure and more...☆145Updated 2 months ago
- Apache Airflow - OpenApi Client for Python☆440Updated 2 weeks ago
- Patch asyncio to allow nested event loops☆749Updated last year
- Python package to enforce column names & data types of pandas DataFrames☆220Updated 4 years ago
- Yet Another Python Profiler, but this time multithreading, asyncio and gevent aware.☆1,676Updated last month
- Real-time stream processing for python☆1,289Updated last week
- SQLAlchemy driver for DuckDB☆478Updated last week
- (Asyncio OR Threadsafe) Google Cloud Client Library for Python☆330Updated last week