fsspec / s3fs
S3 Filesystem
☆902Updated 3 weeks ago
Alternatives and similar repositories for s3fs:
Users that are interested in s3fs are comparing it to the libraries listed below
- Extended pickling support for Python objects☆1,688Updated this week
- Python pathlib-style classes for cloud storage services such as Amazon S3, Azure Blob Storage, and Google Cloud Storage.☆493Updated last month
- python implementation of the parquet columnar file format.☆801Updated 2 months ago
- A specification that python filesystems should adhere to.☆1,091Updated this week
- Intake is a lightweight package for finding, investigating, loading and disseminating data.☆1,019Updated this week
- Pythonic file-system interface for Google Cloud Storage☆352Updated last week
- Wrapper to use boto3 resources with the aiobotocore async backend☆783Updated 3 weeks ago
- s3path is a pathlib extension for AWS S3 Service☆211Updated 2 months ago
- Fast Avro for Python☆649Updated 2 weeks ago
- PyAthena is a Python DB API 2.0 (PEP 249) client for Amazon Athena.☆469Updated this week
- Native Kubernetes integration for Dask☆317Updated this week
- A distributed task scheduler for Dask☆1,589Updated this week
- asyncio support for botocore library using aiohttp☆1,230Updated last week
- Flexible test automation for Python☆1,352Updated this week
- A Python memory profiler for data processing and scientific computing applications☆849Updated 2 months ago
- Distributed SQL Engine in Python using Dask☆396Updated 4 months ago
- Docker images for dask☆233Updated last week
- Robust and reusable Executor for joblib☆546Updated 2 months ago
- Run-time type checker for Python☆1,576Updated last week
- Thin-wrapper around the mock package for easier use with pytest☆1,876Updated this week
- A lightweight Traits like module☆628Updated last month
- serialize all of Python☆2,302Updated 2 weeks ago
- Iterative JSON parser with Pythonic interfaces☆874Updated 2 weeks ago
- Extensible memoizing collections and decorators☆2,388Updated last month
- Scalable Machine Learning with Dask☆912Updated last month
- Development tool to measure, monitor and analyze the memory behavior of Python objects in a running Python application.☆1,231Updated 6 months ago
- A high-performance immutable mapping type for Python.☆1,137Updated 3 months ago
- Utils for streaming large files (S3, HDFS, gzip, bz2...)☆3,249Updated last month
- Dev tools for python☆1,003Updated 7 months ago
- Composable custom class converters for attrs, dataclasses and friends.☆845Updated this week