S3 Filesystem
☆1,016Mar 13, 2026Updated last week
Alternatives and similar repositories for s3fs
Users that are interested in s3fs are comparing it to the libraries listed below
Sorting:
- A specification that python filesystems should adhere to.☆1,290Updated this week
- Pythonic file-system interface for Google Cloud Storage☆382Mar 13, 2026Updated last week
- Native Kubernetes integration for Dask☆324Mar 2, 2026Updated 2 weeks ago
- python implementation of the parquet columnar file format.☆890Updated this week
- Parallel computing with task scheduling☆13,774Updated this week
- Utils for streaming large files (S3, HDFS, gzip, bz2...)☆3,434Feb 23, 2026Updated 3 weeks ago
- Intake is a lightweight package for finding, investigating, loading and disseminating data.☆1,071Mar 9, 2026Updated last week
- An implementation of chunked, compressed, N-dimensional arrays for Python.☆1,943Updated this week
- A distributed task scheduler for Dask☆1,665Updated this week
- asyncio support for botocore library using aiohttp☆1,395Updated this week
- Amazon S3 filesystem for PyFilesystem2☆159Jul 16, 2024Updated last year
- FUSE-based file system backed by Amazon S3☆9,756Updated this week
- Extended pickling support for Python objects☆1,903Nov 5, 2025Updated 4 months ago
- pathlib api extended to use fsspec backends☆381Updated this week
- Scalable Machine Learning with Dask☆945Sep 27, 2025Updated 5 months ago
- pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoD…☆4,106Updated this week
- Rust python FS☆34Apr 28, 2023Updated 2 years ago
- For extending xarray.open_dataset to accept pystac objects☆44Nov 28, 2025Updated 3 months ago
- A multi-tenant server for securely deploying and managing Dask clusters.☆143Mar 2, 2026Updated 2 weeks ago
- Cloud-friendly access to archival data☆360Jan 21, 2026Updated 2 months ago
- A Python package providing buffer compression and transformation codecs for use in data storage and communication applications.☆141Mar 9, 2026Updated last week
- sshfs - SSH/SFTP implementation for fsspec☆85Jan 26, 2026Updated last month
- Modin: Scale your Pandas workflows by changing a single line of code☆10,363Feb 10, 2026Updated last month
- 📚 Parameterize, execute, and analyze notebooks☆6,407Updated this week
- Python pathlib-style classes for cloud storage services such as Amazon S3, Azure Blob Storage, and Google Cloud Storage.☆608Updated this week
- A light-weight, flexible, and expressive statistical data testing library☆4,259Updated this week
- Disk-to-disk chunk transformation for chunked arrays.☆175Updated this week
- An orchestration platform for the development, production, and observation of data assets.☆15,107Mar 16, 2026Updated last week
- Retrying library for Python☆8,446Mar 11, 2026Updated last week
- fsspec filesystem for Alibaba Cloud (Aliyun) Object Storage System (OSS)☆27May 7, 2025Updated 10 months ago
- the portable Python dataframe library☆6,457Updated this week
- A library that allows you to easily mock out tests based on AWS infrastructure.☆8,275Updated this week
- Prefect is a workflow orchestration framework for building resilient data pipelines in Python.☆21,910Updated this week
- Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per s…☆8,492Mar 1, 2026Updated 3 weeks ago
- Typer, build great CLIs. Easy to code. Based on Python type hints.☆19,035Updated this week
- Batch generation from xarray datasets☆194Jan 20, 2026Updated 2 months ago
- Extremely fast Query Engine for DataFrames, written in Rust☆37,810Updated this week
- JupyterLab extension for Dask☆328Jun 2, 2025Updated 9 months ago
- Cloud-Optimize your Scientific Data as Virtual Zarr stores, using xarray syntax.☆269Mar 12, 2026Updated last week