A specification that python filesystems should adhere to.
☆1,290Mar 16, 2026Updated this week
Alternatives and similar repositories for filesystem_spec
Users that are interested in filesystem_spec are comparing it to the libraries listed below
Sorting:
- pathlib api extended to use fsspec backends☆381Updated this week
- Intake is a lightweight package for finding, investigating, loading and disseminating data.☆1,071Mar 9, 2026Updated last week
- Pythonic file-system interface for Google Cloud Storage☆382Mar 13, 2026Updated last week
- Cloud-friendly access to archival data☆360Jan 21, 2026Updated 2 months ago
- S3 Filesystem☆1,016Mar 13, 2026Updated last week
- fsspec-compatible Azure Blob and Data Lake Storage (Gen2) access☆206Mar 9, 2026Updated last week
- An implementation of chunked, compressed, N-dimensional arrays for Python.☆1,936Mar 13, 2026Updated last week
- sshfs - SSH/SFTP implementation for fsspec☆85Jan 26, 2026Updated last month
- Disk-to-disk chunk transformation for chunked arrays.☆175Mar 9, 2026Updated last week
- Rust python FS☆34Apr 28, 2023Updated 2 years ago
- Parallel computing with task scheduling☆13,765Mar 12, 2026Updated last week
- Scalable array processing with bounded memory☆258Mar 9, 2026Updated last week
- Python's Filesystem abstraction layer☆2,097May 17, 2025Updated 10 months ago
- Concurrent appendable key-value storage☆107Jul 15, 2024Updated last year
- For extending xarray.open_dataset to accept pystac objects☆44Nov 28, 2025Updated 3 months ago
- Vector data cubes for Xarray☆132Feb 19, 2026Updated last month
- the portable Python dataframe library☆6,457Updated this week
- A distributed task scheduler for Dask☆1,665Updated this week
- Utils for streaming large files (S3, HDFS, gzip, bz2...)☆3,434Feb 23, 2026Updated 3 weeks ago
- Extended pickling support for Python objects☆1,903Nov 5, 2025Updated 4 months ago
- Cloud-Optimize your Scientific Data as Virtual Zarr stores, using xarray syntax.☆269Mar 12, 2026Updated last week
- A small utility for generating ND array pyramids using Xarray and Zarr.☆116Feb 1, 2026Updated last month
- Useful Mutable Mappings☆72Oct 31, 2023Updated 2 years ago
- A Python package providing buffer compression and transformation codecs for use in data storage and communication applications.☆141Mar 9, 2026Updated last week
- Python library for building Pangeo Forge recipes.☆134Mar 2, 2026Updated 2 weeks ago
- Lightweight lockfile for conda environments☆556Mar 13, 2026Updated last week
- Fast & furious GroupBy operations for dask.array☆135Updated this week
- ☆19Mar 9, 2026Updated last week
- WIP implementation of a tree-like hierarchical data structure for xarray.☆164Oct 24, 2024Updated last year
- High level asynchronous concurrency and networking framework that works on top of either Trio or asyncio☆2,408Mar 9, 2026Updated last week
- ☆89Jan 21, 2025Updated last year
- A fast serialization and validation library, with builtin support for JSON, MessagePack, YAML, and TOML☆3,646Nov 27, 2025Updated 3 months ago
- JupyterLab extension for Dask☆328Jun 2, 2025Updated 9 months ago
- Manipulate JSON-like data with NumPy-like idioms.☆952Mar 13, 2026Updated last week
- Python pathlib-style classes for cloud storage services such as Amazon S3, Azure Blob Storage, and Google Cloud Storage.☆608Jan 26, 2026Updated last month
- N-D labeled arrays and datasets in Python☆4,119Updated this week
- Typer, build great CLIs. Easy to code. Based on Python type hints.☆19,035Updated this week
- RFC document, tooling and other content related to the array API standard☆265Mar 2, 2026Updated 2 weeks ago
- Retrying library for Python☆8,446Mar 11, 2026Updated last week