fsspec / filesystem_specLinks
A specification that python filesystems should adhere to.
☆1,221Updated last week
Alternatives and similar repositories for filesystem_spec
Users that are interested in filesystem_spec are comparing it to the libraries listed below
Sorting:
- Python pathlib-style classes for cloud storage services such as Amazon S3, Azure Blob Storage, and Google Cloud Storage.☆573Updated 2 weeks ago
- pathlib api extended to use fsspec backends☆326Updated this week
- Extended pickling support for Python objects☆1,817Updated 2 weeks ago
- S3 Filesystem☆962Updated last week
- A Python memory profiler for data processing and scientific computing applications☆882Updated 10 months ago
- Run-time type checker for Python☆1,700Updated 3 weeks ago
- Python profile viewer☆1,501Updated this week
- Pythonic file-system interface for Google Cloud Storage☆373Updated last week
- Intake is a lightweight package for finding, investigating, loading and disseminating data.☆1,050Updated 2 months ago
- Robust and reusable Executor for joblib☆583Updated last week
- Lightweight lockfile for conda environments☆532Updated last week
- Yet Another Python Profiler, but this time multithreading, asyncio and gevent aware.☆1,639Updated 7 months ago
- Immutable and statically-typeable DataFrames with runtime type and data validation☆473Updated this week
- Composable custom class converters for attrs, dataclasses and friends.☆938Updated last week
- Package conda environments for redistribution☆556Updated this week
- s3path is a pathlib extension for AWS S3 Service☆222Updated 2 months ago
- A data modelling layer built on top of polars and pydantic☆529Updated last week
- Flexible test automation for Python☆1,447Updated 3 weeks ago
- Entity relationship diagrams for Python data model classes like Pydantic☆387Updated last month
- Fast and well tested serialization library☆873Updated 2 weeks ago
- A fast serialization and validation library, with builtin support for JSON, MessagePack, YAML, and TOML☆3,131Updated 4 months ago
- SQLAlchemy driver for DuckDB☆456Updated last week
- Python package to enforce column names & data types of pandas DataFrames☆219Updated 4 years ago
- Plugin for Poetry to enable dynamic versioning based on VCS tags☆656Updated 2 months ago
- Find unused, missing and transitive dependencies in a Python project.☆1,171Updated this week
- python implementation of the parquet columnar file format.☆851Updated 2 weeks ago
- A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rew…☆2,109Updated 5 months ago
- Manipulate JSON-like data with NumPy-like idioms.☆901Updated this week
- Production-grade retries for Python☆1,245Updated last week
- Run ruff, isort, pyupgrade, mypy, pylint, flake8, and more on Jupyter Notebooks☆1,153Updated 2 weeks ago