fsspec / s3fs

Related projects ⓘ

Alternatives and complementary repositories for s3fs

• cloudpipe / cloudpickle
  Extended pickling support for Python objects
  ☆1,661Updated last month
• fsspec / filesystem_spec
  A specification that python filesystems should adhere to.
  ☆1,037Updated this week
• fsspec / gcsfs
  Pythonic file-system interface for Google Cloud Storage
  ☆345Updated this week
• dask / fastparquet
  python implementation of the parquet columnar file format.
  ☆787Updated last week
• drivendataorg / cloudpathlib
  Python pathlib-style classes for cloud storage services such as Amazon S3, Azure Blob Storage, and Google Cloud Storage.
  ☆475Updated 3 weeks ago
• aio-libs / aiobotocore
  asyncio support for botocore library using aiohttp
  ☆1,204Updated this week
• terricain / aioboto3
  Wrapper to use boto3 resources with the aiobotocore async backend
  ☆765Updated last month
• intake / intake
  Intake is a lightweight package for finding, investigating, loading and disseminating data.
  ☆1,013Updated last week
• dask / dask-kubernetes
  Native Kubernetes integration for Dask
  ☆312Updated 2 weeks ago
• laughingman7743 / PyAthena
  PyAthena is a Python DB API 2.0 (PEP 249) client for Amazon Athena.
  ☆463Updated 3 months ago
• liormizr / s3path
  s3path is a pathlib extension for AWS S3 Service
  ☆208Updated last week
• youtype / mypy_boto3_builder
  Type annotations builder for boto3 compatible with VSCode, PyCharm, Emacs, Sublime Text, pyright and mypy.
  ☆556Updated this week
• fastavro / fastavro
  Fast Avro for Python
  ☆645Updated this week
• piskvorky / smart_open
  Utils for streaming large files (S3, HDFS, gzip, bz2...)
  ☆3,215Updated 3 weeks ago
• dask / distributed
  A distributed task scheduler for Dask
  ☆1,579Updated this week
• pythonspeed / filprofiler
  A Python memory profiler for data processing and scientific computing applications
  ☆840Updated 2 weeks ago
• dask-contrib / dask-sql
  Distributed SQL Engine in Python using Dask
  ☆397Updated 2 months ago
• joblib / loky
  Robust and reusable Executor for joblib
  ☆538Updated 3 weeks ago
• static-frame / static-frame
  Immutable and statically-typeable DataFrames with runtime type and data validation
  ☆442Updated this week
• blue-yonder / turbodbc
  Turbodbc is a Python module to access relational databases via the Open Database Connectivity (ODBC) interface. The module complies with …
  ☆623Updated last week
• dask / dask-docker
  Docker images for dask
  ☆232Updated last week
• conda / conda-pack
  Package conda environments for redistribution
  ☆526Updated this week
• nschloe / tuna
  Python profile viewer
  ☆1,382Updated this week
• pympler / pympler
  Development tool to measure, monitor and analyze the memory behavior of Python objects in a running Python application.
  ☆1,212Updated 4 months ago
• Mause / duckdb_engine
  SQLAlchemy driver for DuckDB
  ☆355Updated this week
• madzak / python-json-logger
  Json Formatter for the standard python logger
  ☆1,757Updated 4 months ago
• tkem / cachetools
  Extensible memoizing collections and decorators
  ☆2,347Updated last month
• uqfoundation / dill
  serialize all of Python
  ☆2,277Updated 2 weeks ago
• python-streamz / streamz
  Real-time stream processing for python
  ☆1,244Updated 5 months ago
• agronholm / anyio
  High level asynchronous concurrency and networking framework that works on top of either trio or asyncio
  ☆1,818Updated this week