fsspec / s3fs

Related projects: ⓘ

• drivendataorg / cloudpathlib
  Python pathlib-style classes for cloud storage services such as Amazon S3, Azure Blob Storage, and Google Cloud Storage.
  ☆450Updated this week
• terricain / aioboto3
  Wrapper to use boto3 resources with the aiobotocore async backend
  ☆735Updated 3 weeks ago
• laughingman7743 / PyAthena
  PyAthena is a Python DB API 2.0 (PEP 249) client for Amazon Athena.
  ☆460Updated last month
• fsspec / filesystem_spec
  A specification that python filesystems should adhere to.
  ☆990Updated 2 weeks ago
• aio-libs / aiobotocore
  asyncio support for botocore library using aiohttp
  ☆1,171Updated this week
• dask / fastparquet
  python implementation of the parquet columnar file format.
  ☆767Updated last week
• fsspec / gcsfs
  Pythonic file-system interface for Google Cloud Storage
  ☆330Updated 2 weeks ago
• fastavro / fastavro
  Fast Avro for Python
  ☆637Updated this week
• cloudpipe / cloudpickle
  Extended pickling support for Python objects
  ☆1,632Updated last month
• liormizr / s3path
  s3path is a pathlib extension for AWS S3 Service
  ☆207Updated 3 weeks ago
• youtype / mypy_boto3_builder
  Type annotations builder for boto3 compatible with VSCode, PyCharm, Emacs, Sublime Text, pyright and mypy.
  ☆532Updated this week
• piskvorky / smart_open
  Utils for streaming large files (S3, HDFS, gzip, bz2...)
  ☆3,174Updated this week
• intake / intake
  Intake is a lightweight package for finding, investigating, loading and disseminating data.
  ☆1,001Updated 2 weeks ago
• dask / dask-kubernetes
  Native Kubernetes integration for Dask
  ☆312Updated 2 weeks ago
• ICRAR / ijson
  Iterative JSON parser with Pythonic interfaces
  ☆820Updated this week
• pythonspeed / filprofiler
  A Python memory profiler for data processing and scientific computing applications
  ☆833Updated last month
• wntrblm / nox
  Flexible test automation for Python
  ☆1,296Updated last week
• fabiocaccamo / python-benedict
  dict subclass with keylist/keypath support, built-in I/O operations (base64, csv, html, ini, json, pickle, plist, query-string, toml, xl…
  ☆1,484Updated this week
• pytest-dev / pytest-mock
  Thin-wrapper around the mock package for easier use with pytest
  ☆1,825Updated last week
• python-streamz / streamz
  Real-time stream processing for python
  ☆1,234Updated 3 months ago
• uqfoundation / dill
  serialize all of Python
  ☆2,241Updated this week
• ClearcodeHQ / pytest-postgresql
  This is a pytest plugin, that enables you to test your code that relies on a running PostgreSQL Database. It allows you to specify fixtur…
  ☆412Updated last week
• Kludex / mangum
  AWS Lambda support for ASGI applications
  ☆1,670Updated 3 months ago
• seperman / deepdiff
  DeepDiff: Deep Difference and search of any Python object/data. DeepHash: Hash of any object based on its contents. Delta: Use deltas to …
  ☆1,990Updated last week
• invl / retry
  easy to use retry decorator in python
  ☆707Updated 2 months ago
• Fatal1ty / mashumaro
  Fast and well tested serialization library
  ☆759Updated 2 months ago
• joblib / loky
  Robust and reusable Executor for joblib
  ☆524Updated last month
• blue-yonder / turbodbc
  Turbodbc is a Python module to access relational databases via the Open Database Connectivity (ODBC) interface. The module complies with …
  ☆614Updated this week
• kislyuk / watchtower
  Python CloudWatch Logging: Log Analytics and Application Intelligence
  ☆778Updated 3 weeks ago
• MagicStack / immutables
  A high-performance immutable mapping type for Python.
  ☆1,119Updated 2 weeks ago