dask / fastparquet

Related projects ⓘ

Alternatives and complementary repositories for fastparquet

• jcrobak / parquet-python
  python implementation of the parquet columnar file format.
  ☆341Updated 3 years ago
• intake / intake
  Intake is a lightweight package for finding, investigating, loading and disseminating data.
  ☆1,013Updated last week
• blue-yonder / turbodbc
  Turbodbc is a Python module to access relational databases via the Open Database Connectivity (ODBC) interface. The module complies with …
  ☆623Updated last week
• cloudpipe / cloudpickle
  Extended pickling support for Python objects
  ☆1,661Updated last month
• python-streamz / streamz
  Real-time stream processing for python
  ☆1,244Updated 5 months ago
• dask / distributed
  A distributed task scheduler for Dask
  ☆1,579Updated this week
• dask-contrib / dask-sql
  Distributed SQL Engine in Python using Dask
  ☆397Updated 2 months ago
• dask / dask-ml
  Scalable Machine Learning with Dask
  ☆902Updated 3 months ago
• xhochy / fletcher
  Pandas ExtensionDType/Array backed by Apache Arrow
  ☆229Updated last year
• fsspec / s3fs
  S3 Filesystem
  ☆890Updated last week
• fastavro / fastavro
  Fast Avro for Python
  ☆645Updated this week
• laughingman7743 / PyAthena
  PyAthena is a Python DB API 2.0 (PEP 249) client for Amazon Athena.
  ☆463Updated 3 months ago
• pydata / bottleneck
  Fast NumPy array functions written in C
  ☆1,073Updated last month
• wesm / pandas2
  Design documents and code for the pandas 2.0 effort.
  ☆306Updated 6 years ago
• joblib / joblib-spark
  Joblib Apache Spark Backend
  ☆242Updated 3 months ago
• PyTables / PyTables
  A Python package to manage extremely large amounts of data
  ☆1,311Updated 2 weeks ago
• pdpipe / pdpipe
  Easy pipelines for pandas DataFrames.
  ☆716Updated 3 weeks ago
• minrk / findspark
  ☆511Updated 2 years ago
• jupyter-incubator / sparkmagic
  Jupyter magics and kernels for working with remote Spark clusters
  ☆1,328Updated last week
• joblib / loky
  Robust and reusable Executor for joblib
  ☆538Updated 3 weeks ago
• hi-primus / optimus
  Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
  ☆1,481Updated this week
• yhat / pandasql
  sqldf for pandas
  ☆1,342Updated 3 months ago
• fsspec / filesystem_spec
  A specification that python filesystems should adhere to.
  ☆1,037Updated this week
• IntelPython / sdc
  Numba extension for compiling Pandas data frames, Intel® Scalable Dataframe Compiler
  ☆646Updated last year
• blaze / odo
  Data Migration for the Blaze Project
  ☆1,004Updated 2 years ago
• static-frame / static-frame
  Immutable and statically-typeable DataFrames with runtime type and data validation
  ☆442Updated this week
• ynqa / pandavro
  Apache Avro <-> pandas DataFrame
  ☆135Updated 3 months ago
• dask / dask-kubernetes
  Native Kubernetes integration for Dask
  ☆312Updated 2 weeks ago
• dask / dask-docker
  Docker images for dask
  ☆232Updated last week
• fsspec / gcsfs
  Pythonic file-system interface for Google Cloud Storage
  ☆345Updated this week