dask / fastparquet
python implementation of the parquet columnar file format.
☆816Updated 4 months ago
Alternatives and similar repositories for fastparquet:
Users that are interested in fastparquet are comparing it to the libraries listed below
- Turbodbc is a Python module to access relational databases via the Open Database Connectivity (ODBC) interface. The module complies with …☆628Updated 2 weeks ago
- A distributed task scheduler for Dask☆1,612Updated this week
- Intake is a lightweight package for finding, investigating, loading and disseminating data.☆1,032Updated last week
- Distributed SQL Engine in Python using Dask☆401Updated 6 months ago
- python implementation of the parquet columnar file format.☆349Updated 3 years ago
- PyAthena is a Python DB API 2.0 (PEP 249) client for Amazon Athena.☆469Updated 2 months ago
- S3 Filesystem☆919Updated 2 weeks ago
- Extended pickling support for Python objects☆1,716Updated last week
- Scalable Machine Learning with Dask☆922Updated last month
- Pandas ExtensionDType/Array backed by Apache Arrow☆229Updated 2 years ago
- Robust and reusable Executor for joblib☆558Updated this week
- Jupyter magics and kernels for working with remote Spark clusters☆1,345Updated 2 weeks ago
- Real-time stream processing for python☆1,256Updated 4 months ago
- Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark☆1,497Updated 3 months ago
- Docker images for dask☆235Updated last month
- Pythonic file-system interface for Google Cloud Storage☆357Updated last week
- NumPy and Pandas interface to Big Data☆3,196Updated last year
- Data Migration for the Blaze Project☆1,004Updated 2 years ago
- sqldf for pandas☆1,345Updated 7 months ago
- Fast Avro for Python☆658Updated 2 weeks ago
- Native Kubernetes integration for Dask☆316Updated last week
- A Python connector for Druid☆513Updated 7 months ago
- A Python package to manage extremely large amounts of data☆1,324Updated 3 weeks ago
- Easy pipelines for pandas DataFrames.☆717Updated 4 months ago
- A consistent table management library in python☆160Updated last year
- Python interface to Hive and Presto. 🐝☆1,678Updated 7 months ago
- Joblib Apache Spark Backend☆245Updated 7 months ago
- Python DB API 2.0 client for Impala and Hive (HiveServer2 protocol)☆734Updated last week
- A pure Python implementation of Apache Spark's RDD and DStream interfaces.☆268Updated 6 months ago
- Design documents and code for the pandas 2.0 effort.☆303Updated 6 years ago