jorgecarleitao / datafusion-pythonLinks
A Python library to run analytics workloads with the performance of Rust, the flexibility of Python and O(1) cost in moving data between the two. Uses Apache Arrow in-memory format and respective query engine DataFusion.
☆61Updated 4 years ago
Alternatives and similar repositories for datafusion-python
Users that are interested in datafusion-python are comparing it to the libraries listed below
Sorting:
- Experimental support for serializing DataFusion plans using substrait☆46Updated 2 years ago
- Batteries included CLI, TUI, and server implementations for DataFusion.☆184Updated last month
- Arrow, pydantic style☆85Updated 3 years ago
- Serverless query engine☆141Updated 2 years ago
- Fastest and safest Rust implementation of parquet. `unsafe` free. Integration-tested against pyarrow☆379Updated last year
- Python binding for DataFusion☆59Updated 3 years ago
- Incremental view maintenance & query rewriting for materialized views in DataFusion☆66Updated this week
- Rust crate for Substrait: Cross-Language Serialization for Relational Algebra☆83Updated this week
- Fill Apache Arrow record batches from an ODBC data source in Rust.☆75Updated last month
- S3 as an ObjectStore for DataFusion☆66Updated 2 years ago
- Derive for arrow2☆67Updated 2 years ago
- A set of tools for writing servers that speak PostgreSQL's wire protocol☆93Updated 2 weeks ago
- Generated Rust of Apache Arrow spec☆17Updated 2 years ago
- ☆55Updated last year
- Robust data transformation tool using SQL☆22Updated 3 years ago
- results cache for Apache DataFusion☆32Updated last year
- A reader that buffers ranged calls☆12Updated 3 years ago
- Rust implementation of the FastLanes compression library☆151Updated 2 weeks ago
- ☆19Updated 7 years ago
- An experimental (work-in-progress) statically typed implementation of Apache Arrow☆28Updated last week
- Query Plan Markup Language☆45Updated last year
- Postgres protocol frontend for DataFusion☆119Updated last week
- HDFS based on Java implementation as a remote ObjectStore for DataFusion☆10Updated last year
- Allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.☆158Updated 3 weeks ago
- Convert sequences of Rust objects to Arrow tables☆94Updated 3 weeks ago
- Integration of opentelemetry with the tracing crate☆24Updated 3 weeks ago
- Boring Data Tool☆238Updated last year
- DataFusion TableProviders for reading data from other systems☆161Updated last week
- ☆22Updated last year
- Experimental optimizer for DataFusion☆15Updated 4 years ago