rewrite-bigdata-in-rust / RBIR
A collection of RBIR projects and posts for anyone interested in joining this journey.
☆231Updated this week
Alternatives and similar repositories for RBIR:
Users that are interested in RBIR are comparing it to the libraries listed below
- Pure Rust Iceberg Implementation☆163Updated 8 months ago
- Apache DataFusion Ray☆183Updated 2 weeks ago
- Apache Paimon Rust The rust implementation of Apache Paimon.☆113Updated 6 months ago
- Rust implementation of Apache Iceberg with integration for Datafusion☆163Updated last week
- Message queue and data streaming based on cloud native services.☆107Updated 2 months ago
- Allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.☆119Updated this week
- The native Rust implementation for Apache Hudi, with Python API bindings.☆207Updated last week
- DataFusion TableProviders for reading data from other systems☆102Updated this week
- TPC-H benchmark data generation in pure Rust☆34Updated this week
- CMU-DB's Cascades optimizer framework☆397Updated 3 months ago
- 10x lower latency for cloud-native DataFusion☆94Updated last week
- Sqllogictest (dialect with extensions) parser and runner in Rust.☆189Updated this week
- Apache Iceberg☆886Updated this week
- Batteries included CLI, TUI, and server implementations for DataFusion.☆146Updated this week
- A native Delta implementation for integration with any query engine☆220Updated this week
- Learn Data Lake From Storage Layer.☆45Updated 8 months ago
- Apache Spark Connect Client for Rust☆106Updated 2 months ago
- A User-Defined Function Framework for Apache Arrow.☆89Updated last week
- Distributed SQL Query Engine in Python using Ray☆243Updated 6 months ago
- High-performance Stream Processing Framework. An alternative to Apache Flink.☆454Updated last year
- JSON support for DataFusion (unofficial)☆38Updated 3 weeks ago
- Hybrid in-memory and disk cache in Rust☆814Updated this week
- View parquet files online☆148Updated this week
- Embeddable Aggregate Management System for Streams and Queries.☆90Updated this week
- Rust crate for Substrait: Cross-Language Serialization for Relational Algebra☆65Updated this week
- ☆46Updated this week
- A portable embedded database using Arrow.☆980Updated this week
- Boring Data Tool☆217Updated last year
- This is the companion repository for the book How Query Engines Work.☆386Updated last year
- Fastest and safest Rust implementation of parquet. `unsafe` free. Integration-tested against pyarrow☆359Updated 8 months ago