rewrite-bigdata-in-rust / RBIRLinks
A collection of RBIR projects and posts for anyone interested in joining this journey.
☆306Updated this week
Alternatives and similar repositories for RBIR
Users that are interested in RBIR are comparing it to the libraries listed below
Sorting:
- Distributed pushdown cache for DataFusion☆377Updated 2 weeks ago
- Pure Rust Iceberg Implementation☆162Updated last year
- Apache Paimon Rust The rust implementation of Apache Paimon.☆141Updated 9 months ago
- The native Rust implementation for Apache Hudi, with C++ & Python API bindings.☆268Updated 2 weeks ago
- Apache DataFusion Ray☆229Updated 4 months ago
- TPC-H benchmark data generation in pure Rust☆226Updated last week
- Unofficial rust implementation of Apache Iceberg with integration for Datafusion☆233Updated this week
- A native Delta implementation for integration with any query engine☆312Updated this week
- DataFusion TableProviders for reading data from other systems☆167Updated last week
- Allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.☆164Updated 3 weeks ago
- Apache Iceberg☆1,213Updated this week
- Message queue and data streaming based on cloud native services.☆116Updated 2 months ago
- Fully Managed, Streaming Ingestion (CDC) into your Lakehouse☆302Updated this week
- CMU-DB's Cascades optimizer framework☆404Updated last year
- This is the companion repository for the book How Query Engines Work.☆424Updated 2 weeks ago
- A User-Defined Function Framework for Apache Arrow.☆111Updated last week
- Distributed SQL Query Engine in Python using Ray☆245Updated last year
- Batteries included CLI, TUI, and server implementations for DataFusion.☆188Updated 2 weeks ago
- ☆70Updated 2 weeks ago
- High-performance Stream Processing Framework. An alternative to Apache Flink.☆474Updated 2 years ago
- Compaction runtime for Apache Iceberg.☆116Updated last week
- Learn Data Lake From Storage Layer.☆44Updated last year
- View parquet files online☆209Updated this week
- Apache Spark Connect Client for Rust☆118Updated 8 months ago
- Quickly view your data☆345Updated this week
- Sqllogictest parser and runner in Rust, with extensions.☆216Updated last month
- Rust based high-performance Apache Uniffle shuffle-server☆60Updated last week
- Incremental view maintenance & query rewriting for materialized views in DataFusion☆68Updated last week
- Boring Data Tool☆240Updated last year
- LakeSail's computation framework with a mission to unify batch processing, stream processing, and compute-intensive AI workloads.☆1,162Updated this week