rewrite-bigdata-in-rust / RBIR
A collection of RBIR projects and posts for anyone interested in joining this journey.
☆174Updated this week
Related projects ⓘ
Alternatives and complementary repositories for RBIR
- Pure Rust Iceberg Implementation☆166Updated 3 months ago
- Apache DataFusion Ray☆116Updated this week
- Apache Paimon Rust The rust implementation of Apache Paimon.☆100Updated last month
- Allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.☆77Updated this week
- Rust implementation of Apache Iceberg with integration for Datafusion☆107Updated this week
- Message queue and data streaming based on cloud native services.☆77Updated this week
- A User-Defined Function Framework for Apache Arrow.☆77Updated this week
- Learn Data Lake From Storage Layer.☆46Updated 3 months ago
- Embeddable Aggregate Management System for Streams and Queries.☆83Updated 2 weeks ago
- A native Delta implementation for integration with any query engine☆144Updated this week
- Apache Iceberg☆658Updated this week
- A native Rust library for Apache Hudi, with bindings into Python☆146Updated this week
- CMU-DB's Cascades optimizer framework☆373Updated this week
- An opinionated and batteries included DataFusion implementation.☆114Updated this week
- DataFusion TableProviders for reading data from other systems☆61Updated this week
- A native storage format for apache arrow☆81Updated last year
- AnyBlob - A Universal Cloud Object Storage Download Manager Built For Cost-Throughput Optimal Analytics!☆104Updated last month
- ☆33Updated last year
- A collection of demonstrations showcasing how stream processing can be used to solve real-world problems.☆70Updated last week
- Boring Data Tool☆209Updated 7 months ago
- Sqllogictest (dialect with extensions) parser and runner in Rust.☆176Updated this week
- Rust crate for Substrait: Cross-Language Serialization for Relational Algebra☆58Updated this week
- ☆31Updated this week
- Experimental support for serializing DataFusion plans using substrait☆44Updated last year
- An understandable, fast and scalable Raft Consensus implementation☆129Updated 2 months ago
- This is the companion repository for the book How Query Engines Work.☆373Updated last year
- Fastest and safest Rust implementation of parquet. `unsafe` free. Integration-tested against pyarrow☆356Updated 3 months ago
- Fusio provides file operations on multiple storages across various async runtimes.☆196Updated this week
- JSON support for DataFusion (unofficial)☆29Updated last week
- OmniPaxos is a distributed log implemented as a Rust library.☆191Updated this week