Apache Spark Connect Client for Rust
☆117Jun 10, 2025Updated 8 months ago
Alternatives and similar repositories for spark-connect-rs
Users that are interested in spark-connect-rs are comparing it to the libraries listed below
Sorting:
- Apache Spark Connect for Rust☆28Feb 13, 2026Updated 3 weeks ago
- An example for using the Rust language to write Spark UDFs☆13Jun 22, 2021Updated 4 years ago
- Unofficial rust implementation of Apache Iceberg with integration for Datafusion☆233Feb 27, 2026Updated last week
- Open, Multi-modal Catalog for Data & AI, written in Rust☆86Sep 30, 2024Updated last year
- Apache DataFusion Comet Spark Accelerator☆1,150Updated this week
- Apache Iceberg☆1,234Updated this week
- Apache DataFusion Ballista Distributed Query Engine☆1,984Mar 2, 2026Updated last week
- DataFusion TableProviders for reading data from other systems☆172Updated this week
- Apache DataFusion Ray☆228Oct 5, 2025Updated 5 months ago
- A leightweight UI for Lakekeeper☆16Mar 2, 2026Updated last week
- Helm chart for Lakekeeper - a Rust Native Iceberg REST Catalog☆23Feb 26, 2026Updated last week
- ☆23Jan 23, 2022Updated 4 years ago
- The Auron accelerator for distributed computing framework (e.g., Spark) leverages native vectorized execution to accelerate query process…☆1,719Updated this week
- A highly efficient daemon for streaming data from Kafka into Delta Lake☆428May 5, 2025Updated 10 months ago
- TPC-H benchmark data generation in pure Rust☆233Mar 2, 2026Updated last week
- A minimal Python library for Apache Arrow, connecting to the Rust Arrow crate☆254Mar 2, 2026Updated last week
- A native Delta implementation for integration with any query engine☆319Updated this week
- A native Rust library for Delta Lake, with bindings into Python☆3,160Mar 2, 2026Updated last week
- Lakekeeper is an Apache-Licensed, secure, fast and easy to use Apache Iceberg REST Catalog written in Rust.☆1,210Updated this week
- LakeSail's computation framework with a mission to unify batch processing, stream processing, and compute-intensive AI workloads.☆1,181Updated this week
- Collection of AWS Lambdas for creating and managing Delta tables☆57Updated this week
- Apache Paimon Rust The rust implementation of Apache Paimon.☆146Updated this week
- Apache DataFusion Python Bindings☆565Updated this week
- The native Rust implementation for Apache Hudi, with C++ & Python API bindings.☆269Updated this week
- ✨ A Pydantic to PySpark schema library☆121Updated this week
- Web Framework accelerates the development process with its flexibility & speed of use. Written as a library in C language. You can custom…☆15Dec 30, 2025Updated 2 months ago
- A collection of RBIR projects and posts for anyone interested in joining this journey.☆316Updated this week
- Apache Spark Connect Client for Golang☆248Oct 13, 2025Updated 4 months ago
- Batteries included CLI, TUI, and server implementations for DataFusion.☆191Feb 23, 2026Updated 2 weeks ago
- Rust SDK for Apache Avro - a data serialization system.☆110Updated this week
- ☆23May 2, 2024Updated last year
- Utility functions for dbt projects running on Athena☆12Mar 25, 2025Updated 11 months ago
- Rust based high-performance Apache Uniffle shuffle-server☆62Feb 28, 2026Updated last week
- A write-audit-publish implementation on a data lake without the JVM☆45Aug 12, 2024Updated last year
- Unofficial Rust bindings for LightGBM☆11Updated this week
- This repo demonstrates an Apache Arrow Flight server implementation in Kubernetes.☆12Oct 25, 2024Updated last year
- ☆17Nov 25, 2024Updated last year
- Allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.☆172Updated this week
- spark connector for Milvus☆15Jan 19, 2026Updated last month