Apache Spark Connect Client for Rust
☆116Jun 10, 2025Updated 11 months ago
Alternatives and similar repositories for spark-connect-rs
Users that are interested in spark-connect-rs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Apache Spark Connect for Rust☆32Updated this week
- Unofficial rust implementation of Apache Iceberg with integration for Datafusion☆235Updated this week
- Apache DataFusion Comet Spark Accelerator☆1,194May 21, 2026Updated last week
- Open, Multi-modal Catalog for Data & AI, written in Rust☆84Sep 30, 2024Updated last year
- Apache DataFusion Ballista Distributed Query Engine☆2,039Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Apache Iceberg☆1,302Updated this week
- Apache DataFusion Ray☆230May 15, 2026Updated 2 weeks ago
- TPC-H benchmark data generation in pure Rust☆241Updated this week
- Apache DataFusion Python Bindings☆583Updated this week
- The Auron accelerator for distributed computing framework (e.g., Spark) leverages native vectorized execution to accelerate query process…☆1,766Updated this week
- DataFusion TableProviders for reading data from other systems☆190May 22, 2026Updated last week
- ☆23Jan 23, 2022Updated 4 years ago
- A collection of RBIR projects and posts for anyone interested in joining this journey.☆324Updated this week
- Apache Spark Connect Client for Golang☆252May 15, 2026Updated 2 weeks ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A minimal Python library for Apache Arrow, connecting to the Rust Arrow crate☆260Mar 24, 2026Updated 2 months ago
- A native Delta implementation for integration with any query engine☆330May 22, 2026Updated last week
- A highly efficient daemon for streaming data from Kafka into Delta Lake☆435May 5, 2025Updated last year
- Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.☆2,764Updated this week
- A native Rust library for Delta Lake, with bindings into Python☆3,225Updated this week
- Apache Paimon Rust The rust implementation of Apache Paimon.☆171May 21, 2026Updated last week
- Lakekeeper is an Apache-Licensed, secure, fast and easy to use Apache Iceberg REST Catalog written in Rust.☆1,306Updated this week
- A write-audit-publish implementation on a data lake without the JVM☆45Aug 12, 2024Updated last year
- The native Rust implementation for Apache Hudi, with C++ & Python API bindings.☆275May 22, 2026Updated last week
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Rust based high-performance Apache Uniffle shuffle-server☆65Apr 24, 2026Updated last month
- Learn about Spice.ai with in-depth samples☆19Dec 19, 2024Updated last year
- ✨ A Pydantic to PySpark schema library☆124May 20, 2026Updated last week
- Simple and convenient API for File System access☆21May 5, 2026Updated 3 weeks ago
- Official Rust implementation of Apache Arrow☆3,471May 22, 2026Updated last week
- ☆19Jul 8, 2024Updated last year
- Allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.☆182Apr 20, 2026Updated last month
- Batteries included CLI, TUI, and server implementations for DataFusion.☆194Apr 14, 2026Updated last month
- Collection of AWS Lambdas for creating and managing Delta tables☆57Apr 23, 2026Updated last month
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A Rust-native DuckLake engine built on Apache DataFusion☆129Updated this week
- ☆33May 9, 2025Updated last year
- A leightweight UI for Lakekeeper☆17Updated this week
- Rust crate for Substrait: Cross-Language Serialization for Relational Algebra☆86Updated this week
- A Python Library to support running data quality rules while the spark job is running⚡☆202May 19, 2026Updated last week
- (Experimental) Template for Rust-based DuckDB extensions☆107Apr 14, 2026Updated last month
- A flake8 plugin that detects of usage withColumn in a loop or inside reduce☆28Jun 20, 2025Updated 11 months ago