Apache Spark Connect Client for Rust
☆116Jun 10, 2025Updated last year
Alternatives and similar repositories for spark-connect-rs
Users that are interested in spark-connect-rs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Apache Spark Connect for Rust☆36May 26, 2026Updated 2 months ago
- Unofficial rust implementation of Apache Iceberg with integration for Datafusion☆245Updated this week
- An example for using the Rust language to write Spark UDFs☆13Jun 22, 2021Updated 5 years ago
- Apache DataFusion Comet Spark Accelerator☆1,251Updated this week
- Open, Multi-modal Catalog for Data & AI, written in Rust☆87Sep 30, 2024Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Apache DataFusion Ballista Distributed Query Engine☆2,112Updated this week
- Apache DataFusion Ray☆230May 15, 2026Updated 3 months ago
- Apache DataFusion Python Bindings☆596Updated this week
- The Auron accelerator for distributed computing framework (e.g., Spark) leverages native vectorized execution to accelerate query process…☆1,792Updated this week
- ☆23Jan 23, 2022Updated 4 years ago
- Apache Iceberg☆1,381Updated this week
- A collection of RBIR projects and posts for anyone interested in joining this journey.☆327Updated this week
- DataFusion TableProviders for reading data from other systems☆204Updated this week
- A minimal Python library for Apache Arrow, connecting to the Rust Arrow crate☆264Jun 15, 2026Updated 2 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Apache Spark Connect Client for Golang☆251May 15, 2026Updated 3 months ago
- ☆26Feb 22, 2026Updated 5 months ago
- A highly efficient daemon for streaming data from Kafka into Delta Lake☆441Jun 22, 2026Updated last month
- A native Rust library for Delta Lake, with bindings into Python☆3,284Updated this week
- A software library of stochastic streaming algorithms, a.k.a. sketches.☆113Updated this week
- Apache Paimon Rust The rust implementation of Apache Paimon.☆191Updated this week
- A write-audit-publish implementation on a data lake without the JVM☆45Aug 12, 2024Updated 2 years ago
- The native Rust implementation for Apache Hudi, with C++ & Python API bindings.☆280Updated this week
- TPC-H benchmark data generation in pure Rust☆254Aug 10, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A native Delta implementation for integration with any query engine☆354Updated this week
- Learn about Spice.ai with in-depth samples☆19Dec 19, 2024Updated last year
- Apache Iceberg REST Catalog in Rust — access control, credential vending and audit for every engine and AI agent. Apache 2.0.☆1,421Updated this week
- Allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.☆192Jul 2, 2026Updated last month
- ✨ A Pydantic to PySpark schema library☆130Updated this week
- Library for bringing distributed capabilities to Apache DataFusion☆126Updated this week
- RAPIDS Accelerator JNI For Apache Spark☆63Updated this week
- The goal of this library is to provide a compatibility layer that makes it easier to adopt Spark Connect. The library is designed to be s…☆18Nov 25, 2024Updated last year
- Official Rust implementation of Apache Arrow☆3,584Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Collection of AWS Lambdas for creating and managing Delta tables☆58Updated this week
- Batteries included CLI, TUI, and server implementations for DataFusion.☆200Updated this week
- ☆19Jul 8, 2024Updated 2 years ago
- Pushdown cache for DataFusion☆421Jun 13, 2026Updated 2 months ago
- (Experimental) Template for Rust-based DuckDB extensions☆112Jul 23, 2026Updated 3 weeks ago
- Rust crate for Substrait: Cross-Language Serialization for Relational Algebra☆90Aug 11, 2026Updated last week
- A flake8 plugin that detects of usage withColumn in a loop or inside reduce☆28Jun 20, 2025Updated last year