Apache Spark Connect Client for Rust
☆116Jun 10, 2025Updated last year
Alternatives and similar repositories for spark-connect-rs
Users that are interested in spark-connect-rs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Apache Spark Connect for Rust☆35May 26, 2026Updated 2 months ago
- Unofficial rust implementation of Apache Iceberg with integration for Datafusion☆241Updated this week
- An example for using the Rust language to write Spark UDFs☆13Jun 22, 2021Updated 5 years ago
- Apache DataFusion Comet Spark Accelerator☆1,235Updated this week
- Open, Multi-modal Catalog for Data & AI, written in Rust☆86Sep 30, 2024Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Apache DataFusion Ballista Distributed Query Engine☆2,096Updated this week
- Apache DataFusion Ray☆230May 15, 2026Updated 2 months ago
- Apache DataFusion Python Bindings☆594Updated this week
- The Auron accelerator for distributed computing framework (e.g., Spark) leverages native vectorized execution to accelerate query process…☆1,780Updated this week
- ☆23Jan 23, 2022Updated 4 years ago
- Apache Iceberg☆1,363Updated this week
- A collection of RBIR projects and posts for anyone interested in joining this journey.☆327Updated this week
- DataFusion TableProviders for reading data from other systems☆203Updated this week
- A minimal Python library for Apache Arrow, connecting to the Rust Arrow crate☆264Jun 15, 2026Updated last month
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Apache Spark Connect Client for Golang☆252May 15, 2026Updated 2 months ago
- ☆26Feb 22, 2026Updated 5 months ago
- A highly efficient daemon for streaming data from Kafka into Delta Lake☆440Jun 22, 2026Updated last month
- A native Rust library for Delta Lake, with bindings into Python☆3,274Updated this week
- A software library of stochastic streaming algorithms, a.k.a. sketches.☆108Updated this week
- Apache Paimon Rust The rust implementation of Apache Paimon.☆187Updated this week
- A write-audit-publish implementation on a data lake without the JVM☆45Aug 12, 2024Updated last year
- The native Rust implementation for Apache Hudi, with C++ & Python API bindings.☆278Jun 26, 2026Updated last month
- TPC-H benchmark data generation in pure Rust☆253Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A native Delta implementation for integration with any query engine☆353Updated this week
- Learn about Spice.ai with in-depth samples☆19Dec 19, 2024Updated last year
- Lakekeeper is an Apache-Licensed, secure, fast and easy to use Apache Iceberg REST Catalog written in Rust.☆1,400Updated this week
- Allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.☆185Jul 2, 2026Updated 3 weeks ago
- ✨ A Pydantic to PySpark schema library☆129Updated this week
- Library for bringing distributed capabilities to Apache DataFusion☆123Updated this week
- Simple and convenient API for File System access☆21Jul 7, 2026Updated 3 weeks ago
- The goal of this library is to provide a compatibility layer that makes it easier to adopt Spark Connect. The library is designed to be s…☆18Nov 25, 2024Updated last year
- Official Rust implementation of Apache Arrow☆3,553Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Collection of AWS Lambdas for creating and managing Delta tables☆58Updated this week
- Batteries included CLI, TUI, and server implementations for DataFusion.☆199Jul 13, 2026Updated 2 weeks ago
- ☆19Jul 8, 2024Updated 2 years ago
- Pushdown cache for DataFusion☆418Jun 13, 2026Updated last month
- (Experimental) Template for Rust-based DuckDB extensions☆111Jul 23, 2026Updated last week
- ☆34May 9, 2025Updated last year
- Rust crate for Substrait: Cross-Language Serialization for Relational Algebra☆90Updated this week