Apache Spark Connect Client for Rust
☆116Jun 10, 2025Updated last year
Alternatives and similar repositories for spark-connect-rs
Users that are interested in spark-connect-rs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Apache Spark Connect Client for Rust (Rust core + Python wrapper)☆45Sep 11, 2026Updated 2 weeks ago
- Unofficial rust implementation of Apache Iceberg with integration for Datafusion☆247Updated this week
- An example for using the Rust language to write Spark UDFs☆13Jun 22, 2021Updated 5 years ago
- Apache DataFusion Comet Spark Accelerator☆1,286Updated this week
- Open, Multi-modal Catalog for Data & AI, written in Rust☆88Sep 30, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Apache DataFusion Ballista Distributed Query Engine☆2,142Updated this week
- Apache DataFusion Ray☆230May 15, 2026Updated 4 months ago
- Apache DataFusion Python Bindings☆606Updated this week
- Apache Auron(Incubating) is an accelerator for big data engines, leveraging native vectorized execution to accelerate query processing.☆1,809Updated this week
- ☆23Jan 23, 2022Updated 4 years ago
- Apache Iceberg☆1,416Updated this week
- A collection of RBIR projects and posts for anyone interested in joining this journey.☆329Updated this week
- DataFusion TableProviders for reading data from other systems☆208Sep 8, 2026Updated 2 weeks ago
- A minimal Python library for Apache Arrow, connecting to the Rust Arrow crate☆265Sep 21, 2026Updated last week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Apache Spark Connect Client for Golang☆251May 15, 2026Updated 4 months ago
- ☆26Feb 22, 2026Updated 7 months ago
- A highly efficient daemon for streaming data from Kafka into Delta Lake☆444Jun 22, 2026Updated 3 months ago
- A native Rust library for Delta Lake, with bindings into Python☆3,321Updated this week
- Apache Paimon Rust The rust implementation of Apache Paimon.☆199Updated this week
- A write-audit-publish implementation on a data lake without the JVM☆45Aug 12, 2024Updated 2 years ago
- A software library of stochastic streaming algorithms, a.k.a. sketches.☆125Updated this week
- The native Rust implementation for Apache Hudi, with C++ & Python API bindings.☆279Updated this week
- TPC-H benchmark data generation in pure Rust☆260Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A native Delta implementation for integration with any query engine☆363Updated this week
- Apache Iceberg REST Catalog in Rust — access control, credential vending and audit for every engine and AI agent. Apache 2.0.☆1,466Updated this week
- Allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.☆196Updated this week
- ✨ A Pydantic to PySpark schema library☆132Updated this week
- Library for bringing distributed capabilities to Apache DataFusion☆139Updated this week
- Simple and convenient API for File System access☆22Aug 21, 2026Updated last month
- The goal of this library is to provide a compatibility layer that makes it easier to adopt Spark Connect. The library is designed to be s…☆19Nov 25, 2024Updated last year
- Official Rust implementation of Apache Arrow☆3,621Updated this week
- Collection of AWS Lambdas for creating and managing Delta tables☆58Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Batteries included CLI, TUI, and server implementations for DataFusion.☆203Sep 17, 2026Updated last week
- ☆19Jul 8, 2024Updated 2 years ago
- (Experimental) Template for Rust-based DuckDB extensions☆115Jul 23, 2026Updated 2 months ago
- Pushdown cache for DataFusion☆456Updated this week
- ☆34May 9, 2025Updated last year
- Rust crate for Substrait: Cross-Language Serialization for Relational Algebra☆92Updated this week
- A flake8 plugin that detects of usage withColumn in a loop or inside reduce☆28Jun 20, 2025Updated last year