Apache Spark Connect Client for Rust
☆116Jun 10, 2025Updated last year
Alternatives and similar repositories for spark-connect-rs
Users that are interested in spark-connect-rs are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Apache Spark Connect Client for Rust (Rust core + Python wrapper)☆47Sep 11, 2026Updated last month
- Unofficial rust implementation of Apache Iceberg with integration for Datafusion☆248Oct 7, 2026Updated last week
- An example for using the Rust language to write Spark UDFs☆13Jun 22, 2021Updated 5 years ago
- Apache DataFusion Comet Spark Accelerator☆1,290Updated this week
- Open, Multi-modal Catalog for Data & AI, written in Rust☆89Sep 30, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Apache DataFusion Ballista Distributed Query Engine☆2,150Updated this week
- Apache DataFusion Ray☆231May 15, 2026Updated 5 months ago
- Apache DataFusion Python Bindings☆610Updated this week
- Apache Auron is an accelerator for big data engines, leveraging native vectorized execution to accelerate query processing.☆1,825Updated this week
- ☆23Jan 23, 2022Updated 4 years ago
- Apache Iceberg☆1,427Updated this week
- DataFusion TableProviders for reading data from other systems☆213Updated this week
- A collection of RBIR projects and posts for anyone interested in joining this journey.☆332Updated this week
- A minimal Python library for Apache Arrow, connecting to the Rust Arrow crate☆266Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Apache Spark Connect Client for Golang☆251May 15, 2026Updated 5 months ago
- A highly efficient daemon for streaming data from Kafka into Delta Lake☆447Updated this week
- Apache Paimon Rust The rust implementation of Apache Paimon.☆200Updated this week
- A native Rust library for Delta Lake, with bindings into Python☆3,343Updated this week
- A write-audit-publish implementation on a data lake without the JVM☆45Aug 12, 2024Updated 2 years ago
- ☆26Oct 3, 2026Updated 2 weeks ago
- A software library of stochastic streaming algorithms, a.k.a. sketches.☆133Oct 8, 2026Updated last week
- TPC-H benchmark data generation in pure Rust☆261Updated this week
- The native Rust implementation for Apache Hudi, with C++ & Python API bindings.☆280Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A native Delta implementation for integration with any query engine☆368Updated this week
- Apache Iceberg REST Catalog in Rust — access control, credential vending and audit for every engine and AI agent. Apache 2.0.☆1,482Updated this week
- Allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.☆199Sep 22, 2026Updated 3 weeks ago
- Official Rust implementation of Apache Arrow☆3,640Updated this week
- ✨ A Pydantic to PySpark schema library☆133Updated this week
- The goal of this library is to provide a compatibility layer that makes it easier to adopt Spark Connect. The library is designed to be s…☆19Nov 25, 2024Updated last year
- Library for bringing distributed capabilities to Apache DataFusion☆163Updated this week
- NVIDIA cuDF plugin JNI For Apache Spark☆65Updated this week
- Simple and convenient API for File System access☆22Aug 21, 2026Updated last month
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- (Experimental) Template for Rust-based DuckDB extensions☆115Oct 2, 2026Updated 2 weeks ago
- Collection of AWS Lambdas for creating and managing Delta tables☆58Oct 10, 2026Updated last week
- ☆19Jul 8, 2024Updated 2 years ago
- Batteries included CLI, TUI, and server implementations for DataFusion.☆203Sep 30, 2026Updated 2 weeks ago
- Pushdown cache for DataFusion☆460Updated this week
- ☆34May 9, 2025Updated last year
- A flake8 plugin that detects of usage withColumn in a loop or inside reduce☆29Jun 20, 2025Updated last year