Apache DataFusion Comet Spark Accelerator
☆1,288Oct 7, 2026Updated this week
Alternatives and similar repositories for datafusion-comet
Users that are interested in datafusion-comet are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Apache Auron is an accelerator for big data engines, leveraging native vectorized execution to accelerate query processing.☆1,810Updated this week
- Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.☆1,602Updated this week
- Apache DataFusion Ballista Distributed Query Engine☆2,144Updated this week
- Apache Iceberg☆1,420Updated this week
- Apache DataFusion SQL Query Engine☆9,412Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Apache Iceberg REST Catalog in Rust — access control, credential vending and audit for every engine and AI agent. Apache 2.0.☆1,475Updated this week
- Apache DataFusion Ray☆231May 15, 2026Updated 4 months ago
- A cross platform way to express data transformation, relational algebra, standardized record expression and plans.☆1,565Updated this week
- Official Rust implementation of Apache Arrow☆3,631Updated this week
- A composable and fully extensible C++ execution engine library for data management systems.☆4,223Updated this week
- Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.☆1,065Sep 15, 2026Updated 3 weeks ago
- Apache DataFusion Python Bindings☆606Updated this week
- An extensible, state-of-the-art framework for columnar compression, and the fastest FOSS columnar file format. Formerly at @spiraldb, now…☆3,248Updated this week
- Unofficial rust implementation of Apache Iceberg with integration for Datafusion☆248Sep 30, 2026Updated last week
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale☆5,791Updated this week
- Apache Polaris, the interoperable, open source catalog for Apache Iceberg☆2,082Updated this week
- A native Rust library for Delta Lake, with bindings into Python☆3,328Updated this week
- Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.☆3,416Updated this week
- Open, Multi-modal Catalog for Data & AI☆3,553Updated this week
- Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data ve…☆7,139Updated this week
- Apache Paimon Rust The rust implementation of Apache Paimon.☆199Updated this week
- Apache Iceberg☆9,305Updated this week
- Pushdown cache for DataFusion☆458Sep 25, 2026Updated last week
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- The native Rust implementation for Apache Hudi, with C++ & Python API bindings.☆279Updated this week
- Apache Spark Kubernetes Operator☆323Updated this week
- Uniffle is a high performance, general purpose Remote Shuffle Service.☆454Sep 24, 2026Updated 2 weeks ago
- New and extensible file format for storage of large columnar datasets.☆740Sep 21, 2026Updated 2 weeks ago
- NVIDIA cuDF for Apache Spark plugin - accelerate Apache Spark with GPUs☆1,008Updated this week
- Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.☆2,367Updated this week
- Distributed stream processing engine in Rust☆5,048Updated this week
- DataFusion TableProviders for reading data from other systems☆209Updated this week
- Distributed SQL Query Engine in Python using Ray☆245Oct 2, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- TPC-H benchmark data generation in pure Rust☆261Updated this week
- GlareDB: A light and fast SQL database for analytics☆1,023Nov 14, 2025Updated 10 months ago
- Apache Fluss is a streaming storage built for real-time analytics.☆2,194Updated this week
- Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.☆9,360Updated this week
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…☆9,040Updated this week
- CMU-DB's Cascades optimizer framework☆406Jan 6, 2025Updated last year
- Nessie: Transactional Catalog for Data Lakes with Git-like semantics☆1,519Updated this week