Apache DataFusion Comet Spark Accelerator
☆1,203Jun 5, 2026Updated this week
Alternatives and similar repositories for datafusion-comet
Users that are interested in datafusion-comet are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The Auron accelerator for distributed computing framework (e.g., Spark) leverages native vectorized execution to accelerate query process…☆1,769Updated this week
- Apache DataFusion Ballista Distributed Query Engine☆2,051Jun 1, 2026Updated last week
- Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.☆1,568Jun 1, 2026Updated last week
- Apache DataFusion SQL Query Engine☆8,856Updated this week
- Apache Iceberg☆1,310Updated this week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Apache DataFusion Ray☆231May 15, 2026Updated 3 weeks ago
- A cross platform way to express data transformation, relational algebra, standardized record expression and plans.☆1,516Updated this week
- Apache DataFusion Python Bindings☆586Updated this week
- Lakekeeper is an Apache-Licensed, secure, fast and easy to use Apache Iceberg REST Catalog written in Rust.☆1,333Updated this week
- A composable and fully extensible C++ execution engine library for data management systems.☆4,147Updated this week
- Official Rust implementation of Apache Arrow☆3,482Updated this week
- Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.☆2,848Updated this week
- Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.☆1,052Updated this week
- Apache Paimon Rust The rust implementation of Apache Paimon.☆175Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Unofficial rust implementation of Apache Iceberg with integration for Datafusion☆236Jun 2, 2026Updated last week
- Apache Polaris, the interoperable, open source catalog for Apache Iceberg☆1,965Updated this week
- Open, Multi-modal Catalog for Data & AI☆3,417Updated this week
- A native Rust library for Delta Lake, with bindings into Python☆3,233Updated this week
- New and extensible file format for storage of large columnar datasets.☆716Updated this week
- Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data ve…☆6,568Jun 2, 2026Updated last week
- Apache Iceberg☆8,938Updated this week
- The native Rust implementation for Apache Hudi, with C++ & Python API bindings.☆275May 29, 2026Updated last week
- Distributed SQL Query Engine in Python using Ray☆245Oct 2, 2024Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale☆5,544Updated this week
- Uniffle is a high performance, general purpose Remote Shuffle Service.☆451May 27, 2026Updated last week
- An extensible, state-of-the-art framework for columnar compression, and the fastest FOSS columnar file format. Formerly at @spiraldb, now…☆2,987Updated this week
- Distributed stream processing engine in Rust☆4,933Updated this week
- Spark RAPIDS plugin - accelerate Apache Spark with GPUs☆976Updated this week
- GlareDB: A light and fast SQL database for analytics☆1,012Nov 14, 2025Updated 6 months ago
- Nessie: Transactional Catalog for Data Lakes with Git-like semantics☆1,463Updated this week
- Apache XTable (incubating) is a cross-table converter for lakehouse table formats that facilitates interoperability across data processin…☆1,193Updated this week
- Event streaming platform for agentic AI. Continuously ingest, transform, and serve event streams in real time, at scale.☆9,065Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- CMU-DB's Cascades optimizer framework☆405Jan 6, 2025Updated last year
- Pure Rust Iceberg Implementation☆163Aug 13, 2024Updated last year
- DataFusion TableProviders for reading data from other systems☆190Updated this week
- Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.☆2,341Jun 2, 2026Updated last week
- An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Tr…☆8,841Updated this week
- Batteries included CLI, TUI, and server implementations for DataFusion.☆197Apr 14, 2026Updated last month
- Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch …☆3,296Updated this week