Drop-in replacement for Apache Spark UI
☆498Oct 19, 2026Updated last week
Alternatives and similar repositories for spark
Users that are interested in spark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This repository contains the development code for sparkMeasure, an Apache Spark performance analysis and troubleshooting library. It simp…☆832Oct 16, 2026Updated 2 weeks ago
- MCP Server and CLI for Apache Spark History Server. Debug Spark applications from AI agents, scripts, or the terminal.☆206Oct 20, 2026Updated last week
- Apache Spark Kubernetes Operator☆324Oct 24, 2026Updated last week
- Apache DataFusion Comet Spark Accelerator☆1,306Updated this week
- Spark-Dashboard is an open-source monitoring solution for Apache Spark that provides real-time performance dashboards using containers an…☆141Sep 18, 2026Updated last month
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Apache Spark Connect Gateway☆14Oct 23, 2026Updated last week
- A library that provides useful extensions to Apache Spark and PySpark.☆241Sep 10, 2026Updated last month
- Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.☆1,078Updated this week
- Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.☆1,613Updated this week
- Apache Auron is an accelerator for big data engines, leveraging native vectorized execution to accelerate query processing.☆1,838Updated this week
- Apache Iceberg REST Catalog in Rust — access control, credential vending and audit for every engine and AI agent. Apache 2.0.☆1,493Updated this week
- A flake8 plugin that detects of usage withColumn in a loop or inside reduce☆29Jun 20, 2025Updated last year
- Apache XTable (incubating) is a cross-table converter for lakehouse table formats that facilitates interoperability across data processin…☆1,314Updated this week
- Uniffle is a high performance, general purpose Remote Shuffle Service.☆455Oct 20, 2026Updated last week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Qubole Sparklens tool for performance tuning Apache Spark☆593Jun 26, 2024Updated 2 years ago
- Open, Multi-modal Catalog for Data & AI☆3,566Updated this week
- Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.☆2,372Updated this week
- Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.☆3,480Updated this week
- PySpark test helper methods with beautiful error messages☆777Updated this week
- Full-stack OpenTelemetry observability for Apache Spark☆20Oct 12, 2026Updated 2 weeks ago
- Apache Polaris, the interoperable, open source catalog for Apache Iceberg☆2,102Updated this week
- A Python Library to support running data quality rules while the spark job is running⚡☆203Oct 7, 2026Updated 3 weeks ago
- The observability platform for Iceberg lakehouses.☆483Jan 12, 2026Updated 9 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Kubernetes operator for managing the lifecycle of Apache Spark applications on Kubernetes.☆3,155Oct 23, 2026Updated last week
- Community Grafana datasource for Databricks - visualize costs, jobs and SDP pipelines in your dashboards.☆19Nov 7, 2025Updated 11 months ago
- Python API for Deequ☆828Oct 24, 2026Updated last week
- Open Control Plane for Tables in Data Lakehouse☆402Updated this week
- Delta Lake helper methods. No Spark dependency.☆21Jan 19, 2026Updated 9 months ago
- This project provides a reverse proxy for Spark UI on Kubernetes☆16Oct 12, 2023Updated 3 years ago
- ☆16Jul 25, 2025Updated last year
- A Python Client for Hive Metastore☆14Nov 4, 2025Updated 11 months ago
- A tool to benchmark L (loading) workloads within ETL workloads☆35Aug 24, 2026Updated 2 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Nessie: Transactional Catalog for Data Lakes with Git-like semantics☆1,525Updated this week
- ☆268Updated this week
- Apache Iceberg☆9,389Updated this week
- A multi-modal Python library for benchmarking lakehouse engines and ELT scenarios, supporting both industry-standard and novel benchmarks…☆56Oct 14, 2026Updated 2 weeks ago
- Turning PySpark Into a Universal DataFrame API☆542Updated this week
- Low Cost, Simple and Scalable Way of Data Replication to Apache Iceberg/Cloud/Data Lake☆333Updated this week
- Traditionally, engineers were needed to implement business logic via data pipelines before business users can start using it. Using this …☆12Oct 22, 2026Updated last week