Alternatives and similar repositories for spark

Users that are interested in spark are comparing it to the libraries listed below

• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆232Updated this week
• cerndb / spark-dashboard
  Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an A…
  ☆131Updated 2 weeks ago
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆194Updated last week
• datamechanics / delight
  A Spark UI and Spark History Server alternative with CPU and Memory metrics! Delight is free, cross-platform, and open-source.
  ☆346Updated last year
• memiiso / debezium-server-iceberg
  Low Cost, Simple and Scalable Way of Data Replication to Apache Iceberg/Cloud/Data Lake
  ☆293Updated this week
• bitsondatadev / trino-getting-started
  ☆269Updated last year
• starburstdata / dbt-trino
  The Trino (https://trino.io/) adapter plugin for dbt (https://getdbt.com)
  ☆253Updated this week
• trinodb / trino-gateway
  ☆240Updated this week
• LucaCanali / sparkMeasure
  This is the development repository for sparkMeasure, a tool and library designed for efficient analysis and troubleshooting of Apache Spa…
  ☆808Updated last week
• projectnessie / iceberg-catalog-migrator
  CLI tool to bulk migrate the tables from one catalog another without a data copy
  ☆83Updated 9 months ago
• exacaster / lighter
  REST API for Apache Spark on K8S or YARN
  ☆109Updated last month
• linkedin / openhouse
  Open Control Plane for Tables in Data Lakehouse
  ☆377Updated this week
• apache / spark-kubernetes-operator
  Apache Spark Kubernetes Operator
  ☆250Updated this week
• snowlift / trino-storage
  Storage connector for Trino
  ☆117Updated 3 weeks ago
• delta-io / kafka-delta-ingest
  A highly efficient daemon for streaming data from Kafka into Delta Lake
  ☆426Updated 8 months ago
• getindata / dbt-flink-adapter
  Adapter for dbt that executes dbt pipelines on Apache Flink
  ☆96Updated last year
• varadaio / presto-workload-analyzer
  The Workload Analyzer collects Presto® and Trino workload statistics, and analyzes them
  ☆136Updated 2 years ago
• Qbeast-io / qbeast-spark
  Qbeast-spark: DataSource enabling multi-dimensional indexing and efficient data sampling. Big Data, free from the unnecessary!
  ☆235Updated 11 months ago
• naushadh / hive-metastore
  Apache Hive Metastore as a Standalone server in Docker
  ☆79Updated last year
• YotpoLtd / metorikku
  A simplified, lightweight ETL Framework based on Apache Spark
  ☆588Updated last year
• projectnessie / nessie
  Nessie: Transactional Catalog for Data Lakes with Git-like semantics
  ☆1,395Updated last week
• apache / datafusion-comet
  Apache DataFusion Comet Spark Accelerator
  ☆1,105Updated this week
• getindata / kafka-connect-iceberg-sink
  ☆81Updated 8 months ago
• mrpowers-io / spark-style-guide
  Spark style guide
  ☆271Updated last year
• MrPowers / mack
  Delta Lake helper methods in PySpark
  ☆326Updated last year
• SETL-Framework / setl
  A simple Spark-powered ETL framework that just works 🍺
  ☆182Updated 3 months ago
• AbsaOSS / ABRiS
  Avro SerDe for Apache Spark structured APIs.
  ☆240Updated 7 months ago
• lakekeeper / lakekeeper
  Lakekeeper is an Apache-Licensed, secure, fast and easy to use Apache Iceberg REST Catalog written in Rust.
  ☆1,141Updated last week
• dbt-labs / dbt-spark
  This repository has moved into https://github.com/dbt-labs/dbt-adapters
  ☆443Updated 6 months ago
• kubeflow / mcp-apache-spark-history-server
  MCP Server for Apache Spark History Server. The bridge between Agentic AI and Apache Spark.
  ☆119Updated 3 weeks ago