Alternatives and similar repositories for spark

Users that are interested in spark are comparing it to the libraries listed below

• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆226Updated 3 months ago
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆188Updated last week
• cerndb / spark-dashboard
  Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an A…
  ☆125Updated last month
• mrpowers-io / spark-style-guide
  Spark style guide
  ☆259Updated 8 months ago
• MrPowers / mack
  Delta Lake helper methods in PySpark
  ☆326Updated 9 months ago
• starburstdata / dbt-trino
  The Trino (https://trino.io/) adapter plugin for dbt (https://getdbt.com)
  ☆238Updated 2 weeks ago
• apache / spark-kubernetes-operator
  Apache Spark Kubernetes Operator
  ☆177Updated this week
• Nike-Inc / brickflow
  Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
  ☆218Updated last week
• datamechanics / delight
  A Spark UI and Spark History Server alternative with CPU and Memory metrics! Delight is free, cross-platform, and open-source.
  ☆344Updated last year
• YotpoLtd / metorikku
  A simplified, lightweight ETL Framework based on Apache Spark
  ☆586Updated last year
• memiiso / debezium-server-iceberg
  Low Cost, Simple and Scalable Way of Data Replication to Apache Iceberg/Cloud/Data Lake
  ☆265Updated this week
• allisonwang-db / pyspark-data-sources
  Custom PySpark Data Sources
  ☆56Updated 2 weeks ago
• delta-io / kafka-delta-ingest
  A highly efficient daemon for streaming data from Kafka into Delta Lake
  ☆407Updated last month
• trinodb / trino-gateway
  ☆208Updated this week
• varadaio / presto-workload-analyzer
  The Workload Analyzer collects Presto® and Trino workload statistics, and analyzes them
  ☆135Updated last year
• sodadata / soda-spark
  Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes
  ☆64Updated 3 years ago
• adidas / lakehouse-engine
  The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for sever…
  ☆254Updated 4 months ago
• bitsondatadev / trino-getting-started
  ☆265Updated 8 months ago
• trinodb / charts
  Helm charts for Trino and Trino Gateway
  ☆170Updated last week
• dbt-labs / dbt-spark
  dbt-spark contains all of the code enabling dbt to work with Apache Spark and Databricks
  ☆433Updated 4 months ago
• LucaCanali / sparkMeasure
  This is the development repository for sparkMeasure, a tool and library designed for efficient analysis and troubleshooting of Apache Spa…
  ☆764Updated 2 weeks ago
• eakmanrq / sqlframe
  Turning PySpark Into a Universal DataFrame API
  ☆408Updated last week
• projectnessie / iceberg-catalog-migrator
  CLI tool to bulk migrate the tables from one catalog another without a data copy
  ☆79Updated 2 months ago
• linkedin / openhouse
  Open Control Plane for Tables in Data Lakehouse
  ☆355Updated this week
• snowlift / trino-storage
  Storage connector for Trino
  ☆112Updated 2 weeks ago
• AbsaOSS / spline-spark-agent
  Spline agent for Apache Spark
  ☆194Updated this week
• snowflakedb / spark-snowflake
  Snowflake Data Source for Apache Spark.
  ☆226Updated last week
• mrpowers-io / jodie
  Delta lake and filesystem helper methods
  ☆51Updated last year
• acryldata / datahub-helm
  Repository of helm charts for deploying DataHub on a Kubernetes cluster
  ☆190Updated last week
• quintoandar / hive-metastore-client
  A client for connecting and running DDLs on hive metastore.
  ☆55Updated last year