Alternatives and similar repositories for spark-submit

Users that are interested in spark-submit are comparing it to the libraries listed below

• Nike-Inc / brickflow
  Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
  ☆222Updated 3 weeks ago
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆193Updated this week
• MrPowers / mack
  Delta Lake helper methods in PySpark
  ☆325Updated last year
• great-expectations / airflow-provider-great-expectations
  Great Expectations Airflow operator
  ☆169Updated 3 weeks ago
• MrPowers / chispa
  PySpark test helper methods with beautiful error messages
  ☆743Updated 2 weeks ago
• rafaelpierre / pyjaws
  PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows
  ☆45Updated 2 weeks ago
• sfu-db / lineagex
  ☆81Updated 10 months ago
• trinodb / trino-python-client
  Python client for Trino
  ☆408Updated 3 months ago
• eakmanrq / sqlframe
  Turning PySpark Into a Universal DataFrame API
  ☆469Updated 2 weeks ago
• mitchelllisle / sparkdantic
  ✨ A Pydantic to PySpark schema library
  ☆115Updated last week
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆232Updated 2 weeks ago
• delta-io / delta-examples
  Delta Lake examples
  ☆235Updated last year
• astronomer / astro-sdk
  Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.
  ☆377Updated 7 months ago
• dataflint / spark
  Drop-in replacement for Apache Spark UI
  ☆376Updated last month
• mrpowers-io / levi
  Delta Lake helper methods. No Spark dependency.
  ☆23Updated last year
• 1ambda / lakehouse
  Playground for Lakehouse (Iceberg, Hudi, Spark, Flink, Trino, DBT, Airflow, Kafka, Debezium CDC)
  ☆64Updated 2 years ago
• tomasfarias / airflow-dbt-python
  A collection of Airflow operators, hooks, and utilities to elevate dbt to a first-class citizen of Airflow.
  ☆208Updated this week
• adidas / lakehouse-engine
  The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for sever…
  ☆279Updated 2 months ago
• awslabs / python-deequ
  Python API for Deequ
  ☆808Updated 9 months ago
• gmyrianthous / dbt-airflow
  A Python package that creates fine-grained dbt tasks on Apache Airflow
  ☆80Updated last week
• dbt-labs / dbt-spark
  This repository has moved into https://github.com/dbt-labs/dbt-adapters
  ☆444Updated 5 months ago
• pipeline-tools / gusty
  Making DAG construction easier
  ☆283Updated 2 weeks ago
• andreax79 / airflow-code-editor
  A plugin for Apache Airflow that allows you to edit DAGs in browser
  ☆455Updated last month
• hussein-awala / spark-on-k8s
  A Python package to submit and manage Apache Spark applications on Kubernetes.
  ☆46Updated 4 months ago
• gocardless / airflow-dbt
  Apache Airflow integration for dbt
  ☆412Updated last year
• mrpowers-io / quinn
  pyspark methods to enhance developer productivity 📣 👯 🎉
  ☆682Updated 9 months ago
• canimus / cuallee
  Possibly the fastest DataFrame-agnostic quality check library in town.
  ☆233Updated 2 months ago
• castor-team / airflow-castor
  ☆42Updated 4 years ago
• memiiso / opendbt
  Make dbt great again! Extend dbt with plugins, local docs and custom adapters — fast, safe, and developer-friendly
  ☆268Updated 3 weeks ago
• godatadriven / pydantic-spark
  ☆26Updated last year