Alternatives and similar repositories for spark-submit

Users that are interested in spark-submit are comparing it to the libraries listed below

• eakmanrq / sqlframe
  Turning PySpark Into a Universal DataFrame API
  ☆485Updated this week
• trinodb / trino-python-client
  Python client for Trino
  ☆411Updated 5 months ago
• Nike-Inc / brickflow
  Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
  ☆226Updated last week
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆197Updated last week
• mitchelllisle / sparkdantic
  ✨ A Pydantic to PySpark schema library
  ☆118Updated this week
• pipeline-tools / gusty
  Making DAG construction easier
  ☆283Updated last month
• MrPowers / chispa
  PySpark test helper methods with beautiful error messages
  ☆752Updated 3 weeks ago
• tomasfarias / airflow-dbt-python
  A collection of Airflow operators, hooks, and utilities to elevate dbt to a first-class citizen of Airflow.
  ☆211Updated last month
• great-expectations / airflow-provider-great-expectations
  Great Expectations Airflow operator
  ☆170Updated last week
• MrPowers / mack
  Delta Lake helper methods in PySpark
  ☆327Updated 3 weeks ago
• conveyordata / data-product-portal
  Data Product Portal created by Dataminded
  ☆198Updated this week
• gmyrianthous / dbt-airflow
  A Python package that creates fine-grained dbt tasks on Apache Airflow
  ☆82Updated 2 weeks ago
• memiiso / opendbt
  Make dbt great again! Extend dbt with plugins, local docs and custom adapters — fast, safe, and developer-friendly
  ☆279Updated last week
• yu-iskw / dbt-artifacts-parser
  A dbt artifacts parser in python
  ☆111Updated this week
• awslabs / python-deequ
  Python API for Deequ
  ☆810Updated 2 weeks ago
• PicnicSupermarket / dbt-score
  Linter for dbt metadata
  ☆206Updated last month
• kaxil / airflowctl
  A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects
  ☆225Updated 9 months ago
• sfu-db / lineagex
  ☆81Updated 11 months ago
• castor-team / airflow-castor
  ☆42Updated 4 years ago
• dataflint / spark
  Drop-in replacement for Apache Spark UI
  ☆401Updated this week
• starburstdata / dbt-trino
  The Trino (https://trino.io/) adapter plugin for dbt (https://getdbt.com)
  ☆253Updated 3 weeks ago
• astronomer / astronomer-providers
  Airflow Providers containing Deferrable Operators & Sensors from Astronomer
  ☆149Updated 2 weeks ago
• boringdata / boring-catalog
  ☆178Updated 8 months ago
• getindata / dbt-flink-adapter
  Adapter for dbt that executes dbt pipelines on Apache Flink
  ☆96Updated last year
• dbt-labs / dbt-spark
  This repository has moved into https://github.com/dbt-labs/dbt-adapters
  ☆443Updated 6 months ago
• mrpowers-io / quinn
  pyspark methods to enhance developer productivity 📣 👯 🎉
  ☆682Updated 11 months ago
• airbytehq / PyAirbyte
  PyAirbyte brings the power of Airbyte to every Python developer.
  ☆315Updated last week
• astronomer / astro-sdk
  Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.
  ☆375Updated 8 months ago
• pragunbhutani / dbt-llm-agent
  LLM based AI Agent to automate Data Analysis for dbt projects with remote MCP server
  ☆159Updated 6 months ago
• StarRocks / dbt-starrocks
  dbt-starrocks contains all of the code enabling dbt to work with StarRocks
  ☆57Updated 3 weeks ago