Alternatives and similar repositories for spark-fires

Users that are interested in spark-fires are comparing it to the libraries listed below

• MrPowers / mack
  Delta Lake helper methods in PySpark
  ☆324Updated last year
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆188Updated this week
• SemyonSinchenko / flake8-pyspark-with-column
  A flake8 plugin that detects of usage withColumn in a loop or inside reduce
  ☆28Updated 3 months ago
• Nike-Inc / brickflow
  Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
  ☆219Updated 2 months ago
• mattiasthalen / adventure-works
  Modern serverless lakehouse implementing HOOK methodology, Unified Star Schema (USS), and Analytical Data Storage System (ADSS) principle…
  ☆115Updated 6 months ago
• eakmanrq / sqlframe
  Turning PySpark Into a Universal DataFrame API
  ☆434Updated this week
• adidas / lakehouse-engine
  The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for sever…
  ☆268Updated last month
• cnstlungu / portable-data-stack-dagster
  A portable Datamart and Business Intelligence suite built with Docker, Dagster, dbt, DuckDB and Superset
  ☆245Updated this week
• borjavb / dbt-iceberg-poc
  ☆80Updated 11 months ago
• cnstlungu / portable-data-stack-sqlmesh
  A portable Datamart and Business Intelligence suite built with Docker, sqlmesh + dbtcore, DuckDB and Superset
  ☆53Updated 11 months ago
• sparkdq-community / sparkdq
  A declarative PySpark framework for row- and aggregate-level data quality validation.
  ☆59Updated last week
• gmyrianthous / dbt-airflow
  A Python package that creates fine-grained dbt tasks on Apache Airflow
  ☆73Updated this week
• tomasfarias / airflow-dbt-python
  A collection of Airflow operators, hooks, and utilities to elevate dbt to a first-class citizen of Airflow.
  ☆208Updated last month
• delta-io / delta-examples
  Delta Lake examples
  ☆229Updated last year
• data-catering / insta-infra
  Quickstart for any service
  ☆161Updated last week
• opensource-observer / dagster-sqlmesh
  Dagster SQLMesh Adapter
  ☆72Updated 3 weeks ago
• nicholasyager / dbt-loom
  A dbt-core plugin to weave together multi-project dbt-core deployments
  ☆169Updated last month
• canva-public / dbt-column-lineage-extractor
  A lightweight Python-based tool for extracting and analyzing data column lineage for dbt projects
  ☆182Updated 6 months ago
• PicnicSupermarket / dbt-score
  Linter for dbt metadata
  ☆177Updated this week
• dagster-io / project-dagster-university
  Dagster University courses
  ☆112Updated last week
• rafaelpierre / pyjaws
  PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows
  ☆43Updated 3 months ago
• mitchelllisle / sparkdantic
  ✨ A Pydantic to PySpark schema library
  ☆106Updated this week
• l-mds / local-data-stack
  Slow & local data allows you to move fast and deliver business value for the 99.9% of the data challenges.
  ☆301Updated last week
• starlake-ai / starlake
  Declarative text based tool for data analysts and engineers to extract, load, transform and orchestrate their data pipelines.
  ☆135Updated last week
• canimus / cuallee
  Possibly the fastest DataFrame-agnostic quality check library in town.
  ☆220Updated this week
• ananthdurai / schemata
  Schema modelling framework for decentralised domain-driven ownership of data.
  ☆259Updated last year
• astronomer / cosmos-demo
  Demo DAGs that show how to run dbt Core in Airflow using Cosmos
  ☆64Updated 4 months ago
• pgoslatara / dbt-beyond-the-basics
  Showcase of advanced use cases relating to CI in dbt
  ☆89Updated 2 weeks ago
• flexanalytics / dbt-business-intelligence
  ☆155Updated 2 months ago
• danielbeach / lakescum
  A Python package to help Databricks Unity Catalog users to read and query Delta Lake tables with Polars, DuckDb, or PyArrow.
  ☆26Updated last year