Alternatives and similar repositories for hexagonal-architecture-python-spark

Users that are interested in hexagonal-architecture-python-spark are comparing it to the libraries listed below

• kaxil / airflowctl
  A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects
  ☆218Updated 2 months ago
• bartosz25 / data-engineering-design-patterns-book
  Code snippets for Data Engineering Design Patterns book
  ☆128Updated 4 months ago
• Nike-Inc / brickflow
  Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
  ☆218Updated last month
• EcZachly / microbatch-hourly-deduped-tutorial
  ☆113Updated 3 years ago
• tobyweb3x / data-engineering-book-reviews
  Just starting your DE journey or along the way already?. I will be sharing a short list of DATA-ENGINEERING-CENTRED books that covers the…
  ☆34Updated 3 years ago
• paypal / data-contract-template
  Template for a data contract used in a data mesh.
  ☆471Updated last year
• mitchelllisle / sparkdantic
  ✨ A Pydantic to PySpark schema library
  ☆98Updated this week
• canimus / cuallee
  Possibly the fastest DataFrame-agnostic quality check library in town.
  ☆195Updated this week
• TJaniF / airflow-elt-blueprint
  A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.
  ☆74Updated last year
• AltimateAI / awesome-data-contracts
  A curated list of awesome blogs, videos, tools and resources about Data Contracts
  ☆177Updated 11 months ago
• danielbeach / tinytimmy
  A simple and easy to use Data Quality (DQ) tool built with Python.
  ☆50Updated last year
• datacontract / datacontract-specification
  The Data Contract Specification Repository
  ☆359Updated last week
• MrPowers / chispa
  PySpark test helper methods with beautiful error messages
  ☆704Updated last week
• adidas / lakehouse-engine
  The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for sever…
  ☆255Updated 2 weeks ago
• anna-geller / dataflow-ops
  Project demonstrating how to automate Prefect 2.0 deployments to AWS ECS Fargate
  ☆115Updated last year
• feluelle / airflint
  Enforce Best Practices for all your Airflow DAGs. ⭐
  ☆104Updated this week
• datacontract / datacontract-cli
  Enforce Data Contracts
  ☆649Updated this week
• gmyrianthous / dbt-airflow
  A Python package that creates fine-grained dbt tasks on Apache Airflow
  ☆70Updated 9 months ago
• rickyriled / data_engineering_project_1
  My first attempt at a rough ETL pipeline; technologies include spark, GCS, prefect orchestration, and terraform
  ☆15Updated 2 years ago
• sodadata / soda-spark
  Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes
  ☆64Updated 3 years ago
• airbytehq / quickstarts
  ☆202Updated 5 months ago
• bruno-szdl / dbt-ci-cd
  ☆132Updated 11 months ago
• sbalnojan / run-a-data-team
  A guide for leading a data (engineering) team
  ☆64Updated last year
• datarootsio / terraform-aws-ecs-airflow
  A terraform module that creates an airflow instance in AWS ECS.
  ☆61Updated last year
• tekumara / fakesnow
  Run, mock and test fake Snowflake databases locally.
  ☆144Updated last week
• data-engineering-helpers / data-contracts
  Food for thoughts around data contracts
  ☆26Updated 4 months ago
• hankehly / deploy-airflow-on-ecs-fargate
  An example of how to deploy Apache Airflow on Amazon ECS Fargate
  ☆42Updated 3 years ago
• dotlas / databricks_helpers
  🧱 A collection of supplementary utilities and helper notebooks to perform admin tasks on Databricks
  ☆56Updated 2 weeks ago
• spbail / dag-stack
  Data pipeline with dbt, Airflow, Great Expectations
  ☆163Updated 4 years ago
• anna-geller / prefect-dataplatform
  Example repository showing how to build a data platform with Prefect, dbt and Snowflake
  ☆104Updated 2 years ago