ssp-data / data-engineering-devops

Related projects ⓘ

Alternatives and complementary repositories for data-engineering-devops

• danielbeach / tinytimmy
  A simple and easy to use Data Quality (DQ) tool built with Python.
  ☆48Updated last year
• bartosz25 / data-engineering-design-patterns-book
  Code snippets for Data Engineering Design Patterns book
  ☆38Updated this week
• josephmachado / analytical_dp_with_sql
  Code for my "Efficient Data Processing in SQL" book.
  ☆49Updated 3 months ago
• josephmachado / cost_effective_data_pipelines
  Cost Efficient Data Pipelines with DuckDB
  ☆46Updated 3 months ago
• franloza / coches-net-dashboard
  Sample project that use Dagster, dbt, DuckDB and Dash to visualize car and motorcycle Spanish market
  ☆55Updated last year
• jonathanneo / data-aware-orchestration
  Data-aware orchestration with dagster, dbt, and airbyte
  ☆30Updated last year
• Data-Engineer-Camp / modern-elt-demo
  A modern ELT demo using airbyte, dbt, snowflake and dagster
  ☆24Updated last year
• josephmachado / simple_polars_etl
  ☆15Updated 6 months ago
• ssp-data / awesome-dagster
  A curated list of dagster code snippets for data engineers
  ☆50Updated 8 months ago
• airbytehq / open-data-stack
  Open Data Stack Projects: Examples of End to End Data Engineering Projects
  ☆70Updated last year
• 1997mahadi / dbt-dlt-ingestion-pipeline
  ☆15Updated 3 months ago
• BauplanLabs / no-jvm-wap-with-iceberg
  A write-audit-publish implementation on a data lake without the JVM
  ☆41Updated 3 months ago
• danielbeach / lakescum
  A Python package to help Databricks Unity Catalog users to read and query Delta Lake tables with Polars, DuckDb, or PyArrow.
  ☆22Updated 7 months ago
• dbt-labs / spark-utils
  Utility functions for dbt projects running on Spark
  ☆31Updated last year
• delta-io / delta-docs
  Delta Lake Documentation
  ☆46Updated 4 months ago
• stkbailey / dagster-jaffle-shop
  Repo for orienting dbt users to the Dagster asset framework
  ☆48Updated 2 years ago
• ssp-data / personal-swiss-finance-dw
  Personal Finance Project to automatically collect swiss banking transaction into a DWH and visualise it
  ☆26Updated 8 months ago
• josephmachado / data-quality-w-greatexpectations
  Code for data quality with greatexpectations blog
  ☆12Updated 3 months ago
• zsvoboda / ngods
  New generation opensource data stack
  ☆61Updated 2 years ago
• borjavb / dbt-iceberg-poc
  ☆65Updated 3 weeks ago
• cnstlungu / portable-data-stack-airflow
  A portable Datamart and Business Intelligence suite built with Docker, Airflow, dbt, PostgreSQL and Superset
  ☆24Updated 4 months ago
• dqops / dqo
  Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observ…
  ☆111Updated this week
• dlt-hub / verified-sources
  Contribute to dlt verified sources 🔥
  ☆70Updated 2 weeks ago
• danielbeach / dataEngineeringTemplate
  Template for Data Engineering and Data Pipeline projects
  ☆104Updated last year
• danhphan / trusted-data-pipeline
  Building 3D Trusted Data Pipelines With Dagster, Dbt, and Duckdb
  ☆18Updated last year
• hnawaz007 / dbt-dw
  build dw with dbt
  ☆29Updated 2 weeks ago
• astronomer / airflow-testing-guide
  ☆20Updated 3 years ago
• danielbeach / sniffer
  csv and flat-file sniffer built in Rust.
  ☆42Updated 9 months ago
• mehd-io / pypi-duck-flow
  end-to-end data engineering project to get insights from PyPi using python, duckdb, MotherDuck & Evidence
  ☆145Updated 3 weeks ago
• pybokeh / dagster-sklearn
  dagster scikit-learn pipeline example.
  ☆43Updated last year