sspaeti-com / data-engineering-devops

Related projects: ⓘ

• josephmachado / analytical_dp_with_sql
  Code for my "Efficient Data Processing in SQL" book.
  ☆47Updated last month
• jonathanneo / data-aware-orchestration
  Data-aware orchestration with dagster, dbt, and airbyte
  ☆29Updated last year
• bartosz25 / data-engineering-design-patterns-book
  Code snippets for Data Engineering Design Patterns book
  ☆27Updated this week
• airbytehq / open-data-stack
  Open Data Stack Projects: Examples of End to End Data Engineering Projects
  ☆68Updated last year
• Data-Engineer-Camp / modern-elt-demo
  A modern ELT demo using airbyte, dbt, snowflake and dagster
  ☆22Updated last year
• josephmachado / cost_effective_data_pipelines
  Cost Efficient Data Pipelines with DuckDB
  ☆42Updated last month
• delta-io / delta-docs
  Delta Lake Documentation
  ☆45Updated 3 months ago
• franloza / coches-net-dashboard
  Sample project that use Dagster, dbt, DuckDB and Dash to visualize car and motorcycle Spanish market
  ☆52Updated last year
• danielbeach / tinytimmy
  A simple and easy to use Data Quality (DQ) tool built with Python.
  ☆45Updated last year
• 1997mahadi / dbt-dlt-ingestion-pipeline
  ☆12Updated last month
• zsvoboda / ngods
  New generation opensource data stack
  ☆60Updated 2 years ago
• ismaildawoodjee / GreatEx
  A project for exploring how Great Expectations can be used to ensure data quality and validate batches within a data pipeline defined in …
  ☆21Updated 2 years ago
• gmyrianthous / dbt-airflow
  A Python package that creates fine-grained dbt tasks on Apache Airflow
  ☆52Updated 5 months ago
• danielbeach / sniffer
  csv and flat-file sniffer built in Rust.
  ☆40Updated 7 months ago
• josephmachado / data-quality-w-greatexpectations
  Code for data quality with greatexpectations blog
  ☆10Updated last month
• TJaniF / airflow-elt-blueprint
  A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.
  ☆54Updated last year
• sspaeti-com / awesome-dagster
  A curated list of dagster code snippets for data engineers
  ☆48Updated 6 months ago
• astronomer / airflow-testing-guide
  ☆20Updated 3 years ago
• josephmachado / simple_polars_etl
  ☆15Updated 4 months ago
• josephmachado / adv_data_transformation_in_sql
  Code for "Advanced data transformations in SQL" free live workshop
  ☆54Updated last month
• mrn-aglic / apache-iceberg-data-exploration
  ☆11Updated 7 months ago
• josephmachado / e2e_datapipeline_test
  Example repo to create end to end tests for data pipeline.
  ☆21Updated 3 months ago
• PacktPublishing / Driving-Data-Quality-with-Data-Contracts
  ☆32Updated 3 months ago
• Stefen-Taime / modern-data-pipeline
  reating a modern data pipeline using a combination of Terraform, AWS Lambda and S3, Snowflake, DBT, Mage AI, and Dash.
  ☆12Updated last year
• astronomer / airflow-data-quality-demo
  A repository of sample code to show data quality checking best practices using Airflow.
  ☆71Updated last year
• guidok91 / spark-movies-etl
  Spark data pipeline that processes movie ratings data.
  ☆26Updated last month
• InfuseAI / taxi_rides_ny_duckdb
  PipeRider dbt workshop for DataTalksClub DE Zoomcamp
  ☆16Updated 9 months ago
• dlt-hub / verified-sources
  Contribute to dlt verified sources 🔥
  ☆64Updated this week
• danielbeach / lakescum
  A Python package to help Databricks Unity Catalog users to read and query Delta Lake tables with Polars, DuckDb, or PyArrow.
  ☆22Updated 5 months ago
• treeverse / lakeFS-samples
  lakefs-samples repository
  ☆69Updated last week