jason-jz-zhu / Modularization_Python_Docker_Demo
The Demo for Blog: Modularization using Python and Docker (MicroService)
☆12Updated 4 years ago
Alternatives and similar repositories for Modularization_Python_Docker_Demo:
Users that are interested in Modularization_Python_Docker_Demo are comparing it to the libraries listed below
- A project for exploring how Great Expectations can be used to ensure data quality and validate batches within a data pipeline defined in …☆21Updated 2 years ago
- Blog post on ETL pipelines with Airflow☆23Updated 4 years ago
- Medium Article☆11Updated 3 years ago
- A Beginner's Guide to DuckDB's Python Client☆42Updated 4 months ago
- A tutorial for the Great Expectations library.☆69Updated 4 years ago
- Feedzai's theme for Altair charts.☆14Updated last year
- A proof of concept for how to set up a codebase for an analytics org.☆14Updated 3 years ago
- Sample projects using Ploomber.☆86Updated last year
- Data lake, data warehouse on GCP☆55Updated 3 years ago
- A modern ELT demo using airbyte, dbt, snowflake and dagster☆26Updated 2 years ago
- Delta-Lake, ETL, Spark, Airflow☆46Updated 2 years ago
- (project & tutorial) dag pipeline tests + ci/cd setup☆86Updated 4 years ago
- Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.☆166Updated last year
- In this repository we store all materials for dlt workshops, courses, etc.☆113Updated last month
- An example of a Dagster project with a possible folder structure to organize the assets, jobs, repositories, schedules, and ops. Also has…☆91Updated 3 months ago
- Code for blog at: https://www.startdataengineering.com/post/docker-for-de/☆34Updated 9 months ago
- ☆31Updated 8 months ago
- Resources for video demonstrations and blog posts related to DataOps on AWS☆172Updated 3 years ago
- Data engineering project using UK Bus Open Data Service (BODS) to calculate late buses in real-time for any selected region in England. P…☆28Updated last year
- A repository of sample code to show data quality checking best practices using Airflow.☆74Updated last year
- Cost Efficient Data Pipelines with DuckDB☆49Updated 6 months ago
- Great Expectations Airflow operator☆159Updated this week
- Data-aware orchestration with dagster, dbt, and airbyte☆31Updated 2 years ago
- Docker with Airflow and Spark standalone cluster☆249Updated last year
- ☆15Updated last year
- ☆102Updated 2 years ago
- Notebooks that support blog posts and tech talks on Dask / Coiled.☆47Updated last year
- Course notes for the Astronomer Certification DAG Authoring for Apache Airflow☆52Updated 10 months ago
- The practical use-cases of how to make your Machine Learning Pipelines robust and reliable using Apache Airflow.☆52Updated 2 years ago
- Code for dbt tutorial☆151Updated 8 months ago