mozilla / docker-etlLinks
Collection of dockerized ETL jobs managed by data engineering.
☆21Updated this week
Alternatives and similar repositories for docker-etl
Users that are interested in docker-etl are comparing it to the libraries listed below
Sorting:
- Weekly Data Engineering Newsletter☆96Updated last year
- Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.☆169Updated last year
- locopy: Loading/Unloading to Redshift and Snowflake using Python.☆113Updated 2 months ago
- A repository of sample code to show data quality checking best practices using Airflow.☆78Updated 2 years ago
- Utility functions for dbt projects running on Spark☆33Updated 7 months ago
- PySpark schema generator☆43Updated 2 years ago
- Delta Lake examples☆228Updated 11 months ago
- A simple and easy to use Data Quality (DQ) tool built with Python.☆50Updated 2 years ago
- Astronomer Core Docker Images☆106Updated last year
- Read Delta tables without any Spark☆47Updated last year
- Sample configuration to deploy a modern data platform.☆88Updated 3 years ago
- Full stack data engineering tools and infrastructure set-up☆56Updated 4 years ago
- Great Expectations Airflow operator☆167Updated last week
- Solution Accelerators for Serverless Spark on GCP, the industry's first auto-scaling and serverless Spark as a service☆72Updated last year
- Viewflow is an Airflow-based framework that allows data scientists to create data models without writing Airflow code.☆126Updated 4 years ago
- ☆23Updated 4 years ago
- Fast iterative local development and testing of Apache Airflow workflows☆201Updated last month
- The go to demo for public and private dbt Learn☆80Updated 6 months ago
- Any Airflow project day 1, you can spin up a local desktop Kubernetes Airflow environment AND one in Google Cloud Composer with tested da…☆112Updated 2 years ago
- New generation opensource data stack☆73Updated 3 years ago
- Airflow configuration for Telemetry☆195Updated last week
- Cloud-native, data onboarding architecture for Google Cloud Datasets☆165Updated 2 months ago
- Soda SQL and Soda Spark have been deprecated and replaced by Soda Core. docs.soda.io/soda-core/overview.html☆62Updated 2 years ago
- Delta Lake Documentation☆50Updated last year
- Pythonic Programming Framework to orchestrate jobs in Databricks Workflow☆219Updated 2 months ago
- Delta reader for the Ray open-source toolkit for building ML applications☆46Updated last year
- Data processing and modelling framework for automating tasks (incl. Python & SQL transformations).☆120Updated 2 weeks ago
- Example orchestration pipeline for Fivetran + dbt managed by Airflow☆21Updated 4 years ago
- The shared semantic layer definitions that dbt-core and MetricFlow use.☆85Updated this week
- A serverless duckDB deployment at GCP☆41Updated 3 years ago