mozilla / docker-etlLinks
Collection of dockerized ETL jobs managed by data engineering.
☆20Updated this week
Alternatives and similar repositories for docker-etl
Users that are interested in docker-etl are comparing it to the libraries listed below
Sorting:
- Utility functions for dbt projects running on Spark☆33Updated 6 months ago
- Weekly Data Engineering Newsletter☆96Updated last year
- PySpark schema generator☆43Updated 2 years ago
- [ARCHIVED] The Presto adapter plugin for dbt Core☆33Updated last year
- Read Delta tables without any Spark☆47Updated last year
- locopy: Loading/Unloading to Redshift and Snowflake using Python.☆110Updated 3 weeks ago
- A GitHub Action that makes it easy to use Great Expectations to validate your data pipelines in your CI workflows.☆80Updated last year
- Data validation library for PySpark 3.0.0☆33Updated 2 years ago
- Fast iterative local development and testing of Apache Airflow workflows☆202Updated last week
- Data pipelines from re-usable components☆107Updated 2 years ago
- Superglue is a lineage-tracking tool built to help visualize the propagation of data through complex pipelines composed of tables, jobs …☆158Updated 2 years ago
- Soda SQL and Soda Spark have been deprecated and replaced by Soda Core. docs.soda.io/soda-core/overview.html☆61Updated 2 years ago
- Ibis analytics, with Ibis (and more!)☆22Updated 11 months ago
- Supporting materials/code examples for my course in data engineering for machine learning.☆38Updated 2 years ago
- Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes☆64Updated 3 years ago
- Pylint plugin for static code analysis on Airflow code☆95Updated 4 years ago
- Benchmark data warehouses under Fivetran-like conditions☆170Updated 2 years ago
- DBAPI and SQLAlchemy dialect for Databricks Workspace and SQL Analytics clusters☆22Updated 3 years ago
- Pipeline definitions for managing data flows to power analytics at MIT Open Learning☆43Updated last week
- rb_status_plugin : Data confidence tool for Airflow☆13Updated 2 years ago
- Data Tools Subjective List☆86Updated 2 years ago
- Making DAG construction easier☆271Updated last month
- ☆30Updated 8 months ago
- Delta Lake helper methods. No Spark dependency.☆23Updated 11 months ago
- Mapping of DWH database tables to business entities, attributes & metrics in Python, with automatic creation of flattened tables☆74Updated last year
- Generate and Visualize Data Lineage from query history☆326Updated 2 years ago
- A simple and easy to use Data Quality (DQ) tool built with Python.☆50Updated last year
- Bigquery ETL☆321Updated last week
- The shared semantic layer definitions that dbt-core and MetricFlow use.☆82Updated this week
- Astronomer Core Docker Images☆107Updated last year