jksinghpro / docker-airflowLinks
Docker for airflow with mysql as backend
☆12Updated 7 years ago
Alternatives and similar repositories for docker-airflow
Users that are interested in docker-airflow are comparing it to the libraries listed below
Sorting:
- Example DAGs using hooks and operators from Airflow Plugins☆348Updated 7 years ago
- Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.☆168Updated 2 years ago
- Sample Airflow DAGs☆65Updated 3 years ago
- Delta Lake examples☆238Updated last year
- An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR☆176Updated 8 months ago
- locopy: Loading/Unloading to Redshift and Snowflake using Python.☆115Updated this week
- Airflow training for the crunch conf☆105Updated 7 years ago
- Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…☆56Updated 2 years ago
- Resources for video demonstrations and blog posts related to DataOps on AWS☆183Updated 4 years ago
- Tutorial for setting up a Spark cluster running inside of Docker containers located on different machines☆135Updated 3 years ago
- A workspace to experiment with Apache Spark, Livy, and Airflow in a Docker environment.☆38Updated 4 years ago
- Execution of DBT models using Apache Airflow through Docker Compose☆126Updated 3 years ago
- Data Engineering with Spark and Delta Lake☆106Updated 3 years ago
- A complete development environment setup for working with Airflow☆129Updated 2 years ago
- spark on kubernetes☆104Updated 2 years ago
- Apache Airflow in Docker Compose (for both versions 1.10.* and 2.*)☆185Updated 2 years ago
- O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian☆228Updated 2 years ago
- A repository of sample code to accompany our blog post on Airflow and dbt.☆183Updated 2 years ago
- Trino dbt demo project to mix and load BigQuery data with and in a local PostgreSQL database☆76Updated 4 years ago
- Bare minimal Airflow on Kubernetes (Local, EKS, AKS)☆53Updated 5 years ago
- A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for …☆141Updated 5 years ago
- Airflow Unit Tests and Integration Tests☆261Updated 3 years ago
- ☆26Updated 2 years ago
- Apache Airflow integration for dbt☆411Updated last year
- ☆44Updated 3 years ago
- Streaming Synthetic Sales Data Generator: Streaming sales data generator for Apache Kafka, written in Python☆44Updated 3 years ago
- CLI that makes it easy to create, test and deploy Airflow DAGs to Astronomer☆439Updated this week
- Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes☆63Updated 3 years ago
- Learn Apache Spark in Scala, Python (PySpark) and R (SparkR) by building your own cluster with a JupyterLab interface on Docker.☆507Updated 3 months ago
- Simple repo to demonstrate how to submit a spark job to EMR from Airflow☆34Updated 5 years ago