garystafford / tickit-data-lake-demo
Resources for video demonstrations and blog posts related to DataOps on AWS
☆173Updated 3 years ago
Alternatives and similar repositories for tickit-data-lake-demo:
Users that are interested in tickit-data-lake-demo are comparing it to the libraries listed below
- Execution of DBT models using Apache Airflow through Docker Compose☆113Updated 2 years ago
- Project files for the post: Running PySpark Applications on Amazon EMR using Apache Airflow: Using the new Amazon Managed Workflows for A…☆41Updated 2 years ago
- Spark runtime on AWS Lambda☆105Updated 4 months ago
- Amazon Managed Workflows for Apache Airflow (MWAA) Examples repository contains example DAGs, requirements.txt, plugins, and CloudFormati …☆110Updated 2 months ago
- Data pipeline with dbt, Airflow, Great Expectations☆160Updated 3 years ago
- Code for dbt tutorial☆149Updated 7 months ago
- This repository contains the dbt-glue adapter☆107Updated last week
- A repository of sample code to accompany our blog post on Airflow and dbt.☆168Updated last year
- A repository of sample code to show data quality checking best practices using Airflow.☆74Updated last year
- (project & tutorial) dag pipeline tests + ci/cd setup☆86Updated 3 years ago
- Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.☆166Updated last year
- Docker with Airflow and Spark standalone cluster☆247Updated last year
- Data lake, data warehouse on GCP☆55Updated 3 years ago
- Example code for running Spark and Hive jobs on EMR Serverless.☆160Updated 3 weeks ago
- Project for "Data pipeline design patterns" blog.☆43Updated 5 months ago
- build dw with dbt☆35Updated 3 months ago
- Any Airflow project day 1, you can spin up a local desktop Kubernetes Airflow environment AND one in Google Cloud Composer with tested da…☆111Updated last year
- A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects☆206Updated this week
- ☆106Updated 6 months ago
- ☆34Updated 2 years ago
- Cloned by the `dbt init` task☆60Updated 9 months ago
- This project helps me to understand the core concepts of Apache Airflow. I have created custom operators to perform tasks such as staging…☆75Updated 5 years ago
- This repository is for demonstrating the capability to do SQL-based UPDATES, DELETES, and INSERTS directly in the Data Lake using Amazon …☆16Updated 3 years ago
- ☆117Updated 3 months ago
- Demo DAGs that show how to run dbt Core in Airflow using Cosmos☆53Updated 3 months ago
- Airflow Deployment on AWS ECS Fargate Using Cloudformation☆205Updated 2 years ago
- A collection of Airflow operators, hooks, and utilities to elevate dbt to a first-class citizen of Airflow.☆186Updated 6 months ago
- Step-by-step tutorial on building a Kimball dimensional model with dbt☆122Updated 6 months ago
- Delta-Lake, ETL, Spark, Airflow☆46Updated 2 years ago
- Simple repo to demonstrate how to submit a spark job to EMR from Airflow☆32Updated 4 years ago