garystafford / tickit-data-lake-demo
Resources for video demonstrations and blog posts related to DataOps on AWS
☆170Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for tickit-data-lake-demo
- Amazon Managed Workflows for Apache Airflow (MWAA) Examples repository contains example DAGs, requirements.txt, plugins, and CloudFormati…☆106Updated last week
- Project files for the post: Running PySpark Applications on Amazon EMR using Apache Airflow: Using the new Amazon Managed Workflows for A…☆41Updated 2 years ago
- Data pipeline with dbt, Airflow, Great Expectations☆158Updated 3 years ago
- This repository contains the dbt-glue adapter☆101Updated this week
- Execution of DBT models using Apache Airflow through Docker Compose☆113Updated last year
- A template repository to create a data project with IAC, CI/CD, Data migrations, & testing☆241Updated 4 months ago
- Spark runtime on AWS Lambda☆94Updated 2 months ago
- A repository of sample code to accompany our blog post on Airflow and dbt.☆167Updated last year
- Learn how to add data validation and documentation to a data pipeline built with dbt and Airflow.☆166Updated last year
- Docker with Airflow and Spark standalone cluster☆245Updated last year
- Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow☆133Updated 4 years ago
- A repository of sample code to show data quality checking best practices using Airflow.☆72Updated last year
- Pyspark boilerplate for running prod ready data pipeline☆28Updated 3 years ago
- Delta-Lake, ETL, Spark, Airflow☆44Updated 2 years ago
- A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects☆195Updated this week
- Code for dbt tutorial☆143Updated 5 months ago
- ☆113Updated last month
- Code snippets for Data Engineering Design Patterns book☆40Updated last week
- Project for "Data pipeline design patterns" blog.☆41Updated 3 months ago
- Cloned by the `dbt init` task☆59Updated 6 months ago
- Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation,…☆89Updated 2 years ago
- Example code for running Spark and Hive jobs on EMR Serverless.☆153Updated this week
- Simple stream processing pipeline☆92Updated 5 months ago
- Course notes for the Astronomer Certification DAG Authoring for Apache Airflow☆51Updated 8 months ago
- Demo DAGs that show how to run dbt Core in Airflow using Cosmos☆46Updated last month
- Sample project to demonstrate data engineering best practices☆166Updated 8 months ago
- Demo code to illustrate the execution of PyTest unit test cases for AWS Glue jobs in AWS CodePipeline using AWS CodeBuild projects☆39Updated last week
- End to end data engineering project☆51Updated 2 years ago
- A collection of Airflow operators, hooks, and utilities to elevate dbt to a first-class citizen of Airflow.☆181Updated 4 months ago