r-kells / prod-airflow
Helping you get Airflow running in production.
☆9Updated 5 years ago
Alternatives and similar repositories for prod-airflow
Users that are interested in prod-airflow are comparing it to the libraries listed below
Sorting:
- Udacity Data Pipeline Exercises☆15Updated 4 years ago
- ☆18Updated 3 years ago
- Snowflake Guide: Building a Recommendation Engine Using Snowflake & Amazon SageMaker☆31Updated 3 years ago
- Just a boilerplate for PySpark and Flask☆35Updated 6 years ago
- event-triggered plugins for airflow☆21Updated 5 years ago
- Repository used for Spark Trainings☆53Updated 2 years ago
- Blog post on ETL pipelines with Airflow☆23Updated 4 years ago
- Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation,…☆90Updated 3 years ago
- A repo to track data engineering projects☆13Updated 2 years ago
- A production-grade data pipeline has been designed to automate the parsing of user search patterns to analyze user engagement. Extract d…☆24Updated 3 years ago
- Demonstration of using Apache Spark to build robust ETL pipelines while taking advantage of open source, general purpose cluster computin…☆24Updated last year
- Big Data Demystified meetup and blog examples☆31Updated 9 months ago
- Glue VSCode devcontainer setup☆14Updated 2 years ago
- DataHub on AWS demonstration resources☆10Updated 2 years ago
- Amazon Redshift Cookbook, Published by Packt☆15Updated 2 years ago
- Demo for GitHub Universe 2022☆12Updated 2 years ago
- ☆19Updated 4 years ago
- Repo for all my code on the articles I post on medium☆107Updated 2 years ago
- PyConDE & PyData Berlin 2019 Airflow Workshop: Airflow for machine learning pipelines.☆47Updated last year
- Project files for the post: Running PySpark Applications on Amazon EMR using Apache Airflow: Using the new Amazon Managed Workflows for A…☆41Updated 2 years ago
- Data models, build data warehouses and data lakes, automate data pipelines, and worked with massive datasets.☆13Updated 5 years ago
- Quickstart PySpark with Anaconda on AWS/EMR using Terraform☆47Updated 4 months ago
- Build end-to-end Machine Learning pipeline to predict accessibility of playgrounds in NYC☆15Updated 4 years ago
- ☆26Updated last year
- This repository has a collection of utilities for Glue Crawlers. These utilities come in the form of AWS CloudFormation templates or AWS …☆19Updated 3 years ago
- Jupyter notebooks and AWS CloudFormation template to show how Hudi, Iceberg, and Delta Lake work☆47Updated 2 years ago
- Basic tutorial of using Apache Airflow☆36Updated 6 years ago
- A Pyspark job to handle upserts, conversion to parquet and create partitions on S3☆26Updated 4 years ago
- PySpark phonetic and string matching algorithms☆39Updated last year
- dbt (data build tool) projects targeting AWS analytics services (redshift, glue, emr, athena) and open table formats☆29Updated 2 years ago