r-kells / prod-airflow
Helping you get Airflow running in production.
☆9Updated 5 years ago
Alternatives and similar repositories for prod-airflow:
Users that are interested in prod-airflow are comparing it to the libraries listed below
- Blog post on ETL pipelines with Airflow☆23Updated 4 years ago
- Udacity Data Pipeline Exercises☆15Updated 4 years ago
- ☆16Updated 7 years ago
- Just a boilerplate for PySpark and Flask☆35Updated 6 years ago
- Design/Implement stream/batch architecture on NYC taxi data | #DE☆25Updated 3 years ago
- Repo for all my code on the articles I post on medium☆107Updated 2 years ago
- Big Data Demystified meetup and blog examples☆31Updated 8 months ago
- ☆19Updated 4 years ago
- PyConDE & PyData Berlin 2019 Airflow Workshop: Airflow for machine learning pipelines.☆47Updated last year
- ☆18Updated 3 years ago
- Use Airflow to move data from multiple MySQL databases to BigQuery☆100Updated 4 years ago
- How to do data science with Optimus, Spark and Python.☆19Updated 5 years ago
- PySpark phonetic and string matching algorithms☆39Updated last year
- Basic tutorial of using Apache Airflow☆36Updated 6 years ago
- ☆11Updated 3 years ago
- Built a stream processing data pipeline to get data from disparate systems into a dashboard using Kafka as an intermediary.☆29Updated last year
- event-triggered plugins for airflow☆21Updated 5 years ago
- ElasticSearch implementation of MlFlow tracking store☆18Updated 4 years ago
- Finance 🏦 Data Builder 🛠️ @ postgres 🐘☆21Updated 4 years ago
- Airflow helm chart for AWS EKS☆18Updated 4 years ago
- Using the Parquet file format with Python☆15Updated last year
- Scaling Python Machine Learning☆45Updated last year
- Delux Airflow deployment with Minikube☆10Updated 4 years ago
- locopy: Loading/Unloading to Redshift and Snowflake using Python.☆107Updated this week
- Quickstart PySpark with Anaconda on AWS/EMR using Terraform☆47Updated 3 months ago
- Example of an ETL Pipeline using Airflow☆34Updated 7 years ago
- Examples for using Amazon SageMaker components in Kubeflow Pipelines☆22Updated 4 years ago
- This repo demonstrates how to load a sample Parquet formatted file from an AWS S3 Bucket. A python job will then be submitted to a Apach…☆19Updated 8 years ago
- Documentation and resources for deploying JupyterHub on Hadoop☆18Updated 5 years ago
- A repo to track data engineering projects☆13Updated 2 years ago