r-kells / prod-airflow

Related projects ⓘ

Alternatives and complementary repositories for prod-airflow

• mjhea0 / flask-spark-docker
  Just a boilerplate for PySpark and Flask
  ☆35Updated 6 years ago
• mdh266 / AirflowETL
  Blog post on ETL pipelines with Airflow
  ☆23Updated 4 years ago
• yennanliu / NYC_Taxi_Pipeline
  Design/Implement stream/batch architecture on NYC taxi data | #DE
  ☆26Updated 3 years ago
• vergili / bigdata_tutorial
  ☆16Updated 6 years ago
• kadnan / Calories-Alert-Kafka
  Simple alert system implemented in Kafka and Python
  ☆94Updated 6 years ago
• benjigoldberg / udacity-airflow
  Udacity Data Pipeline Exercises
  ☆15Updated 4 years ago
• mewwts / feng
  feng - feature engineering for machine-learning champions
  ☆27Updated 7 years ago
• MrPowers / ceja
  PySpark phonetic and string matching algorithms
  ☆35Updated 9 months ago
• ds-muzalevskiy / sagemaker-docker-deploy
  ☆18Updated 3 years ago
• FavioVazquez / ds-optimus
  How to do data science with Optimus, Spark and Python.
  ☆18Updated 5 years ago
• PacktPublishing / Amazon-Redshift-Cookbook
  Amazon Redshift Cookbook, Published by Packt
  ☆15Updated last year
• JasonSanchez / spark-streaming-twitter-kafka
  Ingest tweets with Kafka. Use Spark to track popular hashtags and trendsetters for each hashtag
  ☆29Updated 8 years ago
• MuttData / muttlib
  ☆29Updated 11 months ago
• karenbajador / pyspark_greatexpectations
  ☆11Updated 2 years ago
• RichardAfolabi / Realtime-Data-Analytics-Using-Spark
  Realtime social media data analytics with Apache Spark, Python, Kafka, Pandas, etc
  ☆52Updated 8 years ago
• mikeghen / airflow-tutorial
  Use Airflow to move data from multiple MySQL databases to BigQuery
  ☆99Updated 4 years ago
• BigDataRepublic / bdr-analytics-py
  Common data science and data engineering utilities to help us perform analytics. Our toolbox for data scientists, licensed under Apache-2…
  ☆30Updated 6 years ago
• MrPowers / gill
  An example PySpark project with pytest
  ☆17Updated 7 years ago
• ananthdurai / airflow-training
  Airflow training for the crunch conf
  ☆105Updated 6 years ago
• deliveryhero / pyconde2019-airflow-ml-workshop
  PyConDE & PyData Berlin 2019 Airflow Workshop: Airflow for machine learning pipelines.
  ☆46Updated last year
• dataquestio / analytics_pipeline
  Code to build a simple analytics data pipeline with Python
  ☆102Updated 7 years ago
• shlin168 / airflow-event-plugins
  event-triggered plugins for airflow
  ☆21Updated 4 years ago
• vim89 / datapipelines-essentials-python
  Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…
  ☆53Updated last year
• datastacktv / kubeflow-introduction
  Code examples for the Introduction to Kubeflow course
  ☆13Updated 3 years ago
• dimajix / spark-training
  Repository used for Spark Trainings
  ☆53Updated last year
• cmuth001 / Data-Engineer-Nano-Degree
  Data models, build data warehouses and data lakes, automate data pipelines, and worked with massive datasets.
  ☆13Updated 5 years ago
• Atreya22 / luigi_rosmann_sales
  Using Luigi to create a Machine Learning Pipeline using the Rossman Sales data from Kaggle
  ☆33Updated 8 years ago
• idealo / terraform-emr-pyspark
  Quickstart PySpark with Anaconda on AWS/EMR using Terraform
  ☆47Updated 11 months ago
• feluelle / finance-data-builder
  Finance 🏦 Data Builder 🛠️ @ postgres 🐘
  ☆18Updated 3 years ago