r-kells / prod-airflow

Related projects ⓘ

Alternatives and complementary repositories for prod-airflow

• mjhea0 / flask-spark-docker
  Just a boilerplate for PySpark and Flask
  ☆35Updated 6 years ago
• ofermend / practical-data-science-with-hadoop-and-spark
  ☆26Updated 10 months ago
• ds-muzalevskiy / sagemaker-docker-deploy
  ☆18Updated 3 years ago
• benjigoldberg / udacity-airflow
  Udacity Data Pipeline Exercises
  ☆15Updated 4 years ago
• rdempsey / pyspark-for-data-processing
  Code for my presentation: Using PySpark to Process Boat Loads of Data
  ☆20Updated 7 years ago
• Atreya22 / luigi_rosmann_sales
  Using Luigi to create a Machine Learning Pipeline using the Rossman Sales data from Kaggle
  ☆33Updated 8 years ago
• florimondmanca / kafka-fraud-detector
  🚨 Simple, self-contained fraud detection system built with Apache Kafka and Python
  ☆83Updated 5 years ago
• NYUBigDataProject / SparkClean
  A Scalable Data Cleaning Library for PySpark.
  ☆26Updated 5 years ago
• alteryx / predict-household-poverty
  Predict the poverty of households in Costa Rica using automated feature engineering.
  ☆23Updated 4 years ago
• criteo / mlflow-elasticsearchstore
  ElasticSearch implementation of MlFlow tracking store
  ☆16Updated 4 years ago
• mdh266 / AirflowETL
  Blog post on ETL pipelines with Airflow
  ☆23Updated 4 years ago
• osin-vladimir / architect_big_data_solutions_with_spark
  code, labs and lectures for the course
  ☆45Updated last year
• saturncloud / saturn-cloud-examples
  ☆19Updated 3 years ago
• deliveryhero / pyconde2019-airflow-ml-workshop
  PyConDE & PyData Berlin 2019 Airflow Workshop: Airflow for machine learning pipelines.
  ☆46Updated last year
• NikTRSK / Data-Science-and-Machine-Learning-with-Python---Hands-On
  Data Science and Machine Learning with Python - Hands On from Udemy
  ☆14Updated 7 years ago
• cmuth001 / Data-Engineer-Nano-Degree
  Data models, build data warehouses and data lakes, automate data pipelines, and worked with massive datasets.
  ☆13Updated 5 years ago
• HackerEarth-Challenges / Future_Datathon
  This is a machine learning challenge conducted by C&D Labs and Future Group in association with HackerEarth.
  ☆10Updated 6 years ago
• bodywork-ml / ml-pipeline-engineering
  Best practices for engineering ML pipelines.
  ☆37Updated 2 years ago
• gwenshap / flask-and-kafka
  ☆10Updated 6 years ago
• MrPowers / gill
  An example PySpark project with pytest
  ☆17Updated 7 years ago
• abhioncbr / docker-airflow
  Repo for building docker based airflow image. Containers support multiple features like writing logs to local or S3 folder and Initializi…
  ☆32Updated 5 years ago
• eugeneyan / poc-docker-template
  Simple template showing how to set up docker for reproducible data science with Jupyter notebooks.
  ☆22Updated 4 months ago
• masfworld / cdc_deltaLake
  Docker compose and Google Colab demo to build a CDC with Delta Lake
  ☆15Updated 2 years ago
• apinf / ml-rest
  REST API (and possible UI) for Machine Learning workflows
  ☆63Updated 5 years ago
• tomaszdudek7 / airflow_project
  scaffold of Apache Airflow executing Docker containers
  ☆85Updated last year
• RichardAfolabi / Realtime-Data-Analytics-Using-Spark
  Realtime social media data analytics with Apache Spark, Python, Kafka, Pandas, etc
  ☆52Updated 8 years ago
• Wittline / pyspark-on-aws-emr
  The goal of this project is to offer an AWS EMR template using Spot Fleet and On-Demand Instances that you can use quickly. Just focus on…
  ☆25Updated 2 years ago
• opeyemibami / TDD-in-MLOps
  This repo is an approach to TDD in machine learning model operation. it covers project structure, testing essentials using pytest with Gi…
  ☆14Updated 3 years ago