mdh266 / AirflowDataPipeline

Related projects: ⓘ

• mdh266 / AirflowETL
  Blog post on ETL pipelines with Airflow
  ☆23Updated 4 years ago
• trallard / airflow-tutorial
  🐍💨 Airflow tutorial for PyCon 2019
  ☆85Updated last year
• ananthdurai / airflow-training
  Airflow training for the crunch conf
  ☆105Updated 5 years ago
• dataquestio / analytics_pipeline
  Code to build a simple analytics data pipeline with Python
  ☆102Updated 7 years ago
• marcosmarxm / airflow-testing-ci-workflow
  (project & tutorial) dag pipeline tests + ci/cd setup
  ☆84Updated 3 years ago
• danclark5 / pytesting_db
  Sample pytest tests for testing SQL Server assests.
  ☆45Updated 5 years ago
• kadnan / airflow-scraping
  Using Apache Airflow to schedule web scrapers
  ☆42Updated 5 years ago
• vergili / bigdata_tutorial
  ☆16Updated 6 years ago
• cmuth001 / Data-Engineer-Nano-Degree
  Data models, build data warehouses and data lakes, automate data pipelines, and worked with massive datasets.
  ☆13Updated 5 years ago
• iamaaronknight / luigi-exercise-template
  ☆22Updated this week
• erood / interviewqs.com_code_snippets
  ☆47Updated 2 years ago
• josephwibowo / MeetBaeArea
  Airflow ETL for Meetup API
  ☆47Updated 5 years ago
• Sean-Bradley / Stream-Data-From-Flask-To-Postgres
  A tutorial on streaming data from a Flask REST API and streaming the response into PostgreSQL
  ☆39Updated 4 years ago
• deliveryhero / pyconde2019-airflow-ml-workshop
  PyConDE & PyData Berlin 2019 Airflow Workshop: Airflow for machine learning pipelines.
  ☆47Updated last year
• AnalyticsInsightsNinja / Python_TidyData
  How to use Python to understand data and transform the data into a tidy format ready to be used for modelling and visualisation.
  ☆37Updated 5 years ago
• dimgold / ETL_with_Python
  ETL with Python - Taught at DWH course 2017 (TAU)
  ☆101Updated 7 years ago
• daddydrac / PySpark-Confluent-Kafka-Apache-Drill-
  A code-based tutorial for production level data streaming with PySpark plus Optimus for data cleaning, Confluent Kafka, & Apache Drill u…
  ☆26Updated 5 years ago
• kadnan / Calories-Alert-Kafka
  Simple alert system implemented in Kafka and Python
  ☆93Updated 6 years ago
• jacobceles / intro-to-colab-pyspark-emr
  A tutorial that helps Big Data Engineers ramp up faster by getting familiar with PySpark dataframes and functions. It also covers topics …
  ☆17Updated 2 years ago
• ddgope / Data-Pipelines-with-Airflow
  This project helps me to understand the core concepts of Apache Airflow. I have created custom operators to perform tasks such as staging…
  ☆69Updated 5 years ago
• airflow-plugins / mongo_plugin
  ☆23Updated 5 years ago
• sizrailev / life-around-data-code
  Code snippets and tools published on the blog at lifearounddata.com
  ☆12Updated 4 years ago
• rbmayer / Udacity-Data-Engineering-Nanodegree
  Udacity Data Engineering Nanodegree Projects
  ☆11Updated 5 years ago
• mjhea0 / flask-spark-docker
  Just a boilerplate for PySpark and Flask
  ☆35Updated 6 years ago
• tdpetrou / integrating-pandas-with-scikit-learn
  Tutorial covering a new workflow available going from pandas to scikit-learn
  ☆40Updated last year
• rich-iannone / so-many-pyspark-examples
  Spark and Python (PySpark) Examples
  ☆39Updated 3 years ago
• BenSchr / Udacity-Data-Engineering-Projects
  My solutions for the Udacity Data Engineering Nanodegree
  ☆33Updated 4 years ago
• MrPowers / gill
  An example PySpark project with pytest
  ☆17Updated 6 years ago
• kadnan / Airflow-Tutorial
  Basic tutorial of using Apache Airflow
  ☆35Updated 5 years ago
• nareshk1290 / dataquest-DE
  Data Quest - Data Engineer Learning and Projects
  ☆24Updated 5 years ago