vergili / bigdata_tutorial

Related projects: ⓘ

• mjhea0 / flask-spark-docker
  Just a boilerplate for PySpark and Flask
  ☆35Updated 6 years ago
• dataquestio / analytics_pipeline
  Code to build a simple analytics data pipeline with Python
  ☆102Updated 7 years ago
• ananthdurai / airflow-training
  Airflow training for the crunch conf
  ☆105Updated 5 years ago
• geosolutions-it / evo-odas
  Code Repository for the EVO-ODAS
  ☆31Updated 6 years ago
• mdh266 / AirflowETL
  Blog post on ETL pipelines with Airflow
  ☆23Updated 4 years ago
• kadnan / Calories-Alert-Kafka
  Simple alert system implemented in Kafka and Python
  ☆93Updated 6 years ago
• deliveryhero / pyconde2019-airflow-ml-workshop
  PyConDE & PyData Berlin 2019 Airflow Workshop: Airflow for machine learning pipelines.
  ☆47Updated last year
• astronomer / webinar-dag-writing-best-practices
  ☆48Updated 2 years ago
• astronomer / airflow-covid-data
  Sample Airflow DAGs to load data from the CovidTracking API to Snowflake via an AWS S3 intermediary.
  ☆16Updated 3 years ago
• daddydrac / PySpark-Confluent-Kafka-Apache-Drill-
  A code-based tutorial for production level data streaming with PySpark plus Optimus for data cleaning, Confluent Kafka, & Apache Drill u…
  ☆26Updated 5 years ago
• iamaaronknight / luigi-exercise-template
  ☆22Updated this week
• mikeghen / airflow-tutorial
  Use Airflow to move data from multiple MySQL databases to BigQuery
  ☆99Updated 4 years ago
• MrPowers / gill
  An example PySpark project with pytest
  ☆17Updated 6 years ago
• atlanhq / airflow_blog
  Code that goes along with https://humansofdata.atlan.com/2018/06/apache-airflow-disease-outbreaks-india/
  ☆24Updated last year
• benjigoldberg / udacity-airflow
  Udacity Data Pipeline Exercises
  ☆15Updated 4 years ago
• kadnan / Airflow-Tutorial
  Basic tutorial of using Apache Airflow
  ☆35Updated 5 years ago
• trallard / airflow-tutorial
  🐍💨 Airflow tutorial for PyCon 2019
  ☆85Updated last year
• kaantas / spark-twitter-sentiment-analysis
  Sentiment Analysis of a Twitter Topic with Spark Structured Streaming
  ☆54Updated 5 years ago
• omidvd79 / Big_Data_Demystified
  Big Data Demystified meetup and blog examples
  ☆31Updated last month
• postrational / airflow_tutorial
  ☆54Updated 5 years ago
• shlin168 / airflow-event-plugins
  event-triggered plugins for airflow
  ☆21Updated 4 years ago
• Soluto / spark-submit-with-pyspark-template
  ☆39Updated this week
• mdh266 / AirflowDataPipeline
  Example of an ETL Pipeline using Airflow
  ☆31Updated 7 years ago
• AnalyticsInsightsNinja / Python_TidyData
  How to use Python to understand data and transform the data into a tidy format ready to be used for modelling and visualisation.
  ☆37Updated 5 years ago
• Data-Engineer-Camp / modern-elt-demo
  A modern ELT demo using airbyte, dbt, snowflake and dagster
  ☆22Updated last year
• rbmayer / Udacity-Data-Engineering-Nanodegree
  Udacity Data Engineering Nanodegree Projects
  ☆11Updated 5 years ago
• richardanaya / spark_delta_lake
  ☆16Updated 4 years ago
• dimajix / spark-training
  Repository used for Spark Trainings
  ☆53Updated last year
• astronomer / airflow-data-quality-demo
  A repository of sample code to show data quality checking best practices using Airflow.
  ☆71Updated last year
• patvarilly / python-and-spark-for-data-analysis
  A four-day course on Python, the Scientific Python stack and PySpark, adapted from a training course I gave to one of our clients in Dece…
  ☆10Updated 8 years ago