vergili / bigdata_tutorial
☆16Updated 7 years ago
Alternatives and similar repositories for bigdata_tutorial:
Users that are interested in bigdata_tutorial are comparing it to the libraries listed below
- 🐍💨 Airflow tutorial for PyCon 2019☆86Updated 2 years ago
- Blog post on ETL pipelines with Airflow☆23Updated 4 years ago
- Just a boilerplate for PySpark and Flask☆35Updated 6 years ago
- Code to build a simple analytics data pipeline with Python☆102Updated 8 years ago
- Example of an ETL Pipeline using Airflow☆34Updated 7 years ago
- Airflow training for the crunch conf☆105Updated 6 years ago
- How to use Python to understand data and transform the data into a tidy format ready to be used for modelling and visualisation.☆37Updated 5 years ago
- Big Data Demystified meetup and blog examples☆31Updated 8 months ago
- ☆49Updated 3 years ago
- scaffold of Apache Airflow executing Docker containers☆85Updated 2 years ago
- Material for Talk Python Training course on Getting Started with Dask.☆28Updated 2 years ago
- Code Repository for the EVO-ODAS☆31Updated 7 years ago
- A modern ELT demo using airbyte, dbt, snowflake and dagster☆27Updated 2 years ago
- A repository of sample code to show data quality checking best practices using Airflow.☆77Updated 2 years ago
- Airflow ETL for Meetup API☆46Updated 6 years ago
- ☆54Updated 6 years ago
- Full stack data engineering tools and infrastructure set-up☆52Updated 4 years ago
- Use Airflow to move data from multiple MySQL databases to BigQuery☆100Updated 4 years ago
- Batch Processing , orchestration using Apache Airflow and Google Workflows, spark structured Streaming and a lot more☆19Updated 2 years ago
- A tutorial for using Hadoop with Python and Hive☆10Updated 9 years ago
- Code for my presentation: Using PySpark to Process Boat Loads of Data☆20Updated 7 years ago
- (project & tutorial) dag pipeline tests + ci/cd setup☆87Updated 4 years ago
- Repository used for Spark Trainings☆53Updated 2 years ago
- How to do data science with Optimus, Spark and Python.☆19Updated 5 years ago
- Data validation library for PySpark 3.0.0☆33Updated 2 years ago
- Repo for building docker based airflow image. Containers support multiple features like writing logs to local or S3 folder and Initializi…☆32Updated 5 years ago
- PyConDE & PyData Berlin 2019 Airflow Workshop: Airflow for machine learning pipelines.☆47Updated last year
- Code that goes along with https://humansofdata.atlan.com/2018/06/apache-airflow-disease-outbreaks-india/☆24Updated last year
- Public source code for the Udemy online course Apache Airflow: Complete Hands-On Beginner to Advanced Class.☆63Updated 4 years ago
- ETL with Python - Taught at DWH course 2017 (TAU)☆103Updated 7 years ago