vergili / bigdata_tutorial
☆16Updated 7 years ago
Alternatives and similar repositories for bigdata_tutorial:
Users that are interested in bigdata_tutorial are comparing it to the libraries listed below
- Code to build a simple analytics data pipeline with Python☆102Updated 7 years ago
- Just a boilerplate for PySpark and Flask☆35Updated 6 years ago
- scaffold of Apache Airflow executing Docker containers☆85Updated 2 years ago
- Blog post on ETL pipelines with Airflow☆23Updated 4 years ago
- 🐍💨 Airflow tutorial for PyCon 2019☆85Updated 2 years ago
- Example of an ETL Pipeline using Airflow☆33Updated 7 years ago
- Airflow training for the crunch conf☆105Updated 6 years ago
- Use Airflow to move data from multiple MySQL databases to BigQuery☆100Updated 4 years ago
- How to do data science with Optimus, Spark and Python.☆19Updated 5 years ago
- PyConDE & PyData Berlin 2019 Airflow Workshop: Airflow for machine learning pipelines.☆46Updated last year
- Code Repository for the EVO-ODAS☆31Updated 7 years ago
- Code for my presentation: Using PySpark to Process Boat Loads of Data☆20Updated 7 years ago
- ☆49Updated 3 years ago
- Big Data Demystified meetup and blog examples☆31Updated 6 months ago
- A modern ELT demo using airbyte, dbt, snowflake and dagster☆26Updated 2 years ago
- Material for Talk Python Training course on Getting Started with Dask.☆28Updated 2 years ago
- Basic tutorial of using Apache Airflow☆36Updated 6 years ago
- PySpark phonetic and string matching algorithms☆39Updated 11 months ago
- REST-like API exposing Airflow data and operations☆61Updated 6 years ago
- ☆16Updated 4 years ago
- ☆40Updated 3 years ago
- Data models, build data warehouses and data lakes, automate data pipelines, and worked with massive datasets.☆13Updated 5 years ago
- Simple alert system implemented in Kafka and Python☆95Updated 6 years ago
- Source code for the MC technical blog post "Data Observability in Practice Using SQL"☆36Updated 6 months ago
- A repository of sample code to show data quality checking best practices using Airflow.☆74Updated last year
- Using Luigi to create a Machine Learning Pipeline using the Rossman Sales data from Kaggle☆33Updated 8 years ago
- Airflow workflow management platform chef cookbook.☆71Updated 5 years ago
- Full stack data engineering tools and infrastructure set-up☆48Updated 4 years ago
- Data validation library for PySpark 3.0.0☆34Updated 2 years ago
- Repo for building docker based airflow image. Containers support multiple features like writing logs to local or S3 folder and Initializi…☆32Updated 5 years ago