mdh266 / AirflowETL
Blog post on ETL pipelines with Airflow
☆23Updated 4 years ago
Alternatives and similar repositories for AirflowETL:
Users that are interested in AirflowETL are comparing it to the libraries listed below
- Example of an ETL Pipeline using Airflow☆34Updated 7 years ago
- How to use Python to understand data and transform the data into a tidy format ready to be used for modelling and visualisation.☆37Updated 5 years ago
- A modern ELT demo using airbyte, dbt, snowflake and dagster☆27Updated 2 years ago
- ☆19Updated 4 years ago
- Big Data Demystified meetup and blog examples☆31Updated 8 months ago
- ☆18Updated 3 years ago
- ☆84Updated 2 years ago
- PyConDE & PyData Berlin 2019 Airflow Workshop: Airflow for machine learning pipelines.☆47Updated last year
- Snowflake Guide: Building a Recommendation Engine Using Snowflake & Amazon SageMaker☆31Updated 3 years ago
- This is a repository for the Duke University Cloud Computing course project on Serveless Data Engineering Pipeline. For this project, I r…☆19Updated 4 years ago
- How to do data science with Optimus, Spark and Python.☆19Updated 5 years ago
- Source code for the MC technical blog post "Data Observability in Practice Using SQL"☆38Updated 9 months ago
- Data models, build data warehouses and data lakes, automate data pipelines, and worked with massive datasets.☆13Updated 5 years ago
- A tutorial that helps Big Data Engineers ramp up faster by getting familiar with PySpark dataframes and functions. It also covers topics …☆20Updated 3 years ago
- ☆12Updated 3 years ago
- (project & tutorial) dag pipeline tests + ci/cd setup☆87Updated 4 years ago
- Code snippets and tools published on the blog at lifearounddata.com☆12Updated 5 years ago
- A code-based tutorial for production level data streaming with PySpark plus Optimus for data cleaning, Confluent Kafka, & Apache Drill u…☆26Updated 5 years ago
- "Building a Recommender System from Scratch" Workshop Material for PyDataDC 2018☆24Updated 6 years ago
- Automated Exploratory Data Analysis. Simplifying Data Exploration☆35Updated 4 years ago
- ☆16Updated 7 years ago
- Predicting the Likelihood to Purchase a Financial Product Following a Direct Marketing Campaign☆27Updated 2 years ago
- Spark NLP for Streamlit☆15Updated 3 years ago
- Demo on how to use Prefect with Docker☆25Updated 2 years ago
- Full stack data engineering tools and infrastructure set-up☆52Updated 4 years ago
- Build your feature store with macros right within your dbt repository☆38Updated 2 years ago
- Code to build a simple analytics data pipeline with Python☆102Updated 8 years ago
- Tutorial covering a new workflow available going from pandas to scikit-learn☆40Updated 2 years ago
- ☆22Updated 2 years ago
- Cost Efficient Data Pipelines with DuckDB☆52Updated 9 months ago