brfulu / airflow-data-pipeline
Udacity Data Engineer Nanodegree - Airflow data pipeline
☆10Updated 5 years ago
Alternatives and similar repositories for airflow-data-pipeline:
Users that are interested in airflow-data-pipeline are comparing it to the libraries listed below
- Udacity Data Engineer Nano Degree - Project-3 (Data Warehouse)☆22Updated 5 years ago
- Repository used for Spark Trainings☆53Updated last year
- Udacity Data Engineer Nanodegree - Capstone project☆11Updated 5 years ago
- Quickstart PySpark with Anaconda on AWS/EMR using Terraform☆47Updated 2 months ago
- Udacity Data Pipeline Exercises☆15Updated 4 years ago
- My solutions for the Udacity Data Engineering Nanodegree☆33Updated 5 years ago
- ☆16Updated last year
- A code-based tutorial for production level data streaming with PySpark plus Optimus for data cleaning, Confluent Kafka, & Apache Drill u…☆26Updated 5 years ago
- Project files for the post: Running PySpark Applications on Amazon EMR using Apache Airflow: Using the new Amazon Managed Workflows for A…☆40Updated 2 years ago
- Udacity Data Engineering Nanodegree Projects☆11Updated 5 years ago
- AWS Glue tutorial for data developers.☆23Updated 5 years ago
- Data models, build data warehouses and data lakes, automate data pipelines, and worked with massive datasets.☆13Updated 5 years ago
- AWS Big Data Certification☆25Updated 2 months ago
- RedditR for Content Engagement and Recommendation☆21Updated 7 years ago
- Data Engineering pipeline hosted entirely in the AWS ecosystem utilizing DocumentDB as the database☆13Updated 3 years ago
- A way for home buyers to know about factors affecting a state☆47Updated 6 years ago
- Airflow training for the crunch conf☆105Updated 6 years ago
- An example PySpark project with pytest☆17Updated 7 years ago
- Batch Processing , orchestration using Apache Airflow and Google Workflows, spark structured Streaming and a lot more☆19Updated 2 years ago
- Contains source files used in the Spark with Python course☆18Updated 5 years ago
- Code for my blogs on Data Engineering☆15Updated 4 years ago
- How to build an awesome data engineering team☆100Updated 5 years ago
- ☆34Updated 2 years ago
- Blog post on ETL pipelines with Airflow☆23Updated 4 years ago
- Spark and Python (PySpark) Examples☆39Updated 3 years ago
- Build end-to-end Machine Learning pipeline to predict accessibility of playgrounds in NYC☆15Updated 4 years ago
- A real-time event pipeline around Kafka Ecosystem for Chicago Transit Authority.☆30Updated last year
- A simple introduction to using spark ml pipelines☆26Updated 6 years ago
- (project & tutorial) dag pipeline tests + ci/cd setup☆86Updated 4 years ago
- 😈Complete End to End ETL Pipeline with Spark, Airflow, & AWS☆45Updated 5 years ago