tatwan / airflow-spark-aws-emr
β12Updated 4 years ago
Alternatives and similar repositories for airflow-spark-aws-emr:
Users that are interested in airflow-spark-aws-emr are comparing it to the libraries listed below
- πComplete End to End ETL Pipeline with Spark, Airflow, & AWSβ45Updated 5 years ago
- β129Updated 2 months ago
- β87Updated 2 years ago
- Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflowβ144Updated 4 years ago
- End to end data engineering projectβ54Updated 2 years ago
- Big Data Engineering practice project, including ETL with Airflow and Spark using AWS S3 and EMRβ83Updated 5 years ago
- Simple stream processing pipelineβ102Updated 10 months ago
- This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics whichβ¦β98Updated 9 months ago
- Code for dbt tutorialβ157Updated 11 months ago
- YouTube tutorial projectβ101Updated last year
- β40Updated 10 months ago
- This repo contains commands that data engineers use in day to day work.β60Updated 2 years ago
- Simple ETL pipeline using Pythonβ26Updated last year
- A batch processing data pipeline, using AWS resources (S3, EMR, Redshift, EC2, IAM), provisioned via Terraform, and orchestrated from locβ¦β22Updated 2 years ago
- Solution to all projects of Udacity's Data Engineering Nanodegree: Data Modeling with Postgres & Cassandra, Data Warehouse with Redshift,β¦β56Updated 2 years ago
- Classwork projects and home works done through Udacity data engineering nano degreeβ74Updated last year
- β107Updated 3 years ago
- β51Updated last year
- β25Updated last year
- β151Updated 2 years ago
- PySpark Cheatsheetβ36Updated 2 years ago
- Sample project to demonstrate data engineering best practicesβ189Updated last year
- code snippet for analytics sessionsβ34Updated 2 years ago
- Ravi Azure ADB ADF Repositoryβ66Updated 3 months ago
- Series follows learning from Apache Spark (PySpark) with quick tips and workaround for daily problems in handβ50Updated last year
- data-warehouse-snowflake-for-data-engineeringβ17Updated last year
- Code snippets for Data Engineering Design Patterns bookβ101Updated last month
- A template repository to create a data project with IAC, CI/CD, Data migrations, & testingβ261Updated 9 months ago
- β64Updated this week
- This repo is mostly created for pyspark and hive related interview questions.β47Updated 3 years ago