salahdev8 / NYYellowTaxiProjectLinks
Big Data project using Hadoop (MapReduce, spark, Hive)
☆31Updated 5 years ago
Alternatives and similar repositories for NYYellowTaxiProject
Users that are interested in NYYellowTaxiProject are comparing it to the libraries listed below
Sorting:
- Data Engineering Capstone Project: ETL Pipelines and Data Warehouse Development☆21Updated 5 years ago
- ☆21Updated 2 years ago
- ☆28Updated last year
- A Python package that creates fine-grained dbt tasks on Apache Airflow☆12Updated last year
- Simple ETL pipeline using Python☆26Updated 2 years ago
- DataTalks.Club's Data Engineering Zoomcamp Project☆23Updated 2 years ago
- This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which…☆98Updated 10 months ago
- Classwork projects and home works done through Udacity data engineering nano degree☆74Updated last year
- A batch processing data pipeline, using AWS resources (S3, EMR, Redshift, EC2, IAM), provisioned via Terraform, and orchestrated from loc…☆22Updated 3 years ago
- Writes the CSV file to Postgres, read table and modify it. Write more tables to Postgres with Airflow.☆35Updated last year
- Real World Project on Formula1 Racing using Azure Databricks, Delta Lake and Azure Data Factory☆13Updated last year
- Repository related to Spark SQL and Pyspark using Python3☆38Updated 2 years ago
- Resources and projects from Udacity Data Engineering with AWS nano degree programme☆25Updated 2 years ago
- ☆15Updated last year
- In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data fro…☆22Updated 2 years ago
- Developed an ETL pipeline for a Data Lake that extracts data from S3, processes the data using Spark, and loads the data back into S3 as …☆16Updated 5 years ago
- This repository contains the code for a realtime election voting system. The system is built using Python, Kafka, Spark Streaming, Postgr…☆39Updated last year
- ☆87Updated 2 years ago
- A course by DataTalks Club that covers Spark, Kafka, Docker, Airflow, Terraform, DBT, Big Query etc☆13Updated 3 years ago
- Data Streaming Nanodegree (from Udacity) exercises, projects and their solutions☆17Updated last year
- AlvinToh Learning Repository for The Ultimate Hands-On Hadoop - Tame your Big Data!☆11Updated 7 years ago
- Built a Data Pipeline for a Retail store using AWS services that collects data from its transactional database (OLTP) in Snowflake and tr…☆9Updated 2 years ago
- ☆12Updated 4 years ago
- A production-grade data pipeline has been designed to automate the parsing of user search patterns to analyze user engagement. Extract d…☆24Updated 3 years ago
- reating a modern data pipeline using a combination of Terraform, AWS Lambda and S3, Snowflake, DBT, Mage AI, and Dash.☆14Updated last year
- ☆21Updated last year
- Data Engineering, Data Warehouse, Data Mart, Cloud Data, AWS, SAS, Redshift, S3☆30Updated 4 years ago
- Final Project of the MLOps Zoomcamp hosted by DataTalksClub.☆26Updated 2 years ago
- In this project, we setup and end to end data engineering using Apache Spark, Azure Databricks, Data Build Tool (DBT) using Azure as our …☆31Updated last year
- Repository for Data Engineering Interview Series☆31Updated 7 months ago