darshilparmar / twitter-airflow-data-engineering-projectView external linksLinks
YouTube tutorial project
☆108Oct 17, 2023Updated 2 years ago
Alternatives and similar repositories for twitter-airflow-data-engineering-project
Users that are interested in twitter-airflow-data-engineering-project are comparing it to the libraries listed below
Sorting:
- ☆212Aug 13, 2023Updated 2 years ago
- sql-for-data-engineering-course☆18May 12, 2023Updated 2 years ago
- ☆316Aug 13, 2024Updated last year
- Business challenge that requires building a data platform for retailer data analytics.☆16Feb 19, 2023Updated 2 years ago
- I am using confluent Kafka cluster to produce and consume scraped data. In this project, I've created a real-time data pipeline that uti…☆29May 2, 2023Updated 2 years ago
- ☆59Sep 17, 2023Updated 2 years ago
- This project involves an ETL (Extract, Transform, Load) process to analyze sleep data exported from Apple Health☆29Apr 29, 2023Updated 2 years ago
- This repo contains all the code used in the Python for Data Engineering Course☆336Apr 24, 2024Updated last year
- In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data fro…☆25May 6, 2023Updated 2 years ago
- tokyo-olympic-azure-data-engineering-project☆221Jul 16, 2024Updated last year
- data-warehouse-snowflake-for-data-engineering☆19Sep 14, 2023Updated 2 years ago
- ☆22Sep 26, 2021Updated 4 years ago
- End-to-end ELT data engineering project☆22Dec 24, 2022Updated 3 years ago
- ☆19Feb 28, 2022Updated 3 years ago
- ☆17May 26, 2023Updated 2 years ago
- Capstone Project for the IBM Data Engineering Professional Certification.☆13Mar 7, 2022Updated 3 years ago
- Sample project to demonstrate data engineering best practices☆202Feb 24, 2024Updated last year
- This data project can be used as a take-home assignment to learn Pyspark and Data Engineering.☆17Feb 19, 2023Updated 2 years ago
- This repo is for the Linkedin Learning course: End-to-End Data Engineering Project☆28Nov 9, 2023Updated 2 years ago
- reating a modern data pipeline using a combination of Terraform, AWS Lambda and S3, Snowflake, DBT, Mage AI, and Dash.☆15Jun 26, 2023Updated 2 years ago
- a simple machine learning pipeline built using Apache AirFlow☆15Nov 22, 2022Updated 3 years ago
- ☆30Jul 26, 2022Updated 3 years ago
- Simple ETL pipeline using Python☆29May 22, 2023Updated 2 years ago
- Sample Faust project to process tweets in real-time☆13Mar 29, 2021Updated 4 years ago
- ☆147Jan 31, 2023Updated 3 years ago
- This project shows how to capture changes from postgres database and stream them into kafka☆41May 17, 2024Updated last year
- End to end data engineering project with kafka, airflow, spark, postgres and docker.☆108Jan 8, 2026Updated last month
- Final Project for IoT: Big Data Processing and Analytics class. Analyzing U.S nationwide temperature from IoT sensors in real-time☆71Nov 21, 2016Updated 9 years ago
- ☆16May 29, 2023Updated 2 years ago
- From Scratch Implementation of some popular Deep Learning Papers with PyTorch and Tensorflow☆18Mar 15, 2023Updated 2 years ago
- Deep Learning Projects on TensorFlow and Keras☆20Jun 13, 2024Updated last year
- ☆19Apr 21, 2024Updated last year
- A collection of data engineering projects: data modeling, ETL pipelines, data lakes, infrastructure configuration on AWS, data warehousin…☆15Apr 29, 2021Updated 4 years ago
- ☆19Apr 3, 2024Updated last year
- Example end to end data engineering project.☆1,384Dec 8, 2022Updated 3 years ago
- My Data Engineer Capstone project. A consolidated dataset with several jobs around the world.☆13May 22, 2023Updated 2 years ago
- ☆21Nov 21, 2023Updated 2 years ago
- iNeuron BusinessIntelligence Internship: End to End Project on Budget Sales Analysis☆19Sep 5, 2022Updated 3 years ago
- Udacity Data Engineering Nanodegree Capstone Project☆37May 9, 2020Updated 5 years ago