kishlayjeet / Twitter-Data-Pipeline-using-Airflow-and-AWS-S3
An end-to-end Twitter Data Pipeline that extracts data from Twitter and loads it into AWS S3.
☆14Updated last year
Related projects ⓘ
Alternatives and complementary repositories for Twitter-Data-Pipeline-using-Airflow-and-AWS-S3
- End to End ML Project☆27Updated last year
- Data Engineering YouTube Analysis Project by Darshil Parmar☆138Updated 11 months ago
- Worked on various OTT Dataset. Used the Query Editor for data cleaning and preprocessing. Displayed the visuals using a variety of plots,…☆37Updated last year
- Project submission for data engineering zoomcamp 2023 - https://github.com/DataTalksClub/data-engineering-zoomcamp☆8Updated last year
- YouTube tutorial project☆94Updated last year
- This repo contains all the code used in the Python for Data Engineering Course☆231Updated 6 months ago
- Data analytics interview questions and answers☆58Updated 4 years ago
- ☆22Updated 3 years ago
- I'm partaking in a Data Engineering Bootcamp / Zoomcamp. I'll store files and progress here.☆99Updated 2 years ago
- iNeuron BusinessIntelligence Internship: End to End Project on Budget Sales Analysis☆15Updated 2 years ago
- Step by step instructions to create a production-ready data pipeline☆27Updated last month
- This project demonstrates how to build and automate an ETL pipeline written in Python and schedule it using open source Apache Airflow or…☆13Updated this week
- ☆224Updated 3 months ago
- This repository contains all the codes,ppts,project & interview questions which I have used in my LIVE CLASS on YouTube and any other rel…☆54Updated last week
- ☆48Updated last year
- tokyo-olympic-azure-data-engineering-project☆162Updated 4 months ago
- Cool DE Projects☆18Updated this week
- apache-spark-with-databricks-for-data-engineering☆58Updated 4 months ago
- This repo demonstrates the development of a real-time data pipeline designed to ingest, process, and analyze stock market data. Using cut…☆20Updated 2 months ago
- A data science project to predict whether a transaction is a fraud or not.☆149Updated 2 months ago
- MLOps-Roadmap-2023 is a repository that provides a comprehensive and up-to-date guide for anyone who wants to learn and master machine le…☆23Updated 6 months ago
- Working with Youtube's API to collect video statistics from a channel☆50Updated 3 years ago
- Databricks. Incremental data processing, task orchestration, and production job monitoring.☆10Updated 8 months ago
- Real World Project on Formula1 Racing using Azure Databricks, Delta Lake and Azure Data Factory☆13Updated last year
- ☆9Updated last year
- ☆16Updated 9 months ago
- For this project I am creating an ETL (Extract, Transform, and Load) pipeline using Python, RegEx, and SQL Database. The goal is to retri…☆25Updated 3 years ago
- Sample repo for startdataengineering DE 101 free course☆35Updated 4 months ago
- I am using confluent Kafka cluster to produce and consume scraped data. In this project, I've created a real-time data pipeline that uti…☆29Updated last year
- The goal of this project is to track the expenses of Uber Rides and Uber Eats through data Engineering processes using technologies such …☆116Updated 2 years ago