Banana1206 / TikiAPI-WebScrapingLinks
Crawl data from the TIKI e-commerce, designing a data warehouse, implementing an ETL (Extract, Transform, Load) process, and loading the data into MySQL.
☆15Updated 2 years ago
Alternatives and similar repositories for TikiAPI-WebScraping
Users that are interested in TikiAPI-WebScraping are comparing it to the libraries listed below
Sorting:
- ELT Data Pipeline implementation in Data Warehousing environment☆25Updated 4 months ago
- Nyc_Taxi_Data_Pipeline - DE Project☆122Updated 11 months ago
- Realtime Data Engineering Project☆30Updated 8 months ago
- Sample code and documentation for very basic things that I can't remember but want to aggregate in one place☆14Updated 3 years ago
- Analyzing Spotify Data with Pyspark and ETL Procedures☆23Updated 11 months ago
- Đồ án tốt nghiệp | Data Lakehouse☆22Updated last year
- End to end data engineering project with kafka, airflow, spark, postgres and docker.☆101Updated 6 months ago
- ☆204Updated 2 years ago
- YouTube tutorial project☆105Updated last year
- ☆22Updated 4 years ago
- ☆17Updated last year
- Get data from API, run a scheduled script with Airflow, send data to Kafka and consume with Spark, then write to Cassandra☆143Updated 2 years ago
- Price Crawler - Tracking Price Inflation☆187Updated 5 years ago
- Data Engineering YouTube Analysis Project by Darshil Parmar☆206Updated last year
- This project provides a comprehensive data pipeline solution to extract, transform, and load (ETL) Reddit data into a Redshift data wareh…☆156Updated last year
- ☆290Updated last year
- This repository is to show my Data Analytics & Engineering skills, share projects, and track my progress.☆57Updated 2 years ago
- On-premises ELT Pipeline☆28Updated 2 months ago
- A custom end-to-end analytics platform for customer churn☆11Updated 4 months ago
- ☆19Updated last year
- An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Ka…☆274Updated 7 months ago
- ☆17Updated 2 years ago
- ☆142Updated 2 years ago
- An end-to-end data engineering pipeline that fetches real-time YouTube analytics and streams them through Kafka for processing with ksqlD…☆12Updated 2 years ago
- This is a simple ETL project with Python :)☆31Updated 2 years ago
- Classwork projects and home works done through Udacity data engineering nano degree☆74Updated last year
- IBM Data Engineering Courses from Coursera☆71Updated 2 years ago
- Series follows learning from Apache Spark (PySpark) with quick tips and workaround for daily problems in hand☆55Updated last year
- This repository contains the code for a realtime election voting system. The system is built using Python, Kafka, Spark Streaming, Postgr…☆41Updated last year
- End-to-end data platform: A PoC Data Platform project utilizing modern data stack (Spark, Airflow, DBT, Trino, Lightdash, Hive metastore,…☆43Updated 11 months ago