Banana1206 / TikiAPI-WebScraping
Crawl data from the TIKI e-commerce, designing a data warehouse, implementing an ETL (Extract, Transform, Load) process, and loading the data into MySQL.
☆14Updated last year
Related projects ⓘ
Alternatives and complementary repositories for TikiAPI-WebScraping
- Machine Translation using Seq2Seq and Transformer Models☆12Updated last year
- Sample code and documentation for very basic things that I can't remember but want to aggregate in one place☆13Updated 3 years ago
- Nyc_Taxi_Data_Pipeline - DE Project☆85Updated last month
- ☆225Updated 3 months ago
- ☆22Updated 3 years ago
- ☆182Updated last year
- ☆18Updated 10 months ago
- My documents for self-learning fundamental of Data engineering skills☆11Updated last year
- Welcome to my data engineering projects repository! Here you will find a collection of data engineering projects that I have worked on.☆15Updated last year
- All of my individual learning materials, documents, and notes from the process of getting the Coursera IBM Data Engineer Professional Cer…☆80Updated last year
- An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Ka…☆204Updated last year
- Writes the CSV file to Postgres, read table and modify it. Write more tables to Postgres with Airflow.☆35Updated last year
- ☆44Updated 3 months ago
- End to end data engineering project with kafka, airflow, spark, postgres and docker.☆67Updated 3 months ago
- This repository contains the code for a realtime election voting system. The system is built using Python, Kafka, Spark Streaming, Postgr…☆32Updated 11 months ago
- Data Engineering Project with Hadoop HDFS and Kafka☆32Updated last year
- ☆27Updated 8 months ago
- Building ETL Pipelines with Python☆106Updated 4 months ago
- DataTalks.Club's Data Engineering Zoomcamp Project☆22Updated 2 years ago
- Data Engineering YouTube Analysis Project by Darshil Parmar☆138Updated 11 months ago
- An end-to-end data engineering pipeline that fetches real-time YouTube analytics and streams them through Kafka for processing with ksqlD…☆10Updated last year
- 💜🌈📊 A Data Engineering Project that implements an ETL data pipeline using Dagster, Apache Spark, Streamlit, MinIO, Metabase, Dbt, Pola…☆18Updated this week
- ☆28Updated 9 months ago
- This repository will contain all of the resources for the Mage component of the Data Engineering Zoomcamp: https://github.com/DataTalksCl…☆96Updated 3 months ago
- ☆59Updated 10 months ago
- My personal project for data engineering zoomcamp☆16Updated this week
- ☆48Updated 2 months ago
- Classwork projects and home works done through Udacity data engineering nano degree☆74Updated 11 months ago
- Data Science Handbook☆259Updated 2 years ago
- This repo gives an introduction to setting up streaming analytics using open source technologies☆22Updated last year