Wittline / data-engineering-challenge-th
Dockerizing a Python Script for Web Scraping and consume the scraped data using FastApi (www.metroscubicos.com)
☆14Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for data-engineering-challenge-th
- This project is for demonstrating knowledge of Data Engineering tools and concepts and also learning in the process☆45Updated last year
- Price Crawler - Tracking Price Inflation☆184Updated 4 years ago
- Challenge Data Engineer☆25Updated 2 years ago
- Data pipeline performing ETL to AWS Redshift using Spark, orchestrated with Apache Airflow☆133Updated 4 years ago
- A template repository to create a data project with IAC, CI/CD, Data migrations, & testing☆241Updated 4 months ago
- ☆171Updated 3 years ago
- ☆86Updated 2 years ago
- ☆128Updated last year
- ☆132Updated 2 years ago
- ☆113Updated last month
- End to end data engineering project☆51Updated 2 years ago
- Data Engineering with Google Cloud Platform, published by Packt☆109Updated last year
- Repo for saving cheat sheets☆42Updated 5 months ago
- Learn the entire ETL process based on Spotify API data☆247Updated 3 years ago
- All important Python tools a Data Engineer needs☆22Updated 5 months ago
- Streaming data from a transactional database to a data warehouse using Kafka (Confluent Cloud), Snowflake, and PostgreSQL.☆13Updated last year
- YouTube tutorial project☆94Updated last year
- The goal of this project is to track the expenses of Uber Rides and Uber Eats through data Engineering processes using technologies such …☆116Updated 2 years ago
- Sample project to demonstrate data engineering best practices☆166Updated 8 months ago
- Docker with Airflow and Spark standalone cluster☆246Updated last year
- Data lake, data warehouse on GCP☆54Updated 2 years ago
- Template for Data Engineering and Data Pipeline projects☆104Updated last year
- Hey this is the repo that has all the queries and data for my video game training series!☆133Updated 2 years ago
- This repository goes over how to handle massive variety in data engineering☆121Updated last year
- Pipeline that extracts data from the Spotify API to build a more detailed version of Spotify Wrapped☆31Updated last year
- Code for blog at https://www.startdataengineering.com/post/python-for-de/☆55Updated 5 months ago
- Produce Kafka messages, consume them and upload into Cassandra, MongoDB.☆37Updated last year
- Grupo de estudio Apache Airflow organizado por la comunidad Data Engineering Latam☆15Updated 10 months ago
- Data Engineering YouTube Analysis Project by Darshil Parmar☆138Updated 11 months ago