With everything I learned from DEZoomcamp from datatalks.club, this project performs a batch processing on AWS for the cycling dataset which is available on Transport For London (TFL) website. https://cycling.data.tfl.gov.uk
☆15Jan 4, 2026Updated 10 months ago
Alternatives and similar repositories for batch-processing-on-aws
Users that are interested in batch-processing-on-aws are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆36Jun 3, 2023Updated 3 years ago
- DataTalks.Club's Data Engineering Zoomcamp Project☆25Jul 14, 2022Updated 4 years ago
- Python or SQL for data transformation☆11Jul 4, 2024Updated 2 years ago
- Big Data Engineering practice project, including ETL with Airflow and Spark using AWS S3 and EMR☆91Jul 17, 2019Updated 7 years ago
- ☆15Mar 15, 2024Updated 2 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- StreamSoft enables real-time analysis of any stock market☆14Apr 24, 2024Updated 2 years ago
- End to end data engineering project☆60Oct 27, 2022Updated 4 years ago
- A batch Data Pipeline that retrieves data from a user purchase table and a movie review table and is transformed to form a user behaviour…☆18Aug 14, 2025Updated last year
- ☆12Mar 6, 2021Updated 5 years ago
- Toolset for detecting reflected xss in websites☆16Oct 6, 2018Updated 8 years ago
- A simple pipeline utilising cron, Postgres, AWS EC2, and Metabase☆13Jul 9, 2024Updated 2 years ago
- An end-to-end AWS data lakehouse leveraging batch data processing, big data technologies, and advanced business analytics.☆11Feb 12, 2026Updated 9 months ago
- ☆12Jan 14, 2023Updated 3 years ago
- An Internet of Things server built with Django and Python☆25Dec 8, 2022Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- TrafficAdvisor: a Real-Time Traffic Monitoring System☆13Sep 10, 2018Updated 8 years ago
- real time log event processing using spark, kafka & cassandra☆13Dec 4, 2014Updated 11 years ago
- Fundamentals of Apache Flink [video], published by Packt☆12Jan 30, 2023Updated 3 years ago
- ☆12Apr 3, 2026Updated 7 months ago
- MLOps Zoomcamp 2023 repository for Module 3☆11Jun 1, 2023Updated 3 years ago
- Implementation of Redis (Lite) Server in Java, that supports RESP v2 protocol and a subset of Redis commands☆11Apr 3, 2026Updated 7 months ago
- Building pipeline to process the real-time data using Spark and Mongodb.☆12Oct 30, 2019Updated 7 years ago
- resources to create an environment to experiement with Iceberg using Flink, Spark, and Dremio☆10Oct 11, 2023Updated 3 years ago
- A Retrieval-Augmented Generation (RAG) based chatbot system for e-commerce product search and order management. The system provides seman…☆15Nov 25, 2025Updated 11 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Semantic subtitle aligner and merger for bilingual subtitle syncing.☆15Oct 10, 2026Updated last month
- A demonstration of an ELT (Extract, Load, Transform) pipeline☆32Feb 19, 2024Updated 2 years ago
- Simple stream processing pipeline☆115Jun 17, 2024Updated 2 years ago
- AWS IoT Services sample codes. these will be used in AWS IoT hands-on/workshops in Japan.☆11Jan 14, 2021Updated 5 years ago
- An API that analyses the housing market real time and presents market opportunities☆28Dec 20, 2022Updated 3 years ago
- ☆12Updated this week
- ☆30Nov 16, 2023Updated 3 years ago
- ☆20May 11, 2023Updated 3 years ago
- ☆16Aug 5, 2023Updated 3 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- A simple script for backing up your favorite YouTube channels.☆12Jan 27, 2024Updated 2 years ago
- ETL flow framework based on Yaml configs in Python☆22Oct 21, 2023Updated 3 years ago
- all things related to Uniswap V3 pools and liquidity provision strategies☆15May 23, 2023Updated 3 years ago
- Simplify Big Data Analytics with Amazon EMR, published by Packt☆13Jan 18, 2023Updated 3 years ago
- ☆15Aug 3, 2022Updated 4 years ago
- ☆14Jan 3, 2020Updated 6 years ago
- This repository contains the code snippets used in "LLM Prompt Engineering For Developers"☆14Apr 22, 2024Updated 2 years ago
Are these results useful?