This project aims to predict smartphone prices using a combination of batch and stream processing techniques in a Big Data environment. The architecture follows the Lambda Architecture pattern, providing both real-time and batch processing capabilities to users.
☆27Apr 15, 2024Updated 2 years ago
Alternatives and similar repositories for Big-Data-Project
Users that are interested in Big-Data-Project are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This project demonstrates real-time data streaming and processing architecture using Kafka, Spark Streaming, and Debezium for capturing C…☆19Oct 24, 2024Updated last year
- An interactive web application tool that enables big data visualization of the 136k+ UK Road Accidents reported during 2016.☆10Oct 19, 2022Updated 3 years ago
- COMP90024 - Cluster and Cloud Computing - 2020S1 - Assignment 1☆10Apr 24, 2020Updated 6 years ago
- DataTalks.Club's Data Engineering Zoomcamp Project☆11May 7, 2023Updated 3 years ago
- Data Streaming with Debezium, Kafka, Spark Streaming, Delta Lake, and MinIO☆15May 15, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- This project serves as a comprehensive guide to building an end-to-end data engineering pipeline using TCP/IP Socket, Apache Spark, OpenA…☆47Jan 4, 2024Updated 2 years ago
- Qs from other and my answer on them☆11Jan 27, 2024Updated 2 years ago
- An end-to-end data pipeline for building Data Lake and supporting report using Apache Spark.☆16Jan 31, 2023Updated 3 years ago
- 🎊🎉I designed this stuff for web developer community 🧑💻 to choose best color palette for their web sites☆12Dec 30, 2022Updated 3 years ago
- ☆10Aug 19, 2024Updated 2 years ago
- This API is built using django rest framework and has all the features (Vendor and Customer) of a food delivery app, say Zomato.☆10Jun 21, 2021Updated 5 years ago
- My personal project for data engineering zoomcamp☆18Dec 13, 2024Updated last year
- ☆11Apr 1, 2022Updated 4 years ago
- ☆23Feb 8, 2023Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Solution to the Soccernet 2024 Dense video captioning task from CVPR workshop☆13Jul 1, 2024Updated 2 years ago
- Generating Video Caption Using LSTM☆12May 29, 2023Updated 3 years ago
- ⚙️ Airflow data pipeline with Terraform, GCP BigQuery, dbt, Soda and Looker Studio.☆26Oct 19, 2023Updated 2 years ago
- ☆12Oct 22, 2022Updated 3 years ago
- GSoC 2025 project☆17May 9, 2026Updated 5 months ago
- ☆30Apr 6, 2024Updated 2 years ago
- ☆12Jun 18, 2022Updated 4 years ago
- 모두의 AI 케인의 Agent로 완성하는 RAG 강의 레포지토리입니다.☆20Dec 16, 2025Updated 9 months ago
- Built and deployed scalable LLM retrieval APIs on a hybrid GCP architecture with full CI/CD, IaC, and monitoring☆83Aug 10, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Multi-modal video search engine using CLIP embeddings and vector database.☆19Jul 21, 2025Updated last year
- DataTalks.Club's Data Engineering Zoomcamp Project☆25Jul 14, 2022Updated 4 years ago
- ☆13Jul 29, 2023Updated 3 years ago
- An end-2-end project about Son Tung M-TP☆29Sep 25, 2025Updated last year
- Single-Shot Multibox Detector Implementation in PyTorch for VOC, COCO and Custom Data (WIP)☆10Jun 4, 2018Updated 8 years ago
- Insight Data Engineering project: A platform built in HDFS, Spark and Airflow to help you to find social influencers from GitHub Net…☆16May 21, 2024Updated 2 years ago
- A big data web application to predict USA airline traffic delay with Python, Flask, Apache Spark, Kafka, MongoDB, ElasticSearch, d3.js, s…☆32Jul 25, 2022Updated 4 years ago
- AWS KR Tech Blog: 'Amazon Bedrock으로 30분 만에 멀티모달 RAG 챗봇 구축하기 실전 가이드' sample code☆16Feb 15, 2025Updated last year
- Vistral-V: Visual Instruction Tuning for Vistral - Vietnamese Large Vision-Language Model.☆23Jul 1, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆20Jan 2, 2026Updated 9 months ago
- Node.JS Microservices using RabbitMQ Message Broker☆26Jan 16, 2025Updated last year
- ☆22Jul 10, 2025Updated last year
- End-to-end MLOps architecture built for polyp segmentation — featuring distributed Ray training, MLflow experiment tracking, and automate…☆21Oct 31, 2025Updated 11 months ago
- ☆22Aug 25, 2020Updated 6 years ago
- Large Language Models (LLMs) Learning Resources☆21Jun 16, 2024Updated 2 years ago
- I am using confluent Kafka cluster to produce and consume scraped data. In this project, I've created a real-time data pipeline that uti…☆29May 2, 2023Updated 3 years ago