This project aims to predict smartphone prices using a combination of batch and stream processing techniques in a Big Data environment. The architecture follows the Lambda Architecture pattern, providing both real-time and batch processing capabilities to users.
☆23Apr 15, 2024Updated last year
Alternatives and similar repositories for Big-Data-Project
Users that are interested in Big-Data-Project are comparing it to the libraries listed below
Sorting:
- An end-to-end data pipeline for building Data Lake and supporting report using Apache Spark.☆16Jan 31, 2023Updated 3 years ago
- Machine Learning Experience☆21May 6, 2022Updated 3 years ago
- DSLab Training☆25Jul 15, 2024Updated last year
- I am using confluent Kafka cluster to produce and consume scraped data. In this project, I've created a real-time data pipeline that uti…☆29May 2, 2023Updated 2 years ago
- End to end machine leanring project: This repository serves as a simplified guide to help you grasp the fundamentals of MLOps.☆29Apr 22, 2024Updated last year
- Building a highly scalable Machine Learning System☆27Dec 3, 2024Updated last year
- VN Stock Advisor is an intelligent stock analysis tool utilizing CrewAI's Multi-AI-Agent system.☆61Jun 14, 2025Updated 8 months ago
- ☆57Apr 2, 2025Updated 11 months ago
- ☆63Sep 20, 2025Updated 5 months ago
- Built and deployed scalable LLM retrieval APIs on a hybrid GCP architecture with full CI/CD, IaC, and monitoring☆73Aug 10, 2025Updated 6 months ago
- ☆64Nov 24, 2024Updated last year
- ☆69Aug 15, 2024Updated last year
- Practical guide to build end-to-end machine learning pipeline and deploy your model in production,☆80Aug 28, 2023Updated 2 years ago
- NTTU Chatbot - A student support chatbot using LLM + Document Retriever (RAG) in Vietnamese☆109May 15, 2025Updated 9 months ago
- Data Engineering Project with Hadoop HDFS and Kafka☆123Nov 4, 2023Updated 2 years ago
- ☆168May 20, 2022Updated 3 years ago
- A hybrid Big Data pipeline architecture that combines a real-time streaming layer with a batch layer to process large datasets(Lambda Arc…☆189Mar 2, 2026Updated last week
- ☆242May 16, 2025Updated 9 months ago
- A turnkey MLOps pipeline demonstrating how to go from raw events to real-time predictions at scale.☆240Oct 21, 2025Updated 4 months ago
- The #Python framework for connecting AI agents to any onchain app on @solana-labs 🤖🐍☆258Oct 16, 2025Updated 4 months ago
- An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Ka…☆318Feb 14, 2025Updated last year
- An MCP Multimodal AI Agent with eyes and ears!☆543Jan 5, 2026Updated 2 months ago
- ☆333Aug 13, 2024Updated last year
- The resources of the preparation course for Databricks Data Engineer Associate certification exam☆601Dec 26, 2025Updated 2 months ago
- A Vietnamese natural language processing toolkit (NAACL 2018)☆659Feb 12, 2023Updated 3 years ago
- Serverless Machine Learning Course for building AI-enabled Prediction Services from models and features☆683Sep 24, 2024Updated last year
- My Machine Learning blog☆673Dec 29, 2025Updated 2 months ago
- Fast Multimodal Semantic Deduplication & Filtering☆892Jan 20, 2026Updated last month
- ☆1,033Mar 29, 2019Updated 6 years ago
- Data Structure and Algorithm (DSA) contributions☆872Jun 3, 2024Updated last year
- Deep Reinforcement Learning toolkit: record and replay cryptocurrency limit order book data & train a DDQN agent☆945Jan 12, 2022Updated 4 years ago
- A database of SDKs, frameworks, libraries, and tools for creating, monitoring, debugging and deploying autonomous AI agents☆1,139Feb 26, 2025Updated last year
- Getting Started with Data Enngineering☆1,315Apr 20, 2025Updated 10 months ago
- Tez is a super-simple and lightweight Trainer for PyTorch. It also comes with many utils that you can use to tackle over 90% of deep lear…☆1,160Jan 29, 2023Updated 3 years ago
- Example deep learning projects that use wandb's features.☆1,199Feb 23, 2026Updated last week
- 🤖 Awesome list of AI Agents☆1,845Feb 26, 2026Updated last week
- Home surveillance system with facial recognition☆1,258Nov 22, 2022Updated 3 years ago
- Example end to end data engineering project.☆1,387Dec 8, 2022Updated 3 years ago
- The best place to learn data engineering. Built and maintained by the data engineering community.☆1,900Jan 31, 2026Updated last month