📈 A scalable, production-ready data pipeline for real-time streaming & batch processing, integrating Kafka, Spark, Airflow, AWS, Kubernetes, and MLflow. Supports end-to-end data ingestion, transformation, storage, monitoring, and AI/ML serving with CI/CD automation using Terraform & GitHub Actions.
☆144Sep 27, 2026Updated last month
Alternatives and similar repositories for End-to-End-Data-Pipeline
Users that are interested in End-to-End-Data-Pipeline are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 🥇 A project for analyzing Olympic medal data with R, combining TidyTuesday records and World Bank indicators to assess raw medal counts,…☆12Sep 27, 2026Updated last month
- 💾 GhostCache - An NPM package for automatic caching of fetch() and Axios requests, reducing redundant API calls and improving your app's…☆11Sep 27, 2026Updated last month
- 🛡️ EnvGuard – A powerful NPM package that validates your .env files against a predefined schema, ensuring all required environment varia…☆12Sep 27, 2026Updated last month
- 💡 A JavaFX-powered implementation of the Akari logic puzzle, featuring intuitive controls, dynamic feedback, and a diverse puzzle librar…☆12Sep 27, 2026Updated last month
- 🐈 A project for analyzing the distribution and variability of Pokémon Attack stats using R, with visualizations, summary statistics, and…☆12Sep 27, 2026Updated last month
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- 🍷 A project for analyzing red and white wine quality using R, combining exploratory visualizations, PCA, and a regression model to uncov…☆10Sep 27, 2026Updated last month
- ⏳ TimeWarp Manipulation – An NPM package that controls time in JavaScript with precision! Warp, freeze, or accelerate Date.now() with sea…☆11Sep 27, 2026Updated last month
- 🎮 This repository hosts a Bouncing Ball game coded in JavaFX, offering a fun and interactive gameplay experience. It showcases object mo…☆14Sep 27, 2026Updated last month
- 🗂️ A next-gen relational database & DBMS with ACID transactions, mergeable CRDT tables, time-travel queries, vector search, B+ Tree inde…☆11Sep 27, 2026Updated last month
- 🔧 A shell implementation in C featuring command parsing, built-in commands, external program execution, and robust memory management for…☆11Sep 27, 2026Updated last month
- 👻 An NPM package featuring a smart, heuristic-driven data prefetching library that speeds up your SPA or dashboard by preloading API res…☆13Sep 27, 2026Updated last month
- 🔍 This repository explores the graph data structure, focusing on its application in analyzing large texts and developing the Word Graph …☆12Sep 27, 2026Updated last month
- 📋 An enterprise-grade Go microservices backend for storing & analyzing posts, on a CloudWeGo stack (Kitex / Thrift RPC, Hertz HTTP) with…☆14Sep 27, 2026Updated last month
- ⚡ FastFetch – An NPM package for a smarter fetch() wrapper with auto-retry, deduplication, and minimal boilerplate for efficient API requ…☆12Sep 27, 2026Updated last month
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- 🧮 A sleek, modern web-based calculator with PWA support and built with Vite, offering responsive touch and keyboard controls. It feature…☆10Sep 27, 2026Updated last month
- 🔍 A project for analyzing the Gapminder dataset (1952–2007) using R, producing 12 visualizations that explore trends in life expectancy,…☆13Sep 27, 2026Updated last month
- 🔄 This repository delves into sorting algorithms, with a special emphasis on the implementation of Merge Sort to organize artworks in a …☆12Sep 27, 2026Updated last month
- 🌳 This repository is dedicated to the Binary Search Tree (BST) data structure, featuring a comprehensive demo of all its functionalities…☆11Sep 27, 2026Updated last month
- Welcome to my GitHub profile! Although this README might look long and detailed, it is not a comprehensive overview of my skills and abi…☆12Sep 27, 2026Updated last month
- 🖱️ This repository hosts the "Escape the Cursor" game, developed in Java and JavaFX. It presents an engaging and challenging gameplay wh…☆10Mar 27, 2023Updated 3 years ago
- 🏦 This repository features a Banking System Simulator developed in C. It simulates basic banking operations such as account creation, de…☆13Mar 27, 2023Updated 3 years ago
- 🎒 An AI/ML-powered, full-stack job-posting fraud copilot delivering calibrated risk scores, natural-language rationales, interactive cha…☆16Sep 27, 2026Updated last month
- 🐱 An interactive Pokédex app built with Next.js, Tailwind CSS, and React Query for blazing-fast performance and smooth UX. Includes live…☆18Sep 27, 2026Updated last month
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- 🧰 Collabify supercharges your workflow with a smarter, cleaner alternative to project boards like Jira & Trello. Track tasks, manage rol…☆21Sep 27, 2026Updated last month
- 🌌 This repository presents a VR/AR project depicting the Solar System, offering an immersive experience of space exploration. It include…☆11Apr 6, 2023Updated 3 years ago
- 📦 This repository contains an Inventory Management System (Simulator) written in Python. It is designed to simulate real-world inventory…☆16Mar 27, 2023Updated 3 years ago
- 💡An end-to-end solution for aggregating, summarizing, and displaying news articles using an AI-powered backend, an automated CRON crawle…☆30Oct 9, 2026Updated 3 weeks ago
- 👨🍳 Welcome to The Recipe Genie App - The Ultimate Recipe Assistant, your personal culinary guide and portal to a world of delicious di…☆17Sep 27, 2026Updated last month
- 🏠 This repository contains data analysis scripts for the 2022 American Community Survey (ACS) focusing on individuals aged 25 and over i…☆16Sep 27, 2026Updated last month
- 📋 A dynamic tool that allows users to display and organize tasks on a virtual board. It offers an intuitive interface for task managemen…☆10Apr 5, 2023Updated 3 years ago
- 🏸 Welcome to BadminVerse demo: Your ultimate UI for booking badminton and basketball courts! Effortlessly find and reserve courts, explo…☆11Sep 4, 2024Updated 2 years ago
- 🧬 Build your own conversational AI in minutes (or seconds) with this customizable chatbot template, utilizing modern technologies like N…☆26Sep 27, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 📈 This repository hosts a Stock Market Simulation in Python, providing tools to mimic market behaviors, portfolio management, and tradin…☆23Mar 27, 2023Updated 3 years ago
- 👨🏻💻 Meet Lumina – my personal AI assistant powered by hybrid RAG with Pinecone vector search and Neo4j graph traversal, Google AI, La…☆50Sep 27, 2026Updated last month
- 🤖 This repository houses a collection of image classification models for various purposes, including vehicle, object, animal, and flower…☆28Sep 27, 2026Updated last month
- 🧠 A production-grade, agentic RAG platform for portfolio intelligence, combining LangChain, Chroma/FAISS, Hugging Face embeddings, and O…☆51Sep 27, 2026Updated last month
- 🐦 This Swift version of Flappy Bird delivers the classic tap-to-fly challenge on iOS devices. Navigate through pipes in this engaging, S…☆29Sep 27, 2026Updated last month
- 🌟 A sleek showcase of my tech journey - dive into my projects, experiences, and innovations. Built with passion, presented with flair! C…☆22Sep 27, 2026Updated last month
- 💡 A comprehensive collection of Profile README Cards, designed to enhance GitHub profiles with visually appealing statistics, contributi…☆28May 19, 2024Updated 2 years ago