A end-to-end real-time stock market data pipeline with Python, AWS EC2, Apache Kafka, and Cassandra Data is processed on AWS EC2 with Apache Kafka and stored in a local Cassandra database.
☆29Jun 7, 2023Updated 3 years ago
Alternatives and similar repositories for Stock-Market-Real-Time-Data-Pipeline-with-Apache-Kafka-and-Cassandra
Users that are interested in Stock-Market-Real-Time-Data-Pipeline-with-Apache-Kafka-and-Cassandra are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A Data Engineering Project that implements an ETL data pipeline using Dagster, Apache Spark, Streamlit, MinIO, Metabase, Dbt, Polars, Doc…☆24Nov 19, 2024Updated last year
- DataTalks.Club's Data Engineering Zoomcamp Project☆24Jul 14, 2022Updated 3 years ago
- 🌟 An end-to-end full-stack data science project, including modelling, MLOps, and data storytelling. ✨☆16Aug 30, 2025Updated 9 months ago
- Spark data pipeline that processes movie ratings data.☆31May 1, 2026Updated last month
- A place to learn and explore PySpark Streaming, PySpark Structured Streaming with Hands-On. Lets get started ...☆17Oct 24, 2020Updated 5 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- StarCraft 2 Data Pipeline with Airflow, DuckDB and Streamlit☆16Mar 14, 2024Updated 2 years ago
- Streamlit OpenAI app to chat with custom text documents of all kinds☆13Apr 11, 2026Updated 2 months ago
- Spark, Airflow, Kafka☆24Apr 30, 2023Updated 3 years ago
- In this project I have built etl pipline which scraps the trending repository based on month,week and day LIVE extract other related info…☆12Sep 9, 2023Updated 2 years ago
- RealTime StockStream is a streamlined, simulation system for processing live stock market data. It uses Apache Kafka for data input, Apac…☆30Feb 18, 2025Updated last year
- End-to-end data engineer project☆24Aug 17, 2023Updated 2 years ago
- ☆35Nov 25, 2023Updated 2 years ago
- velib-v2: An ETL pipeline that employs batch and streaming jobs using Spark, Kafka, Airflow, and other tools, all orchestrated with Docke…☆21Aug 12, 2025Updated 10 months ago
- An example integration between Flask and the Preact front end library.☆13Jun 20, 2022Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Curated List of NLP tutorials☆30Feb 27, 2025Updated last year
- ☆10Feb 12, 2026Updated 4 months ago
- Welcome to my data engineering projects repository! Here you will find a collection of data engineering projects that I have worked on.☆25Apr 27, 2023Updated 3 years ago
- A fullstack starter with Next.js, Tailwind, Shadcn UI, FastAPI, SQLAlchemy, Pydantic, Alembic, Asyncio, Postgres, Redis, Celery, RabbitMQ☆32Jul 26, 2023Updated 2 years ago
- A real-time streaming ETL pipeline for streaming and performing sentiment analysis on Twitter data using Apache Kafka, Apache Spark and D…☆29Aug 8, 2020Updated 5 years ago
- Abnormal Activity Detection using Deep Learning LRCN is a model that combines CNN and RNN to identify abnormal behavior in videos. With r…☆11Sep 22, 2023Updated 2 years ago
- Set up an async pipeline in python using Celery, RabbitMQ and MongoDB. This repo covers the end to end deployment of an async pipeline fo…☆13Sep 23, 2022Updated 3 years ago
- Haraka SMTP plugin for logging outbound traffic. Useful for storing audit information of delivered/bounced emails.☆16Jan 12, 2023Updated 3 years ago
- Anything I read, whether it's a paper, a book, or an article, I'll post here.☆11Feb 13, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆25Dec 18, 2020Updated 5 years ago
- A complete all-in-one stock bot to fetch and store incremental day on day BSE data, build models and predict future prices and assess fin…☆13Jun 22, 2022Updated 3 years ago
- This repo contains my projects from the Udacity Data Engineering Nano degree☆13Apr 26, 2023Updated 3 years ago
- ☆15Jun 22, 2022Updated 3 years ago
- ZINDI GIZ NLP Agricultural Keyword Spotter 3rd place solution, Audio Classification☆11Sep 8, 2021Updated 4 years ago
- ☆10Nov 6, 2018Updated 7 years ago
- A user-friendly Command & Control (C&C) web platform for remote monitoring, management, and task automation across multiple devices.☆14Dec 15, 2024Updated last year
- ChatOps for Tinkerbell☆15Jun 11, 2020Updated 6 years ago
- A fully functional MERN stack CRUD application, to report and assign bugs issues to developers. While developers respond to the raised is…☆13Nov 25, 2021Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A simple flask upload program for multiple files requiring credential☆17Nov 14, 2020Updated 5 years ago
- insight data engineering fellow project☆16Nov 14, 2016Updated 9 years ago
- Built a stream processing data pipeline to get data from disparate systems into a dashboard using Kafka as an intermediary.☆29Aug 14, 2023Updated 2 years ago
- 📕Ansible playbooks for Raspberry Pi, Linux and Mac☆14Dec 22, 2024Updated last year
- ☆12May 15, 2021Updated 5 years ago
- Simple ETL pipeline using Python☆29May 22, 2023Updated 3 years ago
- Functions for executing trading strategies via the API of Interactive Brokers☆15Oct 29, 2021Updated 4 years ago