Ecommerce Realtime Data Pipeline (Data Modeling, Workflow Orchestration, Change Data Capture, Analytical Database and Dashboarding)
☆66Mar 9, 2024Updated 2 years ago
Alternatives and similar repositories for ecommerce_realtime_data_pipeline
Users that are interested in ecommerce_realtime_data_pipeline are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This repository hosts materials for the Docker for Data Engineers workshop, offering hands-on exercises and resources tailored for data e…☆17May 23, 2024Updated last year
- This project serves as a comprehensive guide to building an end-to-end data engineering pipeline using TCP/IP Socket, Apache Spark, OpenA…☆44Jan 4, 2024Updated 2 years ago
- FastAPI CLI is a command-line tool designed to help developers quickly generate a structured project file system for FastAPI applications…☆12Feb 3, 2025Updated last year
- ELT Data Pipeline implementation in Data Warehousing environment☆30May 2, 2025Updated 11 months ago
- This project sets up a real-time data pipeline utilizing Change Data Capture (CDC) to stream changes from a PostgreSQL database to a Clic…☆12May 9, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Dockerized monitoring stack for Apache Airflow☆36Sep 8, 2024Updated last year
- Repository for Data Engineering Interview Series☆37Oct 17, 2024Updated last year
- ☆27Jan 16, 2025Updated last year
- An implementation of the paper "Leveraging ParsBERT for cross-domain polarity sentiment classification of Persian social media comments" …☆10Jul 8, 2022Updated 3 years ago
- MCP server for Zoekt☆21Nov 25, 2025Updated 4 months ago
- In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data fro…☆25May 6, 2023Updated 2 years ago
- A custom end-to-end analytics platform for customer churn☆11May 15, 2025Updated 11 months ago
- an end-to-end data pipeline extracting music listening habits and producing an insightful dashboard☆17Mar 31, 2024Updated 2 years ago
- Data from the state of data science survey released by Anaconda each year.☆17Aug 15, 2024Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Scan and monitor your network effortlessly! Nmap Prometheus Exporter provides insights into network health and security with Prometheus-c…☆15Oct 2, 2023Updated 2 years ago
- ☆11Jun 7, 2024Updated last year
- Demonstrating the capabilities of DuckDB as a transformation engine for data lakes☆34Oct 8, 2024Updated last year
- Data Pipeline that utilizes GCP, Python 3.10, Prefect, and more.☆10Jan 23, 2023Updated 3 years ago
- Realtime Data Engineering Project☆31Jan 12, 2025Updated last year
- Building Data Lakehouse by open source technology. Support end to end data pipeline, from source data on AWS S3 to Lakehouse, visualize a…☆40Dec 15, 2025Updated 4 months ago
- used Airflow, Postgres, Kafka, Spark, and Cassandra, and GitHub Actions to establish an end-to-end data pipeline☆32Oct 25, 2023Updated 2 years ago
- Real-time Data Warehouse with Apache Flink & Apache Kafka & Apache Hudi☆119Dec 15, 2023Updated 2 years ago
- On-premises ELT Pipeline☆31Jul 10, 2025Updated 9 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ReviewSense is a cutting-edge AI assistant tailored for the marketing department for any business which lists products at e-commerce webs…☆18Nov 20, 2023Updated 2 years ago
- A repo dedicated to different approaches in building a Persian Generative Chatbot.☆12Sep 7, 2022Updated 3 years ago
- Change Data Capture with Debezium & PostgreSQL. This repository contains the demo Docker Compose file for setting up and running the whol…☆13Jan 31, 2022Updated 4 years ago
- End to end data engineering project with kafka, airflow, spark, postgres and docker.☆111Jan 8, 2026Updated 3 months ago
- An end-to-end data pipeline for building Data Lake and supporting report using Apache Spark.☆16Jan 31, 2023Updated 3 years ago
- A collection of MLOps interview questions and answers for data scientists and engineers. Learn how to apply MLOps principles and practice…☆68Jul 27, 2023Updated 2 years ago
- This project shows how to capture changes from postgres database and stream them into kafka☆42May 17, 2024Updated last year
- trino monitoring with JMX metrics through Prometheus and Grafana☆17Aug 14, 2024Updated last year
- A Firebase Cloud Function and a Firebase hosted web app to treat weather data collected by Cloud IoT Core☆18Mar 10, 2019Updated 7 years ago
- Wordpress hosting with auto-scaling - Free Trial • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Next-Gen Data Classification and Encryption☆15Jan 29, 2025Updated last year
- Tapsi Ride Demand Prediction☆12Jan 13, 2026Updated 3 months ago
- Code snippets for Data Engineering Design Patterns book☆371Feb 16, 2026Updated 2 months ago
- ☆16Sep 20, 2023Updated 2 years ago
- Building Spotify's 'Weekly Discover' with Spark☆17May 24, 2017Updated 8 years ago
- 12th Amirkabir Linux and Open-Source Festival resources.☆15Mar 20, 2021Updated 5 years ago
- A Metabase model that converts Gregorian dates to the Persian (Jalali) calendar system. This model provides Persian year, month, day, sea…☆74Feb 18, 2025Updated last year