This project shows how to capture changes from postgres database and stream them into kafka
☆41May 17, 2024Updated last year
Alternatives and similar repositories for changecapture-e2e
Users that are interested in changecapture-e2e are comparing it to the libraries listed below
Sorting:
- This repository contains an end-to-end data engineering project using Apache Flink, focused on performing sales analytics. The project de…☆11Nov 18, 2023Updated 2 years ago
- This project showcases how to integrate the world of DevOps, focusing on Continuous Integration (CI) and Continuous Deployment (CD) with …☆15Dec 27, 2023Updated 2 years ago
- This repository contains the necessary configuration files and DAGs (Directed Acyclic Graphs) for setting up a robust data engineering en…☆25Jan 26, 2024Updated 2 years ago
- An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Ka…☆316Feb 14, 2025Updated last year
- This project demonstrates how to use Apache Airflow to submit jobs to Apache spark cluster in different programming laguages using Python…☆48Mar 14, 2024Updated last year
- This construct builds some elements for you to quickly launch an EMR Serverless application. After submitting the Emr Serverless job, you…☆11Nov 18, 2025Updated 3 months ago
- In this project, we setup and end to end data engineering using Apache Spark, Azure Databricks, Data Build Tool (DBT) using Azure as our …☆39Dec 18, 2023Updated 2 years ago
- This repository contains an Apache Flink application for real-time sales analytics built using Docker Compose to orchestrate the necessar…☆48Dec 4, 2023Updated 2 years ago
- A Python package that creates fine-grained dbt tasks on Apache Airflow☆18Apr 25, 2024Updated last year
- Apache Airflow advanced functionalities examples☆21Mar 22, 2024Updated last year
- Data Engineering Project in GCP☆22Mar 29, 2023Updated 2 years ago
- OpenConext SAML 2.0 IdP/SP Gateway☆17Updated this week
- key-value in-memory database server☆13Jan 20, 2023Updated 3 years ago
- Data Engineering with Scala, published by Packt☆28Feb 5, 2024Updated 2 years ago
- Data Engineering Bootcamp☆30Aug 5, 2025Updated 6 months ago
- A demonstration of an ELT (Extract, Load, Transform) pipeline☆31Feb 19, 2024Updated 2 years ago
- An end-to-end data engineering pipeline that fetches data from Wikipedia, cleans and transforms it with Apache Airflow and saves it on Az…☆32Oct 2, 2023Updated 2 years ago
- ☆30Nov 16, 2023Updated 2 years ago
- Built a stream processing data pipeline to get data from disparate systems into a dashboard using Kafka as an intermediary.☆29Aug 14, 2023Updated 2 years ago
- Repository to host micro service implementation patterns.☆13Jun 25, 2025Updated 8 months ago
- Beyond Vibe Coding. Code, Planning, Documentation and Product Management agents.☆70Feb 20, 2026Updated last week
- Repository for the dbt Semantic Layer course☆11Nov 13, 2025Updated 3 months ago
- Get data from API, run a scheduled script with Airflow, send data to Kafka and consume with Spark, then write to Cassandra☆144Jul 27, 2023Updated 2 years ago
- ☆13May 10, 2023Updated 2 years ago
- MQTT Load Tester and Monitoring Tool☆12Aug 4, 2023Updated 2 years ago
- Pipeliner is a set of CICD pipeline templates for GitLab based on Trunk-Based Development git workflows☆11Feb 24, 2022Updated 4 years ago
- Code to help generate SQL for stakeholders. Code at https://www.startdataengineering.com/post/data-democratize-llm/☆13May 24, 2024Updated last year
- dump elasticsearch index with golang☆11Nov 8, 2025Updated 3 months ago
- This project sets up a real-time data pipeline utilizing Change Data Capture (CDC) to stream changes from a PostgreSQL database to a Clic…☆12May 9, 2024Updated last year
- an SPI or plugin to do a simple password encryption-decryption for Keycloak or Red Hat Single Sign-On (RHSSO)☆11Mar 30, 2021Updated 4 years ago
- Packer plugin for Alibaba Cloud Image Builder☆15Dec 22, 2025Updated 2 months ago
- This repository holds all material related to the Ory Summit, specifically the presentations.☆12Oct 22, 2025Updated 4 months ago
- Jenkins plugin to monitor pull requests with customizable dashboard. You can also provide a view for your plugin that other developers ca…☆10Jun 26, 2025Updated 8 months ago
- Deterministic U2F token project☆10Oct 29, 2019Updated 6 years ago
- DBT and clickhouse test project with dagster☆12Aug 29, 2023Updated 2 years ago
- Apache YuniKorn Web UI☆40Updated this week
- An exploration of Flink and change-data-capture via flink-cdc-connectors☆11Jul 7, 2021Updated 4 years ago
- Go implementation of Neubot's DASH experiment☆13Aug 24, 2023Updated 2 years ago
- Python3, NetworkX, Java, MLlib, Spark, Cassandra, Neo4j 3.0, Gephi, Docker☆11Jul 18, 2017Updated 8 years ago