This project sets up a real-time data pipeline utilizing Change Data Capture (CDC) to stream changes from a PostgreSQL database to a ClickHouse database through Apache Kafka. Using Debezium to capture and stream database changes, and Kafka Connect to sink the data into ClickHouse, this pipeline allows for efficient data synchronization.
☆12May 9, 2024Updated 2 years ago
Alternatives and similar repositories for cdc-postgresql-clickhouse
Users that are interested in cdc-postgresql-clickhouse are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This repository hosts materials for the Docker for Data Engineers workshop, offering hands-on exercises and resources tailored for data e…☆15May 23, 2024Updated 2 years ago
- Change Data Capture with Debezium & PostgreSQL. This repository contains the demo Docker Compose file for setting up and running the whol…☆13Jan 31, 2022Updated 4 years ago
- Multi-Cluster Istio Service Mesh with SPIFFE/SPIRE Federation☆13Mar 19, 2025Updated last year
- This course is designed to provide learners with the fundamental skills needed for data engineering using Python. The objective is to int…☆65Aug 15, 2024Updated 2 years ago
- 12-Button IR Remote Control☆48Dec 12, 2022Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- 12th Amirkabir Linux and Open-Source Festival resources.☆15Mar 20, 2021Updated 5 years ago
- This repository contains the replication of the iGSM dataset generation process from the Physics of LLM paper by Zeyuan Zhu.☆17Sep 13, 2024Updated 2 years ago
- This API provides authentication and CRUD operations for data used by the Chronas application☆14Updated this week
- Flink Example☆17Nov 19, 2023Updated 2 years ago
- ☆10Apr 2, 2015Updated 11 years ago
- ☆26Nov 8, 2022Updated 3 years ago
- ☆23May 7, 2023Updated 3 years ago
- ☆19Mar 24, 2023Updated 3 years ago
- Diagram concepts for making Kubernetes concepts easy to understand☆17Jul 3, 2018Updated 8 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- CDI extension for Java EE 8 application using Apache Kafka as Event Store☆17Jul 13, 2025Updated last year
- Set up your Ubuntu system with essential and fun packages☆22May 18, 2024Updated 2 years ago
- dbt-databend adapter plugin☆10May 30, 2024Updated 2 years ago
- Implementation of envoy control plane server☆11Jul 5, 2023Updated 3 years ago
- Keras implementation of multi-label classification of movie genres from IMDB posters☆17May 14, 2020Updated 6 years ago
- Free Gemini web interface proxy for OpenCode - Use your free Gemini subscription as an OpenAI-compatible API with full tool calling suppo…☆29Jan 19, 2026Updated 8 months ago
- Workarounds to write/export Jupyter notebooks with Persian text in them☆26Jan 20, 2021Updated 5 years ago
- Meticulous notes on various topics in cryptography, cryptocurrencies, and blockchain based on Blockchain at Berkeley's Spring 2017 "Intro…☆26May 20, 2018Updated 8 years ago
- Syntax highlighting for Kubernetes manifests [WIP]☆19Apr 9, 2020Updated 6 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Fast Inventory simulation and optimization☆10Feb 23, 2025Updated last year
- DBT and clickhouse test project with dagster☆12Aug 29, 2023Updated 3 years ago
- Ecommerce Realtime Data Pipeline (Data Modeling, Workflow Orchestration, Change Data Capture, Analytical Database and Dashboarding)☆72Mar 9, 2024Updated 2 years ago
- Chrome extension for monitoring Stack Exchange sites such as Stack Overflow, etc.☆23Apr 15, 2023Updated 3 years ago
- ☆18Jan 27, 2023Updated 3 years ago
- Simple module for using Doctolib's API in node.js☆10May 10, 2021Updated 5 years ago
- Wox Plugin for Chocolatey☆20Feb 9, 2024Updated 2 years ago
- dlt-dagster-demo☆14Nov 6, 2023Updated 2 years ago
- Trying out the Dataframe Polars library with Delta Lake ... feat Python.☆12Jan 29, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- VS Code extension to run commands in Markdown files☆21Jul 13, 2024Updated 2 years ago
- VSCode Extension to execute commands directly from Markdown☆20Mar 11, 2026Updated 6 months ago
- Data Observability for Data Engineering, published by Packt Publishing☆11Jan 24, 2025Updated last year
- 🌀 Ultimate Docker Compose to rule them all.☆39Apr 2, 2022Updated 4 years ago
- Code for Apache Hudi, Apache Iceberg and Delta Lake analysis☆10Feb 2, 2024Updated 2 years ago
- Building a poor man's data lake: Exploring the Power of Polars and Delta Lake☆11Dec 6, 2025Updated 9 months ago
- Clean up Django migrations with just one press [archived]☆13Nov 18, 2016Updated 9 years ago