This project sets up a real-time data pipeline utilizing Change Data Capture (CDC) to stream changes from a PostgreSQL database to a ClickHouse database through Apache Kafka. Using Debezium to capture and stream database changes, and Kafka Connect to sink the data into ClickHouse, this pipeline allows for efficient data synchronization.
☆12May 9, 2024Updated 2 years ago
Alternatives and similar repositories for cdc-postgresql-clickhouse
Users that are interested in cdc-postgresql-clickhouse are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This repository hosts materials for the Docker for Data Engineers workshop, offering hands-on exercises and resources tailored for data e…☆16May 23, 2024Updated 2 years ago
- Change Data Capture with Debezium & PostgreSQL. This repository contains the demo Docker Compose file for setting up and running the whol…☆13Jan 31, 2022Updated 4 years ago
- This course is designed to provide learners with the fundamental skills needed for data engineering using Python. The objective is to int…☆39Aug 15, 2024Updated last year
- Multi-Cluster Istio Service Mesh with SPIFFE/SPIRE Federation☆13Mar 19, 2025Updated last year
- 12-Button IR Remote Control☆48Dec 12, 2022Updated 3 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- 12th Amirkabir Linux and Open-Source Festival resources.☆15Mar 20, 2021Updated 5 years ago
- This repository contains the replication of the iGSM dataset generation process from the Physics of LLM paper by Zeyuan Zhu.☆17Sep 13, 2024Updated last year
- This API provides authentication and CRUD operations for data used by the Chronas application☆14Jul 21, 2026Updated last week
- Flink Example☆17Nov 19, 2023Updated 2 years ago
- ☆10Apr 2, 2015Updated 11 years ago
- ☆26Nov 8, 2022Updated 3 years ago
- ☆23May 7, 2023Updated 3 years ago
- ☆19Mar 24, 2023Updated 3 years ago
- Diagram concepts for making Kubernetes concepts easy to understand☆17Jul 3, 2018Updated 8 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- CDI extension for Java EE 8 application using Apache Kafka as Event Store☆17Jul 13, 2025Updated last year
- Set up your Ubuntu system with essential and fun packages☆22May 18, 2024Updated 2 years ago
- dbt-databend adapter plugin☆10May 30, 2024Updated 2 years ago
- Implementation of envoy control plane server☆11Jul 5, 2023Updated 3 years ago
- Free Gemini web interface proxy for OpenCode - Use your free Gemini subscription as an OpenAI-compatible API with full tool calling suppo…☆24Jan 19, 2026Updated 6 months ago
- Keras implementation of multi-label classification of movie genres from IMDB posters☆17May 14, 2020Updated 6 years ago
- Workarounds to write/export Jupyter notebooks with Persian text in them☆26Jan 20, 2021Updated 5 years ago
- Meticulous notes on various topics in cryptography, cryptocurrencies, and blockchain based on Blockchain at Berkeley's Spring 2017 "Intro…☆26May 20, 2018Updated 8 years ago
- Syntax highlighting for Kubernetes manifests [WIP]☆19Apr 9, 2020Updated 6 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Fast Inventory simulation and optimization☆10Feb 23, 2025Updated last year
- DBT and clickhouse test project with dagster☆12Aug 29, 2023Updated 2 years ago
- Ecommerce Realtime Data Pipeline (Data Modeling, Workflow Orchestration, Change Data Capture, Analytical Database and Dashboarding)☆71Mar 9, 2024Updated 2 years ago
- Chrome extension for monitoring Stack Exchange sites such as Stack Overflow, etc.☆23Apr 15, 2023Updated 3 years ago
- ☆18Jan 27, 2023Updated 3 years ago
- Simple module for using Doctolib's API in node.js☆10May 10, 2021Updated 5 years ago
- Wox Plugin for Chocolatey☆20Feb 9, 2024Updated 2 years ago
- dlt-dagster-demo☆14Nov 6, 2023Updated 2 years ago
- Trying out the Dataframe Polars library with Delta Lake ... feat Python.☆12Jan 29, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- VS Code extension to run commands in Markdown files☆21Jul 13, 2024Updated 2 years ago
- VSCode Extension to execute commands directly from Markdown☆20Mar 11, 2026Updated 4 months ago
- Data Observability for Data Engineering, published by Packt Publishing☆11Jan 24, 2025Updated last year
- 🌀 Ultimate Docker Compose to rule them all.☆39Apr 2, 2022Updated 4 years ago
- Code for Apache Hudi, Apache Iceberg and Delta Lake analysis☆10Feb 2, 2024Updated 2 years ago
- Building a poor man's data lake: Exploring the Power of Polars and Delta Lake☆11Dec 6, 2025Updated 7 months ago
- Clean up Django migrations with just one press [archived]☆13Nov 18, 2016Updated 9 years ago