mtpatter / postgres-kafka-demoLinks
Fully reproducible, Dockerized, step-by-step, demo on how to stream tables from Postgres to Kafka/KSQL back to Postgres. Detailed blog post published on Medium.
☆152Updated 4 years ago
Alternatives and similar repositories for postgres-kafka-demo
Users that are interested in postgres-kafka-demo are comparing it to the libraries listed below
Sorting:
- ❤for real-time DataOps - where the application and data fabric blends - Lenses☆160Updated 3 weeks ago
- Multiple node presto cluster on docker container☆126Updated 3 years ago
- Experiments and demonstrations of AVRO, Protobuf serialisation☆61Updated 3 years ago
- Common Transforms for Kafka Connect.☆171Updated 3 weeks ago
- An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR☆176Updated 8 months ago
- ☆65Updated last year
- spark on kubernetes☆104Updated 2 years ago
- Docker images for Debezium. Please log issues at https://github.com/debezium/dbz/issues.☆337Updated 2 weeks ago
- Kafka Connect connector for reading CSV files into Kafka.☆171Updated 8 months ago
- A python wrapper for the KSQL REST API.☆158Updated 2 years ago
- 🔗 A multipurpose Kafka Connect connector that makes it easy to parse, transform and stream any file, in any format, into Apache Kafka☆345Updated last month
- ☆117Updated 3 years ago
- Setup for running Trino with Hive Metastore on Kubernetes☆103Updated 3 years ago
- Apache Airflow in Docker Compose (for both versions 1.10.* and 2.*)☆185Updated 2 years ago
- Support for generating modern platforms dynamically with services such as Kafka, Spark, Streamsets, HDFS, ....☆80Updated this week
- ☆270Updated last year
- Generate authentic looking mock data based on a SQL, JSON or Avro schema and produce to Kafka in JSON or Avro format.☆169Updated 5 months ago
- Aiven's collection of Single Message Transformations (SMTs) for Apache Kafka Connect☆87Updated 4 months ago
- A hybrid Big Data pipeline architecture that combines a real-time streaming layer with a batch layer to process large datasets(Lambda Arc…☆189Updated 5 months ago
- Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pi…☆97Updated this week
- Kafka Connect REST connector☆113Updated 3 years ago
- Everything about Apache Kafka☆207Updated 2 years ago
- One click deploy docker-compose with Kafka, Spark Streaming, Zeppelin UI and Monitoring (Grafana + Kafka Manager)☆120Updated 4 years ago
- Dremio Container Tools☆164Updated 5 months ago
- Streaming Synthetic Sales Data Generator: Streaming sales data generator for Apache Kafka, written in Python☆44Updated 3 years ago
- Kafka Connect connector that enables Change Data Capture from JSON/HTTP APIs into Kafka.☆136Updated last year
- This repository contains recipes for Apache Pinot.☆32Updated 11 months ago
- For a series of posts on Amazon MSK, Amazon EKS, and Amazon EMR☆67Updated 4 years ago
- Streaming data changes to a Data Lake with Debezium and Delta Lake pipeline☆76Updated 2 years ago
- Example for article Running Spark 3 with standalone Hive Metastore 3.0☆103Updated 3 years ago