mtpatter / postgres-kafka-demoLinks
Fully reproducible, Dockerized, step-by-step, demo on how to stream tables from Postgres to Kafka/KSQL back to Postgres. Detailed blog post published on Medium.
☆152Updated 4 years ago
Alternatives and similar repositories for postgres-kafka-demo
Users that are interested in postgres-kafka-demo are comparing it to the libraries listed below
Sorting:
- ❤for real-time DataOps - where the application and data fabric blends - Lenses☆159Updated 3 weeks ago
- ☆62Updated last year
- spark on kubernetes☆104Updated 2 years ago
- Multiple node presto cluster on docker container☆126Updated 3 years ago
- An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR☆175Updated 5 months ago
- Common Transforms for Kafka Connect.☆169Updated 4 months ago
- A python wrapper for the KSQL REST API.☆158Updated 2 years ago
- ☆118Updated 2 years ago
- Deploy your Spark Production Cluster on Kubernetes☆47Updated 5 years ago
- Experiments and demonstrations of AVRO, Protobuf serialisation☆61Updated 2 years ago
- Kafka Connect connector for reading CSV files into Kafka.☆170Updated 5 months ago
- Maven quick start for building Kafka Connect connectors.☆148Updated 4 years ago
- One click deploy docker-compose with Kafka, Spark Streaming, Zeppelin UI and Monitoring (Grafana + Kafka Manager)☆120Updated 4 years ago
- Example for article Running Spark 3 with standalone Hive Metastore 3.0☆102Updated 2 years ago
- Kafka Connect REST connector☆112Updated 3 years ago
- 🔗 A multipurpose Kafka Connect connector that makes it easy to parse, transform and stream any file, in any format, into Apache Kafka☆340Updated 3 weeks ago
- A convenient Python wrapper for Apache NiFi☆269Updated last week
- Airflow Unit Tests and Integration Tests☆261Updated 3 years ago
- For a series of posts on Amazon MSK, Amazon EKS, and Amazon EMR☆67Updated 3 years ago
- Docker images for Debezium. Please log issues in our JIRA at https://issues.redhat.com/projects/DBZ/summary☆335Updated last week
- Kafka Connect connector to stream data in real time from Twitter.☆127Updated 2 years ago
- Everything about Apache Kafka☆206Updated 2 years ago
- This repository contains recipes for Apache Pinot.☆32Updated 8 months ago
- Fast iterative local development and testing of Apache Airflow workflows☆202Updated 3 months ago
- Trino dbt demo project to mix and load BigQuery data with and in a local PostgreSQL database☆77Updated 4 years ago
- Supporting repository for the blog post at https://medium.com/@stephane.maarek/how-to-use-apache-kafka-to-transform-a-batch-pipeline-into…☆245Updated last year
- A hybrid Big Data pipeline architecture that combines a real-time streaming layer with a batch layer to process large datasets(Lambda Arc…☆185Updated 2 months ago
- Kafka Connect connector that enables Change Data Capture from JSON/HTTP APIs into Kafka.☆134Updated last year
- Streamline Apache Kafka with Conduktor Platform. 🚀☆150Updated 3 weeks ago
- Examples for using Apache Flink® with DataStream API, Table API, Flink SQL and connectors such as MySQL, JDBC, CDC, Kafka.☆65Updated 2 years ago