hellokoding / kafka-connect-sink-postgres-with-avro-schemaregistry-pythonLinks
Streaming Data from Kafka to Postgres with Kafka Connect, AVRO, Schema Registry and Python
☆14Updated 6 years ago
Alternatives and similar repositories for kafka-connect-sink-postgres-with-avro-schemaregistry-python
Users that are interested in kafka-connect-sink-postgres-with-avro-schemaregistry-python are comparing it to the libraries listed below
Sorting:
- Fully reproducible, Dockerized, step-by-step, demo on how to stream tables from Postgres to Kafka/KSQL back to Postgres. Detailed blog p…☆152Updated 3 years ago
- Real-time report dashboard with Apache Kafka, Apache Spark Streaming and Node.js☆50Updated last year
- Use Kafka and Apache Spark streaming to perform click stream analytics☆76Updated 5 years ago
- Kafka Connect playground☆10Updated 5 years ago
- Kafka Connect Examples☆44Updated 2 years ago
- Deep Learning UDF for KSQL, the Streaming SQL Engine for Apache Kafka with Elasticsearch Sink Example☆79Updated 6 years ago
- Various Demos mostly based on docker environments☆33Updated 2 years ago
- A demonstration of dashboards for monitoring Kafka Streams applications.☆37Updated last year
- Real-time anomaly detection using Kafka, KSQL User Defined Function and a pre-trained model☆30Updated last year
- This repository contains a recipe for bootstrapping a climate analysis application using Apache Pinot and Superset☆20Updated 4 years ago
- 🚨 Simple, self-contained fraud detection system built with Apache Kafka and Python☆87Updated 6 years ago
- Twitter sentiment analysis using Spark and Stanford CoreNLP and visualization using elasticsearch and kibana☆20Updated 7 years ago
- One click deploy docker-compose with Kafka, Spark Streaming, Zeppelin UI and Monitoring (Grafana + Kafka Manager)☆120Updated 3 years ago
- Docker compose files for various kafka stacks☆32Updated 7 years ago
- event-triggered plugins for airflow☆21Updated 5 years ago
- Lighthouse is a library for data lakes built on top of Apache Spark. It provides high-level APIs in Scala to streamline data pipelines an…☆61Updated 9 months ago
- Pyspark boilerplate for running prod ready data pipeline☆28Updated 4 years ago
- Internet of Things Integration Example => Apache Kafka + Kafka Connect + MQTT Connector + Sensor Data☆210Updated 5 years ago
- Kafka Connect Store Partitioner by custom fields and time☆40Updated 3 years ago
- A proof of concept using Divolte, Kafka, Druid and Superset☆62Updated 5 years ago
- Common components used across the datamountaineer kafka connect connectors☆21Updated 4 years ago
- Spark with Scala example projects☆34Updated 6 years ago
- Spark and Hive docker containers sharing a common MySQL metastore☆26Updated 5 years ago
- This project describes how to write full ETL data pipeline using spark.☆15Updated 2 years ago
- Simple examle for Spark Streaming over Kafka topic☆106Updated 4 years ago
- spark on kubernetes☆104Updated 2 years ago
- Supporting repository for the blog post at https://medium.com/@stephane.maarek/how-to-use-apache-kafka-to-transform-a-batch-pipeline-into…☆244Updated last year
- MonitoFi: Health & Performance Monitor for your Apache NiFi☆63Updated last year
- Kafka-Connect SMT (Single Message Transformations) with SQL syntax (Using Apache Calcite for the SQL parsing)☆33Updated 5 years ago
- Get started with Apache Beam and Flink☆43Updated 8 years ago