hellokoding / kafka-connect-sink-postgres-with-avro-schemaregistry-python
Streaming Data from Kafka to Postgres with Kafka Connect, AVRO, Schema Registry and Python
☆14Updated 6 years ago
Alternatives and similar repositories for kafka-connect-sink-postgres-with-avro-schemaregistry-python:
Users that are interested in kafka-connect-sink-postgres-with-avro-schemaregistry-python are comparing it to the libraries listed below
- Docker compose files for various kafka stacks☆32Updated 6 years ago
- Real-time anomaly detection using Kafka, KSQL User Defined Function and a pre-trained model☆30Updated last year
- Kafka Connect Examples☆43Updated 2 years ago
- Real-time report dashboard with Apache Kafka, Apache Spark Streaming and Node.js☆50Updated last year
- Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…☆53Updated last year
- Kinesis Connector for Spark Structured Streaming☆11Updated last year
- This project describes how to write full ETL data pipeline using spark.☆15Updated 2 years ago
- 🚨 Simple, self-contained fraud detection system built with Apache Kafka and Python☆84Updated 5 years ago
- Sample programs for MapR Streams compatible with Apache Kafka 0.9 API☆15Updated last year
- Various Demos mostly based on docker environments☆34Updated 2 years ago
- Kafka Connect Sink/Source for Twitter☆90Updated 4 years ago
- event-triggered plugins for airflow☆21Updated 5 years ago
- Ingest tweets with Kafka. Use Spark to track popular hashtags and trendsetters for each hashtag☆29Updated 8 years ago
- Docker container for Kafka - Spark Streaming - Cassandra☆97Updated 5 years ago
- A demonstration of dashboards for monitoring Kafka Streams applications.☆37Updated last year
- Common components used across the datamountaineer kafka connect connectors☆21Updated 3 years ago
- Spark with Scala example projects☆34Updated 5 years ago
- Fully reproducible, Dockerized, step-by-step, demo on how to stream tables from Postgres to Kafka/KSQL back to Postgres. Detailed blog p…☆150Updated 3 years ago
- Spark structured streaming with Kafka data source and writing to Cassandra☆63Updated 5 years ago
- A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator☆73Updated 5 years ago
- Use Kafka and Apache Spark streaming to perform click stream analytics☆76Updated 4 years ago
- Realtime social media data analytics with Apache Spark, Python, Kafka, Pandas, etc☆51Updated 8 years ago
- Sample processing code using Spark 2.1+ and Scala☆51Updated 4 years ago
- No longer maintained and soon to be deleted☆76Updated 5 years ago
- Some AWS EMR examples☆16Updated 7 years ago
- Kafka Connect connector to stream data in real time from Twitter.☆126Updated 2 years ago
- Telecom scenarios implemented with streaming techniques☆11Updated last year
- Kafka Connect Store Partitioner by custom fields and time☆39Updated 3 years ago
- Real-world Spark pipelines examples☆83Updated 6 years ago