hellokoding / kafka-connect-sink-postgres-with-avro-schemaregistry-pythonLinks
Streaming Data from Kafka to Postgres with Kafka Connect, AVRO, Schema Registry and Python
☆14Updated 7 years ago
Alternatives and similar repositories for kafka-connect-sink-postgres-with-avro-schemaregistry-python
Users that are interested in kafka-connect-sink-postgres-with-avro-schemaregistry-python are comparing it to the libraries listed below
Sorting:
- Various Demos mostly based on docker environments☆33Updated 3 years ago
- Use Kafka and Apache Spark streaming to perform click stream analytics☆76Updated 5 years ago
- Repository used for Spark Trainings☆54Updated 2 years ago
- Docker container for Kafka - Spark Streaming - Cassandra☆97Updated 6 years ago
- A hybrid Big Data pipeline architecture that combines a real-time streaming layer with a batch layer to process large datasets(Lambda Arc…☆187Updated 3 months ago
- Set up a 3 node spark cluster using docker containers☆34Updated 7 years ago
- Real-time report dashboard with Apache Kafka, Apache Spark Streaming and Node.js☆50Updated 2 years ago
- Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…☆55Updated 2 years ago
- An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR☆175Updated 6 months ago
- How to manage Slowly Changing Dimensions with Apache Hive☆55Updated 6 years ago
- Realtime social media data analytics with Apache Spark, Python, Kafka, Pandas, etc☆52Updated 9 years ago
- Docker compose files for various kafka stacks☆32Updated 7 years ago
- This project describes how to write full ETL data pipeline using spark.☆15Updated 3 years ago
- Airflow training for the crunch conf☆104Updated 7 years ago
- Simple examle for Spark Streaming over Kafka topic☆107Updated 5 years ago
- Simple alert system implemented in Kafka and Python☆95Updated 7 years ago
- Spark with Scala example projects☆34Updated 6 years ago
- Spark Structured Streaming / Kafka / Cassandra / Elastic☆183Updated 2 years ago
- Sentiment Analysis of a Twitter Topic with Spark Structured Streaming☆55Updated 7 years ago
- Apache Spark Course Material☆96Updated 2 years ago
- Real-Time Data Processing Pipeline & Visualization with Docker, Spark, Kafka and Cassandra☆85Updated 8 years ago
- Kafka Connect connector to stream data in real time from Twitter.☆127Updated 3 years ago
- How to build an awesome data engineering team☆101Updated 6 years ago
- Stream/batch system with Hadoop, Spark on NYC taxi data | #DE☆26Updated 2 months ago
- Educational notes,Hands on problems w/ solutions for hadoop ecosystem☆87Updated 6 years ago
- ❤for real-time DataOps - where the application and data fabric blends - Lenses☆160Updated 3 weeks ago
- Apache Spark docker container image (Standalone mode)☆35Updated 5 years ago
- Data validation library for PySpark 3.0.0☆33Updated 3 years ago
- Fully reproducible, Dockerized, step-by-step, demo on how to stream tables from Postgres to Kafka/KSQL back to Postgres. Detailed blog p…☆152Updated 4 years ago
- 🚨 Simple, self-contained fraud detection system built with Apache Kafka and Python☆89Updated 6 years ago