hellokoding / kafka-connect-sink-postgres-with-avro-schemaregistry-pythonLinks
Streaming Data from Kafka to Postgres with Kafka Connect, AVRO, Schema Registry and Python
☆14Updated 7 years ago
Alternatives and similar repositories for kafka-connect-sink-postgres-with-avro-schemaregistry-python
Users that are interested in kafka-connect-sink-postgres-with-avro-schemaregistry-python are comparing it to the libraries listed below
Sorting:
- Fully reproducible, Dockerized, step-by-step, demo on how to stream tables from Postgres to Kafka/KSQL back to Postgres. Detailed blog p…☆152Updated 3 years ago
- Docker container for Kafka - Spark Streaming - Cassandra☆98Updated 6 years ago
- Set up a 3 node spark cluster using docker containers☆34Updated 7 years ago
- A hybrid Big Data pipeline architecture that combines a real-time streaming layer with a batch layer to process large datasets(Lambda Arc…☆183Updated last month
- Real-time report dashboard with Apache Kafka, Apache Spark Streaming and Node.js☆50Updated 2 years ago
- Deep Learning UDF for KSQL, the Streaming SQL Engine for Apache Kafka with Elasticsearch Sink Example☆79Updated 7 years ago
- Various Demos mostly based on docker environments☆33Updated 2 years ago
- 🚨 Simple, self-contained fraud detection system built with Apache Kafka and Python☆89Updated 6 years ago
- Repository used for Spark Trainings☆54Updated 2 years ago
- Making Machine Learning Simple and Scalable with Python, Jupyter Notebook, TensorFlow, Keras, Apache Kafka and KSQL☆97Updated 6 years ago
- An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR☆175Updated 4 months ago
- Real-Time Data Processing Pipeline & Visualization with Docker, Spark, Kafka and Cassandra☆86Updated 8 years ago
- Real-world Spark pipelines examples☆83Updated 7 years ago
- Educational notes,Hands on problems w/ solutions for hadoop ecosystem☆87Updated 6 years ago
- Spark Examples☆125Updated 3 years ago
- Maven quick start for building Kafka Connect connectors.☆148Updated 4 years ago
- Spark and Hive docker containers sharing a common MySQL metastore☆26Updated 5 years ago
- ☆23Updated 4 years ago
- Kafka Connect connector to stream data in real time from Twitter.☆128Updated 2 years ago
- How to build an awesome data engineering team☆100Updated 6 years ago
- ☆60Updated last year
- How to manage Slowly Changing Dimensions with Apache Hive☆55Updated 6 years ago
- ❤for real-time DataOps - where the application and data fabric blends - Lenses☆159Updated last week
- One click deploy docker-compose with Kafka, Spark Streaming, Zeppelin UI and Monitoring (Grafana + Kafka Manager)☆120Updated 4 years ago
- Spark structured streaming examples with using of version 3.5.1☆26Updated last year
- Docker compose files for various kafka stacks☆32Updated 7 years ago
- Examples To Help You Learn Apache Spark☆77Updated 7 years ago
- Example DAGs using hooks and operators from Airflow Plugins☆347Updated 7 years ago
- Kafka Connect REST connector☆112Updated 2 years ago
- Airflow Unit Tests and Integration Tests☆261Updated 2 years ago