mtpatter / postgres-kafka-demo
Fully reproducible, Dockerized, step-by-step, demo on how to stream tables from Postgres to Kafka/KSQL back to Postgres. Detailed blog post published on Medium.
☆153Updated 3 years ago
Alternatives and similar repositories for postgres-kafka-demo:
Users that are interested in postgres-kafka-demo are comparing it to the libraries listed below
- ☆53Updated 7 months ago
- ❤for real-time DataOps - where the application and data fabric blends - Lenses☆156Updated last month
- Generate authentic looking mock data based on a SQL, JSON or Avro schema and produce to Kafka in JSON or Avro format.☆157Updated 4 months ago
- Trino dbt demo project to mix and load BigQuery data with and in a local PostgreSQL database☆72Updated 3 years ago
- 🌟 Examples of use cases that utilize Decodable, as well as demos for related open-source projects such as Apache Flink, Debezium, and Po…☆67Updated 2 weeks ago
- Terraform / NiFi on the Google Cloud Platform☆28Updated 4 months ago
- Streaming Synthetic Sales Data Generator: Streaming sales data generator for Apache Kafka, written in Python☆43Updated 2 years ago
- DEPRECATED. PLEASE USE https://github.com/confluentinc/kafka-connect-bigquery. A Kafka Connect BigQuery sink connector☆152Updated last year
- Common Transforms for Kafka Connect.☆157Updated 7 months ago
- Kafka Connect Store Partitioner by custom fields and time☆39Updated 3 years ago
- Maven quick start for building Kafka Connect connectors.☆145Updated 4 years ago
- A proof of concept using Divolte, Kafka, Druid and Superset☆62Updated 4 years ago
- This repository contains recipes for Apache Pinot.☆30Updated last month
- Spark on Kubernetes using Helm☆34Updated 4 years ago
- Examples for using Apache Flink® with DataStream API, Table API, Flink SQL and connectors such as MySQL, JDBC, CDC, Kafka.☆63Updated last year
- An Airflow docker image preconfigured to work well with Spark and Hadoop/EMR☆174Updated last year
- Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes☆63Updated 2 years ago
- Everything about Apache Kafka☆206Updated last year
- 🔗 A multipurpose Kafka Connect connector that makes it easy to parse, transform and stream any file, in any format, into Apache Kafka☆326Updated last week
- Streaming data changes to a Data Lake with Debezium and Delta Lake pipeline☆75Updated 2 years ago
- ☆260Updated 5 months ago
- ☆79Updated last year
- Airflow helm chart for AWS EKS☆18Updated 4 years ago
- 📚 Tech blogs & talks by companies that run Apache Flink in production☆167Updated 2 months ago
- Adapter for dbt that executes dbt pipelines on Apache Flink☆91Updated last year
- SQL data model for working with Snowplow web data. Supports Redshift and Looker. Snowflake and BigQuery coming soon☆60Updated 4 years ago
- Snowflake Kafka Connector (Sink Connector)☆149Updated this week
- Multiple node presto cluster on docker container☆124Updated 2 years ago
- ☆80Updated last year
- Sample Airflow DAGs☆62Updated 2 years ago