RWaltersMA / mongo-source-sinkLinks
This is an example of using MongoDB as both a source and sink.
☆10Updated 5 years ago
Alternatives and similar repositories for mongo-source-sink
Users that are interested in mongo-source-sink are comparing it to the libraries listed below
Sorting:
- ☆14Updated 2 years ago
- This project shows how to capture changes from postgres database and stream them into kafka☆40Updated last year
- ☆16Updated last year
- This project provides an end-to-end data processing and visualization of visa numbers in Japan using PySpark and Plotly. The spark cluste…☆12Updated 2 years ago
- ☆28Updated 3 years ago
- Streaming Synthetic Sales Data Generator: Streaming sales data generator for Apache Kafka, written in Python☆44Updated 3 years ago
- Glue ETL job or EMR Spark that gets from data catalog, modifies and uploads to S3 and Data Catalog☆13Updated 2 years ago
- ☆28Updated 10 months ago
- code-snippets☆13Updated 3 months ago
- Jupyter notebooks and AWS CloudFormation template to show how Hudi, Iceberg, and Delta Lake work☆47Updated 3 years ago
- This repository contains the necessary configuration files and DAGs (Directed Acyclic Graphs) for setting up a robust data engineering en…☆24Updated 2 years ago
- This repository contains the code for a realtime election voting system. The system is built using Python, Kafka, Spark Streaming, Postgr…☆45Updated 2 years ago
- AWS Fargate & Elastic Container Service Masterclass - Course☆257Updated last year
- This project serves as a comprehensive guide to building an end-to-end data engineering pipeline using TCP/IP Socket, Apache Spark, OpenA…☆44Updated 2 years ago
- ☆70Updated last week
- An end-to-end data engineering pipeline that fetches real-time YouTube analytics and streams them through Kafka for processing with ksqlD…☆16Updated 2 years ago
- Confluent Kafka questions to practice for CCDAK☆203Updated 3 weeks ago
- Code repository for the Mastering Kafka Streams and ksqlDB book☆501Updated 2 years ago
- Data Engineering with Google Cloud Platform - Second Edition, published by Packt☆45Updated last year
- A Python package that creates fine-grained dbt tasks on Apache Airflow☆18Updated last year
- ☆17Updated 4 years ago
- Terraform aws snippets☆23Updated last year
- DAS-C01 ACG/LA by Brock Tubre and John Hanna☆124Updated 2 years ago
- ☆173Updated last year
- Kafka Connect Examples☆43Updated 3 years ago
- Create a streaming data, transfer it to Kafka, modify it with PySpark, take it to ElasticSearch and MinIO☆65Updated 2 years ago
- ☆75Updated 2 years ago
- Repository to host micro service implementation patterns.☆12Updated 7 months ago
- ☆93Updated last year
- An example of an ETL pipeline that lays out generic DE processes. This is now out of date but still provides useful information☆29Updated 3 years ago