gwenshap / lambda_s3_kafka
AWS Lambda function to get events in Kafka topic when files are uploaded to S3
☆24Updated 6 years ago
Related projects ⓘ
Alternatives and complementary repositories for lambda_s3_kafka
- ☆43Updated 3 months ago
- An example PySpark project with pytest☆17Updated 7 years ago
- Quickstart PySpark with Anaconda on AWS/EMR using Terraform☆47Updated 10 months ago
- Real-world Spark pipelines examples☆83Updated 6 years ago
- These are some code examples☆55Updated 4 years ago
- Jupyter notebooks and AWS CloudFormation template to show how Hudi, Iceberg, and Delta Lake work☆47Updated 2 years ago
- The open source version of the Amazon Redshift Cluster Management Guide.☆48Updated last year
- Spark with Scala example projects☆33Updated 5 years ago
- Real-time anomaly detection using Kafka, KSQL User Defined Function and a pre-trained model☆30Updated 10 months ago
- ☆10Updated 6 years ago
- A full example of my blog post regarding Sparks stateful streaming (http://asyncified.io/2016/07/31/exploring-stateful-streaming-with-apa…☆34Updated 7 years ago
- Examples for High Performance Spark☆15Updated last week
- Streaming ETL with Apache Flink and Amazon Kinesis Data Analytics☆65Updated last year
- Sample processing code using Spark 2.1+ and Scala☆51Updated 4 years ago
- Spark stream from kafka(json) to s3(parquet)☆15Updated 6 years ago
- Telecom scenarios implemented with streaming techniques☆11Updated last year
- JSON schema parser for Apache Spark☆81Updated 2 years ago
- This project describes how to write full ETL data pipeline using spark.☆15Updated 2 years ago
- Scalable CDC Pattern Implemented using PySpark☆18Updated 5 years ago
- Some AWS EMR examples☆16Updated 6 years ago
- Data validation library for PySpark 3.0.0☆34Updated 2 years ago
- Code examples and docker environment for Spark☆26Updated 8 years ago
- Kafka Connect Store Partitioner by custom fields and time☆39Updated 2 years ago
- Docker image to submit Spark applications☆38Updated 6 years ago
- Testing Scala code with scalatest☆11Updated 2 years ago
- A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator☆75Updated 5 years ago
- Kafka Connect Examples☆42Updated 2 years ago