This is a collecton of Amazon CDK projects to show how to directly ingest streaming data from Amazon Mananged Service for Apache Kafka (MSK) and MSK Serverless into Apache Iceberg table in S3 with AWS Glue Streaming.
☆16Sep 10, 2024Updated last year
Alternatives and similar repositories for aws-glue-streaming-ingestion-from-kafka-to-apache-iceberg
Users that are interested in aws-glue-streaming-ingestion-from-kafka-to-apache-iceberg are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Streaming ETL job cases in AWS Glue to integrate Iceberg and creating an in-place updatable data lake on Amazon S3☆26Sep 10, 2024Updated last year
- ☆17Jan 11, 2024Updated 2 years ago
- 小売業で予測ベースの発注を実現するためのサンプルソリューション☆17Apr 10, 2025Updated last year
- ☆23Feb 14, 2025Updated last year
- The project leverages Apache Flink, Apache Kafka and Python digital Twin to provide real-time insights into healthcare data, enabling tim…☆14Nov 4, 2023Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- This repository provides the resources required for the Amazon Redshift Streaming workshop☆13Jul 12, 2023Updated 2 years ago
- This is a sample app created to illustrate the best practices outlined in the following blog post☆15Oct 6, 2023Updated 2 years ago
- ☆11May 7, 2024Updated last year
- ☆15Feb 12, 2026Updated 2 months ago
- Stream CDC into an Amazon S3 data lake in Apache Iceberg table format with AWS Glue Streaming and DMS☆36Feb 15, 2025Updated last year
- Building a Q&A app (powered by a LLM model) using AWS Bedrock, AWS Kendra, AWS S3 and Streamlit in just a couple of hours☆16Dec 7, 2023Updated 2 years ago
- ☆10Apr 5, 2024Updated 2 years ago
- ☆19Dec 23, 2022Updated 3 years ago
- This repository contains an analysis of the effects of COVID-19 on trade trends up to December 2021. The dataset used provides daily trad…☆15Aug 16, 2023Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆21Nov 11, 2023Updated 2 years ago
- ☆15Feb 20, 2018Updated 8 years ago
- ☆26Mar 12, 2024Updated 2 years ago
- #DataPipeLine #ETL - Created is a Facebook data extraction utility to extract the publicly available data on Facebook. Used Facebook Grap…☆13Jun 27, 2018Updated 7 years ago
- Building a GPT-4 Q&A app using Azure OpenAI, Pinecone and Streamlit in just a couple of hours☆24Jul 6, 2023Updated 2 years ago
- This repository contains End-to-end Data Analytics Projects☆18Jun 6, 2023Updated 2 years ago
- Data Analysis of Bicycle Manufacturing Company Using Python, SQL and Power BI☆13Apr 14, 2023Updated 3 years ago
- Fundamentals of Apache Flink [video], published by Packt☆12Jan 30, 2023Updated 3 years ago
- An Apache Spark Structured Streaming S3 connector for reading S3 files using Amazon S3 event notifications to AWS SQS☆15Feb 13, 2024Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆14Jan 9, 2020Updated 6 years ago
- ☆14Feb 26, 2024Updated 2 years ago
- Amazon Bedrock AI Karaoke is an interactive demonstration of Amazon Bedrock. Users complete the prompt with the microphone and choose the…☆19Jan 29, 2025Updated last year
- Amazon CloudWatch Network Monitoring - Network Flow Monitor agent repository☆24Apr 10, 2026Updated last week
- ☆18Updated this week
- ☆12Sep 24, 2020Updated 5 years ago
- ☆19Dec 22, 2025Updated 3 months ago
- CLI tool to help importing existing dbt Cloud config to Terraform☆31Mar 11, 2026Updated last month
- This repository contains the code snippets used in "LLM Prompt Engineering For Developers"☆12Apr 22, 2024Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Spark runtime on AWS Lambda☆113Aug 28, 2025Updated 7 months ago
- AWS IoT Services sample codes. these will be used in AWS IoT hands-on/workshops in Japan.☆11Jan 14, 2021Updated 5 years ago
- Delta Lake helper methods. No Spark dependency.☆22Jan 19, 2026Updated 3 months ago
- Centralised Limit Order Book (CLOB) in Rust☆24Oct 5, 2025Updated 6 months ago
- Removes unused images from AWS ECR☆19Apr 7, 2023Updated 3 years ago
- Sample code to collect Apache Iceberg metrics for table monitoring☆29Aug 18, 2024Updated last year
- ☆14Jan 30, 2023Updated 3 years ago