tj--- / iceberg-demoLinks
A sample implementation of stream writes to an Iceberg table on GCS using Flink and reading it using Trino
☆21Updated 3 years ago
Alternatives and similar repositories for iceberg-demo
Users that are interested in iceberg-demo are comparing it to the libraries listed below
Sorting:
- Example for article Running Spark 3 with standalone Hive Metastore 3.0☆100Updated 2 years ago
- Playground for Lakehouse (Iceberg, Hudi, Spark, Flink, Trino, DBT, Airflow, Kafka, Debezium CDC)☆60Updated last year
- Adapter for dbt that executes dbt pipelines on Apache Flink☆95Updated last year
- Low Cost, Simple and Scalable Way of Data Replication to Apache Iceberg/Cloud/Data Lake☆283Updated last week
- Trino dbt demo project to mix and load BigQuery data with and in a local PostgreSQL database☆76Updated 4 years ago
- Apache Hive Metastore as a Standalone server in Docker☆80Updated last year
- ☆267Updated 10 months ago
- Delta Lake helper methods. No Spark dependency.☆23Updated last year
- ☆80Updated 4 months ago
- Presto Trino with Apache Hive Postgres metastore☆43Updated last year
- ☆59Updated last year
- ☆95Updated 8 months ago
- DataOps Observability is part of DataKitchen's Open Source Data Observability. DataOps Observability monitors every data journey from da…☆46Updated 3 weeks ago
- a curated list of awesome lakehouse frameworks, applications, etc☆35Updated 6 months ago
- Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pi…☆96Updated this week
- Real-time Data Warehouse with Apache Flink & Apache Kafka & Apache Hudi☆116Updated last year
- The Workload Analyzer collects Presto® and Trino workload statistics, and analyzes them☆135Updated last year
- Repo for everything open table formats (Iceberg, Hudi, Delta Lake) and the overall Lakehouse architecture☆107Updated 3 months ago
- dbt-starrocks contains all of the code enabling dbt to work with StarRocks☆43Updated last week
- 📚 Tech blogs & talks by companies that run Apache Flink in production☆173Updated 3 weeks ago
- REST API for Apache Spark on K8S or YARN☆102Updated 3 weeks ago
- Drop-in replacement for Apache Spark UI☆309Updated 2 weeks ago
- A curated list of Apache Flink learning resources☆91Updated 8 months ago
- The Internals of PySpark☆26Updated 8 months ago
- Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.☆29Updated last week
- A Python Library to support running data quality rules while the spark job is running⚡☆188Updated this week
- A Python package to submit and manage Apache Spark applications on Kubernetes.☆42Updated last month
- ☆39Updated 3 years ago
- The Trino (https://trino.io/) adapter plugin for dbt (https://getdbt.com)☆246Updated last week
- Smart Automation Tool for building modern Data Lakes and Data Pipelines☆124Updated this week