tj--- / iceberg-demoLinks
A sample implementation of stream writes to an Iceberg table on GCS using Flink and reading it using Trino
☆21Updated 3 years ago
Alternatives and similar repositories for iceberg-demo
Users that are interested in iceberg-demo are comparing it to the libraries listed below
Sorting:
- Playground for Lakehouse (Iceberg, Hudi, Spark, Flink, Trino, DBT, Airflow, Kafka, Debezium CDC)☆59Updated last year
- Example for article Running Spark 3 with standalone Hive Metastore 3.0☆100Updated 2 years ago
- Real-time Data Warehouse with Apache Flink & Apache Kafka & Apache Hudi☆117Updated last year
- Adapter for dbt that executes dbt pipelines on Apache Flink☆95Updated last year
- Low Cost, Simple and Scalable Way of Data Replication to Apache Iceberg/Cloud/Data Lake☆275Updated this week
- ☆58Updated 11 months ago
- Presto Trino with Apache Hive Postgres metastore☆43Updated 10 months ago
- A curated list of Apache Flink learning resources☆83Updated 6 months ago
- ☆266Updated 9 months ago
- Demos for Nessie. Nessie provides Git-like capabilities for your Data Lake.☆29Updated last week
- Yet Another (Spark) ETL Framework☆21Updated last year
- Delta Lake helper methods. No Spark dependency.☆23Updated 10 months ago
- Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pi …☆96Updated last week
- DataOps Observability is part of DataKitchen's Open Source Data Observability. DataOps Observability monitors every data journey from da…☆46Updated this week
- Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observ…☆159Updated last week
- dbt-starrocks contains all of the code enabling dbt to work with StarRocks☆41Updated 2 months ago
- A Python Library to support running data quality rules while the spark job is running⚡☆189Updated this week
- ☆80Updated 3 months ago
- Trino dbt demo project to mix and load BigQuery data with and in a local PostgreSQL database☆75Updated 3 years ago
- Apache Hive Metastore as a Standalone server in Docker☆79Updated 11 months ago
- Repo for everything open table formats (Iceberg, Hudi, Delta Lake) and the overall Lakehouse architecture☆90Updated last month
- DataHub Actions is a framework for responding to changes to your DataHub Metadata Graph in real time.☆48Updated 3 months ago
- Support for generating modern platforms dynamically with services such as Kafka, Spark, Streamsets, HDFS, ....☆75Updated this week
- A playground to experience Gravitino☆53Updated last week
- The Workload Analyzer collects Presto® and Trino workload statistics, and analyzes them☆135Updated last year
- Examples of Spark 3.0☆47Updated 4 years ago
- Repository of helm charts for deploying DataHub on a Kubernetes cluster☆191Updated last week
- ☆89Updated 6 months ago
- a curated list of awesome lakehouse frameworks, applications, etc☆34Updated 5 months ago
- Drop-in replacement for Apache Spark UI☆281Updated 2 weeks ago