tj--- / iceberg-demo
A sample implementation of stream writes to an Iceberg table on GCS using Flink and reading it using Trino
☆15Updated 2 years ago
Related projects: ⓘ
- Adapter for dbt that executes dbt pipelines on Apache Flink☆80Updated 6 months ago
- ☆77Updated last year
- Simple project to expose a catalog over REST using a Java catalog backend☆103Updated this week
- Trino dbt demo project to mix and load BigQuery data with and in a local PostgreSQL database☆64Updated 3 years ago
- ☆232Updated this week
- Presto Trino with Apache Hive Postgres metastore☆36Updated last week
- ☆37Updated 6 months ago
- Example for article Running Spark 3 with standalone Hive Metastore 3.0☆96Updated last year
- Docker envinroment to stream data from Kafka to Iceberg tables☆24Updated 6 months ago
- Playground for Lakehouse (Iceberg, Hudi, Spark, Flink, Trino, DBT, Airflow, Kafka, Debezium CDC)☆40Updated 11 months ago
- Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pi…☆91Updated this week
- Apache Hive Metastore as a Standalone server in Docker☆64Updated 3 weeks ago
- Replicates any database (CDC events) to Apache Iceberg (To Cloud Storage)☆179Updated this week
- dbt-starrocks contains all of the code enabling dbt to work with StarRocks☆16Updated last month
- ☆31Updated 2 years ago
- Streaming Synthetic Sales Data Generator: Streaming sales data generator for Apache Kafka, written in Python☆43Updated last year
- Support for generating modern platforms dynamically with services such as Kafka, Spark, Streamsets, HDFS, ....☆68Updated this week
- A Python Library to support running data quality rules while the spark job is running⚡☆161Updated last month
- dbt + Trino demo project, using TPC-H sample data☆18Updated 5 months ago
- Yet Another (Spark) ETL Framework☆18Updated 10 months ago
- The Trino (https://trino.io/) adapter plugin for dbt (https://getdbt.com)☆207Updated this week
- Open source stack lakehouse☆25Updated 6 months ago
- A Table format agnostic data sharing framework☆36Updated 7 months ago
- A repository of sample code to show data quality checking best practices using Airflow.☆71Updated last year
- Delta Lake Documentation☆45Updated 3 months ago
- REST API for Apache Spark on K8S or YARN☆89Updated last week
- Delta Lake helper methods. No Spark dependency.☆21Updated last week
- Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observ…☆102Updated this week
- A Python package to submit and manage Apache Spark applications on Kubernetes.☆33Updated last month
- ☆37Updated last month