wirelessr / trino-iceberg-playground
Query Iceberg in Trino, Nessie as Catalog, and use minio to replace AWS S3
☆18Updated 10 months ago
Alternatives and similar repositories for trino-iceberg-playground:
Users that are interested in trino-iceberg-playground are comparing it to the libraries listed below
- Docker envinroment to stream data from Kafka to Iceberg tables☆26Updated last year
- A write-audit-publish implementation on a data lake without the JVM☆46Updated 7 months ago
- Streaming Synthetic Sales Data Generator: Streaming sales data generator for Apache Kafka, written in Python☆43Updated 2 years ago
- A minimal docker compose setup for experimenting with cloud agnostic Lakehouse Architectures Apache Spark with Hive Metastore + Delta Lak…☆21Updated 11 months ago
- A Rust based data/CSV/Parquet file generator☆46Updated 3 weeks ago
- ☆16Updated last year
- ☆13Updated 2 years ago
- Unity Catalog UI☆40Updated 6 months ago
- Example Dagster Cloud code for the Hooli Data Engineering organization.☆1Updated last week
- To provide a deeper understanding of how the modern, open-source data stack consisting of Iceberg, dbt, Trino, and Hive operates within a…☆32Updated last year
- ☆71Updated 2 months ago
- Delta Lake helper methods. No Spark dependency.☆23Updated 6 months ago
- Trino dbt demo project to mix and load BigQuery data with and in a local PostgreSQL database☆73Updated 3 years ago
- Utility functions for dbt projects running on Spark☆31Updated last month
- Cost Efficient Data Pipelines with DuckDB☆51Updated 8 months ago
- Repo for CDC with debezium blog post☆28Updated 6 months ago
- ☆75Updated 5 months ago
- Code snippets for Data Engineering Design Patterns book☆75Updated 2 weeks ago
- Presto Trino with Apache Hive Postgres metastore☆40Updated 6 months ago
- Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observ…☆134Updated 2 months ago
- Delta Lake Documentation☆49Updated 9 months ago
- Yet Another (Spark) ETL Framework☆20Updated last year
- Python package for querying iceberg data through duckdb.☆64Updated last year
- ☆20Updated 3 years ago
- Full stack data engineering tools and infrastructure set-up☆50Updated 4 years ago
- The go to demo for public and private dbt Learn☆76Updated this week
- Building Data Lakehouse by open source technology. Support end to end data pipeline, from source data on AWS S3 to Lakehouse, visualize a…☆24Updated 11 months ago
- Demonstrating the capabilities of DuckDB as a transformation engine for data lakes☆23Updated 5 months ago
- A curated list of dagster code snippets for data engineers☆54Updated last year
- Quick Guides from Dremio on Several topics☆69Updated 2 months ago