jaehyeon-kim / flink-demos
Apache Flink (Pyflink) and Related Projects
☆23Updated 3 months ago
Related projects: ⓘ
- Trino dbt demo project to mix and load BigQuery data with and in a local PostgreSQL database☆64Updated 3 years ago
- ☆21Updated 6 months ago
- Adapter for dbt that executes dbt pipelines on Apache Flink☆80Updated 6 months ago
- Example for article Running Spark 3 with standalone Hive Metastore 3.0☆96Updated last year
- Spark on Kubernetes using Helm☆34Updated 4 years ago
- Apache Hive Metastore as a Standalone server in Docker☆64Updated 3 weeks ago
- Docker envinroment to stream data from Kafka to Iceberg tables☆24Updated 6 months ago
- Presto Trino with Apache Hive Postgres metastore☆36Updated last week
- ☆249Updated 2 weeks ago
- ☆232Updated this week
- ☆40Updated last year
- ☆13Updated last year
- Sparglim✨ makes PySpark App Configurable and Deploy Spark Connect Server Easier!☆35Updated last month
- Utility functions for dbt projects running on Trino☆19Updated 9 months ago
- dbt + Trino demo project, using TPC-H sample data☆18Updated 5 months ago
- The Python fake data producer for Apache Kafka® is a complete demo app allowing you to quickly produce JSON fake streaming datasets and …☆81Updated 4 months ago
- Playground for Lakehouse (Iceberg, Hudi, Spark, Flink, Trino, DBT, Airflow, Kafka, Debezium CDC)☆40Updated 11 months ago
- The Trino (https://trino.io/) adapter plugin for dbt (https://getdbt.com)☆207Updated this week
- Streaming Synthetic Sales Data Generator: Streaming sales data generator for Apache Kafka, written in Python☆43Updated last year
- Simple project to expose a catalog over REST using a Java catalog backend☆103Updated this week
- Yet Another (Spark) ETL Framework☆18Updated 10 months ago
- Library to convert DBT manifest metadata to Airflow tasks☆45Updated 6 months ago
- Sample Airflow DAGs☆60Updated last year
- ☆39Updated last week
- ☆77Updated last year
- Minimal example to run Trino, Minio, and Hive standalone metastore on docker☆45Updated 2 years ago
- Jupyter notebooks and AWS CloudFormation template to show how Hudi, Iceberg, and Delta Lake work☆47Updated 2 years ago
- Complete data engineering pipeline running on Minikube Kubernetes, Argo CD, Spark, Trino, S3, Delta lake, Postgres+ Debezium CDC, MySQL,…☆25Updated 5 months ago
- ☆3Updated last year
- Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pi…☆91Updated this week