To provide a deeper understanding of how the modern, open-source data stack consisting of Iceberg, dbt, Trino, and Hive operates within a music streaming platform, let’s delve into the detailed workflow and benefits of each component.
☆45Mar 7, 2024Updated 2 years ago
Alternatives and similar repositories for Iceberg-Dbt-Trino-Hive-modern-open-source-data-stack
Users that are interested in Iceberg-Dbt-Trino-Hive-modern-open-source-data-stack are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- In this article, you will learn how to set up a real-time data processing and analytics environment using Docker, MySQL, Redpanda, MinIO,…☆11Jun 27, 2023Updated 2 years ago
- On-premises ELT Pipeline☆32Jul 10, 2025Updated 9 months ago
- Testing some ideas in the Python playground.☆11Sep 23, 2022Updated 3 years ago
- Image building contents for running Spark standalone on Kubernetes☆16Apr 10, 2020Updated 6 years ago
- Building a Data Pipeline with an Open Source Stack☆59Jun 27, 2025Updated 10 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆39Apr 25, 2024Updated 2 years ago
- A Python package that creates fine-grained dbt tasks on Apache Airflow☆84Mar 9, 2026Updated 2 months ago
- Building Data Lakehouse by open source technology. Support end to end data pipeline, from source data on AWS S3 to Lakehouse, visualize a…☆40Dec 15, 2025Updated 4 months ago
- An Open Source Based Reference Analytics Platform for a Retail Company☆24Sep 11, 2024Updated last year
- A DataOps framework for building a lakehouse.☆57Updated this week
- An LLM-powered chatbot with the added context of the dbt knowledge base.☆39Dec 4, 2024Updated last year
- A tampermonkey / greasemonkey tool to download Scridb.com content☆14Mar 30, 2022Updated 4 years ago
- Transporter for integrating OpenLineage with OpenMetadata☆18Sep 10, 2025Updated 7 months ago
- Build Data Lake using Open Source tools☆128May 27, 2025Updated 11 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Tooling to build a custom Confluent Platform Kafka Connect container with additional connectors from Confluent Hub.☆15Oct 26, 2020Updated 5 years ago
- A collection of Data Engineering projects using different cloud providers. Explore real-world implementations of data pipelines, transfor…☆16Apr 7, 2025Updated last year
- A data generator for Apache Druid☆12Mar 26, 2025Updated last year
- A course in data warehouse☆19Sep 27, 2025Updated 7 months ago
- Build a data pipeline with Apache Airflow☆11May 7, 2021Updated 5 years ago
- A portable Datamart and Business Intelligence suite built with Docker, Airflow, dbt, duckdb and Superset☆49Apr 5, 2026Updated last month
- Asynchronous file handers for Python's logging☆15Jul 22, 2017Updated 8 years ago
- Data Pipeline with Dagster, dlt, and dbt using UV Python☆23Feb 15, 2025Updated last year
- Playbook to provision a Confluent Cluster☆10Oct 22, 2017Updated 8 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Complete data engineering pipeline running on Minikube Kubernetes, Argo CD, Spark, Trino, S3, Delta lake, Postgres+ Debezium CDC, MySQL,…☆29May 19, 2025Updated 11 months ago
- This repo is an approach to TDD in machine learning model operation. it covers project structure, testing essentials using pytest with Gi…☆15Dec 2, 2020Updated 5 years ago
- ☆19Mar 24, 2025Updated last year
- Amazon EMR Serverless and Amazon MSK Serverless Demo☆13Jul 31, 2022Updated 3 years ago
- ☆10Jul 21, 2022Updated 3 years ago
- Glue VSCode devcontainer setup☆14Jan 31, 2023Updated 3 years ago
- ☆21Nov 21, 2023Updated 2 years ago
- GitHub Actions Dashboard☆18Mar 9, 2026Updated 2 months ago
- Objects and Animals detection with Wifi camera and Yolo☆17Apr 28, 2024Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- hackintosh 13900 macos☆12Jun 23, 2023Updated 2 years ago
- Python tool to help export Azure DevOps WIKI into a single PDF☆10May 10, 2020Updated 5 years ago
- ☆11Mar 7, 2021Updated 5 years ago
- ☆23Sep 5, 2022Updated 3 years ago
- Automated basic infrastructure to intall OKD4 on free ESXi☆13Aug 8, 2020Updated 5 years ago
- reating a modern data pipeline using a combination of Terraform, AWS Lambda and S3, Snowflake, DBT, Mage AI, and Dash.☆15Jun 26, 2023Updated 2 years ago
- Exemplos do livro Estatística para Data Science, da Casa do Código☆12Feb 18, 2025Updated last year