To provide a deeper understanding of how the modern, open-source data stack consisting of Iceberg, dbt, Trino, and Hive operates within a music streaming platform, let’s delve into the detailed workflow and benefits of each component.
☆47Mar 7, 2024Updated 2 years ago
Alternatives and similar repositories for Iceberg-Dbt-Trino-Hive-modern-open-source-data-stack
Users that are interested in Iceberg-Dbt-Trino-Hive-modern-open-source-data-stack are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- In this article, you will learn how to set up a real-time data processing and analytics environment using Docker, MySQL, Redpanda, MinIO,…☆11Jun 27, 2023Updated 3 years ago
- From FHIR ingestion to patient outcomes analysis☆15Dec 2, 2024Updated last year
- ☆13Oct 4, 2023Updated 2 years ago
- ☆40Apr 25, 2024Updated 2 years ago
- End-to-end data platform: A PoC Data Platform project utilizing modern data stack (Spark, Airflow, DBT, Trino, Lightdash, Hive metastore,…☆50Oct 14, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A course in data warehouse☆23Sep 27, 2025Updated 11 months ago
- A Python package that creates fine-grained dbt tasks on Apache Airflow☆85Jul 8, 2026Updated 2 months ago
- End-to-end ELT pipeline for 160K+ Skytrax airline reviews: Airflow orchestration, BeautifulSoup scraping, S3 staging, Snowflake wareho…☆14Jul 30, 2026Updated last month
- An end-to-end open-source data stack for crawling and visualizing real estate data, facilitating insights into market trends.☆15Mar 16, 2026Updated 6 months ago
- Building Data Lakehouse by open source technology. Support end to end data pipeline, from source data on AWS S3 to Lakehouse, visualize a…☆42Dec 15, 2025Updated 9 months ago
- An LLM-powered chatbot with the added context of the dbt knowledge base.☆39Dec 4, 2024Updated last year
- An Open Source Based Reference Analytics Platform for a Retail Company☆24Sep 11, 2024Updated 2 years ago
- A DataOps framework for building a lakehouse.☆57Sep 11, 2026Updated last week
- Integrating Apache Airflow, dbt, Great Expectations and Apache Superset to develop a modern open source data stack.☆19Jun 19, 2022Updated 4 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- This repo demonstrate a comprehensive modern data stack using popular open-source tools.☆39Sep 11, 2023Updated 3 years ago
- A portable Datamart and Business Intelligence suite built with Docker, Airflow, dbt, duckdb and Superset☆49Updated this week
- A data generator for Apache Druid☆12Mar 26, 2025Updated last year
- Data Pipeline with Dagster, dlt, and dbt using UV Python☆26Feb 15, 2025Updated last year
- Playbook to provision a Confluent Cluster☆10Oct 22, 2017Updated 8 years ago
- DIRECT, the Data Integration Run-time Execution Control Tool, is a data logistics control framework that can be used to monitor, log, aud…☆29Feb 14, 2026Updated 7 months ago
- Build a data pipeline with Apache Airflow☆11May 7, 2021Updated 5 years ago
- This repo is an approach to TDD in machine learning model operation. it covers project structure, testing essentials using pytest with Gi…☆15Dec 2, 2020Updated 5 years ago
- Terraform AWS free tier, EC2/ECR/RDS/EFS/DynamoDB/Lambda/S3. Docker running on EC2, Traefik reverse proxy, Lets Encrypt, dynamic DNS, Zer…☆38Jun 19, 2026Updated 3 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- This repo contains DAGs demonstrating a variety of ELT patterns using Airflow along with dbt.☆12Jan 12, 2023Updated 3 years ago
- ☆21Nov 21, 2023Updated 2 years ago
- Amazon EMR Serverless and Amazon MSK Serverless Demo☆13Jul 31, 2022Updated 4 years ago
- Python tool to help export Azure DevOps WIKI into a single PDF☆10May 10, 2020Updated 6 years ago
- ☆22Sep 5, 2022Updated 4 years ago
- repo do Diego☆10Nov 7, 2023Updated 2 years ago
- Automated basic infrastructure to intall OKD4 on free ESXi☆13Aug 8, 2020Updated 6 years ago
- FastAPI ASGI with Django ORM and admin☆15May 15, 2022Updated 4 years ago
- Exemplos do livro Estatística para Data Science, da Casa do Código☆13Feb 18, 2025Updated last year
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆23Mar 30, 2022Updated 4 years ago
- ☆11Mar 7, 2021Updated 5 years ago
- OMOP <-> FHIR mapper☆11Mar 6, 2023Updated 3 years ago
- A python script to convert your youtube URL to an mp3 file and download it to the same directory as the .py file.☆12May 20, 2025Updated last year
- This workshop will familiarize you with some of the key steps towards building an autonomous driving data lake and extracting images from…☆11Jul 12, 2022Updated 4 years ago
- Ansible for Kubernetes by Examples by Luca Berton☆12Dec 25, 2023Updated 2 years ago
- Introdução a processos de validação mais complexos do que o hold out básico (train/test), como validação cruzada, grupos etc.☆13Nov 26, 2018Updated 7 years ago