Building a Data Pipeline with an Open Source Stack
☆59Jun 27, 2025Updated 10 months ago
Alternatives and similar repositories for os-data-stack
Users that are interested in os-data-stack are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A portable Datamart and Business Intelligence suite built with Docker, Airflow, dbt, duckdb and Superset☆49Apr 5, 2026Updated last month
- ☆16May 29, 2023Updated 2 years ago
- To provide a deeper understanding of how the modern, open-source data stack consisting of Iceberg, dbt, Trino, and Hive operates within a…☆45Mar 7, 2024Updated 2 years ago
- learning-by-doing data model built with dbt-core☆17Apr 10, 2026Updated last month
- This project shows how to capture changes from postgres database and stream them into kafka☆42May 17, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆19Oct 22, 2025Updated 6 months ago
- ☆31Jul 7, 2023Updated 2 years ago
- build dw with dbt☆55Oct 24, 2024Updated last year
- Desarrollé un proyecto de ETL sobre archivos de diferentes orígenes (CSV, JSON). Luego, utilicé FastAPI para crear una API que permita re…☆10Dec 9, 2022Updated 3 years ago
- RedditR for Content Engagement and Recommendation☆18Dec 21, 2017Updated 8 years ago
- Unit testing using databricks connect☆32Nov 3, 2021Updated 4 years ago
- This is a demo project to compare two web scrapping frameworks, Playwright and Selenium and using the new Pipelining tool Dagster☆15Sep 9, 2021Updated 4 years ago
- End to End Sales Streaming Pipeline (FastAPI, Kafka, Spark, Cassandra, MySQL, Superset)☆10May 26, 2023Updated 2 years ago
- Deployed an kafka instance in AWS EC2 Instance to streamline the data into Databricks☆10Aug 15, 2023Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- An end-to-end open-source data stack for crawling and visualizing real estate data, facilitating insights into market trends.☆15Mar 16, 2026Updated 2 months ago
- A collection of Data Engineering projects using different cloud providers. Explore real-world implementations of data pipelines, transfor…☆16Apr 7, 2025Updated last year
- XML/XSLT processing in the browser, supported by a Typescript library☆11Feb 18, 2025Updated last year
- ☆20May 31, 2025Updated 11 months ago
- ⚡ An Augmented Reality real-world length measuring web application built by the modification of the example being provided by babylonjs -…☆12Sep 24, 2020Updated 5 years ago
- How to build an ACP compliant agent that uses MCP as well!☆11May 6, 2025Updated last year
- A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.☆81Aug 21, 2023Updated 2 years ago
- ☆12Aug 13, 2024Updated last year
- Data Analysis Experiments☆12Nov 2, 2017Updated 8 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Docker compose and Google Colab demo to build a CDC with Delta Lake☆15Sep 7, 2022Updated 3 years ago
- ☆12Jan 18, 2021Updated 5 years ago
- This repo contains DAGs demonstrating a variety of ELT patterns using Airflow along with dbt.☆12Jan 12, 2023Updated 3 years ago
- Using Apache Airflow to author, run and monitor complex data pipelines.☆12Oct 24, 2018Updated 7 years ago
- ☆11Dec 12, 2019Updated 6 years ago
- Guideline to extract table lineage info in OpenLineage format from access history view☆14May 11, 2023Updated 3 years ago
- Metabase Teradata Driver shipped as 3rd party plugin☆12Dec 1, 2025Updated 5 months ago
- Repo that will help you explore how to build a hybrid workflow using Apache Airflow and Amazon ECS Anywhere☆11Jul 12, 2022Updated 3 years ago
- Data Mesh Manager (Community Edition)☆60Apr 1, 2026Updated last month
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆19Feb 25, 2022Updated 4 years ago
- Building Data Lakehouse by open source technology. Support end to end data pipeline, from source data on AWS S3 to Lakehouse, visualize a…☆40Dec 15, 2025Updated 5 months ago
- Para entender e aprender um pouco sobre o Apache Kafka.https://www.youtube.com/channel/UC3pevgVzUWKo5CoWdhDsoHw☆13Mar 10, 2026Updated 2 months ago
- ☆10Feb 2, 2024Updated 2 years ago
- Code for DE101 book at https://de101.startdataengineering.com/☆105Feb 22, 2026Updated 2 months ago
- ☆75May 14, 2026Updated last week
- ☆11Feb 13, 2019Updated 7 years ago