Building a Data Pipeline with an Open Source Stack
☆58Jun 27, 2025Updated 9 months ago
Alternatives and similar repositories for os-data-stack
Users that are interested in os-data-stack are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆16May 29, 2023Updated 2 years ago
- To provide a deeper understanding of how the modern, open-source data stack consisting of Iceberg, dbt, Trino, and Hive operates within a…☆45Mar 7, 2024Updated 2 years ago
- learning-by-doing data model built with dbt-core☆17Updated this week
- This project shows how to capture changes from postgres database and stream them into kafka☆42May 17, 2024Updated last year
- ☆31Jul 7, 2023Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting with the flexibility to host WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Cloudways by DigitalOcean.
- The Christmas Project is a festive-themed data engineering initiative designed to integrate and analyze diverse datasets, creating a comp…☆19Jan 11, 2025Updated last year
- build dw with dbt☆54Oct 24, 2024Updated last year
- Department of Education (DOE) for New South Wales (AUS) data stack in a box☆35Nov 13, 2024Updated last year
- RedditR for Content Engagement and Recommendation☆18Dec 21, 2017Updated 8 years ago
- Code for Medium article "Automate Presentation Creation with Python"☆24Aug 6, 2024Updated last year
- Unit testing using databricks connect☆32Nov 3, 2021Updated 4 years ago
- This is a demo project to compare two web scrapping frameworks, Playwright and Selenium and using the new Pipelining tool Dagster☆15Sep 9, 2021Updated 4 years ago
- An end-to-end open-source data stack for crawling and visualizing real estate data, facilitating insights into market trends.☆15Mar 16, 2026Updated 3 weeks ago
- A repository to store recipes, custom sources, transformations and other things to make your DataHub experience magical☆13Sep 23, 2022Updated 3 years ago
- Wordpress hosting with auto-scaling on Cloudways • AdFully Managed hosting built for WordPress-powered businesses that need reliable, auto-scalable hosting. Cloudways SafeUpdates now available.
- ☆19May 31, 2025Updated 10 months ago
- A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.☆81Aug 21, 2023Updated 2 years ago
- Docker compose and Google Colab demo to build a CDC with Delta Lake☆15Sep 7, 2022Updated 3 years ago
- This repo contains DAGs demonstrating a variety of ELT patterns using Airflow along with dbt.☆12Jan 12, 2023Updated 3 years ago
- Using Apache Airflow to author, run and monitor complex data pipelines.☆12Oct 24, 2018Updated 7 years ago
- ☆11Dec 12, 2019Updated 6 years ago
- Guideline to extract table lineage info in OpenLineage format from access history view☆14May 11, 2023Updated 2 years ago
- Repo that will help you explore how to build a hybrid workflow using Apache Airflow and Amazon ECS Anywhere☆11Jul 12, 2022Updated 3 years ago
- Data Mesh Manager (Community Edition)☆58Apr 1, 2026Updated last week
- Wordpress hosting with auto-scaling on Cloudways • AdFully Managed hosting built for WordPress-powered businesses that need reliable, auto-scalable hosting. Cloudways SafeUpdates now available.
- Proyecto de juguete para mostrar cómo realizar el setup de un proyecto de data science☆11Nov 24, 2022Updated 3 years ago
- ☆29Nov 7, 2025Updated 5 months ago
- ☆19Feb 25, 2022Updated 4 years ago
- Code for DE101 book at https://de101.startdataengineering.com/☆95Feb 22, 2026Updated last month
- ☆10Feb 2, 2024Updated 2 years ago
- ☆10Jul 1, 2024Updated last year
- 创意计算课程资源☆16Oct 16, 2020Updated 5 years ago
- ☆67Apr 1, 2026Updated last week
- ROSI Challenge repository for the XIV SBAI☆17Dec 23, 2020Updated 5 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Data Engineering Project to Extract and Process Solana Reddit Data☆40Feb 3, 2024Updated 2 years ago
- ☆24Updated this week
- A sample project for KSQL along with debezium and kafka connect☆15Aug 18, 2022Updated 3 years ago
- Classify your e-commerce products into categories of well-known e-commerce platforms. It uses OpenAI embeddings and LangChain.☆20Feb 8, 2024Updated 2 years ago
- A Python package extending pandas with helper functions for simpler exploratory data analysis and data wrangling.☆10Feb 6, 2025Updated last year
- Data Analysis and Image Processing Python Course☆12Nov 4, 2014Updated 11 years ago
- Code/Notes for the Data Engineering Zoomcamp by DataTalksClub☆32Mar 16, 2023Updated 3 years ago