Building a Data Pipeline with an Open Source Stack
☆59Jun 27, 2025Updated last year
Alternatives and similar repositories for os-data-stack
Users that are interested in os-data-stack are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆16Mar 2, 2024Updated 2 years ago
- Desarrollé un proyecto de ETL sobre archivos de diferentes orígenes (CSV, JSON). Luego, utilicé FastAPI para crear una API que permita re…☆10Dec 9, 2022Updated 3 years ago
- learning-by-doing data model built with dbt-core☆17Apr 10, 2026Updated 4 months ago
- Leverage Ollion's AWS Landing Zone to deploy a secure, compliant foundation with ease. The repository contains an implementation of a sec…☆12Mar 14, 2024Updated 2 years ago
- To provide a deeper understanding of how the modern, open-source data stack consisting of Iceberg, dbt, Trino, and Hive operates within a…☆47Mar 7, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆19Feb 25, 2022Updated 4 years ago
- The Christmas Project is a festive-themed data engineering initiative designed to integrate and analyze diverse datasets, creating a comp…☆20Jan 11, 2025Updated last year
- ☆31Jul 7, 2023Updated 3 years ago
- Code for Medium article "Automate Presentation Creation with Python"☆25Aug 6, 2024Updated 2 years ago
- An end-to-end open-source data stack for crawling and visualizing real estate data, facilitating insights into market trends.☆15Mar 16, 2026Updated 5 months ago
- Unit testing using databricks connect☆32Nov 3, 2021Updated 4 years ago
- ☆21May 3, 2023Updated 3 years ago
- RedditR for Content Engagement and Recommendation☆18Dec 21, 2017Updated 8 years ago
- This is a demo project to compare two web scrapping frameworks, Playwright and Selenium and using the new Pipelining tool Dagster☆15Sep 9, 2021Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- End to End Sales Streaming Pipeline (FastAPI, Kafka, Spark, Cassandra, MySQL, Superset)☆10May 26, 2023Updated 3 years ago
- Deployed an kafka instance in AWS EC2 Instance to streamline the data into Databricks☆10Aug 15, 2023Updated 3 years ago
- ⚡ An Augmented Reality real-world length measuring web application built by the modification of the example being provided by babylonjs -…☆12Sep 24, 2020Updated 5 years ago
- Repo that will help you explore how to build a hybrid workflow using Apache Airflow and Amazon ECS Anywhere☆11Jul 12, 2022Updated 4 years ago
- A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.☆82Aug 21, 2023Updated 3 years ago
- Escrevi este roadmap para ajudar amigos próximos, está aberto a sugestões!☆14Jun 4, 2026Updated 2 months ago
- Homeworks, Midterm, & Capstone from ML BookCamp☆16Jan 28, 2022Updated 4 years ago
- Production-style real-time e-commerce lakehouse with Kafka, Airflow, Databricks, Medallion architecture, data quality, quarantine, Terraf…☆34May 30, 2026Updated 3 months ago
- Using Apache Airflow to author, run and monitor complex data pipelines.☆12Oct 24, 2018Updated 7 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Docker compose and Google Colab demo to build a CDC with Delta Lake☆15Sep 7, 2022Updated 3 years ago
- Building Data Lakehouse by open source technology. Support end to end data pipeline, from source data on AWS S3 to Lakehouse, visualize a…☆43Dec 15, 2025Updated 8 months ago
- Guideline to extract table lineage info in OpenLineage format from access history view☆14May 11, 2023Updated 3 years ago
- Data Analysis and Image Processing Python Course☆12Nov 4, 2014Updated 11 years ago
- Ontology Catalog in SQL to use with Timbr Intelligent Semantic Layer☆22Sep 8, 2025Updated 11 months ago
- text2sql with modern LLMs (duckdb-nsql, SQLCoder etc ...)☆18Apr 13, 2024Updated 2 years ago
- ☆11Aug 20, 2024Updated 2 years ago
- ☆10Dec 29, 2021Updated 4 years ago
- 创意计算课程资源☆16Oct 16, 2020Updated 5 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆17Jun 27, 2020Updated 6 years ago
- Data Engineering Project to Extract and Process Solana Reddit Data☆40Feb 3, 2024Updated 2 years ago
- A CLI to convert SQL models across database dialects in your dbt projects.☆16May 6, 2025Updated last year
- Predicting the Stock Market - Can we do it?☆10Jul 24, 2021Updated 5 years ago
- Leverage Ollion's GCP Landing Zone to deploy a secure, compliant foundation with ease. The repository contains an implementation of a sec…☆38Jun 13, 2024Updated 2 years ago
- A sample project for KSQL along with debezium and kafka connect☆15Aug 18, 2022Updated 4 years ago
- ☆19Updated this week