fpgmaas / stream-iotLinks
An end-to-end workflow for processing streaming data on Azure.
☆15Updated 9 months ago
Alternatives and similar repositories for stream-iot
Users that are interested in stream-iot are comparing it to the libraries listed below
Sorting:
- reating a modern data pipeline using a combination of Terraform, AWS Lambda and S3, Snowflake, DBT, Mage AI, and Dash.☆14Updated 2 years ago
- Cost Efficient Data Pipelines with DuckDB☆54Updated last month
- Full stack data engineering tools and infrastructure set-up☆53Updated 4 years ago
- A Postgres data warehouse for processing synthetic data using IAC principles☆18Updated 2 years ago
- ☆28Updated 5 months ago
- To provide a deeper understanding of how the modern, open-source data stack consisting of Iceberg, dbt, Trino, and Hive operates within a…☆35Updated last year
- ☆18Updated 10 months ago
- This is a demo streaming project simulating a music streaming service.☆35Updated 10 months ago
- A portable Datamart and Business Intelligence suite built with Docker, Airflow, dbt, PostgreSQL and Superset☆43Updated 7 months ago
- Code for my "Efficient Data Processing in SQL" book.☆56Updated 10 months ago
- New generation opensource data stack☆68Updated 3 years ago
- A modern ELT demo using airbyte, dbt, snowflake and dagster☆28Updated 2 years ago
- Code snippets for Data Engineering Design Patterns book☆119Updated 3 months ago
- DataTalks Workshop Materials☆19Updated last year
- Repo for CDC with debezium blog post☆28Updated 9 months ago
- A simple and easy to use Data Quality (DQ) tool built with Python.☆50Updated last year
- Delta-Lake, ETL, Spark, Airflow☆47Updated 2 years ago
- ☆12Updated 3 years ago
- Open Data Stack Projects: Examples of End to End Data Engineering Projects☆84Updated 2 years ago
- Building Data Lakehouse by open source technology. Support end to end data pipeline, from source data on AWS S3 to Lakehouse, visualize a…☆30Updated last year
- A write-audit-publish implementation on a data lake without the JVM☆46Updated 10 months ago
- A Python package to help Databricks Unity Catalog users to read and query Delta Lake tables with Polars, DuckDb, or PyArrow.☆25Updated last year
- Code for blog at https://www.startdataengineering.com/post/python-for-de/☆77Updated last year
- A simple Data Engineering solution for testing or education purposes. You only need to know SQL and Python to understand this project. Da…☆25Updated 2 years ago
- duckdb-etl-framework☆12Updated 6 months ago
- Data models for Hubspot built using dbt.☆35Updated 2 months ago
- A DataOps framework for building a lakehouse.☆50Updated this week
- A "modern" Strava data pipeline fueled by dlt, duckdb, dbt, and evidence.dev☆33Updated last month
- dlt-dagster-demo☆11Updated last year
- Code to help generate SQL for stakeholders. Code at https://www.startdataengineering.com/post/data-democratize-llm/☆11Updated last year