avriiil / stream-this-dataset
Code to convert static datasets into simulated data streams
☆15Updated last year
Related projects ⓘ
Alternatives and complementary repositories for stream-this-dataset
- A write-audit-publish implementation on a data lake without the JVM☆41Updated 2 months ago
- Set up a Cost-Effective Modern Data Stack for a Charity☆19Updated 8 months ago
- Ingesting data with Pulumi, AWS lambdas and Snowflake in a scalable, fully replayable manner☆68Updated 2 years ago
- Contribute to dlt verified sources 🔥☆70Updated last week
- Airbyte made simple (no UI, no database, no cluster)☆148Updated this week
- A Python PySpark Projet with Poetry☆18Updated last month
- ☆15Updated 3 months ago
- Playground for using large language models into the Modern Data Stack for entity matching☆106Updated last year
- Possibly the fastest DataFrame-agnostic quality check library in town.☆171Updated this week
- Fugue collections for Prefect 2.0☆38Updated last year
- A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects☆191Updated this week
- ☆32Updated 8 months ago
- A dbt-core plugin to weave together multi-project dbt-core deployments☆118Updated last month
- end-to-end data engineering project to get insights from PyPi using python, duckdb, MotherDuck & Evidence☆145Updated 2 weeks ago
- Open Data Stack Projects: Examples of End to End Data Engineering Projects☆70Updated last year
- A dbt-core python package that automates the management and creation of dbt groups, contracts, access, and versions.☆110Updated 3 months ago
- ☆32Updated last year
- Data Quality and Observability platform for the whole data lifecycle, from profiling new data sources to full automation with Data Observ…☆111Updated last week
- Step-by-step tutorial on building a Kimball dimensional model with dbt☆109Updated 3 months ago
- ☆48Updated 4 months ago
- Kedro Plugin to support running workflows on Kubeflow Pipelines☆52Updated 2 months ago
- Demo repository to lambda-fy your dbt runs☆11Updated last year
- Project demonstrating how to automate Prefect 2.0 deployments to AWS ECS Fargate☆113Updated last year
- Food for thoughts around data contracts☆24Updated 3 months ago
- fst: flow state tool | smooth where you want it, friction where you need it when data engineering☆32Updated last year
- ☆54Updated 2 weeks ago
- Swiple enables you to easily observe, understand, validate and improve the quality of your data☆79Updated this week
- Example repository showing how to build a data platform with Prefect, dbt and Snowflake☆95Updated last year
- Project for "Data pipeline design patterns" blog.☆41Updated 3 months ago
- Full stack data engineering tools and infrastructure set-up☆41Updated 3 years ago