avriiil / stream-this-dataset
Code to convert static datasets into simulated data streams
☆15Updated 2 years ago
Alternatives and similar repositories for stream-this-dataset:
Users that are interested in stream-this-dataset are comparing it to the libraries listed below
- Cookiecutter Pathway is a framework for jumpstarting production-ready Pathway projects quickly.☆54Updated last year
- Code examples for the Pathway programming framework☆40Updated last year
- Real-time data pipeline for AI apps in Azure☆25Updated last year
- Airbyte made simple (no UI, no database, no cluster)☆171Updated 2 weeks ago
- Possibly the fastest DataFrame-agnostic quality check library in town.☆187Updated this week
- A write-audit-publish implementation on a data lake without the JVM☆46Updated 8 months ago
- Open Data Stack Projects: Examples of End to End Data Engineering Projects☆82Updated last year
- Pythonic Programming Framework to orchestrate jobs in Databricks Workflow☆215Updated last week
- Example repository showing how to build a data platform with Prefect, dbt and Snowflake☆100Updated 2 years ago
- A web extension to empower dbt users☆27Updated 2 years ago
- Project for "Data pipeline design patterns" blog.☆45Updated 8 months ago
- Food for thoughts around data contracts☆25Updated last month
- New generation opensource data stack☆67Updated 2 years ago
- Modern serverless lakehouse implementing HOOK methodology, Unified Star Schema (USS), and Analytical Data Storage System (ADSS) principle…☆111Updated 3 weeks ago
- Ingesting data with Pulumi, AWS lambdas and Snowflake in a scalable, fully replayable manner☆71Updated 3 years ago
- ✨ A Pydantic to PySpark schema library☆84Updated this week
- PDF DataSource for Apache Spark, allow to read PDF files directly to the DataFrame and ocr it☆49Updated last week
- A simple and easy to use Data Quality (DQ) tool built with Python.☆50Updated last year
- Find real-time sales with AI-powered Python API using ChatGPT and LLM (Large Language Model) App.☆84Updated last year
- A "modern" Strava data pipeline fueled by dlt, duckdb, dbt, and evidence.dev☆32Updated 3 months ago
- Example Dagster Cloud code for the Hooli Data Engineering organization.☆1Updated 3 weeks ago
- Playground for using large language models into the Modern Data Stack for entity matching☆107Updated 2 years ago
- How to use Prefect Deployments with flow code baked into a Docker image☆33Updated 2 years ago
- ☆31Updated last week
- Pytest plugin for dbt core☆60Updated 3 months ago
- ☆49Updated 9 months ago
- Event data simulator. Generates a stream of pseudo-random events from a set of users, designed to simulate web traffic.☆86Updated last year
- A Python Library to support running data quality rules while the spark job is running⚡☆183Updated last week
- A guide for leading a data (engineering) team☆62Updated 11 months ago
- An end-to-end data pipeline which extracts divvy bikeshare data from web loads it into data lake and datawarehouse transforms it using db…☆35Updated last year