Softlandia-Ltd / stateful-streaming-examples
Stateful streaming computations implemented with many technologies
☆31Updated 4 months ago
Related projects: ⓘ
- Tutorials for Fugue - A unified interface for distributed computing. Fugue executes SQL, Python, and Pandas code on Spark and Dask withou…☆111Updated 5 months ago
- A playground for running duckdb as a stateless query engine over a data lake☆156Updated 8 months ago
- ☆54Updated 8 months ago
- IbisML is a library for building scalable ML pipelines using Ibis.☆81Updated this week
- The Modern Data Stack in a Python package☆45Updated 9 months ago
- A Minimalistic Rust Implementation of Delta Sharing Server.☆79Updated last month
- Ray provider for Apache Airflow☆47Updated 7 months ago
- Swiple enables you to easily observe, understand, validate and improve the quality of your data☆79Updated this week
- Delta reader for the Ray open-source toolkit for building ML applications☆40Updated 7 months ago
- Apache DataFusion Python Bindings☆349Updated this week
- A write-audit-publish implementation on a data lake without the JVM☆39Updated last month
- A software engineering framework to jump start your machine learning projects☆35Updated 3 months ago
- An fsspec implementation for the lakeFS project☆39Updated 2 months ago
- Python binding for DataFusion☆59Updated 2 years ago
- The DBT of ML, as Aligned describes data dependencies in ML systems, and reduce technical data debt☆49Updated last week
- ☆30Updated 3 years ago
- Cloud-agnostic Python API☆59Updated 3 months ago
- Arrow, pydantic style☆82Updated last year
- Tools and utilities for operating Metaflow in production☆44Updated 2 weeks ago
- Read Apache Arrow batches from ODBC data sources in Python☆54Updated 2 weeks ago
- 🚕 Self-contained demo using Redpanda, Materialize, River, Redis, and Streamlit to predict taxi trip durations☆44Updated last year
- A kafka streams client library built on confluent-kafka-python☆67Updated 11 months ago
- This library can convert a pydantic class to a avro schema or generate python code from a avro schema.☆60Updated last week
- ☆66Updated 8 months ago
- Dask integration for Snowflake☆29Updated 2 months ago
- ☆72Updated last week
- Experimental MLflow plugin for Google Cloud Vertex AI☆37Updated 6 months ago
- A data modelling layer built on top of polars and pydantic☆197Updated last year
- ☆80Updated 4 months ago
- Polars plugin for stable hashing functionality☆51Updated last month