pydiverse / pydiverse.pipedag
A data pipeline orchestration library for rapid iterative development with automatic cache invalidation allowing users to focus writing their tasks in pandas, polars, sqlalchemy, ibis, and alike.
☆30Updated 2 weeks ago
Alternatives and similar repositories for pydiverse.pipedag:
Users that are interested in pydiverse.pipedag are comparing it to the libraries listed below
- ☆10Updated last month
- Native polars deltalake reader☆9Updated 4 months ago
- Automated, schema-based JSON unpacking to Polars objects☆13Updated 10 months ago
- Extremely lightweight compatibility layer between pandas and Polars☆39Updated 8 months ago
- RFC document, tooling and other content related to the dataframe API standard☆105Updated 9 months ago
- Assessing whether data from database complies with reference information.☆42Updated this week
- A place to provide Coiled feedback☆15Updated 6 months ago
- Dask integration for Snowflake☆30Updated 2 months ago
- ☆36Updated this week
- Flat files, flat land.☆25Updated this week
- Time based splits for cross validation☆34Updated 2 weeks ago
- ☆89Updated 3 weeks ago
- Linear regression in SQL using dbt☆68Updated this week
- 🌎 Polars H3 Geospatial Plugin☆39Updated last week
- Rethinking machine learning pipelines☆28Updated last month
- Write your dbt models using Ibis☆56Updated last week
- Distributed Task Queue based Dask☆36Updated last year
- Coming soon☆59Updated last year
- rust-for-data☆44Updated last year
- A library to use `modal` as a backend for `joblib`.☆21Updated this week
- Jupyter Cell / Line Magics for DuckDB☆46Updated 2 months ago
- Minimal plugin loading package for polars with optional typegen☆12Updated 2 months ago
- A repository of runnable examples using ibis☆42Updated 6 months ago
- IbisML is a library for building scalable ML pipelines using Ibis.☆96Updated 3 weeks ago
- Arrow, pydantic style☆84Updated 2 years ago
- Sentiment and language detection for text analytics.☆16Updated 6 months ago
- hooqu is a library built on top of Pandas-like Dataframes for defining "unit tests for data". This is a spiritual port of Apache Deequ to…☆26Updated last month
- Comparing Polars to Pandas and a small introduction☆43Updated 3 years ago