pydiverse / pydiverse.pipedagLinks
A data pipeline orchestration library for rapid iterative development with automatic cache invalidation allowing users to focus writing their tasks in pandas, polars, sqlalchemy, ibis, and alike.
☆32Updated this week
Alternatives and similar repositories for pydiverse.pipedag
Users that are interested in pydiverse.pipedag are comparing it to the libraries listed below
Sorting:
- ☆38Updated this week
- IbisML is a library for building scalable ML pipelines using Ibis.☆110Updated 6 months ago
- RFC document, tooling and other content related to the dataframe API standard☆110Updated last year
- A toolbox 🧰 for Jupyter notebooks 📙: testing, experiment tracking, debugging, profiling, and more!☆67Updated 9 months ago
- Dask integration for Snowflake☆30Updated 8 months ago
- Native polars deltalake reader☆9Updated 10 months ago
- A repository of runnable examples using ibis☆44Updated last year
- Coming soon☆61Updated last year
- A place to provide Coiled feedback☆20Updated 4 months ago
- Python package implementing transformers for pre processing steps for machine learning.☆61Updated last week
- Turn SciKitLearn pipelines into SQL☆35Updated 3 weeks ago
- Automated, schema-based JSON unpacking to Polars objects☆13Updated last year
- ☆89Updated 5 months ago
- Make Polars DataFrames Generic Types☆15Updated 2 months ago
- ☆11Updated 10 months ago
- Fast approximate joins on string columns for polars dataframes.☆13Updated 8 months ago
- Assessing whether data from database complies with reference information.☆43Updated last week
- A curated list of polars projects and resources.☆37Updated 3 months ago
- Arrow, pydantic style☆84Updated 2 years ago
- Tools for making Prefect work better for typical data science workflows☆18Updated 3 years ago
- Python bindings and arrow integration for the rust object_store crate.☆63Updated 11 months ago
- DSL for HTML that targets marimo and more!☆44Updated last week
- Sentiment and language detection for text analytics.☆17Updated last year
- Typed wrappers over pandas DataFrames with schema validation☆101Updated last year
- Polars plugin for stable hashing functionality☆77Updated 2 months ago
- An abstraction layer for parameter tuning☆35Updated 10 months ago
- Polars extension for fzf-style fuzzy matching☆28Updated 10 months ago
- Easy and flexible data contracts☆152Updated 3 weeks ago
- Capture all information throughout your model's development in a reproducible way and tie results directly to the model code!☆133Updated this week
- 🦖 A SQL-on-everything Query Engine you can execute over multiple databases and file formats. Query your data, where it lives.☆105Updated this week