pydiverse / pydiverse.pipedag
A data pipeline orchestration library for rapid iterative development with automatic cache invalidation allowing users to focus writing their tasks in pandas, polars, sqlalchemy, ibis, and alike.
☆30Updated this week
Alternatives and similar repositories for pydiverse.pipedag:
Users that are interested in pydiverse.pipedag are comparing it to the libraries listed below
- Assessing whether data from database complies with reference information.☆42Updated this week
- A toolbox 🧰 for Jupyter notebooks 📙: testing, experiment tracking, debugging, profiling, and more!☆68Updated 5 months ago
- Coming soon☆59Updated last year
- ☆37Updated this week
- Automated, schema-based JSON unpacking to Polars objects☆13Updated 11 months ago
- ☆10Updated 2 months ago
- Extremely lightweight compatibility layer between pandas and Polars☆39Updated 9 months ago
- ☆89Updated 3 weeks ago
- IbisML is a library for building scalable ML pipelines using Ibis.☆100Updated last month
- A repository of runnable examples using ibis☆42Updated 7 months ago
- Native polars deltalake reader☆9Updated 5 months ago
- Polars plugin for stable hashing functionality☆60Updated 2 months ago
- Easy and flexible data contracts☆110Updated last week
- Cluster tools for running Dask on Databricks☆13Updated 8 months ago
- Prefect integrations for working with Docker☆43Updated 9 months ago
- Identifiers and Standard Format Parsing for Polars Dataframe☆14Updated this week
- Arrow, pydantic style☆84Updated 2 years ago
- A hatch plugin to help build Jupyter packages☆42Updated 8 months ago
- Kedro Plugin to support running pipelines on Kubernetes using Airflow.☆28Updated last year
- Tools for making Prefect work better for typical data science workflows☆19Updated 2 years ago
- Sentiment and language detection for text analytics.☆16Updated 7 months ago
- Reproducible Jupyter notebooks, powered by uv.☆185Updated this week
- Jupyter Cell / Line Magics for DuckDB☆45Updated last week
- Distributed Task Queue based Dask☆37Updated last year
- Automatically upgrade your Polars code to use the latest syntax available☆62Updated 8 months ago
- A place to provide Coiled feedback☆17Updated 7 months ago
- A collection of self-contained fsspec-based filesystems☆15Updated last week
- RFC document, tooling and other content related to the dataframe API standard☆105Updated 10 months ago
- general functions for your data .pipe()-lines.☆16Updated last year
- Polars plugin offering eXtra stuff for DateTimes☆197Updated 2 months ago