pydiverse / pydiverse.pipedagLinks
A data pipeline orchestration library for rapid iterative development with automatic cache invalidation allowing users to focus writing their tasks in pandas, polars, sqlalchemy, ibis, and alike.
☆34Updated this week
Alternatives and similar repositories for pydiverse.pipedag
Users that are interested in pydiverse.pipedag are comparing it to the libraries listed below
Sorting:
- RFC document, tooling and other content related to the dataframe API standard☆107Updated last year
- IbisML is a library for building scalable ML pipelines using Ibis.☆120Updated 6 months ago
- Python bindings and arrow integration for the rust object_store crate.☆64Updated last year
- Sentiment and language detection for text analytics.☆17Updated last year
- ☆40Updated last month
- Coming soon☆62Updated 2 years ago
- A toolbox 🧰 for Jupyter notebooks 📙: testing, experiment tracking, debugging, profiling, and more!☆68Updated last year
- Automated, schema-based JSON unpacking to Polars objects☆13Updated 4 months ago
- Arrow, pydantic style☆85Updated 3 years ago
- Assessing whether data from database complies with reference information.☆44Updated this week
- Python package implementing ML feature engineering and pre-processing for polars or pandas dataframes.☆88Updated this week
- ☆89Updated last year
- A data modelling layer built on top of polars and pydantic☆197Updated 2 years ago
- Tools for making Prefect work better for typical data science workflows☆18Updated 3 years ago
- An Python object protocol for projects to interchange data frame-like data without forcing pandas.DataFrame as the intermediary☆15Updated 5 years ago
- Make Polars DataFrames Generic Types☆15Updated 9 months ago
- Dask integration for Snowflake☆30Updated 5 months ago
- Extremely lightweight compatibility layer between pandas and Polars☆41Updated last year
- Lightweight DataFrame validation decorators for Pandas, Polars, Modin, and PyArrow. No custom types required.☆53Updated this week
- Turn SciKitLearn pipelines into SQL☆109Updated 2 weeks ago
- Capture all information throughout your model's development in a reproducible way and tie results directly to the model code!☆139Updated last week
- A repository of runnable examples using ibis☆46Updated last year
- Polars extension for fzf-style fuzzy matching☆34Updated last year
- Automatically upgrade your Polars code to use the latest syntax available☆65Updated last year
- Polars plugin for stable hashing functionality☆84Updated 3 weeks ago
- The DBT of ML, as Aligned describes data dependencies in ML systems, and reduce technical data debt☆60Updated 3 weeks ago
- Distributed persistent Task Queue running on Dask☆38Updated 2 years ago
- Provide fine-grained push access to GitHub from a JupyterHub☆29Updated 3 weeks ago
- Linear regression in SQL using dbt☆75Updated last month
- asyncio bridge to the duckdb library☆47Updated 2 years ago