pydiverse / pydiverse.pipedagLinks
A data pipeline orchestration library for rapid iterative development with automatic cache invalidation allowing users to focus writing their tasks in pandas, polars, sqlalchemy, ibis, and alike.
☆34Updated 3 weeks ago
Alternatives and similar repositories for pydiverse.pipedag
Users that are interested in pydiverse.pipedag are comparing it to the libraries listed below
Sorting:
- IbisML is a library for building scalable ML pipelines using Ibis.☆117Updated 3 months ago
- RFC document, tooling and other content related to the dataframe API standard☆108Updated last year
- Coming soon☆62Updated last year
- Dask integration for Snowflake☆30Updated 2 months ago
- ☆38Updated this week
- A data modelling layer built on top of polars and pydantic☆198Updated 2 years ago
- Typed wrappers over pandas DataFrames with schema validation☆102Updated last year
- Extremely lightweight compatibility layer between pandas and Polars☆41Updated last year
- A repository of runnable examples using ibis☆46Updated last year
- A place to provide Coiled feedback☆23Updated 7 months ago
- A software engineering framework to jump start your machine learning projects☆37Updated last year
- A toolbox 🧰 for Jupyter notebooks 📙: testing, experiment tracking, debugging, profiling, and more!☆67Updated last year
- Moneyflow: Personal Finance Data Interface for Power Users (supporting backends like Monarch Money, YNAB)☆87Updated this week
- Turn SciKitLearn pipelines into SQL☆103Updated 2 weeks ago
- Arrow, pydantic style☆85Updated 2 years ago
- Cluster tools for running Dask on Databricks☆15Updated last year
- ☆88Updated 9 months ago
- Assessing whether data from database complies with reference information.☆43Updated last week
- Polars plugin for stable hashing functionality☆83Updated last month
- Python package implementing transformers for pre processing steps for machine learning.☆66Updated this week
- Ibis tutorial repository☆34Updated last year
- Cloud provider cluster managers for Dask. Supports AWS, Google Cloud Azure and more...☆145Updated 2 weeks ago
- Rethinking machine learning pipelines☆33Updated last month
- Automatically upgrade your Polars code to use the latest syntax available☆65Updated last year
- Prefect integrations for working with Docker☆42Updated last year
- Sentiment and language detection for text analytics.☆17Updated last year
- Time based splits for cross validation☆39Updated last month
- Provide fine-grained push access to GitHub from a JupyterHub☆28Updated last week
- Run pytest against markdown files/docstrings.☆131Updated 3 months ago
- Automated, schema-based JSON unpacking to Polars objects☆13Updated last month