pydiverse / pydiverse.pipedagLinks
A data pipeline orchestration library for rapid iterative development with automatic cache invalidation allowing users to focus writing their tasks in pandas, polars, sqlalchemy, ibis, and alike.
☆34Updated this week
Alternatives and similar repositories for pydiverse.pipedag
Users that are interested in pydiverse.pipedag are comparing it to the libraries listed below
Sorting:
- RFC document, tooling and other content related to the dataframe API standard☆108Updated last year
- IbisML is a library for building scalable ML pipelines using Ibis.☆115Updated last month
- Coming soon☆62Updated last year
- A data modelling layer built on top of polars and pydantic☆198Updated 2 years ago
- A repository of runnable examples using ibis☆45Updated last year
- Arrow, pydantic style☆84Updated 2 years ago
- Extremely lightweight compatibility layer between pandas and Polars☆41Updated last year
- Dask integration for Snowflake☆30Updated last month
- Polars plugin for stable hashing functionality☆81Updated last week
- Python bindings and arrow integration for the rust object_store crate.☆63Updated last year
- Assessing whether data from database complies with reference information.☆43Updated last week
- Automated, schema-based JSON unpacking to Polars objects☆13Updated last year
- Easy and flexible data contracts☆157Updated last week
- ☆89Updated 7 months ago
- Python package implementing transformers for pre processing steps for machine learning.☆65Updated last week
- Capture all information throughout your model's development in a reproducible way and tie results directly to the model code!☆137Updated last week
- Project template for Polars Plugins☆78Updated last month
- Polars plugin offering eXtra stuff for DateTimes☆220Updated last month
- Automatically upgrade your Polars code to use the latest syntax available☆65Updated last year
- A place to provide Coiled feedback☆19Updated 6 months ago
- Cluster tools for running Dask on Databricks☆14Updated last year
- Make Polars DataFrames Generic Types☆15Updated 4 months ago
- A toolbox 🧰 for Jupyter notebooks 📙: testing, experiment tracking, debugging, profiling, and more!☆67Updated last year
- ☆38Updated this week
- DSL for HTML that targets marimo and more!☆52Updated 2 months ago
- Polars plugin for pairwise distance functions☆78Updated 4 months ago
- Typed wrappers over pandas DataFrames with schema validation☆102Updated last year
- A curated list of polars projects and resources.☆39Updated 6 months ago
- An Python object protocol for projects to interchange data frame-like data without forcing pandas.DataFrame as the intermediary☆15Updated 5 years ago
- Sentiment and language detection for text analytics.☆17Updated last year