pydiverse / pydiverse.pipedag
A data pipeline orchestration library for rapid iterative development with automatic cache invalidation allowing users to focus writing their tasks in pandas, polars, sqlalchemy, ibis, and alike.
☆30Updated 2 weeks ago
Alternatives and similar repositories for pydiverse.pipedag:
Users that are interested in pydiverse.pipedag are comparing it to the libraries listed below
- Extremely lightweight compatibility layer between pandas and Polars☆41Updated 11 months ago
- Sentiment and language detection for text analytics.☆17Updated 9 months ago
- Automated Jupyter notebook testing. 📙☆41Updated last year
- RFC document, tooling and other content related to the dataframe API standard☆108Updated last year
- Automated, schema-based JSON unpacking to Polars objects☆13Updated last year
- IbisML is a library for building scalable ML pipelines using Ibis.☆108Updated 4 months ago
- Python bindings and arrow integration for the rust object_store crate.☆64Updated 8 months ago
- Native polars deltalake reader☆9Updated 8 months ago
- A repository of runnable examples using ibis☆43Updated 9 months ago
- Cluster tools for running Dask on Databricks☆13Updated 10 months ago
- Fast approximate joins on string columns for polars dataframes.☆12Updated 6 months ago
- ☆38Updated this week
- ☆32Updated 11 months ago
- Minimal plugin loading package for polars with optional type stub generation☆16Updated 2 months ago
- Have UV deal with all your Jupyter deps.☆24Updated 7 months ago
- A curated list of polars projects and resources.☆37Updated last month
- A place to provide Coiled feedback☆18Updated last month
- Use pathlib syntax to easily work with Pandas series containing file paths.☆69Updated last year
- The DBT of ML, as Aligned describes data dependencies in ML systems, and reduce technical data debt☆58Updated last month
- Kedro plugin to support running pipelines on Dagster☆11Updated this week
- A toolbox 🧰 for Jupyter notebooks 📙: testing, experiment tracking, debugging, profiling, and more!☆68Updated 7 months ago
- Arrow, pydantic style☆82Updated 2 years ago
- A declarative, 🐻❄️-native data frame validation library.☆135Updated this week
- ☆14Updated 4 months ago
- ☆89Updated 3 months ago
- s3pathlib is the python package provides the Pythonic objective oriented programming (OOP) interface to manipulate AWS S3 object / direct…☆30Updated 2 years ago
- Assessing whether data from database complies with reference information.☆42Updated this week
- Copier template for Python projects managed by uv.☆87Updated 2 weeks ago
- A hatch plugin to help build Jupyter packages☆45Updated 10 months ago
- asyncio bridge to the duckdb library☆41Updated 2 years ago