epwalsh / batched-fn
🦀 Rust server plugin for deploying deep learning models with batched prediction
☆21Updated last year
Alternatives and similar repositories for batched-fn:
Users that are interested in batched-fn are comparing it to the libraries listed below
- 🦀 Example of serving deep learning models in Rust with batched prediction☆34Updated 2 years ago
- Modular Rust transformer/LLM library using Candle☆36Updated 10 months ago
- Neural syntax annotator, supporting sequence labeling, lemmatization, and dependency parsing.☆73Updated last year
- An extension library to Candle that provides PyTorch functions not currently available in Candle☆38Updated 11 months ago
- Orkhon: ML Inference Framework and Server Runtime☆148Updated 4 years ago
- .npy and .npz file format support for ndarray☆59Updated 5 months ago
- Simplistic API for deep learning tensor operations☆28Updated last month
- Further developed as SyntaxDot: https://github.com/tensordot/syntaxdot☆13Updated 4 years ago
- finalfusion embeddings in Rust☆95Updated last year
- ☆15Updated 2 years ago
- Rust bindings for the spaCy library.☆21Updated 2 years ago
- Parallel Barnes-Hut t-SNE implementation written in Rust.☆77Updated 5 months ago
- An easy-to-use recorder and viewer for high-performance traces☆40Updated 3 months ago
- Rust wrappers for NGT approximate nearest neighbor search☆37Updated 9 months ago
- Texting Robots: A Rust native `robots.txt` parser with thorough unit testing☆27Updated last year
- `async_dag` is an async task scheduling utility.☆23Updated 2 years ago
- Succeeded by SyntaxDot: https://github.com/tensordot/syntaxdot☆25Updated 3 years ago
- Tensor library for machine learning☆25Updated 2 weeks ago
- Parallel iterator processing library for Rust☆102Updated last year
- fastText Rust binding☆59Updated last year
- A Rust Library for High-Performance Tensor Exchange with Python☆40Updated 3 months ago
- A simple in-memory search for collections and key-value stores.☆70Updated last month
- Provides an interface layer to convert between n-dimensional types in different Rust crates☆51Updated 6 months ago
- A flat container abstraction for Rust☆14Updated 3 months ago
- An automatic differentiation library for both forward and reverse auto-diff via code transformation written in Rust.☆16Updated 3 years ago
- Small and fast library for k-means clustering.☆44Updated 3 months ago
- A Rust Vector which swaps to disk based on given parameters☆44Updated last year
- Rust implementation of Python dependency parser for PEP 508☆23Updated 11 months ago
- Rustic bindings to the IREE Compiler/Runtime☆17Updated last month
- structured parallel execution for async Rust☆33Updated 6 months ago