epwalsh / batched-fn
π¦ Rust server plugin for deploying deep learning models with batched prediction
β21Updated 11 months ago
Alternatives and similar repositories for batched-fn:
Users that are interested in batched-fn are comparing it to the libraries listed below
- π¦ Example of serving deep learning models in Rust with batched predictionβ34Updated last year
- Modular Rust transformer/LLM library using Candleβ36Updated 9 months ago
- An extension library to Candle that provides PyTorch functions not currently available in Candleβ38Updated 11 months ago
- Rust wrappers for NGT approximate nearest neighbor searchβ37Updated 9 months ago
- Simplistic API for deep learning tensor operationsβ28Updated 2 weeks ago
- Neural syntax annotator, supporting sequence labeling, lemmatization, and dependency parsing.β73Updated last year
- Texting Robots: A Rust native `robots.txt` parser with thorough unit testingβ27Updated last year
- Rust wrapper for Microsoft's ONNX Runtime with CUDA support (version 1.7)β24Updated 2 years ago
- Dataflow is a data processing library, primarily for machine learning.β20Updated last year
- A Rust crate that reads and writes tfrecord filesβ24Updated 10 months ago
- fastText Rust bindingβ58Updated last year
- β57Updated last year
- β133Updated 7 months ago
- Rust binding to crfsuiteβ25Updated 2 years ago
- A simple in-memory search for collections and key-value stores.β69Updated last week
- A flat container abstraction for Rustβ14Updated 3 months ago
- 8-bit floating point types for Rustβ44Updated 3 weeks ago
- β21Updated 7 months ago
- A replacement of the #[test] attribute that initializes logging and/or tracing infrastructure before running tests.β130Updated 3 weeks ago
- Extended utilities for working with files and filesystems in Rust. This is a fork of the fs2-rs crate, the aim for this fork is to supporβ¦β71Updated last month
- Rust wrapper for the BlingFire tokenization libraryβ15Updated 4 years ago
- Tensor library for machine learningβ24Updated this week
- A high-performance constrained decoding engine based on context free grammar in Rustβ46Updated last month
- finalfusion embeddings in Rustβ95Updated last year
- Experimental compiler for deep learning modelsβ26Updated this week
- Further developed as SyntaxDot: https://github.com/tensordot/syntaxdotβ13Updated 4 years ago
- .npy and .npz file format support for ndarrayβ59Updated 5 months ago
- Small and fast library for k-means clustering.β44Updated 3 months ago
- Logging bridge from pyo3 native extension to pythonβ63Updated 2 months ago
- Rust bindings for the spaCy library.β21Updated 2 years ago