epwalsh / batched-fnLinks
🦀 Rust server plugin for deploying deep learning models with batched prediction
☆21Updated last year
Alternatives and similar repositories for batched-fn
Users that are interested in batched-fn are comparing it to the libraries listed below
Sorting:
- 🦀 Example of serving deep learning models in Rust with batched prediction☆34Updated 2 years ago
- finalfusion embeddings in Rust☆103Updated 2 years ago
- Neural syntax annotator, supporting sequence labeling, lemmatization, and dependency parsing.☆78Updated last year
- Rust wrappers for NGT approximate nearest neighbor search☆39Updated last year
- Graph data structure library aspiring to be convenient, versatile, correct and performant.☆79Updated last month
- ☆93Updated 9 months ago
- A Rust Library for High-Performance Tensor Exchange with Python☆47Updated last month
- An extension library to Candle that provides PyTorch functions not currently available in Candle☆40Updated last year
- Orkhon: ML Inference Framework and Server Runtime☆151Updated 4 years ago
- Modular Rust transformer/LLM library using Candle☆36Updated last year
- Almost-Pure Rust TTS Engine for my Rustnation talk☆44Updated 9 months ago
- Locality Sensitive Hashing in Rust with Python bindings☆118Updated 2 years ago
- fastText Rust binding☆62Updated last year
- 8-bit floating point types for Rust☆59Updated 2 months ago
- Convert between nalgebra and numpy types.☆23Updated 2 years ago
- Rust port of sentence-transformers (https://github.com/UKPLab/sentence-transformers)☆121Updated last year
- Static Linear Algebra System☆36Updated 2 years ago
- Source of BLAS and LAPACK via OpenBLAS☆89Updated last month
- Context-sensitive word embeddings with subwords. In Rust.☆87Updated last year
- A Demo server serving Bert through ONNX with GPU written in Rust with <3☆41Updated 4 years ago
- Further developed as SyntaxDot: https://github.com/tensordot/syntaxdot☆13Updated 4 years ago
- Rust binding to crfsuite☆25Updated 3 years ago
- Dachshund is a graph mining library written in Rust. It provides high performance data structures for multiple kinds of graphs, from simp…☆91Updated last year
- Succeeded by SyntaxDot: https://github.com/tensordot/syntaxdot☆25Updated 4 years ago
- Parallel iterator processing library for Rust☆103Updated 2 years ago
- Small and fast library for k-means clustering.☆51Updated 3 months ago
- A simplified example in Rust of training a neural network and then using it based on the Candle Framework by Hugging Face.☆39Updated last year
- A flexible ULID or Snowflake-like ID generator for producing unique, monotonic, and lexicographically sortable IDs.☆23Updated 2 weeks ago
- Rust bindings for XGBoost.☆113Updated last year
- structured parallel execution for async Rust☆36Updated last year