epwalsh / rust-dl-webserver
🦀 Example of serving deep learning models in Rust with batched prediction
☆34Updated last year
Related projects ⓘ
Alternatives and complementary repositories for rust-dl-webserver
- Rust wrapper for Microsoft's ONNX Runtime with CUDA support (version 1.7)☆24Updated 2 years ago
- Rust client for txtai☆106Updated 3 weeks ago
- Neural syntax annotator, supporting sequence labeling, lemmatization, and dependency parsing.☆71Updated last year
- 🦀 Rust server plugin for deploying deep learning models with batched prediction☆19Updated 7 months ago
- Dataflow is a data processing library, primarily for machine learning.☆19Updated last year
- This demo showcase the use of onnxruntime-rs with a GPU on CUDA 11 to run Bert in a data pipeline with Rust.☆16Updated 2 years ago
- A Demo server serving Bert through ONNX with GPU written in Rust with <3☆39Updated 3 years ago
- fastText Rust binding☆57Updated 10 months ago
- Orkhon: ML Inference Framework and Server Runtime☆146Updated 3 years ago
- Simple neural network library for classification written in Rust.☆44Updated 2 years ago
- finalfusion embeddings in Rust☆92Updated last year
- Fast English word segmentation in Rust☆90Updated 3 weeks ago
- Simple NLP in Rust with Python bindings☆148Updated last year
- Rust library for Self Organising Maps (SOM).☆33Updated 2 years ago
- Rust implementation of Duckling☆77Updated 3 years ago
- Further developed as SyntaxDot: https://github.com/tensordot/syntaxdot☆13Updated 3 years ago
- Rust port of sentence-transformers (https://github.com/UKPLab/sentence-transformers)☆106Updated last month
- Succeeded by syntaxdot-transformers: https://github.com/tensordot/syntaxdot/tree/main/syntaxdot-transformers☆19Updated 4 years ago
- pure rust implementaion for deep learning library like keras☆59Updated 2 years ago
- Common stop words in a variety of languages☆19Updated last year
- A neural network, and tensor dynamic automatic differentiation implementation for Rust.☆23Updated 2 years ago
- Run ONNX and TensorFlow inference in the browser.☆75Updated last year
- A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust☆80Updated 9 months ago
- Machine learning library providing matrices, named tensors, linear algebra and autodiff aimed at being easy to use☆24Updated last week
- An extension library to Candle that provides PyTorch functions not currently available in Candle☆36Updated 7 months ago
- Deep recommender systems for Rust☆125Updated 5 years ago
- Fwumious Wabbit, fast on-line machine learning toolkit written in Rust☆134Updated 4 months ago
- Succeeded by SyntaxDot: https://github.com/tensordot/syntaxdot☆25Updated 3 years ago
- Static Linear Algebra System☆34Updated last year
- Modular Rust transformer/LLM library using Candle☆36Updated 6 months ago