epwalsh / rust-dl-webserver
🦀 Example of serving deep learning models in Rust with batched prediction
☆34Updated 2 years ago
Alternatives and similar repositories for rust-dl-webserver:
Users that are interested in rust-dl-webserver are comparing it to the libraries listed below
- Rust wrapper for Microsoft's ONNX Runtime with CUDA support (version 1.7)☆24Updated 2 years ago
- Neural syntax annotator, supporting sequence labeling, lemmatization, and dependency parsing.☆76Updated last year
- 🦀 Rust server plugin for deploying deep learning models with batched prediction☆21Updated last year
- A Demo server serving Bert through ONNX with GPU written in Rust with <3☆40Updated 3 years ago
- Dataflow is a data processing library, primarily for machine learning.☆21Updated last year
- Rust client for txtai☆111Updated 2 weeks ago
- Fast English word segmentation in Rust☆98Updated last month
- Rust wrappers for NGT approximate nearest neighbor search☆38Updated 11 months ago
- This demo showcase the use of onnxruntime-rs with a GPU on CUDA 11 to run Bert in a data pipeline with Rust.☆16Updated 3 years ago
- Simple NLP in Rust with Python bindings☆150Updated last year
- fastText Rust binding☆59Updated last year
- Modular Rust transformer/LLM library using Candle☆36Updated last year
- Rust implementation of Duckling☆78Updated 3 years ago
- Further developed as SyntaxDot: https://github.com/tensordot/syntaxdot☆13Updated 4 years ago
- An extension library to Candle that provides PyTorch functions not currently available in Candle☆39Updated last year
- Orkhon: ML Inference Framework and Server Runtime☆149Updated 4 years ago
- Succeeded by syntaxdot-transformers: https://github.com/tensordot/syntaxdot/tree/main/syntaxdot-transformers☆19Updated 4 years ago
- Rust port of sentence-transformers (https://github.com/UKPLab/sentence-transformers)☆114Updated 7 months ago
- Bandit Algorithms in Rust☆34Updated 2 months ago
- A neural network, and tensor dynamic automatic differentiation implementation for Rust.☆23Updated 4 months ago
- Succeeded by SyntaxDot: https://github.com/tensordot/syntaxdot☆25Updated 4 years ago
- pure rust implemention of word2vec☆83Updated 2 years ago
- Rust library for running TensorRT accelerated deep learning models☆56Updated 3 years ago
- Simple neural network library for classification written in Rust.☆46Updated 2 years ago
- finalfusion embeddings in Rust☆100Updated last year
- GPU based FFT written in Rust and CubeCL☆22Updated last month
- Deep recommender systems for Rust☆128Updated 5 years ago
- Texting Robots: A Rust native `robots.txt` parser with thorough unit testing☆28Updated last year
- A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust☆79Updated last year
- Rust binding to crfsuite☆25Updated 3 years ago