haixuanTao / bert-onnx-rs-serverLinks
A Demo server serving Bert through ONNX with GPU written in Rust with <3
β40Updated 3 years ago
Alternatives and similar repositories for bert-onnx-rs-server
Users that are interested in bert-onnx-rs-server are comparing it to the libraries listed below
Sorting:
- Rust wrapper for Microsoft's ONNX Runtime with CUDA support (version 1.7)β23Updated 2 years ago
- π¦ Example of serving deep learning models in Rust with batched predictionβ34Updated 2 years ago
- This demo showcase the use of onnxruntime-rs with a GPU on CUDA 11 to run Bert in a data pipeline with Rust.β16Updated 3 years ago
- Run ONNX and TensorFlow inference in the browser.β75Updated 2 years ago
- Neural syntax annotator, supporting sequence labeling, lemmatization, and dependency parsing.β77Updated last year
- Modular Rust transformer/LLM library using Candleβ35Updated last year
- Highly specialized crate to parse and use `google/sentencepiece` 's precompiled_charsmap in `tokenizers`β18Updated 3 years ago
- Rust binding to crfsuiteβ25Updated 3 years ago
- π Python bidding for the Hora Approximate Nearest Neighbor Search Algorithm libraryβ72Updated 3 years ago
- Supporting example for "A Rust SentencePiece implementation"β18Updated 4 years ago
- Simple NLP in Rust with Python bindingsβ150Updated last year
- Your one stop CLI for ONNX model analysis.β47Updated 2 years ago
- Dataflow is a data processing library, primarily for machine learning.β21Updated last year
- Rust binding for the sentencepiece libraryβ22Updated last month
- π¦ A Rust implementation of a RoBERTa classification model for the SNLI datasetβ13Updated 3 years ago
- β23Updated last month
- fastText Rust bindingβ60Updated last year
- β39Updated 2 years ago
- Succeeded by SyntaxDot: https://github.com/tensordot/syntaxdotβ25Updated 4 years ago
- Rust bindings for CTranslate2β14Updated last year
- Further developed as SyntaxDot: https://github.com/tensordot/syntaxdotβ13Updated 4 years ago
- Rust port of sentence-transformers (https://github.com/UKPLab/sentence-transformers)β114Updated 8 months ago
- GPU based FFT written in Rust and CubeCLβ22Updated 2 months ago
- A collection of optimisers for use with candleβ36Updated 2 weeks ago
- Locality Sensitive Hashingβ71Updated last year
- Succeeded by syntaxdot-transformers: https://github.com/tensordot/syntaxdot/tree/main/syntaxdot-transformersβ19Updated 4 years ago
- A client library in Rust for Nvidia Triton.β30Updated last year
- Rust implementation of Huggingface transformers pipelines using onnxruntime backend with bindings to C# and C.β39Updated 2 years ago
- An extension library to Candle that provides PyTorch functions not currently available in Candleβ39Updated last year
- Fast and versatile tokenizer for language models, compatible with SentencePiece, Tokenizers, Tiktoken and more. Supports BPE, Unigram andβ¦β24Updated 2 months ago