Alternatives and similar repositories for bert-onnx-rs-server

Users that are interested in bert-onnx-rs-server are comparing it to the libraries listed below

• haixuanTao / onnxruntime-rs
  Rust wrapper for Microsoft's ONNX Runtime with CUDA support (version 1.7)
  ☆23Updated 3 years ago
• haixuanTao / bert-onnx-rs-pipeline
  This demo showcase the use of onnxruntime-rs with a GPU on CUDA 11 to run Bert in a data pipeline with Rust.
  ☆16Updated 3 years ago
• epwalsh / rust-dl-webserver
  🦀 Example of serving deep learning models in Rust with batched prediction
  ☆34Updated 2 years ago
• hora-search / horapy
  🐍 Python bidding for the Hora Approximate Nearest Neighbor Search Algorithm library
  ☆72Updated 3 years ago
• bminixhofer / tractjs
  Run ONNX and TensorFlow inference in the browser.
  ☆75Updated 2 years ago
• tensordot / syntaxdot
  Neural syntax annotator, supporting sequence labeling, lemmatization, and dependency parsing.
  ☆78Updated last year
• oxidized-transformers / oxidized-transformers
  Modular Rust transformer/LLM library using Candle
  ☆36Updated last year
• messense / crfsuite-rs
  Rust binding to crfsuite
  ☆25Updated 3 years ago
• rth / vtext
  Simple NLP in Rust with Python bindings
  ☆152Updated 2 years ago
• serega / gaoya
  Locality Sensitive Hashing
  ☆72Updated 2 years ago
• cpcdoy / rust-sbert
  Rust port of sentence-transformers (https://github.com/UKPLab/sentence-transformers)
  ☆119Updated 10 months ago
• octoml / triton-client-rs
  A client library in Rust for Nvidia Triton.
  ☆30Updated 2 years ago
• jafioti / dataflow
  Dataflow is a data processing library, primarily for machine learning.
  ☆24Updated 2 years ago
• kykosic / actix-pytorch-example
  An example of using Torch rust bindings to serve trained machine learning models via Actix Web
  ☆16Updated 3 years ago
• nbigaouette / onnxruntime-rs
  Rust wrapper for Microsoft's ONNX Runtime (version 1.8)
  ☆305Updated last year
• FL33TW00D / steelix
  Your one stop CLI for ONNX model analysis.
  ☆47Updated 2 years ago
• guillaume-be / rust-tokenizers
  Rust-tokenizer offers high-performance tokenizers for modern language models, including WordPiece, Byte-Pair Encoding (BPE) and Unigram (…
  ☆323Updated last year
• Narsil / bloomserver
  ☆39Updated 2 years ago
• ritchie46 / lsh-rs
  Locality Sensitive Hashing in Rust with Python bindings
  ☆116Updated 2 years ago
• Systemcluster / kitoken
  Fast and versatile tokenizer for language models, compatible with SentencePiece, Tokenizers, Tiktoken and more. Supports BPE, Unigram and…
  ☆28Updated 4 months ago
• Narsil / bindgen_cuda
  ☆23Updated 3 months ago
• epwalsh / batched-fn
  🦀 Rust server plugin for deploying deep learning models with batched prediction
  ☆21Updated last year
• eugenehp / gpu-fft
  GPU based FFT written in Rust and CubeCL
  ☆23Updated last month
• npc-engine / edge-transformers
  Rust implementation of Huggingface transformers pipelines using onnxruntime backend with bindings to C# and C.
  ☆39Updated 2 years ago
• guillaume-be / SentencePiece-Rust-example
  Supporting example for "A Rust SentencePiece implementation"
  ☆19Updated 5 years ago
• gaxler / llama2.rs
  Inference Llama 2 in one file of pure Rust 🦀
  ☆234Updated last year
• pjankiewicz / visual-search
  ☆47Updated last year
• mokeyish / candle-ext
  An extension library to Candle that provides PyTorch functions not currently available in Candle
  ☆40Updated last year
• JulesBelveze / bert-squeeze
  🛠️ Tools for Transformers compression using PyTorch Lightning ⚡
  ☆84Updated 8 months ago
• gnp / minbpe-rs
  Port of Andrej Karpathy's minbpe to Rust
  ☆25Updated last year