Alternatives and similar repositories for sentencepiece:

Users that are interested in sentencepiece are comparing it to the libraries listed below

• tensordot / syntaxdot
  Neural syntax annotator, supporting sequence labeling, lemmatization, and dependency parsing.
  ☆75Updated last year
• messense / crfsuite-rs
  Rust binding to crfsuite
  ☆25Updated 3 years ago
• finalfusion / finalfusion-rust
  finalfusion embeddings in Rust
  ☆99Updated last year
• messense / crfs-rs
  Pure Rust port of CRFsuite: a fast implementation of Conditional Random Fields (CRFs)
  ☆29Updated last month
• cpcdoy / rust-sbert
  Rust port of sentence-transformers (https://github.com/UKPLab/sentence-transformers)
  ☆113Updated 7 months ago
• finalfusion / finalfrontier
  Context-sensitive word embeddings with subwords. In Rust.
  ☆87Updated last year
• stickeritis / sticker
  Succeeded by SyntaxDot: https://github.com/tensordot/syntaxdot
  ☆25Updated 4 years ago
• haixuanTao / bert-onnx-rs-server
  A Demo server serving Bert through ONNX with GPU written in Rust with <3
  ☆40Updated 3 years ago
• stickeritis / sticker-transformers
  Succeeded by syntaxdot-transformers: https://github.com/tensordot/syntaxdot/tree/main/syntaxdot-transformers
  ☆19Updated 4 years ago
• reneklacan / symspell
  Spelling correction & Fuzzy search based on Symmetric Delete spelling correction algorithm.
  ☆134Updated 2 months ago
• messense / fasttext-rs
  fastText Rust binding
  ☆59Updated last year
• haixuanTao / onnxruntime-rs
  Rust wrapper for Microsoft's ONNX Runtime with CUDA support (version 1.7)
  ☆24Updated 2 years ago
• epwalsh / rust-dl-webserver
  🦀 Example of serving deep learning models in Rust with batched prediction
  ☆34Updated 2 years ago
• oxidized-transformers / oxidized-transformers
  Modular Rust transformer/LLM library using Candle
  ☆36Updated 11 months ago
• mladvladimir / rust-sentence-transformers
  Rust port of https://github.com/UKPLab/sentence-transformers
  ☆28Updated 5 years ago
• mklf / word2vec-rs
  pure rust implemention of word2vec
  ☆83Updated last year
• allenai / rustberta-snli
  🦀 A Rust implementation of a RoBERTa classification model for the SNLI dataset
  ☆13Updated 3 years ago
• sonos / rustling
  Rust implementation of Duckling
  ☆78Updated 3 years ago
• Enet4 / faiss-rs
  Rust language bindings for Faiss
  ☆214Updated last month
• guillaume-be / rust-tokenizers
  Rust-tokenizer offers high-performance tokenizers for modern language models, including WordPiece, Byte-Pair Encoding (BPE) and Unigram (…
  ☆309Updated last year
• stickeritis / sticker2
  Further developed as SyntaxDot: https://github.com/tensordot/syntaxdot
  ☆13Updated 4 years ago
• neuml / txtai.rs
  Rust client for txtai
  ☆111Updated last week
• epwalsh / batched-fn
  🦀 Rust server plugin for deploying deep learning models with batched prediction
  ☆21Updated last year
• djc / instant-segment
  Fast English word segmentation in Rust
  ☆98Updated last month
• rth / vtext
  Simple NLP in Rust with Python bindings
  ☆150Updated last year
• quickwit-oss / levenshtein-automata
  ☆65Updated 2 years ago
• ssoudan / tch-m1
  Example of tch-rs on M1
  ☆53Updated last year
• sonos / rustling-ontology
  Ontology for rustling
  ☆128Updated 3 years ago
• guillaume-be / SentencePiece-Rust-example
  Supporting example for "A Rust SentencePiece implementation"
  ☆18Updated 4 years ago
• ybyygu / rust-lbfgs
  LBFGS optimization algorithm ported from liblbfgs
  ☆12Updated 2 years ago