Alternatives and similar repositories for sentencepiece

Users that are interested in sentencepiece are comparing it to the libraries listed below

• tensordot / syntaxdot
  Neural syntax annotator, supporting sequence labeling, lemmatization, and dependency parsing.
  ☆76Updated last year
• messense / crfsuite-rs
  Rust binding to crfsuite
  ☆25Updated 3 years ago
• mklf / word2vec-rs
  pure rust implemention of word2vec
  ☆83Updated 2 years ago
• finalfusion / finalfusion-rust
  finalfusion embeddings in Rust
  ☆100Updated last year
• stickeritis / sticker
  Succeeded by SyntaxDot: https://github.com/tensordot/syntaxdot
  ☆25Updated 4 years ago
• dluman / rusTy
  Rust bindings for the spaCy library.
  ☆22Updated 2 years ago
• mrsteyk / rwkvk-rs
  ☆32Updated 2 years ago
• messense / crfs-rs
  Pure Rust port of CRFsuite: a fast implementation of Conditional Random Fields (CRFs)
  ☆29Updated 2 weeks ago
• stickeritis / sticker-transformers
  Succeeded by syntaxdot-transformers: https://github.com/tensordot/syntaxdot/tree/main/syntaxdot-transformers
  ☆19Updated 4 years ago
• oxidized-transformers / oxidized-transformers
  Modular Rust transformer/LLM library using Candle
  ☆36Updated last year
• stickeritis / sticker2
  Further developed as SyntaxDot: https://github.com/tensordot/syntaxdot
  ☆13Updated 4 years ago
• reneklacan / symspell
  Spelling correction & Fuzzy search based on Symmetric Delete spelling correction algorithm.
  ☆136Updated 3 months ago
• messense / fasttext-rs
  fastText Rust binding
  ☆60Updated last year
• Smerity / texting_robots
  Texting Robots: A Rust native `robots.txt` parser with thorough unit testing
  ☆28Updated last year
• haixuanTao / onnxruntime-rs
  Rust wrapper for Microsoft's ONNX Runtime with CUDA support (version 1.7)
  ☆23Updated 2 years ago
• zk4x / zyx
  Tensor library for machine learning
  ☆28Updated this week
• allenai / rustberta-snli
  🦀 A Rust implementation of a RoBERTa classification model for the SNLI dataset
  ☆13Updated 3 years ago
• CurrySoftware / rust-stemmers
  A rust implementation of some popular snowball stemming algorithms
  ☆125Updated last year
• haixuanTao / bert-onnx-rs-server
  A Demo server serving Bert through ONNX with GPU written in Rust with <3
  ☆40Updated 3 years ago
• lerouxrgd / ngt-rs
  Rust wrappers for NGT approximate nearest neighbor search
  ☆38Updated last year
• finalfusion / finalfrontier
  Context-sensitive word embeddings with subwords. In Rust.
  ☆87Updated last year
• KerfuffleV2 / repugnant-pickle
  Low effort scraping Python's pickle format in Rust. It is to complete pickle parsing as BeautifulSoup was to complete HTML parsing.
  ☆25Updated 11 months ago
• tomsanbear / bitnet-rs
  Implementing the BitNet model in Rust
  ☆37Updated last year
• ssoudan / tch-m1
  Example of tch-rs on M1
  ☆53Updated last year
• ShelbyJenkins / candle_embed
  A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face
  ☆36Updated last year
• eugenehp / gpu-fft
  GPU based FFT written in Rust and CubeCL
  ☆22Updated 2 months ago
• Narsil / bindgen_cuda
  ☆23Updated last month
• vishpat / candle-coursera-ml
  Implementation of the Coursera ML course in Rust
  ☆38Updated 3 months ago
• EricLBuehler / candle-lora
  Low rank adaptation (LoRA) for Candle.
  ☆146Updated last month
• KGrewal1 / candle-optimisers
  A collection of optimisers for use with candle
  ☆35Updated last week