Alternatives and similar repositories for edge-transformers:

Users that are interested in edge-transformers are comparing it to the libraries listed below

• wavey-ai / mel-spec
  Rust library for whisper.cpp compatible Mel spectrograms
  ☆65Updated last month
• mokeyish / candle-ext
  An extension library to Candle that provides PyTorch functions not currently available in Candle
  ☆38Updated last year
• oxidized-transformers / oxidized-transformers
  Modular Rust transformer/LLM library using Candle
  ☆36Updated 11 months ago
• ShelbyJenkins / candle_embed
  A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face
  ☆35Updated 11 months ago
• KGrewal1 / candle-optimisers
  A collection of optimisers for use with candle
  ☆34Updated 5 months ago
• Narsil / smelte-rs
  ☆59Updated 2 years ago
• leo-du / llama2.rs
  Inference Llama 2 in one file of zero-dependency, zero-unsafe Rust
  ☆38Updated last year
• pixelspark / poly
  A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust
  ☆79Updated last year
• EricLBuehler / candle-lora
  Low rank adaptation (LoRA) for Candle.
  ☆142Updated 7 months ago
• hanabi1224 / RuAnnoy
  Rust port of annoy (https://github.com/spotify/annoy)
  ☆42Updated 7 months ago
• coreylowman / llama-dfdx
  LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!
  ☆104Updated last year
• thewh1teagle / vad-rs
  Speech detection using silero vad in Rust
  ☆19Updated 4 months ago
• mrsteyk / rwkvk-rs
  ☆32Updated 2 years ago
• eugenehp / gpu-fft
  GPU based FFT written in Rust and CubeCL
  ☆21Updated last month
• vishpat / candle-coursera-ml
  Implementation of the Coursera ML course in Rust
  ☆37Updated 2 months ago
• oxideai / diffusers-burn
  A diffusers API in Burn (Rust)
  ☆19Updated 9 months ago
• tomsanbear / candle-einops
  ☆28Updated 5 months ago
• EricLBuehler / float8
  8-bit floating point types for Rust
  ☆46Updated last month
• cpcdoy / rust-sbert
  Rust port of sentence-transformers (https://github.com/UKPLab/sentence-transformers)
  ☆113Updated 7 months ago
• spyglass-search / memex
  Super-simple, fully Rust powered "memory" (doc store + semantic search) for LLM projects, semantic search, etc.
  ☆58Updated last year
• thewh1teagle / sherpa-rs
  Rust bindings to https://github.com/k2-fsa/sherpa-onnx
  ☆150Updated 3 weeks ago
• Narsil / ggblas
  ☆26Updated last year
• epwalsh / rust-dl-webserver
  🦀 Example of serving deep learning models in Rust with batched prediction
  ☆34Updated 2 years ago
• KerfuffleV2 / llm-samplers
  A collection of LLM token samplers in Rust
  ☆17Updated last year
• thewh1teagle / pyannote-rs
  pyannote audio diarization in rust
  ☆62Updated 4 months ago
• tensordot / syntaxdot
  Neural syntax annotator, supporting sequence labeling, lemmatization, and dependency parsing.
  ☆74Updated last year
• LaurentMazare / glim
  ☆19Updated 6 months ago
• tomsanbear / bitnet-rs
  Implementing the BitNet model in Rust
  ☆31Updated 11 months ago
• beowolx / rensa
  High-performance MinHash implementation in Rust with Python bindings for efficient similarity estimation and deduplication of large datas…
  ☆82Updated 2 weeks ago
• KerfuffleV2 / smolrsrwkv
  A relatively basic implementation of RWKV in Rust written by someone with very little math and ML knowledge. Supports 32, 8 and 4 bit eva…
  ☆93Updated last year