Alternatives and similar repositories for edge-transformers:

Users that are interested in edge-transformers are comparing it to the libraries listed below

• Narsil / smelte-rs
  ☆57Updated last year
• EricLBuehler / candle-lora
  Low rank adaptation (LoRA) for Candle.
  ☆142Updated 6 months ago
• KGrewal1 / candle-optimisers
  A collection of optimisers for use with candle
  ☆34Updated 3 months ago
• pixelspark / poly
  A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust
  ☆79Updated last year
• coreylowman / llama-dfdx
  LLaMa 7b with CUDA acceleration implemented in rust. Minimal GPU memory needed!
  ☆102Updated last year
• wavey-ai / mel-spec
  Rust library for whisper.cpp compatible Mel spectrograms
  ☆63Updated 5 months ago
• leo-du / llama2.rs
  Inference Llama 2 in one file of zero-dependency, zero-unsafe Rust
  ☆37Updated last year
• oxideai / diffusers-burn
  A diffusers API in Burn (Rust)
  ☆19Updated 7 months ago
• tomsanbear / candle-einops
  ☆28Updated 3 months ago
• Narsil / ggblas
  ☆25Updated last year
• LaurentMazare / ug
  Experimental compiler for deep learning models
  ☆26Updated this week
• ShelbyJenkins / candle_embed
  A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face
  ☆32Updated 9 months ago
• mokeyish / candle-ext
  An extension library to Candle that provides PyTorch functions not currently available in Candle
  ☆38Updated 11 months ago
• EricLBuehler / float8
  8-bit floating point types for Rust
  ☆44Updated 3 weeks ago
• mrsteyk / rwkvk-rs
  ☆32Updated last year
• mladvladimir / rust-sentence-transformers
  Rust port of https://github.com/UKPLab/sentence-transformers
  ☆28Updated 4 years ago
• cpcdoy / rust-sbert
  Rust port of sentence-transformers (https://github.com/UKPLab/sentence-transformers)
  ☆113Updated 5 months ago
• FL33TW00D / steelix
  Your one stop CLI for ONNX model analysis.
  ☆47Updated 2 years ago
• LaurentMazare / glim
  ☆19Updated 4 months ago
• KerfuffleV2 / smolrsrwkv
  A relatively basic implementation of RWKV in Rust written by someone with very little math and ML knowledge. Supports 32, 8 and 4 bit eva…
  ☆93Updated last year
• oxidized-transformers / oxidized-transformers
  Modular Rust transformer/LLM library using Candle
  ☆36Updated 9 months ago
• LaurentMazare / mamba.rs
  ☆125Updated 9 months ago
• hanabi1224 / RuAnnoy
  Rust port of annoy (https://github.com/spotify/annoy)
  ☆42Updated 5 months ago
• tomsanbear / bitnet-rs
  Implementing the BitNet model in Rust
  ☆30Updated 10 months ago
• vv9k / AIrtifex
  Generative AI web UI and server
  ☆21Updated last year
• Narsil / bindgen_cuda
  ☆21Updated 7 months ago
• EndlessReform / fish-speech.rs
  A Fish Speech implementation in Rust, with Candle.rs
  ☆70Updated this week
• haixuanTao / onnxruntime-rs
  Rust wrapper for Microsoft's ONNX Runtime with CUDA support (version 1.7)
  ☆24Updated 2 years ago
• qdrant / page-search
  Neural search for web-sites, docs, articles - online!
  ☆131Updated 3 months ago
• guidance-ai / llgtrt
  TensorRT-LLM server with Structured Outputs (JSON) built with Rust
  ☆35Updated this week