Alternatives and similar repositories for llama-rs:

Users that are interested in llama-rs are comparing it to the libraries listed below

• EricLBuehler / float8
  8-bit floating point types for Rust
  ☆47Updated last month
• JackMatthewRimmer / rust-rag-toolchain
  Library for doing RAG
  ☆72Updated this week
• ShelbyJenkins / candle_embed
  A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face
  ☆36Updated last year
• mokeyish / candle-ext
  An extension library to Candle that provides PyTorch functions not currently available in Candle
  ☆39Updated last year
• tomsanbear / bitnet-rs
  Implementing the BitNet model in Rust
  ☆33Updated last year
• EricLBuehler / candle-lora
  Low rank adaptation (LoRA) for Candle.
  ☆145Updated 3 weeks ago
• oxideai / diffusers-burn
  A diffusers API in Burn (Rust)
  ☆19Updated 9 months ago
• jeroenvlek / gpt-from-scratch-rs
  Andrej Karpathy's Let's build GPT: from scratch video & notebook implemented in Rust + candle
  ☆72Updated last year
• EndlessReform / fish-speech.rs
  A Fish Speech implementation in Rust, with Candle.rs
  ☆80Updated 2 months ago
• PlugOvr-ai / PlugOvr
  AI Assistant
  ☆20Updated 3 weeks ago
• pixelspark / poly
  A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust
  ☆79Updated last year
• subbu963 / bott
  bott: Your Terminal Copilot
  ☆87Updated last year
• wonkodv / large-vector
  Rust Vector for large amounts of data, that does not copy when growing, by using full `mmap`'d pages.
  ☆22Updated last year
• evgenyigumnov / candle-simplified-example
  A simplified example in Rust of training a neural network and then using it based on the Candle Framework by Hugging Face.
  ☆38Updated last year
• minskylab / auto-rust
  auto-rust is an experimental project that automatically generate Rust code with LLM (Large Language Models) during compilation, utilizing…
  ☆40Updated 5 months ago
• KarelPeeters / Kyanite
  A neural network inference library, written in Rust.
  ☆61Updated 9 months ago
• BDUG / Lighter
  A Keras like abstraction layer on top of the Rust ML framework candle
  ☆23Updated 10 months ago
• danielclough / fireside-chat
  An LLM interface (chat bot) implemented in pure Rust using HuggingFace/Candle over Axum Websockets, an SQLite Database, and a Leptos (Was…
  ☆133Updated 6 months ago
• JtPerez-Acle / chrono-mind
  ChronoMind: Redefining Vector Intelligence Through Time.
  ☆68Updated last week
• rmitsuboshi / miniboosts
  A collection of boosting algorithms written in Rust 🦀
  ☆53Updated 3 months ago
• elftausend / custos
  A minimal OpenCL, CUDA, Vulkan and host CPU array manipulation engine / framework.
  ☆73Updated last month
• kevin-rs / autogpt
  🦀 A Pure Rust Framework For Building AGI (WIP).
  ☆72Updated 2 weeks ago
• avahowell / offeryn
  Build tools for LLMs in Rust using Model Context Protocol
  ☆38Updated 2 months ago
• TuckerBMorgan / poro
  Toy NN LIB
  ☆22Updated 2 months ago
• huggingface / hf-hub
  Rust client for the huggingface hub aiming for minimal subset of features over `huggingface-hub` python package
  ☆202Updated 2 months ago
• thewh1teagle / piper-rs
  Use piper TTS models in Rust
  ☆26Updated 4 months ago
• IncredibleDevHQ / agent-panel
  AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.
  ☆61Updated 10 months ago
• DioxusLabs / dioxus-ai
  ☆36Updated 5 months ago
• ssoudan / tch-m1
  Example of tch-rs on M1
  ☆53Updated last year
• xd009642 / xd-tts
  Almost-Pure Rust TTS Engine for my Rustnation talk
  ☆40Updated 4 months ago