Alternatives and similar repositories for llama-rs:

Users that are interested in llama-rs are comparing it to the libraries listed below

• EricLBuehler / float8
  8-bit floating point types for Rust
  ☆44Updated 3 weeks ago
• oxideai / diffusers-burn
  A diffusers API in Burn (Rust)
  ☆19Updated 7 months ago
• mokeyish / candle-ext
  An extension library to Candle that provides PyTorch functions not currently available in Candle
  ☆38Updated 11 months ago
• thewh1teagle / piper-rs
  Use piper TTS models in Rust
  ☆16Updated 2 months ago
• wonkodv / large-vector
  Rust Vector for large amounts of data, that does not copy when growing, by using full `mmap`'d pages.
  ☆22Updated 11 months ago
• EndlessReform / fish-speech.rs
  A Fish Speech implementation in Rust, with Candle.rs
  ☆70Updated this week
• tomsanbear / bitnet-rs
  Implementing the BitNet model in Rust
  ☆30Updated 10 months ago
• Brogolem35 / markov_str
  Fast and efficient Markov Chain implementation, optimized for text generation.
  ☆27Updated last month
• alphastrata / nvtop-rust
  An NVIDIA SMI'esk GPU Monitoring tool for your terminal.
  ☆34Updated 6 months ago
• ShelbyJenkins / candle_embed
  A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face
  ☆32Updated 9 months ago
• subbu963 / bott
  bott: Your Terminal Copilot
  ☆86Updated last year
• EricLBuehler / zig_ml
  Tensor library for Zig
  ☆11Updated 3 months ago
• SamKG / iree-rs
  Rustic bindings for IREE
  ☆18Updated 2 years ago
• JackMatthewRimmer / rust-rag-toolchain
  Library for doing RAG
  ☆68Updated 2 months ago
• julianbuettner / swapvec
  A Rust Vector which swaps to disk based on given parameters
  ☆44Updated last year
• frankfralick / openai-func-enums
  A set of Rust macros for working with OpenAI function/tool calls.
  ☆45Updated 10 months ago
• KerfuffleV2 / ggml-sys-bleedingedge
  Bleeding edge low level Rust binding for GGML
  ☆16Updated 7 months ago
• xd009642 / xd-tts
  Almost-Pure Rust TTS Engine for my Rustnation talk
  ☆36Updated last month
• inventhq / failsafe-rs
  Failsafe is a lightweight rust library for handling failures
  ☆16Updated 2 years ago
• KerfuffleV2 / rusty-ggml
  GGML bindings that aim to be idiomatic Rust rather than directly corresponding to the C/C++ interface
  ☆19Updated last year
• EricLBuehler / candle_graphs
  Graph model execution API for Candle
  ☆13Updated 2 months ago
• neferdata / allms
  allms: One Rust Library to rule them aLLMs
  ☆61Updated last week
• hytopiagg / cef-ui
  This repository contains a bridge between Rust and the Chromium Embedded Framework.
  ☆10Updated 4 months ago
• Narsil / bindgen_cuda
  ☆21Updated 7 months ago
• LaurentMazare / glim
  ☆19Updated 4 months ago
• BDUG / Lighter
  A Keras like abstraction layer on top of the Rust ML framework candle
  ☆23Updated 8 months ago
• LaurentMazare / ug
  Experimental compiler for deep learning models
  ☆26Updated last week
• JaLnYn / websocket-ide
  ☆57Updated 2 months ago
• omkar-mohanty / vortex
  A tool to extract images from pdf files
  ☆57Updated last year
• rhaiscript / rhai-sci
  Scientific computing for Rhai.
  ☆16Updated 3 weeks ago