Alternatives and similar repositories for llm_utils

Users that are interested in llm_utils are comparing it to the libraries listed below

• EricLBuehler / float8
  8-bit floating point types for Rust
  ☆47Updated 3 months ago
• ShelbyJenkins / candle_embed
  A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face
  ☆37Updated last year
• IncredibleDevHQ / agent-panel
  AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.
  ☆63Updated last year
• rmitsuboshi / miniboosts
  A collection of boosting algorithms written in Rust 🦀
  ☆57Updated last month
• julianbuettner / swapvec
  A Rust Vector which swaps to disk based on given parameters
  ☆44Updated last year
• pixelspark / poly
  A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust
  ☆80Updated last year
• JackMatthewRimmer / rust-rag-toolchain
  Library for doing RAG
  ☆74Updated last month
• viniciusf-dev / nebulla
  A lightweight, high-performance text embedding model implemented in Rust.
  ☆66Updated 2 months ago
• neferdata / allms
  allms: One Rust Library to rule them aLLMs
  ☆88Updated last week
• evgenyigumnov / candle-simplified-example
  A simplified example in Rust of training a neural network and then using it based on the Candle Framework by Hugging Face.
  ☆38Updated last year
• jeroenvlek / gpt-from-scratch-rs
  Andrej Karpathy's Let's build GPT: from scratch video & notebook implemented in Rust + candle
  ☆71Updated last year
• cptrodgers / aj
  Rust - background jobs.
  ☆47Updated 5 months ago
• ShelbyJenkins / llm_client
  The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes
  ☆205Updated 4 months ago
• Maruti-io / cephalon-rs
  ☆34Updated last year
• avahowell / offeryn
  Build tools for LLMs in Rust using Model Context Protocol
  ☆38Updated 4 months ago
• a-agmon / doc-embedder
  A high-performance RAG indexing pipeline implemented in Rust using LanceDB and Candle
  ☆18Updated 11 months ago
• TuckerBMorgan / poro
  Toy NN LIB
  ☆22Updated 4 months ago
• KarelPeeters / Kyanite
  A neural network inference library, written in Rust.
  ☆63Updated last year
• neuml / txtai.rs
  Rust client for txtai
  ☆111Updated last month
• chenhunghan / oxpilot
  Your AI Copilot in Rust
  ☆48Updated last year
• feldera / techdemo-spreadsheet
  A Spreadsheet with the Feldera Engine
  ☆29Updated 3 weeks ago
• workflow-rs / workflow-rs
  Rust application development framework for native and web applications
  ☆65Updated 3 weeks ago
• atoma-network / atoma-infer
  Fast serverless LLM inference, in Rust.
  ☆88Updated 4 months ago
• cmccomb / rust-stop-words
  Common stop words in a variety of languages
  ☆21Updated 4 months ago
• DioxusLabs / dioxus-ai
  ☆37Updated 7 months ago
• kaegi / webrtc-vad
  Rust interface for the WebRTC Voice-Activity-Module
  ☆30Updated 4 years ago
• plabayo / venndb
  in memory Rust database to query your data like a Venn diagram
  ☆110Updated 7 months ago
• danielclough / fireside-chat
  An LLM interface (chat bot) implemented in pure Rust using HuggingFace/Candle over Axum Websockets, an SQLite Database, and a Leptos (Was…
  ☆134Updated 9 months ago
• fjall-rs / value-log
  Value log implementation for key-value separated storage in safe Rust
  ☆41Updated last month
• al8n / serf
  A highly customable, adaptable, runtime agnostic and WASM/WASI friendly decentralized solution for service discovery and orchestration th…
  ☆52Updated last week