Alternatives and similar repositories for LLM-Inference-API-in-Rust

Users that are interested in LLM-Inference-API-in-Rust are comparing it to the libraries listed below

• KevKibe / memvectordb
  ⚡️Lightning fast in-memory VectorDB written in rust🦀
  ☆22Updated 4 months ago
• spyglass-search / memex
  Super-simple, fully Rust powered "memory" (doc store + semantic search) for LLM projects, semantic search, etc.
  ☆62Updated last year
• ShelbyJenkins / candle_embed
  A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face
  ☆37Updated last year
• minskylab / auto-rust
  auto-rust is an experimental project that automatically generate Rust code with LLM (Large Language Models) during compilation, utilizing…
  ☆40Updated 8 months ago
• TexasFortress-AI / rs_filesystem
  MCP Filesystem tools written in Rust
  ☆20Updated 3 months ago
• Noveum / ai-gateway
  Built for demanding AI workflows, this gateway offers low-latency, provider-agnostic access, ensuring your AI applications run smoothly a…
  ☆70Updated last month
• JackMatthewRimmer / rust-rag-toolchain
  Library for doing RAG
  ☆74Updated 2 months ago
• kevin-rs / autogpt
  🦀 A Pure Rust Framework For Building AGI (WIP).
  ☆92Updated last week
• geminik23 / ai-agents
  a Rust library designed for building and managing generative AI agents, leveraging the capabilities of large language models (LLMs)
  ☆20Updated 2 months ago
• rupeshs / shortgpt
  Ask shortgpt for instant and concise answers
  ☆13Updated 2 years ago
• stippi / code-assistant
  An LLM-powered, autonomous coding assistant. Also offers an MCP mode.
  ☆80Updated this week
• Intellicode / writer
  🤖📝 A markdown editor powered by AI (Ollama)
  ☆62Updated 9 months ago
• linux-china / mcp-rs-template
  Model Context Protocol (MCP) CLI server template for Rust
  ☆78Updated 3 months ago
• samuel-vitorino / lm.rs-webui
  Light WebUI for lm.rs
  ☆24Updated 9 months ago
• pixelspark / poly
  A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust
  ☆80Updated last year
• IncredibleDevHQ / agent-panel
  AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.
  ☆63Updated last year
• mcp-ectors / mcp-ectors
  The MCP enterprise actors-based server or mcp-ectors for short
  ☆30Updated last month
• AntigmaLabs / mcp-sdk
  Minimalistic Rust Implementation Of Model Context Protocol from Anthropic
  ☆56Updated 4 months ago
• danielclough / fireside-chat
  An LLM interface (chat bot) implemented in pure Rust using HuggingFace/Candle over Axum Websockets, an SQLite Database, and a Leptos (Was…
  ☆134Updated 9 months ago
• sudoish / openai_cli
  An openAI CLI built in rust
  ☆10Updated 2 years ago
• graniet / kheish
  Kheish: A multi-role LLM agent for tasks like code auditing, file searching, and more seamlessly leveraging RAG and extensible modules.
  ☆141Updated 6 months ago
• jimexist / surya-rs
  Rust implementation of Surya
  ☆58Updated 4 months ago
• AIAnytime / Document-Buddy-App
  Built using Open Source Stack (Llama 3.2 Model, BGE Embeddings, and Qdrant running locally within a Docker Container)
  ☆145Updated 2 weeks ago
• blankenshipz / clerk
  LLM based file organizer
  ☆26Updated 2 years ago
• richardanaya / epistemology
  A simple and clear way of hosting llama.cpp as a private HTTP API using Rust
  ☆27Updated last year
• PlugOvr-ai / PlugOvr
  AI Assistant
  ☆20Updated 3 months ago
• startino / aitino
  Aitino is a platform that allows for the creation of crews of AI Agents to help you automate tasks and solve complex problems.
  ☆87Updated 4 months ago
• jkawamoto / ctranslate2-rs
  Rust bindings for OpenNMT/CTranslate2
  ☆33Updated 2 months ago
• Mustafa-Shoukat1 / Autonomous-HybridRAG-AI-Agent
  ☆11Updated 8 months ago
• sudarshan-koirala / rag-chat-with-pdf
  Simple Chainlit UI for running llms locally using Ollama and LangChain
  ☆119Updated 11 months ago