Alternatives and similar repositories for LLM-Inference-API-in-Rust

Users that are interested in LLM-Inference-API-in-Rust are comparing it to the libraries listed below

• samuel-vitorino / lm.rs-webui
  Light WebUI for lm.rs
  ☆23Updated 8 months ago
• PlugOvr-ai / PlugOvr
  AI Assistant
  ☆20Updated 2 months ago
• ShelbyJenkins / candle_embed
  A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face
  ☆37Updated last year
• ayaansh-roy / voice_assistant_llm
  ☆66Updated last year
• smithakolan / AssemblyAI-Applications
  Here is a collection of cool applications that I've built with AssemblyAI
  ☆35Updated 10 months ago
• Josephrp / EasyRealEstate
  multi agent team with coding and data analysis capability to structure real estate investment plans and help with decision making.
  ☆15Updated last year
• AIAnytime / SLIM-Models-by-LLMWare
  SLIM Models by LLMWare. A streamlit app showing the capabilities for AI Agents and Function Calls.
  ☆20Updated last year
• Mustafa-Shoukat1 / Autonomous-HybridRAG-AI-Agent
  ☆11Updated 7 months ago
• startino / aitino
  Aitino is a platform that allows for the creation of crews of AI Agents to help you automate tasks and solve complex problems.
  ☆86Updated 3 months ago
• KevKibe / memvectordb
  ⚡️Lightning fast in-memory VectorDB written in rust🦀
  ☆22Updated 3 months ago
• HenryHengZJ / flowise-streamlit
  ☆26Updated 9 months ago
• john-adeojo / crew_ai_tutorial
  A quick Crew AI tutorial
  ☆23Updated last year
• richardanaya / epistemology
  A simple and clear way of hosting llama.cpp as a private HTTP API using Rust
  ☆26Updated last year
• dleerdefi / peak-ai-agent-stack
  RinAI agentic chat stack. Includes graphRAG memory, parallel tool calling, DeepSeek R1 powered web search, advanced LLM gateway and activ…
  ☆40Updated 4 months ago
• lypsoty112 / llm-project-skeleton
  ☆12Updated last year
• leporejoseph / PraisonAi-Streamlit
  ☆45Updated 11 months ago
• ngmisl / mojo-qa
  Using langchain, deeplake and openai to create a Q&A on the Mojo lang programming manual
  ☆22Updated last year
• AIAnytime / On-device-real-time-RAG-App
  On-device real-time RAG App built using Jina Reader, Mediapipe, Gemma 2b IT LLM.
  ☆14Updated last year
• Cerebras / inference-examples
  Inference examples
  ☆46Updated 4 months ago
• amrrs / deepseek-r1-agent
  Deepseek R1 Agent powered by LMStudio and Smolagents
  ☆31Updated 5 months ago
• MrSentinel137 / crewai-gemini-pro-vision
  AI Agents with Google's Gemini Pro and Gemini Pro Vision Models
  ☆27Updated last year
• AIAnytime / On-device-LLM-Inference-using-Mediapipe
  On-device LLM Inference using Mediapipe LLM Inference API.
  ☆21Updated last year
• agno-agi / phidata-docs
  ☆44Updated 4 months ago
• caspianmoon / jsonpaws
  A library for generating structured JSON using GPT-4o.
  ☆13Updated 10 months ago
• skolo-online / ai-agents
  ☆13Updated 5 months ago
• jndiogo / sibila
  Extract structured data from local or remote LLM models
  ☆42Updated last year
• AstraBert / Pokemon-Bot
  Discord bot that knows a lot about Pokemons :)
  ☆10Updated 6 months ago
• The-Swarm-Corporation / FluidAPI
  Welcome to **FluidAPI**, a framework that allows you to interact with APIs using **natural language**. No more JSON, headers, or complex …
  ☆31Updated this week
• alexdredmon / crayeye
  👁️ Multimodal LLM vision multitool
  ☆28Updated 8 months ago
• sudarshan-koirala / langchain-gemma-ollama-chainlit
  Simple Chainlit UI for running llms locally using Ollama and LangChain
  ☆45Updated last year