Alternatives and similar repositories for LLM-Inference-API-in-Rust:

Users that are interested in LLM-Inference-API-in-Rust are comparing it to the libraries listed below

• AIAnytime / On-device-LLM-Inference-using-Mediapipe
  On-device LLM Inference using Mediapipe LLM Inference API.
  ☆21Updated last year
• samuel-vitorino / lm.rs-webui
  Light WebUI for lm.rs
  ☆23Updated 5 months ago
• sudarshan-koirala / RAG-chat-with-documents
  Chainlit app for advanced RAG. Uses llamaparse, langchain, qdrant and models from groq.
  ☆44Updated 10 months ago
• smithakolan / AssemblyAI-Applications
  Here is a collection of cool applications that I've built with AssemblyAI
  ☆35Updated 7 months ago
• The-Swarm-Corporation / swarms-rs
  The Enterprise-Grade Production-Ready Multi-Agent Orchestration Framework in Rust
  ☆10Updated last week
• Drlordbasil / easy-openai-gpt-4o1-thinking-loop
  time based thinking and structure like OpenAI's o1 preview.
  ☆10Updated 6 months ago
• john-adeojo / crew_ai_tutorial
  A quick Crew AI tutorial
  ☆23Updated 10 months ago
• amrrs / deepseek-r1-agent
  Deepseek R1 Agent powered by LMStudio and Smolagents
  ☆30Updated 2 months ago
• disler / elm-itv-benchmark
  Simple, Opinionated benchmark for testing the viability of Efficient Language Models (ELMs) for personal use cases.
  ☆47Updated 10 months ago
• Jeomon / Meta-Agent-with-More-Agents
  The purpose of the "Meta Agent with More Agents" project is to dynamically solve complex queries by breaking them down into smaller tasks…
  ☆26Updated 3 months ago
• AllAboutAI-YT / ai-vision-scraping
  Scrape Webpages with AI Vision
  ☆50Updated last year
• AIAnytime / SLIM-Models-by-LLMWare
  SLIM Models by LLMWare. A streamlit app showing the capabilities for AI Agents and Function Calls.
  ☆20Updated last year
• leporejoseph / PraisonAi-Streamlit
  ☆44Updated 8 months ago
• sudarshan-koirala / langchain-gemma-ollama-chainlit
  Simple Chainlit UI for running llms locally using Ollama and LangChain
  ☆44Updated last year
• AIAnytime / Medical-Mixture-of-Experts-LLM
  Medical Mixture of Experts LLM using Mergekit.
  ☆20Updated last year
• Intellicode / writer
  🤖📝 A markdown editor powered by AI (Ollama)
  ☆62Updated 5 months ago
• PlugOvr-ai / PlugOvr
  AI Assistant
  ☆20Updated this week
• AIAnytime / SaaS-Startup-using-Generative-AI
  A SaaS Startup using Generative AI. This is a code bug fixer SaaS built using Azure OpenAI, Stripe, SQLite, and web technologies.
  ☆15Updated last year
• developersdigest / ollama-anywhere
  Access your Ollama inference server running on your computer from anywhere. Set up with NextJS + Langchain JS LCEL + Ngrok
  ☆25Updated last year
• HenryHengZJ / flowise-streamlit
  ☆25Updated 6 months ago
• Pythagora-io / gpt-optimizely
  Example Optimizely clone created with GPT Pilot
  ☆23Updated 4 months ago
• rupeshs / shortgpt
  Ask shortgpt for instant and concise answers
  ☆13Updated last year
• syedazharmbnr1 / ClaudeMCPServer
  MCP Server implementation for Claude
  ☆23Updated 4 months ago
• AIAnytime / On-device-real-time-RAG-App
  On-device real-time RAG App built using Jina Reader, Mediapipe, Gemma 2b IT LLM.
  ☆13Updated 11 months ago
• catena-labs / moa-llm
  A Python library to orchestrate LLMs in a neural network-inspired structure
  ☆46Updated 5 months ago
• developersdigest / Groq-API-Quick-Guide-with-Examples-Groq-SDK-Langchain-LlamaIndex-OpenAI-SDK-Vercel
  Groq API: Quick Guide with Examples Groq SDK, Langchain, LlamaIndex, OpenAI SDK, Vercel
  ☆40Updated last year
• unclecode / whisperanywhere-js
  WhisperAnywhere: Effortless speech-to-text everywhere on your Mac. Use a hotkey to dictate in any app, powered by Whisper AI and Groq API…
  ☆27Updated 6 months ago
• The-Swarm-Corporation / Cookbook
  Examples and guides for using Swarms Framework
  ☆36Updated 2 months ago
• agno-agi / phidata-docs
  ☆44Updated 2 months ago
• samwit / ollama-tutorials
  A set of Ollama Tutorials from my youtube channel
  ☆39Updated last year