Alternatives and similar repositories for LLM-Inference-API-in-Rust:

Users that are interested in LLM-Inference-API-in-Rust are comparing it to the libraries listed below

• AIAnytime / On-device-LLM-Inference-using-Mediapipe
  On-device LLM Inference using Mediapipe LLM Inference API.
  ☆21Updated last year
• john-adeojo / crew_ai_tutorial
  A quick Crew AI tutorial
  ☆23Updated 11 months ago
• rupeshs / shortgpt
  Ask shortgpt for instant and concise answers
  ☆13Updated last year
• samuel-vitorino / lm.rs-webui
  Light WebUI for lm.rs
  ☆23Updated 6 months ago
• KevKibe / memvectordb
  ⚡️Lightning fast in-memory VectorDB written in rust🦀
  ☆20Updated last month
• smithakolan / AssemblyAI-Applications
  Here is a collection of cool applications that I've built with AssemblyAI
  ☆35Updated 8 months ago
• microsandbox / microsandbox
  Self-hosted Solution for Running AI-Generated Code in Secure Sandboxes
  ☆53Updated this week
• AIAnytime / Medical-Mixture-of-Experts-LLM
  Medical Mixture of Experts LLM using Mergekit.
  ☆20Updated last year
• ngmisl / mojo-qa
  Using langchain, deeplake and openai to create a Q&A on the Mojo lang programming manual
  ☆22Updated last year
• RexiaAI / codeExamples
  Various simple code examples utilising large language models's and related tools
  ☆11Updated 10 months ago
• unclecode / groqopilot
  VSCode Copilot for Groq fans!
  ☆41Updated 9 months ago
• JayZeeDesign / knowledge-retrieval-with-imgs
  ☆42Updated last year
• ayaansh-roy / voice_assistant_llm
  ☆65Updated last year
• kevin-rs / autogpt
  🦀 A Pure Rust Framework For Building AGI (WIP).
  ☆70Updated this week
• spyglass-search / memex
  Super-simple, fully Rust powered "memory" (doc store + semantic search) for LLM projects, semantic search, etc.
  ☆58Updated last year
• fxnai / fxn
  Run Python functions on desktop, mobile, web, and in the cloud. https://fxn.ai/explore
  ☆57Updated last week
• PlugOvr-ai / PlugOvr
  AI Assistant
  ☆20Updated last week
• agentsea / taskara
  Task management for AI agents
  ☆14Updated this week
• leporejoseph / PraisonAi-Streamlit
  ☆44Updated 9 months ago
• Doriandarko / giotto-artist-assistant
  The very first artist assistant
  ☆20Updated last year
• AIAnytime / Function-Calling-Mistral-7B
  Function Calling Mistral 7B. Learn how to make functions call for open source LLMs.
  ☆48Updated last year
• startino / aitino
  Aitino is a platform that allows for the creation of crews of AI Agents to help you automate tasks and solve complex problems.
  ☆82Updated last month
• alexdredmon / crayeye
  👁️ Multimodal LLM vision multitool
  ☆26Updated 6 months ago
• Intellicode / writer
  🤖📝 A markdown editor powered by AI (Ollama)
  ☆63Updated 6 months ago
• MrSentinel137 / crewai-gemini-pro-vision
  AI Agents with Google's Gemini Pro and Gemini Pro Vision Models
  ☆27Updated last year
• sudarshan-koirala / langchain-gemma-ollama-chainlit
  Simple Chainlit UI for running llms locally using Ollama and LangChain
  ☆44Updated last year
• definitive-io / llama3-function-calling
  ☆59Updated last year
• ialacol / text-inference-batcher
  A high performance batching router optimises max throughput for text inference workload
  ☆16Updated last year
• rust10x / rust-ai-buddy
  ☆38Updated last year
• geminik23 / ai-agents
  a Rust library designed for building and managing generative AI agents, leveraging the capabilities of large language models (LLMs)
  ☆19Updated this week