varunvasudeva1 / llm-server-docsLinks
End-to-end documentation to set up your own local & fully private LLM server on Debian. Equipped with chat, web search, RAG, model management, MCP servers, image generation, and TTS.
☆633Updated last month
Alternatives and similar repositories for llm-server-docs
Users that are interested in llm-server-docs are comparing it to the libraries listed below
Sorting:
- Open‑WebUI Tools is a modular toolkit designed to extend and enrich your Open WebUI instance, turning it into a powerful AI workstation. …☆448Updated last month
- WilmerAI is one of the oldest LLM semantic routers. It uses multi-layer prompt routing and complex workflows to allow you to not only cre…☆791Updated 2 months ago
- A proxy server for multiple ollama instances with Key security☆543Updated last month
- ✨ AI interface for tinkerers (Ollama, Haystack RAG, Python)☆473Updated 3 months ago
- Compare open-source local LLM inference projects by their metrics to assess popularity and activeness.☆687Updated last month
- An opinionated list of awesome Ollama web and desktop uis, frameworks, libraries, software and resources.☆433Updated 10 months ago
- The Fastest Way to Fine-Tune LLMs Locally☆328Updated 8 months ago
- A Python-based web-assisted large language model (LLM) search assistant using Llama.cpp☆364Updated last year
- Effortlessly run LLM backends, APIs, frontends, and services with one command.☆2,183Updated this week
- MAESTRO is an AI-powered research application designed to streamline complex research tasks.☆1,359Updated 2 months ago
- A multi-platform desktop application to evaluate and compare LLM models, written in Rust and React.☆881Updated 3 weeks ago
- User-friendly AI Interface (Supports Ollama, OpenAI API, ...)☆290Updated 8 months ago
- API up your Ollama Server.☆186Updated 2 months ago
- The AI toolkit for the AI developer☆1,117Updated this week
- beep boop 🤖 (experimental)☆117Updated 11 months ago
- Search the web and your self-hosted apps using local AI agents.☆536Updated last year
- AI-powered assistant to help you with your daily tasks, powered by Llama 3, DeepSeek R1, and many more models on HuggingFace.☆522Updated last week
- AI Search tools.☆340Updated last month
- llmbasedos — Local-First OS Where Your AI Agents Wake Up and Work☆278Updated 3 months ago
- ☆1,215Updated last week
- An AI memory layer with short- and long-term storage, semantic clustering, and optional memory decay for context-aware applications.☆674Updated 10 months ago
- Your Trusty Memory-enabled AI Companion - Simple RAG chatbot optimized for local LLMs | 12 Languages Supported | OpenAI API Compatible☆344Updated 9 months ago
- Open WebUI Desktop 🌐 (Alpha)☆736Updated 4 months ago
- QA-Pilot is an interactive chat project that leverages online/local LLM for rapid understanding and navigation of GitHub code repository.☆312Updated 3 months ago
- Go manage your Ollama models☆1,608Updated this week
- Building blocks for rapid development of GenAI applications☆1,597Updated this week
- open source assistant hybrid using small models (2b - 5b) and gemini , with image and agentic tool capabilities and integration of RAG…☆221Updated 2 months ago
- An implementation of iterative deep research using the OpenAI Agents SDK☆687Updated 6 months ago
- Excalidraw meets ComfyUI for LLMs☆296Updated 3 months ago
- Local debugging agent that runs in your terminal☆396Updated 6 months ago