varunvasudeva1 / llm-server-docsLinks
Documentation on setting up a local LLM server on Debian from scratch, using Ollama/llama.cpp/vLLM, Open WebUI, Kokoro FastAPI, and ComfyUI.
☆541Updated 4 months ago
Alternatives and similar repositories for llm-server-docs
Users that are interested in llm-server-docs are comparing it to the libraries listed below
Sorting:
- Open‑WebUI Tools is a modular toolkit designed to extend and enrich your Open WebUI instance, turning it into a powerful AI workstation. …☆341Updated last week
- What If Language Models Expertly Routed All Inference? WilmerAI allows prompts to be routed to specialized workflows based on the domain …☆768Updated last week
- The Fastest Way to Fine-Tune LLMs Locally☆317Updated 5 months ago
- A proxy server for multiple ollama instances with Key security☆489Updated last week
- Local LLM Powered Recursive Search & Smart Knowledge Explorer☆252Updated 7 months ago
- Compare open-source local LLM inference projects by their metrics to assess popularity and activeness.☆637Updated last week
- AI Search tools.☆337Updated 5 months ago
- ✨ AI interface for tinkerers (Ollama, Haystack RAG, Python)☆468Updated this week
- Manifold is a platform for enabling workflow automation using AI assistants.☆458Updated last month
- Go manage your Ollama models☆1,417Updated 3 weeks ago
- AI-powered assistant to help you with your daily tasks, powered by Llama 3, DeepSeek R1, and many more models on HuggingFace.☆516Updated 6 months ago
- 🦙 echoOLlama: A real-time voice AI platform powered by local LLMs. Features WebSocket streaming, voice interactions, and OpenAI API comp…☆118Updated 10 months ago
- An AI memory layer with short- and long-term storage, semantic clustering, and optional memory decay for context-aware applications.☆659Updated 7 months ago
- ☆1,115Updated this week
- Effortlessly run LLM backends, APIs, frontends, and services with one command.☆2,037Updated 2 weeks ago
- User-friendly AI Interface (Supports Ollama, OpenAI API, ...)☆280Updated 5 months ago
- ☆223Updated 4 months ago
- An opinionated list of awesome Ollama web and desktop uis, frameworks, libraries, software and resources.☆396Updated 7 months ago
- Search the web and your self-hosted apps using local AI agents.☆465Updated 9 months ago
- API up your Ollama Server.☆177Updated 3 months ago
- A Python-based web-assisted large language model (LLM) search assistant using Llama.cpp☆359Updated 10 months ago
- Notate is a desktop chat application that takes AI conversations to the next level. It combines the simplicity of chat with advanced feat…☆257Updated 6 months ago
- open source assistant using small models (2b - 5b) , with agentic and tool calling capabilities and integration of RAG with effiecient …☆210Updated 3 weeks ago
- Abbey is a self-hosted configurable AI interface with workspaces, document chats, YouTube chats, and more. Find our hosted version at htt…☆403Updated 4 months ago
- Local debugging agent that runs in your terminal☆393Updated 3 months ago
- Optimized Ollama LLM server configuration for Mac Studio and other Apple Silicon Macs. Headless setup with automatic startup, resource op…☆253Updated 6 months ago
- This project demonstrates a basic chain-of-thought interaction with any LLM (Large Language Model)☆322Updated 11 months ago
- The AI toolkit for the AI developer☆916Updated this week
- Excalidraw meets ComfyUI for LLMs☆280Updated 3 weeks ago
- Deeper Seeker is an simpler OSS version of OpenAI's latest Deep Research feature in ChatGPT.It is an agentic research tool to reason , cr…☆412Updated 4 months ago