varunvasudeva1 / llm-server-docs
Documentation on setting up an LLM server on Debian from scratch, using Ollama/vLLM, Open WebUI, OpenedAI Speech/Kokoro FastAPI, and ComfyUI.
☆450Updated 2 weeks ago
Alternatives and similar repositories for llm-server-docs
Users that are interested in llm-server-docs are comparing it to the libraries listed below
Sorting:
- a Repository of Open-WebUI tools to use with your favourite LLMs☆217Updated last week
- API up your Ollama Server.☆152Updated last month
- Compare open-source local LLM inference projects by their metrics to assess popularity and activeness.☆562Updated this week
- A Python-based web-assisted large language model (LLM) search assistant using Llama.cpp☆348Updated 6 months ago
- Clara – Privacy-first, client-side AI assistant for Ollama with tool calling & mini n8n-style flow builder. No backend. No data leaks. 10…☆729Updated this week
- tl/dw (Too Long, Didn't Watch): Your Personal Research Multi-Tool - a naive attempt at 'A Young Lady's Illustrated Primer' (Open Source N…☆769Updated this week
- Go manage your Ollama models☆1,076Updated last week
- ☆195Updated last week
- A multi-platform desktop application to evaluate and compare LLM models, written in Rust and React.☆730Updated 3 weeks ago
- Ollama chat client in Vue, everything you need to do your private text rpg in browser☆130Updated 6 months ago
- What If Language Models Expertly Routed All Inference? WilmerAI allows prompts to be routed to specialized workflows based on the domain …☆677Updated last month
- QA-Pilot is an interactive chat project that leverages online/local LLM for rapid understanding and navigation of GitHub code repository.☆283Updated 2 months ago
- Efficient visual programming for AI language models☆361Updated 8 months ago
- Effortlessly run LLM backends, APIs, frontends, and services with one command.☆1,658Updated this week
- A proxy server for multiple ollama instances with Key security☆421Updated last month
- Model swapping for llama.cpp (or any local OpenAPI compatible server)☆745Updated this week
- AI Search tools.☆317Updated last month
- Local LLM Powered Recursive Search & Smart Knowledge Explorer☆241Updated 3 months ago
- Your Trusty Memory-enabled AI Companion - Simple RAG chatbot optimized for local LLMs | 12 Languages Supported | OpenAI API Compatible☆313Updated 2 months ago
- beep boop 🤖 (experimental)☆108Updated 4 months ago
- An opinionated list of awesome Ollama web and desktop uis, frameworks, libraries, software and resources.☆382Updated 3 months ago
- ☆1,165Updated last week
- User-friendly AI Interface (Supports Ollama, OpenAI API, ...)☆260Updated last month
- ☆202Updated 3 weeks ago
- A middleware to provide an openAI compatible endpoint that can call MCP tools☆705Updated 2 weeks ago
- Manifold is a platform for enabling workflow automation using AI assistants.☆378Updated this week
- The AI toolkit for the AI developer☆604Updated this week
- Deeper Seeker is an simpler OSS version of OpenAI's latest Deep Research feature in ChatGPT.It is an agentic research tool to reason , cr…☆400Updated last month
- The Fastest Way to Fine-Tune LLMs Locally☆294Updated last month
- Your gateway to both Ollama & Apple MlX models☆131Updated 2 months ago