varunvasudeva1 / llm-server-docs
Documentation on setting up an LLM server on Debian from scratch, using Ollama/vLLM, Open WebUI, OpenedAI Speech/Kokoro FastAPI, and ComfyUI.
☆338Updated 2 months ago
Alternatives and similar repositories for llm-server-docs:
Users that are interested in llm-server-docs are comparing it to the libraries listed below
- A Python-based web-assisted large language model (LLM) search assistant using Llama.cpp☆346Updated 5 months ago
- A multi-platform desktop application to evaluate and compare LLM models, written in Rust and React.☆676Updated 2 months ago
- This project demonstrates a basic chain-of-thought interaction with any LLM (Large Language Model)☆318Updated 6 months ago
- ☆159Updated last week
- What If Language Models Expertly Routed All Inference? WilmerAI allows prompts to be routed to specialized workflows based on the domain …☆630Updated last week
- API up your Ollama Server.☆144Updated 3 months ago
- Belullama is a comprehensive AI application that bundles Ollama, Open WebUI, and Automatic1111 (Stable Diffusion WebUI) into a single, ea…☆155Updated 6 months ago
- A command-line personal assistant that integrates with Google Calendar, Gmail, and Tasks to help manage your digital life.☆120Updated 4 months ago
- open source assistant using small models (2b - 5b) , with agentic and tool calling capabilities and integration of RAG with effiecient …☆123Updated last week
- Compare open-source local LLM inference projects by their metrics to assess popularity and activeness.☆529Updated 2 months ago
- AI planner similar to OpenAI's deep research☆113Updated this week
- Scalable Multi-modal RAG platform☆471Updated this week
- tl/dw (Too Long, Didn't Watch): Your Personal Research Multi-Tool - a naive attempt at 'A Young Lady's Illustrated Primer' (Open Source N…☆671Updated this week
- Your Trusty Memory-enabled AI Companion - Simple RAG chatbot optimized for local LLMs | 12 Languages Supported | OpenAI API Compatible☆305Updated last month
- Link you Ollama models to LM-Studio☆132Updated 8 months ago
- a Repository of Open-WebUI tools to use with your favourite LLMs☆182Updated last week
- Ollama chat client in Vue, everything you need to do your private text rpg in browser☆125Updated 5 months ago
- Local LLM Powered Recursive Search & Smart Knowledge Explorer☆230Updated last month
- A simple, intuitive toolkit for quickly implementing LLM powered applications.☆224Updated 2 months ago
- TUI for Ollama and other LLM providers☆251Updated this week
- Chat with your current directory's files using a local or API LLM.☆335Updated 2 weeks ago
- The AI toolkit for the AI developer☆430Updated last week
- Open source LLM UI, compatible with all local LLM providers.☆173Updated 6 months ago
- AI stack for interacting with LLMs, Stable Diffusion, Whisper, xTTS and many other AI models☆152Updated 10 months ago
- Your gateway to both Ollama & Apple MlX models☆111Updated 3 weeks ago
- Yet another self-hosted AI voice assistant. GlaDOS' blazing fast pipeline with a more realistic Kokoro TTS voice and vision.☆53Updated 2 months ago
- You don’t need to read the code to understand how to build!☆184Updated 2 months ago
- An extension that lets the AI take the wheel, allowing it to use the mouse and keyboard, recognize UI elements, and prompt itself :3...no…☆115Updated 5 months ago
- 🤖 An open-source AI assistant answering questions using your docs☆157Updated last week
- Using Gemma-3 Vision☆56Updated last week