varunvasudeva1 / llm-server-docsLinks
Documentation on setting up a local LLM server on Debian from scratch, using Ollama/llama.cpp/vLLM, Open WebUI, Kokoro FastAPI, and ComfyUI.
☆505Updated 2 months ago
Alternatives and similar repositories for llm-server-docs
Users that are interested in llm-server-docs are comparing it to the libraries listed below
Sorting:
- a Repository of Open-WebUI tools to use with your favourite LLMs☆283Updated this week
- The Fastest Way to Fine-Tune LLMs Locally☆313Updated 4 months ago
- The AI toolkit for the AI developer☆824Updated this week
- Effortlessly run LLM backends, APIs, frontends, and services with one command.☆1,924Updated last week
- What If Language Models Expertly Routed All Inference? WilmerAI allows prompts to be routed to specialized workflows based on the domain …☆728Updated last week
- ✨ AI interface for tinkerers (Ollama, Haystack RAG, Python)☆464Updated last month
- Notate is a desktop chat application that takes AI conversations to the next level. It combines the simplicity of chat with advanced feat…☆257Updated 5 months ago
- API up your Ollama Server.☆165Updated last month
- Compare open-source local LLM inference projects by their metrics to assess popularity and activeness.☆612Updated 2 months ago
- open source assistant using small models (2b - 5b) , with agentic and tool calling capabilities and integration of RAG with effiecient …☆202Updated this week
- Search the web and your self-hosted apps using local AI agents.☆454Updated 8 months ago
- AI-powered assistant to help you with your daily tasks, powered by Llama 3, DeepSeek R1, and many more models on HuggingFace.☆511Updated 4 months ago
- Optimized Ollama LLM server configuration for Mac Studio and other Apple Silicon Macs. Headless setup with automatic startup, resource op…☆206Updated 4 months ago
- Abbey is a self-hosted configurable AI interface with workspaces, document chats, YouTube chats, and more. Find our hosted version at htt…☆393Updated 3 months ago
- Manifold is a platform for enabling workflow automation using AI assistants.☆454Updated this week
- Local LLM Powered Recursive Search & Smart Knowledge Explorer☆246Updated 5 months ago
- ☆207Updated 2 months ago
- An AI memory layer with short- and long-term storage, semantic clustering, and optional memory decay for context-aware applications.☆641Updated 6 months ago
- A proxy server for multiple ollama instances with Key security☆466Updated 2 weeks ago
- User-friendly AI Interface (Supports Ollama, OpenAI API, ...)☆276Updated 3 months ago
- ☆923Updated this week
- LLM for Long Text Summary (Comprehensive Bulleted Notes)☆573Updated 2 weeks ago
- An application for running LLMs locally on your device, with your documents, facilitating detailed citations in generated responses.☆602Updated 8 months ago
- AI Search tools.☆328Updated 3 months ago
- A multi-platform desktop application to evaluate and compare LLM models, written in Rust and React.☆792Updated 3 months ago
- ☆186Updated 3 months ago
- A Python-based web-assisted large language model (LLM) search assistant using Llama.cpp☆358Updated 8 months ago
- A real production-worthy RAG Pipeline.☆263Updated 5 months ago
- Local debugging agent that runs in your terminal☆383Updated last month
- Minimalist web-searching platform with an AI assistant that runs directly from your browser. Uses WebLLM, Wllama and SearXNG. Demo: https…☆459Updated this week