varunvasudeva1 / llm-server-docsLinks
Documentation on setting up an LLM server on Debian from scratch, using Ollama/vLLM, Open WebUI, OpenedAI Speech/Kokoro FastAPI, and ComfyUI.
☆484Updated last month
Alternatives and similar repositories for llm-server-docs
Users that are interested in llm-server-docs are comparing it to the libraries listed below
Sorting:
- Compare open-source local LLM inference projects by their metrics to assess popularity and activeness.☆591Updated last month
- AlwaysReddy is a LLM voice assistant that is always just a hotkey away.☆744Updated 3 months ago
- 🚀 Retrieval Augmented Generation (RAG) with txtai. Combine search and LLMs to find insights with your own data.☆382Updated last month
- The AI toolkit for the AI developer☆740Updated this week
- Local LLM Powered Recursive Search & Smart Knowledge Explorer☆243Updated 4 months ago
- Notate is a desktop chat application that takes AI conversations to the next level. It combines the simplicity of chat with advanced feat…☆256Updated 4 months ago
- User-friendly AI Interface (Supports Ollama, OpenAI API, ...)☆268Updated 2 months ago
- a Repository of Open-WebUI tools to use with your favourite LLMs☆232Updated last week
- ✨ AI interface for tinkerers (Ollama, Haystack RAG, Python)☆462Updated last week
- AI-powered assistant to help you with your daily tasks, powered by Llama 3, DeepSeek R1, and many more models on HuggingFace.☆507Updated 3 months ago
- The Fastest Way to Fine-Tune LLMs Locally☆306Updated 3 months ago
- Ollama client written in Python☆2Updated 6 months ago
- Turns devices into a scalable LLM platform☆144Updated last week
- Abbey is a self-hosted configurable AI interface with workspaces, document chats, YouTube chats, and more. Find our hosted version at htt…☆383Updated 2 months ago
- AI Search tools.☆322Updated 2 months ago
- Excalidraw meets ComfyUI for LLMs☆265Updated this week
- Minimal Linux OS with a Model Context Protocol (MCP) gateway to expose local capabilities to LLMs.☆247Updated this week
- ☆184Updated 2 months ago
- Effortlessly run LLM backends, APIs, frontends, and services with one command.☆1,880Updated this week
- Manifold is a platform for enabling workflow automation using AI assistants.☆438Updated 3 weeks ago
- ☆204Updated last month
- A proxy server for multiple ollama instances with Key security☆449Updated this week
- ☆349Updated this week
- A community-driven collection of RAG (Retrieval-Augmented Generation) frameworks, projects, and resources. Contribute and explore the evo…☆922Updated last week
- Go manage your Ollama models☆1,183Updated last week
- A Python-based web-assisted large language model (LLM) search assistant using Llama.cpp☆356Updated 8 months ago
- Optimized Ollama LLM server configuration for Mac Studio and other Apple Silicon Macs. Headless setup with automatic startup, resource op…☆199Updated 3 months ago
- Command-line personal assistant using your favorite proprietary or local models with access to over 30+ tools☆109Updated 2 months ago
- Your Trusty Memory-enabled AI Companion - Simple RAG chatbot optimized for local LLMs | 12 Languages Supported | OpenAI API Compatible☆317Updated 3 months ago
- Efficient visual programming for AI language models☆364Updated last month