varunvasudeva1 / llm-server-docsLinks
Documentation on setting up an LLM server on Debian from scratch, using Ollama/vLLM, Open WebUI, OpenedAI Speech/Kokoro FastAPI, and ComfyUI.
☆465Updated last month
Alternatives and similar repositories for llm-server-docs
Users that are interested in llm-server-docs are comparing it to the libraries listed below
Sorting:
- A proxy server for multiple ollama instances with Key security☆436Updated last month
- An application for running LLMs locally on your device, with your documents, facilitating detailed citations in generated responses.☆594Updated 7 months ago
- The Fastest Way to Fine-Tune LLMs Locally☆300Updated 2 months ago
- A Python-based web-assisted large language model (LLM) search assistant using Llama.cpp☆351Updated 7 months ago
- API up your Ollama Server.☆154Updated 2 months ago
- Efficient visual programming for AI language models☆362Updated 3 weeks ago
- a Repository of Open-WebUI tools to use with your favourite LLMs☆226Updated 2 weeks ago
- The AI toolkit for the AI developer☆657Updated this week
- Compare open-source local LLM inference projects by their metrics to assess popularity and activeness.☆575Updated 3 weeks ago
- Local LLM Powered Recursive Search & Smart Knowledge Explorer☆243Updated 3 months ago
- Building blocks for rapid development of GenAI applications☆70Updated this week
- Manifold is a platform for enabling workflow automation using AI assistants.☆435Updated this week
- Notate is a desktop chat application that takes AI conversations to the next level. It combines the simplicity of chat with advanced feat…☆253Updated 3 months ago
- What If Language Models Expertly Routed All Inference? WilmerAI allows prompts to be routed to specialized workflows based on the domain …☆689Updated 2 months ago
- User-friendly AI Interface (Supports Ollama, OpenAI API, ...)☆266Updated 2 months ago
- This project demonstrates a basic chain-of-thought interaction with any LLM (Large Language Model)☆319Updated 8 months ago
- Model swapping for llama.cpp (or any local OpenAPI compatible server)☆848Updated last week
- ☆181Updated 2 months ago
- AI Search tools.☆317Updated last month
- Local debugging agent that runs in your terminal☆362Updated this week
- Generate large synthetic data using an LLM☆420Updated this week
- Effortlessly run LLM backends, APIs, frontends, and services with one command.☆1,774Updated this week
- Generic rag framework to apply the power of LLMs on any given dataset☆613Updated this week
- An AI memory layer with short- and long-term storage, semantic clustering, and optional memory decay for context-aware applications.☆634Updated 4 months ago
- ☆198Updated last month
- The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …☆567Updated 3 months ago
- OpenAPI Tool Servers☆441Updated this week
- Minimalist web-searching platform with an AI assistant that runs directly from your browser. Uses WebLLM, Wllama and SearXNG. Demo: https…☆417Updated this week
- Command-line personal assistant using your favorite proprietary or local models with access to over 30+ tools☆110Updated 2 months ago
- Code execution utilities for Open WebUI & Ollama☆282Updated 6 months ago