turboderp-org / exuiLinks
Web UI for ExLlamaV2
☆495Updated 3 months ago
Alternatives and similar repositories for exui
Users that are interested in exui are comparing it to the libraries listed below
Sorting:
- The official API server for Exllama. OAI compatible, lightweight, and fast.☆962Updated last week
- A multimodal, function calling powered LLM webui.☆214Updated 8 months ago
- An AI assistant beyond the chat box.☆329Updated last year
- An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs☆375Updated this week
- LLM Frontend in a single html file☆482Updated 4 months ago
- A fast batching API to serve LLM models☆181Updated last year
- Large-scale LLM inference engine☆1,435Updated this week
- Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.☆153Updated last year
- Memoir+ a persona memory extension for Text Gen Web UI.☆203Updated last week
- AI stack for interacting with LLMs, Stable Diffusion, Whisper, xTTS and many other AI models☆157Updated last year
- An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.☆254Updated 2 months ago
- Open source LLM UI, compatible with all local LLM providers.☆174Updated 8 months ago
- ☆202Updated 2 weeks ago
- The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …☆566Updated 3 months ago
- A gradio web UI for running Large Language Models like GPT-J 6B, OPT, GALACTICA, LLaMA, and Pygmalion.☆309Updated last year
- An extension for oobabooga/text-generation-webui that enables the LLM to search the web using DuckDuckGo☆246Updated 2 weeks ago
- A zero dependency web UI for any LLM backend, including KoboldCpp, OpenAI and AI Horde☆121Updated this week
- A prompt/context management system☆169Updated 2 years ago
- ☆90Updated 5 months ago
- ☆630Updated this week
- ☆71Updated last week
- automatically quant GGUF models☆179Updated this week
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆122Updated last year
- KoboldAI is generative AI software optimized for fictional use, but capable of much more!☆405Updated 4 months ago
- A frontend for creative writing with LLMs☆121Updated 10 months ago
- Easily view and modify JSON datasets for large language models☆75Updated 2 weeks ago
- Falcon LLM ggml framework with CPU and GPU support☆245Updated last year
- Text WebUI extension to add clever Notebooks to Chat mode☆139Updated last year
- Clipboard Conqueror is a novel copy and paste copilot alternative designed to bring your very own LLM AI assistant to any text field.☆401Updated 4 months ago
- TheBloke's Dockerfiles☆302Updated last year