turboderp-org / exui
Web UI for ExLlamaV2
☆492Updated 2 months ago
Alternatives and similar repositories for exui:
Users that are interested in exui are comparing it to the libraries listed below
- An OAI compatible exllamav2 API that's both lightweight and fast☆907Updated this week
- A multimodal, function calling powered LLM webui.☆214Updated 6 months ago
- A fast batching API to serve LLM models☆182Updated 11 months ago
- LLM Frontend in a single html file☆439Updated 3 months ago
- An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs☆226Updated this week
- An AI assistant beyond the chat box.☆325Updated last year
- Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.☆148Updated 11 months ago
- Large-scale LLM inference engine☆1,379Updated last week
- Easily view and modify JSON datasets for large language models☆73Updated last month
- Memoir+ a persona memory extension for Text Gen Web UI.☆197Updated 3 weeks ago
- An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.☆248Updated last month
- Open source LLM UI, compatible with all local LLM providers.☆173Updated 6 months ago
- ☆282Updated last week
- Dataset Crafting w/ RAG/Wikipedia ground truth and Efficient Fine-Tuning Using MLX and Unsloth. Includes configurable dataset annotation …☆179Updated 8 months ago
- automatically quant GGUF models☆167Updated last week
- TheBloke's Dockerfiles☆303Updated last year
- The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …☆551Updated 2 months ago
- ☆197Updated this week
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆123Updated last year
- A gradio web UI for running Large Language Models like GPT-J 6B, OPT, GALACTICA, LLaMA, and Pygmalion.☆310Updated last year
- ☆84Updated 3 months ago
- AI stack for interacting with LLMs, Stable Diffusion, Whisper, xTTS and many other AI models☆154Updated 11 months ago
- A zero dependency web UI for any LLM backend, including KoboldCpp, OpenAI and AI Horde☆109Updated this week
- Clipboard Conqueror is a novel copy and paste copilot alternative designed to bring your very own LLM AI assistant to any text field.☆397Updated 3 months ago
- Automated prompting and scoring framework to evaluate LLMs using updated human knowledge prompts☆113Updated last year
- Low-Rank adapter extraction for fine-tuned transformers models☆171Updated 11 months ago
- Falcon LLM ggml framework with CPU and GPU support☆246Updated last year
- ☆619Updated last week
- Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes…☆147Updated last year
- An extension for oobabooga/text-generation-webui that enables the LLM to search the web using DuckDuckGo☆231Updated this week