turboderp-org / exui
Web UI for ExLlamaV2
☆460Updated 3 weeks ago
Alternatives and similar repositories for exui:
Users that are interested in exui are comparing it to the libraries listed below
- An OAI compatible exllamav2 API that's both lightweight and fast☆733Updated this week
- A multimodal, function calling powered LLM webui.☆213Updated 3 months ago
- LLM Frontend in a single html file☆305Updated this week
- Large-scale LLM inference engine☆1,232Updated last week
- A fast batching API to serve LLM models☆177Updated 8 months ago
- An AI assistant beyond the chat box.☆317Updated 10 months ago
- Memoir+ a persona extension for Text Gen Web UI. That includes memory, emotions, command handling and more.☆180Updated 3 weeks ago
- function calling-based LLM agents☆281Updated 4 months ago
- Dolphin System Messages☆226Updated 3 months ago
- A prompt/context management system☆167Updated last year
- transparent proxy server for llama.cpp's server to provide automatic model swapping☆135Updated this week
- TheBloke's Dockerfiles☆300Updated 10 months ago
- The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …☆519Updated last month
- ☆250Updated this week
- Simple Python library/structure to ablate features in LLMs which are supported by TransformerLens☆372Updated 7 months ago
- Easily view and modify JSON datasets for large language models☆68Updated 3 months ago
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆123Updated last year
- An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.☆217Updated last month
- Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.☆136Updated 8 months ago
- Dataset Crafting w/ RAG/Wikipedia ground truth and Efficient Fine-Tuning Using MLX and Unsloth. Includes configurable dataset annotation …☆168Updated 5 months ago
- Falcon LLM ggml framework with CPU and GPU support☆245Updated 11 months ago
- A gradio web UI for running Large Language Models like GPT-J 6B, OPT, GALACTICA, LLaMA, and Pygmalion.☆309Updated last year
- ☆181Updated last month
- AI stack for interacting with LLMs, Stable Diffusion, Whisper, xTTS and many other AI models☆145Updated 8 months ago
- An autonomous AI agent extension for Oobabooga's web ui☆176Updated last year
- This is our own implementation of 'Layer Selective Rank Reduction'☆232Updated 7 months ago
- Text WebUI extension to add clever Notebooks to Chat mode☆140Updated last year
- Clipboard Conqueror is a novel copy and paste copilot alternative designed to bring your very own LLM AI assistant to any text field.☆373Updated this week
- An extension for oobabooga/text-generation-webui that enables the LLM to search the web using DuckDuckGo☆196Updated this week