turboderp-org / exui
Web UI for ExLlamaV2
☆493Updated 3 months ago
Alternatives and similar repositories for exui:
Users that are interested in exui are comparing it to the libraries listed below
- An OAI compatible exllamav2 API that's both lightweight and fast☆940Updated this week
- An AI assistant beyond the chat box.☆328Updated last year
- A multimodal, function calling powered LLM webui.☆214Updated 7 months ago
- An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs☆341Updated this week
- LLM Frontend in a single html file☆457Updated 3 months ago
- Large-scale LLM inference engine☆1,405Updated last week
- Memoir+ a persona memory extension for Text Gen Web UI.☆199Updated last week
- Clipboard Conqueror is a novel copy and paste copilot alternative designed to bring your very own LLM AI assistant to any text field.☆399Updated 3 months ago
- A fast batching API to serve LLM models☆182Updated last year
- Dolphin System Messages☆302Updated 2 months ago
- Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.☆152Updated 11 months ago
- Easily view and modify JSON datasets for large language models☆75Updated 2 months ago
- automatically quant GGUF models☆174Updated this week
- ☆288Updated last month
- AI stack for interacting with LLMs, Stable Diffusion, Whisper, xTTS and many other AI models☆157Updated last year
- Your Trusty Memory-enabled AI Companion - Simple RAG chatbot optimized for local LLMs | 12 Languages Supported | OpenAI API Compatible☆311Updated 2 months ago
- Open source LLM UI, compatible with all local LLM providers.☆174Updated 7 months ago
- Efficient visual programming for AI language models☆359Updated 7 months ago
- TheBloke's Dockerfiles☆303Updated last year
- Falcon LLM ggml framework with CPU and GPU support☆246Updated last year
- An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.☆251Updated 2 months ago
- Landmark Attention: Random-Access Infinite Context Length for Transformers QLoRA☆123Updated last year
- The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …☆558Updated 2 months ago
- function calling-based LLM agents☆285Updated 7 months ago
- A gradio web UI for running Large Language Models like GPT-J 6B, OPT, GALACTICA, LLaMA, and Pygmalion.☆310Updated last year
- An extension for oobabooga/text-generation-webui that enables the LLM to search the web using DuckDuckGo☆240Updated this week
- Customizable implementation of the self-instruct paper.☆1,044Updated last year
- ☆201Updated 2 weeks ago
- Use local llama LLM or openai to chat, discuss/summarize your documents, youtube videos, and so on.☆152Updated 4 months ago
- ☆626Updated last week