turboderp-org / exuiLinks
Web UI for ExLlamaV2
☆513Updated 7 months ago
Alternatives and similar repositories for exui
Users that are interested in exui are comparing it to the libraries listed below
Sorting:
- The official API server for Exllama. OAI compatible, lightweight, and fast.☆1,046Updated 2 weeks ago
- A multimodal, function calling powered LLM webui.☆216Updated 11 months ago
- An AI assistant beyond the chat box.☆328Updated last year
- LLM Frontend in a single html file☆643Updated 7 months ago
- A fast batching API to serve LLM models☆187Updated last year
- Memoir+ a persona memory extension for Text Gen Web UI.☆214Updated 3 weeks ago
- An optimized quantization and inference library for running LLMs locally on modern consumer-class GPUs☆491Updated last week
- Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.☆164Updated last year
- Your Trusty Memory-enabled AI Companion - Simple RAG chatbot optimized for local LLMs | 12 Languages Supported | OpenAI API Compatible☆337Updated 6 months ago
- The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …☆589Updated 6 months ago
- Large-scale LLM inference engine☆1,543Updated this week
- An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.☆259Updated 6 months ago
- Dolphin System Messages☆346Updated 6 months ago
- An extension for oobabooga/text-generation-webui that enables the LLM to search the web☆267Updated this week
- Clipboard Conqueror is a novel copy and paste copilot alternative designed to bring your very own LLM AI assistant to any text field.☆421Updated 8 months ago
- function calling-based LLM agents☆287Updated 11 months ago
- ☆83Updated this week
- AI stack for interacting with LLMs, Stable Diffusion, Whisper, xTTS and many other AI models☆164Updated last year
- A prompt/context management system☆170Updated 2 years ago
- Open source LLM UI, compatible with all local LLM providers.☆174Updated 11 months ago
- ☆316Updated last month
- Dataset Crafting w/ RAG/Wikipedia ground truth and Efficient Fine-Tuning Using MLX and Unsloth. Includes configurable dataset annotation …☆185Updated last year
- Efficient visual programming for AI language models☆362Updated 3 months ago
- Y'all thought the dead internet theory wasn't real, but HERE IT IS☆202Updated last year
- A local AI companion that uses a collection of free, open source AI models in order to create two virtual companions that will follow you…☆232Updated last month
- ☆209Updated this week
- TheBloke's Dockerfiles☆307Updated last year
- Falcon LLM ggml framework with CPU and GPU support☆247Updated last year
- This project demonstrates a basic chain-of-thought interaction with any LLM (Large Language Model)☆322Updated 11 months ago
- automatically quant GGUF models☆199Updated this week