yoziru / nextjs-vllm-uiLinks
Fully-featured, beautiful web interface for vLLM - built with NextJS.
☆145Updated 2 months ago
Alternatives and similar repositories for nextjs-vllm-ui
Users that are interested in nextjs-vllm-ui are comparing it to the libraries listed below
Sorting:
- automatically quant GGUF models☆185Updated this week
- An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.☆257Updated 4 months ago
- A fast batching API to serve LLM models☆183Updated last year
- This is the Mixture-of-Agents (MoA) concept, adapted from the original work by TogetherAI. My version is tailored for local model usage a…☆117Updated last year
- The RunPod worker template for serving our large language model endpoints. Powered by vLLM.☆328Updated 2 weeks ago
- ☆131Updated 2 months ago
- ☆96Updated 6 months ago
- Docker compose to run vLLM on Windows☆92Updated last year
- One click templates for inferencing Language Models☆193Updated 3 weeks ago
- Dataset Crafting w/ RAG/Wikipedia ground truth and Efficient Fine-Tuning Using MLX and Unsloth. Includes configurable dataset annotation …☆185Updated 11 months ago
- Simple UI for Llama-3.2-11B-Vision & Molmo-7B-D☆136Updated 9 months ago
- A python package for developing AI applications with local LLMs.☆150Updated 6 months ago
- Inference service for Qwen2.5-VL-7b model☆187Updated 3 months ago
- ☆204Updated last month
- The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM …☆575Updated 4 months ago
- Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.☆116Updated last year
- ☆145Updated last week
- Comparison of the output quality of quantization methods, using Llama 3, transformers, GGUF, EXL2.☆156Updated last year
- A multimodal, function calling powered LLM webui.☆214Updated 9 months ago
- Building open version of OpenAI o1 via reasoning traces (Groq, ollama, Anthropic, Gemini, OpenAI, Azure supported) Demo: https://hugging…☆181Updated 8 months ago
- Ollama chat client in Vue, everything you need to do your private text rpg in browser☆133Updated 8 months ago
- Cascading voice assistant combining real-time speech recognition, AI reasoning, and neural text-to-speech capabilities.☆102Updated 2 months ago
- A pipeline parallel training script for LLMs.☆152Updated 2 months ago
- ☆49Updated 4 months ago
- multi1: create o1-like reasoning chains with multiple AI providers (and locally). Supports LiteLLM as backend too for 100+ providers at o…☆348Updated 5 months ago
- ☆115Updated 8 months ago
- Service for testing out the new Qwen2.5 omni model☆54Updated 2 months ago
- 🚀 Retrieval Augmented Generation (RAG) with txtai. Combine search and LLMs to find insights with your own data.☆383Updated 2 months ago
- Unsloth Studio☆92Updated 3 months ago
- Open source LLM UI, compatible with all local LLM providers.☆175Updated 9 months ago