aneeshjoy / vllm-windowsLinks
Docker compose to run vLLM on Windows
☆114Updated 2 years ago
Alternatives and similar repositories for vllm-windows
Users that are interested in vllm-windows are comparing it to the libraries listed below
Sorting:
- This is the Mixture-of-Agents (MoA) concept, adapted from the original work by TogetherAI. My version is tailored for local model usage a…☆118Updated last year
- ☆128Updated last year
- automatically quant GGUF models☆219Updated last month
- Service for testing out the new Qwen2.5 omni model☆62Updated 9 months ago
- ☆51Updated 11 months ago
- ☆109Updated 5 months ago
- ☆209Updated 3 weeks ago
- An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.☆266Updated 10 months ago
- An extension that lets the AI take the wheel, allowing it to use the mouse and keyboard, recognize UI elements, and prompt itself :3...no…☆127Updated last year
- Fully-featured, beautiful web interface for vLLM - built with NextJS.☆172Updated last month
- Simple UI for Llama-3.2-11B-Vision & Molmo-7B-D☆134Updated last year
- A fast batching API to serve LLM models☆188Updated last year
- A real-time speech-to-speech chatbot powered by Whisper Small, Llama 3.2, and Kokoro-82M.☆245Updated last year
- This small API downloads and exposes access to NeuML's txtai-wikipedia and full wikipedia datasets, taking in a query and returning full …☆103Updated 5 months ago
- A python package for developing AI applications with local LLMs.☆150Updated last year
- ☆135Updated last month
- Inference service for Qwen2.5-VL-7b model☆209Updated 10 months ago
- This extension enhances the capabilities of textgen-webui by integrating advanced vision models, allowing users to have contextualized co…☆57Updated last year
- An extension for oobabooga/text-generation-webui that enables the LLM to search the web☆275Updated 3 weeks ago
- Open Source Text Embedding Models with OpenAI Compatible API☆167Updated last year
- Dataset Crafting w/ RAG/Wikipedia ground truth and Efficient Fine-Tuning Using MLX and Unsloth. Includes configurable dataset annotation …☆193Updated last year
- A multimodal, function calling powered LLM webui.☆216Updated last year
- After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…☆53Updated last year
- Guide on text completion large language model fine-tuning, including example scripts and training data acquiring.☆87Updated 11 months ago
- Auto Data is a library designed for quick and effortless creation of datasets tailored for fine-tuning Large Language Models (LLMs).☆105Updated last year
- an AI interaction tool with RAG hybrid search, conversation context, web content processing and structured data analysis with LLM / GPT☆211Updated 7 months ago
- Ollama chat client in Vue, everything you need to do your private text rpg in browser☆139Updated last year
- Local Powerpointer - A beautiful powerpoint generator which uses the power of local running large language models to generate the powerpo…☆288Updated 7 months ago
- A programming framework for agentic AI 🤖☆24Updated last year
- Phi4 Multimodal Instruct - OpenAI endpoint and Docker Image for self-hosting☆40Updated 10 months ago