aneeshjoy / vllm-windows
Docker compose to run vLLM on Windows
☆78Updated last year
Alternatives and similar repositories for vllm-windows:
Users that are interested in vllm-windows are comparing it to the libraries listed below
- ☆47Updated 2 months ago
- This is the Mixture-of-Agents (MoA) concept, adapted from the original work by TogetherAI. My version is tailored for local model usage a…☆116Updated 10 months ago
- idea: https://github.com/nyxkrage/ebook-groupchat/☆86Updated 8 months ago
- ☆89Updated 4 months ago
- An extension that lets the AI take the wheel, allowing it to use the mouse and keyboard, recognize UI elements, and prompt itself :3...no…☆120Updated 6 months ago
- A fast batching API to serve LLM models☆182Updated last year
- ☆110Updated 6 months ago
- automatically quant GGUF models☆174Updated last week
- ☆130Updated 2 weeks ago
- Speech-to-speech AI assistant with natural conversation flow, mid-speech interruption, vision capabilities and AI-initiated follow-ups. F…☆137Updated 3 weeks ago
- This extension enhances the capabilities of textgen-webui by integrating advanced vision models, allowing users to have contextualized co…☆53Updated 6 months ago
- Automated LLM novelist☆45Updated last year
- Dataset Crafting w/ RAG/Wikipedia ground truth and Efficient Fine-Tuning Using MLX and Unsloth. Includes configurable dataset annotation …☆183Updated 9 months ago
- A open webui function for better R1 experience☆79Updated 2 months ago
- Open Sourced NoteBookLM☆58Updated 7 months ago
- Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.☆115Updated 11 months ago
- Fully-featured, beautiful web interface for vLLM - built with NextJS.☆135Updated last month
- ☆69Updated this week
- Clone of https://r.jina.ai which is deployable locally☆44Updated 7 months ago
- A real-time speech-to-speech chatbot powered by Whisper Small, Llama 3.2, and Kokoro-82M.☆224Updated 3 months ago
- An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.☆253Updated 2 months ago
- API server for Instant voice cloning by MyShell.☆91Updated 7 months ago
- A multimodal, function calling powered LLM webui.☆214Updated 7 months ago
- After my server ui improvements were successfully merged, consider this repo a playground for experimenting, tinkering and hacking around…☆54Updated 8 months ago
- ☆202Updated 3 weeks ago
- ☆28Updated 7 months ago
- High level tool use for LLMs☆34Updated 9 months ago
- ☆88Updated 2 months ago
- A python package for developing AI applications with local LLMs.☆149Updated 4 months ago
- Serving LLMs in the HF-Transformers format via a PyFlask API☆71Updated 8 months ago