aneeshjoy / vllm-windowsLinks
Docker compose to run vLLM on Windows
☆91Updated last year
Alternatives and similar repositories for vllm-windows
Users that are interested in vllm-windows are comparing it to the libraries listed below
Sorting:
- This is the Mixture-of-Agents (MoA) concept, adapted from the original work by TogetherAI. My version is tailored for local model usage a…☆116Updated 11 months ago
- An extension that lets the AI take the wheel, allowing it to use the mouse and keyboard, recognize UI elements, and prompt itself :3...no…☆123Updated 8 months ago
- Function Calling Mistral 7B. Learn how to make functions call for open source LLMs.☆48Updated last year
- Open Sourced NoteBookLM☆59Updated 8 months ago
- ☆130Updated 2 months ago
- A comprehensive platform for managing, testing, and leveraging Ollama AI models with advanced features for customization, workflow automa…☆48Updated 3 months ago
- A fast batching API to serve LLM models☆183Updated last year
- ☆29Updated 8 months ago
- ☆49Updated 4 months ago
- Service for testing out the new Qwen2.5 omni model☆52Updated last month
- Educational framework exploring ergonomic, lightweight multi-agent orchestration. Modified to use local Ollama endpoint☆50Updated 8 months ago
- High level tool use for LLMs☆34Updated 10 months ago
- ☆95Updated 6 months ago
- Mycomind Daemon: A mycelium-inspired, advanced Mixture-of-Memory-RAG-Agents (MoMRA) cognitive assistant that combines multiple AI models …☆34Updated 11 months ago
- A python package for developing AI applications with local LLMs.☆150Updated 5 months ago
- automatically quant GGUF models☆184Updated last week
- The latest graphrag interface is used, using the local ollama to provide the LLM interface.Support for using the pip installation☆153Updated 8 months ago
- Own your AI, search the web with it🌐😎☆87Updated 5 months ago
- A simple wrapper around "F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matching" that provides an OpenAI-compatibl…☆13Updated 4 months ago
- BUD-E (Buddy) is an open-source voice assistant framework that facilitates seamless interaction with AI models and APIs, enabling the cre…☆36Updated 11 months ago
- Serving LLMs in the HF-Transformers format via a PyFlask API☆71Updated 9 months ago
- This is the Mixture-of-Agents (MoA) concept, adapted from the original work by TogetherAI. My version is tailored for local model usage a…☆12Updated last year
- Simple example to showcase how to use llamaparser to parse PDF files☆87Updated 9 months ago
- Gradio based tool to run opensource LLM models directly from Huggingface☆93Updated last year
- Something similar to Apple Intelligence?☆61Updated 11 months ago
- SPLAA is an AI assistant framework that utilizes voice recognition, text-to-speech, and tool-calling capabilities to provide a conversati…☆27Updated last month
- Clone of https://r.jina.ai which is deployable locally☆44Updated 9 months ago
- Automated LLM novelist☆47Updated last year
- This small API downloads and exposes access to NeuML's txtai-wikipedia and full wikipedia datasets, taking in a query and returning full …☆96Updated 2 months ago
- ☆114Updated 6 months ago