Docker compose to run vLLM on Windows
☆125Jan 1, 2024Updated 2 years ago
Alternatives and similar repositories for vllm-windows
Users that are interested in vllm-windows are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Yet another frontend for LLM, written using .NET and WinUI 3☆11Sep 14, 2025Updated last year
- ESPNet TTS with Streamlit GUI☆14Apr 30, 2023Updated 3 years ago
- Semantic Web Memory for Intelligent Agents☆20Jul 12, 2026Updated 3 months ago
- A fast batching API to serve LLM models☆188Apr 26, 2024Updated 2 years ago
- A dynamic compression method that selects consecutive layers from top to bottom using a pre-defined similarity threshold, and compacts pa…☆12Dec 4, 2025Updated 10 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Offline tool that processes YouTube videos using WhisperX for automatic transcription and speaker diarization, detects logical fallacies,…☆29Aug 14, 2024Updated 2 years ago
- ☆31Mar 26, 2025Updated last year
- Categorize credit card transactions using a local large language model similar to GPT3☆15Dec 29, 2023Updated 2 years ago
- A full-stack document management and AI chat application that enables users to upload, manage, and chat with their documents using AI. Bu…☆16Aug 10, 2025Updated last year
- ☆24Dec 29, 2025Updated 10 months ago
- an auto-sleeping and -waking framework around llama.cpp☆13Feb 8, 2025Updated last year
- GoalChain for goal-orientated LLM conversation flows☆71Dec 2, 2024Updated last year
- Hierarchical RAG architecture scaling to 693K chunks on consumer hardware (4GB VRAM). Features 3-address routing, hybrid vector+graph fus…☆40Feb 11, 2026Updated 8 months ago
- A repository to store helpful information and emerging insights in regard to LLMs☆21Oct 27, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Paste a story, get a film. A ComfyUI node pack that plans a story into shots, casts it with Krea2 reference sheets, and renders it with M…☆21Aug 29, 2026Updated 2 months ago
- This is an LLM interface that you can use to analyze and get insight into diary entries or other documents completely offline.☆16Dec 31, 2023Updated 2 years ago
- ☆11Oct 18, 2026Updated 2 weeks ago
- Embed widgets in your Notion pages easily☆17Oct 31, 2024Updated 2 years ago
- Playing with CSM☆23Mar 14, 2025Updated last year
- ☆23Jun 1, 2024Updated 2 years ago
- A visual library for exploring and comparing Krea 2 prompt styles across base prompt scenes, generated locally with ComfyUI.☆17Oct 11, 2026Updated 3 weeks ago
- Talk to your data. Instantly analyze, visualize, and transform☆22Oct 30, 2025Updated last year
- Enter, track, cherish. Look back at your best moments with Memory. iOS-first mood tracker & diary app built using React Native, React Nav…☆13Oct 20, 2022Updated 4 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Streamlit app presented to the Streamlit LLMs Hackathon September 23☆15May 13, 2024Updated 2 years ago
- 쿠팡이츠 사조! 쿠팡 주식 사조!☆10Dec 4, 2021Updated 4 years ago
- Supporting code for "LLMs for your iPhone: Whole-Tensor 4 Bit Quantization"☆11Mar 31, 2024Updated 2 years ago
- Crow is a Desktop AI Assistant☆32Aug 9, 2024Updated 2 years ago
- ☆10Jul 21, 2017Updated 9 years ago
- DeepFloyd IF web UI☆30May 7, 2023Updated 3 years ago
- Code example of how to call your OpenAI assistant via API (Python).☆25Dec 23, 2023Updated 2 years ago
- ☆11Apr 5, 2023Updated 3 years ago
- ☆17May 10, 2026Updated 5 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆16Dec 16, 2024Updated last year
- O'Reilly Course, In-Memory Computing Essentials☆10Oct 16, 2020Updated 6 years ago
- Python based voice assistant using the ChatGPT API☆12Sep 20, 2023Updated 3 years ago
- Adding a multi-text multi-speaker script (diffe) that is based on a script from asiff00 on issue 61 for Sesame: A Conversational Speech G…☆26Mar 28, 2025Updated last year
- A Laravel wrapper for apex charts☆12Jul 24, 2026Updated 3 months ago
- e2e encrypted secret sharing via p2p exchanges & embedded vaults☆12Oct 3, 2026Updated 3 weeks ago
- [WACV 2026] Mobile-Oriented Video Diffusion: Enabling Text-to-Video Generation on Mobile Devices Without Retraining, Compression, or Prun…☆11Feb 19, 2026Updated 8 months ago