☆24Dec 29, 2025Updated 6 months ago
Alternatives and similar repositories for vllm-distributed
Users that are interested in vllm-distributed are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆57Feb 18, 2025Updated last year
- A physics-grounded, cost-aware optimizer for vLLM.☆52Updated this week
- Vibe Coded Project Management System☆21Apr 19, 2025Updated last year
- ☆32Jun 10, 2026Updated last month
- Llama.cpp runner/swapper and proxy that emulates LMStudio / Ollama backends☆60Aug 21, 2025Updated 10 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Optimized vLLM setup for Qwen3.6-27B-FP8 on dual RTX PRO 6000 Blackwell (192 GB GDDR7, no NVLink) ; config, benchmark sweep results, and …☆15May 10, 2026Updated 2 months ago
- Your universal AI text processor, powered by local and cloud LLMs. Edit, refactor, and transform text in any application on Windows, macO…☆75Nov 9, 2025Updated 8 months ago
- A browser extension to automatically extract and batch-copy transcripts from Udemy videos. Perfect for students and learners who use note…☆15Jun 14, 2026Updated last month
- Make Qwen3 Think like Gemini 2.5 Pro | Open webui function☆25May 10, 2025Updated last year
- Production-ready Python library for multi-provider LLM orchestration☆42Jul 5, 2026Updated 2 weeks ago
- OpenPipe Reinforcement Learning Experiments☆34Mar 14, 2025Updated last year
- Automatically updated manifest for Ambient Music Mod☆21Updated this week
- Mixed-vendor GPU inference cluster manager with speculative decoding☆28Jul 2, 2026Updated 2 weeks ago
- ☆83Feb 28, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Asimov helps you build high performance LLM apps, written in Rust 🦀☆11Jun 28, 2024Updated 2 years ago
- Serving LLMs in the HF-Transformers format via a PyFlask API☆72Sep 10, 2024Updated last year
- Local & Private LLM that drafts responses LIKE you automatically☆87Nov 18, 2024Updated last year
- Crow is a Desktop AI Assistant☆33Aug 9, 2024Updated last year
- A highly optimized engine for maya-1 tts model to generate minutes of audio in seconds.☆66Nov 17, 2025Updated 8 months ago
- 4 bits quantization of LLaMa using GPTQ☆12Jun 2, 2023Updated 3 years ago
- Host LLM via text-generation-inference☆16Dec 5, 2023Updated 2 years ago
- APEX defines how AI agents communicate with brokers, exchanges, dealers, and other execution venues. One protocol. Realtime state. Autono…☆16May 31, 2026Updated last month
- Governed memory runtime for AI assistants: policy-before-storage, context admission, memory usage trace, deletion proof, leakage evals, a…☆15Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆39Nov 10, 2025Updated 8 months ago
- Open source tool for transcirption and subtitling, alternative to happyscribe.☆36Feb 12, 2025Updated last year
- Gen AI Hardening x Attack Suite☆17Jul 9, 2025Updated last year
- Enpass-to-Keepass converter. Digests an Enpass JSON export file and writes all entries (including attachments) to an existing Keepass fil…☆10Aug 5, 2025Updated 11 months ago
- Cast your video element to the big screen with ease!☆24May 8, 2024Updated 2 years ago
- Generate and validate license codes☆13Sep 24, 2022Updated 3 years ago
- A library for web scraping, inspired by MetaInspector☆11May 29, 2017Updated 9 years ago
- A multi App to download file from LibGen.io☆12Aug 5, 2019Updated 6 years ago
- ☆50Aug 12, 2025Updated 11 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Markify is an open source command line application written in python which scrapes data from your social media accounts and utilises mark…☆13Aug 8, 2024Updated last year
- A Processing Environment for Swift☆17Apr 30, 2022Updated 4 years ago
- TUI for LM Studio☆17Oct 19, 2025Updated 9 months ago
- ☆24Apr 25, 2025Updated last year
- A collection of LittleSnitch rule sets to block outbound connections to a given country.☆16Jun 13, 2023Updated 3 years ago
- ☆13Feb 18, 2024Updated 2 years ago
- A native macOS app that allows users to chat with a local LLM, based on FreeChat (https://github.com/psugihara/FreeChat). It adds the abi…☆17Sep 26, 2024Updated last year