☆24Dec 29, 2025Updated 7 months ago
Alternatives and similar repositories for vllm-distributed
Users that are interested in vllm-distributed are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A physics-grounded, cost-aware optimization loop for vLLM☆60Updated this week
- Vibe Coded Project Management System☆21Apr 19, 2025Updated last year
- ☆34Jul 19, 2026Updated 3 weeks ago
- Optimized vLLM setup for Qwen3.6-27B-FP8 on dual RTX PRO 6000 Blackwell (192 GB GDDR7, no NVLink) ; config, benchmark sweep results, and …☆17May 10, 2026Updated 2 months ago
- Your universal AI text processor, powered by local and cloud LLMs. Edit, refactor, and transform text in any application on Windows, macO…☆75Nov 9, 2025Updated 9 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- A browser extension to automatically extract and batch-copy transcripts from Udemy videos. Perfect for students and learners who use note…☆19Jun 14, 2026Updated last month
- Make Qwen3 Think like Gemini 2.5 Pro | Open webui function☆25May 10, 2025Updated last year
- Production-ready Python library for multi-provider LLM orchestration☆42Jul 21, 2026Updated 2 weeks ago
- ☆20Apr 27, 2026Updated 3 months ago
- Automatically updated manifest for Ambient Music Mod☆22Updated this week
- ☆84Feb 28, 2025Updated last year
- Mixed-vendor GPU inference cluster manager with speculative decoding☆31Jul 2, 2026Updated last month
- audiobook GUI for chatterbox☆39Jul 26, 2025Updated last year
- Serving LLMs in the HF-Transformers format via a PyFlask API☆72Sep 10, 2024Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆24Jan 22, 2025Updated last year
- ShellX — desktop AI workspace for Grok Build, Claude Code, Codex, and Antigravity across Windows, macOS, WSL, and SSH. Includes a private…☆16Updated this week
- Local & Private LLM that drafts responses LIKE you automatically☆87Nov 18, 2024Updated last year
- A highly optimized engine for maya-1 tts model to generate minutes of audio in seconds.☆67Nov 17, 2025Updated 8 months ago
- Crow is a Desktop AI Assistant☆33Aug 9, 2024Updated 2 years ago
- A simple frontend page to interact with an OpenAI like API☆17Jan 31, 2025Updated last year
- APEX defines how AI agents communicate with brokers, exchanges, dealers, and other execution venues. One protocol. Realtime state. Autono…☆16Jul 23, 2026Updated 2 weeks ago
- A multi-provider AI coding agent with the persona of a Tech-Priest☆18Nov 1, 2025Updated 9 months ago
- Use any AI model, locally or in the cloud, while tracking on-device token usage and collecting token telemetry data.☆18Jul 31, 2026Updated last week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Developing K - a language model to generate OPENSCAD code from prompt☆19Dec 3, 2025Updated 8 months ago
- OpenPipe Reinforcement Learning Experiments☆34Mar 14, 2025Updated last year
- XETBook, a free version of Bembo☆16Apr 25, 2026Updated 3 months ago
- Node.js (ESM) service that polls Gmail, sends each new email to a local OpenAI-compatible LLM, and optionally forwards summarized mobile …☆26Feb 23, 2026Updated 5 months ago
- A news based stock scalper using LLM and quant approach☆15Jan 16, 2025Updated last year
- Rules-based file management for macOS☆14Updated this week
- ☆39Nov 10, 2025Updated 8 months ago
- Open source tool for transcirption and subtitling, alternative to happyscribe.☆36Feb 12, 2025Updated last year
- A Keras-based recommendation engine for subreddits, channels on the popular social media site Reddit☆10Feb 24, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- One script to replace every outdated tool that Apple ships on macOS with modern versions via Homebrew☆16Jul 18, 2026Updated 3 weeks ago
- TWX Proxy - an advanced gamplay helper for TradeWars 2002☆14Jun 19, 2018Updated 8 years ago
- Ixmage component for Astro☆13Jun 4, 2022Updated 4 years ago
- Get information about your Battery☆12Aug 4, 2021Updated 5 years ago
- This project is distributed as a free Unreal Engine Plugin. It consists in a single c++ actor component that handles the playback of anim…☆13Mar 10, 2024Updated 2 years ago
- TUI for LM Studio☆17Oct 19, 2025Updated 9 months ago
- A production-ready FastAPI wrapper for SearXNG that provides LLM-friendly search and web content extraction capabilities.☆18Dec 16, 2025Updated 7 months ago