☆24Dec 29, 2025Updated 9 months ago
Alternatives and similar repositories for vllm-distributed
Users that are interested in vllm-distributed are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆18Jul 1, 2025Updated last year
- A physics-grounded, cost-aware optimization loop for vLLM☆68Aug 22, 2026Updated last month
- Vibe Coded Project Management System☆21Apr 19, 2025Updated last year
- Llama.cpp runner/swapper and proxy that emulates LMStudio / Ollama backends☆61Aug 21, 2025Updated last year
- Your universal AI text processor, powered by local and cloud LLMs. Edit, refactor, and transform text in any application on Windows, macO…☆75Nov 9, 2025Updated 10 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A browser extension to automatically extract and batch-copy transcripts from Udemy videos. Perfect for students and learners who use note…☆23Sep 28, 2026Updated last week
- Make Qwen3 Think like Gemini 2.5 Pro | Open webui function☆25May 10, 2025Updated last year
- Production-ready Python library for multi-provider LLM orchestration☆43Sep 24, 2026Updated 2 weeks ago
- ☆13Jan 12, 2022Updated 4 years ago
- ☆20Apr 27, 2026Updated 5 months ago
- Automatically updated manifest for Ambient Music Mod☆22Sep 29, 2026Updated last week
- Mixed-vendor GPU inference cluster manager with speculative decoding☆37Jul 2, 2026Updated 3 months ago
- Asimov helps you build high performance LLM apps, written in Rust 🦀☆11Jun 28, 2024Updated 2 years ago
- Serving LLMs in the HF-Transformers format via a PyFlask API☆70Sep 10, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆24Jan 22, 2025Updated last year
- Local & Private LLM that drafts responses LIKE you automatically☆87Nov 18, 2024Updated last year
- A highly optimized engine for maya-1 tts model to generate minutes of audio in seconds.☆65Nov 17, 2025Updated 10 months ago
- 4 bits quantization of LLaMa using GPTQ☆12Jun 2, 2023Updated 3 years ago
- A simple frontend page to interact with an OpenAI like API☆17Jan 31, 2025Updated last year
- Natural language control for Python CLI tools using locally-trained SLMs (CPU inference)☆33Sep 22, 2026Updated 2 weeks ago
- Host LLM via text-generation-inference☆16Dec 5, 2023Updated 2 years ago
- APEX defines how AI agents communicate with brokers, exchanges, dealers, and other execution venues. One protocol. Realtime state. Autono…☆16Jul 23, 2026Updated 2 months ago
- Developing K - a language model to generate OPENSCAD code from prompt☆19Dec 3, 2025Updated 10 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- OpenPipe Reinforcement Learning Experiments☆34Mar 14, 2025Updated last year
- Node.js (ESM) service that polls Gmail, sends each new email to a local OpenAI-compatible LLM, and optionally forwards summarized mobile …☆26Feb 23, 2026Updated 7 months ago
- A Model Context Protocol (MCP) server that provides AI assistants with secure, read-only access to your ShadowGit repositories. This enab…☆50Sep 11, 2025Updated last year
- ☆40Nov 10, 2025Updated 10 months ago
- A news based stock scalper using LLM and quant approach☆15Jan 16, 2025Updated last year
- Task manager for macOS fully implemented in SwiftUI☆10Apr 28, 2020Updated 6 years ago
- Open source tool for transcirption and subtitling, alternative to happyscribe.☆37Feb 12, 2025Updated last year
- A Keras-based recommendation engine for subreddits, channels on the popular social media site Reddit☆10Feb 24, 2024Updated 2 years ago
- Generate and validate license codes☆13Sep 24, 2022Updated 4 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- One script to replace every outdated tool that Apple ships on macOS with modern versions via Homebrew☆16Jul 18, 2026Updated 2 months ago
- DNS-Blocklists: For a better internet - keep the internet clean!☆10Oct 2, 2026Updated last week
- A modular framework for building massively parallel agentic systems☆34Sep 8, 2025Updated last year
- A Windows 98 clone created entirely with SwiftUI framework with drag gestures, borders, animations, windows, states and a myriad of featu…☆14Aug 12, 2020Updated 6 years ago
- TUI for LM Studio☆17Oct 19, 2025Updated 11 months ago
- A production-ready FastAPI wrapper for SearXNG that provides LLM-friendly search and web content extraction capabilities.☆20Dec 16, 2025Updated 9 months ago
- A Processing Environment for Swift☆17Apr 30, 2022Updated 4 years ago