The lowest-overhead LLM router. Production-ready, highly available, one OpenAI-compatible endpoint in front of 80 providers and your own vLLM/SGLang — 0.76 µs per request, no I/O on the request path, cache-affinity routing, RBAC, budgets and a 13-screen UI in the binary.
☆106Oct 18, 2026Updated this week
Alternatives and similar repositories for Fastllm-proxy
Users that are interested in Fastllm-proxy are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This Agent MCP allows you to train external intelligence with zero GPU and let you trade it at Tetrees EX☆300Oct 9, 2026Updated last week
- Deterministic firmware simulator for microcontrollers with hardware-validated parity. Labwired.com☆80Updated this week
- One Feishu bot, N users, N profiles. A hermes-agent plugin for multi-tenant routing.☆26Oct 8, 2026Updated last week
- Free interactive course on world models in AI. Nine visual chapters on prediction, latent dynamics, planning, JEPA, video models, and fai…☆205Aug 24, 2026Updated last month
- Open Lakehouse Compute Fabric: an open-source lakehouse platform with Microsoft Fabric Compute Extension.☆236Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Evidence-aware on-prem LLM inference sizing and TCO calculator☆113Aug 2, 2026Updated 2 months ago
- Private AI on premise☆247Updated this week
- ENGRAFT: write facts into an LLM's n-gram (Engram) memory table as a removable overlay: 100 facts in a 9 MB file, no weights touched, ver…☆56Sep 30, 2026Updated 2 weeks ago
- Prism: sandboxed, themed, interactive visualizations in Obsidian notes☆46Updated this week
- A free, self-paced 24-week AI engineering course: Python, machine learning, LLMs, RAG, fine-tuning, agents and MCP, Azure and Vertex and …☆318Aug 17, 2026Updated 2 months ago
- A full-stack document management and AI chat application that enables users to upload, manage, and chat with their documents using AI. Bu…☆16Aug 10, 2025Updated last year
- Quality gate for Agent Skills: lint, security audit, and Claude/Cursor/Codex/OpenCode compatibility.☆11Aug 16, 2026Updated 2 months ago
- Catch dangerous AI agent skills before they catch you. Zero-dependency security scanner for Agent Skills, SKILL.md and MCP configs.☆64Updated this week
- A browser in the agent's hand. 9 MCP tools, self-diagnosing verdicts, single Go binary.☆29Jul 24, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆31Oct 6, 2026Updated last week
- Bionic reading for Claude Code: bolds the leading part of each word in Claude's streamed replies so your eyes move faster. Zero dependenc…☆20Sep 28, 2026Updated 2 weeks ago
- Sync AI coding-agent configs (Claude Code, OpenCode, Codex, and more) from one canonical, committable source.☆37Updated this week
- OSINT knowledge base + MCP server for autonomous AI agents — Claude Code, Cursor, Kimi K3, recon & threat intel playbooks.☆36Oct 2, 2026Updated 2 weeks ago
- Agent skill that turns a short brief, screenshots or a repo into a directed motion-graphics MP4: it directs a concept, builds HTML/CSS sc…☆42Oct 10, 2026Updated last week
- A local-first database of your academic papers built to support arXiv papers and more☆60Oct 11, 2026Updated last week
- Account balancer plugin for opencode.☆52Jul 17, 2026Updated 3 months ago
- Local-first MCP memory server for AI agents, with source citations and OKF/Markdown knowledge bases.☆18Updated this week
- Free LLM gateway: 22 LLM providers, 178 enabled chat routes, 431 cataloged chat models; keyless start when available.☆127Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Browser automation for AI agents in your real, logged-in Chrome. You watch every action and can veto any tab. Chrome extension + zero-dep…☆14Updated this week
- On-Device Mobile Agent: Control your phone directly with Vision Language Models, untethered from any PC. 手机直接调用视觉大模型 ，无需连接电脑，让 AI 直接操作你的手…☆31Oct 6, 2026Updated last week
- Open-source AI coding agent for your terminal — one Rust binary, 15+ LLM providers, 1,000+ models. A self-hostable Claude Code / Codex CL…☆148Jul 21, 2026Updated 2 months ago
- LangGraph Multi-Agent Handoffs, Clearly Explained☆13Dec 12, 2025Updated 10 months ago
- Build local-first desktop workflow tools with TypeScript, embedded SQLite, consent-scoped files, and native installers—without owning a R…☆27Updated this week
- Windows desktop console for llama.cpp runtimes, models, and local coding workflows☆132Updated this week
- macOS menu-bar meter for coding-agent subscription quotas☆30Sep 28, 2026Updated 2 weeks ago
- Free open-source Opus Clip alternative for ComfyUI — AI video clipping nodes that turn long-form videos / podcasts / interviews into rank…☆30Jul 21, 2026Updated 2 months ago
- This is a fork of SGLang for hip-attention integration. Please refer to hip-attention for detail.☆18Mar 31, 2026Updated 6 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- pure go for rwkv☆18Dec 31, 2023Updated 2 years ago
- a cross-agent memory system☆33Oct 5, 2026Updated last week
- A multi-provider, multi-agent orchestrator that organizes agents into a visual authority hierarchy.☆32Sep 10, 2026Updated last month
- ☆46Jul 22, 2026Updated 2 months ago
- Bidirectional sync for Claude Code and Codex — instructions, skills, agents, MCP servers, hooks, permissions.☆45Updated this week
- Put everything on your wallpaper. Terse is a live 3D particle wallpaper for macOS & Windows: synced song lyrics, notifications, window ti…☆73Oct 8, 2026Updated last week
- F24 SALES free AI model directory, verified LiteLLM routes, import tools and agent-assisted model research.☆52Updated this week