Stateful API logic for agentic applications using vLLM
☆357Nov 19, 2026Updated this week
Alternatives and similar repositories for agentic-api
Users that are interested in agentic-api are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Performance benchmark & accuracy evaluation for vLLM☆19Updated this week
- Asynchronous Processor for Inference Gateway. Orchestrator of queues☆16Updated this week
- AI Gateway☆45Updated this week
- ☆21Updated this week
- llm-d Router: The intelligent entry point for inference requests☆471Updated this week
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- A high-performance and light-weight router for vLLM large scale deployment☆527Updated this week
- State of the art inference performance with modern accelerators on Kubernetes☆5,310Updated this week
- Agent skills for vLLM☆105Apr 3, 2026Updated 7 months ago
- llm-d-batch-gateway is a standalone, backend-agnostic, OpenAI-compatible batch API and processing engine☆28Updated this week
- Copilot of JiusiServe sub repos☆19Updated this week
- Incubating P/D sidecar for llm-d☆17Nov 13, 2025Updated last year
- Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini &…☆732Updated this week
- LMCache: Supercharge Your LLM with the Fastest KV Cache Layer☆12,398Updated this week
- An LLM post-training framework with vLLM for RL Scaling☆506Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Distributed KV cache scheduling & offloading libraries☆197Updated this week
- ☆16Mar 20, 2026Updated 8 months ago
- Early-stage Rust drop-in alternative frontend for vLLM☆73May 22, 2026Updated 5 months ago
- vLLM’s reference system for K8S-native cluster-wide deployment with community-driven performance optimization☆2,731Nov 7, 2026Updated last week
- llm-d benchmark scripts and tooling☆79Updated this week
- NVIDIA Inference Xfer Library (NIXL)☆1,371Updated this week
- A framework for efficient model inference with omni-modality models☆7,848Updated this week
- A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM☆967Updated this week
- Model Express is a Rust-based component meant to be placed next to existing model inference systems to speed up their startup times and i…☆205Updated this week
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- An external provider for Llama Stack allowing for the use of RamaLama for inference.☆22Dec 22, 2025Updated 10 months ago
- Gateway API Inference Extension☆806Nov 9, 2026Updated last week
- TokenSpeed is a speed-of-light LLM inference engine.☆2,941Updated this week
- AI and cloud-native proxy server and framework☆113Updated this week
- ☆29Nov 12, 2026Updated last week
- High-performance OpenAI and Anthropic compatible omni-modality model inference server for Apple Silicon.☆27Oct 21, 2026Updated 3 weeks ago
- AI-native backend in a single binary: describe it, your agent builds supacraft.json over MCP, you get a REST API (SQLite, auth, files, cr…☆17Nov 13, 2026Updated last week
- Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs☆1,794Updated this week
- GPU Kernel Manager Operator☆12Nov 9, 2026Updated last week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆30Updated this week
- A Datacenter Scale Distributed Inference Serving Framework☆8,520Updated this week
- ☆77Updated this week
- This repo hosts code for vLLM CI & Performance Benchmark infrastructure.☆65Updated this week
- Local-first agent that drives Claude Code and Codex over ACP. Desktop app, git-URL plugins, A2A 1.0. MIT.☆19Updated this week
- GenAI inference performance benchmarking tool☆278Updated this week
- A scalable, agentic-first, and HuggingFace-native RL framework for research (9k lines).☆1,376Updated this week
Are these results useful?