☆103Oct 4, 2026Updated 2 weeks ago
Alternatives and similar repositories for vLLM_Inference_Engine
Users that are interested in vLLM_Inference_Engine are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Exploring GPU programming with CUDA from fundamentals to advanced kernels.☆88Updated this week
- 100 days of LLM inference engineering — daily posts, experiments, and visualizations☆1,860Apr 30, 2026Updated 5 months ago
- [ICML 2026]: Building Social World Models with Large Language Models☆36Aug 25, 2026Updated last month
- Learn LLM Inference Engineering step by step - from KV cache, PagedAttention, and continuous batching to vLLM, SGLang, and GPUs.☆366Oct 5, 2026Updated last week
- 🤪Cogifed version of Tencent (Hunyuan)'s Open-Source Lip-Sync Model HunyuanVideo-Avatar🫦☆11Jun 3, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Record desktop workflows once and compile them into reusable AI-agent skills for reliable replay.☆40Jul 10, 2026Updated 3 months ago
- a personal collection of my notes for ml sys☆126Updated this week
- Pi extension that adds CodeGraph-powered code intelligence tools to Pi Agent☆28Updated this week
- P2P support for nvidia consumer cards☆23Sep 5, 2026Updated last month
- 知乎 AI 蓝宝书 · 三册文稿（AI Infra / RL / 具身智能）☆104Sep 16, 2026Updated last month
- Official Project Page for KL-Regularized Policy Optimization (KLPO) (https://arxiv.org/abs/2610.08963)☆186Oct 10, 2026Updated last week
- Kernel Module that implements Paxos protocol☆12Oct 23, 2020Updated 5 years ago
- Framework for building, optimizing, and deploying AI agents as Effect services. Define an agent as a declarative blueprint. Run it agains…☆23Apr 13, 2026Updated 6 months ago
- A 10-week, 30-minutes-a-day roadmap for LLM inference serving and optimization. vLLM, SGLang, quantization, speculative decoding, benchma…☆993Aug 14, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆51Sep 1, 2026Updated last month
- Schema-first state machines for Effect. Define once, derive everywhere, break nothing.☆91Oct 3, 2026Updated 2 weeks ago
- Source reconstruction of 東方幻想郷 ～ Lotus Land Story☆33Updated this week
- fastest and secure Hypervisor☆12Mar 16, 2026Updated 7 months ago
- ☆60Sep 30, 2026Updated 2 weeks ago
- Mission control for parallel Claude Code & Codex sessions — a live grid of coding agents that glow when they need you, across multiple ac…☆26Jul 27, 2026Updated 2 months ago
- Pi package exposing ast-grep outline and structural search tools.☆27Jul 10, 2026Updated 3 months ago
- Reproducible refusal-subspace editing and TP=2 deployment of DeepSeek V4 Flash 0731 on two DGX Sparks☆90Aug 14, 2026Updated 2 months ago
- Memory-safe clean-room Redis reimplementation in Rust with strict/hardened compatibility modes, deterministic replication semantics, diff…☆28Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Hermes Agent proficiencies: shareable operating-attribute skills for human SOPs/playbooks, agent skill/tool-SOP building, safe publishing…☆35Jul 13, 2026Updated 3 months ago
- NFS MW, UG2 and Carbon online server emulator.☆58Oct 7, 2026Updated last week
- Resources and Discussions About Detection Engineering☆12Sep 28, 2022Updated 4 years ago
- Build a coding agent from scratch, one harness primitive at a time. 15 chapters (ch-00..ch-14), each green on two gates.☆79Aug 22, 2026Updated last month
- Useful Information☆21Updated this week
- Agent Skills for competitive GTM work - battlecards, win-loss, positioning, pricing, launches, deal prep and sales enablement. Installs i …☆82Oct 2, 2026Updated 2 weeks ago
- Open-source middleware for AI agents — catches mid-run failures,compresses stale context, and grows a reasoning library across runs. Any …☆24May 19, 2026Updated 4 months ago
- External agent-supervision system: detects runaway/compromised AI coding agents and terminates them via documented apoptosis protocol (co…☆38Jun 6, 2026Updated 4 months ago
- ☆13Jan 7, 2026Updated 9 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Convert sessions across harnesses to a unified trajectory format - designed to be consumed by agents (e.g. for memory formation, dreaming…☆278Sep 25, 2026Updated 3 weeks ago
- Grammarly for your terminal — underlines typos in Claude Code, Codex, Aider & any other terminal app☆36Oct 8, 2026Updated last week
- LLM Assisted Geology Descriptions of Arbitrary Locations = LAGDAL☆15Jun 23, 2024Updated 2 years ago
- Your Claude, ChatGPT and Gemini subscriptions as one fast API. A single Rust binary with OpenAI, Anthropic and Gemini compatible endpoint…☆38Updated this week
- No Postman, Just GetCat! 用 Rust + GPUI 打造的原生跨平台 HTTP 接口调试工具☆45Sep 16, 2026Updated last month
- Taming Stable Diffusion for Lip Sync!☆17Mar 18, 2025Updated last year
- A curated resource list for learning AI performance engineering, from GPU fundamentals to production inference.☆4,226Updated this week