Learn LLM Inference Engineering step by step - from KV cache, PagedAttention, and continuous batching to vLLM, SGLang, and GPUs.
☆347Oct 5, 2026Updated last week
Alternatives and similar repositories for llm-inference-engineering
Users that are interested in llm-inference-engineering are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- AI Engineer Roadmap - A step-by-step AI Engineering roadmap to become an AI Engineer, with a blog for every topic.☆261Updated this week
- Next-Generation AI agent platform for autonomous software engineering with intelligent orchestration, persistent memory, Knowledge Graph,…☆18Updated this week
- Deep, Evolving Environments for Computer-Use Agents☆41Oct 9, 2026Updated last week
- Claude's Tokenizer, Offline, Kinda☆83Sep 25, 2026Updated 3 weeks ago
- MoJev: typed, calibrated decisions in one forward pass.☆29Sep 23, 2026Updated 3 weeks ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- NCM: Next Concept Modeling☆77Updated this week
- AI System Design - Learn how to design AI systems built on LLMs, RAG, and AI Agents step by step.☆688Updated this week
- One catalog for every CLI tool on your Mac: native app plus a JSON-friendly CLI for AI agents☆45Oct 8, 2026Updated last week
- Local VS Code search across Claude Code, Codex, and OpenCode chats with Laya reranking☆67Sep 25, 2026Updated 3 weeks ago
- verl/HybridFlow: A Flexible and Efficient RL Post-Training Framework☆713Sep 26, 2026Updated 3 weeks ago
- ☆120Oct 7, 2026Updated last week
- FLUX 3 Action: open weights 7B world action model from Black Forest Labs. Train, fine-tune and run action prediction for robots (DROID, S…☆184Updated this week
- Centrally manage AI-agent skills, tools, context, permissions, and identity across your entire org. Self-hosted, Git-backed and MCP-nativ…☆115Updated this week
- ☆17Jan 7, 2026Updated 9 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A framework for building robust RL environments to train aligned AI.☆143Updated this week
- Hand off tasks to Devin — a plugin/skill for Claude Code, Codex, Cursor, and any coding agent☆74Jul 19, 2026Updated 2 months ago
- Durable, named agents for Pi: delegate tasks, compose agents into graphs, and watch them work.☆63Updated this week
- Pinned one-DGX-Spark Docker recipe for DeepSeek V4 Flash with EXL3, SparkInfer, and 262K NVFP4 MLA KV cache☆166Sep 3, 2026Updated last month
- AI Engineering Course - A free and complete AI Engineering Course to learn AI Engineering step by step - from Machine Learning, Neural Ne…☆537Updated this week
- Making sure your context is clean.☆84Oct 11, 2026Updated last week
- Hierarchical, steerable subagent threads for pi☆111Updated this week
- PorTAL generates portable task specific LoRA adapters that can efficiently transfer across language models.☆126Jul 27, 2026Updated 2 months ago
- Official repo for MAI-Code models, where we publish MAI-Code model releases and updates and engage with developer community on issues and…☆74Aug 11, 2026Updated 2 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Native macOS execution layer for Maka Computer Use. Forked from iFurySt/open-codex-computer-use (MIT).☆47Sep 2, 2026Updated last month
- MVVM News Architecture using Kotlin, Dagger2, Retrofit, Coroutines, Flow, Room, and many more.☆13Jan 21, 2024Updated 2 years ago
- ☆241Oct 4, 2026Updated last week
- The harness interoperability layer for coding agent. Agent to Agent connect over ACP, A2A and UHP☆61Updated this week
- Deterministic multi-agent workflow orchestration and codemode scripts for Pi☆246Updated this week
- Agent skill that mines your repo's history to draft a VISION.md, stress-tests it with hard hypotheticals, and iterates with you on an int…☆332Sep 2, 2026Updated last month
- My personal web site was also made using just Stencil from @ionic-team, it is also a PWA.☆10Sep 25, 2026Updated 3 weeks ago
- Real browser automation with local GLiNER2 inference and open weights. Work in progress. Contributions welcome.☆80Sep 18, 2026Updated 3 weeks ago
- Typed-decision models (noul / choice / score) trained by a self-improving loop of AI agents — checkpoints, the code that produced them, a…☆110Oct 10, 2026Updated last week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆12Jan 24, 2025Updated last year
- Single neuron simulator/ prediction benchmark; uses Hodgkin-Huxley with novel mechanisms☆47Aug 12, 2026Updated 2 months ago
- MAGI-2-preview: Scaling Video Generation Models Efficiently☆638Aug 6, 2026Updated 2 months ago
- Pluggable extension packages for the Pi AI-agent runtime. Each package exposes LLM-callable tools via MCP — covering IM workspace integra…☆82Updated this week
- OpenRouter Agent SDK☆33Sep 24, 2026Updated 3 weeks ago
- Keep private data, internal infrastructure and secrets out of cloud coding agents without breaking your workflow.☆56Oct 8, 2026Updated last week
- ☆10Mar 7, 2024Updated 2 years ago