DeepInfer: High-performance, large-scale inference framework for DeepSeek models
☆18,426Oct 21, 2026Updated this week
Alternatives and similar repositories for DeepInfer
Users that are interested in DeepInfer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆1,908Updated this week
- DeepSeek Harness: Everything is a Plugin.☆252,921Updated this week
- Reverse engineer anything with agents, from app behavior down to native binaries.☆366,239Updated this week
- ☆16,886Oct 14, 2026Updated last week
- MoonEP: A Perfectly Balanced Expert Parallelism Library via Dynamic Redundant Experts☆1,189Oct 12, 2026Updated last week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on loca…☆30,418Updated this week
- 《深入理解 AI Infra：量化分析与系统设计》（李博杰 著）开源书稿：从硬件约束和模型架构出发，量化推导 LLM 推理与训练系统设计。含全书正文、PDF、配套计算工具与实验☆6,826Oct 1, 2026Updated 3 weeks ago
- ☆15,333Oct 12, 2026Updated last week
- DeepSelect: TopK kernels for DeepSeek Sparse Attention (DSA) and Samplers☆495Sep 30, 2026Updated 3 weeks ago
- SpaceXAI's coding agent harness and TUI. Fullscreen, mouse interactive, extensible.☆27,485Sep 29, 2026Updated 3 weeks ago
- SGLang is a high-performance serving framework for large language models and multimodal models.☆37,616Updated this week
- DeepGEMM-Ascend: clean and efficient matrix multiplication kernel library for Huawei Ascend NPUs☆607Oct 14, 2026Updated last week
- Official SGLang x Datawhale course on LLM inference: understand inference, build a mini-sglang from scratch, then read the real SGLang so…☆1,550Updated this week
- Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels☆8,725Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- TokenSpeed is a speed-of-light LLM inference engine.☆2,754Updated this week
- Z.ai's coding agent harness. Powerful, intelligent, extensible.☆8,075Updated this week
- Open Frontier Intelligence☆8,947Aug 6, 2026Updated 2 months ago
- Non-autoregressive System 1 decision engine. Typed choice, score and yes/no decisions over any text in a single forward pass, in 100+ lan…☆33,341Updated this week
- AI agent toolkit: unified LLM API, agent loop, TUI, coding agent CLI☆116,215Updated this week
- AgentENV (AENV) is a distributed platform for running agent environments at scale.☆3,652Updated this week
- A high-performance communication library for machine learning training and inference on Huawei Ascend NPUs.☆269Sep 30, 2026Updated 3 weeks ago
- A lightweight library for xPU kernel JIT compilation☆422Updated this week
- Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.☆6,865Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Every agent's model. One place. Codex on DeepSeek, Claude Code on Kimi, from the menu bar.☆18,730Updated this week
- Meta-Framework of Spatiotemporal Composability☆9,314Updated this week
- Tile-Based Runtime for Ultra-Low-Latency LLM Inference☆1,874Sep 24, 2026Updated 3 weeks ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆94,958Updated this week
- Kernel Design Agents (KDA) is a agent-centric workflow to write high-performance CUDA Kernels.☆1,431Updated this week
- DeepGEMM: clean and efficient BLAS kernel library on GPU☆9,074Updated this week
- Agent Executor (AX) is Google's open agentic orchestration runtime☆14,025Updated this week
- slime is an LLM training framework for RL Scaling.☆8,718Updated this week
- Lightweight coding agent that runs in your terminal☆130,349Updated this week
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- A self-improving RLM agent for coding workflows and long-running autonomous tasks.☆22,265Updated this week
- FlashInfer: Kernel Library for LLM Serving☆6,744Updated this week
- DeepSpec: a full-stack codebase for training and evaluating speculative decoding algorithms☆7,243Jul 9, 2026Updated 3 months ago
- Miles is an enterprise-facing reinforcement learning framework for LLM and VLM post-training, forked from and co-evolving with slime.☆3,182Updated this week
- Algorithm powering the For You feed on X☆33,714Updated this week
- FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.☆14,678Updated this week
- DeepEP: an efficient expert-parallel communication library☆10,334Updated this week