Bringing thousands of learners together to unpack DeepInfer through peer-reviewed explanations, documentation, and hands-on examples.
☆150Oct 22, 2026Updated 3 weeks ago
Alternatives and similar repositories for deepinfer-unpacked
Users that are interested in deepinfer-unpacked are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 从零开始学习AI Infra相关内容☆90Updated this week
- Lightweight LLM inference engine inspired by nano-vllm, with radix-tree based prefix cache, tp & pp, cuda graph, openai api, async schedu…☆17Mar 29, 2026Updated 7 months ago
- ☆230Sep 29, 2026Updated last month
- DeepInfer: High-performance, large-scale inference framework for DeepSeek models☆26,009Nov 3, 2026Updated last week
- AI Infra 全栈从0入门学习资料：https://caomaolufei.github.io/AIInfraGuide/☆3,290Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A case study of quantitative modeling for beginners.☆26Jan 26, 2026Updated 9 months ago
- Magpie plugin with live free-model catalogs for OpenCode Zen and Kilo Gateway, including native Jev System One support.☆15Oct 19, 2026Updated 3 weeks ago
- Based on Nano-vLLM, a simple replication of vLLM with self-contained paged attention and flash attention implementation☆1,108Aug 29, 2026Updated 2 months ago
- Official repository for the paper DynaPipe: Optimizing Multi-task Training through Dynamic Pipelines☆20Dec 8, 2023Updated 2 years ago
- ☆35Updated this week
- Exact LLM inference engine written from scratch for AMD Strix Halo (gfx1151, ROCm/HIP). Qwen3.8-Flash-Next on one node or two replicas; D…☆24Updated this week
- 以斯坦福公开课 CS 336 为基底，零基础手搓大模型☆31Nov 5, 2026Updated last week
- vue+element-ui兼职招聘系统学生用户前端☆10Dec 10, 2022Updated 3 years ago
- 宝藏问题：汇总了大模型的重要资源，整理了宝藏问题手稿，宝藏论文参考文献☆397Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- 北京大学未名超算队与北京大学学生 Linux 俱乐部合办的暑期 AI Infra 系列活动仓库☆256Aug 22, 2026Updated 2 months ago
- Implement a Pytorch-like DL library in C++ from scratch, step by step☆402Apr 15, 2026Updated 7 months ago
- Official SGLang x Datawhale course on LLM inference: understand inference, build a mini-sglang from scratch, then read the real SGLang so…☆2,128Updated this week
- DSH 插件开发踩坑与做法档案（skill + 文档）：cordis 双副本、tsconfig 三件套、Windows junction、多帧 zstd 等实测记录☆17Sep 10, 2026Updated 2 months ago
- BUAA Computer Organization (2026) | Lab assignments, past exam problems, solutions, and tips.☆45Updated this week
- Models Take Notes at Prefill: KV Cache Can Be Editable and Composable (arXiv:2606.17107) — paper, code, results, and interactive companio…☆16Updated this week
- 循序渐进学习LLM：基础篇入门原理，进阶篇源码解析☆14Nov 9, 2025Updated last year
- 把 B 站长视频和系列网课，一键变成能直接当教材读的深度长文与备考笔记☆41Nov 3, 2026Updated last week
- ☆17Apr 23, 2026Updated 6 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A sparse-first inference engine (SparseEngine).☆109Updated this week
- ☆14Jun 26, 2022Updated 4 years ago
- 🚀 First survey bridging LLM, RL, and Agentic Eras — 100+ papers on efficient inference from static generation to systematic reasoning an…☆16May 13, 2026Updated 6 months ago
- 从0到1学习多模态推理框架☆26Jul 30, 2026Updated 3 months ago
- 新一代智能工业/科研平台☆22Aug 17, 2026Updated 2 months ago
- 灵茶山艾府（@endlesscheng）LeetCode Hot100 题解整理：Python 代码 + 思路 + 套路模板手册☆27Sep 14, 2026Updated 2 months ago
- Run Qwen3.8-Flash-Next on one AMD Strix Halo (Ryzen AI Max+ 395, gfx1151). EXL3 4.05 and 3.05 bpw packs, own ROCm/HIP kernels, OpenAI-com…☆21Updated this week
- [IEEE RA-L&ICRA2025] Think Step by Step: Chain-of-Gesture Prompting for Error Detection in Robotic Surgical Videos☆15Aug 26, 2025Updated last year
- 基于企业微信的恋陪Agent☆15Apr 8, 2026Updated 7 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- hpc 教程，包含集合通信(mpi、nccl)、cuda 编程、向量化 SIMD、RDMA 通信等☆790Apr 27, 2026Updated 6 months ago
- cs336 spring 2026 assignment1，已通过所有测试点☆17May 27, 2026Updated 5 months ago
- 一个用于共享《Mathematical Foundations of Reinforcement Learning》的中文翻译版本的仓库☆19Dec 26, 2025Updated 10 months ago
- how to optimize some algorithm in cuda.☆3,350Nov 2, 2026Updated last week
- A local-LLM privacy layer for anything you paste into a cloud model — detect, tokenize, restore. Zero deps, reversible, strong on Chinese…☆26Jul 2, 2026Updated 4 months ago
- 斯坦福 CS329Z《Engineering AI Agents》中文学习站 · 35 篇论文逐段中英对照全译(2035 段/45 万字)+ 14 篇博客规范全译 + 讲义同步 | 在线阅读 cs.xuyili.com☆44Updated this week
- DeerFlow 面试学习指南 - Hyper-Agent Framework 深度解析☆22Apr 18, 2026Updated 6 months ago
Are these results useful?