deepseek-ai / open-infra-indexLinks
Production-tested AI infrastructure tools for efficient AGI development and community-driven innovation
☆7,904Updated 3 months ago
Alternatives and similar repositories for open-infra-index
Users that are interested in open-infra-index are comparing it to the libraries listed below
Sorting:
- DeepEP: an efficient expert-parallel communication library☆8,446Updated this week
- DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling☆5,654Updated this week
- A bidirectional pipeline parallelism algorithm for computation-communication overlap in V3/R1 training.☆2,856Updated 5 months ago
- FlashMLA: Efficient MLA kernels☆11,715Updated this week
- Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.☆3,846Updated this week
- A Datacenter Scale Distributed Inference Serving Framework☆4,841Updated this week
- SGLang is a fast serving framework for large language models and vision language models.☆17,106Updated this week
- A high-performance distributed file system designed to address the challenges of AI training and inference workloads.☆9,261Updated this week
- Expert Parallelism Load Balancer☆1,255Updated 5 months ago
- Analyze computation-communication overlap in V3/R1.☆1,096Updated 5 months ago
- FlashInfer: Kernel Library for LLM Serving☆3,618Updated this week
- Nano vLLM☆5,989Updated 2 months ago
- A lightweight data processing framework built on DuckDB and 3FS.☆4,769Updated 5 months ago
- A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations☆14,902Updated 3 weeks ago
- My learning notes/codes for ML SYS.☆3,451Updated this week
- MoBA: Mixture of Block Attention for Long-Context LLMs☆1,878Updated 4 months ago
- Democratizing Reinforcement Learning for LLMs☆4,074Updated last week
- verl: Volcano Engine Reinforcement Learning for LLMs☆12,563Updated last week
- Qwen3 is the large language model series developed by Qwen team, Alibaba Cloud.☆24,200Updated 3 weeks ago
- LMDeploy is a toolkit for compressing, deploying, and serving LLMs.☆6,920Updated this week
- The official repo of MiniMax-Text-01 and MiniMax-VL-01, large-language-model & vision-language-model based on Linear Attention☆3,128Updated last month
- Distributed RL System for LLM Reasoning☆2,507Updated this week
- 📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉☆4,424Updated last week
- LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalabili…☆3,559Updated this week
- ☆3,464Updated 5 months ago
- DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model☆4,935Updated 11 months ago
- Simple RL training for reasoning☆3,728Updated 3 weeks ago
- DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understanding☆5,026Updated 6 months ago
- TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and support state-of-the-art optimizati…☆11,437Updated this week
- vLLM’s reference system for K8S-native cluster-wide deployment with community-driven performance optimization☆1,722Updated this week