intelligent-machine-learning / dlroverLinks
DLRover: An Automatic Distributed Deep Learning System
☆1,552Updated this week
Alternatives and similar repositories for dlrover
Users that are interested in dlrover are comparing it to the libraries listed below
Sorting:
- RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.☆851Updated last week
- A PyTorch Native LLM Training Framework☆865Updated last week
- 一种任务级GPU算力 分时调度的高性能深度学习训练平台☆696Updated last year
- The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.☆1,347Updated this week
- FlagPerf is an open-source software platform for benchmarking AI chips.☆350Updated last month
- Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.☆3,967Updated this week
- Community maintained hardware plugin for vLLM on Ascend☆1,128Updated this week
- GLake: optimizing GPU memory management and IO transmission.☆480Updated 5 months ago
- ☆497Updated last week
- A highly optimized LLM inference acceleration engine for Llama and its variants.☆900Updated 2 months ago
- A fast communication-overlapping library for tensor/expert parallelism on GPUs.☆1,114Updated 3 weeks ago
- FlagScale is a large model toolkit based on open-sourced projects.☆353Updated last week
- Disaggregated serving system for Large Language Models (LLMs).☆687Updated 5 months ago
- Ongoing research training transformer language models at scale, including: BERT & GPT-2☆2,161Updated last month
- Best practice for training LLaMA models in Megatron-LM☆661Updated last year
- FlashInfer: Kernel Library for LLM Serving☆3,761Updated this week
- A self-learning tutorail for CUDA High Performance Programing.☆735Updated 2 months ago
- NCCL Tests☆1,265Updated 2 weeks ago
- AI 基础知识 - GPU 架构、CUDA 编程、大模型基础及AI Agent 相关知识☆464Updated this week
- Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.☆268Updated 2 years ago
- Distributed RL System for LLM Reasoning☆2,614Updated this week
- Materials for learning SGLang☆572Updated 2 weeks ago
- My learning notes/codes for ML SYS.☆3,632Updated this week
- Ascend PyTorch adapter (torch_npu). Mirror of https://gitee.com/ascend/pytorch☆432Updated last week
- how to optimize some algorithm in cuda.☆2,473Updated this week
- FlagGems is an operator library for large language models implemented in the Triton Language.☆677Updated this week
- xDiT: A Scalable Inference Engine for Diffusion Transformers (DiTs) with Massive Parallelism☆2,279Updated this week
- Efficient and easy multi-instance LLM serving☆484Updated 2 weeks ago
- High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.☆1,278Updated this week
- Distributed Compiler based on Triton for Parallel Systems☆1,125Updated this week