HFAiLab / hai-platformLinks
一种任务级GPU算力分时调度的高性能深度学习训练平台
☆675Updated last year
Alternatives and similar repositories for hai-platform
Users that are interested in hai-platform are comparing it to the libraries listed below
Sorting:
- RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.☆830Updated last week
- Community maintained hardware plugin for vLLM on Ascend☆946Updated last week
- ☆477Updated this week
- FlagScale is a large model toolkit based on open-sourced projects.☆336Updated this week
- GLake: optimizing GPU memory management and IO transmission.☆471Updated 4 months ago
- DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …☆263Updated last week
- High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.☆1,186Updated this week
- Ascend PyTorch adapter (torch_npu). Mirror of https://gitee.com/ascend/pytorch☆401Updated last week
- ☆172Updated this week
- 配合 HAI Platform 使用的集成化用户界面☆52Updated 2 years ago
- LLM Inference benchmark☆424Updated last year
- DLRover: An Automatic Distributed Deep Learning System☆1,515Updated last week
- Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.☆267Updated 2 years ago
- The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.☆1,269Updated last week
- ☆220Updated last year
- A streamlined and customizable framework for efficient large model evaluation and performance benchmarking☆1,427Updated this week
- ☆124Updated 5 months ago
- A fast communication-overlapping library for tensor/expert parallelism on GPUs.☆1,054Updated last week
- ☆52Updated this week
- ☆31Updated 2 years ago
- A PyTorch Native LLM Training Framework☆839Updated 3 weeks ago
- Materials for learning SGLang☆522Updated 2 weeks ago
- FlagPerf is an open-source software platform for benchmarking AI chips.☆344Updated last week
- AI 基础知识 - GPU 架构、CUDA 编程、大模型基础及AI Agent 相关知识☆203Updated this week
- Disaggregated serving system for Large Language Models (LLMs).☆659Updated 4 months ago
- Best practice for training LLaMA models in Megatron-LM☆659Updated last year
- ☆277Updated 2 years ago
- Efficient and easy multi-instance LLM serving☆458Updated this week
- 中文版 llm-numbers☆122Updated last year
- Efficient AI Inference & Serving☆472Updated last year