HFAiLab / hai-platformLinks
一种任务级GPU算力分时调度的高性能深度学习训练平台
☆692Updated last year
Alternatives and similar repositories for hai-platform
Users that are interested in hai-platform are comparing it to the libraries listed below
Sorting:
- Community maintained hardware plugin for vLLM on Ascend☆1,048Updated this week
- RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.☆840Updated last month
- ☆485Updated 3 weeks ago
- FlagScale is a large model toolkit based on open-sourced projects.☆347Updated this week
- High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.☆1,245Updated this week
- Easy Parallel Library (EPL) is a general and efficient deep learning framework for distributed model training.☆267Updated 2 years ago
- DLRover: An Automatic Distributed Deep Learning System☆1,531Updated this week
- 配合 HAI Platform 使用的集成化用户界面☆53Updated 2 years ago
- LLM Inference benchmark☆426Updated last year
- DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …☆263Updated 3 weeks ago
- Ascend PyTorch adapter (torch_npu). Mirror of https://gitee.com/ascend/pytorch☆413Updated this week
- GLake: optimizing GPU memory management and IO transmission.☆477Updated 5 months ago
- ☆220Updated 2 years ago
- ☆172Updated this week
- A fast communication-overlapping library for tensor/expert parallelism on GPUs.☆1,085Updated last week
- The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.☆1,307Updated last week
- ☆54Updated this week
- ☆124Updated 6 months ago
- A PyTorch Native LLM Training Framework☆861Updated last month
- A streamlined and customizable framework for efficient large model evaluation and performance benchmarking☆1,576Updated this week
- OpenAIOS vGPU device plugin for Kubernetes is originated from the OpenAIOS project to virtualize GPU device memory, in order to allow app…☆570Updated last year
- Disaggregated serving system for Large Language Models (LLMs).☆675Updated 4 months ago
- A flexible and efficient training framework for large-scale alignment tasks☆415Updated this week
- FireFlyer Record file format, writer and reader for DL training samples.☆230Updated 2 years ago
- ☆427Updated last week
- Efficient and easy multi-instance LLM serving☆473Updated last week
- Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.☆3,846Updated this week
- vLLM Documentation in Chinese Simplified / vLLM 中文文档☆94Updated 2 weeks ago
- AI 基础知识 - GPU 架构、CUDA 编程、大模型基础及AI Agent 相关知识☆334Updated this week
- Transformer related optimization, including BERT, GPT☆39Updated 2 years ago