vllm-project / vllm-ascendLinks
Community maintained hardware plugin for vLLM on Ascend
☆1,022Updated this week
Alternatives and similar repositories for vllm-ascend
Users that are interested in vllm-ascend are comparing it to the libraries listed below
Sorting:
- A streamlined and customizable framework for efficient large model evaluation and performance benchmarking☆1,502Updated last week
- High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.☆1,243Updated this week
- The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.☆1,298Updated last week
- RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.☆838Updated 3 weeks ago
- FlagScale is a large model toolkit based on open-sourced projects.☆346Updated this week
- Ascend PyTorch adapter (torch_npu). Mirror of https://gitee.com/ascend/pytorch☆410Updated this week
- Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.☆3,768Updated last week
- 一种任务级GPU算力分时调度的高性能深度学习训练平台