MooreThreads / torch_musaLinks
torch_musa is an open source repository based on PyTorch, which can make full use of the super computing power of MooreThreads graphics cards.
☆431Updated 3 weeks ago
Alternatives and similar repositories for torch_musa
Users that are interested in torch_musa are comparing it to the libraries listed below
Sorting:
- a lightweight LLM model inference framework☆734Updated last year
- Ascend PyTorch adapter (torch_npu). Mirror of https://gitee.com/ascend/pytorch☆401Updated last week
- Machine learning compiler based on MLIR for Sophgo TPU.☆766Updated last week
- PaddlePaddle custom device implementaion. (『飞桨』自定义硬件接入实现)☆90Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆55Updated 9 months ago
- llm-export can export llm model to onnx.☆301Updated 6 months ago
- C++ implementation of Qwen-LM☆604Updated 8 months ago
- Run generative AI models in sophgo BM1684X/BM1688☆232Updated this week
- ☆477Updated this week
- MUSA Templates for Linear Algebra Subroutines☆30Updated 5 months ago
- ☆611Updated last year
- A CPU tool for benchmarking the peak of floating points☆557Updated last month
- Triton Documentation in Chinese Simplified / Triton 中文文档☆78Updated 3 months ago
- FlagGems is an operator library for large language models implemented in the Triton Language.☆640Updated this week
- optimized BERT transformer inference on NVIDIA GPU. https://arxiv.org/abs/2210.03052☆474Updated last year
- llm deploy project based mnn. This project has merged into MNN.☆1,601Updated 6 months ago
- ☆428Updated 2 weeks ago
- LLaMa/RWKV onnx models, quantization and testcase☆363Updated 2 years ago
- Efficient operation implementation based on the Cambricon Machine Learning Unit (MLU) .☆125Updated last week
- ☆48Updated last year
- MegCC是一个运行时超轻量,高效,移植简单的深度学习模型编译器☆486Updated 9 months ago
- Low-bit LLM inference on CPU/NPU with lookup table☆836Updated 2 months ago
- ☆246Updated last week
- DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …☆263Updated last week
- PyTorch Neural Network eXchange☆606Updated this week
- RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.☆830Updated last week
- export llama to onnx☆131Updated 7 months ago
- A model compilation solution for various hardware☆439Updated 2 weeks ago
- ☆139Updated last year
- ☆31Updated last week