yinghuo302 / ascend-llmLinks
基于昇腾310芯片的大语言模型部署
☆20Updated last year
Alternatives and similar repositories for ascend-llm
Users that are interested in ascend-llm are comparing it to the libraries listed below
Sorting:
- Deploying LLMs offline on the NVIDIA Jetson platform marks the dawn of a new era in embodied intelligence, where devices can function ind…☆98Updated last year
- ☆47Updated 8 months ago
- ☆387Updated last week
- A toolbox of yolo models and algorithms based on MindSpore☆136Updated this week
- ☆142Updated last year
- llm-export can export llm model to onnx.☆299Updated 5 months ago
- An onnx-based quantitation tool.☆71Updated last year
- Compare multiple optimization methods on triton to imporve model service performance☆52Updated last year
- Examples for SophonSDK☆105Updated 2 years ago
- Run generative AI models in sophgo BM1684X/BM1688☆224Updated last week
- ☆128Updated last year
- learning-cuda-trt☆113Updated 2 years ago
- ☆118Updated last month
- ☆41Updated last year
- Large Language Model Onnx Inference Framework☆36Updated 6 months ago
- rknn-3588部署yolov5，利用线程池实现npu推理加速；Deploying YOLOv5 on RKNN-3588, utilizing a thread pool to achieve NPU inference acceleration.☆73Updated 2 months ago
- yolov8n 部署版本，后处理用python语言和C++语言形式进行改写，便于移植不同平台（onnx、tensorRT、RKNN、Horzion）☆149Updated last year
- yolov11（yolov8）尝试了7种不同的部署方法，并对每种方法的优势进行了简单总结。不同的平台、不同的时耗或CPU占用需求，总有一种方法是适用的。针对想入门部署的也是一个很好的参考学习资料。☆30Updated 5 months ago
- The project is a multi-threaded inference demo of Yolo running on the RK3588 platform, which has been adapted for reading video files and…☆342Updated last month
- ☆46Updated 3 months ago
- yolov8 瑞芯微 rknn 板端 C++部署。☆109Updated last year
- 该代码与B站上的视频 https://www.bilibili.com/video/BV18L41197Uz/?spm_id_from=333.788&vd_source=eefa4b6e337f16d87d87c2c357db8ca7 相关联。☆69Updated last year
- A more efficient yolov5 with oneflow backend 🎉🎉🎉☆215Updated this week
- yolov11 的tensorRT C++ 部署，后处理使用cuda实现比较耗时的操作。☆39Updated 6 months ago
- Easy Training Official YOLOv11、YOLOv10、YOLOv8、YOLOv7、YOLOv6、YOLOv5 and Prune all_model using Torch-Pruning!☆82Updated last week
- 训练一个对中文支持更好的LLaVA模型，并开源训练代码和数据。☆64Updated 10 months ago
- run ChatGLM2-6B in BM1684X☆49Updated last year
- 🚀🚀🚀This is an AI high-performance reasoning C++ library, Currently supports the deployment of yolov5, yolov7, yolov7-pose, yolov8, yol…☆133Updated last year
- yolov5 tensorrt int8量化方法汇总☆77Updated last year
- ☆114Updated last year