Tlntin / qwen-ascend-llmLinks
☆49Updated 9 months ago
Alternatives and similar repositories for qwen-ascend-llm
Users that are interested in qwen-ascend-llm are comparing it to the libraries listed below
Sorting:
- llm-export can export llm model to onnx.☆304Updated 7 months ago
- DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …☆263Updated 3 weeks ago
- run ChatGLM2-6B in BM1684X☆50Updated last year
- simplify >2GB large onnx model☆63Updated 8 months ago
- ☆90Updated 2 years ago
- export llama to onnx☆132Updated 8 months ago
- ☆54Updated this week
- NVIDIA TensorRT Hackathon 2023复赛选题:通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆42Updated last year
- 基于MNN-llm的安卓手机部署大语言模型:Qwen1.5-0.5B-Chat☆82Updated last year
- Model compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.☆89Updated this week
- ☆27Updated 9 months ago
- Large Language Model Onnx Inference Framework☆36Updated 7 months ago
- ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化☆50Updated last year
- Transformer related optimization, including BERT, GPT☆17Updated 2 years ago
- 用于学习GOT/Qwen/OnnxLLm☆53Updated 10 months ago
- LLM101n: Let's build a Storyteller 中文版☆132Updated last year
- GLM Series Edge Models☆147Updated 2 months ago
- 研究GOT-OCR-项目落地加速,不限语言☆61Updated 10 months ago
- Deploying LLMs offline on the NVIDIA Jetson platform marks the dawn of a new era in embodied intelligence, where devices can function ind…☆100Updated last year
- Compare multiple optimization methods on triton to imporve model service performance☆52Updated last year
- ☆172Updated this week
- 一些大语言模型和多模态模型的生态,主要包括跨模态搜索、投机解码、QAT量化、多模态量化、ChatBot、OCR☆187Updated 2 weeks ago
- PDF解析工具:GOT的vLLM加速实现,MinerU做布局识别裁剪、GOT做表格公式解析,实现RAG中的pdf解析☆62Updated 9 months ago
- unify-easy-llm(ULM)旨在打造一个简易的一键式大模型训练工具,支持Nvidia GPU、Ascend NPU等不同硬件以及常用的大模型。☆57Updated last year
- 大模型部署实战:TensorRT-LLM, Triton Inference Server, vLLM☆26Updated last year
- vLLM Documentation in Chinese Simplified / vLLM 中文文档☆95Updated 2 weeks ago
- A Toolkit to Help Optimize Large Onnx Model☆158Updated last year
- 将SmolVLM2的视觉头与Qwen3-0.6B模型进行了拼接微调☆277Updated 3 weeks ago
- 训练一个对中文支持更好的LLaVA模型,并开源训练代码和数据。☆67Updated 11 months ago
- llm deploy project based onnx.☆43Updated 10 months ago