Tlntin / qwen-ascend-llmLinks
☆47Updated 8 months ago
Alternatives and similar repositories for qwen-ascend-llm
Users that are interested in qwen-ascend-llm are comparing it to the libraries listed below
Sorting:
- llm-export can export llm model to onnx.☆299Updated 5 months ago
- ☆90Updated 2 years ago
- DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …☆259Updated last month
- simplify >2GB large onnx model☆59Updated 7 months ago
- run ChatGLM2-6B in BM1684X☆49Updated last year
- Large Language Model Onnx Inference Framework☆36Updated 6 months ago
- ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化☆49Updated last year
- export llama to onnx☆129Updated 6 months ago
- ☆53Updated last week
- NVIDIA TensorRT Hackathon 2023复赛选题:通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆42Updated last year
- LLM101n: Let's build a Storyteller 中文版☆131Updated 11 months ago
- 训练一个对中文支持更好的LLaVA模型,并开源训练代码和数据。☆64Updated 10 months ago
- Built upon Megatron-Deepspeed and HuggingFace Trainer, EasyLLM has reorganized the code logic with a focus on usability. While enhancing …☆47Updated 9 months ago
- 基于MNN-llm的安卓手机部署大语言模型:Qwen1.5-0.5B-Chat☆80Updated last year
- Compare multiple optimization methods on triton to imporve model service performance☆52Updated last year
- A Toolkit to Help Optimize Large Onnx Model☆157Updated last year
- Deploying LLMs offline on the NVIDIA Jetson platform marks the dawn of a new era in embodied intelligence, where devices can function ind…☆98Updated last year
- ☆169Updated this week
- Transformer related optimization, including BERT, GPT☆17Updated last year
- ☆27Updated 8 months ago
- [EMNLP 2024 Industry Track] This is the official PyTorch implementation of "LLMC: Benchmarking Large Language Model Quantization with a V…☆510Updated last week
- 大模型部署实战:TensorRT-LLM, Triton Inference Server, vLLM☆26Updated last year
- llm deploy project based onnx.☆42Updated 9 months ago
- GLM Series Edge Models☆144Updated last month
- Serving Inside Pytorch☆163Updated last week
- 一些大语言模型和多模态模型的生态,主要包括跨模态搜索、投机解码、QAT量化、多模态量化、ChatBot、OCR☆184Updated 3 weeks ago
- vLLM Documentation in Chinese Simplified / vLLM 中文文档☆84Updated 2 months ago
- 用于学习GOT/Qwen/OnnxLLm☆52Updated 9 months ago
- 基于昇腾310芯片的大语言模型部署☆20Updated last year
- qwen2 and llama3 cpp implementation☆45Updated last year