Tlntin / qwen-ascend-llmLinks
☆52Updated last year
Alternatives and similar repositories for qwen-ascend-llm
Users that are interested in qwen-ascend-llm are comparing it to the libraries listed below
Sorting:
- llm-export can export llm model to onnx.☆328Updated 3 weeks ago
- run ChatGLM2-6B in BM1684X☆50Updated last year
- simplify >2GB large onnx model☆66Updated 11 months ago
- DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …☆268Updated 3 months ago
- ☆90Updated 2 years ago
- ☆65Updated last week
- export llama to onnx☆136Updated 10 months ago
- LLM101n: Let's build a Storyteller 中文版☆135Updated last year
- Large Language Model Onnx Inference Framework☆36Updated 3 weeks ago
- ☆27Updated last year
- ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化☆50Updated 2 years ago
- Deploying LLMs offline on the NVIDIA Jetson platform marks the dawn of a new era in embodied intelligence, where devices can function ind…☆102Updated last year
- ☆177Updated this week
- 基于MNN-llm的安卓手机部署大语言模型：Qwen1.5-0.5B-Chat☆86Updated last year
- GLM Series Edge Models☆154Updated 5 months ago
- NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆43Updated 2 years ago
- 一些大语言模型和多模态模型的生态,主要包括跨模态搜索、投机解码、QAT量化、多模态量化、ChatBot、OCR☆193Updated 3 months ago
- LLaMa/RWKV onnx models, quantization and testcase☆367Updated 2 years ago
- Compare multiple optimization methods on triton to imporve model service performance☆52Updated last year
- LLM 推理服务性能测试☆44Updated last year
- 用于学习GOT/Qwen/OnnxLLm☆53Updated last year
- vLLM Documentation in Chinese Simplified / vLLM 中文文档☆124Updated last month
- A high-throughput and memory-efficient inference and serving engine for LLMs☆68Updated last year
- 训练一个对中文支持更好的LLaVA模型，并开源训练代码和数据。☆76Updated last year
- 大模型部署实战：TensorRT-LLM, Triton Inference Server, vLLM☆26Updated last year
- Model compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.☆201Updated last week
- Transformer related optimization, including BERT, GPT☆17Updated 2 years ago
- PDF解析工具：GOT的vLLM加速实现，MinerU做布局识别裁剪、GOT做表格公式解析，实现RAG中的pdf解析☆66Updated last year
- Mixture-of-Experts (MoE) Language Model☆192Updated last year
- 基于昇腾310芯片的大语言模型部 署☆25Updated last year