Tlntin / qwen-ascend-llmLinks
☆49Updated 9 months ago
Alternatives and similar repositories for qwen-ascend-llm
Users that are interested in qwen-ascend-llm are comparing it to the libraries listed below
Sorting:
- llm-export can export llm model to onnx.☆301Updated 6 months ago
- run ChatGLM2-6B in BM1684X☆49Updated last year
- DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …☆263Updated last week
- ☆52Updated last week
- simplify >2GB large onnx model☆61Updated 8 months ago
- 基于MNN-llm的安卓手机部署大语言模型:Qwen1.5-0.5B-Chat☆82Updated last year
- export llama to onnx☆130Updated 7 months ago
- ☆90Updated 2 years ago
- Large Language Model Onnx Inference Framework☆36Updated 6 months ago
- NVIDIA TensorRT Hackathon 2023复赛选题:通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆42Updated last year
- ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化☆50Updated last year
- 一些大语言模型和多模态模型的生态,主要包括跨模态搜索、投机解码、QAT量化、多模态量化、ChatBot、OCR☆185Updated last week
- GLM Series Edge Models☆146Updated last month
- ☆27Updated 9 months ago
- Deploying LLMs offline on the NVIDIA Jetson platform marks the dawn of a new era in embodied intelligence, where devices can function ind…☆98Updated last year
- LLM101n: Let's build a Storyteller 中文版☆131Updated 11 months ago
- [EMNLP 2024 Industry Track] This is the official PyTorch implementation of "LLMC: Benchmarking Large Language Model Quantization with a V…☆528Updated this week
- Run generative AI models in sophgo BM1684X/BM1688☆231Updated last week
- ☆172Updated this week
- Built upon Megatron-Deepspeed and HuggingFace Trainer, EasyLLM has reorganized the code logic with a focus on usability. While enhancing …☆48Updated 10 months ago
- 将SmolVLM2的视觉头与Qwen3-0.6B模型进行了拼接微调☆195Updated last week
- Transformer related optimization, including BERT, GPT☆17Updated 2 years ago
- LLaMa/RWKV onnx models, quantization and testcase☆362Updated 2 years ago
- 研究GOT-OCR-项目落地加速,不限语言☆61Updated 9 months ago
- 训练一个对中文支持更好的LLaVA模型,并开源训练代码和数据。☆64Updated 11 months ago
- Serving Inside Pytorch☆163Updated this week
- ☆59Updated 8 months ago
- 用于学习GOT/Qwen/OnnxLLm☆53Updated 9 months ago
- Triton Documentation in Chinese Simplified / Triton 中文文档☆78Updated 3 months ago
- Model compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.☆31Updated last week