MegEngine / InferLLM
a lightweight LLM model inference framework
☆681Updated 5 months ago
Related projects: ⓘ
- C++ implementation of Qwen-LM☆531Updated 8 months ago
- llm deploy project based mnn.☆1,419Updated this week
- 纯c++的全平台llm加速库,支持python调用,chatglm-6B级模型单卡可达10000+token / s,支持glm, llama, moss基座,手机端流畅运行☆3,285Updated this week
- 支持中文场景的的小语言模型 llama2.c-zh☆140Updated 6 months ago
- RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.☆512Updated last week
- 中文Mixtral混合专家大模型(Chinese Mixtral MoE LLMs)☆575Updated 4 months ago
- 中文Mixtral-8x7B(Chinese-Mixtral-8x7B)☆637Updated last month
- llm-export can export llm model to onnx.☆193Updated this week
- The official repo of Aquila2 series proposed by BAAI, including pretrained & chat large language models.☆429Updated 7 months ago
- Efficient AI Inference & Serving☆452Updated 8 months ago
- XVERSE-13B: A multilingual large language model developed by XVERSE Technology Inc.☆649Updated 5 months ago
- Phi2-Chinese-0.2B 从0开始训练自己的Phi2中文小模型,支持接入langchain加载本地知识库做检索增强生成RAG。Training your own Phi2 small chat model from scratch.☆467Updated 2 months ago
- Easy and Efficient Finetuning LLMs. (Supported LLama, LLama2, LLama3, Qwen, Baichuan, GLM , Falcon) 大模型高效量化训练+部署.☆562Updated 2 months ago
- Official github repo for C-Eval, a Chinese evaluation suite for foundation models [NeurIPS 2023]☆1,601Updated 10 months ago
- C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)☆2,912Updated last month
- LLaMa/RWKV onnx models, quantization and testcase☆345Updated last year
- DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …☆130Updated 3 weeks ago
- 骆驼:A Chinese finetuned instruction LLaMA. Developed by 陈启源 @ 华中师范大学 & 李鲁鲁 @ 商汤科技 & 冷子昂 @ 商汤科技☆708Updated last year
- Yuan 2.0 Large Language Model☆676Updated 2 months ago
- Play LLaMA2 (official / 中文版 / INT4 / llama2.cpp) Together! ONLY 3 STEPS! ( non GPU / 5GB vRAM / 8~14GB vRAM)☆532Updated last year
- CMMLU: Measuring massive multitask language understanding in Chinese☆669Updated last week
- Low-bit LLM inference on CPU with lookup table☆440Updated this week
- Code for fintune ChatGLM-6b using low-rank adaptation (LoRA)☆724Updated last year
- Open Multilingual Chatbot for Everyone☆1,228Updated 4 months ago
- 人工精调的中文对话数据集和一段chatglm的微调代码☆1,138Updated 4 months ago
- ☆251Updated last week
- 中文对话0.2B小模型(ChatLM-Chinese-0.2B),开源所有数据集来源、数据清洗、tokenizer训练、模型预训练、SFT指令微调、RLHF优化等流程的全部代码。支持下游任务sft微调,给出三元组信息抽取微调示例。☆1,134Updated 5 months ago
- LLM Inference benchmark☆331Updated last month
- torch_musa is an open source repository based on PyTorch, which can make full use of the super computing power of MooreThreads graphics c…☆292Updated last month
- TigerBot: A multi-language multi-task LLM☆2,233Updated 3 months ago