pandada8 / llm-inference-benchmarkLinks
LLM 推理服务性能测试
☆42Updated last year
Alternatives and similar repositories for llm-inference-benchmark
Users that are interested in llm-inference-benchmark are comparing it to the libraries listed below
Sorting:
- DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …☆259Updated last month
- ☆169Updated last week
- LLM101n: Let's build a Storyteller 中文版☆131Updated 11 months ago
- vLLM Documentation in Chinese Simplified / vLLM 中文文档☆84Updated 2 months ago
- ☆230Updated last year
- 欢迎来到 "LLM-travel" 仓库！探索大语言模型（LLM）的奥秘 🚀。致力于深入理解、探讨以及实现与大模型相关的各种技术、原理和应用。☆329Updated 11 months ago
- ☆53Updated 2 weeks ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆136Updated 7 months ago
- ☆345Updated last year
- 通义千问VLLM推理部署DEMO☆586Updated last year
- 中文大模型微调(LLM-SFT), 数学指令数据集MWP-Instruct, 支持模型(ChatGLM-6B, LLaMA, Bloom-7B, baichuan-7B), 支持(LoRA, QLoRA, DeepSpeed, UI, TensorboardX), 支持(微…☆206Updated last year
- ☆313Updated this week
- LLM Inference benchmark☆422Updated 11 months ago
- Awesome Chinese LLM: A curated list of Chinese Large Language Model 中文大语言模型数据集和模型资料汇总☆159Updated last year
- 一些大语言模型和多模态模型的生态,主要包括跨模态搜索、投机解码、QAT量化、多模态量化、ChatBot、OCR☆184Updated 3 weeks ago
- Alpaca Chinese Dataset -- 中文指令微调数据集☆209Updated 9 months ago
- A flexible and efficient training framework for large-scale alignment tasks☆388Updated last week
- 基于《西游记》原文、白话文、ChatGPT生成数据制作的，以InternLM2微调的角 色扮演多LLM聊天室。 本项目将介绍关于角色扮演类 LLM 的一切，从数据获取、数据处理，到使用 XTuner 微调并部署至 OpenXLab，再到使用 LMDeploy 部署，以 op…☆102Updated last year
- 大语言模型应用：RAG、NL2SQL、聊天机器人、预训练、MOE混合专家模型、微调训练、强化学习、天池数据竞赛☆64Updated 5 months ago
- ☆111Updated 8 months ago
- Accelerate inference without tears☆319Updated 4 months ago
- NLP 项目记录档案☆57Updated 2 months ago
- 训练一个对中文支持更好的LLaVA模型，并开源训练代码和数据。☆64Updated 10 months ago
- ☆45Updated last year
- InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencie…☆395Updated 2 weeks ago
- TinyRAG☆314Updated 2 weeks ago
- Generate dialog data from documents using LLM like ChatGLM2 or ChatGPT;利用ChatGLM2,ChatGPT等大模型根据文档生成对话数据集☆158Updated last year
- ☆30Updated 10 months ago
- Mixture-of-Experts (MoE) Language Model☆189Updated 10 months ago
- FlagScale is a large model toolkit based on open-sourced projects.☆325Updated this week