pandada8 / llm-inference-benchmark
LLM 推理服务性能测试
☆37Updated last year
Alternatives and similar repositories for llm-inference-benchmark:
Users that are interested in llm-inference-benchmark are comparing it to the libraries listed below
- LLM101n: Let's build a Storyteller 中文版☆130Updated 7 months ago
- DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …☆238Updated 2 weeks ago
- 中文大模型微调(LLM-SFT), 数学指令数据集MWP-Instruct, 支持模型(ChatGLM-6B, LLaMA, Bloom-7B, baichuan-7B), 支持(LoRA, QLoRA, DeepSpeed, UI, TensorboardX), 支持(微…☆188Updated 10 months ago
- 怎么训练一个LLM分词器☆142Updated last year
- ☆44Updated this week
- Imitate OpenAI with Local Models☆88Updated 6 months ago
- vLLM Documentation in Chinese Simplified / vLLM 中文文档☆55Updated 2 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆132Updated 3 months ago
- ☆225Updated 10 months ago
- 欢迎来到 "LLM-travel" 仓库！探索大语言模型（LLM）的奥秘 🚀。致力于深入理解、探讨以及实现与大模型相关的各种技术、原理和应用。☆303Updated 8 months ago
- 大语言模型应用：RAG、NL2SQL、聊天机器人、预 训练、MOE混合专家模型、微调训练、强化学习、天池数据竞赛☆58Updated last month
- ☆157Updated this week
- LLaMA Factory Document☆111Updated last week
- ☆105Updated 4 months ago
- 专注于对话系统领域的技术分享，重点写《Dify应用操作和源码剖析》专栏。☆87Updated 8 months ago
- 一些大语言模型和多模态模型的应用,主要包括Rag，小模型，Agent，跨模态搜索，OCR等等☆157Updated 4 months ago
- Community maintained hardware plugin for vLLM on Ascend☆370Updated this week
- A flexible and efficient training framework for large-scale alignment tasks☆333Updated last month
- unify-easy-llm（ULM）旨在打造一个简易的一键式大模型训练工具，支持Nvidia GPU、Ascend NPU等不同硬件以及常用的大模型。☆55Updated 7 months ago
- A unified tool to generate fine-tuning datasets for LLMs, including questions, answers, and dialogues. ✨🤖📚💬☆57Updated last week
- ☆312Updated 9 months ago
- 通义千问VLLM推理部署DEMO☆550Updated 11 months ago
- A visuailzation tool to make deep understaning and easier debugging for RLHF training.☆173Updated last month
- Inference code for LLaMA models☆118Updated last year
- Baichuan2代码的逐行解析版本，适合小白☆212Updated last year
- OpenSeek aims to unite the global open source community to drive collaborative innovation in algorithms, data and systems to develop next…☆124Updated this week
- MegaPairs: Massive Data Synthesis For Universal Multimodal Retrieval☆128Updated last week
- InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencie…☆368Updated this week
- 训练一个对中文支持更好的LLaVA模型，并开源训练代码和数据。☆53Updated 6 months ago
- 专注于中文领域大语言模型，落地到某个行业某个领域，成为一个行业大模型、公司级别或行业级别领域大模型。☆116Updated 2 weeks ago