pandada8 / llm-inference-benchmarkLinks
LLM 推理服务性能测试
☆45Updated last year
Alternatives and similar repositories for llm-inference-benchmark
Users that are interested in llm-inference-benchmark are comparing it to the libraries listed below
Sorting:
- LLM101n: Let's build a Storyteller 中文版☆132Updated last year
- DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including …☆263Updated 3 weeks ago
- vLLM Documentation in Chinese Simplified / vLLM 中文文档☆95Updated 2 weeks ago
- ☆54Updated this week
- LLM Inference benchmark☆426Updated last year
- ☆172Updated this week
- 通义千问VLLM推理部署DEMO☆596Updated last year
- Accelerate inference without tears☆322Updated 5 months ago
- 欢迎来到 "LLM-travel" 仓库！探索大语言模型（LLM）的奥秘 🚀。致力于深入理解、探讨以及实现与大模型相关的各种技术、原理和应用。☆338Updated last year
- 训练一个对中文支持更好的LLaVA模型，并开源训练代码和数据。☆68Updated 11 months ago
- FlagScale is a large model toolkit based on open-sourced projects.☆347Updated this week
- unify-easy-llm（ULM）旨在打造一个简易的一键式大模型训练工具，支持Nvidia GPU、Ascend NPU等不同硬件以及常用的大模型。☆57Updated last year
- ☆485Updated 3 weeks ago
- ☆113Updated 9 months ago
- This is a user guide for the MiniCPM and MiniCPM-V series of small language models (SLMs) developed by ModelBest. “面壁小钢炮” focuses on achi…☆277Updated last month
- 一些大语言模型和多模态模型的生态,主要包括跨模态搜索、投机解码、QAT量化、多模态量化、ChatBot、OCR☆188Updated 2 weeks ago
- InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencie…☆404Updated last week
- Inference code for LLaMA models☆122Updated 2 years ago
- A flexible and efficient training framework for large-scale alignment tasks☆415Updated this week
- ☆231Updated last year
- 基于《西游记》原文、白话文、ChatGPT生成数据制作的，以InternLM2微调的角色扮演多LLM聊天室。 本项目将介绍关于角色扮演类 LLM 的一切，从数据获取、数据处理，到使用 XTuner 微调并部署至 OpenXLab，再到使用 LMDeploy 部署，以 op…☆103Updated last year
- ☆341Updated this week
- TinyRAG☆323Updated 2 months ago
- ☆49Updated 9 months ago
- 从0开始，将chatgpt的技术路线跑一遍。☆252Updated 11 months ago
- This is a repository used by individuals to experiment and reproduce the pre-training process of LLM.☆467Updated 3 months ago
- GraphGen: Enhancing Supervised Fine-Tuning for LLMs with Knowledge-Driven Synthetic Data Generation☆324Updated this week
- ☆65Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMs☆137Updated 8 months ago
- RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.☆840Updated last month