lework / llm-benchmarkLinks
LLM 并发性能测试工具,支持自动化压力测试和性能报告生成。
☆211Updated last month
Alternatives and similar repositories for llm-benchmark
Users that are interested in llm-benchmark are comparing it to the libraries listed below
Sorting:
- 通义千问VLLM推理部署DEMO☆637Updated last year
- Ragflow-Plus 是 Ragflow 的二次开发版本,使其更为简洁实用☆1,201Updated last month
- dify's rag patch module☆278Updated 4 months ago
- 自动批量上传并解析文档至 RagFlow 知识库,省去手动操作,提升效率。☆486Updated 5 months ago
- gpt_server是一个用于生产级部署LLMs、Embedding、Reranker、ASR、TTS、文生图、图片编辑和文生视频的开源框架。☆244Updated 2 weeks ago
- ☆274Updated last year
- Scripting tool for downloading Dify plugin package from Dify Marketplace and Github and repackaging [true] offline package.☆599Updated 3 weeks ago
- A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.