lework / llm-benchmarkLinks
LLM 并发性能测试工具,支持自动化压力测试和性能报告生成。
☆202Updated 3 weeks ago
Alternatives and similar repositories for llm-benchmark
Users that are interested in llm-benchmark are comparing it to the libraries listed below
Sorting:
- 通义千问VLLM推理部署DEMO☆637Updated last year
- A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.☆2,215Updated this week
- Scripting tool for downloading Dify plugin package from Dify Marketplace and Github and repackaging [true] offline package.☆581Updated this week
- gpt_server是一个用于生产级部署LLMs、Embedding、Reranker、ASR、TTS、文生图、图片编辑和文生视频的开源框架。☆243Updated 2 weeks ago
- Ragflow-Plus 是 Ragflow 的二次开发版本,使其更为简洁实用☆1,168Updated 3 weeks ago
- Community maintained hardware plugin for vLLM on Ascend☆1,532Updated this week
- dify's rag patch module☆277Updated 4 months ago
- ☆274Updated last year
- 自动批量上传并解析文档至 RagFlow 知识库,省去手动操作,提升效率。☆483Updated 5 months ago
- High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.☆1,374Updated this week
- 企业级RAG系统从入门到精通☆612Updated 6 months ago
- DIFY PULGIN 插件源码集合☆320Updated 7 months ago
- “AI-Compass”将为社区指引在 AI 技术海洋中航行的方向,无论你是初学者还是进阶开发者,都能在这里找到通往 AI 各大方向的路径。旨在帮助开发者系统性地 了解 AI 的核心概念、主流技术、前沿趋势,并通过实践掌握从理论到落地的全过程。☆481Updated 3 weeks ago
- run DeepSeek-R1 GGUFs on KTransformers☆259Updated 10 months ago
- KnowFlowRAG☆406Updated last week
- An easy-to-use framework for modular RAG☆422Updated this week
- 标书大模型(Proposal-LLM Chinese version )☆301Updated last year
- 使用Docker Stack搭建Milvus向量数据库集群☆39Updated 2 years ago
- 大模型推理压测☆44Updated 5 months ago
- ☆172Updated 9 months ago
- vLLM Documentation in Chinese Simplified / vLLM 中文文档☆143Updated 3 weeks ago
- ☆803Updated 2 months ago
- 使用LangGraph+DeepSeek-R1+FastAPI+Gradio实现一个带有记忆功能的流量包推荐智能客服web端用例,同时也支持gpt大模型、国产大模型(OneApi方式)、Ollama本地开源大模型、阿里通义千问大模型☆385Updated 8 months ago
- ☆162Updated 10 months ago
- ☆1,244Updated 3 months ago
- 一个适合学习、使用、自主扩展的RAG【检索增强生成】系统!可联网做AI搜索☆523Updated last year
- llamafactory blog☆48Updated last year
- 本项目旨在分享人工智能相关应用技术以及实战经验,包括大模型、语音合成、数字人、图像生成等。☆276Updated last year
- 为AI带路党Pro视频准备☆278Updated 10 months ago
- A code executor for Dify that is compatible with the official sandbox API calls and dependency installation.☆371Updated 8 months ago