lework / llm-benchmarkLinks
LLM 并发性能测试工具,支持自动化压力测试和性能报告生成。
☆124Updated 3 months ago
Alternatives and similar repositories for llm-benchmark
Users that are interested in llm-benchmark are comparing it to the libraries listed below
Sorting:
- dify's rag patch module☆258Updated last month
- 通义千问VLLM推理部署DEMO☆586Updated last year
- A streamlined and customizable framework for efficient large model evaluation and performance benchmarking☆1,329Updated this week
- Scripting tool for downloading Dify plugin package from Dify Marketplace and Github and repackaging [true] offline package.☆332Updated 2 weeks ago
- gpt_server是一个用于生产级部署LLMs、Embedding、Reranker、ASR和TTS的开源框架。☆200Updated last week
- Ragflow-Plus 是 Ragflow 的二次开发版本,使其更为简洁实用☆722Updated last week
- 《赋范大模型技术社区》是针对各阶大模型学习者量身打造的基于各类大模型,包括环境设置、本地部署、高效微调、开发实战等技能在内的全流程指导!☆481Updated last week
- Community maintained hardware plugin for vLLM on Ascend☆881Updated this week
- DIFY PULGIN 插件源码集合☆258Updated last month
- KnowFlowRAG☆139Updated this week
- ☆573Updated 3 weeks ago
- 使用LangGraph+DeepSeek-R1+FastAPI+Gradio实现一个带有记忆功能的流量包推荐智能客服web端用例,同时也支持gpt大模型、国产大模型(OneApi方式)、Ollama本地开源大模型、阿里通义千问大模型☆197Updated 3 months ago
- 企业级RAG系统从入门到精通☆518Updated 3 weeks ago
- An easy-to-use framework for modular RAG☆375Updated this week
- ☆254Updated 6 months ago
- ☆969Updated 2 weeks ago
- High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.☆1,159Updated this week
- ☆131Updated 4 months ago
- 一个适合学习、使用、自主扩展的RAG【检索增强生成】系统!可联网做AI搜索☆496Updated 10 months ago
- 自动批量上传并解析文档至 RagFlow 知识库,省去手动操作,提升效率。☆395Updated 2 weeks ago
- ☆157Updated 3 months ago
- Easy-to-Use RAG Framework; CCF AIOps International Challenge 2024 Top3 Solution; CCF AIOps 国际挑战赛 2024 季军方案☆541Updated 8 months ago
- 添加🚀流式 Web 服务到 GraphRAG,兼容 OpenAI SDK,支持可访问的实体链接🔗,支持建议问题,兼容本地嵌入模型,修复诸多问题。Add streaming web server to GraphRAG, compatible with OpenAI SD…☆255Updated 3 months ago
- RAG-QA-Generator 是一个用于检索增强生成(RAG)系统的自动化知识库构建与管理工具。该工具通过读取文档数据,利用大规模语言模型生成高质量的问答对(QA对),并将这些数据插入数据库中,实现RAG系统知识库的自动化构建和管理。☆205Updated 6 months ago
- A code executor for Dify that is compatible with the official sandbox API calls and dependency installation.☆311Updated 2 months ago
- 支持查询主流agent框架技术文档的MCP server(支持stdio和sse两种传输协议), 支持 langchain、llama-index、autogen、agno、openai-agents-sdk、mcp-doc、camel-ai 和 crew-ai☆122Updated 2 months ago
- 使用Docker Stack搭建Milvus向量数据库集群☆36Updated last year
- Convert files into markdown to help RAG or LLM understand, based on markitdown and MinerU, which could provide high quality pdf parser.☆118Updated 3 months ago
- vLLM Documentation in Chinese Simplified / vLLM 中文文档☆85Updated 2 months ago
- An open-source solution for full parameter fine-tuning of DeepSeek-V3/R1 671B, including complete code and scripts from training to infer…☆725Updated 4 months ago