lework / llm-benchmarkLinks
LLM 并发性能测试工具,支持自动化压力测试和性能报告生成。
☆93Updated 3 months ago
Alternatives and similar repositories for llm-benchmark
Users that are interested in llm-benchmark are comparing it to the libraries listed below
Sorting:
- gpt_server是一个用于生产级部署LLMs、Embedding、Reranker、ASR和TTS的开源框架。☆194Updated this week
- 通义千问VLLM推理部署DEMO☆584Updated last year
- dify's rag patch module☆249Updated 3 weeks ago
- A streamlined and customizable framework for efficient large model evaluation and performance benchmarking☆1,203Updated this week
- Community maintained hardware plugin for vLLM on Ascend☆791Updated this week
- ☆250Updated 6 months ago
- Easy-to-Use RAG Framework; CCF AIOps International Challenge 2024 Top3 Solution; CCF AIOps 国际挑战赛 2024 季军方案☆521Updated 7 months ago
- 使用LangGraph+DeepSeek-R1+FastAPI+Gradio实现一个带有记忆功能的流量包推荐智能客服web端用例,同时也支持gpt大模型、国产大模型(OneApi方式)、Ollama本地开源大模型、阿里通义千问大模型☆170Updated 2 months ago
- Scripting tool for downloading Dify plugin package from Dify Marketplace and Github and repackaging [true] offline package.☆275Updated 2 weeks ago
- ☆125Updated 3 months ago
- ☆154Updated 3 months ago
- Ragflow-Plus 是 Ragflow 的二次开发版本,使其更为简洁实用☆632Updated this week
- RAG-QA-Generator 是一个用于检索增强生成(RAG)系统的自动化知识库构建与管理工具。该工具通过读取文档数据,利用大规模语言模型生成高质量的问答对(QA对),并将这些数据插入数据库中,实现RAG系统知识库的自动化 构建和管理。☆200Updated 6 months ago
- DIFY PULGIN 插件源码集合☆236Updated 3 weeks ago
- An easy-to-use framework for modular RAG☆372Updated this week
- llamafactory blog☆29Updated 8 months ago
- Q&A based on elasticsearch+langchain+chatglm2 | 基于elasticsearch,langchain,chatglm2的自有知识库问答☆241Updated last year
- 自动批量上传并解析文档至 RagFlow 知识库,省去手动操作,提升效率。☆371Updated last week
- vLLM Documentation in Chinese Simplified / vLLM 中文文档☆80Updated last month
- ☆544Updated last week
- prompt 工程项目案例☆85Updated 3 months ago
- KnowFlowRAG☆87Updated this week
- Convert files into markdown to help RAG or LLM understand, based on markitdown and MinerU, which could provide high quality pdf parser.☆108Updated 3 months ago
- 使用Docker Stack搭建Milvus向量数据库集群☆33Updated last year
- GraphRAG的应用实例,项目特点在于提供了替换OpenAI模型的方法,并通过修改原有提示和切分文档的方法,提高了GraphRAG处理中文内容的能力。☆165Updated 7 months ago
- 基于大语言模型的检索增强生成RAG示例☆151Updated last month
- 这是一个从头训练大语言模型的项目,包括预训练、微调和直接偏好优化,模型拥有1B参数,支持中英文。☆437Updated 4 months ago
- 快速入门RAG与私有化部署☆192Updated last year
- unify-easy-llm(ULM)旨在打造一个简易的一键式大模型训练工具,支持Nvidia GPU、Ascend NPU等不同硬件以及常用的大模型。☆55Updated 11 months ago
- 一些大语言模型和多模态模型的生态,主要包括跨模态搜索、投机解码、QAT量化、多模态量化、ChatBot、OCR☆182Updated this week