lework / llm-benchmarkLinks
LLM 并发性能测试工具,支持自动化压力测试和性能报告生成。
☆160Updated 6 months ago
Alternatives and similar repositories for llm-benchmark
Users that are interested in llm-benchmark are comparing it to the libraries listed below
Sorting:
- 通义千问VLLM推理部署DEMO☆608Updated last year
- A streamlined and customizable framework for efficient large model evaluation and performance benchmarking☆1,762Updated last week
- Community maintained hardware plugin for vLLM on Ascend☆1,179Updated last week
- dify's rag patch module☆275Updated last month
- gpt_server是一个用于生产级部署LLMs、Embedding、Reranker、ASR、TTS、文生图、图片编辑和文生视频的开源框架。☆213Updated 2 weeks ago
- 企业级RAG系统从入门到精通☆565Updated 3 months ago
- Scripting tool for downloading Dify plugin package from Dify Marketplace and Github and repackaging [true] offline package.☆460Updated 2 weeks ago
- 大模型推理压测☆35Updated 2 months ago
- High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.☆1,293Updated this week
- An easy-to-use framework for modular RAG☆394Updated this week
- ☆168Updated 6 months ago
- llamafactory blog☆41Updated 11 months ago
- Ragflow-Plus 是 Ragflow 的二次开发版本,使其更为简洁实用☆1,046Updated last month
- 自动批量上传并解析文档至 RagFlow 知识库,省去手动操作,提升效率。☆441Updated 2 months ago
- Easy-to-Use RAG Framework; CCF AIOps International Challenge 2024 Top3 Solution; CCF AIOps 国际挑战赛 2024 季军方案☆583Updated 10 months ago
- DIFY PULGIN 插件源码集合☆300Updated 4 months ago
- KnowFlowRAG☆313Updated 2 weeks ago
- 一个适合学习、使用、自主扩展的RAG【检索增强生成】系统!可联网做AI搜索☆510Updated last year
- ☆269Updated 9 months ago
- ☆697Updated 3 months ago
- ☆148Updated 7 months ago
- run DeepSeek-R1 GGUFs on KTransformers☆252Updated 7 months ago
- “AI-Compass”将为社区指引在 AI 技术海洋中航行的方向,无论你是初学者还是进阶开发者,都能在这里找到通往 AI 各大方向的路径。旨在帮助开发者系统性地了解 AI 的核心概念、主流技术、前沿趋势,并通过实践掌握从理论到落地的全过程。☆314Updated last week
- 大模型/LLM推理和部署理论与实践☆348Updated 2 months ago
- ☆1,072Updated 3 weeks ago
- RAG-QA-Generator 是一个用于检索增强生成(RAG)系统的自动化知识库构建与管理工具。该工具通过读取文档数据,利用大规模语言模型生成高质量的问答对(QA对),并将这些数据插入数据库中,实现RAG系统知识库的自动化构建和管理。☆232Updated 9 months ago
- 《赋范大模型技术社区》是针对各阶大模型学习者量身打造的基于各类大模型,包括环境设置、本地部署、高效微调、开发实战等技能在内的全流程指导!☆660Updated 2 months ago
- unify-easy-llm(ULM)旨在打造一个简易的一键式大模型训练工具,支持Nvidia GPU、Ascend NPU等不同硬件以及常用的大模型。☆57Updated last year
- 个人关于大模型的记忆宝藏☆50Updated 6 months ago
- 本项目旨在分享人工智能相关应用技术以及实战经验,包括大模型、语音合成、数字人、图像生成等。☆266Updated last year