LLM 并发性能测试工具，支持自动化压力测试和性能报告生成。
☆295Dec 10, 2025Updated 10 months ago
Alternatives and similar repositories for llm-benchmark
Users that are interested in llm-benchmark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.☆3,617Updated this week
- 安卓手机部署DeepSeek-R1 蒸馏的1.5B模型☆26Feb 4, 2025Updated last year
- 大模型推理压测☆51Jul 31, 2025Updated last year
- Community maintained hardware plugin for vLLM on Huawei Ascend☆3,036Updated this week
- HunyuanDiT with TensorRT and libtorch☆18May 22, 2024Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- 一个轻量化的大模型推理框架☆23May 26, 2025Updated last year
- A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.☆5,932Updated this week
- 无需编程，即可快速构建基于先进AI模型的各类智能应用——从简单的问答机器人到包含复杂逻辑的工作流。构建完成后，一键发布 至主流社交平台、Web网页，或通过开放API无缝集成到现有系统进行深度开发。☆12Nov 26, 2025Updated 11 months ago
- 大语言模型评估平台，支持多种评估基准、自定义数据集和性能测试。支持基于自定义数据集的RAG评估。☆100Aug 20, 2025Updated last year
- 大模型API性能指标比较 - 深入分析TTFT、TPS等关键指标☆20Sep 12, 2024Updated 2 years ago
- ☆20Dec 29, 2023Updated 2 years ago
- A prompt-aware LLM router that predicts which models can complete each request, then selects the cheapest capable one: 53.2% lower cost a…☆42Updated this week
- 医院体检报告信息抽取及模板生成☆12Apr 25, 2019Updated 7 years ago
- opencv调用jetson/rk3588 mpp硬解码，重写了open与read函数，支持h264/h265☆14Aug 4, 2026Updated 2 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- **本项目是一个基于 `nanobot` 与 `nanobot-webui` 二次开发的 AI System Agent 机器人系统，目标是构建一个能够长期运行、具备自主执行能力的智能系统管理员。** *This project is an AI System Agent …☆21Sep 2, 2026Updated last month
- 基于Qwen2模型进行通用信息抽取【实体/关系/事件抽取】☆41Jul 10, 2024Updated 2 years ago
- Lightweight multi-agent orchestration engine☆14Jul 1, 2026Updated 3 months ago
- ☆13Nov 29, 2024Updated last year
- Flash Attention in ~100 lines of CUDA (forward pass only)☆12Jun 10, 2024Updated 2 years ago
- 这是一个使用opencv读取视频并使用socket进行传输视频画面的脚本文件，相较于调用ffmpeg传输节约了90%的数据量☆11May 14, 2024Updated 2 years ago
- YOLOv12 TensorRT 端到端模型加速推理和INT8量化实现☆14Mar 5, 2025Updated last year
- Whisper in TensorRT-LLM☆16Sep 21, 2023Updated 3 years ago
- Repository containing necessary files to run a server able to run Webots simulation☆12Apr 15, 2026Updated 6 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- 搜藏的希望的代码片段☆13Jun 6, 2023Updated 3 years ago
- Benchmarking the serving capabilities of vLLM☆59Aug 20, 2024Updated 2 years ago
- 使用mnn-llm对GOT-OCR2.0进行推理☆13Oct 2, 2024Updated 2 years ago
- The batch engine for AI agents.☆27Updated this week
- The Spaced Repetition Systems for Agents☆22Mar 24, 2026Updated 7 months ago
- Claude AI 的使用指南和最佳实践中文版 https://github.com/anthropics/claude-cookbooks☆19Feb 26, 2026Updated 8 months ago
- 高性能 高精度 大陆车牌、港澳车牌、台湾车牌 韩国车牌(South Korea LPR)识别 代码开源(ncnn移植）☆50Nov 5, 2025Updated 11 months ago
- 语音识别模型pytorch转ONNX转MNN，C++实现部署☆84Sep 1, 2022Updated 4 years ago
- fastllm是后端无依赖的高性能大模型推理库，帮助您在大部分设备上高效推理大模型！☆5,129Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- 基于Dify自主创建的AI应用DSL工作流，你可以免费获取，无论是出于个人需求还是学习目的，它都能为您开启一段充满无限可能的智能之旅。☆2,674Jul 13, 2026Updated 3 months ago
- 非线智能 NoneLinear - ReLE评测：中文AI大模型能力评测（持续更新）：目前已囊括374个大模型，覆盖chatgpt、gpt-5.4、谷歌gemini-3.1-pro、Claude-4.6、文心ERNIE-X1.1、ERNIE-5.0、qwen3.6-max、…☆6,490Updated this week
- LMDeploy is a toolkit for compressing, deploying, and serving LLMs.☆8,126Updated this week
- HippoBuddy — AI-powered desktop assistant for chat, coding, and office workflows.☆55Oct 7, 2026Updated 3 weeks ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆95,916Updated this week
- ☆14Aug 27, 2025Updated last year
- SuperPoint-SuperGlue-ONNX☆18Jul 27, 2023Updated 3 years ago