LLM 并发性能测试工具，支持自动化压力测试和性能报告生成。
☆272Dec 10, 2025Updated 8 months ago
Alternatives and similar repositories for llm-benchmark
Users that are interested in llm-benchmark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.☆3,240Updated this week
- HunyuanDiT with TensorRT and libtorch☆18May 22, 2024Updated 2 years ago
- 大模型推理压测☆51Jul 31, 2025Updated last year
- Community maintained hardware plugin for vLLM on Ascend☆2,635Updated this week
- 华为集合通信性能测试☆16May 27, 2024Updated 2 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- A prompt-aware LLM router that predicts which models can complete each request, then selects the cheapest capable one: 53.2% lower cost a…☆35Jul 26, 2026Updated 3 weeks ago
- opencv调用jetson/rk3588 mpp硬解码，重写了open与read函数，支持h264/h265☆14Aug 4, 2026Updated last week
- A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.☆5,487Updated this week
- ☆20Dec 29, 2023Updated 2 years ago
- Библиотека для Windows, которая модифицирует внешний вид проводника☆19Nov 1, 2025Updated 9 months ago
- 基于Qwen2模型进行通用信息抽取【实体/关系/事件抽取】☆41Jul 10, 2024Updated 2 years ago
- ☆13Feb 9, 2026Updated 6 months ago
- Whisper in TensorRT-LLM☆16Sep 21, 2023Updated 2 years ago
- Lightweight multi-agent orchestration engine☆15Jul 1, 2026Updated last month
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Flash Attention in ~100 lines of CUDA (forward pass only)☆12Jun 10, 2024Updated 2 years ago
- 搜藏的希望的代码片段☆13Jun 6, 2023Updated 3 years ago
- a ai infra framework for edge device base on nndeploy☆18Nov 27, 2025Updated 8 months ago
- 使用mnn-llm对GOT-OCR2.0进行推理☆13Oct 2, 2024Updated last year
- Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-p…☆9,497Updated this week
- 高性能 高精度 大陆车牌、港澳车牌、台湾车牌 韩国车牌(South Korea LPR)识别 代码开源(ncnn移植）☆48Nov 5, 2025Updated 9 months ago
- 基于Dify自主创建的AI应 用DSL工作流，你可以免费获取，无论是出于个人需求还是学习目的，它都能为您开启一段充满无限可能的智能之旅。☆2,635Jul 13, 2026Updated last month
- To convert CosyVoice model to ONNX☆16Dec 22, 2025Updated 7 months ago
- Open-source speech recognition toolkit for training, inference, streaming ASR, VAD, punctuation, speaker diarization pipelines, and OpenA…☆19,851Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 简易版任务型对话系统☆18May 17, 2019Updated 7 years ago
- 使用C++ tensorrt10 推理 ml-depth-pro 模型☆23Jan 8, 2025Updated last year
- fastllm是后端无依赖的高性能大模型推理库。同时支持张量并行推理稠密模型和混合模式推理MOE模型，任意10G以上显卡即可推理满血DeepSeek。双路9004/9005服务器+单显卡部署DeepSeek满血满精度原版模型，单并发20tps；INT4量化模型单并发30tp…☆4,920Updated this week
- ☆31May 9, 2025Updated last year
- Automate hyper-parameters tuning for NNs (learning rate, number of dense layers and nodes and activation function)☆14Aug 9, 2020Updated 6 years ago
- AI-agent应用，基于GPT、langchain、function calling、Stable diffusion等的AI儿童绘本生成☆25Oct 11, 2023Updated 2 years ago
- Co-DETR (Detection Transformer) compiled from PyTorch to NVIDIA TensorRT☆21Apr 19, 2025Updated last year
- This is a repository to practice multi-thread programming in C++☆31Feb 21, 2024Updated 2 years ago
- LMCache on Ascend☆83Aug 8, 2026Updated last week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- mnn asr demo.☆27Mar 24, 2025Updated last year
- Auto Thinking Mode switch for Qwen3 in Open webui☆71May 8, 2025Updated last year
- A simple neural network inference framework☆25Aug 1, 2023Updated 3 years ago
- This project is primarily used to deploy large language models and multimodal large models on Orin.🚀🚀🚀☆18Jun 23, 2026Updated last month
- a simple lightweight large language model pipeline framework.☆28Apr 25, 2025Updated last year
- 学习vLLM，使用vLLM部署Qwen2-0.5B的模型，并使用docker部署。☆20Jun 22, 2024Updated 2 years ago
- a repo for sharing ustc course resources☆37Sep 21, 2024Updated last year