morsoli / llmbenchmarkLinks
大模型API性能指标比较 - 深入分析TTFT、TPS等关键指标
☆18Updated 9 months ago
Alternatives and similar repositories for llmbenchmark
Users that are interested in llmbenchmark are comparing it to the libraries listed below
Sorting:
- Whisper in TensorRT-LLM☆16Updated last year
- Bert TensorRT模型加速部署☆9Updated 3 years ago
- 天池 NVIDIA TensorRT Hackathon 2023 —— 生成式AI模型优化赛 初赛第三名方案☆49Updated last year
- NVIDIA TensorRT Hackathon 2023复赛选题:通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆42Updated last year
- deploy onnx models with TensorRT and LibTorch☆17Updated 3 years ago
- YOLOv12 TensorRT 端到端模型加速推理和INT8量化实现☆12Updated 3 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆16Updated last year
- 国内外数据竞赛资讯整理☆18Updated 3 years ago
- 安卓手机部署DeepSeek-R1 蒸馏的1.5B模型☆21Updated 4 months ago
- ☆27Updated this week
- Inference deployment of the llama3☆11Updated last year
- run ChatGLM2-6B in BM1684X☆49Updated last year
- Inference TinyLlama models on ncnn☆24Updated last year
- ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化☆48Updated last year
- 官方transformers源码解析。AI大模型时代,pytorch、transformer是新操作系统,其他都是运行在其上面的软件。☆17Updated last year
- qwen2 and llama3 cpp implementation☆44Updated last year
- 百度QA100万数据集☆47Updated last year
- Stable Diffusion in TensorRT 8.5+☆14Updated 2 years ago
- paper-read-notes☆12Updated 8 months ago
- 使用onnxruntime部署实时视频帧插值,包含C++和Python两个版本的程序☆25Updated last year
- ☆27Updated 8 months ago
- Transformer related optimization, including BERT, GPT☆17Updated last year
- the newest version of llama3,source code explained line by line using Chinese☆22Updated last year
- 使用mnn-llm对GOT-OCR2.0进行推理☆16Updated 8 months ago
- ggml学习笔记,ggml是一个机器学习的推理框架☆15Updated last year
- 模型 llava-Qwen2-7B-Instruct-Chinese-CLIP 增强中文文字识别能力和表情包内涵识别能力,接近gpt4o、claude-3.5-sonnet的识别水平!☆23Updated 11 months ago
- 使用ONNXRuntime部署Detic检测2万1千种类别的物体,包含C++和Python两个版本的程序☆17Updated last year
- HunyuanDiT with TensorRT and libtorch☆17Updated last year
- 研究GOT-OCR-项目落地加速,不限语言☆60Updated 8 months ago
- Music large model based on InternLM2-chat.☆22Updated 6 months ago