DataXujing / Bert_TensorRTLinks
Bert TensorRT模型加速部署
☆9Updated 3 years ago
Alternatives and similar repositories for Bert_TensorRT
Users that are interested in Bert_TensorRT are comparing it to the libraries listed below
Sorting:
- 国内外数据竞赛资讯整理☆18Updated 3 years ago
- 天池 NVIDIA TensorRT Hackathon 2023 —— 生成式AI模型优化赛 初赛第三名方案☆49Updated last year
- 陆续开源医疗行业的深度学习模型及数据集☆13Updated 3 years ago
- 文档图片表格结构识别算法-同花顺算法挑战赛-2022年2-4月春季赛☆25Updated 3 years ago
- Whisper in TensorRT-LLM☆16Updated last year
- 大模型API性能指标比较 - 深入分析TTFT、TPS等关键指标☆18Updated 9 months ago
- deploy onnx models with TensorRT and LibTorch☆17Updated 3 years ago
- NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆42Updated last year
- 纯Python实现的深度学习框架，帮助你理解底层细节斩获offer☆20Updated 2 years ago
- cpp rotation album，基于cpp eigen实现的3d旋转相册，GAMES101复现内容☆12Updated 2 years ago
- 利用tensorflow/serving进行单模型、多模型、同一模型多版本的部署，并进行模型预测，并用Prothemus进行服务监控。☆11Updated 4 years ago
- A tool convert TensorRT engine/plan to a fake onnx☆39Updated 2 years ago
- 使用DBNet检测条形码，包含C++和Python两种版本的程序☆37Updated 4 years ago
- 分别使用OpenCV、ONNXRuntime部署CenterNet目标检测，包含C++和Python两个版本的程序☆9Updated 2 years ago
- TensorRT简明教程☆26Updated 3 years ago
- miemienet is a C++ AI deep learning inference framework.Supports PPYOLOE、PICODET.☆11Updated 2 years ago
- multi-task classifier☆22Updated last year
- Wanwu models release, code will be released soon☆24Updated 2 years ago
- ☆13Updated 2 years ago
- ☆14Updated 5 years ago
- lightweighted deep learning inference service framework☆39Updated 4 years ago
- HunyuanDiT with TensorRT and libtorch☆17Updated last year
- ☆17Updated 5 months ago
- paper-read-notes☆12Updated 9 months ago
- 手摸手 美团 YOLOv6模型训练和TensorRT端到端部署方案教程☆31Updated 2 years ago
- ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化☆48Updated last year
- convert paddleOCR to torchOCR, ppocr-v3,ppocr-v4, onnx, openvino☆32Updated last year
- ☆27Updated last week
- YOLOv5 in PyTorch > ONNX > CoreML > iOS☆9Updated 10 months ago
- ☆26Updated 10 months ago