DataXujing / Bert_TensorRTLinks
Bert TensorRT模型加速部署
☆9Updated 3 years ago
Alternatives and similar repositories for Bert_TensorRT
Users that are interested in Bert_TensorRT are comparing it to the libraries listed below
Sorting:
- 国内外数据竞赛资讯整理☆18Updated 3 years ago
- 天池 NVIDIA TensorRT Hackathon 2023 —— 生成式AI模型优化赛 初赛第三名方案☆49Updated last year
- 文档图片表格结构识别算法-同花顺算法挑战赛-2022年2-4月春季赛☆25Updated 3 years ago
- 大模型API性能指标比较 - 深入分析TTFT、TPS等关键指标☆17Updated 8 months ago
- NVIDIA TensorRT Hackathon 2023复赛选题:通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆42Updated last year
- cpp rotation album,基于cpp eigen实现的3d旋转相册,GAMES101复现内容☆12Updated 2 years ago
- 陆续开源医疗行业的深度学习模型及数据集☆13Updated 3 years ago
- 使用DBNet检测条形码,包含C++和Python两种版本的程序☆35Updated 4 years ago
- 纯Python实现的深度学习框架,帮助你理解底层细节斩获offer☆20Updated 2 years ago
- deploy onnx models with TensorRT and LibTorch☆17Updated 3 years ago
- TensorRT简明教程☆26Updated 3 years ago
- Wanwu models release, code will be released soon☆24Updated 2 years ago
- paper-read-notes☆11Updated 8 months ago
- 手摸手 美团 YOLOv6模型训练和TensorRT端到端部署方案教程☆31Updated 2 years ago
- ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化☆48Updated last year
- HunyuanDiT with TensorRT and libtorch☆17Updated last year
- learn TensorRT from scratch🥰☆15Updated 8 months ago
- lightweighted deep learning inference service framework☆39Updated 3 years ago
- YOLOv5 in PyTorch > ONNX > CoreML > iOS☆9Updated 10 months ago
- 利用tensorflow/serving进行单模型、多模型、同一模型多版本的部署,并进行模型预测,并用Prothemus进行服务监控。☆11Updated 4 years ago
- ☆17Updated 3 years ago
- ☆14Updated 5 years ago
- 基于rknn的yolov5的cpp实现,包含各种依赖库,是一个完整工程,可直接编译运行☆19Updated 3 years ago
- Various test models in WNNX format. It can view with `pip install wnetron && wnetron`☆12Updated 2 years ago
- Using TensorRT and Triton Server to build BERT model as a service☆13Updated 3 years ago
- ☆25Updated 9 months ago
- Whisper in TensorRT-LLM☆15Updated last year
- ocr with yolo3 as feature extractor, implemented by keras, and accelerated by tensorrt☆34Updated 4 years ago
- ☆13Updated 2 years ago
- convert paddleOCR to torchOCR, ppocr-v3,ppocr-v4, onnx, openvino☆32Updated last year