Alternatives and similar repositories for Bert_TensorRT

Users that are interested in Bert_TensorRT are comparing it to the libraries listed below

• lin-honghui / data-competition-calendar
  国内外数据竞赛资讯整理
  ☆18Updated 4 years ago
• TRT2022 / ControlNet_TensorRT
  天池 NVIDIA TensorRT Hackathon 2023 —— 生成式AI模型优化赛 初赛第三名方案
  ☆50Updated 2 years ago
• morsoli / llmbenchmark
  大模型API性能指标比较 - 深入分析TTFT、TPS等关键指标
  ☆19Updated last year
• FeiGeChuanShu / trt2023
  NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化
  ☆43Updated 2 years ago
• miemie2013 / Pure_Python_Deep_Learning
  纯Python实现的深度学习框架，帮助你理解底层细节斩获offer
  ☆21Updated 3 years ago
• shouxieai / cpp-rotation-album
  cpp rotation album，基于cpp eigen实现的3d旋转相册，GAMES101复现内容
  ☆12Updated 3 years ago
• TRT2022 / trtllm-llama
  ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化
  ☆51Updated 2 years ago
• lucasjinreal / wanwu_release
  Wanwu models release, code will be released soon
  ☆24Updated 3 years ago
• Tramac / tensorrt-tutorial
  TensorRT简明教程
  ☆26Updated 4 years ago
• hpc203 / dbnet-barcode
  使用DBNet检测条形码，包含C++和Python两种版本的程序
  ☆37Updated 4 years ago
• chineseocr / ai-medical
  陆续开源医疗行业的深度学习模型及数据集
  ☆13Updated 4 years ago
• isLinXu / paper-read-notes
  paper-read-notes
  ☆14Updated last year
• wjc852456 / ONNX-TensorRT-LibTorch
  deploy onnx models with TensorRT and LibTorch
  ☆19Updated 4 years ago
• zhahoi / PlateRecognition_ncnn
  高性能 高精度 大陆车牌、港澳车牌、台湾车牌 韩国车牌(South Korea LPR)识别 代码开源(ncnn移植）
  ☆41Updated 2 months ago
• xiaqing10 / RKNN_YOLOV5S_CPP
  基于rknn的yolov5的cpp实现，包含各种依赖库，是一个完整工程，可直接编译运行
  ☆21Updated 3 years ago
• AXERA-TECH / CLIP-ONNX-AX650-CPP
  ☆28Updated 7 months ago
• miemie2013 / miemienet
  miemienet is a C++ AI deep learning inference framework.Supports PPYOLOE、PICODET.
  ☆12Updated 3 years ago
• TengFeiHan0 / CenterMask_plus
  ☆14Updated 5 years ago
• triple-mu / TensorRT2ONNX
  A tool convert TensorRT engine/plan to a fake onnx
  ☆42Updated 3 years ago
• EdVince / whisper-trtllm
  Whisper in TensorRT-LLM
  ☆17Updated 2 years ago
• ChenCVer / python_cpp_extension
  C++ and CUDA extensions for Python/Pytorch and GPU Accelerated Augmentation.
  ☆35Updated 3 years ago
• triple-mu / HunyuanDiT-TensorRT-libtorch
  HunyuanDiT with TensorRT and libtorch
  ☆18Updated last year
• LeeJuly30 / BERTCpp
  implement bert in pure c++
  ☆36Updated 5 years ago
• MachineLP / QDServing
  ml模型分布式服务部署：grpc，flask；docker
  ☆76Updated 5 years ago
• DataXujing / YOLOv12-TensorRT
  YOLOv12 TensorRT 端到端模型加速推理和INT8量化实现
  ☆13Updated 10 months ago
• DataXujing / YOLOv6
  手摸手 美团 YOLOv6模型训练和TensorRT端到端部署方案教程
  ☆34Updated 3 years ago
• BADBADBADBOY / baipiaoOCR
  convert paddleOCR to torchOCR, ppocr-v3,ppocr-v4, onnx, openvino
  ☆33Updated 2 years ago
• lxl24 / SwinTransformerV2_TensorRT
  For 2022 Nvidia Hackathon
  ☆22Updated 3 years ago
• k9ele7en / Triton-TensorRT-Inference-CRAFT-pytorch
  Advanced inference pipeline using NVIDIA Triton Inference Server for CRAFT Text detection (Pytorch), included converter from Pytorch -> O…
  ☆33Updated 4 years ago
• DayBreak-u / thundernet_ncnn
  the C++ version of thundernet with ncnn
  ☆14Updated 4 years ago