Alternatives and similar repositories for Bert_TensorRT

Users that are interested in Bert_TensorRT are comparing it to the libraries listed below

• lin-honghui / data-competition-calendar
  国内外数据竞赛资讯整理
  ☆18Updated 3 years ago
• TRT2022 / ControlNet_TensorRT
  天池 NVIDIA TensorRT Hackathon 2023 —— 生成式AI模型优化赛 初赛第三名方案
  ☆49Updated last year
• 10jqka-aicubes / table-recognition
  文档图片表格结构识别算法-同花顺算法挑战赛-2022年2-4月春季赛
  ☆25Updated 3 years ago
• morsoli / llmbenchmark
  大模型API性能指标比较 - 深入分析TTFT、TPS等关键指标
  ☆17Updated 8 months ago
• FeiGeChuanShu / trt2023
  NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化
  ☆42Updated last year
• shouxieai / cpp-rotation-album
  cpp rotation album，基于cpp eigen实现的3d旋转相册，GAMES101复现内容
  ☆12Updated 2 years ago
• chineseocr / ai-medical
  陆续开源医疗行业的深度学习模型及数据集
  ☆13Updated 3 years ago
• hpc203 / dbnet-barcode
  使用DBNet检测条形码，包含C++和Python两种版本的程序
  ☆35Updated 4 years ago
• miemie2013 / Pure_Python_Deep_Learning
  纯Python实现的深度学习框架，帮助你理解底层细节斩获offer
  ☆20Updated 2 years ago
• wjc852456 / ONNX-TensorRT-LibTorch
  deploy onnx models with TensorRT and LibTorch
  ☆17Updated 3 years ago
• Tramac / tensorrt-tutorial
  TensorRT简明教程
  ☆26Updated 3 years ago
• lucasjinreal / wanwu_release
  Wanwu models release, code will be released soon
  ☆24Updated 2 years ago
• isLinXu / paper-read-notes
  paper-read-notes
  ☆11Updated 8 months ago
• DataXujing / YOLOv6
  手摸手 美团 YOLOv6模型训练和TensorRT端到端部署方案教程
  ☆31Updated 2 years ago
• TRT2022 / trtllm-llama
  ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化
  ☆48Updated last year
• triple-Mu / HunyuanDiT-TensorRT-libtorch
  HunyuanDiT with TensorRT and libtorch
  ☆17Updated last year
• Phoenix8215 / learn-TensorRT-from-scratch
  learn TensorRT from scratch🥰
  ☆15Updated 8 months ago
• thuwyh / InferLight
  lightweighted deep learning inference service framework
  ☆39Updated 3 years ago
• linghu8812 / yolov5
  YOLOv5 in PyTorch > ONNX > CoreML > iOS
  ☆9Updated 10 months ago
• percent4 / tensorflow_serving_examples
  利用tensorflow/serving进行单模型、多模型、同一模型多版本的部署，并进行模型预测，并用Prothemus进行服务监控。
  ☆11Updated 4 years ago
• ppogg / ncnn-android-v5lite
  ☆17Updated 3 years ago
• TengFeiHan0 / CenterMask_plus
  ☆14Updated 5 years ago
• xiaqing10 / RKNN_YOLOV5S_CPP
  基于rknn的yolov5的cpp实现，包含各种依赖库，是一个完整工程，可直接编译运行
  ☆19Updated 3 years ago
• lucasjinreal / wnnx_models
  Various test models in WNNX format. It can view with `pip install wnetron && wnetron`
  ☆12Updated 2 years ago
• xiangyangkan / faster-bert-as-service
  Using TensorRT and Triton Server to build BERT model as a service
  ☆13Updated 3 years ago
• zhangfaen / finetune-InternVL2
  ☆25Updated 9 months ago
• EdVince / whisper-trtllm
  Whisper in TensorRT-LLM
  ☆15Updated last year
• zhaogangthu / keras-yolo3-ocr-tensorrt
  ocr with yolo3 as feature extractor, implemented by keras, and accelerated by tensorrt
  ☆34Updated 4 years ago
• BBuf / oneflow-cifar
  ☆13Updated 2 years ago
• BADBADBADBOY / baipiaoOCR
  convert paddleOCR to torchOCR, ppocr-v3,ppocr-v4, onnx, openvino
  ☆32Updated last year