Alternatives and similar repositories for PaddleOCR-Torch-Infer

Users that are interested in PaddleOCR-Torch-Infer are comparing it to the libraries listed below

• EdVince / whisper-trtllm
  Whisper in TensorRT-LLM
  ☆17Updated 2 years ago
• FeiGeChuanShu / trt2023
  NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化
  ☆43Updated 2 years ago
• futz12 / uie_ncnn_windows
  UIE(Universal Information Extraction) infer by ncnn
  ☆15Updated last year
• hpc203 / CoupledTPS-opencv-dnn
  使用OpenCV部署CoupledTPS，包含了肖像矫正，不规则边界的图像矩形化，旋转图像矫正，三个模型。依然是包含C++和Python两个版本的程序
  ☆20Updated last year
• sophgo / ChatGLM2-TPU
  run ChatGLM2-6B in BM1684X
  ☆49Updated last year
• yvonwin / qwen2.cpp
  qwen2 and llama3 cpp implementation
  ☆49Updated last year
• zjd1988 / seetaface2_onnx_model
  only contain face detect 、5/81 points 、face recognization models
  ☆11Updated 5 years ago
• wjc852456 / ONNX-TensorRT-LibTorch
  deploy onnx models with TensorRT and LibTorch
  ☆19Updated 4 years ago
• AXERA-TECH / CLIP-ONNX-AX650-CPP
  ☆28Updated 7 months ago
• hpc203 / Real-Time-Frame-Interpolation-onnxrun
  使用onnxruntime部署实时视频帧插值，包含C++和Python两个版本的程序
  ☆28Updated last year
• lrw04 / tinyllamas-ncnn
  Inference TinyLlama models on ncnn
  ☆24Updated 2 years ago
• hpc203 / face-gaze-estimation-opencv-dnn
  使用OpenCV部署L2CS-Net人脸朝向估计，包含C++和Python两个版本的程序，只依赖opencv库就可以运行
  ☆21Updated 2 years ago
• BaofengZan / GOT-OCRv2-onnx
  用于学习GOT/Qwen/OnnxLLm
  ☆53Updated last year
• morsoli / llmbenchmark
  大模型API性能指标比较 - 深入分析TTFT、TPS等关键指标
  ☆20Updated last year
• inisis / OnnxLLM
  Large Language Model Onnx Inference Framework
  ☆36Updated 2 months ago
• OAID / TengineInferPipe
  ☆24Updated 3 years ago
• EdVince / llm-cpp
  ☆33Updated last year
• TRT2022 / ControlNet_TensorRT
  天池 NVIDIA TensorRT Hackathon 2023 —— 生成式AI模型优化赛 初赛第三名方案
  ☆50Updated 2 years ago
• iimmortall / QuantLib
  ☆14Updated 4 years ago
• mlbo / Insightface-NPU
  ☆25Updated 4 years ago
• lucasjinreal / wanwu_release
  Wanwu models release, code will be released soon
  ☆24Updated 3 years ago
• thomaszheng / OcrLiteMnn
  ChineseOcr Lite Mnn，超轻量级中文OCR PC Demo，使用MNN推理
  ☆27Updated 4 years ago
• Plumess / yolov5-qnn
  YOLOv5在高通AI Engine Direct环境下进行QNN量化，CPU推理的项目
  ☆16Updated last year
• chineseocr / ai-medical
  陆续开源医疗行业的深度学习模型及数据集
  ☆13Updated 4 years ago
• TRT2022 / trtllm-llama
  ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化
  ☆51Updated 2 years ago
• percent4 / yi_vl_experiment
  本项目是关于Yi的多模态系列模型，如Yi-VL-6B/34B等的实验与应用。
  ☆14Updated 2 years ago
• Zolewit / TNNdemo
  很好用的tnn classify demo
  ☆11Updated 4 years ago
• DataXujing / Bert_TensorRT
  Bert TensorRT模型加速部署
  ☆10Updated 3 years ago
• wangzhaode / tokenizer.cpp
  A lightweight, production-ready C++ library for LLM tokenization, fully compatible with HuggingFace tokenizer.json.
  ☆21Updated last month
• triple-mu / TensorRT2ONNX
  A tool convert TensorRT engine/plan to a fake onnx
  ☆42Updated 3 years ago