Alternatives and similar repositories for Deepstream-Box

Users that are interested in Deepstream-Box are comparing it to the libraries listed below

• ozanarmagan / clip_tokenizer_cpp
  ☆10Updated last year
• hopef / llama3_chat
  Llama3 Streaming Chat Sample
  ☆22Updated last year
• raymond1123 / hgemm
  ☆30Updated last year
• caibucai22 / awesome-cuda
  Awesome code, projects, books, etc. related to CUDA
  ☆28Updated last month
• sesmfs / onnx_quant_tool
  An onnx-based quantitation tool.
  ☆71Updated 2 years ago
• ZHEQIUSHUI / CLIP-ONNX-AX650-CPP
  c++实现的clip推理，模型有一点点改动，但是不大，改动和导出模型的代码可以在readme里找到，模型文件都在Releases里，包括AX650的模型。新增支持ChineseCLIP
  ☆30Updated 7 months ago
• yhwang-hub / yolov5_QAT
  Quantize yolov5 using pytorch_quantization.🚀🚀🚀
  ☆14Updated 2 years ago
• richjjj / duscratch
  搜藏的希望的代码片段
  ☆13Updated 2 years ago
• kalfazed / multi-thread-programming
  This is a repository to practice multi-thread programming in C++
  ☆26Updated last year
• richjjj / cuvid-tensorrt-multi
  ffmpeg+cuvid+tensorrt+multicamera
  ☆12Updated last year
• Phoenix8215 / learn-TensorRT-from-scratch
  learn TensorRT from scratch🥰
  ☆18Updated last year
• l-sf / Nanodet_openvino_quant_deploy
  本仓库在OpenVINO推理框架下部署Nanodet检测算法，并重写预处理和后处理部分，具有超高性能！让你在Intel CPU平台上的检测速度起飞！ 并基于NNCF和PPQ工具将模型量化(PTQ)至int8精度，推理速度更快！
  ☆16Updated 2 years ago
• FeiGeChuanShu / trt2023
  NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化
  ☆43Updated 2 years ago
• AXERA-TECH / OWLVIT-ONNX-AX650-CPP
  ☆23Updated 2 years ago
• cqu20160901 / DETR_onnx_tensorRT_V2
  DETR tensor去除推理过程无用辅助头+fp16部署再次加速+解决转tensorrt 输出全为0问题的新方法。
  ☆12Updated 2 years ago
• AXERA-TECH / ONNX-YOLO-World-Open-Vocabulary-Object-Detection
  Python scripts performing Open Vocabulary Object Detection using the YOLO-World model in ONNX. And Export the ONNX model for AXera's NPU
  ☆12Updated 5 months ago
• triple-mu / HunyuanDiT-TensorRT-libtorch
  HunyuanDiT with TensorRT and libtorch
  ☆18Updated last year
• emptysoal / cuda-image-preprocess
  Speed up image preprocess with cuda when handle image or tensorrt inference
  ☆83Updated 2 months ago
• yhwang-hub / yolov7_QAT
  Quantize yolov7 using pytorch_quantization.🚀🚀🚀
  ☆11Updated 2 years ago
• yuxiaoranyu / stable_diffusion_trt_triton
  ☆20Updated 2 years ago
• nuwandda / cuda-histogram-equalization
  Implementation of a histogram equalization program using CUDA. Histogram equalization is a technique for adjusting image intensities to e…
  ☆13Updated 5 years ago
• zpye / SimpleInfer
  A simple neural network inference framework
  ☆25Updated 2 years ago
• wangzhaode / onnx-llm
  llm deploy project based onnx.
  ☆49Updated last year
• BaofengZan / my_trt_pro
  跟着Tensorrt_pro学习各种知识
  ☆40Updated 3 years ago
• inisis / OnnxLLM
  Large Language Model Onnx Inference Framework
  ☆36Updated last month
• Dominic23331 / rtmpose_tensorrt
  ☆22Updated last year
• shouxieai / tensorRT_quantization
  该代码与B站上的视频 https://www.bilibili.com/video/BV18L41197Uz/?spm_id_from=333.788&vd_source=eefa4b6e337f16d87d87c2c357db8ca7 相关联。
  ☆71Updated 2 years ago
• Tlntin / trt2023
  ☆26Updated 2 years ago
• luliyucoordinate / flash-attention-minimal
  Flash Attention in ~100 lines of CUDA (forward pass only)
  ☆11Updated last year
• Guanbin-Huang / camera_calibration_cpp
  ☆19Updated 3 years ago