Alternatives and similar repositories for concurrent_inference

Users that are interested in concurrent_inference are comparing it to the libraries listed below

• triton-inference-server / dali_backend
  The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.
  ☆140Updated this week
• isarsoft / yolov4-triton-tensorrt
  This repository deploys YOLOv4 as an optimized TensorRT engine to Triton Inference Server
  ☆284Updated 3 years ago
• huynhbaobk / tensorrt-triton-yolov5
  ☆53Updated 4 years ago
• tienluongngoc / yolov5_triton_inference_server
  ☆53Updated 3 years ago
• louisoutin / yolov5_torchserve
  Torchserve server using a YoloV5 model running on docker with GPU and static batch inference to perform production ready and real time in…
  ☆101Updated 2 years ago
• BlueMirrors / cvu
  Computer Vision deployment tools for dummies and experts. CVU aims at making CV pipelines easier to build and consistent around platform…
  ☆90Updated 2 years ago
• zhouyuchong / face-recognition-deepstream
  Deepstream app use retinaface and arcface for face recognition.
  ☆78Updated last year
• ljk53 / pytorch-rpi
  Share PyTorch binaries built for Raspberry Pi
  ☆90Updated 4 years ago
• ml6team / deepstream-python
  NVIDIA Deepstream 6.1 Python boilerplate
  ☆146Updated 2 years ago
• NVIDIA-AI-IOT / deepstream_lpr_app
  Sample app code for LPR deployment on DeepStream
  ☆228Updated last year
• dnth / yolov5-deepsparse-blogpost
  By the end of this post, you will learn how to: Train a SOTA YOLOv5 model on your own data. Sparsify the model using SparseML quantizati…
  ☆57Updated 2 years ago
• prominenceai / deepstream-services-library
  A shared library of on-demand DeepStream Pipeline Services for Python and C/C++
  ☆334Updated 10 months ago
• thatbrguy / Deep-Stream-ONNX
  How to deploy ONNX models using DeepStream on Jetson Nano
  ☆102Updated 4 years ago
• MegaMosquito / slipstream
  A simple Python example that uses Deepstream to process a video stream.
  ☆37Updated 4 years ago
• NVIDIA-AI-IOT / deepstream_triton_model_deploy
  How to deploy open source models using DeepStream and Triton Inference Server
  ☆86Updated last year
• leimao / ONNX-Runtime-Inference
  ONNX Runtime Inference C++ Example
  ☆258Updated 10 months ago
• UranKhatolaaa / deepstream-examples
  NVIDIA Jetson amd Deepstream Python Examples
  ☆30Updated 4 years ago
• NVIDIA-AI-IOT / deepstream_parallel_inference_app
  A project demonstrating how to use nvmetamux to run multiple models in parallel.
  ☆112Updated last year
• Curt-Park / mnist-fastapi-aio-triton
  Simple example of FastAPI + gRPC AsyncIO + Triton
  ☆69Updated 3 years ago
• mrtj / pyds_tracker_meta
  A Python wrapper written in C++11 for past frame tracking result metadata classes in Nvidia's DeepStream framework, providing functionali…
  ☆31Updated 5 years ago
• galliot-us / adaptive-object-detection
  ☆23Updated 3 years ago
• pbridger / pytorch-video-pipeline
  ☆116Updated 5 years ago
• NNDam / Vietnamese-License-Plate-Generator
  Vietnamese License Plate Generator for OCR part
  ☆25Updated last year
• karthickai / YOLOV4_DeepStream_5.0
  YOLOv4 in NVIDIA DeepStream 5.0 (DarkNet or Pytorch --> ONNX --> TensorRT --> DeepStream)
  ☆11Updated 5 years ago
• bharatsubedi / ALPR-Yolov5
  ☆68Updated 3 years ago
• zhouyuchong / gst-nvinfer-custom
  Custom gst-nvinfer for alignment in Deepstream
  ☆30Updated last year
• renatoviolin / Deploying-Deep-Learning-Models-in-C-A-comparison-with-Python-server
  ☆10Updated 4 years ago
• NVIDIA-AI-IOT / face-mask-detection
  Face Mask Detection using NVIDIA Transfer Learning Toolkit (TLT) and DeepStream for COVID-19
  ☆249Updated last year
• NVIDIA-AI-IOT / deepstream-retail-analytics
  A DeepStream sample application demonstrating end-to-end retail video analytics for brick-and-mortar retail.
  ☆52Updated 3 years ago
• BlueMirrors / Yolov5-TensorRT
  Yolov5 TensorRT Implementations
  ☆67Updated 3 years ago