Alternatives and similar repositories for tensorrt

Users that are interested in tensorrt are comparing it to the libraries listed below

• onnx / onnx-tensorflow
  Tensorflow Backend for ONNX
  ☆1,326Updated last year
• leimao / Frozen-Graph-TensorFlow
  Save, Load Frozen Graph and Run Inference From Frozen Graph in TensorFlow 1.x and 2.x
  ☆304Updated 5 years ago
• NVIDIA-AI-IOT / tf_trt_models
  TensorFlow models accelerated with NVIDIA TensorRT
  ☆692Updated 4 years ago
• onnx / keras-onnx
  Convert tf.keras/Keras models to ONNX
  ☆381Updated 4 years ago
• NVIDIA-AI-IOT / tf_to_trt_image_classification
  Image classification with NVIDIA TensorRT from TensorFlow models.
  ☆460Updated 5 years ago
• tensorflow / model-optimization
  A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.
  ☆1,559Updated this week
• NVIDIA / tensorrt-laboratory
  Explore the Capabilities of the TensorRT Platform
  ☆264Updated 4 years ago
• ardianumam / Tensorflow-TensorRT
  This repository is for my YT video series about optimizing a Tensorflow deep learning model using TensorRT. We demonstrate optimizing LeN…
  ☆300Updated 6 years ago
• NVIDIA / retinanet-examples
  Fast and accurate object detection with end-to-end GPU optimization
  ☆901Updated 4 years ago
• tensorflow / runtime
  A performant and modular runtime for TensorFlow
  ☆756Updated 3 months ago
• NVIDIA / object-detection-tensorrt-example
  Running object detection on a webcam feed using TensorRT on NVIDIA GPUs in Python.
  ☆228Updated 4 years ago
• onnx / tensorflow-onnx
  Convert TensorFlow, Keras, Tensorflow.js and Tflite models to ONNX
  ☆2,500Updated 3 months ago
• google-research / tf-slim
  ☆371Updated 6 months ago
• onnx / onnx-docker
  Dockerfiles and scripts for ONNX container images
  ☆138Updated 3 years ago
• zerollzeng / tiny-tensorrt
  Deploy your model with TensorRT quickly.
  ☆764Updated 2 years ago
• onnx / onnx-tensorrt
  ONNX-TensorRT: TensorRT backend for ONNX
  ☆3,175Updated last month
• openvinotoolkit / model_server
  A scalable inference server for models optimized with OpenVINO™
  ☆804Updated this week
• pytorch / tvm
  TVM integration into PyTorch
  ☆456Updated 5 years ago
• onnx / optimizer
  ONNX Optimizer
  ☆780Updated last month
• pytorch / TensorRT
  PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT
  ☆2,907Updated this week
• tensorflow / custom-op
  Guide for building custom op for TensorFlow
  ☆385Updated 2 years ago
• rmccorm4 / tensorrt-utils
  ⚡ Useful scripts when using TensorRT
  ☆237Updated 5 years ago
• pytorch / QNNPACK
  Quantized Neural Network PACKage - mobile-optimized implementation of quantized neural network operators
  ☆1,548Updated 6 years ago
• triton-inference-server / model_analyzer
  Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Serv…
  ☆501Updated last week
• dkorobchenko / tensorrt-demo
  TensorRT and TensorFlow demo/example (python, jupyter notebook)
  ☆81Updated 6 years ago
• NVIDIA-AI-IOT / deepstream_reference_apps
  Samples for TensorRT/Deepstream for Tesla & Jetson
  ☆1,274Updated 2 months ago
• intel / ai-reference-models
  Intel® AI Reference Models: contains Intel optimizations for running deep learning workloads on Intel® Xeon® Scalable processors and Inte…
  ☆723Updated this week
• triton-inference-server / dali_backend
  The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.
  ☆139Updated this week
• facebookresearch / kill-the-bits
  Code for: "And the bit goes down: Revisiting the quantization of neural networks"
  ☆631Updated 5 years ago
• openxla / xprof
  A profiling and performance analysis tool for machine learning
  ☆452Updated this week