pytorch / TensorRTLinks
PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT
☆2,873Updated last week
Alternatives and similar repositories for TensorRT
Users that are interested in TensorRT are comparing it to the libraries listed below
Sorting:
- ONNX-TensorRT: TensorRT backend for ONNX☆3,156Updated last month
- Simplify your onnx model☆4,209Updated last month
- An easy to use PyTorch to TensorRT converter☆4,824Updated last year
- CV-CUDA™ is an open-source, GPU accelerated library for cloud-scale image processing and computer vision.☆2,588Updated 5 months ago
- A tool to modify ONNX models in a visualization fashion, based on Netron and Flask.☆1,563Updated 7 months ago
- ONNX Optimizer☆764Updated 2 weeks ago
- A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep lear…☆5,531Updated this week
- A unified library of state-of-the-art model optimization techniques like quantization, pruning, distillation, speculative decoding, etc. …☆1,443Updated last week
- PyTorch extensions for high performance and large scale training.☆3,380Updated 5 months ago
- Simple samples for TensorRT programming☆1,644Updated 4 months ago
- SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX R…☆2,511Updated this week
- AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.☆2,471Updated this week
- NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source compone…☆12,250Updated 3 weeks ago
- Convert TensorFlow, Keras, Tensorflow.js and Tflite models to ONNX☆2,478Updated last month
- OpenMMLab Model Deployment Framework☆3,052Updated last year
- A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper, Ada and Bla…☆2,834Updated this week
- TensorFlow/TensorRT integration☆744Updated last year
- TorchBench is a collection of open source benchmarks used to evaluate PyTorch performance.☆988Updated this week
- Tensorflow Backend for ONNX☆1,325Updated last year
- Deploy your model with TensorRT quickly.☆765Updated last year
- Collection of common code that's shared among different research projects in FAIR computer vision team.☆2,189Updated last month
- Neural Network Compression Framework for enhanced OpenVINO™ inference☆1,087Updated last week
- A Python-level JIT compiler designed to make unmodified PyTorch programs faster.☆1,064Updated last year
- A primitive library for neural network☆1,363Updated 10 months ago
- Triton backend that enables pre-process, post-processing and other logic to be implemented in Python.☆648Updated last week
- OpenMMLab Foundational Library for Training Deep Learning Models☆1,385Updated last month
- The Triton Inference Server provides an optimized cloud and edge inferencing solution.☆9,908Updated this week
- This repository contains tutorials and examples for Triton Inference Server☆787Updated last week
- A CPU+GPU Profiling library that provides access to timeline traces and hardware performance counters.☆881Updated this week
- PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.☆823Updated 2 months ago