pytorch / TensorRT
PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT
☆2,597Updated this week
Related projects ⓘ
Alternatives and complementary repositories for TensorRT
- ONNX-TensorRT: TensorRT backend for ONNX☆2,953Updated 2 weeks ago
- An easy to use PyTorch to TensorRT converter☆4,612Updated 3 months ago
- Simplify your onnx model☆3,865Updated 2 months ago
- NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source compone…☆10,820Updated 2 weeks ago
- Actively maintained ONNX Optimizer☆647Updated 8 months ago
- CV-CUDA™ is an open-source, GPU accelerated library for cloud-scale image processing and computer vision.☆2,381Updated last month
- A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch☆8,415Updated 2 weeks ago
- A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs…☆1,979Updated this week
- PyTorch extensions for high performance and large scale training.☆3,195Updated last week
- Neural Network Compression Framework for enhanced OpenVINO™ inference☆943Updated this week
- TensorFlow/TensorRT integration☆736Updated 11 months ago
- SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX R…☆2,227Updated this week
- Deploy your model with TensorRT quickly.☆762Updated 11 months ago
- A tool to modify ONNX models in a visualization fashion, based on Netron and Flask.☆1,346Updated 2 weeks ago
- AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.☆2,148Updated this week
- Simple samples for TensorRT programming☆1,519Updated 2 weeks ago
- Implementation of popular deep learning networks with TensorRT network definition API☆7,016Updated 3 weeks ago
- Serve, optimize and scale PyTorch models in production☆4,218Updated 3 weeks ago
- Convert TensorFlow, Keras, Tensorflow.js and Tflite models to ONNX☆2,327Updated 2 months ago
- Collection of common code that's shared among different research projects in FAIR computer vision team.☆2,029Updated last month
- A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep lear…☆5,158Updated this week
- OpenMMLab Model Deployment Framework☆2,777Updated last month
- A Python-level JIT compiler designed to make unmodified PyTorch programs faster.☆1,011Updated 7 months ago
- Transformer related optimization, including BERT, GPT☆5,890Updated 7 months ago
- A high-performance Python-based I/O system for large (and small) deep learning problems, with strong support for PyTorch.☆2,328Updated last month
- [ICLR 2020] Once for All: Train One Network and Specialize it for Efficient Deployment☆1,884Updated 11 months ago
- Fast and accurate object detection with end-to-end GPU optimization☆887Updated 3 years ago
- View model summaries in PyTorch!☆2,603Updated this week
- Codebase for Image Classification Research, written in PyTorch.☆2,139Updated 8 months ago
- TensorRT Model Optimizer is a unified library of state-of-the-art model optimization techniques such as quantization, pruning, distillati…☆567Updated this week