triton-inference-server / pytorch_backendLinks
The Triton backend for the PyTorch TorchScript models.
☆160Updated last week
Alternatives and similar repositories for pytorch_backend
Users that are interested in pytorch_backend are comparing it to the libraries listed below
Sorting:
- The Triton backend for the ONNX Runtime.☆162Updated 2 weeks ago
- Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.☆213Updated 6 months ago
- torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…☆180Updated last month
- The Triton backend for TensorRT.☆79Updated 2 weeks ago
- Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Serv…☆494Updated 2 weeks ago
- A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…☆161Updated last month
- PyTorch RFCs (experimental)☆135Updated 4 months ago
- Common source, scripts and utilities for creating Triton backends.☆352Updated 2 weeks ago
- Torch Distributed Experimental☆117Updated last year
- ☆121Updated last year
- Reference models for Intel(R) Gaudi(R) AI Accelerator☆165Updated last month
- TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…☆395Updated last week
- Home for OctoML PyTorch Profiler☆114Updated 2 years ago
- Distributed preprocessing and data loading for language datasets☆39Updated last year
- Implementation of a Transformer, but completely in Triton☆276Updated 3 years ago
- Provide Python access to the NVML library for GPU diagnostics☆248Updated last month
- Accelerate PyTorch models with ONNX Runtime☆365Updated 8 months ago
- ☆302Updated last week
- Triton CLI is an open source command line interface that enables users to create, deploy, and profile models served by the Triton Inferen…☆70Updated 2 weeks ago
- ☆72Updated 6 months ago
- A library to analyze PyTorch traces.☆416Updated last week
- 🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.☆215Updated last week
- ☆205Updated 5 months ago
- Easy and Efficient Quantization for Transformers☆202Updated 4 months ago
- A Fusion Code Generator for NVIDIA GPUs (commonly known as "nvFuser")☆357Updated last week
- Dynamic batching library for Deep Learning inference. Tutorials for LLM, GPT scenarios.☆102Updated last year
- A Python library transfers PyTorch tensors between CPU and NVMe☆120Updated 10 months ago
- This repository hosts code that supports the testing infrastructure for the PyTorch organization. For example, this repo hosts the logic …☆102Updated this week
- A tensor-aware point-to-point communication primitive for machine learning☆273Updated 2 months ago
- Applied AI experiments and examples for PyTorch☆299Updated 2 months ago