pytorch / ortLinks
Accelerate PyTorch models with ONNX Runtime
☆364Updated 7 months ago
Alternatives and similar repositories for ort
Users that are interested in ort are comparing it to the libraries listed below
Sorting:
- torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…☆181Updated last month
- Examples for using ONNX Runtime for model training.☆348Updated 11 months ago
- TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…☆392Updated this week
- Scailable ONNX python tools☆97Updated 11 months ago
- A GPU performance profiling tool for PyTorch models☆505Updated 4 years ago
- The Triton backend for the PyTorch TorchScript models.☆159Updated last week
- ONNX Script enables developers to naturally author ONNX functions and models using a subset of Python.☆400Updated this week
- Implementation of a Transformer, but completely in Triton☆275Updated 3 years ago
- Common utilities for ONNX converters☆281Updated last month
- DiffQ performs differentiable quantization using pseudo quantization noise. It can automatically tune the number of bits used per weight …☆236Updated 2 years ago
- The Triton backend for the ONNX Runtime.☆162Updated last week
- Torch Distributed Experimental☆117Updated last year
- Slicing a PyTorch Tensor Into Parallel Shards☆301Updated 3 months ago
- Provide Python access to the NVML library for GPU diagnostics☆247Updated 3 weeks ago
- Library for 8-bit optimizers and quantization routines.☆780Updated 3 years ago
- A library that contains a rich collection of performant PyTorch model metrics, a simple interface to create new metrics, a toolkit to fac…☆241Updated last week
- Plugin for deploying MLflow models to TorchServe☆110Updated 2 years ago
- Recipes are a standard, well supported set of blueprints for machine learning engineers to rapidly train models using the latest research…☆330Updated this week
- Prune a model while finetuning or training.☆405Updated 3 years ago
- A code generator from ONNX to PyTorch code☆141Updated 2 years ago
- A Python-level JIT compiler designed to make unmodified PyTorch programs faster.☆1,063Updated last year
- Pytorch Lightning Distributed Accelerators using Ray☆214Updated last year
- PyTorch interface for the IPU☆181Updated last year
- PyTorch RFCs (experimental)☆135Updated 4 months ago
- onnxruntime-extensions: A specialized pre- and post- processing library for ONNX Runtime☆414Updated this week
- Productionize machine learning predictions, with ONNX or without☆66Updated last year
- High performance model preprocessing library on PyTorch☆645Updated last year
- Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.☆211Updated 5 months ago
- Configuration classes enabling type-safe PyTorch configuration for Hydra apps☆222Updated 3 years ago
- A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…☆161Updated 2 weeks ago