Accelerate PyTorch models with ONNX Runtime
☆368Feb 5, 2026Updated 3 weeks ago
Alternatives and similar repositories for ort
Users that are interested in ort are comparing it to the libraries listed below
Sorting:
- A Python-level JIT compiler designed to make unmodified PyTorch programs faster.☆1,075Apr 17, 2024Updated last year
- High performance model preprocessing library on PyTorch☆646Mar 29, 2024Updated last year
- PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT☆2,947Updated this week
- Smoothly deprecate and redirect Python functions/classes with smart warnings and auto-routing—keep your codebase clean while maintaining …☆54Updated this week
- Examples for using ONNX Runtime for model training.☆363Oct 23, 2024Updated last year
- A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.☆1,248Feb 22, 2026Updated last week
- PyTorch extensions for high performance and large scale training.☆3,400Apr 26, 2025Updated 10 months ago
- TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and sup…☆417Updated this week
- Simple repository contribution statistics☆15Jan 20, 2026Updated last month
- ☆15Aug 3, 2021Updated 4 years ago
- ONNX Command-Line Toolbox☆35Oct 11, 2024Updated last year
- functorch is JAX-like composable function transforms for PyTorch.☆1,436Aug 21, 2025Updated 6 months ago
- 🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization…☆3,296Feb 9, 2026Updated 2 weeks ago
- ONNX Optimizer☆797Feb 4, 2026Updated 3 weeks ago
- Supplementary components to accelerate research and development in PyTorch☆280Updated this week
- torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…☆179Dec 16, 2025Updated 2 months ago
- New operators for the ReferenceEvaluator, new kernels for onnxruntime, CPU, CUDA☆35Feb 13, 2026Updated 2 weeks ago
- Slicing a PyTorch Tensor Into Parallel Shards☆300Jun 7, 2025Updated 8 months ago
- A GPU performance profiling tool for PyTorch models☆509Jul 13, 2021Updated 4 years ago
- Common utilities for ONNX converters☆295Dec 16, 2025Updated 2 months ago
- Olive: Simplify ML Model Finetuning, Conversion, Quantization, and Optimization for CPUs, GPUs and NPUs.☆2,255Updated this week
- Torch Distributed Experimental☆117Aug 5, 2024Updated last year
- Type annotations and dynamic checking for a tensor's shape, dtype, names, etc.☆1,472May 2, 2025Updated 9 months ago
- A CPU+GPU Profiling library that provides access to timeline traces and hardware performance counters.☆922Updated this week
- Serve, optimize and scale PyTorch models in production☆4,359Aug 6, 2025Updated 6 months ago
- Prune a model while finetuning or training.☆406Jun 21, 2022Updated 3 years ago
- A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on H…☆3,170Feb 21, 2026Updated last week
- Flexible components pairing 🤗 Transformers with Pytorch Lightning☆612Nov 21, 2022Updated 3 years ago
- AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (N…☆4,706Jan 12, 2026Updated last month
- Parallelformers: An Efficient Model Parallelization Toolkit for Deployment☆791Apr 24, 2023Updated 2 years ago
- Toolbox of models, callbacks, and datasets for AI/ML researchers.☆1,752Jan 20, 2026Updated last month
- Library for 8-bit optimizers and quantization routines.☆780Aug 18, 2022Updated 3 years ago
- A very simple tool that compresses the overall size of the ONNX model by aggregating duplicate constant values as much as possible.☆52Sep 8, 2022Updated 3 years ago
- Simplify your onnx model☆4,297Updated this week
- 🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (i…☆9,513Updated this week
- Parallelized automatic corpus collection for ASR. Forked from https://github.com/EgorLakomkin/KTSpeechCrawler☆23Mar 21, 2021Updated 4 years ago
- 한국어 문서에 노이즈를 추가합니다.☆27Nov 9, 2022Updated 3 years ago
- Continuous builder and binary build scripts for pytorch☆355Aug 12, 2025Updated 6 months ago
- Transformer related optimization, including BERT, GPT☆6,394Mar 27, 2024Updated last year