microsoft / onnxruntime-extensionsLinks
onnxruntime-extensions: A specialized pre- and post- processing library for ONNX Runtime
☆409Updated last week
Alternatives and similar repositories for onnxruntime-extensions
Users that are interested in onnxruntime-extensions are comparing it to the libraries listed below
Sorting:
- Common utilities for ONNX converters☆276Updated last month
- ONNX Script enables developers to naturally author ONNX functions and models using a subset of Python.☆376Updated this week
- ONNX Optimizer☆742Updated 3 weeks ago
- Examples for using ONNX Runtime for model training.☆340Updated 10 months ago
- The Triton backend for the ONNX Runtime.☆159Updated 3 weeks ago
- ONNXMLTools enables conversion of models to ONNX☆1,105Updated 2 months ago
- A Toolkit to Help Optimize Onnx Model☆197Updated 2 weeks ago
- Generative AI extensions for onnxruntime☆806Updated this week
- Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Serv…☆484Updated 3 weeks ago
- Triton Python, C++ and Java client libraries, and GRPC-generated client examples for go, java and scala.☆641Updated last week
- Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.☆210Updated 4 months ago
- Universal cross-platform tokenizers binding to HF and sentencepiece☆377Updated 2 weeks ago
- Common source, scripts and utilities for creating Triton backends.☆342Updated 3 weeks ago
- A parser, editor and profiler tool for ONNX models.☆451Updated 3 weeks ago
- 🤗 Optimum Intel: Accelerate inference with Intel optimization tools☆485Updated this week
- Accelerate PyTorch models with ONNX Runtime☆363Updated 6 months ago
- The Triton backend for TensorRT.☆78Updated 3 weeks ago
- LLaMa/RWKV onnx models, quantization and testcase☆363Updated 2 years ago
- Use safetensors with ONNX 🤗☆69Updated last month
- Triton backend that enables pre-process, post-processing and other logic to be implemented in Python.☆632Updated last week
- Transform ONNX model to PyTorch representation☆339Updated 9 months ago
- Convert ONNX models to PyTorch.☆697Updated last year
- Neural Network Compression Framework for enhanced OpenVINO™ inference☆1,074Updated this week
- Examples for using ONNX Runtime for machine learning inferencing.☆1,454Updated this week
- The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.☆136Updated 2 weeks ago
- Representation and Reference Lowering of ONNX Models in MLIR Compiler Infrastructure☆901Updated this week
- Inference Vision Transformer (ViT) in plain C/C++ with ggml☆292Updated last year
- PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.☆816Updated last week
- Model compression for ONNX☆97Updated 9 months ago
- A unified library of state-of-the-art model optimization techniques like quantization, pruning, distillation, speculative decoding, etc. …☆1,141Updated this week