leimao / ONNX-Python-Examples
ONNX Python Examples
☆16Updated 2 years ago
Alternatives and similar repositories for ONNX-Python-Examples:
Users that are interested in ONNX-Python-Examples are comparing it to the libraries listed below
- A Toolkit to Help Optimize Large Onnx Model☆153Updated 11 months ago
- Count number of parameters / MACs / FLOPS for ONNX models.☆91Updated 6 months ago
- ☆71Updated 2 years ago
- Inference of quantization aware trained networks using TensorRT☆80Updated 2 years ago
- ☆99Updated 3 years ago
- A tool convert TensorRT engine/plan to a fake onnx☆38Updated 2 years ago
- NVIDIA TensorRT Hackathon 2023复赛选题:通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆42Updated last year
- PyTorch Quantization Aware Training Example☆135Updated 11 months ago
- MegEngine到其他框架的转换器☆69Updated 2 years ago
- Roughly calculate FLOPs of a tflite model☆38Updated 3 years ago
- 天池 NVIDIA TensorRT Hackathon 2023 —— 生成式AI模型优化赛 初赛第三名方案☆49Updated last year
- Utility scripts for editing or modifying onnx models. Utility scripts to summarize onnx model files along with visualization for loop ope…☆79Updated 3 years ago
- A Toolkit to Help Optimize Onnx Model☆140Updated last week
- ☆26Updated last year
- ONNX2Pytorch☆161Updated 4 years ago
- Convert tflite to JSON and make it editable in the IDE. It also converts the edited JSON back to tflite binary.☆27Updated 2 years ago
- ResNet Implementation, Training, and Inference Using LibTorch C++ API☆40Updated 10 months ago
- simplify >2GB large onnx model☆55Updated 4 months ago
- TensorRT 2022复赛方案: 首个基于Transformer的图像重建模型MST++的TensorRT模型推断优化☆138Updated 2 years ago
- Script to typecast ONNX model parameters from INT64 to INT32.☆106Updated 11 months ago
- A code generator from ONNX to PyTorch code☆136Updated 2 years ago
- 一大波学习onnx的案例☆15Updated 7 months ago
- [CVPR-2023] Towards Any Structural Pruning☆16Updated last year
- Large Language Model Onnx Inference Framework☆32Updated 3 months ago
- ☆24Updated last year
- triton server ensemble model demo☆30Updated 2 years ago
- ONNX Runtime Inference C++ Example☆235Updated 3 weeks ago
- Serving Inside Pytorch☆160Updated this week
- ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化☆46Updated last year
- The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.☆132Updated this week