inisis / OnnxSlim
A Toolkit to Help Optimize Onnx Model
☆89Updated this week
Alternatives and similar repositories for OnnxSlim:
Users that are interested in OnnxSlim are comparing it to the libraries listed below
- A Toolkit to Help Optimize Large Onnx Model☆148Updated 7 months ago
- Large Language Model Onnx Inference Framework☆27Updated 2 months ago
- llm deploy project based onnx.☆26Updated 2 months ago
- A tool convert TensorRT engine/plan to a fake onnx☆37Updated 2 years ago
- Serving Inside Pytorch☆147Updated last week
- SAM and lama inpaint,包含QT的GUI交互界面,实现了交互式可实时显示结果的画点、画框进行SAM,然后通过进行Inpaint,具体操作看readme里的视频。☆43Updated 10 months ago
- an example of segment-anything infer by ncnn☆120Updated last year
- Explore LLM model deployment based on AXera's AI chips☆56Updated 2 weeks ago
- Script to typecast ONNX model parameters from INT64 to INT32.☆97Updated 7 months ago
- stable diffusion using mnn☆65Updated last year
- ☆30Updated 4 months ago
- Implementation of YOLOv9 QAT optimized for deployment on TensorRT platforms.☆92Updated last month
- NVIDIA TensorRT Hackathon 2023复赛选题: 通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆41Updated last year
- mnn yolo demos.☆58Updated 2 months ago
- ☆62Updated 2 years ago
- ☆37Updated 2 years ago
- ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化☆44Updated last year
- ☆124Updated last year
- Quick and Self-Contained TensorRT Custom Plugin Implementation and Integration☆45Updated 6 months ago
- c++实现的clip推理,模型有一点点改动,但是不大,改动和导出模型的代码可以在readme里找到,模型文件都在Releases里,包括AX650的模型。新增支持ChineseCLIP☆27Updated 11 months ago
- segment-anything based mnn☆34Updated last year
- This repository provides optical character detection and recognition solution optimized on Nvidia devices.☆58Updated this week
- ☆19Updated 11 months ago
- simplify >2GB large onnx model☆45Updated 2 weeks ago
- Model compression for ONNX☆81Updated 3 weeks ago
- Deploy RT-EDTR with onnx from paddlepaddle framwork and graph cut☆27Updated last year
- ☆78Updated last year
- An onnx-based quantitation tool.☆71Updated 11 months ago
- TensorRT encapsulation, learn, rewrite, practice.☆26Updated 2 years ago