tsingmicro-toolchain / OnnxSlim
A Toolkit to Help Optimize Large Onnx Model
☆148Updated 6 months ago
Related projects ⓘ
Alternatives and complementary repositories for OnnxSlim
- A Toolkit to Help Optimize Onnx Model☆80Updated this week
- Offline Quantization Tools for Deploy.☆116Updated 10 months ago
- simplify >2GB large onnx model☆44Updated 8 months ago
- ☆123Updated 11 months ago
- stable diffusion using mnn☆63Updated last year
- an example of segment-anything infer by ncnn☆120Updated last year
- A converter for llama2.c legacy models to ncnn models.☆82Updated 11 months ago
- SAM and lama inpaint,包含QT的GUI交互界面,实现了交互式可实时显示结果的画点、画框 进行SAM,然后通过进行Inpaint,具体操作看readme里的视频。☆40Updated 9 months ago
- TensorRT encapsulation, learn, rewrite, practice.☆24Updated 2 years ago
- Serving Inside Pytorch☆145Updated this week
- ☆70Updated last year
- A parser, editor and profiler tool for ONNX models.☆400Updated this week
- ☆96Updated 3 years ago
- Large Language Model Onnx Inference Framework☆25Updated last month
- MegEngine到其他框架的转换器☆67Updated last year
- ☆32Updated last month
- Explore LLM model deployment based on AXera's AI chips☆54Updated last week
- NVIDIA TensorRT Hackathon 2023复赛选题:通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆40Updated last year
- TensorRT 2022复赛方案: 首个基于Transformer的图像重建模型MST++的TensorRT模型推断优化☆135Updated 2 years ago
- mnn yolo demos.☆56Updated last month
- PyTorch Neural Network eXchange☆526Updated this week
- Quick and Self-Contained TensorRT Custom Plugin Implementation and Integration☆38Updated 5 months ago
- Count number of parameters / MACs / FLOPS for ONNX models.☆89Updated 3 weeks ago
- A simple tutorial of SNPE.☆147Updated last year
- A set of examples around MegEngine☆30Updated 11 months ago
- A simple tool that can generate TensorRT plugin code quickly.☆221Updated last year
- ☆23Updated last year
- 该代码与B站上的视频 https://www.bilibili.com/video/BV18L41197Uz/?spm_id_from=333.788&vd_source=eefa4b6e337f16d87d87c2c357db8ca7 相关联。☆60Updated last year
- llm deploy project based onnx.☆26Updated last month