triton-inference-server / paddlepaddle_backendLinks
☆36Updated last year
Alternatives and similar repositories for paddlepaddle_backend
Users that are interested in paddlepaddle_backend are comparing it to the libraries listed below
Sorting:
- The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.☆139Updated 3 weeks ago
- Compare multiple optimization methods on triton to imporve model service performance☆53Updated last year
- Serving Inside Pytorch☆163Updated last week
- ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化☆50Updated last year
- Common source, scripts and utilities for creating Triton backends.☆348Updated 3 weeks ago
- The Triton backend for TensorRT.☆78Updated 3 weeks ago
- ☆266Updated 4 months ago
- OneFlow->ONNX☆43Updated 2 years ago
- PaddlePaddle Developer Community☆125Updated last week
- TensorRT Plugin Autogen Tool☆367Updated 2 years ago
- A high performance, high expansion, easy to use framework for AI application. 为AI应用的开发者 提供一套统一的高性能、易用的编程框架,快速基于AI全栈服务、开发跨端边云的AI行业应用,支持GPU,…☆156Updated last year
- Triton Inferece Server Model Config and Client Scripts☆32Updated 3 years ago
- Large Language Model Onnx Inference Framework☆36Updated 8 months ago
- Simple Dynamic Batching Inference☆146Updated 3 years ago
- This repository deploys YOLOv4 as an optimized TensorRT engine to Triton Inference Server☆287Updated 3 years ago
- ☆26Updated 2 years ago
- A Toolkit to Help Optimize Large Onnx Model☆160Updated last year
- PaddlePaddle custom device implementaion. (『飞桨』自定义硬件接入实现)☆96Updated this week
- NVIDIA TensorRT Hackathon 2023复赛选题:通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆42Updated last year
- Paddle Large Scale Classification Tools,supports ArcFace, CosFace, PartialFC, Data Parallel + Model Parallel. Model includes ResNet, ViT,…☆153Updated 2 years ago
- ☆120Updated 2 years ago
- LLaMa/RWKV onnx models, quantization and testcase☆365Updated 2 years ago
- triton server ensemble model demo☆30Updated 3 years ago
- ☆59Updated 10 months ago
- Transformer related optimization, including BERT, GPT☆17Updated 2 years ago
- ☆129Updated 9 months ago
- 天池 NVIDIA TensorRT Hackathon 2023 —— 生成式AI模型优化赛 初赛第三名方案☆50Updated 2 years ago
- Implement popular deep learning networks in pytorch, used by tensorrtx.☆197Updated 3 years ago
- ☆90Updated 2 years ago
- Compiler Infrastructure for Neural Networks☆147Updated 2 years ago