triton-inference-server / paddlepaddle_backendLinks
☆36Updated last year
Alternatives and similar repositories for paddlepaddle_backend
Users that are interested in paddlepaddle_backend are comparing it to the libraries listed below
Sorting:
- Serving Inside Pytorch☆163Updated last month
- Compare multiple optimization methods on triton to imporve model service performance☆52Updated last year
- The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.☆139Updated last week
- PaddlePaddle Developer Community☆125Updated this week
- ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化☆50Updated 2 years ago
- The Triton backend for TensorRT.☆79Updated 2 weeks ago
- Common source, scripts and utilities for creating Triton backends.☆352Updated 2 weeks ago
- TensorRT Plugin Autogen Tool☆368Updated 2 years ago
- ☆266Updated 5 months ago
- ☆120Updated 2 years ago
- Triton Inferece Server Model Config and Client Scripts☆32Updated 3 years ago
- PaddlePaddle custom device implementaion. (『飞桨』自定义硬件接入实现)☆97Updated this week
- OneFlow->ONNX☆43Updated 2 years ago
- NVIDIA TensorRT Hackathon 2023复赛选题:通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆43Updated 2 years ago
- PaddlePaddle TestSuite☆47Updated last week
- A Toolkit to Help Optimize Large Onnx Model☆161Updated last year
- Compiler Infrastructure for Neural Networks☆147Updated 2 years ago
- Transformer related optimization, including BERT, GPT☆17Updated 2 years ago
- ☆129Updated 10 months ago
- ☆80Updated 2 months ago
- ☆59Updated 11 months ago
- Large Language Model Onnx Inference Framework☆36Updated 9 months ago
- YOLO v5 Object Detection on Triton Inference Server☆16Updated 2 years ago
- A simple tool that can generate TensorRT plugin code quickly.☆236Updated 2 years ago
- run ChatGLM2-6B in BM1684X☆50Updated last year
- ☆26Updated 2 years ago
- Simple Dynamic Batching Inference☆145Updated 3 years ago
- A high performance, high expansion, easy to use framework for AI application. 为AI应用的开发者提供一套统一的高性能、易用的编程框架,快速基于AI全栈服务、开发跨端边云的AI行业应用,支持GPU,…☆156Updated last year
- Implement popular deep learning networks in pytorch, used by tensorrtx.☆197Updated 3 years ago
- This repository deploys YOLOv4 as an optimized TensorRT engine to Triton Inference Server☆287Updated 3 years ago