triton-inference-server / paddlepaddle_backendLinks
☆36Updated last year
Alternatives and similar repositories for paddlepaddle_backend
Users that are interested in paddlepaddle_backend are comparing it to the libraries listed below
Sorting:
- Serving Inside Pytorch☆162Updated 2 weeks ago
- The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.☆136Updated 2 weeks ago
- Compare multiple optimization methods on triton to imporve model service performance☆52Updated last year
- The Triton backend for TensorRT.☆78Updated 3 weeks ago
- Common source, scripts and utilities for creating Triton backends.☆342Updated 3 weeks ago
- ☆264Updated 2 months ago
- ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化☆50Updated last year
- TensorRT Plugin Autogen Tool☆367Updated 2 years ago
- A Toolkit to Help Optimize Large Onnx Model☆158Updated last year
- Triton Inferece Server Model Config and Client Scripts☆32Updated 3 years ago
- Transformer related optimization, including BERT, GPT☆17Updated 2 years ago
- PaddlePaddle Developer Community☆121Updated 2 weeks ago
- Simple Dynamic Batching Inference☆145Updated 3 years ago
- A high performance, high expansion, easy to use framework for AI application. 为AI应用的开发者提供一套统一的高性能、易用的编程框架,快速基于AI全栈服务、开发跨端边云的AI行业应用,支持GPU,…☆157Updated last year
- PaddlePaddle custom device implementaion. (『飞桨』自定义硬件接入实现)☆92Updated last week
- NVIDIA TensorRT Hackathon 2023复赛选题:通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆42Updated last year
- OneFlow->ONNX☆43Updated 2 years ago
- Common source, scripts and utilities shared across all Triton repositories.☆76Updated 3 weeks ago
- ☆121Updated 2 years ago
- Paddle Large Scale Classification Tools,supports ArcFace, CosFace, PartialFC, Data Parallel + Model Parallel. Model includes ResNet, ViT,…☆153Updated 2 years ago
- A simple tool that can generate TensorRT plugin code quickly.☆234Updated 2 years ago
- ☆99Updated 4 years ago
- The Triton backend for the ONNX Runtime.☆159Updated 2 weeks ago
- Common utilities for ONNX converters☆276Updated last month
- Large Language Model Onnx Inference Framework☆36Updated 7 months ago
- ☆79Updated last week
- Compiler Infrastructure for Neural Networks☆147Updated 2 years ago
- Models and examples built with OneFlow☆98Updated 10 months ago
- This repository deploys YOLOv4 as an optimized TensorRT engine to Triton Inference Server☆287Updated 3 years ago
- ☆90Updated 2 years ago