triton-inference-server / paddlepaddle_backendLinks
☆35Updated last year
Alternatives and similar repositories for paddlepaddle_backend
Users that are interested in paddlepaddle_backend are comparing it to the libraries listed below
Sorting:
- Serving Inside Pytorch☆163Updated this week
- Common source, scripts and utilities for creating Triton backends.☆336Updated 2 weeks ago
- The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.☆136Updated last week
- Compare multiple optimization methods on triton to imporve model service performance☆52Updated last year
- OneFlow->ONNX☆43Updated 2 years ago
- The Triton backend for TensorRT.☆77Updated last week
- ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化☆50Updated last year
- Common source, scripts and utilities shared across all Triton repositories.☆75Updated last week
- Large Language Model Onnx Inference Framework☆36Updated 6 months ago
- TensorRT Plugin Autogen Tool☆369Updated 2 years ago
- A Toolkit to Help Optimize Large Onnx Model☆157Updated last year
- The Triton backend for the ONNX Runtime.☆156Updated this week
- Triton Inferece Server Model Config and Client Scripts☆32Updated 3 years ago
- ☆79Updated 2 weeks ago
- ☆263Updated 2 months ago
- A high performance, high expansion, easy to use framework for AI application. 为AI应用的开发者提供一套统一的高性能、易用的编程框架,快速基于AI全栈服务、开发跨端边云的AI行业应用,支持GPU,…☆156Updated last year
- The Triton backend for TensorFlow.☆52Updated last month
- Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Serv…☆482Updated 2 weeks ago
- NVIDIA TensorRT Hackathon 2023复赛选题:通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆42Updated last year
- This repository deploys YOLOv4 as an optimized TensorRT engine to Triton Inference Server☆286Updated 3 years ago
- PaddlePaddle custom device implementaion. (『飞桨』自定义硬件接入实现)☆89Updated this week
- Simple Dynamic Batching Inference☆145Updated 3 years ago
- Triton Python, C++ and Java client libraries, and GRPC-generated client examples for go, java and scala.☆637Updated 2 weeks ago
- ☆128Updated 7 months ago
- ☆121Updated 2 years ago
- ☆59Updated 8 months ago
- ☆99Updated 4 years ago
- PaddlePaddle Developer Community☆119Updated last week
- Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.☆210Updated 3 months ago
- Datasets, Transforms and Models specific to Computer Vision☆87Updated last year