triton-inference-server / paddlepaddle_backendLinks
☆35Updated last year
Alternatives and similar repositories for paddlepaddle_backend
Users that are interested in paddlepaddle_backend are comparing it to the libraries listed below
Sorting:
- Compare multiple optimization methods on triton to imporve model service performance☆52Updated last year
- The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.☆135Updated 3 weeks ago
- OneFlow->ONNX☆43Updated 2 years ago
- Simple Dynamic Batching Inference☆145Updated 3 years ago
- PaddlePaddle custom device implementaion. (『飞桨』自定义硬件接入实现)☆85Updated this week
- Triton Inferece Server Model Config and Client Scripts☆32Updated 3 years ago
- Serving Inside Pytorch☆160Updated 2 weeks ago
- The Triton backend for TensorRT.☆77Updated this week
- PaddlePaddle Developer Community☆113Updated this week
- Common source, scripts and utilities shared across all Triton repositories.☆74Updated this week
- ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化☆48Updated last year
- The Triton backend for the ONNX Runtime.☆152Updated this week
- Common source, scripts and utilities for creating Triton backends.☆327Updated this week
- triton server ensemble model demo☆30Updated 3 years ago
- Paddle Automatically Diff Precision Toolkits.☆49Updated last year
- ☆262Updated 3 weeks ago
- Large Language Model Onnx Inference Framework☆35Updated 5 months ago
- Compiler Infrastructure for Neural Networks☆146Updated last year
- Transformer related optimization, including BERT, GPT☆17Updated last year
- TensorRT Plugin Autogen Tool☆369Updated 2 years ago
- ☆139Updated last year
- ☆78Updated 2 weeks ago
- ☆27Updated 7 months ago
- ☆128Updated 6 months ago
- PaddlePaddle TestSuite☆47Updated last week
- ☆71Updated 2 years ago
- ☆99Updated 3 years ago
- Transformer related optimization, including BERT, GPT☆39Updated 2 years ago
- A Toolkit to Help Optimize Large Onnx Model☆157Updated last year
- Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.☆205Updated 2 months ago