triton-inference-server / paddlepaddle_backend

Related projects ⓘ

Alternatives and complementary repositories for paddlepaddle_backend

• bug-developer021 / YOLOV5_optimization_on_triton
  Compare multiple optimization methods on triton to imporve model service performance
  ☆46Updated 10 months ago
• zzk0 / triton
  Triton Inferece Server Model Config and Client Scripts
  ☆31Updated 2 years ago
• Oneflow-Inc / oneflow_convert
  OneFlow->ONNX
  ☆42Updated last year
• PaddlePaddle / community
  PaddlePaddle Developer Community
  ☆88Updated this week
• triton-inference-server / dali_backend
  The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.
  ☆125Updated 2 weeks ago
• YellowOldOdd / SDBI
  Simple Dynamic Batching Inference
  ☆145Updated 2 years ago
• Rayrtfr / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆17Updated last year
• PaddlePaddle / Paddle-Inference-Demo
  ☆242Updated last week
• torchpipe / torchpipe
  Serving Inside Pytorch
  ☆145Updated this week
• TRT2022 / trtllm-llama
  ☢️ TensorRT 2023复赛——基于TensorRT-LLM的Llama模型推断加速优化
  ☆44Updated last year
• Tencent / TPAT
  TensorRT Plugin Autogen Tool
  ☆367Updated last year
• Oneflow-Inc / models
  Models and examples built with OneFlow
  ☆96Updated last month
• OpenPPL / ppl.llm.serving
  ☆123Updated 2 weeks ago
• PaddlePaddle / PaddleCustomDevice
  PaddlePaddle custom device implementaion. (『飞桨』自定义硬件接入实现)
  ☆70Updated this week
• BBuf / onnx_learn
  ☆96Updated 3 years ago
• triton-inference-server / common
  Common source, scripts and utilities shared across all Triton repositories.
  ☆62Updated this week
• PaddlePaddle / benchmark
  ☆76Updated last week
• triton-inference-server / model_navigator
  Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.
  ☆185Updated 2 months ago
• dingyuqing05 / trt2022_wenet
  ☆70Updated last year
• OpenPPL / ppl.nn.llm
  ☆140Updated 6 months ago
• Bobo-y / triton_ensemble_model_demo
  triton server ensemble model demo
  ☆30Updated 2 years ago
• lucasjinreal / wanwu_release
  Wanwu models release, code will be released soon
  ☆24Updated 2 years ago
• TRT2022 / ControlNet_TensorRT
  天池 NVIDIA TensorRT Hackathon 2023 —— 生成式AI模型优化赛 初赛第三名方案
  ☆47Updated last year
• THUDM / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆39Updated last year
• inisis / OnnxSlim
  A Toolkit to Help Optimize Onnx Model
  ☆80Updated this week
• sophgo / ChatGLM2-TPU
  run ChatGLM2-6B in BM1684X
  ☆48Updated 8 months ago
• void-main / FasterTransformer
  Transformer related optimization, including BERT, GPT
  ☆60Updated last year
• Oneflow-Inc / vision
  Datasets, Transforms and Models specific to Computer Vision
  ☆82Updated last year
• MAhaitao999 / Yolov3_Dynamic_Batch_TensorRT_Triton
  将Yolov3模型转成可以进行动态Batch的TensorRT推理以及Triton Inference Serving上部署的TensorRT模型
  ☆27Updated 3 years ago
• Oneflow-Inc / DLPerf
  DeepLearning Framework Performance Profiling Toolkit
  ☆277Updated 2 years ago