The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.
☆148Sep 11, 2026Updated 2 weeks ago
Alternatives and similar repositories for dali_backend
Users that are interested in dali_backend are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Triton Model Analyzer is a CLI tool to help with better understanding of the compute and memory requirements of the Triton Inference Serv…☆529Sep 16, 2026Updated last week
- Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.☆226May 27, 2026Updated 4 months ago
- The Triton backend for TensorFlow.☆57Nov 22, 2025Updated 10 months ago
- This repository deploys YOLOv4 as an optimized TensorRT engine to Triton Inference Server☆282Jun 2, 2022Updated 4 years ago
- Transformer related optimization, including BERT, GPT☆17Jul 29, 2023Updated 3 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep lear…☆5,765Updated this week
- Triton Migration Guide for DeepStreamSDK.☆15Dec 19, 2023Updated 2 years ago
- This repository serves as an example of deploying the YOLO models on Triton Server for performance and testing purposes☆71Oct 20, 2025Updated 11 months ago
- The Triton backend for the ONNX Runtime.☆187Sep 18, 2026Updated last week
- Deploy RT-EDTR with onnx from paddlepaddle framwork and graph cut☆32May 5, 2023Updated 3 years ago
- PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.☆850Aug 13, 2025Updated last year
- ☆33Jul 7, 2022Updated 4 years ago
- llama-70b-chat-4-shards implementation☆13Jun 4, 2024Updated 2 years ago
- This repository utilizes the Triton Inference Server Client, which streamlines the complexity of model deployment.☆21Sep 1, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆359Updated this week
- Demonstration of the use of TensorRT and TRITON☆16Feb 9, 2021Updated 5 years ago
- PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT☆3,001Updated this week
- FastAPI middleware for comparing different ML model serving approaches☆15Jul 5, 2023Updated 3 years ago
- 训练速度比原始caffe-ssd提升4~6倍☆10Jun 22, 2021Updated 5 years ago
- Transformer related optimization, including BERT, GPT☆39Feb 10, 2023Updated 3 years ago
- common in-memory tensor structure☆1,250Aug 11, 2026Updated last month
- ☆12Aug 10, 2022Updated 4 years ago
- Implementation of Nvidia DeepStream 7 with YOLOv9 Models.☆15Jun 22, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- How to Install DensePose☆19Jul 15, 2018Updated 8 years ago
- CV-CUDA™ is an open-source, GPU accelerated library for cloud-scale image processing and computer vision.☆2,727Sep 16, 2026Updated last week
- How to quickly serve an LLM using Fast API, Celery, and Redis☆17Aug 29, 2023Updated 3 years ago
- ☆414Nov 11, 2023Updated 2 years ago
- IntLLaMA: A fast and light quantization solution for LLaMA☆19Jul 21, 2023Updated 3 years ago
- The Triton TensorRT-LLM Backend☆944Sep 16, 2026Updated last week
- TensorRT Plugin Autogen Tool☆365Apr 7, 2023Updated 3 years ago
- DeepStream SDK Python bindings and sample applications☆1,894Apr 1, 2026Updated 5 months ago
- TF 2 implementation Learning to Resize Images for Computer Vision Tasks (https://arxiv.org/abs/2103.09950v1).☆54Oct 12, 2021Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Set of Python bindings to C++ libraries which provides full HW acceleration for video decoding, encoding and GPU-accelerated color space …☆1,379Jun 10, 2024Updated 2 years ago
- ONNX-TensorRT: TensorRT backend for ONNX☆3,238Sep 14, 2026Updated 2 weeks ago
- yolort is a runtime stack for yolov5 on specialized accelerators such as tensorrt, libtorch, onnxruntime, tvm and ncnn.☆730Apr 10, 2026Updated 5 months ago
- Experiment code☆10Sep 17, 2018Updated 8 years ago
- OpenVINO backend for Triton.☆39Sep 11, 2026Updated 2 weeks ago
- Provides an ensemble model to deploy a YOLOv8 TensorRT model to Triton☆13Mar 28, 2024Updated 2 years ago
- NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source compone…☆13,367Updated this week