Alternatives and similar repositories for developer_tools:

Users that are interested in developer_tools are comparing it to the libraries listed below

• triton-inference-server / tensorrt_backend
  The Triton backend for TensorRT.
  ☆68Updated this week
• triton-inference-server / dali_backend
  The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.
  ☆132Updated this week
• triton-inference-server / onnxruntime_backend
  The Triton backend for the ONNX Runtime.
  ☆138Updated this week
• triton-inference-server / model_navigator
  Triton Model Navigator is an inference toolkit designed for optimizing and deploying Deep Learning models with a focus on NVIDIA GPUs.
  ☆196Updated last month
• onnx / neural-compressor
  Model compression for ONNX
  ☆84Updated 2 months ago
• NVIDIA / healthcare-on-tap-TRT-TRITON-demo
  Demonstration of the use of TensorRT and TRITON
  ☆16Updated 4 years ago
• jinmingyi1998 / opencl_kernels
  An easy way to run, test, benchmark and tune OpenCL kernel files
  ☆23Updated last year
• SkyworkAI / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆16Updated 8 months ago
• YH-Wu / Triton-Inference-Server-on-Kubernetes
  ☆30Updated 2 years ago
• lucasjinreal / wanwu_release
  Wanwu models release, code will be released soon
  ☆24Updated 2 years ago
• Oneflow-Inc / oneflow_convert
  OneFlow->ONNX
  ☆42Updated last year
• triton-inference-server / openvino_backend
  OpenVINO backend for Triton.
  ☆30Updated this week
• triton-inference-server / perf_analyzer
  ☆43Updated this week
• Archermmt / yolov3_dcn_nv_hackthon2021
  ☆10Updated 3 years ago
• triton-inference-server / tensorflow_backend
  The Triton backend for TensorFlow.
  ☆49Updated this week
• wangkuiyi / huggingface-tokenizer-in-cxx
  ☆55Updated last year
• facebookresearch / fairring
  Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …
  ☆64Updated 2 years ago
• vinx13 / tvm-cuda-int8-benchmark
  Benchmark of TVM quantized model on CUDA
  ☆111Updated 4 years ago
• triton-inference-server / backend
  Common source, scripts and utilities for creating Triton backends.
  ☆307Updated this week
• triton-inference-server / pytorch_backend
  The Triton backend for the PyTorch TorchScript models.
  ☆143Updated this week
• masahi / torchscript-to-tvm
  ☆69Updated last year
• triton-inference-server / paddlepaddle_backend
  ☆33Updated last year
• diegofiori / benchmark-pytorch2.0-with-nebullvm
  ☆9Updated 2 years ago
• NVIDIA-AI-IOT / NVIDIA-Optical-Character-Detection-and-Recognition-Solution
  This repository provides optical character detection and recognition solution optimized on Nvidia devices.
  ☆70Updated this week
• triton-inference-server / triton_cli
  Triton CLI is an open source command line interface that enables users to create, deploy, and profile models served by the Triton Inferen…
  ☆53Updated this week
• OAID / TengineInferPipe
  ☆24Updated 2 years ago
• onnx / steering-committee
  Notes and artifacts from the ONNX steering committee
  ☆25Updated last week
• deepglint / eq-ncnn
  ☆42Updated 4 years ago
• zhenhuaw-me / onnxcli
  ONNX Command-Line Toolbox
  ☆35Updated 4 months ago