diegofiori / benchmark-pytorch2.0-with-nebullvm

Related projects ⓘ

Alternatives and complementary repositories for benchmark-pytorch2.0-with-nebullvm

• onnx / neural-compressor
  Model compression for ONNX
  ☆73Updated 3 weeks ago
• NVIDIA-AI-IOT / whisper_trt
  A project that optimizes Whisper for low latency inference using NVIDIA TensorRT
  ☆59Updated 3 weeks ago
• triple-Mu / TensorRT2ONNX
  A tool convert TensorRT engine/plan to a fake onnx
  ☆37Updated last year
• sdpython / onnx-extended
  New operators for the ReferenceEvaluator, new kernels for onnxruntime, CPU, CUDA
  ☆28Updated last month
• triton-inference-server / onnxruntime_backend
  The Triton backend for the ONNX Runtime.
  ☆129Updated this week
• PINTO0309 / whisper-onnx-tensorrt
  ONNX and TensorRT implementation of Whisper
  ☆58Updated last year
• triton-inference-server / tensorrt_backend
  The Triton backend for TensorRT.
  ☆62Updated this week
• k9ele7en / Triton-TensorRT-Inference-CRAFT-pytorch
  Advanced inference pipeline using NVIDIA Triton Inference Server for CRAFT Text detection (Pytorch), included converter from Pytorch -> O…
  ☆31Updated 3 years ago
• quic / efficient-transformers
  This library empowers users to seamlessly port pretrained models and checkpoints on the HuggingFace (HF) hub (developed using HF transfor…
  ☆47Updated this week
• inisis / OnnxSlim
  A Toolkit to Help Optimize Onnx Model
  ☆75Updated this week
• roboflow / deploy-models-with-grpc-pytorch-asyncio
  Article about deploying machine learning models using grpc, pytorch and asyncio
  ☆24Updated last year
• dusty-nv / NanoDB
  Zero-copy multimodal vector DB with CUDA and CLIP/SigLIP
  ☆36Updated 5 months ago
• huggingface / pixparse
  Pixel Parsing. A reproduction of OCR-free end-to-end document understanding models with open data
  ☆13Updated 3 months ago
• PINTO0309 / sne4onnx
  A very simple tool for situations where optimization with onnx-simplifier would exceed the Protocol Buffers upper file size limit of 2GB,…
  ☆14Updated 6 months ago
• Zasder3 / open_clip_juwels
  An open source implementation of CLIP.
  ☆32Updated 2 years ago
• torchexpo / torchexpo
  Collection of models and extensions for deployment in PyTorch
  ☆24Updated last year
• pallashadow / yolov5face_torchserve_tensorrt
  Torchserve + TensorRT + Detection
  ☆18Updated 2 years ago
• gmalivenko / onnx-opcounter
  Count number of parameters / MACs / FLOPS for ONNX models.
  ☆88Updated 2 weeks ago
• triton-inference-server / dali_backend
  The Triton backend that allows running GPU-accelerated data pre-processing pipelines implemented in DALI's python API.
  ☆123Updated this week
• zhenhuaw-me / onnxcli
  ONNX Command-Line Toolbox
  ☆35Updated 3 weeks ago
• lucasjinreal / wanwu_release
  Wanwu models release, code will be released soon
  ☆24Updated 2 years ago
• NVIDIA-AI-IOT / NVIDIA-Optical-Character-Detection-and-Recognition-Solution
  This repository provides optical character detection and recognition solution optimized on Nvidia devices.
  ☆53Updated 3 weeks ago
• huggingface / open_asr_leaderboard
  ☆51Updated last week
• triton-inference-server / pytorch_backend
  The Triton backend for the PyTorch TorchScript models.
  ☆123Updated this week
• zhreshold / cvpr2020-videomodeling-deployment
  Materials for demonstrating video model deployment
  ☆17Updated 4 years ago
• YH-Wu / Triton-Inference-Server-on-Kubernetes
  ☆30Updated 2 years ago
• MapariAbdullah / Llama2-Custom-document-QA
  Using open-source LLM Llama2 by Meta on local CPU inference for document question-and-answer
  ☆15Updated last year
• triton-inference-server / vllm_backend
  ☆189Updated this week
• scailable / sclblonnx
  Scailable ONNX python tools
  ☆96Updated 2 weeks ago
• jundaf2 / INT8-Flash-Attention-FMHA-Quantization
  ☆156Updated last year