Alternatives and similar repositories for cvGPUSpeedup

Users that are interested in cvGPUSpeedup are comparing it to the libraries listed below

• triple-Mu / TensorRT2ONNX
  A tool convert TensorRT engine/plan to a fake onnx
  ☆39Updated 2 years ago
• onnx / neural-compressor
  Model compression for ONNX
  ☆96Updated 7 months ago
• caibucai22 / awesome-cuda
  Awesome code, projects, books, etc. related to CUDA
  ☆17Updated last week
• dusty-nv / NanoDB
  Zero-copy multimodal vector DB with CUDA and CLIP/SigLIP
  ☆59Updated last month
• leimao / Nsight-Systems-Docker-Image
  Nsight Systems In Docker
  ☆20Updated last year
• PINTO0309 / spo4onnx
  Simple tool for partial optimization of ONNX. Further optimize some models that cannot be optimized with onnx-optimizer and onnxsim by se…
  ☆19Updated last year
• triple-Mu / Stable-Diffusion-TensorRT
  Stable Diffusion in TensorRT 8.5+
  ☆14Updated 2 years ago
• latentCall145 / channels-last-groupnorm
  A CUDA kernel for NHWC GroupNorm for PyTorch
  ☆19Updated 7 months ago
• ibaiGorordo / ONNX-NeuFlowV2-Optical-Flow
  Python scripts performing optical flow estimation using the NeuFlowV2 model in ONNX.
  ☆47Updated 9 months ago
• jinmingyi1998 / opencl_kernels
  An easy way to run, test, benchmark and tune OpenCL kernel files
  ☆23Updated last year
• NVlabs / EfficientDL
  ☆32Updated last week
• triple-Mu / HunyuanDiT-TensorRT-libtorch
  HunyuanDiT with TensorRT and libtorch
  ☆17Updated last year
• GindaChen / FlexFlashAttention3
  FlexAttention w/ FlashAttention3 Support
  ☆26Updated 8 months ago
• MILVLG / mlc-imp
  Enable everyone to develop, optimize and deploy AI models natively on everyone's devices.
  ☆10Updated last year
• tile-ai / tvm
  Open deep learning compiler stack for cpu, gpu and specialized accelerators
  ☆19Updated last week
• WaveSpeedAI / QuantumAttention
  [WIP] Better (FP8) attention for Hopper
  ☆30Updated 4 months ago
• Bruce-Lee-LY / decoding_attention
  Decoding Attention is specially optimized for MHA, MQA, GQA and MLA using CUDA core for the decoding stage of LLM inference.
  ☆38Updated 2 weeks ago
• hova88 / CUDA-MatMul-Practice
  ☆16Updated last year
• tlc-pack / libflash_attn
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆110Updated 9 months ago
• ENOT-AutoDL / ONNX-Runtime-with-TensorRT-and-OpenVINO
  Docker scripts for building ONNX Runtime with TensorRT and OpenVINO in manylinux environment
  ☆22Updated 2 years ago
• BBuf / tensorrt-llm-moe
  ☆29Updated 4 months ago
• masamitsu-murase / deform_conv2d_onnx_exporter
  ☆35Updated 2 years ago
• Oneflow-Inc / one-fx
  A toolkit for developers to simplify the transformation of nn.Module instances. It's now corresponding to Pytorch.fx.
  ☆13Updated 2 years ago
• ahennequ / cuda-tensorcores-register-mapping
  ☆18Updated 2 years ago
• Adlik / model_zoo
  ☆11Updated last year
• yester31 / Cutlass_EX
  study of cutlass
  ☆21Updated 7 months ago
• PINTO0309 / sne4onnx
  A very simple tool for situations where optimization with onnx-simplifier would exceed the Protocol Buffers upper file size limit of 2GB,…
  ☆17Updated last year
• Oneflow-Inc / serving
  OneFlow Serving
  ☆20Updated 2 months ago
• megvii-research / IntLLaMA
  IntLLaMA: A fast and light quantization solution for LLaMA
  ☆18Updated last year
• andravin / spio
  Memory-Efficient CUDA kernels for training ConvNets with PyTorch.
  ☆41Updated 4 months ago