Alternatives and similar repositories for cvGPUSpeedup

Users that are interested in cvGPUSpeedup are comparing it to the libraries listed below

• triple-Mu / TensorRT2ONNX
  A tool convert TensorRT engine/plan to a fake onnx
  ☆39Updated 2 years ago
• onnx / neural-compressor
  Model compression for ONNX
  ☆96Updated 6 months ago
• caibucai22 / awesome-cuda
  Awesome code, projects, books, etc. related to CUDA
  ☆17Updated last month
• dusty-nv / NanoDB
  Zero-copy multimodal vector DB with CUDA and CLIP/SigLIP
  ☆56Updated 3 weeks ago
• dusty-nv / clip_trt
  CLIP and SigLIP models optimized with TensorRT with a Transformers-like API
  ☆25Updated 8 months ago
• triple-Mu / HunyuanDiT-TensorRT-libtorch
  HunyuanDiT with TensorRT and libtorch
  ☆17Updated last year
• jinmingyi1998 / opencl_kernels
  An easy way to run, test, benchmark and tune OpenCL kernel files
  ☆23Updated last year
• ahennequ / cuda-tensorcores-register-mapping
  ☆18Updated 2 years ago
• NVIDIA / nvImageCodec
  A nvImageCodec library of GPU- and CPU- accelerated codecs featuring a unified interface
  ☆104Updated 2 months ago
• tile-ai / tvm
  Open deep learning compiler stack for cpu, gpu and specialized accelerators
  ☆18Updated last week
• WaveSpeedAI / QuantumAttention
  [WIP] Better (FP8) attention for Hopper
  ☆30Updated 3 months ago
• latentCall145 / channels-last-groupnorm
  A CUDA kernel for NHWC GroupNorm for PyTorch
  ☆18Updated 6 months ago
• NVIDIA / ProViz-AI-Samples
  AI-related samples made available by the DevTech ProViz team
  ☆30Updated last year
• NVlabs / EfficientDL
  ☆31Updated 11 months ago
• leimao / Nsight-Systems-Docker-Image
  Nsight Systems In Docker
  ☆20Updated last year
• FeiGeChuanShu / trt2023
  NVIDIA TensorRT Hackathon 2023复赛选题：通义千问Qwen-7B用TensorRT-LLM模型搭建及优化
  ☆42Updated last year
• zhenhuaw-me / onnxcli
  ONNX Command-Line Toolbox
  ☆35Updated 7 months ago
• tlc-pack / libflash_attn
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆109Updated 8 months ago
• habanero-lab / APPy
  APPy (Annotated Parallelism for Python) enables users to annotate loops and tensor expressions in Python with compiler directives akin to…
  ☆23Updated 2 weeks ago
• BBuf / tensorrt-llm-moe
  ☆29Updated 4 months ago
• WongKinYiu / GeneralistYOLO
  Generalist YOLO: Towards Real-Time End-to-End Multi-Task Visual Language Models
  ☆74Updated last month
• PINTO0309 / sne4onnx
  A very simple tool for situations where optimization with onnx-simplifier would exceed the Protocol Buffers upper file size limit of 2GB,…
  ☆17Updated last year
• OAID / TengineInferPipe
  ☆24Updated 2 years ago
• PINTO0309 / spo4onnx
  Simple tool for partial optimization of ONNX. Further optimize some models that cannot be optimized with onnx-optimizer and onnxsim by se…
  ☆19Updated last year
• alenic / timm-models-explorer
  Timm model explorer
  ☆39Updated last year
• Bruce-Lee-LY / decoding_attention
  Decoding Attention is specially optimized for MHA, MQA, GQA and MLA using CUDA core for the decoding stage of LLM inference.
  ☆36Updated 2 months ago
• ibaiGorordo / ONNX-NeuFlowV2-Optical-Flow
  Python scripts performing optical flow estimation using the NeuFlowV2 model in ONNX.
  ☆47Updated 8 months ago
• leimao / PyTorch-Eager-Mode-Quantization-TensorRT-Acceleration
  TensorRT Acceleration for PyTorch Native Eager Mode Quantization Models
  ☆15Updated 10 months ago
• sdpython / onnx-extended
  New operators for the ReferenceEvaluator, new kernels for onnxruntime, CPU, CUDA
  ☆32Updated 2 months ago
• microsoft / AttentionEngine
  ☆70Updated 2 weeks ago