Libraries-Openly-Fused / cvGPUSpeedupLinks
A faster implementation of OpenCV-CUDA that uses OpenCV objects, and more!
☆53Updated 2 weeks ago
Alternatives and similar repositories for cvGPUSpeedup
Users that are interested in cvGPUSpeedup are comparing it to the libraries listed below
Sorting:
- Model compression for ONNX☆97Updated 10 months ago
- A tool convert TensorRT engine/plan to a fake onnx☆41Updated 2 years ago
- HunyuanDiT with TensorRT and libtorch☆18Updated last year
- Awesome code, projects, books, etc. related to CUDA☆24Updated last month
- ☆33Updated 3 months ago
- Zero-copy multimodal vector DB with CUDA and CLIP/SigLIP☆61Updated 5 months ago
- IntLLaMA: A fast and light quantization solution for LLaMA☆18Updated 2 years ago
- Implementation of a methodology that allows all sorts of user defined GPU kernel fusion, for non CUDA programmers.☆25Updated last week
- NVIDIA TensorRT Hackathon 2023复赛选题:通义千问Qwen-7B用TensorRT-LLM模型搭建及优化☆42Updated last year
- [WIP] Better (FP8) attention for Hopper☆33Updated 7 months ago
- A CUDA kernel for NHWC GroupNorm for PyTorch☆20Updated 10 months ago
- Snapdragon Neural Processing Engine (SNPE) SDKThe Snapdragon Neural Processing Engine (SNPE) is a Qualcomm Snapdragon software accelerate…☆35Updated 3 years ago
- ONNX Command-Line Toolbox☆35Updated 11 months ago
- Decoding Attention is specially optimized for MHA, MQA, GQA and MLA using CUDA core for the decoding stage of LLM inference.☆44Updated 3 months ago
- ☆15Updated 4 months ago
- ☆11Updated 2 months ago
- A nvImageCodec library of GPU- and CPU- accelerated codecs featuring a unified interface☆118Updated last month
- ☆18Updated last year
- C++ implementations for various tokenizers (sentencepiece, tiktoken etc).☆36Updated this week
- FlexAttention w/ FlashAttention3 Support☆27Updated last year
- Datasets, Transforms and Models specific to Computer Vision☆90Updated last year
- ☆19Updated 3 years ago
- Nsight Systems In Docker☆20Updated last year
- This library empowers users to seamlessly port pretrained models and checkpoints on the HuggingFace (HF) hub (developed using HF transfor…☆80Updated last week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆17Updated last year
- CVFusion is an open-source deep learning compiler to fuse the OpenCV operators.☆31Updated 3 years ago
- A Toolkit to Help Optimize Large Onnx Model☆160Updated last year
- 天池 NVIDIA TensorRT Hackathon 2023 —— 生成式AI模型优化赛 初赛第三名方案☆50Updated 2 years ago
- ☆27Updated 3 months ago
- ☆41Updated 2 years ago