Alternatives and similar repositories for TensorRT-RTX

Users that are interested in TensorRT-RTX are comparing it to the libraries listed below

• yangsu2022 / OV_SD_CPP
  C++ pipeline with OpenVINO native API for Stable Diffusion v1.5
  ☆13Updated last year
• EdVince / diffusers-ncnn
  ☆84Updated 2 years ago
• Libraries-Openly-Fused / cvGPUSpeedup
  A faster implementation of OpenCV-CUDA that uses OpenCV objects, and more!
  ☆52Updated last month
• guoguo1314 / llama3_learn.c
  Inference deployment of the llama3
  ☆11Updated last year
• inisis / OnnxSlim
  A Toolkit to Help Optimize Onnx Model
  ☆198Updated last week
• aredden / torch-cublas-hgemm
  PyTorch half precision gemm lib w/ fused optional bias + optional relu/gelu
  ☆72Updated 8 months ago
• triple-Mu / HunyuanDiT-TensorRT-libtorch
  HunyuanDiT with TensorRT and libtorch
  ☆17Updated last year
• chengzeyi / piflux
  (WIP) Parallel inference for black-forest-labs' FLUX model.
  ☆19Updated 9 months ago
• onnx / neural-compressor
  Model compression for ONNX
  ☆97Updated 9 months ago
• ZHEQIUSHUI / SAM-ONNX-AX650-CPP
  SAM and lama inpaint，包含QT的GUI交互界面，实现了交互式可实时显示结果的画点、画框进行SAM，然后通过进行Inpaint，具体操作看readme里的视频。
  ☆50Updated last year
• chengzeyi / ParaAttention
  https://wavespeed.ai/ Context parallel attention that accelerates DiT model inference with dynamic caching
  ☆366Updated last month
• deepbeepmeep / mmgp
  Memory Management for the GPU Poor, run the latest open source frontier models on consumer Nvidia GPUs
  ☆148Updated 3 weeks ago
• latentCall145 / channels-last-groupnorm
  A CUDA kernel for NHWC GroupNorm for PyTorch
  ☆20Updated 9 months ago
• NVIDIA / nvImageCodec
  A nvImageCodec library of GPU- and CPU- accelerated codecs featuring a unified interface
  ☆116Updated 2 weeks ago
• chaiNNer-org / spandrel
  Spandrel gives your project support for various PyTorch architectures meant for AI Super-Resolution, restoration, and inpainting. Based o…
  ☆256Updated 3 months ago
• xdit-project / mochi-xdit
  faster parallel inference of mochi-1 video generation model
  ☆126Updated 6 months ago
• togethercomputer / flash-attention-3
  Fast and memory-efficient exact attention
  ☆17Updated 8 months ago
• the-database / traiNNer-redux
  Deep learning training framework for image super resolution and restoration.
  ☆77Updated 2 weeks ago
• justinchuby / onnx-safetensors
  Use safetensors with ONNX 🤗
  ☆69Updated last month
• rajeevsrao / TensorRT
  TensorRT is a C++ library for high performance inference on NVIDIA GPUs and deep learning accelerators.
  ☆19Updated last year
• yjsunnn / DLoRAL
  Official Implementation of “One-Step Diffusion for Detail-Rich and Temporally Consistent Video Super-Resolution”
  ☆260Updated 3 weeks ago
• dusty-nv / NanoDB
  Zero-copy multimodal vector DB with CUDA and CLIP/SigLIP
  ☆61Updated 3 months ago
• Sarania / blissful-tuner
  Extended Musubi Tuner with latent previews, fp16 accumulation, advanced cfg scheduling and more
  ☆27Updated this week
• Chenglin-Yang / 1.58bit.flux
  ☆284Updated 8 months ago
• huggingface / diffusion-fast
  Faster generation with text-to-image diffusion models.
  ☆225Updated 2 months ago
• WaveSpeedAI / QuantumAttention
  [WIP] Better (FP8) attention for Hopper
  ☆32Updated 6 months ago
• jt-zhang / Sparse_SageAttention_API
  ☆50Updated last month
• keddyjin / TensorRT_StableDiffusion_ControlNet
  NVIDIA® TensorRT™, an SDK for high-performance deep learning inference, includes a deep learning inference optimizer and runtime that del…
  ☆26Updated 2 years ago
• Repeerc / flash-attention-v2-RDNA3-minimal
  a simple Flash Attention v2 implementation with ROCM (RDNA3 GPU, roc wmma), mainly used for stable diffusion(ComfyUI) in Windows ZLUDA en…
  ☆47Updated last year
• tsingmicro-toolchain / OnnxSlim
  A Toolkit to Help Optimize Large Onnx Model
  ☆158Updated last year