Alternatives and similar repositories for torch-cublas-hgemm

Users that are interested in torch-cublas-hgemm are comparing it to the libraries listed below

• WaveSpeedAI / QuantumAttention
  [WIP] Better (FP8) attention for Hopper
  ☆30Updated 4 months ago
• chengzeyi / piflux
  (WIP) Parallel inference for black-forest-labs' FLUX model.
  ☆19Updated 7 months ago
• KONAKONA666 / q8_kernels
  ☆70Updated 5 months ago
• chengzeyi / ParaAttention
  https://wavespeed.ai/ Context parallel attention that accelerates DiT model inference with dynamic caching
  ☆304Updated last month
• sekstini / gpupoor
  ☆17Updated 6 months ago
• sandyresearch / chipmunk
  🎬 3.7× faster video generation E2E 🖼️ 1.6× faster image generation E2E ⚡ ColumnSparseAttn 9.3× vs FlashAttn‑3 💨 ColumnSparseGEMM 2.5× …
  ☆74Updated last week
• ethansmith2000 / ImprovedTokenMerge
  ☆49Updated last year
• yangluo7 / CAME
  [ACL 2023] The official implementation of "CAME: Confidence-guided Adaptive Memory Optimization"
  ☆92Updated 3 months ago
• timudk / flux_triton
  Writing FLUX in Triton
  ☆34Updated 9 months ago
• aredden / flux-fp8-api
  Flux diffusion model implementation using quantized fp8 matmul & remaining layers use faster half precision accumulate, which is ~2x fast…
  ☆269Updated 8 months ago
• mit-han-lab / deepcompressor
  Model Compression Toolbox for Large Language Models and Diffusion Models
  ☆501Updated 2 months ago
• PipeFusion / PipeFusion
  A Suite for Parallel Inference of Diffusion Transformers (DiTs) on multi-GPU Clusters
  ☆47Updated 11 months ago
• xdit-project / DiTCacheAnalysis
  An auxiliary project analysis of the characteristics of KV in DiT Attention.
  ☆31Updated 6 months ago
• xdit-project / mochi-xdit
  faster parallel inference of mochi-1 video generation model
  ☆121Updated 4 months ago
• czg1225 / AsyncDiff
  [NeurIPS 2024] AsyncDiff: Parallelizing Diffusion Models by Asynchronous Denoising
  ☆202Updated 4 months ago
• snap-research / BitsFusion
  ☆125Updated 3 months ago
• xdit-project / DistVAE
  A parallelism VAE avoids OOM for high resolution image generation
  ☆64Updated 5 months ago
• NovelAI / t5
  Model code for inferencing T5
  ☆65Updated 3 months ago
• sayakpaul / diffusers-torchao
  End-to-end recipes for optimizing diffusion models with torchao and diffusers (inference and FP8 training).
  ☆360Updated 3 weeks ago
• LoganBooker / prodigy-plus-schedule-free
  Prodigy and Schedule-Free, together at last.
  ☆59Updated 3 weeks ago
• discus0434 / comfyui-flux-accelerator
  Accelerates Flux.1 image generation, just by using this node.
  ☆136Updated 6 months ago
• Cornell-RelaxML / qtip
  ☆137Updated this week
• huggingface / diffusion-fast
  Faster generation with text-to-image diffusion models.
  ☆214Updated 8 months ago
• aredden / torch-bnb-fp4
  Faster Pytorch bitsandbytes 4bit fp4 nn.Linear ops
  ☆30Updated last year
• BlinkDL / modded-nanogpt-rwkv
  RWKV-7: Surpassing GPT
  ☆91Updated 7 months ago
• chu-tianxiang / QuIP-for-all
  QuIP quantization
  ☆54Updated last year
• ai-compiler-study / triton-kernels
  Triton kernels for Flux
  ☆20Updated 5 months ago
• mit-han-lab / patch_conv
  Patch convolution to avoid large GPU memory usage of Conv2D
  ☆88Updated 5 months ago
• sekstini / basedxl
  ☆18Updated last year
• Vchitect / FasterCache
  [ICLR 2025] FasterCache: Training-Free Video Diffusion Model Acceleration with High Quality
  ☆231Updated 5 months ago