Alternatives and similar repositories for xformers:

Users that are interested in xformers are comparing it to the libraries listed below

• huggingface / optimum-amd
  AMD related optimizations for transformer models
  ☆75Updated 5 months ago
• WaveSpeedAI / QuantumAttention
  [WIP] Better (FP8) attention for Hopper
  ☆30Updated 2 months ago
• Repeerc / flash-attention-v2-RDNA3-minimal
  a simple Flash Attention v2 implementation with ROCM (RDNA3 GPU, roc wmma), mainly used for stable diffusion(ComfyUI) in Windows ZLUDA en…
  ☆41Updated 8 months ago
• ROCm / flash-attention
  Fast and memory-efficient exact attention
  ☆171Updated this week
• mit-han-lab / patch_conv
  Patch convolution to avoid large GPU memory usage of Conv2D
  ☆86Updated 3 months ago
• ROCm / bitsandbytes
  8-bit CUDA functions for PyTorch
  ☆48Updated 2 months ago
• chengzeyi / piflux
  (WIP) Parallel inference for black-forest-labs' FLUX model.
  ☆18Updated 5 months ago
• xdit-project / DistVAE
  A parallelism VAE avoids OOM for high resolution image generation
  ☆61Updated 3 months ago
• SealAILab / stable-diffusion-cpp
  SealAI's stable diffusion implementation
  ☆76Updated 4 months ago
• chu-tianxiang / llama-cpp-torch
  llama.cpp to PyTorch Converter
  ☆33Updated last year
• Cornell-RelaxML / qtip
  ☆126Updated last month
• KONAKONA666 / q8_kernels
  ☆66Updated 3 months ago
• PipeFusion / PipeFusion
  A Suite for Parallel Inference of Diffusion Transformers (DiTs) on multi-GPU Clusters
  ☆44Updated 9 months ago
• huggingface / diffusion-fast
  Faster generation with text-to-image diffusion models.
  ☆213Updated 6 months ago
• ethansmith2000 / ImprovedTokenMerge
  ☆49Updated last year
• sgl-project / DeepGEMM
  DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling
  ☆15Updated this week
• deepspeedai / DeepSpeed-Kernels
  ☆68Updated last month
• ROCm / aotriton
  Ahead of Time (AOT) Triton Math Library
  ☆57Updated last week
• chu-tianxiang / QuIP-for-all
  QuIP quantization
  ☆51Updated last year
• aredden / torch-cublas-hgemm
  PyTorch half precision gemm lib w/ fused optional bias + optional relu/gelu
  ☆64Updated 4 months ago
• ROCm / TransformerEngine
  ☆29Updated this week
• IBM / triton-dejavu
  Framework to reduce autotune overhead to zero for well known deployments.
  ☆65Updated last week
• ROCm / jax
  Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more
  ☆22Updated this week
• RWKV / rwkv-onnx
  A converter and basic tester for rwkv onnx
  ☆42Updated last year
• hpcaitech / TensorNVMe
  A Python library transfers PyTorch tensors between CPU and NVMe
  ☆113Updated 4 months ago
• thu-ml / low-bit-optimizers
  Low-bit optimizers for PyTorch
  ☆128Updated last year
• OFA-Sys / diffusion-deploy
  ☆54Updated 2 years ago
• megvii-research / IntLLaMA
  IntLLaMA: A fast and light quantization solution for LLaMA
  ☆18Updated last year
• mlfoundations / open-diffusion
  Simple large-scale training of stable diffusion with multi-node support.
  ☆131Updated last year
• graphcore-research / out-of-the-box-fp8-training
  Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.
  ☆45Updated 9 months ago