Alternatives and similar repositories for Quamba:

Users that are interested in Quamba are comparing it to the libraries listed below

• IST-DASLab / SparseFinetuning
  Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry
  ☆40Updated last year
• ScalingIntelligence / CATS
  ☆23Updated 2 months ago
• IST-DASLab / Sparse-Marlin
  Boosting 4-bit inference kernels with 2:4 Sparsity
  ☆64Updated 4 months ago
• GATECH-EIC / ShiftAddLLM
  ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization
  ☆101Updated 3 months ago
• IST-DASLab / QIGen
  Repository for CPU Kernel Generation for LLM Inference
  ☆25Updated last year
• INT-FlashAttention2024 / INT-FlashAttention
  ☆58Updated last week
• pytorch-labs / superblock
  A block oriented training approach for inference time optimization.
  ☆32Updated 5 months ago
• Raincleared-Song / sparse_gpu_operator
  GPU operators for sparse tensor operations
  ☆30Updated 10 months ago
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆62Updated 10 months ago
• GATECH-EIC / Linearized-LLM
  [ICML 2024] When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models
  ☆28Updated 7 months ago
• mit-han-lab / Block-Sparse-Attention
  A sparse attention kernel supporting mix sparse patterns
  ☆98Updated 3 months ago
• Qualcomm-AI-research / gptvq
  ☆27Updated 10 months ago
• mit-han-lab / patch_conv
  Patch convolution to avoid large GPU memory usage of Conv2D
  ☆82Updated last week
• Aaronhuang-778 / SliM-LLM
  SliM-LLM: Salience-Driven Mixed-Precision Quantization for Large Language Models
  ☆26Updated 5 months ago
• htqin / IR-QLoRA
  [ICML 2024 Oral] This project is the official implementation of our Accurate LoRA-Finetuning Quantization of LLMs via Information Retenti…
  ☆60Updated 9 months ago
• facebookresearch / Ternary_Binary_Transformer
  ACL 2023
  ☆38Updated last year
• GindaChen / FlexFlashAttention3
  FlexAttention w/ FlashAttention3 Support
  ☆27Updated 3 months ago
• thu-ml / Jetfire-INT8Training
  ☆31Updated 6 months ago
• stanford-futuredata / stk
  ☆97Updated 5 months ago
• HuangOwen / RoLoRA
  [EMNLP 2024] RoLoRA: Fine-tuning Rotated Outlier-free LLMs for Effective Weight-Activation Quantization
  ☆29Updated 4 months ago
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆74Updated last year
• andy-yang-1 / DoubleSparse
  16-fold memory access reduction with nearly no loss
  ☆72Updated 2 months ago
• yuzhenmao / IceFormer
  Implementation of IceFormer: Accelerated Inference with Long-Sequence Transformers on CPUs (ICLR 2024).
  ☆22Updated 7 months ago
• Qualcomm-AI-research / outlier-free-transformers
  ☆39Updated last year
• Dao-AILab / fast-hadamard-transform
  Fast Hadamard transform in CUDA, with a PyTorch interface
  ☆135Updated 8 months ago
• Cornell-RelaxML / qtip
  ☆100Updated last month
• xiayuqing0622 / flex_head_fa
  Fast and memory-efficient exact attention
  ☆57Updated last month
• jundaf2 / INT8-Flash-Attention-FMHA-Quantization
  ☆157Updated last year
• fmfi-compbio / admm-pruning
  ☆21Updated 6 months ago
• pytorch-labs / tritonbench
  Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.
  ☆86Updated this week