Alternatives and similar repositories for sparseprop:

Users that are interested in sparseprop are comparing it to the libraries listed below

• Cornell-RelaxML / qtip
  ☆113Updated last week
• IST-DASLab / Sparse-Marlin
  Boosting 4-bit inference kernels with 2:4 Sparsity
  ☆72Updated 7 months ago
• IST-DASLab / QuEST
  Work in progress.
  ☆50Updated 2 weeks ago
• gau-nernst / quantized-training
  Explore training for quantized models
  ☆17Updated 2 months ago
• HanGuo97 / flute
  Fast Matrix Multiplications for Lookup Table-Quantized LLMs
  ☆236Updated last month
• Dao-AILab / fast-hadamard-transform
  Fast Hadamard transform in CUDA, with a PyTorch interface
  ☆165Updated 10 months ago
• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆125Updated 4 months ago
• mengxiayu / LLMSuperWeight
  Code for studying the super weight in LLM
  ☆94Updated 4 months ago
• cchan / tccl
  extensible collectives library in triton
  ☆84Updated this week
• GATECH-EIC / ShiftAddLLM
  ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization
  ☆105Updated 5 months ago
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆78Updated last year
• HanGuo97 / lq-lora
  ☆125Updated last year
• graphcore-research / unit-scaling
  A library for unit scaling in PyTorch
  ☆125Updated 4 months ago
• graphcore-research / unit-scaling-demo
  Unit Scaling demo and experimentation code
  ☆16Updated last year
• CerebrasResearch / Sparse-IFT
  Official repository of Sparse ISO-FLOP Transformations for Maximizing Training Efficiency
  ☆25Updated 8 months ago
• chu-tianxiang / QuIP-for-all
  QuIP quantization
  ☆52Updated last year
• AnswerDotAI / cold-compress
  Cold Compress is a hackable, lightweight, and open-source toolkit for creating and benchmarking cache compression methods built on top of…
  ☆124Updated 7 months ago
• PiotrNawrot / nano-sparse-attention
  The simplest implementation of recent Sparse Attention patterns for efficient LLM inference.
  ☆59Updated 2 months ago
• apple / ml-ademamix
  ☆59Updated 4 months ago
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆47Updated last year
• xiayuqing0622 / flex_head_fa
  Fast and memory-efficient exact attention
  ☆67Updated last month
• GindaChen / FlexFlashAttention3
  FlexAttention w/ FlashAttention3 Support
  ☆26Updated 5 months ago
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆35Updated 11 months ago
• IntelLabs / DyNAS-T
  Dynamic Neural Architecture Search Toolkit
  ☆29Updated 4 months ago
• NolanoOrg / SpectraSuite
  ☆46Updated 8 months ago
• FasterDecoding / TEAL
  ☆122Updated last month
• IST-DASLab / SparseFinetuning
  Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry
  ☆40Updated last year
• neuralmagic / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆92Updated this week
• IntelLabs / Hardware-Aware-Automated-Machine-Learning
  ☆49Updated 2 weeks ago
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆117Updated last month