Alternatives and similar repositories for any4

Users that are interested in any4 are comparing it to the libraries listed below

• lernapparat / torchhacks
  Hacks for PyTorch
  ☆19Updated 2 years ago
• ilur98 / DGQ
  Official Code For Dual Grained Quantization: Efficient Fine-Grained Quantization for LLM
  ☆14Updated last year
• BBuf / flash-rwkv
  ☆31Updated last year
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆48Updated last year
• BlinkDL / LinearAttentionArena
  Here we will test various linear attention designs.
  ☆60Updated last year
• pytorch-labs / superblock
  A block oriented training approach for inference time optimization.
  ☆33Updated 10 months ago
• IST-DASLab / SparseFinetuning
  Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry
  ☆42Updated last year
• IST-DASLab / MicroAdam
  This repository contains code for the MicroAdam paper.
  ☆20Updated 7 months ago
• frankxwang / dpo-prefix-sharing
  DPO, but faster 🚀
  ☆43Updated 7 months ago
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆44Updated 9 months ago
• tridao / flash-attention-wheels
  ☆51Updated last year
• SprocketLab / sparse_matrix_fine_tuning
  Official repository for ICML 2024 paper "MoRe Fine-Tuning with 10x Fewer Parameters"
  ☆20Updated last month
• graphcore-research / out-of-the-box-fp8-training
  Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.
  ☆46Updated last year
• GindaChen / FlexFlashAttention3
  FlexAttention w/ FlashAttention3 Support
  ☆26Updated 9 months ago
• PiotrNawrot / sparse-frontier
  The evaluation framework for training-free sparse attention in LLMs
  ☆82Updated 3 weeks ago
• ylsung / rsq
  Code for "RSQ: Learning from Important Tokens Leads to Better Quantized LLMs"
  ☆18Updated last month
• rayleizhu / vllm-ra
  [ACL 2024] RelayAttention for Efficient Large Language Model Serving with Long System Prompts
  ☆40Updated last year
• chenjoya / dropit
  DropIT: Dropping Intermediate Tensors for Memory-Efficient DNN Training (ICLR 2023)
  ☆31Updated 2 years ago
• ahennequ / pytorch-custom-mma
  ☆29Updated 2 years ago
• kyegomez / Blockwise-Parallel-Transformer
  32 times longer context window than vanilla Transformers and up to 4 times longer than memory efficient Transformers.
  ☆48Updated 2 years ago
• IST-DASLab / QIGen
  Repository for CPU Kernel Generation for LLM Inference
  ☆26Updated 2 years ago
• aredden / torch-bnb-fp4
  Faster Pytorch bitsandbytes 4bit fp4 nn.Linear ops
  ☆30Updated last year
• IST-DASLab / QuEST
  Work in progress.
  ☆70Updated 2 weeks ago
• TianjinYellow / StableSPAM
  ☆22Updated 3 months ago
• insuhan / hyper-attn
  ☆81Updated last year
• feifeibear / Odysseus-Transformer
  Odysseus: Playground of LLM Sequence Parallelism
  ☆70Updated last year
• habanero-lab / APPy
  APPy (Annotated Parallelism for Python) enables users to annotate loops and tensor expressions in Python with compiler directives akin to…
  ☆23Updated 3 weeks ago
• drisspg / transformer_nuggets
  A place to store reusable transformer components of my own creation or found on the interwebs
  ☆56Updated last week
• fla-org / flash-bidirectional-linear-attention
  Triton implement of bi-directional (non-causal) linear attention
  ☆51Updated 5 months ago
• Dao-AILab / gemm-cublas
  ☆21Updated 2 months ago