Alternatives and similar repositories for ZSMerge

Users that are interested in ZSMerge are comparing it to the libraries listed below

• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆130Updated last year
• OpenNLPLab / LASP
  Linear Attention Sequence Parallelism (LASP)
  ☆88Updated last year
• frankxwang / dpo-prefix-sharing
  DPO, but faster 🚀
  ☆46Updated last year
• TRI-ML / linear_open_lm
  A repository for research on medium sized language models.
  ☆77Updated last year
• GATECH-EIC / LaCache
  [ICML 2025] LaCache: Ladder-Shaped KV Caching for Efficient Long-Context Modeling of Large Language Models
  ☆16Updated last month
• kyleliang919 / Super_Muon
  ☆66Updated 8 months ago
• wdlctc / headinfer
  ☆63Updated 7 months ago
• BlinkDL / modded-nanogpt-rwkv
  RWKV-7: Surpassing GPT
  ☆101Updated last year
• recursal / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆45Updated last year
• NathanGodey / qfilters
  Repository for the Q-Filters method (https://arxiv.org/pdf/2503.02812)
  ☆35Updated 9 months ago
• GindaChen / FlexFlashAttention3
  FlexAttention w/ FlashAttention3 Support
  ☆27Updated last year
• facebookresearch / fastgen
  Simple high-throughput inference library
  ☆152Updated 7 months ago
• UmerHA / triton_util
  Make triton easier
  ☆49Updated last year
• LLM360 / crystalcoder-data-prep
  Data preparation code for CrystalCoder 7B LLM
  ☆45Updated last year
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆137Updated 6 months ago
• IST-DASLab / QIGen
  Repository for CPU Kernel Generation for LLM Inference
  ☆27Updated 2 years ago
• BorealisAI / neuzip
  Official repository for the paper "NeuZip: Memory-Efficient Training and Inference with Dynamic Compression of Neural Networks". This rep…
  ☆60Updated last year
• NolanoOrg / SpectraSuite
  ☆52Updated last year
• thunlp / APB
  Official Implementation of APB (ACL 2025 main Oral)
  ☆32Updated 9 months ago
• iantbutler01 / ditty
  A library for simplifying training with multi gpu setups in the HuggingFace / PyTorch ecosystem.
  ☆16Updated last week
• mistralai / mistral-evals
  ☆80Updated 3 weeks ago
• WaveSpeedAI / QuantumAttention
  [WIP] Better (FP8) attention for Hopper
  ☆32Updated 9 months ago
• royeisen / reasoning_loading_bar
  ☆52Updated 5 months ago
• MNoorFawi / curlora
  The code repository for the CURLoRA research paper. Stable LLM continual fine-tuning and catastrophic forgetting mitigation.
  ☆53Updated last year
• Infini-AI-Lab / gsm_infinite
  ☆60Updated 6 months ago
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆37Updated 2 months ago
• sail-sg / Precision-RL
  Defeating the Training-Inference Mismatch via FP16
  ☆165Updated last month
• Zyphra / Zyda_processing
  ☆39Updated last year
• OswaldHe / HMT-pytorch
  [NAACL 2025] Official Implementation of "HMT: Hierarchical Memory Transformer for Long Context Language Processing"
  ☆77Updated 5 months ago
• whyNLP / LCKV
  Layer-Condensed KV cache w/ 10 times larger batch size, fewer params and less computation. Dramatic speed up with better task performance…
  ☆157Updated 8 months ago