Alternatives and similar repositories for ZSMerge

Users that are interested in ZSMerge are comparing it to the libraries listed below

• zenrran4nlp / Awesome-LLM-Inference-Serving
  ☆27Updated 2 weeks ago
• NolanoOrg / SpectraSuite
  ☆46Updated 9 months ago
• UmerHA / triton_util
  Make triton easier
  ☆47Updated 11 months ago
• GindaChen / FlexFlashAttention3
  FlexAttention w/ FlashAttention3 Support
  ☆26Updated 7 months ago
• thunlp / SparsingLaw
  The open-source materials for paper "Sparsing Law: Towards Large Language Models with Greater Activation Sparsity".
  ☆21Updated 6 months ago
• BlinkDL / modded-nanogpt-rwkv
  RWKV-7: Surpassing GPT
  ☆84Updated 6 months ago
• recursal / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆45Updated 9 months ago
• nanowell / Q-Sparse-LLM
  My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated
  ☆32Updated 9 months ago
• lfsszd / CS-Drafting
  Cascade Speculative Drafting
  ☆29Updated last year
• Zyphra / zcookbook
  Training hybrid models for dummies.
  ☆21Updated 4 months ago
• matthewrenze / jhu-concise-cot
  The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models
  ☆22Updated 5 months ago
• hetailang / SqueezeAttention
  ☆37Updated 7 months ago
• Tomorrowdawn / top_nsigma
  The official code repo and data hub of top_nsigma sampling strategy for LLMs.
  ☆24Updated 3 months ago
• kyleliang919 / Online-Subspace-Descent
  This repo is based on https://github.com/jiaweizzhao/GaLore
  ☆27Updated 7 months ago
• Scientific-Computing-Lab / MPI-rigen
  MPI Code Generation through Domain-Specific Language Models
  ☆13Updated 5 months ago
• shuzhangzhong / HybriMoE-Preview
  ☆16Updated last month
• frankxwang / dpo-prefix-sharing
  DPO, but faster 🚀
  ☆42Updated 5 months ago
• LLM360 / crystalcoder-data-prep
  Data preparation code for CrystalCoder 7B LLM
  ☆44Updated last year
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆43Updated 7 months ago
• Infini-AI-Lab / gsm_infinite
  ☆45Updated 2 months ago
• kyleliang919 / Super_Muon
  ☆55Updated last month
• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆126Updated 5 months ago
• Michaelvll / llm-ie-benchmarks
  A collection of reproducible inference engine benchmarks
  ☆30Updated 3 weeks ago
• IST-DASLab / MicroAdam
  This repository contains code for the MicroAdam paper.
  ☆18Updated 5 months ago
• PiotrNawrot / sparse-frontier
  Official implementation of "The Sparse Frontier: Sparse Attention Trade-offs in Transformer LLMs"
  ☆27Updated 3 weeks ago
• Ryu1845 / hyena-jax
  Implementation of Hyena Hierarchy in JAX
  ☆10Updated 2 years ago
• chu-tianxiang / QuIP-for-all
  QuIP quantization
  ☆52Updated last year
• tridao / flash-attention-wheels
  ☆49Updated last year
• OpenNLPLab / LASP
  Linear Attention Sequence Parallelism (LASP)
  ☆82Updated 11 months ago
• RWKV / RWKV-LM
  RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best…
  ☆44Updated 2 months ago