Alternatives and similar repositories for SparsingLaw

Users that are interested in SparsingLaw are comparing it to the libraries listed below

• sail-sg / SkyLadder
  The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling
  ☆40Updated last month
• OpenSparseLLMs / Linearization
  ☆61Updated 4 months ago
• GATECH-EIC / Linearized-LLM
  [ICML 2024] When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models
  ☆36Updated last year
• MikaStars39 / StableMask
  PyTorch implementation of StableMask (ICML'24)
  ☆14Updated last year
• scitix / MEAP
  Mask-Enhanced Autoregressive Prediction: Pay Less Attention to Learn More
  ☆33Updated 5 months ago
• qiuzh20 / gated_attention
  The official implementation for [NeurIPS2025 Oral] Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink…
  ☆101Updated last month
• VITA-Group / WeLore
  From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients. Ajay Jaiswal, Lu Yin, Zhenyu Zhang, Shiwei Liu,…
  ☆51Updated 2 weeks ago
• pixeli99 / MixLN
  [ICLR 2025] Official Pytorch Implementation of "Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LN" by Pengxia…
  ☆27Updated 3 months ago
• kamanphoebe / Look-into-MoEs
  [NAACL 2025] A Closer Look into Mixture-of-Experts in Large Language Models
  ☆55Updated 9 months ago
• Infini-AI-Lab / S2FT
  ☆19Updated 10 months ago
• Doraemonzzz / xmixers
  Xmixers: A collection of SOTA efficient token/channel mixers
  ☆29Updated 2 months ago
• Infini-AI-Lab / gsm_infinite
  ☆55Updated 5 months ago
• DRSY / KV_Compression
  [EMNLP 2023]Context Compression for Auto-regressive Transformers with Sentinel Tokens
  ☆25Updated 2 years ago
• Infini-AI-Lab / Multiverse
  ☆101Updated 2 months ago
• metacarbon / shareAtt
  Beyond KV Caching: Shared Attention for Efficient LLMs
  ☆20Updated last year
• VITA-Group / Ms-PoE
  "Found in the Middle: How Language Models Use Long Contexts Better via Plug-and-Play Positional Encoding" Zhenyu Zhang, Runjin Chen, Shiw…
  ☆30Updated last year
• sramshetty / mixture-of-depths
  An unofficial implementation of "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆36Updated last year
• ylsung / rsq
  Code for "RSQ: Learning from Important Tokens Leads to Better Quantized LLMs"
  ☆19Updated 5 months ago
• jiwonsong-dev / ReasoningPathCompression
  [NeurIPS 2025] Official implementation of "Reasoning Path Compression: Compressing Generation Trajectories for Efficient LLM Reasoning"
  ☆24Updated 3 weeks ago
• john-hewitt / implicit-ins
  Codebase for Instruction Following without Instruction Tuning
  ☆36Updated last year
• ldery / Bonsai
  Code for "Everybody Prune Now: Structured Pruning of LLMs with only Forward Passes"
  ☆28Updated last year
• RAIVNLab / MatFormer-OLMo
  Code repository for the public reproduction of the language modelling experiments on "MatFormer: Nested Transformer for Elastic Inference…
  ☆30Updated 2 years ago
• alessiodevoto / l2compress
  Code for the EMNLP24 paper "A simple and effective L2 norm based method for KV Cache compression."
  ☆17Updated 11 months ago
• SalesforceAIResearch / GemFilter
  ☆85Updated this week
• IST-DASLab / RoSA
  Official implementation of the ICML 2024 paper RoSA (Robust Adaptation)
  ☆44Updated last year
• uservan / ThinkPO
  ☆17Updated 3 months ago
• tongxuluo / prts
  Code and Model for NeurIPS 2024 Spotlight Paper "Stacking Your Transformers: A Closer Look at Model Growth for Efficient LLM Pre-Training…
  ☆43Updated last year
• tianyi-lab / C3PO
  [COLM 2025] "C3PO: Critical-Layer, Core-Expert, Collaborative Pathway Optimization for Test-Time Expert Re-Mixing"
  ☆18Updated 7 months ago
• Infini-AI-Lab / GRESO
  ☆66Updated 4 months ago
• Infini-AI-Lab / Kinetics
  Kinetics: Rethinking Test-Time Scaling Laws
  ☆82Updated 4 months ago