Alternatives and similar repositories for CoLA

Users that are interested in CoLA are comparing it to the libraries listed below

• sail-sg / Attention-Sink
  [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)
  ☆151Updated 6 months ago
• PKU-ML / LongPPL
  Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"
  ☆107Updated 3 months ago
• shawntan / stickbreaking-attention
  Stick-breaking attention
  ☆62Updated 6 months ago
• Infini-AI-Lab / Kinetics
  Kinetics: Rethinking Test-Time Scaling Laws
  ☆85Updated 6 months ago
• OpenSparseLLMs / MoM
  ☆114Updated 3 months ago
• ryoungj / BoLT
  Code for "Reasoning to Learn from Latent Thoughts"
  ☆124Updated 9 months ago
• locuslab / massive-activations
  Code accompanying the paper "Massive Activations in Large Language Models"
  ☆191Updated last year
• bethgelab / sober-reasoning
  A Sober Look at Language Model Reasoning
  ☆92Updated last month
• UCSB-NLP-Chang / ThinkPrune
  ☆46Updated 3 months ago
• abdelfattah-lab / TokenButler
  ☆26Updated last month
• Leooyii / LCEG
  Long Context Extension and Generalization in LLMs
  ☆62Updated last year
• SempraETY / Pruning-via-Merging
  ☆23Updated last year
• hdong920 / GRIFFIN
  ☆39Updated last year
• andyjm3 / SLTrain
  SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)
  ☆38Updated last year
• nasosger / MuToR
  [NeurIPS '25] Multi-Token Prediction Needs Registers
  ☆26Updated 3 weeks ago
• thunlp / Modularity-Analysis
  [ACL 2023 Findings] Emergent Modularity in Pre-trained Transformers
  ☆26Updated 2 years ago
• PRIME-RL / RL-Compositionality
  FROM $f(x)$ AND $g(x)$ TO $f(g(x))$: LLMs Learn New Skills in RL by Composing Old Ones
  ☆55Updated 2 months ago
• GeniusHTX / TALE
  ☆143Updated 3 months ago
• UNITES-Lab / MC-SMoE
  [ICLR‘24 Spotlight] Code for the paper "Merge, Then Compress: Demystify Efficient SMoE with Hints from Its Routing Policy"
  ☆102Updated 6 months ago
• sail-sg / VeriFree
  Reinforcing General Reasoning without Verifiers
  ☆93Updated 6 months ago
• CASE-Lab-UMD / Unified-MoE-Compression
  The official implementation of the paper "Towards Efficient Mixture of Experts: A Holistic Study of Compression Techniques (TMLR)".
  ☆88Updated 9 months ago
• VITA-Group / SEAL
  [COLM 2025] SEAL: Steerable Reasoning Calibration of Large Language Models for Free
  ☆50Updated 9 months ago
• OpenSparseLLMs / Linearization
  ☆62Updated 6 months ago
• hemingkx / SWIFT
  [ICLR 2025] SWIFT: On-the-Fly Self-Speculative Decoding for LLM Inference Acceleration
  ☆61Updated 10 months ago
• socialfoundations / tttlm
  Test-time-training on nearest neighbors for large language models
  ☆49Updated last year
• Zanette-Labs / SpeculativeRejection
  [NeurIPS 2024] Fast Best-of-N Decoding via Speculative Rejection
  ☆54Updated last year
• WANGXinyiLinda / planning_tokens
  Official code for Guiding Language Model Math Reasoning with Planning Tokens
  ☆18Updated last year
• Infini-AI-Lab / GRESO
  ☆72Updated 6 months ago
• SalesforceAIResearch / ThinK
  ThinK: Thinner Key Cache by Query-Driven Pruning
  ☆26Updated 11 months ago
• OpenSparseLLMs / Linear-MoE
  ☆126Updated 7 months ago