Alternatives and similar repositories for DenseMixer

Users that are interested in DenseMixer are comparing it to the libraries listed below

• qiuzh20 / gated_attention
  The official implementation for Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free
  ☆45Updated 2 months ago
• ltzheng / SimpleTIR
  End-to-End Reinforcement Learning for Multi-Turn Tool-Integrated Reasoning
  ☆127Updated this week
• Zanette-Labs / SpeculativeRejection
  [NeurIPS 2024] Fast Best-of-N Decoding via Speculative Rejection
  ☆48Updated 8 months ago
• sail-sg / LongSpec
  LongSpec: Long-Context Lossless Speculative Decoding with Efficient Drafting and Verification
  ☆57Updated 4 months ago
• princeton-pli / PruLong
  Code for the preprint "Cache Me If You Can: How Many KVs Do You Need for Effective Long-Context LMs?"
  ☆38Updated this week
• HKUNLP / critic-rl
  [ICML 2025] Teaching Language Models to Critique via Reinforcement Learning
  ☆103Updated 2 months ago
• sail-sg / scaling-with-vocab
  [NeurIPS-2024] 📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623
  ☆86Updated 9 months ago
• BytedTsinghua-SIA / Enigmata
  Resources for the Enigmata Project.
  ☆53Updated last month
• Shwai-He / MEO
  The source code of "Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (EMNLP 2023)":
  ☆38Updated last year
• OpenSparseLLMs / Linear-MoE
  ☆110Updated last month
• ars22 / scaling-LLM-math-synthetic-data
  Code and data used in the paper: "Training on Incorrect Synthetic Data via RL Scales LLM Math Reasoning Eight-Fold"
  ☆30Updated last year
• PKU-ML / LongPPL
  Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"
  ☆91Updated 2 months ago
• hanxuhu / SeqIns
  The repository of the project "Fine-tuning Large Language Models with Sequential Instructions", code base comes from open-instruct and LA…
  ☆29Updated 7 months ago
• GAIR-NLP / weak-to-strong-reasoning
  ☆59Updated 10 months ago
• RUCAIBox / JiuZhang3.0
  The code and data for the paper JiuZhang3.0
  ☆47Updated last year
• SkyworkAI / MindLink
  ☆53Updated 3 weeks ago
• john-hewitt / implicit-ins
  Codebase for Instruction Following without Instruction Tuning
  ☆35Updated 9 months ago
• Leooyii / LCEG
  Long Context Extension and Generalization in LLMs
  ☆57Updated 9 months ago
• hkust-nlp / mstar
  [ICML 2025] M-STAR (Multimodal Self-Evolving TrAining for Reasoning) Project. Diving into Self-Evolving Training for Multimodal Reasoning
  ☆61Updated this week
• princeton-nlp / ProLong
  Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"
  ☆212Updated 4 months ago
• GAIR-NLP / OctoThinker
  Revisiting Mid-training in the Era of Reinforcement Learning Scaling
  ☆137Updated last week
• yyDing1 / ScaleQuest
  [ACL-25] We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLMs.
  ☆63Updated 8 months ago
• TingchenFu / MathIF
  instruction-following benchmark for large reasoning models
  ☆35Updated last month
• Infini-AI-Lab / gsm_infinite
  ☆47Updated last month
• DRSY / EasyKV
  Easy control for Key-Value Constrained Generative LLM Inference(https://arxiv.org/abs/2402.06262)
  ☆63Updated last year
• hkust-nlp / llm-compression-intelligence
  Official github repo for the paper "Compression Represents Intelligence Linearly" [COLM 2024]
  ☆138Updated 9 months ago
• allenai / easy-to-hard-generalization
  Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"
  ☆48Updated last year
• zhiyuanhubj / LongRecipe
  LongRecipe: Recipe for Efficient Long Context Generalization in Large Language Models
  ☆76Updated 9 months ago
• wwxu21 / CUT
  Source code of "Reasons to Reject? Aligning Language Models with Judgments"
  ☆58Updated last year
• hkust-nlp / B-STaR
  B-STAR: Monitoring and Balancing Exploration and Exploitation in Self-Taught Reasoners
  ☆82Updated last month