Alternatives and similar repositories for multi-token-pred

Users that are interested in multi-token-pred are comparing it to the libraries listed below

• holarissun / RewardModelingBeyondBradleyTerry
  official implementation of ICLR'2025 paper: Rethinking Bradley-Terry Models in Preference-based Reward Modeling: Foundations, Theory, and…
  ☆66Updated 7 months ago
• Essential-AI / reflection
  ☆47Updated 6 months ago
• GuanghaoYe / Emergence-of-Thinking
  ☆53Updated 8 months ago
• Infini-AI-Lab / GRESO
  ☆64Updated 4 months ago
• sail-sg / VeriFree
  Reinforcing General Reasoning without Verifiers
  ☆91Updated 4 months ago
• bethgelab / sober-reasoning
  A Sober Look at Language Model Reasoning
  ☆87Updated 3 weeks ago
• sail-sg / Attention-Sink
  [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)
  ☆132Updated 3 months ago
• facebookresearch / iGSM
  The code for creating the iGSM datasets in papers "Physics of Language Models Part 2.1, Grade-School Math and the Hidden Reasoning Proces…
  ☆79Updated 9 months ago
• PKU-ML / LongPPL
  Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"
  ☆103Updated 3 weeks ago
• gregorbachmann / Next-Token-Failures
  ☆103Updated last year
• facebookresearch / RLCD
  Reproduction of "RLCD Reinforcement Learning from Contrast Distillation for Language Model Alignment
  ☆69Updated 2 years ago
• HKUNLP / efficient-attention
  [EVA ICLR'23; LARA ICML'22] Efficient attention mechanisms via control variates, random features, and importance sampling
  ☆87Updated 2 years ago
• swtheing / PF-PPO-RLHF
  ☆34Updated last year
• thu-coai / MiniPLM
  [ICLR 2025] MiniPLM: Knowledge Distillation for Pre-Training Language Models
  ☆64Updated 11 months ago
• jxiw / M1
  M1: Towards Scalable Test-Time Compute with Mamba Reasoning Models
  ☆44Updated 3 months ago
• thu-wyz / inference_scaling
  ☆75Updated 11 months ago
• sail-sg / dice
  Official implementation of Bootstrapping Language Models via DPO Implicit Rewards
  ☆44Updated 6 months ago
• kamanphoebe / Look-into-MoEs
  [NAACL 2025] A Closer Look into Mixture-of-Experts in Large Language Models
  ☆55Updated 8 months ago
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆55Updated 2 years ago
• sustcsonglin / linear-attention-and-beyond-slides
  ☆95Updated 8 months ago
• Infini-AI-Lab / Kinetics
  Kinetics: Rethinking Test-Time Scaling Laws
  ☆81Updated 3 months ago
• OpenSparseLLMs / MoM
  ☆104Updated last month
• gouki510 / Topology_of_Reasoning
  ☆28Updated 4 months ago
• Dereck0602 / Awesome_Test_Time_LLMs
  ☆129Updated 7 months ago
• Vance0124 / Token-level-Direct-Preference-Optimization
  Reference implementation for Token-level Direct Preference Optimization(TDPO)
  ☆148Updated 8 months ago
• thu-ml / ReMoE
  [ICLR2025] Codebase for "ReMoE: Fully Differentiable Mixture-of-Experts with ReLU Routing", built on Megatron-LM.
  ☆97Updated 10 months ago
• hamishivi / automated-instruction-selection
  Exploration of automated dataset selection approaches at large scales.
  ☆48Updated 8 months ago
• RZFan525 / Awesome-ScalingLaws
  A curated list of awesome resources dedicated to Scaling Laws for LLMs
  ☆79Updated 2 years ago
• GraphPKU / Case_or_Rule
  exploring whether LLMs perform case-based or rule-based reasoning
  ☆29Updated last year
• Shwai-He / MEO
  The source code of "Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (EMNLP 2023)":
  ☆40Updated last year