ash-neupane / multi-token-predLinks
Train toy models using multi-token prediction objective
☆13Updated last year
Alternatives and similar repositories for multi-token-pred
Users that are interested in multi-token-pred are comparing it to the libraries listed below
Sorting:
- ☆47Updated 7 months ago
- ☆66Updated 5 months ago
- official implementation of ICLR'2025 paper: Rethinking Bradley-Terry Models in Preference-based Reward Modeling: Foundations, Theory, and…☆69Updated 7 months ago
- A Sober Look at Language Model Reasoning☆89Updated last week
- ☆106Updated last year
- ☆76Updated last year
- ☆29Updated 5 months ago
- [NAACL 25 main] Awesome LLM Causal Reasoning is a collection of LLM-based casual reasoning works, including papers, codes and datasets.☆104Updated 2 months ago
- [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…☆56Updated 2 years ago
- [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)☆139Updated 4 months ago
- Reference implementation for Token-level Direct Preference Optimization(TDPO)☆148Updated 9 months ago
- Reinforcing General Reasoning without Verifiers☆92Updated 5 months ago
- ☆17Updated 3 months ago
- Code for "Reasoning to Learn from Latent Thoughts"☆122Updated 8 months ago
- The code for creating the iGSM datasets in papers "Physics of Language Models Part 2.1, Grade-School Math and the Hidden Reasoning Proces…☆80Updated 10 months ago
- ICML 2024 - Official Repository for EXO: Towards Efficient Exact Optimization of Language Model Alignment☆57Updated last year
- Domain-specific preference (DSP) data and customized RM fine-tuning.☆25Updated last year
- [NeurIPS 2024] Official code of $\beta$-DPO: Direct Preference Optimization with Dynamic $\beta$☆49Updated last year
- ☆34Updated last year
- "Improving Mathematical Reasoning with Process Supervision" by OPENAI☆113Updated last month
- code for paper Query-Dependent Prompt Evaluation and Optimization with Offline Inverse Reinforcement Learning☆42Updated last year
- PhyX: Does Your Model Have the "Wits" for Physical Reasoning?☆49Updated last month
- ☆51Updated 9 months ago
- Kinetics: Rethinking Test-Time Scaling Laws☆82Updated 4 months ago
- Research Code for preprint "Optimizing Test-Time Compute via Meta Reinforcement Finetuning".☆115Updated 3 months ago
- ☆96Updated 9 months ago
- Reproduction of "RLCD Reinforcement Learning from Contrast Distillation for Language Model Alignment☆69Updated 2 years ago
- Implementation of the ICML 2024 paper "Training Large Language Models for Reasoning through Reverse Curriculum Reinforcement Learning" pr…☆113Updated last year
- [ICLR 2025] MiniPLM: Knowledge Distillation for Pre-Training Language Models☆68Updated last year
- This my attempt to create Self-Correcting-LLM based on the paper Training Language Models to Self-Correct via Reinforcement Learning by g…☆37Updated 4 months ago