JacobPfau / fillerTokens
☆60Updated 11 months ago
Alternatives and similar repositories for fillerTokens:
Users that are interested in fillerTokens are comparing it to the libraries listed below
- Replicating O1 inference-time scaling laws☆83Updated 4 months ago
- A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Models☆47Updated 2 months ago
- Stanford NLP Python library for benchmarking the utility of LLM interpretability methods☆70Updated 3 weeks ago
- Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"☆47Updated last year
- Repository for NPHardEval, a quantified-dynamic benchmark of LLMs☆53Updated last year
- ☆31Updated 3 months ago
- ☆166Updated last week
- Code for Paper: Teaching Language Models to Critique via Reinforcement Learning☆94Updated last week
- ☆78Updated 8 months ago
- Advancing Language Model Reasoning through Reinforcement Learning and Inference Scaling☆101Updated 3 months ago
- ☆46Updated last month
- NeurIPS 2024 tutorial on LLM Inference☆42Updated 4 months ago
- Codebase for Instruction Following without Instruction Tuning☆34Updated 7 months ago
- Flow of Reasoning: Training LLMs for Divergent Problem Solving with Minimal Examples☆84Updated last month
- Exploration of automated dataset selection approaches at large scales.☆39Updated last month
- ☆126Updated 5 months ago
- Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"☆84Updated last year
- ☆96Updated 9 months ago
- From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients. Ajay Jaiswal, Lu Yin, Zhenyu Zhang, Shiwei Liu,…☆44Updated this week
- ☆89Updated 7 months ago
- ☆66Updated last month
- A dataset of LLM-generated chain-of-thought steps annotated with mistake location.☆80Updated 8 months ago
- ☆114Updated 2 months ago
- ☆25Updated 3 months ago
- ☆57Updated last month
- The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling☆29Updated last month
- Code for reproducing our paper "Not All Language Model Features Are Linear"☆73Updated 4 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆55Updated 7 months ago
- What Happened in LLMs Layers when Trained for Fast vs. Slow Thinking: A Gradient Perspective☆63Updated last month
- Language models scale reliably with over-training and on downstream tasks☆96Updated last year