ryoungj / ObsScalingLinks
[NeurIPS'24 Spotlight] Observational Scaling Laws
☆59Updated last year
Alternatives and similar repositories for ObsScaling
Users that are interested in ObsScaling are comparing it to the libraries listed below
Sorting:
- Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision☆124Updated last year
- Code for "Reasoning to Learn from Latent Thoughts"☆122Updated 8 months ago
- [NeurIPS'24] Official code for *🎯DART-Math: Difficulty-Aware Rejection Tuning for Mathematical Problem-Solving*☆119Updated 11 months ago
- Official github repo for the paper "Compression Represents Intelligence Linearly" [COLM 2024]☆143Updated last year
- The code for creating the iGSM datasets in papers "Physics of Language Models Part 2.1, Grade-School Math and the Hidden Reasoning Proces…☆80Updated 10 months ago
- GenRM-CoT: Data release for verification rationales☆66Updated last year
- ☆59Updated 6 months ago
- open-source code for paper: Retrieval Head Mechanistically Explains Long-Context Factuality☆222Updated last year
- ☆216Updated 8 months ago
- A brief and partial summary of RLHF algorithms.☆139Updated 9 months ago
- ☆199Updated 7 months ago
- Repo of paper "Free Process Rewards without Process Labels"☆167Updated 8 months ago
- Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"☆240Updated 2 months ago
- A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Models☆68Updated 9 months ago
- A curated list of awesome resources dedicated to Scaling Laws for LLMs☆80Updated 2 years ago
- Function Vectors in Large Language Models (ICLR 2024)☆186Updated 7 months ago
- Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"☆105Updated last month
- Language models scale reliably with over-training and on downstream tasks☆100Updated last year
- [COLM 2025] Code for Paper: Learning Adaptive Parallel Reasoning with Language Models☆134Updated 3 months ago
- Test-time-training on nearest neighbors for large language models☆47Updated last year
- Code and data used in the paper: "Training on Incorrect Synthetic Data via RL Scales LLM Math Reasoning Eight-Fold"☆31Updated last year
- Code for the paper "VinePPO: Unlocking RL Potential For LLM Reasoning Through Refined Credit Assignment"☆181Updated 6 months ago
- ☆213Updated 9 months ago
- ☆76Updated last year
- ☆158Updated last year
- Long Context Extension and Generalization in LLMs☆62Updated last year
- A Sober Look at Language Model Reasoning☆89Updated 2 weeks ago
- Code accompanying the paper "Massive Activations in Large Language Models"☆187Updated last year
- [NeurIPS 2024 Spotlight] Code and data for the paper "Finding Transformer Circuits with Edge Pruning".☆62Updated 3 months ago
- A simple toolkit for benchmarking LLMs on mathematical reasoning tasks. 🧮✨☆267Updated last year