OSU-NLP-Group / GrokkedTransformerLinks
Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'
☆193Updated 6 months ago
Alternatives and similar repositories for GrokkedTransformer
Users that are interested in GrokkedTransformer are comparing it to the libraries listed below
Sorting:
- Repository for the paper Stream of Search: Learning to Search in Language☆146Updated 3 months ago
- ☆174Updated last month
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆173Updated 2 months ago
- A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning☆169Updated this week
- Reproducible, flexible LLM evaluations☆203Updated 3 weeks ago
- Benchmarking LLMs with Challenging Tasks from Real Users☆223Updated 6 months ago
- Official repository for "Scaling Retrieval-Based Langauge Models with a Trillion-Token Datastore".☆201Updated 3 weeks ago
- ☆97Updated 11 months ago
- ☆131Updated 6 months ago
- ☆114Updated 3 months ago
- ☆120Updated 8 months ago
- Implementation of the Quiet-STAR paper (https://arxiv.org/pdf/2403.09629.pdf)☆54Updated 9 months ago
- Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"☆106Updated last year
- Open source interpretability artefacts for R1.☆138Updated last month
- The HELMET Benchmark☆148Updated last month
- [ICML 2025] Flow of Reasoning: Training LLMs for Divergent Reasoning with Minimal Examples☆88Updated this week
- Self-playing Adversarial Language Game Enhances LLM Reasoning, NeurIPS 2024☆128Updated 3 months ago
- LOFT: A 1 Million+ Token Long-Context Benchmark☆198Updated last month
- Replicating O1 inference-time scaling laws☆87Updated 6 months ago
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆171Updated 4 months ago
- A simple unified framework for evaluating LLMs☆215Updated last month
- "Improving Mathematical Reasoning with Process Supervision" by OPENAI☆107Updated last week
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆75Updated 9 months ago
- Code for the paper "VinePPO: Unlocking RL Potential For LLM Reasoning Through Refined Credit Assignment"☆159Updated last week
- Benchmark and research code for the paper SWEET-RL Training Multi-Turn LLM Agents onCollaborative Reasoning Tasks☆207Updated 3 weeks ago
- Function Vectors in Large Language Models (ICLR 2024)☆167Updated last month
- EvaByte: Efficient Byte-level Language Models at Scale☆98Updated last month
- Code and example data for the paper: Rule Based Rewards for Language Model Safety☆187Updated 10 months ago
- [NeurIPS 2024] Knowledge Circuits in Pretrained Transformers☆148Updated 3 months ago
- Code for In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steering☆174Updated 3 months ago