bbartoldson / TBALinks
Official implementation of TBA for async LLM post-training.
☆15Updated this week
Alternatives and similar repositories for TBA
Users that are interested in TBA are comparing it to the libraries listed below
Sorting:
- Revisiting Mid-training in the Era of RL Scaling☆48Updated last month
- ☆34Updated 2 months ago
- Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"☆47Updated last year
- Code and data used in the paper: "Training on Incorrect Synthetic Data via RL Scales LLM Math Reasoning Eight-Fold"☆30Updated 11 months ago
- Code and Configs for Asynchronous RLHF: Faster and More Efficient RL for Language Models☆53Updated last month
- A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Models☆55Updated 3 months ago
- Learning from preferences is a common paradigm for fine-tuning language models. Yet, many algorithmic design decisions come into play. Ou…☆29Updated last year
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆75Updated 9 months ago
- A scalable asynchronous reinforcement learning implementation with in-flight weight updates.☆117Updated this week
- The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling☆32Updated 2 months ago
- ☆49Updated 3 weeks ago
- Repository for NPHardEval, a quantified-dynamic benchmark of LLMs☆54Updated last year
- ☆13Updated last month
- Simple and efficient pytorch-native transformer training and inference (batched)☆75Updated last year
- The repository contains code for Adaptive Data Optimization☆24Updated 5 months ago
- This repo is based on https://github.com/jiaweizzhao/GaLore☆28Updated 8 months ago
- Code for preprint "Metadata Conditioning Accelerates Language Model Pre-training (MeCo)"☆39Updated 3 weeks ago
- The official implementation for Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free☆38Updated 3 weeks ago
- Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"☆78Updated 2 weeks ago
- [ICML 2025] Teaching Language Models to Critique via Reinforcement Learning☆98Updated 3 weeks ago
- Using FlexAttention to compute attention with different masking patterns☆43Updated 8 months ago
- ☆48Updated 3 weeks ago
- Reinforcing General Reasoning without Verifiers☆33Updated last week
- Codebase for Instruction Following without Instruction Tuning☆34Updated 8 months ago
- The official implementation of Regularized Policy Gradient (RPG) (https://arxiv.org/abs/2505.17508)☆27Updated last week
- GenRM-CoT: Data release for verification rationales☆61Updated 7 months ago
- ☆92Updated 8 months ago
- ☆85Updated last year
- Critique-out-Loud Reward Models☆66Updated 7 months ago
- A version of verl to support tool use☆41Updated last week