ServiceNow / PipelineRLLinks
A scalable asynchronous reinforcement learning implementation with in-flight weight updates.
☆134Updated this week
Alternatives and similar repositories for PipelineRL
Users that are interested in PipelineRL are comparing it to the libraries listed below
Sorting:
- Code and Configs for Asynchronous RLHF: Faster and More Efficient RL for Language Models☆59Updated 3 months ago
- Simple and efficient pytorch-native transformer training and inference (batched)☆78Updated last year
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆174Updated 4 months ago
- Official repository for R2E-Gym: Procedural Environment Generation and Hybrid Verifiers for Scaling Open-Weights SWE Agents☆136Updated 3 weeks ago
- Async pipelined version of Verl☆110Updated 3 months ago
- Replicating O1 inference-time scaling laws☆89Updated 8 months ago
- ☆101Updated 10 months ago
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆127Updated 8 months ago
- The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models" [AISTATS …☆61Updated 9 months ago
- The evaluation framework for training-free sparse attention in LLMs☆86Updated last month
- Storing long contexts in tiny caches with self-study☆117Updated this week
- ☆61Updated last week
- ☆117Updated 5 months ago
- [COLM 2025] Code for Paper: Learning Adaptive Parallel Reasoning with Language Models☆116Updated 3 months ago
- Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"☆218Updated 4 months ago
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆75Updated 11 months ago
- The simplest implementation of recent Sparse Attention patterns for efficient LLM inference.☆82Updated 2 weeks ago
- Cold Compress is a hackable, lightweight, and open-source toolkit for creating and benchmarking cache compression methods built on top of…☆138Updated 11 months ago
- The official repo for "LLoCo: Learning Long Contexts Offline"☆118Updated last year
- The HELMET Benchmark☆161Updated 3 months ago
- Layer-Condensed KV cache w/ 10 times larger batch size, fewer params and less computation. Dramatic speed up with better task performance…☆151Updated 3 months ago
- Physics of Language Models, Part 4☆67Updated this week
- Simple and efficient DeepSeek V3 SFT using pipeline parallel and expert parallel, with both FP8 and BF16 trainings☆50Updated last week
- ☆51Updated last month
- PyTorch building blocks for the OLMo ecosystem☆267Updated last week
- A toolkit for scaling law research ⚖☆50Updated 6 months ago
- Can Language Models Solve Olympiad Programming?☆119Updated 6 months ago
- Evaluation of LLMs on latest math competitions☆153Updated last week
- A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Models☆59Updated 5 months ago
- Official implementation of TBA for async LLM post-training.☆18Updated last month