ServiceNow / PipelineRLLinks
A scalable asynchronous reinforcement learning implementation with in-flight weight updates.
☆125Updated this week
Alternatives and similar repositories for PipelineRL
Users that are interested in PipelineRL are comparing it to the libraries listed below
Sorting:
- Code and Configs for Asynchronous RLHF: Faster and More Efficient RL for Language Models☆57Updated last month
- Simple and efficient pytorch-native transformer training and inference (batched)☆76Updated last year
- ☆96Updated 8 months ago
- Async pipelined version of Verl☆100Updated 2 months ago
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆75Updated 10 months ago
- Archon provides a modular framework for combining different inference-time techniques and LMs with just a JSON config file.☆173Updated 3 months ago
- Official repository for R2E-Gym: Procedural Environment Generation and Hybrid Verifiers for Scaling Open-Weights SWE Agents☆76Updated 2 weeks ago
- Code for Paper: Learning Adaptive Parallel Reasoning with Language Models☆103Updated last month
- Cold Compress is a hackable, lightweight, and open-source toolkit for creating and benchmarking cache compression methods built on top of…☆137Updated 10 months ago
- Code for the paper "VinePPO: Unlocking RL Potential For LLM Reasoning Through Refined Credit Assignment"☆161Updated 3 weeks ago
- Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"☆189Updated 3 months ago
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆126Updated 6 months ago
- NeurIPS 2024 tutorial on LLM Inference☆45Updated 6 months ago
- ☆200Updated this week
- The evaluation framework for training-free sparse attention in LLMs☆69Updated this week
- ☆48Updated last week
- Scalable toolkit for efficient model reinforcement☆438Updated this week
- ☆115Updated 4 months ago
- The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models" [AISTATS …☆59Updated 8 months ago
- EvaByte: Efficient Byte-level Language Models at Scale☆101Updated 2 months ago
- Language models scale reliably with over-training and on downstream tasks☆97Updated last year
- Replicating O1 inference-time scaling laws☆87Updated 6 months ago
- ☆193Updated 4 months ago
- ☆51Updated 7 months ago
- The HELMET Benchmark☆154Updated 2 months ago
- ☆46Updated last week
- PyTorch building blocks for the OLMo ecosystem☆234Updated this week
- A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).☆255Updated this week
- A toolkit for scaling law research ⚖☆49Updated 4 months ago
- The simplest implementation of recent Sparse Attention patterns for efficient LLM inference.☆70Updated last week