microsoft / nanovppoLinks
Nano repo for RL training of LLMs
☆70Updated last month
Alternatives and similar repositories for nanovppo
Users that are interested in nanovppo are comparing it to the libraries listed below
Sorting:
- A lightweight reinforcement learning framework that integrates seamlessly into your codebase, empowering developers to focus on algorithm…☆91Updated 3 months ago
- Async pipelined version of Verl☆125Updated 8 months ago
- Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"☆240Updated 3 months ago
- ☆86Updated 3 months ago
- Implementation for FP8/INT8 Rollout for RL training without performence drop.☆279Updated last month
- Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs☆197Updated last week
- A Comprehensive Survey on Long Context Language Modeling☆213Updated 2 weeks ago
- [NeurIPS 2025] The official repo of SynLogic: Synthesizing Verifiable Reasoning Data at Scale for Learning Logical Reasoning and Beyond☆187Updated 5 months ago
- Long Context Extension and Generalization in LLMs☆62Updated last year
- General Reasoner: Advancing LLM Reasoning Across All Domains [NeurIPS25]☆209Updated 2 weeks ago
- A Large-Scale, Challenging, Decontaminated, and Verifiable Mathematical Dataset for Advancing Reasoning☆280Updated 2 months ago
- A set of examples based on verl for end-to-end RL training recipes.☆58Updated last week
- A highly capable 2.4B lightweight LLM using only 1T pre-training data with all details.☆221Updated 4 months ago
- ☆38Updated this week
- Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"☆176Updated last year
- ☆56Updated 6 months ago
- [ACL 2024] Long-Context Language Modeling with Parallel Encodings☆167Updated last year
- ☆208Updated last month
- ☆159Updated last year
- ☆85Updated last month
- LongRoPE is a novel method that can extends the context window of pre-trained LLMs to an impressive 2048k tokens.☆275Updated last month
- Klear-Reasoner: Advancing Reasoning Capability via Gradient-Preserving Clipping Policy Optimization☆80Updated 2 months ago
- Code for "Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate" [COLM 2025]☆179Updated 5 months ago
- Implementation of the LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens Paper☆152Updated last year
- Flash-Muon: An Efficient Implementation of Muon Optimizer☆223Updated 5 months ago
- [ICML'24] The official implementation of “Rethinking Optimization and Architecture for Tiny Language Models”☆126Updated 10 months ago
- [ICML 2025] |TokenSwift: Lossless Acceleration of Ultra Long Sequence Generation☆118Updated 6 months ago
- ☆122Updated 6 months ago
- Code for paper "Patch-Level Training for Large Language Models"☆95Updated last month
- Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models☆137Updated last year