microsoft / nanovppoLinks
Nano repo for RL training of LLMs
☆70Updated 2 months ago
Alternatives and similar repositories for nanovppo
Users that are interested in nanovppo are comparing it to the libraries listed below
Sorting:
- A lightweight reinforcement learning framework that integrates seamlessly into your codebase, empowering developers to focus on algorithm…☆95Updated 4 months ago
- Async pipelined version of Verl☆124Updated 8 months ago
- Implementation for FP8/INT8 Rollout for RL training without performence drop.☆282Updated last month
- [NeurIPS 2025] The official repo of SynLogic: Synthesizing Verifiable Reasoning Data at Scale for Learning Logical Reasoning and Beyond☆187Updated 5 months ago
- ☆87Updated 4 months ago
- Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"☆243Updated 3 months ago
- (best/better) practices of megatron on veRL and tuning guide☆113Updated 3 months ago
- Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs☆198Updated 3 weeks ago
- Klear-Reasoner: Advancing Reasoning Capability via Gradient-Preserving Clipping Policy Optimization☆80Updated last week
- General Reasoner: Advancing LLM Reasoning Across All Domains [NeurIPS25]☆211Updated last month
- Long Context Extension and Generalization in LLMs☆62Updated last year
- A Large-Scale, Challenging, Decontaminated, and Verifiable Mathematical Dataset for Advancing Reasoning☆280Updated 3 months ago
- ☆160Updated last year
- Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models☆138Updated last year
- A lightweight reproduction of DeepSeek-R1-Zero with indepth analysis of self-reflection behavior.☆249Updated 8 months ago
- A scalable asynchronous reinforcement learning implementation with in-flight weight updates.☆340Updated last week
- A Comprehensive Survey on Long Context Language Modeling☆216Updated last month
- LongRoPE is a novel method that can extends the context window of pre-trained LLMs to an impressive 2048k tokens.☆276Updated 2 months ago
- ☆39Updated 3 weeks ago
- [ICML 2025] |TokenSwift: Lossless Acceleration of Ultra Long Sequence Generation☆118Updated 7 months ago
- ☆85Updated last month
- ☆79Updated 9 months ago
- [COLM 2025] An Open Math Pre-trainng Dataset with 370B Tokens.☆109Updated 8 months ago
- A set of examples based on verl for end-to-end RL training recipes.☆87Updated last month
- ☆99Updated 4 months ago
- WideSearch: Benchmarking Agentic Broad Info-Seeking☆109Updated 2 months ago
- HuggingFace conversion and training library for Megatron-based models☆314Updated this week
- Fused Qwen3 MoE layer for faster training, compatible with HF Transformers, LoRA, 4-bit quant, Unsloth☆217Updated this week
- ☆61Updated 6 months ago
- [EMNLP'25 Industry] Repo for "Z1: Efficient Test-time Scaling with Code"☆67Updated 8 months ago