microsoft / nanovppoLinks
Nano repo for RL training of LLMs
☆68Updated 3 weeks ago
Alternatives and similar repositories for nanovppo
Users that are interested in nanovppo are comparing it to the libraries listed below
Sorting:
- A lightweight reinforcement learning framework that integrates seamlessly into your codebase, empowering developers to focus on algorithm…☆81Updated 2 months ago
- ☆86Updated 3 months ago
- Long Context Extension and Generalization in LLMs☆62Updated last year
- Async pipelined version of Verl☆125Updated 7 months ago
- A Comprehensive Survey on Long Context Language Modeling☆203Updated 4 months ago
- Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs☆194Updated last month
- Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"☆237Updated 2 months ago
- Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models☆137Updated last year
- [NeurIPS 2025] The official repo of SynLogic: Synthesizing Verifiable Reasoning Data at Scale for Learning Logical Reasoning and Beyond☆186Updated 4 months ago
- A highly capable 2.4B lightweight LLM using only 1T pre-training data with all details.☆222Updated 3 months ago
- LongRoPE is a novel method that can extends the context window of pre-trained LLMs to an impressive 2048k tokens.☆271Updated 3 weeks ago
- Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"☆175Updated last year
- [ICLR 2025] LongPO: Long Context Self-Evolution of Large Language Models through Short-to-Long Preference Optimization☆43Updated 8 months ago
- Implementation for FP8/INT8 Rollout for RL training without performence drop.☆269Updated 2 weeks ago
- A Large-Scale, Challenging, Decontaminated, and Verifiable Mathematical Dataset for Advancing Reasoning☆273Updated last month
- [ICML'24] The official implementation of “Rethinking Optimization and Architecture for Tiny Language Models”☆125Updated 10 months ago
- General Reasoner: Advancing LLM Reasoning Across All Domains [NeurIPS25]☆199Updated 3 weeks ago
- Code for paper "Patch-Level Training for Large Language Models"☆93Updated last week
- Ouroboros: Speculative Decoding with Large Model Enhanced Drafting (EMNLP 2024 main)☆112Updated 8 months ago
- ☆120Updated 5 months ago
- ☆108Updated last year
- MiroRL is an MCP-first reinforcement learning framework for deep research agent.☆172Updated 2 months ago
- [NeurIPS 2024] Fast Best-of-N Decoding via Speculative Rejection☆52Updated last year
- Klear-Reasoner: Advancing Reasoning Capability via Gradient-Preserving Clipping Policy Optimization☆79Updated last month
- ☆27Updated 2 months ago
- Code for ICML 25 paper "Metadata Conditioning Accelerates Language Model Pre-training (MeCo)"☆47Updated 4 months ago
- [COLM 2025] An Open Math Pre-trainng Dataset with 370B Tokens.☆107Updated 7 months ago
- ☆155Updated 11 months ago
- ☆55Updated 5 months ago
- [ICML 2025] Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale☆263Updated 4 months ago