microsoft / nanovppoLinks
Nano repo for RL training of LLMs
☆64Updated 3 weeks ago
Alternatives and similar repositories for nanovppo
Users that are interested in nanovppo are comparing it to the libraries listed below
Sorting:
- A lightweight reinforcement learning framework that integrates seamlessly into your codebase, empowering developers to focus on algorithm…☆68Updated 3 weeks ago
- Implementation for FP8/INT8 Rollout for RL training without performence drop.☆200Updated this week
- ☆75Updated last month
- Async pipelined version of Verl☆116Updated 5 months ago
- ☆54Updated 3 months ago
- Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"☆225Updated this week
- ☆150Updated 9 months ago
- Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs☆188Updated 2 months ago
- A Comprehensive Survey on Long Context Language Modeling☆182Updated 2 months ago
- ☆104Updated 11 months ago
- MiroRL is an MCP-first reinforcement learning framework for deep research agent.☆151Updated 2 weeks ago
- A scalable asynchronous reinforcement learning implementation with in-flight weight updates.☆140Updated this week
- The official repo of SynLogic: Synthesizing Verifiable Reasoning Data at Scale for Learning Logical Reasoning and Beyond☆165Updated 2 months ago
- Long Context Extension and Generalization in LLMs☆60Updated 11 months ago
- Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"☆170Updated last year
- WideSearch: Benchmarking Agentic Broad Info-Seeking☆90Updated last month
- [ICML'24] The official implementation of “Rethinking Optimization and Architecture for Tiny Language Models”☆123Updated 8 months ago
- Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models☆137Updated last year
- Code for "Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate" [COLM 2025]☆171Updated 2 months ago
- Flash-Muon: An Efficient Implementation of Muon Optimizer☆185Updated 3 months ago
- ☆89Updated 4 months ago
- Exploring the Limit of Outcome Reward for Learning Mathematical Reasoning☆190Updated 5 months ago
- General Reasoner: Advancing LLM Reasoning Across All Domains☆171Updated 3 months ago
- ☆100Updated 3 months ago
- ☆198Updated 5 months ago
- REST: Retrieval-Based Speculative Decoding, NAACL 2024☆207Updated this week
- Tina: Tiny Reasoning Models via LoRA☆281Updated last month
- [ACL 2024] Long-Context Language Modeling with Parallel Encodings☆162Updated last year
- A highly capable 2.4B lightweight LLM using only 1T pre-training data with all details.☆212Updated last month
- A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Models☆63Updated 6 months ago