microsoft / nanovppoLinks
Nano repo for RL training of LLMs
☆66Updated last month
Alternatives and similar repositories for nanovppo
Users that are interested in nanovppo are comparing it to the libraries listed below
Sorting:
- A lightweight reinforcement learning framework that integrates seamlessly into your codebase, empowering developers to focus on algorithm…☆68Updated last month
- ☆54Updated 3 months ago
- ☆151Updated 10 months ago
- Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"☆229Updated 3 weeks ago
- Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-based LLMs☆192Updated 3 months ago
- Implementation for FP8/INT8 Rollout for RL training without performence drop.☆249Updated last week
- Long Context Extension and Generalization in LLMs☆60Updated last year
- ☆105Updated last year
- A Comprehensive Survey on Long Context Language Modeling☆189Updated 2 months ago
- The official repo of SynLogic: Synthesizing Verifiable Reasoning Data at Scale for Learning Logical Reasoning and Beyond☆165Updated 3 months ago
- A lightweight reproduction of DeepSeek-R1-Zero with indepth analysis of self-reflection behavior.☆244Updated 5 months ago
- LongRoPE is a novel method that can extends the context window of pre-trained LLMs to an impressive 2048k tokens.☆260Updated last year
- ☆78Updated last month
- Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models☆137Updated last year
- [EMNLP 2025 Industry] Repo for "Z1: Efficient Test-time Scaling with Code"☆64Updated 5 months ago
- Async pipelined version of Verl☆117Updated 5 months ago
- Flash-Muon: An Efficient Implementation of Muon Optimizer☆189Updated 3 months ago
- [COLM 2025] An Open Math Pre-trainng Dataset with 370B Tokens.☆100Updated 6 months ago
- Fused Qwen3 MoE layer for faster training, compatible with HF Transformers, LoRA, 4-bit quant, Unsloth☆183Updated 2 weeks ago
- [ICML 2025] |TokenSwift: Lossless Acceleration of Ultra Long Sequence Generation☆113Updated 4 months ago
- ☆169Updated 5 months ago
- ☆318Updated 4 months ago
- [ACL 2024] Long-Context Language Modeling with Parallel Encodings☆163Updated last year
- Code for "Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate" [COLM 2025]☆172Updated 2 months ago
- [ICML 2025] Predictive Data Selection: The Data That Predicts Is the Data That Teaches☆55Updated 7 months ago
- General Reasoner: Advancing LLM Reasoning Across All Domains [NeurIPS25]☆174Updated 3 months ago
- Code for paper "Patch-Level Training for Large Language Models"☆88Updated 10 months ago
- ☆96Updated 3 weeks ago
- patches for huggingface transformers to save memory☆28Updated 4 months ago
- WideSearch: Benchmarking Agentic Broad Info-Seeking☆94Updated last month