Alternatives and similar repositories for nanovppo

Users that are interested in nanovppo are comparing it to the libraries listed below

• YuchuanTian / RethinkTinyLM
  [ICML'24] The official implementation of “Rethinking Optimization and Architecture for Tiny Language Models”
  ☆121Updated 5 months ago
• princeton-nlp / ProLong
  Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"
  ☆189Updated 3 months ago
• GAIR-NLP / OctoThinker
  Revisiting Mid-training in the Era of RL Scaling
  ☆62Updated 2 months ago
• Leooyii / LCEG
  Long Context Extension and Generalization in LLMs
  ☆57Updated 9 months ago
• Infini-AI-Lab / gsm_infinite
  ☆47Updated 2 weeks ago
• LLM360 / MegaMath
  An Open Math Pre-trainng Dataset with 370B Tokens.
  ☆89Updated 2 months ago
• ScalingIntelligence / large_language_monkeys
  ☆96Updated 9 months ago
• LCLM-Horizon / A-Comprehensive-Survey-For-Long-Context-Language-Modeling
  A Comprehensive Survey on Long Context Language Modeling
  ☆152Updated 3 weeks ago
• SkyworkAI / Skywork-MoE
  Skywork-MoE: A Deep Dive into Training Techniques for Mixture-of-Experts Language Models
  ☆133Updated last year
• agentica-project / verl-pipeline
  Async pipelined version of Verl
  ☆100Updated 2 months ago
• SynthLabsAI / big-math
  A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Models
  ☆57Updated 4 months ago
• vwxyzjn / summarize_from_feedback_details
  ☆142Updated 7 months ago
• hkust-nlp / PreSelect
  [ICML 2025] Predictive Data Selection: The Data That Predicts Is the Data That Teaches
  ☆49Updated 3 months ago
• ServiceNow / PipelineRL
  A scalable asynchronous reinforcement learning implementation with in-flight weight updates.
  ☆125Updated this week
• ISEEKYAN / mbridge
  ☆43Updated this week
• nil0x9 / flash-muon
  Flash-Muon: An Efficient Implementation of Muon Optimizer
  ☆131Updated last week
• rlite-project / RLite
  A lightweight reinforcement learning framework that integrates seamlessly into your codebase, empowering developers to focus on algorithm…
  ☆32Updated last month
• yegcjs / mixinglaws
  ☆101Updated 8 months ago
• zankner / Hydra
  ☆45Updated last year
• wdlctc / mini-s
  ☆51Updated 7 months ago
• princeton-pli / MeCo
  Code for preprint "Metadata Conditioning Accelerates Language Model Pre-training (MeCo)"
  ☆39Updated last month
• OpenNLPLab / LASP
  Linear Attention Sequence Parallelism (LASP)
  ☆84Updated last year
• TIGER-AI-Lab / General-Reasoner
  General Reasoner: Advancing LLM Reasoning Across All Domains
  ☆141Updated 2 weeks ago
• microsoft / SWE-bench-Live
  🚀 SWE-bench Goes Live!
  ☆80Updated this week
• Zanette-Labs / SpeculativeRejection
  [NeurIPS 2024] Fast Best-of-N Decoding via Speculative Rejection
  ☆45Updated 7 months ago
• Edward-Sun / gpt-accelera
  Simple and efficient pytorch-native transformer training and inference (batched)
  ☆76Updated last year
• yyht / openrlhf_async_pipline
  ☆53Updated last week
• princeton-nlp / CEPE
  [ACL 2024] Long-Context Language Modeling with Parallel Encodings
  ☆154Updated last year
• MiniMax-AI / SynLogic
  The official repo of SynLogic: Synthesizing Verifiable Reasoning Data at Scale for Learning Logical Reasoning and Beyond
  ☆138Updated 3 weeks ago
• mnoukhov / async_rlhf
  Code and Configs for Asynchronous RLHF: Faster and More Efficient RL for Language Models
  ☆57Updated 2 months ago