NVIDIA-NeMo / RLLinks
Scalable toolkit for efficient model reinforcement
☆1,141Updated last week
Alternatives and similar repositories for RL
Users that are interested in RL are comparing it to the libraries listed below
Sorting:
- A project to improve skills of large language models☆715Updated this week
- SkyRL: A Modular Full-stack RL Library for LLMs☆1,394Updated this week
- ☆941Updated last month
- Scalable toolkit for efficient model alignment☆846Updated 2 months ago
- Checkpoint-engine is a simple middleware to update model weights in LLM inference engines☆871Updated this week
- PyTorch building blocks for the OLMo ecosystem☆612Updated this week
- slime is an LLM post-training framework for RL Scaling.☆2,911Updated last week
- ☆610Updated last week
- Async RL Training at Scale☆950Updated this week
- PyTorch-native post-training at scale☆572Updated this week
- LLM KV cache compression made easy☆729Updated last week
- 🌾 OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.☆584Updated this week
- Muon is Scalable for LLM Training☆1,387Updated 4 months ago
- OLMoE: Open Mixture-of-Experts Language Models☆930Updated 3 months ago
- 🐳 Efficient Triton implementations for "Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention"☆944Updated 9 months ago
- HuggingFace conversion and training library for Megatron-based models☆295Updated this week
- Ring attention implementation with flash attention☆949Updated 3 months ago
- ☆565Updated 3 months ago
- Understanding R1-Zero-Like Training: A Critical Perspective☆1,177Updated 3 months ago
- Single File, Single GPU, From Scratch, Efficient, Full Parameter Tuning library for "RL for LLMs"☆569Updated 2 months ago
- FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.☆327Updated last month
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆275Updated last month
- KernelBench: Can LLMs Write GPU Kernels? - Benchmark + Toolkit with Torch -> CUDA (+ more DSLs)☆718Updated last week
- Recipes to scale inference-time compute of open models☆1,120Updated 7 months ago
- ☆225Updated last month
- Minimalistic large language model 3D-parallelism training☆2,381Updated 2 weeks ago
- Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…☆362Updated last year
- Parallel Scaling Law for Language Model — Beyond Parameter and Inference Time Scaling☆463Updated 7 months ago
- [NeurIPS 2025 Spotlight] Reasoning Environments for Reinforcement Learning with Verifiable Rewards☆1,283Updated last week
- Minimalistic 4D-parallelism distributed training framework for education purpose☆1,923Updated 4 months ago