brendanhogan / DeepSeekRL-ExtendedLinks
Exploring Applications of GRPO
☆248Updated 2 months ago
Alternatives and similar repositories for DeepSeekRL-Extended
Users that are interested in DeepSeekRL-Extended are comparing it to the libraries listed below
Sorting:
- rl from zero pretrain, can it be done? yes.☆280Updated last month
- Build your own visual reasoning model☆414Updated last month
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆173Updated 10 months ago
- Tina: Tiny Reasoning Models via LoRA☆305Updated last month
- Single File, Single GPU, From Scratch, Efficient, Full Parameter Tuning library for "RL for LLMs"☆559Updated last month
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆107Updated 8 months ago
- minimal GRPO implementation from scratch☆99Updated 8 months ago
- ☆135Updated 8 months ago
- Train your own SOTA deductive reasoning model☆107Updated 8 months ago
- Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…☆356Updated 11 months ago
- nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)☆125Updated 6 months ago
- ☆451Updated 2 months ago
- Async RL Training at Scale☆770Updated this week
- ☆126Updated 10 months ago
- Compiling useful links, papers, benchmarks, ideas, etc.☆45Updated 8 months ago
- Training teachers with reinforcement learning able to make LLMs learn how to reason for test time scaling.☆349Updated 4 months ago
- NanoGPT-speedrunning for the poor T4 enjoyers☆72Updated 6 months ago
- Minimal hackable GRPO implementation☆300Updated 9 months ago
- [ACL 2024] Do Large Language Models Latently Perform Multi-Hop Reasoning?☆82Updated 8 months ago
- An extension of the nanoGPT repository for training small MOE models.☆212Updated 8 months ago
- A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning☆311Updated 3 weeks ago
- Simple & Scalable Pretraining for Neural Architecture Research☆299Updated 2 weeks ago
- 🌾 OAT: A research-friendly framework for LLM online alignment, including reinforcement learning, preference learning, etc.☆568Updated 2 weeks ago
- FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.☆303Updated 2 weeks ago
- Official PyTorch implementation for Hogwild! Inference: Parallel LLM Generation with a Concurrent Attention Cache☆129Updated 3 months ago
- Repo for "LoLCATs: On Low-Rank Linearizing of Large Language Models"☆249Updated 9 months ago
- ⚖️ Awesome LLM Judges ⚖️☆133Updated 6 months ago
- Training-Ready RL Environments + Evals☆174Updated this week
- Training an LLM to use a calculator with multi-turn reinforcement learning, achieving a **62% absolute increase in evaluation accuracy**.☆58Updated 6 months ago
- working implimention of deepseek MLA☆45Updated 10 months ago