brendanhogan / DeepSeekRL-ExtendedLinks
Exploring Applications of GRPO
☆252Updated 4 months ago
Alternatives and similar repositories for DeepSeekRL-Extended
Users that are interested in DeepSeekRL-Extended are comparing it to the libraries listed below
Sorting:
- rl from zero pretrain, can it be done? yes.☆286Updated 3 months ago
- Build your own visual reasoning model☆417Updated last week
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆175Updated last year
- Tina: Tiny Reasoning Models via LoRA☆314Updated 3 months ago
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆109Updated 10 months ago
- Train your own SOTA deductive reasoning model☆107Updated 10 months ago
- ☆136Updated 10 months ago
- Single File, Single GPU, From Scratch, Efficient, Full Parameter Tuning library for "RL for LLMs"☆581Updated 3 months ago
- minimal GRPO implementation from scratch☆102Updated 10 months ago
- Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…☆370Updated last year
- nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)☆140Updated 8 months ago
- ⚖️ Awesome LLM Judges ⚖️☆148Updated 8 months ago
- Training teachers with reinforcement learning able to make LLMs learn how to reason for test time scaling.☆358Updated 6 months ago
- FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.☆331Updated 2 months ago
- ☆133Updated last year
- An extension of the nanoGPT repository for training small MOE models.☆226Updated 10 months ago
- Async RL Training at Scale☆1,005Updated this week
- NanoGPT-speedrunning for the poor T4 enjoyers☆73Updated 8 months ago
- Storing long contexts in tiny caches with self-study☆231Updated last month
- Training an LLM to use a calculator with multi-turn reinforcement learning, achieving a **62% absolute increase in evaluation accuracy**.☆65Updated 8 months ago
- ☆116Updated last week
- Minimal hackable GRPO implementation☆316Updated 11 months ago
- The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…☆126Updated 3 months ago
- Simple & Scalable Pretraining for Neural Architecture Research☆306Updated last month
- This repo contains the source code for the paper "Evolution Strategies at Scale: LLM Fine-Tuning Beyond Reinforcement Learning"☆285Updated last month
- ☆467Updated 4 months ago
- Official PyTorch implementation for Hogwild! Inference: Parallel LLM Generation with a Concurrent Attention Cache☆141Updated 5 months ago
- code for training & evaluating Contextual Document Embedding models☆202Updated 8 months ago
- A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning☆342Updated last week
- DeMo: Decoupled Momentum Optimization☆198Updated last year