minosvasilias / simple_grpoLinks
Simple GRPO scripts and configurations.
☆59Updated 10 months ago
Alternatives and similar repositories for simple_grpo
Users that are interested in simple_grpo are comparing it to the libraries listed below
Sorting:
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆59Updated last month
- ☆55Updated last year
- ☆86Updated last year
- ☆52Updated 9 months ago
- Train your own SOTA deductive reasoning model☆107Updated 9 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆60Updated last year
- Project code for training LLMs to write better unit tests + code☆21Updated 6 months ago
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆173Updated 10 months ago
- Zeus LLM Trainer is a rewrite of Stanford Alpaca aiming to be the trainer for all Large Language Models☆70Updated 2 years ago
- An easy-to-understand framework for LLM samplers that rewind and revise generated tokens☆146Updated 9 months ago
- Official repo for Learning to Reason for Long-Form Story Generation☆72Updated 7 months ago
- An introduction to LLM Sampling☆79Updated 11 months ago
- Simple repository for training small reasoning models☆46Updated 10 months ago
- Verifiers for LLM Reinforcement Learning☆80Updated 7 months ago
- ☆39Updated last year
- Collection of autoregressive model implementation☆85Updated 7 months ago
- ☆68Updated 6 months ago
- Official repository for "BLEUBERI: BLEU is a surprisingly effective reward for instruction following"☆31Updated 6 months ago
- ☆48Updated last year
- ☆40Updated last year
- ☆45Updated 2 years ago
- Evaluating LLMs with CommonGen-Lite☆93Updated last year
- ☆105Updated 11 months ago
- QLoRA for Masked Language Modeling☆22Updated 2 years ago
- Using open source LLMs to build synthetic datasets for direct preference optimization☆70Updated last year
- look how they massacred my boy☆63Updated last year
- Training an LLM to use a calculator with multi-turn reinforcement learning, achieving a **62% absolute increase in evaluation accuracy**.☆60Updated 7 months ago
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆24Updated last year
- Just a bunch of benchmark logs for different LLMs☆119Updated last year
- Mixing Language Models with Self-Verification and Meta-Verification☆110Updated 11 months ago