axolotl-ai-cloud / grpo_code
A fast, local, and secure approach for training LLMs for coding tasks using GRPO with WebAssembly and interpreter feedback.
☆23Updated last month
Alternatives and similar repositories for grpo_code
Users that are interested in grpo_code are comparing it to the libraries listed below
Sorting:
- Simple GRPO scripts and configurations.☆58Updated 3 months ago
- ☆48Updated 6 months ago
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆53Updated 3 months ago
- Verifiers for LLM Reinforcement Learning☆50Updated last month
- entropix style sampling + GUI☆26Updated 6 months ago
- ☆43Updated 3 months ago
- Repository containing the SPIN experiments on the DIBT 10k ranked prompts☆24Updated last year
- Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)☆90Updated 3 months ago
- Train your own SOTA deductive reasoning model☆92Updated 2 months ago
- Lego for GRPO☆28Updated last month
- Training an LLM to use a calculator with multi-turn reinforcement learning, achieving a **62% absolute increase in evaluation accuracy**.☆37Updated last week
- ☆50Updated 5 months ago
- ☆41Updated 5 months ago
- ☆31Updated 2 months ago
- Simple examples using Argilla tools to build AI☆52Updated 6 months ago
- ☆66Updated 11 months ago
- Using open source LLMs to build synthetic datasets for direct preference optimization☆61Updated last year
- Using multiple LLMs for ensemble Forecasting☆16Updated last year
- An example implementation of RLHF (or, more accurately, RLAIF) built on MLX and HuggingFace.☆26Updated 10 months ago
- ☆25Updated 7 months ago
- ☆57Updated this week
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated last year
- One Line To Build Zero-Data Classifiers in Minutes☆54Updated 7 months ago
- The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models☆22Updated 5 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆57Updated 8 months ago
- QAlign is a new test-time alignment approach that improves language model performance by using Markov chain Monte Carlo methods.☆23Updated last month
- A framework for evaluating function calls made by LLMs☆37Updated 9 months ago
- Very minimal (and stateless) agent framework☆44Updated 4 months ago
- A Qwen .5B reasoning model trained on OpenR1-Math-220k☆14Updated 2 months ago
- Fine-tunes a student LLM using teacher feedback for improved reasoning and answer quality. Implements GRPO with teacher-provided evaluati…☆42Updated last week