fangyuan-ksgk / Tiny-GRPOLinks
minimal GRPO implementation from scratch
☆94Updated 4 months ago
Alternatives and similar repositories for Tiny-GRPO
Users that are interested in Tiny-GRPO are comparing it to the libraries listed below
Sorting:
- Tina: Tiny Reasoning Models via LoRA☆275Updated this week
- A simplified implementation for experimenting with RLVR on GSM8K, This repository provides a starting point for exploring reasoning.☆120Updated 6 months ago
- nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)☆113Updated 3 months ago
- The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".☆174Updated 4 months ago
- An extension of the nanoGPT repository for training small MOE models.☆172Updated 5 months ago
- OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.☆173Updated 6 months ago
- Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch☆178Updated last month
- Complex Function Calling Benchmark.☆123Updated 6 months ago
- Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks (EMNLP'24)☆147Updated 10 months ago
- Lightweight toolkit package to train and fine-tune 1.58bit Language models☆82Updated 2 months ago
- RL significantly the reasoning capability of Qwen2.5-1.5B-Instruct☆29Updated 5 months ago
- A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).☆265Updated 2 weeks ago
- This is the official repository for Inheritune.☆112Updated 6 months ago
- Verifiers for LLM Reinforcement Learning☆69Updated 3 months ago
- Exploring Applications of GRPO☆245Updated last month
- ☆48Updated 11 months ago
- [ACL 2025] Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward Systems☆99Updated 2 months ago
- a curated list of the role of small models in the LLM era☆103Updated 10 months ago
- Official Code Repository for the paper "Distilling LLM Agent into Small Models with Retrieval and Code Tools"☆130Updated this week
- Survey: A collection of AWESOME papers and resources on the latest research in Mixture of Experts.☆128Updated 11 months ago
- Chain of Experts (CoE) enables communication between experts within Mixture-of-Experts (MoE) models☆220Updated last month
- A compact LLM pretrained in 9 days by using high quality data☆320Updated 4 months ago
- ☆101Updated 10 months ago
- ☆208Updated 5 months ago
- EvolKit is an innovative framework designed to automatically enhance the complexity of instructions used for fine-tuning Large Language M…☆232Updated 9 months ago
- Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)☆160Updated 3 months ago
- My fork os allen AI's OLMo for educational purposes.☆30Updated 8 months ago
- Reproduction of DeepSeek-R1☆235Updated 3 months ago
- A pipeline for LLM knowledge distillation☆106Updated 4 months ago
- [ACL'24] Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning☆360Updated 11 months ago