tyler-romero / microR1
Simple repository for training small reasoning models
☆27Updated 3 months ago
Alternatives and similar repositories for microR1
Users that are interested in microR1 are comparing it to the libraries listed below
Sorting:
- prime-rl is a codebase for decentralized RL training at scale☆89Updated this week
- Compiling useful links, papers, benchmarks, ideas, etc.☆46Updated last month
- ☆48Updated 6 months ago
- LLM training in simple, raw C/CUDA☆14Updated 5 months ago
- ☆114Updated 2 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆57Updated 8 months ago
- A fast, local, and secure approach for training LLMs for coding tasks using GRPO with WebAssembly and interpreter feedback.☆22Updated last month
- ☆25Updated 3 months ago
- Simple GRPO scripts and configurations.☆58Updated 3 months ago
- NanoGPT (124M) quality in 2.67B tokens☆28Updated last week
- ☆27Updated 10 months ago
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆52Updated 3 months ago
- Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Fl…☆72Updated 8 months ago
- Training an LLM to use a calculator with multi-turn reinforcement learning, achieving a **62% absolute increase in evaluation accuracy**.☆31Updated last week
- NanoGPT-speedrunning for the poor T4 enjoyers☆64Updated 2 weeks ago
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆98Updated 2 months ago
- ☆25Updated 7 months ago
- A repository for research on medium sized language models.☆76Updated 11 months ago
- Verifiers for LLM Reinforcement Learning☆18Updated 3 weeks ago
- Official Code Release for "Training a Generally Curious Agent"☆20Updated last month
- A scalable asynchronous reinforcement learning implementation with in-flight weight updates.☆100Updated this week
- [ACL 2024] Do Large Language Models Latently Perform Multi-Hop Reasoning?☆65Updated last month
- Testing paligemma2 finetuning on reasoning dataset☆18Updated 4 months ago
- Official Repo for InSTA: Towards Internet-Scale Training For Agents☆36Updated 2 weeks ago
- ☆43Updated last year
- Code and data for the paper "Why think step by step? Reasoning emerges from the locality of experience"☆60Updated last month
- NeurIPS 2024 tutorial on LLM Inference☆43Updated 5 months ago
- ☆18Updated 7 months ago
- The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling☆29Updated last month
- ☆47Updated 8 months ago