s-smits / grpo-optuna
Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
☆39Updated 2 months ago
Alternatives and similar repositories for grpo-optuna:
Users that are interested in grpo-optuna are comparing it to the libraries listed below
- Simple GRPO scripts and configurations.☆58Updated 2 months ago
- A fast, local, and secure approach for training LLMs for coding tasks using GRPO with WebAssembly and interpreter feedback.☆22Updated last week
- ☆48Updated last year
- Using modal.com to process FineWeb-edu data☆20Updated last week
- Lego for GRPO☆26Updated last week
- look how they massacred my boy☆63Updated 5 months ago
- ☆38Updated 8 months ago
- ☆40Updated 2 months ago
- Latent Large Language Models☆17Updated 7 months ago
- ☆48Updated 5 months ago
- Very minimal (and stateless) agent framework☆42Updated 3 months ago
- Train your own SOTA deductive reasoning model☆83Updated last month
- Testing paligemma2 finetuning on reasoning dataset☆18Updated 3 months ago
- NanoGPT (124M) quality in 2.67B tokens☆28Updated this week
- The Benefits of a Concise Chain of Thought on Problem Solving in Large Language Models☆21Updated 4 months ago
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated last year
- Using multiple LLMs for ensemble Forecasting☆16Updated last year
- ☆50Updated 4 months ago
- Repo hosting codes and materials related to speeding LLMs' inference using token merging.☆35Updated 11 months ago
- ☆19Updated 8 months ago
- QAlign is a new test-time alignment approach that improves language model performance by using Markov chain Monte Carlo methods.☆15Updated last week
- Repository for the Q-Filters method (https://arxiv.org/pdf/2503.02812)☆28Updated last month
- ☆18Updated 3 weeks ago
- entropix style sampling + GUI☆25Updated 5 months ago
- an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)☆95Updated last month
- The official evaluation suite and dynamic data release for MixEval.☆11Updated 6 months ago
- [ACL 2024] Do Large Language Models Latently Perform Multi-Hop Reasoning?☆60Updated 3 weeks ago
- Small, simple agent task environments for training and evaluation☆18Updated 5 months ago
- Entropy Based Sampling and Parallel CoT Decoding☆17Updated 6 months ago
- ☆20Updated last month