Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
☆59Oct 18, 2025Updated 4 months ago
Alternatives and similar repositories for grpo-optuna
Users that are interested in grpo-optuna are comparing it to the libraries listed below
Sorting:
- Project code for training LLMs to write better unit tests + code☆21May 19, 2025Updated 9 months ago
- This project shows how to build a simple handwriting recognizer in Keras with the IAM dataset.☆13Aug 15, 2021Updated 4 years ago
- ☆15Apr 26, 2025Updated 10 months ago
- Various test models in WNNX format. It can view with `pip install wnetron && wnetron`☆12Jun 22, 2022Updated 3 years ago
- Tiny evaluation of leading LLMs on competitive programming problems☆14Nov 28, 2024Updated last year
- Standalone commandline CLI tool for compiling Triton kernels☆20Sep 13, 2024Updated last year
- Minimal (truly) muP implementation, consistent with TP4 and TP5 papers notation☆14Jan 2, 2026Updated 2 months ago
- ICML 2025 Spotlight, PCEvolve: Private Contrastive Evolution for Synthetic Dataset Generation via Few-Shot Private Data and Generative AP…☆14Jun 27, 2025Updated 8 months ago
- Implements RNNPool and SoftPool for CNNs.☆14Jan 29, 2021Updated 5 years ago
- Implementation for the paper "Fictitious Synthetic Data Can Improve LLM Factuality via Prerequisite Learning"☆11Jan 10, 2025Updated last year
- NanoGPT (124M) in 5 minutes☆15Feb 14, 2025Updated last year
- Minimal Objective-C app for iOS using ggwave☆16Jul 17, 2022Updated 3 years ago
- Companion Repo for the Vision Language Modelling YouTube series - https://bit.ly/3PsbsC2 - by Prithivi Da. Open to PRs and collaborations☆14Aug 16, 2022Updated 3 years ago
- ☆14Oct 18, 2023Updated 2 years ago
- ☆37May 5, 2025Updated 10 months ago
- This project takes the arXiv dataset and builds an automatic tag classifier from the arXiv article/paper titles☆13Aug 18, 2021Updated 4 years ago
- An AI character interaction system with emotional modeling and advanced memory management☆17Oct 26, 2024Updated last year
- Shows how to create basic image adversaries, and train adversarially robust image classifiers (to some extent).☆13Oct 14, 2020Updated 5 years ago
- Transfer Learning in Dialogue Benchmarking Toolkit☆14Mar 31, 2023Updated 2 years ago
- ☆12Jun 2, 2023Updated 2 years ago
- official implementation of paper "Process Reward Model with Q-value Rankings"☆66Feb 5, 2025Updated last year
- Interactive environment to explore DeepSeek-R1 on Google Colab, featuring Gradio UI and LangChain pipelines, with Ollama as the model run…☆18Jan 31, 2025Updated last year
- An implementation of the Anthropic's paper and essay on "A statistical approach to model evaluations"☆17Oct 6, 2025Updated 5 months ago
- DuoGuard: A Two-Player RL-Driven Framework for Multilingual LLM Guardrails☆31Feb 26, 2025Updated last year
- various experiments for scaling inference time compute with small reasoning models☆17Jan 16, 2025Updated last year
- This repo maintains a 'cheat sheet' for LLMs that are undertrained on mlx☆18Mar 15, 2025Updated 11 months ago
- in this repository, i'm going to implement increasingly complex llm inference optimizations☆84May 22, 2025Updated 9 months ago
- PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)☆66Mar 24, 2025Updated 11 months ago
- ☆94Jul 4, 2025Updated 8 months ago
- A tree-based prefix cache library that allows rapid creation of looms: hierarchal branching pathways of LLM generations.☆78Feb 11, 2025Updated last year
- Official implementation of the ICML 2024 paper RoSA (Robust Adaptation)☆44Feb 13, 2024Updated 2 years ago
- ☆119Feb 25, 2026Updated last week
- Advanced Coding AI Assistant that uses a Gradio interface to stream coding related responses. ChatRAG supports local and API inference an…☆23May 6, 2025Updated 10 months ago
- Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"☆92Oct 30, 2024Updated last year
- Async RL Training at Scale☆1,107Updated this week
- Very minimal (and stateless) agent framework☆44Jan 12, 2025Updated last year
- Helper scripts and notes that were used while porting various nlp models☆49Mar 22, 2022Updated 3 years ago
- Exploring Applications of GRPO☆252Aug 25, 2025Updated 6 months ago
- ☆67May 23, 2025Updated 9 months ago