RLHF experiments on a single A100 40G GPU. Support PPO, GRPO, REINFORCE, RAFT, RLOO, ReMax, DeepSeek R1-Zero reproducing.
☆81Feb 19, 2025Updated last year
Alternatives and similar repositories for nanoRLHF
Users that are interested in nanoRLHF are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- nanoGRPO is a lightweight implementation of Group Relative Policy Optimization (GRPO)☆144May 8, 2025Updated last year
- ☆13Sep 12, 2024Updated 2 years ago
- 🧭 SailCompass: Towards Reproducible and Robust Evaluation for Southeast Asian Languages☆13Feb 12, 2025Updated last year
- This is a project designed for tts, based on the minimind codebase.☆13Feb 10, 2025Updated last year
- Llama-3-SynE: A Significantly Enhanced Version of Llama-3 with Advanced Scientific Reasoning and Chinese Language Capabilities | 继续预训练提升 …☆40May 31, 2025Updated last year
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- A comprehensive overview of Data Distillation and Condensation (DDC). DDC is a data-centric task where a representative (i.e., small but …☆13Dec 1, 2022Updated 3 years ago
- From Llama to Deepseek, grpo/mtp implemented. With pt/sft/lora/qlora included☆31Apr 21, 2025Updated last year
- Code for safety test in "Keeping LLMs Aligned After Fine-tuning: The Crucial Role of Prompt Templates"☆22Sep 21, 2025Updated last year
- ☆21Apr 16, 2025Updated last year
- ☆33Feb 9, 2025Updated last year
- Official implementation of Privacy Implications of Retrieval-Based Language Models (EMNLP 2023). https://arxiv.org/abs/2305.14888☆37Jun 10, 2024Updated 2 years ago
- [AAAI25] Official Repo of Paper `ChatBug: A Common Vulnerability of Aligned LLMs Induced by Chat Templates`☆14Mar 22, 2025Updated last year
- CVPR 2026☆13Feb 23, 2026Updated 8 months ago
- Simple RL training for reasoning☆3,880Dec 23, 2025Updated 10 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆71Jul 28, 2024Updated 2 years ago
- ☆13Sep 30, 2024Updated 2 years ago
- "R1-Ranker: Teaching LLM Rankers to Reason", Tao Feng, Zhigang Hua, Zijie Lei, Yan Xie, Shuang Yang, Bo Long, Jiaxuan You☆14Feb 5, 2026Updated 9 months ago
- Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];☆42Jan 4, 2024Updated 2 years ago
- Reliable Sandbox for Agent, with agent-aware Checkpoint and Restore ability.☆14Aug 31, 2026Updated 2 months ago
- Code Implementation of Adversarial Prompt Evaluation paper☆14Sep 18, 2025Updated last year
- ☆13Jul 2, 2025Updated last year
- A LLaMA1/LLaMA12 Megatron implement.☆28Dec 13, 2023Updated 2 years ago
- The official implement of paper "Does Federated Learning Really Need Backpropagation?"☆24Feb 9, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- WATERMELON: Multi-Agent Reinforcement Learning Based Algorithmic Stock Trading System with GUI Application☆18Sep 8, 2022Updated 4 years ago
- ☆27Aug 17, 2026Updated 2 months ago
- Reproduce R1 Zero on Logic Puzzle☆2,452Mar 20, 2025Updated last year
- Official implementation of Bootstrapping Language Models via DPO Implicit Rewards☆49Apr 15, 2025Updated last year
- ☆12Apr 13, 2026Updated 6 months ago
- Improving large language models with concept-aware fine-tuning (CAFT)☆30Jan 31, 2026Updated 9 months ago
- ☆14Oct 18, 2023Updated 3 years ago
- Reading seminar in Harvard Cloud Networking and Systems Group☆16Aug 29, 2022Updated 4 years ago
- MemoryDial☆15Mar 10, 2026Updated 7 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Code for ACL 2024 paper: PrivLM-Bench: A Multi-level Privacy Evaluation Benchmark for Language Models.☆15Feb 5, 2025Updated last year
- ☆126May 28, 2024Updated 2 years ago
- Simple and scalable tools for data-driven pretraining data selection.☆32Jun 9, 2025Updated last year
- search-agent☆27Sep 14, 2026Updated last month
- ☆78Dec 26, 2023Updated 2 years ago
- Data and Code Repository for “STRIDE-ED: A Strategy-Grounded Stepwise Reasoning Framework for Empathetic Dialogue Systems”☆17Apr 17, 2026Updated 6 months ago
- FeatureAlignment = Alignment + Mechanistic Interpretability☆35Mar 8, 2025Updated last year