Notes and commented code for RLHF (PPO)
☆136Feb 27, 2024Updated 2 years ago
Alternatives and similar repositories for rlhf-ppo
Users that are interested in rlhf-ppo are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Notes about LLaMA 2 model☆75Aug 30, 2023Updated 2 years ago
- Distributed training (multi-node) of a Transformer model☆99Apr 10, 2024Updated 2 years ago
- LLaMA 2 implemented from scratch in PyTorch☆372Sep 25, 2023Updated 2 years ago
- Because it's there.☆16Sep 22, 2024Updated last year
- PiFlow: Principle-aware Scientific Discovery with Multi-Agent Collaboration☆48Jan 7, 2026Updated 6 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Official repository for our paper, Transformers Learn Higher-Order Optimization Methods for In-Context Learning: A Study with Linear Mode…☆20Nov 19, 2024Updated last year
- MegaScience: Pushing the Frontiers of Post-Training Datasets for Science Reasoning☆121Feb 2, 2026Updated 5 months ago
- Notes on the Mistral AI model☆21Dec 27, 2023Updated 2 years ago
- Pytorch code for experiments on Linear Transformers☆24Jan 12, 2024Updated 2 years ago
- ☆14Nov 15, 2022Updated 3 years ago
- ☆12Feb 3, 2025Updated last year
- Building LLaMA 4 MoE from Scratch☆77Apr 15, 2025Updated last year
- This repo contains all the codes for SEScore implementation☆15Mar 3, 2025Updated last year
- [ACL 2023] Solving Math Word Problems via Cooperative Reasoning induced Language Models (LLMs + MCTS + Self-Improvement)☆51Dec 15, 2023Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Stable Diffusion implemented from scratch in PyTorch☆1,071Oct 22, 2024Updated last year
- Attention is all you need implementation☆1,240Jun 8, 2024Updated 2 years ago
- [ICML 2026 Spotlight] Critique-GRPO: Advancing LLM Reasoning with Natural Language and Numerical Feedback☆70Jun 3, 2026Updated last month
- Synthetic Data Generation for Evaluation☆15Feb 21, 2025Updated last year
- JMLR Cover Letter Template☆10Dec 15, 2021Updated 4 years ago
- Slides for "Retrieval Augmented Generation" video☆27Nov 27, 2023Updated 2 years ago
- ☆20Dec 16, 2024Updated last year
- GAN paper list in text generation (2017-2020) Say it Often...☆12Jul 10, 2020Updated 5 years ago
- ☆46May 24, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆12May 26, 2022Updated 4 years ago
- This repo contains Lyra AI's work in the E-Commerce Hackathon organized by Trendyol and Teknofest.☆12Nov 6, 2024Updated last year
- Developing a Korean LLM model : Hate Speech Filtering, Improving conversational skills, Finetuning with the RLHF method☆19May 27, 2025Updated last year
- The official implementation of HybridNorm: Towards Stable and Efficient Transformer Training via Hybrid Normalization☆19Mar 7, 2025Updated last year
- VideoEval-Pro: Robust and Realistic Long Video Understanding Evaluation [TMLR26]☆15Jun 1, 2026Updated last month
- SPUQ: Perturbation-Based Uncertainty Quantification for Large Language Models☆17Jun 24, 2024Updated 2 years ago
- Official Pytorch implementation of Chromatic Graph Transformers☆10Jun 14, 2023Updated 3 years ago
- Clustered Compositional Embeddings☆13Oct 25, 2023Updated 2 years ago
- Sotopia-RL: Reward Design for Social Intelligence☆52Apr 1, 2026Updated 3 months ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- [ACL 2025] "CoT-UQ: Improving Response-wise Uncertainty Quantification in LLMs with Chain-of-Thought"☆17Apr 3, 2025Updated last year
- A Python toolkit to compute molecular features and predict activities and properties of small molecules☆21Jan 28, 2022Updated 4 years ago
- Ἀνατομή is a PyTorch library to analyze representation of neural networks☆13Jan 31, 2024Updated 2 years ago
- codes and plots for "Active-Dormant Attention Heads: Mechanistically Demystifying Extreme-Token Phenomena in LLMs"☆11Dec 30, 2024Updated last year
- ☆35Mar 27, 2025Updated last year
- Don't just regulate gradients like in Muon, regulate the weights too☆32Jul 30, 2025Updated 11 months ago
- Safe Python Code Execution Environment for Language Models☆17Updated this week