rdnfn / icai
Inverse Constitutional AI [ICLR 2025]: compressing pairwise preference data into a short constitution of principles.
☆22Updated this week
Alternatives and similar repositories for icai:
Users that are interested in icai are comparing it to the libraries listed below
- ☆34Updated last year
- Self-Supervised Alignment with Mutual Information☆16Updated 10 months ago
- ☆26Updated 8 months ago
- Official code repo for paper "Great Memory, Shallow Reasoning: Limits of kNN-LMs"☆22Updated 7 months ago
- Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model☆42Updated last year
- ☆27Updated last year
- [ICLR 2025] "Training LMs on Synthetic Edit Sequences Improves Code Synthesis" (Piterbarg, Pinto, Fergus)☆18Updated last month
- Tasks for describing differences between text distributions.☆16Updated 7 months ago
- Few-shot Learning with Auxiliary Data☆27Updated last year
- Code and Configs for Asynchronous RLHF: Faster and More Efficient RL for Language Models☆41Updated last week
- https://footprints.baulab.info☆17Updated 5 months ago
- Repository for NPHardEval, a quantified-dynamic benchmark of LLMs☆52Updated last year
- CausalGym: Benchmarking causal interpretability methods on linguistic tasks☆41Updated 4 months ago
- Augmenting Statistical Models with Natural Language Parameters☆24Updated 6 months ago
- ☆39Updated 2 years ago
- Official implementation of Bootstrapping Language Models via DPO Implicit Rewards☆43Updated 8 months ago
- ☆45Updated last year
- [EMNLP 2023, Findings] GRACE: Discriminator-Guided Chain-of-Thought Reasoning☆47Updated 5 months ago
- Exploration of automated dataset selection approaches at large scales.☆34Updated last month
- A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Models☆44Updated last month
- Codebase for Context-aware Meta-learned Loss Scaling (CaMeLS). https://arxiv.org/abs/2305.15076.☆25Updated last year
- Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"☆46Updated last year
- [ACL 2024] Masked Thought: Simply Masking Partial Reasoning Steps Can Improve Mathematical Reasoning Learning of Language Models☆18Updated 8 months ago
- Evaluate the Quality of Critique☆34Updated 10 months ago
- ☆19Updated last year
- A library for efficient patching and automatic circuit discovery.☆62Updated last month
- ☆22Updated 6 months ago
- ☆38Updated last year
- ☆73Updated 11 months ago
- Offcial Repo of Paper "Eliminating Position Bias of Language Models: A Mechanistic Approach""☆13Updated 7 months ago