rdnfn / icai
Inverse Constitutional AI: compressing pairwise preference data into a short constitution of principles.
☆18Updated this week
Related projects ⓘ
Alternatives and complementary repositories for icai
- Directional Preference Alignment☆50Updated last month
- Official implementation of Bootstrapping Language Models via DPO Implicit Rewards☆39Updated 3 months ago
- Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"☆24Updated 7 months ago
- ICML 2024 - Official Repository for EXO: Towards Efficient Exact Optimization of Language Model Alignment☆46Updated 5 months ago
- ☆26Updated 8 months ago
- Tasks for describing differences between text distributions.☆16Updated 3 months ago
- ☆26Updated last year
- Few-shot Learning with Auxiliary Data☆26Updated 11 months ago
- ☆40Updated 2 years ago
- ☆29Updated 7 months ago
- ☆36Updated 3 months ago
- ☆53Updated 3 weeks ago
- Self-Supervised Alignment with Mutual Information☆14Updated 5 months ago
- Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"☆44Updated 10 months ago
- Evaluate the Quality of Critique☆35Updated 5 months ago
- GenRM-CoT: Data release for verification rationales☆23Updated last month
- ☆32Updated last year
- This is code for most of the experiments in the paper Understanding the Effects of RLHF on LLM Generalisation and Diversity☆38Updated 10 months ago
- Repository for Skill Set Optimization☆12Updated 3 months ago
- ☆19Updated last year
- Is In-Context Learning Sufficient for Instruction Following in LLMs?☆25Updated 5 months ago
- Repo for "Zemi: Learning Zero-Shot Semi-Parametric Language Models from Multiple Tasks" ACL 2023 Findings☆16Updated last year
- Domain-specific preference (DSP) data and customized RM fine-tuning.☆24Updated 8 months ago
- Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model☆41Updated 10 months ago
- ☆15Updated 4 months ago
- Repository for NPHardEval, a quantified-dynamic benchmark of LLMs☆48Updated 7 months ago
- ☆12Updated 5 months ago
- Are LLMs Capable of Data-based Statistical and Causal Reasoning? Benchmarking Advanced Quantitative Reasoning with Data☆30Updated 3 months ago
- ☆69Updated 8 months ago
- ☆44Updated last year