gauss5930 / iDUS
An unofficial implementation of SOLAR-10.7B model and the newly proposed interlocked-DUS(iDUS) implementation and experiment details.
☆13Updated 8 months ago
Related projects ⓘ
Alternatives and complementary repositories for iDUS
- [ACL 2024] LangBridge: Multilingual Reasoning Without Multilingual Supervision☆81Updated 3 weeks ago
- [NeurIPS 2024] Train LLMs with diverse system messages reflecting individualized preferences to generalize to unseen system messages☆37Updated last month
- [EMNLP Findings 2024 & ACL 2024 NLRSE Oral] Enhancing Mathematical Reasoning in Language Models with Fine-grained Rewards☆44Updated 6 months ago
- ☆23Updated 11 months ago
- All-in-one repository for Fine-tuning & Pretraining (Large) Language Models☆15Updated last year
- Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model☆41Updated 10 months ago
- Official implementation of "OffsetBias: Leveraging Debiased Data for Tuning Evaluators"☆14Updated 2 months ago
- [NAACL 2024] Official repository for "KTRL+F: Knowledge-Augmented In-Document Search"☆20Updated last month
- ☆9Updated 2 months ago
- [ACL 2023] Gradient Ascent Post-training Enhances Language Model Generalization☆27Updated 2 months ago
- Official code for the ACL 2024 paper: Chat Vector: A Simple Approach to Equip LLMs with Instruction Following and Model Alignment in New …☆33Updated 5 months ago
- Critique-out-Loud Reward Models☆37Updated last month
- Minimal implementation of the Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Models paper (ArXiv 20232401.01335)☆28Updated 8 months ago
- IntructIR, a novel benchmark specifically designed to evaluate the instruction following ability in information retrieval models. Our foc…☆28Updated 5 months ago
- Calculating Expected Time for training LLM.☆38Updated last year
- KoCommonGEN v2: A Benchmark for Navigating Korean Commonsense Reasoning Challenges in Large Language Models☆25Updated 2 months ago
- ☆26Updated last year
- Official Code Repository for the paper "Knowledge-Augmented Reasoning Distillation for Small Language Models in Knowledge-intensive Tasks…☆34Updated last month
- evolve llm training instruction, from english instruction to any language.☆113Updated last year
- Official codebase for permutation self-consistency.☆16Updated 9 months ago
- [ACL 2024] Self-Training with Direct Preference Optimization Improves Chain-of-Thought Reasoning☆30Updated 3 months ago
- official repository for ListT5☆35Updated last month
- FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions☆40Updated 4 months ago
- Code for "Democratizing Reasoning Ability: Tailored Learning from Large Language Model", EMNLP 2023☆31Updated 11 months ago
- ☆18Updated 3 months ago
- ☆17Updated 6 months ago
- Difference-based Contrastive Learning for Korean Sentence Embeddings☆24Updated last year
- Pytorch implementation for "Compressed Context Memory For Online Language Model Interaction" (ICLR'24)☆50Updated 7 months ago
- Code and Data Repo for ACL'23 Paper "Element-aware Summary and Summary Chain-of-Thought (SumCoT)"☆53Updated 10 months ago
- Benchmarking Benchmark Leakage in Large Language Models☆46Updated 6 months ago