shankarp8 / knowledge_distillation
Repository for "Propagating Knowledge Updates to LMs Through Distillation" (NeurIPS 2023).
☆24Updated 2 months ago
Related projects ⓘ
Alternatives and complementary repositories for knowledge_distillation
- ☆37Updated 6 months ago
- GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.☆45Updated 4 months ago
- Official repository for MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models☆47Updated last month
- ☆78Updated last year
- Codebase for Instruction Following without Instruction Tuning☆29Updated last month
- ☆33Updated 2 months ago
- LoFiT: Localized Fine-tuning on LLM Representations☆21Updated 4 months ago
- ☆26Updated last year
- Restore safety in fine-tuned language models through task arithmetic☆25Updated 7 months ago
- Code and data for paper "Context-faithful Prompting for Large Language Models".☆39Updated last year
- Long Context Extension and Generalization in LLMs☆39Updated last month
- ☆40Updated 11 months ago
- [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training☆18Updated 2 months ago
- [NeurIPS 2024] Knowledge Circuits in Pretrained Transformers☆66Updated 3 weeks ago
- Evaluate the Quality of Critique☆35Updated 5 months ago
- Evaluating the Ripple Effects of Knowledge Editing in Language Models☆50Updated 6 months ago
- [ACL 2024] Self-Training with Direct Preference Optimization Improves Chain-of-Thought Reasoning☆30Updated 3 months ago
- Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"☆73Updated last year
- Official repository for paper "Weak-to-Strong Extrapolation Expedites Alignment"☆67Updated 5 months ago
- Methods and evaluation for aligning language models temporally☆24Updated 8 months ago
- Lightweight tool to identify Data Contamination in LLMs evaluation☆40Updated 8 months ago
- Code for "Can Retriever-Augmented Language Models Reason? The Blame Game Between the Retriever and the Language Model", EMNLP Findings 20…☆27Updated last year
- ☆44Updated 2 months ago
- Code & Data for our Paper "Alleviating Hallucinations of Large Language Models through Induced Hallucinations"☆59Updated 8 months ago
- ☆25Updated last month
- Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"☆111Updated last week
- Codebase for Hyperdecoders https://arxiv.org/abs/2203.08304☆12Updated 2 years ago
- Code for Suri: Multi-constraint instruction following for long-form text generation☆17Updated last month
- ☆43Updated last year
- ☆33Updated last year