p1nksnow / MoICELinks
Official implementation for "Mixture of In-Context Experts Enhance LLMs’ Awareness of Long Contexts" (Accepted by Neurips2024)
☆13Updated 11 months ago
Alternatives and similar repositories for MoICE
Users that are interested in MoICE are comparing it to the libraries listed below
Sorting:
- [COLM 2025] SEAL: Steerable Reasoning Calibration of Large Language Models for Free☆47Updated 8 months ago
- ThinK: Thinner Key Cache by Query-Driven Pruning☆25Updated 10 months ago
- ☆51Updated last year
- Code associated with Tuning Language Models by Proxy (Liu et al., 2024)☆126Updated last year
- [ACL 2024] Shifting Attention to Relevance: Towards the Predictive Uncertainty Quantification of Free-Form Large Language Models☆59Updated last year
- Code for ACL 2024 accepted paper titled "SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language …☆38Updated 11 months ago
- [EMNLP 25] An effective and interpretable weight-editing method for mitigating overly short reasoning in LLMs, and a mechanistic study un…☆16Updated this week
- Accepted LLM Papers in NeurIPS 2024☆37Updated last year
- ☆14Updated last year
- [NeurIPS 2023] Github repository for "Composing Parameter-Efficient Modules with Arithmetic Operations"☆61Updated 2 years ago
- Must-read Papers on Large Language Model (LLM) Continual Learning☆148Updated 2 years ago
- This pytorch package implements PLATON: Pruning Large Transformer Models with Upper Confidence Bound of Weight Importance (ICML 2022).☆46Updated 3 years ago
- ☆13Updated 3 months ago
- ☆41Updated 2 years ago
- A Sober Look at Language Model Reasoning☆89Updated last month
- ☆79Updated 3 years ago
- ☆13Updated 5 months ago
- The repo for In-context Autoencoder☆157Updated last year
- Localize-and-Stitch: Efficient Model Merging via Sparse Task Arithmetic☆31Updated 2 months ago
- [NeurIPS 2024] "Can Language Models Perform Robust Reasoning in Chain-of-thought Prompting with Noisy Rationales?"☆37Updated 5 months ago
- [EMNLP 2023] MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop Questions☆118Updated last year
- ☆142Updated last year
- ☆181Updated last year
- TRACE: A Comprehensive Benchmark for Continual Learning in Large Language Models☆83Updated last year
- [NeurIPS'23] Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptors☆82Updated last year
- AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.☆97Updated last year
- ☆22Updated 2 years ago
- ☆17Updated last year
- Source code of ACL 2023 Main Conference Paper "PAD-Net: An Efficient Framework for Dynamic Networks".☆12Updated last year
- Model merging is a highly efficient approach for long-to-short reasoning.☆92Updated 2 months ago