p1nksnow / MoICELinks
Official implementation for "Mixture of In-Context Experts Enhance LLMs’ Awareness of Long Contexts" (Accepted by Neurips2024)
☆13Updated 10 months ago
Alternatives and similar repositories for MoICE
Users that are interested in MoICE are comparing it to the libraries listed below
Sorting:
- [COLM 2025] SEAL: Steerable Reasoning Calibration of Large Language Models for Free☆45Updated 7 months ago
- [EMNLP 25] An effective and interpretable weight-editing method for mitigating overly short reasoning in LLMs, and a mechanistic study un…☆16Updated 2 months ago
- ThinK: Thinner Key Cache by Query-Driven Pruning☆24Updated 9 months ago
- ☆22Updated 2 years ago
- [NeurIPS 2023] Github repository for "Composing Parameter-Efficient Modules with Arithmetic Operations"☆61Updated 2 years ago
- ☆51Updated last year
- Codebase for decoding compressed trust.☆25Updated last year
- This pytorch package implements PLATON: Pruning Large Transformer Models with Upper Confidence Bound of Weight Importance (ICML 2022).☆46Updated 3 years ago
- ☆79Updated 3 years ago
- ☆14Updated last year
- Must-read Papers on Large Language Model (LLM) Continual Learning☆148Updated 2 years ago
- ☆142Updated last year
- Localize-and-Stitch: Efficient Model Merging via Sparse Task Arithmetic☆30Updated 2 months ago
- AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.☆96Updated last year
- A curated list of awesome resources dedicated to Scaling Laws for LLMs☆80Updated 2 years ago
- The repo for In-context Autoencoder☆149Updated last year
- [ACL 2024] Shifting Attention to Relevance: Towards the Predictive Uncertainty Quantification of Free-Form Large Language Models☆59Updated last year
- Code associated with Tuning Language Models by Proxy (Liu et al., 2024)☆123Updated last year
- [NeurIPS'23] Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptors☆82Updated 11 months ago
- Principled Data Selection for Alignment: The Hidden Risks of Difficult Examples☆44Updated 4 months ago
- ☆29Updated last year
- ☆13Updated 2 months ago
- Code for ACL 2024 accepted paper titled "SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language …☆36Updated 10 months ago
- Official repository for ICLR 2024 Spotlight paper "Large Language Models Are Not Robust Multiple Choice Selectors"☆42Updated 6 months ago
- A Sober Look at Language Model Reasoning☆89Updated last week
- ☆13Updated 4 months ago
- [EMNLP 2023] MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop Questions☆119Updated last year
- To mitigate position bias in LLMs, especially in long-context scenarios, we scale only one dimension of LLMs, reducing position bias and …☆11Updated last year
- [NeurIPS 2024 Spotlight] EMR-Merging: Tuning-Free High-Performance Model Merging☆72Updated 8 months ago
- ☆101Updated 2 years ago