Alternatives and similar repositories for MoICE

Users that are interested in MoICE are comparing it to the libraries listed below

• SalesforceAIResearch / ThinK
  ThinK: Thinner Key Cache by Query-Driven Pruning
  ☆24Updated 8 months ago
• JingXuTHU / Random-Masking-Finds-Winning-Tickets-for-Parameter-Efficient-Fine-tuning
  ☆14Updated last year
• Trustworthy-ML-Lab / ThinkEdit
  [EMNLP 25] An effective and interpretable weight-editing method for mitigating overly short reasoning in LLMs, and a mechanistic study un…
  ☆15Updated last month
• VITA-Group / SEAL
  Official code for SEAL: Steerable Reasoning Calibration of Large Language Models for Free
  ☆44Updated 7 months ago
• abhishekpanigrahi1996 / Skill-Localization-by-grafting
  ☆51Updated last year
• hkust-nlp / PEM_composition
  [NeurIPS 2023] Github repository for "Composing Parameter-Efficient Modules with Arithmetic Operations"
  ☆61Updated last year
• EnnengYang / AdaMerging
  AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR, 2024.
  ☆94Updated last year
• thunlp / MoEfication
  ☆140Updated last year
• QingruZhang / PLATON
  This pytorch package implements PLATON: Pruning Large Transformer Models with Upper Confidence Bound of Weight Importance (ICML 2022).
  ☆46Updated 3 years ago
• uiuctml / Localize-and-Stitch
  Localize-and-Stitch: Efficient Model Merging via Sparse Task Arithmetic
  ☆30Updated last month
• mmatena / model_merging
  ☆78Updated 3 years ago
• lorenzkuhn / semantic_uncertainty
  ☆180Updated last year
• jinhaoduan / SAR
  [ACL 2024] Shifting Attention to Relevance: Towards the Predictive Uncertainty Quantification of Free-Form Large Language Models
  ☆59Updated last year
• alisawuffles / proxy-tuning
  Code associated with Tuning Language Models by Proxy (Liu et al., 2024)
  ☆121Updated last year
• getao / icae
  The repo for In-context Autoencoder
  ☆150Updated last year
• TaiMingLu / know-dont-tell
  ☆16Updated last year
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆55Updated 2 years ago
• guyuntian / CoT_benchmark
  Code for "Towards Revealing the Mystery behind Chain of Thought: a Theoretical Perspective"
  ☆20Updated 2 years ago
• socialfoundations / tttlm
  Test-time-training on nearest neighbors for large language models
  ☆46Updated last year
• AGI-Edgerunners / LLM-Continual-Learning-Papers
  Must-read Papers on Large Language Model (LLM) Continual Learning
  ☆147Updated last year
• MANGA-UOFA / fdistill
  ☆22Updated 2 years ago
• nik-dim / tall_masks
  Official repository of "Localizing Task Information for Improved Model Merging and Compression" [ICML 2024]
  ☆51Updated last year
• TsinghuaC3I / SoRA
  [EMNLP 2023, Main Conference] Sparse Low-rank Adaptation of Pre-trained Language Models
  ☆83Updated last year
• nightdessert / Retrieval_Head
  open-source code for paper: Retrieval Head Mechanistically Explains Long-Context Factuality
  ☆219Updated last year
• zlin7 / UQ-NLG
  ☆102Updated last year
• VITA-Group / Junk_DNA_Hypothesis
  [ICML 2024] Junk DNA Hypothesis: A Task-Centric Angle of LLM Pre-trained Weights through Sparsity; Lu Yin*, Ajay Jaiswal*, Shiwei Liu, So…
  ☆16Updated 6 months ago
• RZFan525 / Awesome-ScalingLaws
  A curated list of awesome resources dedicated to Scaling Laws for LLMs
  ☆79Updated 2 years ago
• Thartvigsen / GRACE
  [NeurIPS'23] Aging with GRACE: Lifelong Model Editing with Discrete Key-Value Adaptors
  ☆82Updated 10 months ago
• bethgelab / sober-reasoning
  A Sober Look at Language Model Reasoning
  ☆87Updated last month
• circle-hit / SAPT
  Code for ACL 2024 accepted paper titled "SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language …
  ☆36Updated 9 months ago