Alternatives and similar repositories for Skill-Neuron:

Users that are interested in Skill-Neuron are comparing it to the libraries listed below

• adymaharana / d2pruning
  ☆35Updated last year
• sail-sg / dice
  Official implementation of Bootstrapping Language Models via DPO Implicit Rewards
  ☆43Updated last week
• princeton-nlp / Edge-Pruning
  [NeurIPS 2024 Spotlight] Code and data for the paper "Finding Transformer Circuits with Edge Pruning".
  ☆50Updated last month
• abhishekpanigrahi1996 / Skill-Localization-by-grafting
  ☆50Updated last year
• tatsu-lab / test_set_contamination
  ☆37Updated last year
• JayZhang42 / SLED
  SLED: Self Logits Evolution Decoding for Improving Factuality in Large Language Model https://arxiv.org/pdf/2411.02433
  ☆26Updated 4 months ago
• uservan / ThinkPO
  ☆20Updated last month
• joonkeekim / Instructive-Decoding
  Official repository of "Distort, Distract, Decode: Instruction-Tuned Model Can Refine its Response from Noisy Instructions", ICLR 2024 Sp…
  ☆20Updated last year
• JasonForJoy / Model-Editing-Hurt
  EMNLP 2024: Model Editing Harms General Abilities of Large Language Models: Regularization to the Rescue
  ☆35Updated 5 months ago
• haotiansun14 / BBox-Adapter
  Lightweight Adapting for Black-Box Large Language Models
  ☆22Updated last year
• tianyi-lab / Mosaic-IT
  Mosaic IT: Enhancing Instruction Tuning with Data Mosaics
  ☆17Updated 2 months ago
• EnnengYang / RepresentationSurgery
  Representation Surgery for Multi-Task Model Merging. ICML, 2024.
  ☆44Updated 6 months ago
• eric-mitchell / serac
  Semi-Parametric Editing with a Retrieval-Augmented Counterfactual Model
  ☆68Updated 2 years ago
• adihaviv / idiomem
  ☆9Updated last year
• declare-lab / resta
  Restore safety in fine-tuned language models through task arithmetic
  ☆28Updated last year
• deeplearning-wisc / args
  ☆39Updated last year
• UKPLab / iclr2024-model-merging
  This is the repository for "Model Merging by Uncertainty-Based Gradient Matching", ICLR 2024.
  ☆27Updated 11 months ago
• qiuzh20 / EMoE
  Official PyTorch Implementation of EMoE: Unlocking Emergent Modularity in Large Language Models [main conference @ NAACL2024]
  ☆28Updated 10 months ago
• dannyallover / overthinking_the_truth
  ☆29Updated 11 months ago
• VITA-Group / Junk_DNA_Hypothesis
  [ICML 2024] Junk DNA Hypothesis: A Task-Centric Angle of LLM Pre-trained Weights through Sparsity; Lu Yin*, Ajay Jaiswal*, Shiwei Liu, So…
  ☆16Updated 10 months ago
• song-wx / SIFT
  [ICML2024 Spotlight] Fine-Tuning Pre-trained Large Language Models Sparsely
  ☆23Updated 9 months ago
• maszhongming / ParaKnowTransfer
  Code for "Seeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective"
  ☆32Updated 11 months ago
• PKU-ML / LongPPL
  Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"
  ☆51Updated 3 weeks ago
• yfqiu-nlp / sea-llm
  Code for the paper "Spectral Editing of Activations for Large Language Model Alignments"
  ☆22Updated 4 months ago
• Zayne-sprague / To-CoT-or-not-to-CoT
  ☆20Updated last week
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆50Updated 2 years ago
• bethgelab / sober-reasoning
  Code for "A Sober Look at Progress in Language Model Reasoning" paper
  ☆33Updated this week
• BaohaoLiao / mefts
  [NeurIPS 2023] Make Your Pre-trained Model Reversible: From Parameter to Memory Efficient Fine-Tuning
  ☆31Updated last year
• RUCAIBox / RLMEC
  The official repository of "Improving Large Language Models via Fine-grained Reinforcement Learning with Minimum Editing Constraint"
  ☆38Updated last year
• jiahai-feng / binding-iclr
  ☆13Updated last year