Alternatives and similar repositories for Instructive-Decoding

Users that are interested in Instructive-Decoding are comparing it to the libraries listed below

• raymin0223 / fast_robust_early_exit
  Fast and Robust Early-Exiting Framework for Autoregressive Language Models with Synchronized Parallel Decoding (EMNLP 2023 Long)
  ☆65Updated last year
• EnnengYang / RepresentationSurgery
  Representation Surgery for Multi-Task Model Merging. ICML, 2024.
  ☆47Updated last year
• yaojin17 / Unlearning_LLM
  [ACL 2024] Code and data for "Machine Unlearning of Pre-trained Large Language Models"
  ☆66Updated last year
• Nardien / KARD
  Official Code Repository for the paper "Knowledge-Augmented Reasoning Distillation for Small Language Models in Knowledge-intensive Tasks…
  ☆42Updated last year
• PositionalHidden / PositionalHidden
  To mitigate position bias in LLMs, especially in long-context scenarios, we scale only one dimension of LLMs, reducing position bias and …
  ☆11Updated last year
• hbin0701 / Self-Explore
  [𝐄𝐌𝐍𝐋𝐏 𝐅𝐢𝐧𝐝𝐢𝐧𝐠𝐬 𝟐𝟎𝟐𝟒 & 𝐀𝐂𝐋 𝟐𝟎𝟐𝟒 𝐍𝐋𝐑𝐒𝐄 𝐎𝐫𝐚𝐥] 𝘌𝘯𝘩𝘢𝘯𝘤𝘪𝘯𝘨 𝘔𝘢𝘵𝘩𝘦𝘮𝘢𝘵𝘪𝘤𝘢𝘭 𝘙𝘦𝘢𝘴𝘰𝘯𝘪𝘯…
  ☆51Updated last year
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆56Updated 2 years ago
• yule-BUAA / MergeLLM
  Codes for Merging Large Language Models
  ☆35Updated last year
• uservan / ThinkPO
  ☆17Updated 6 months ago
• princeton-nlp / Edge-Pruning
  [NeurIPS 2024 Spotlight] Code and data for the paper "Finding Transformer Circuits with Edge Pruning".
  ☆64Updated 5 months ago
• kaistAI / Knowledge-Entropy
  [ICLR 2025 Oral] Knowledge Entropy Decay during Language Model Pretraining Hinders New Knowledge Acquisition
  ☆16Updated last year
• MattYoon / reasoning-models-confidence
  [NeurIPS 2025] Reasoning Models Better Express Their Confidence"
  ☆22Updated 2 months ago
• avalonstrel / Mitigating-the-Alignment-Tax-of-RLHF
  ☆16Updated last year
• qiuzh20 / EMoE
  Official PyTorch Implementation of EMoE: Unlocking Emergent Modularity in Large Language Models [main conference @ NAACL2024]
  ☆39Updated last year
• snu-mllab / Bayesian-Red-Teaming
  About Official PyTorch implementation of "Query-Efficient Black-Box Red Teaming via Bayesian Optimization" (ACL'23)
  ☆15Updated 2 years ago
• abdelfattah-lab / TokenButler
  ☆27Updated 2 months ago
• RUCAIBox / RLMEC
  The official repository of "Improving Large Language Models via Fine-grained Reinforcement Learning with Minimum Editing Constraint"
  ☆39Updated 2 years ago
• UKPLab / iclr2024-model-merging
  This is the repository for "Model Merging by Uncertainty-Based Gradient Matching", ICLR 2024.
  ☆29Updated last year
• adymaharana / d2pruning
  ☆43Updated 2 years ago
• kamanphoebe / Look-into-MoEs
  [NAACL 2025] A Closer Look into Mixture-of-Experts in Large Language Models
  ☆58Updated last year
• JasonForJoy / Model-Editing-Hurt
  EMNLP 2024: Model Editing Harms General Abilities of Large Language Models: Regularization to the Rescue
  ☆38Updated 8 months ago
• cxcscmu / MATES
  Official repository for MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models [NeurIPS 2024]
  ☆79Updated last year
• sail-sg / Attention-Sink
  [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)
  ☆152Updated 6 months ago
• r-three / smear
  ☆30Updated 2 years ago
• zjysteven / mink-plus-plus
  [ICLR'25 Spotlight] Min-K%++: Improved baseline for detecting pre-training data of LLMs
  ☆52Updated 8 months ago
• Zayne-sprague / To-CoT-or-not-to-CoT
  ☆25Updated 9 months ago
• THU-KEG / RM-Bench
  [ICLR 25 Oral] RM-Bench: Benchmarking Reward Models of Language Models with Subtlety and Style
  ☆73Updated 6 months ago
• hkust-nlp / Activation_Decoding
  In-Context Sharpness as Alerts: An Inner Representation Perspective for Hallucination Mitigation (ICML 2024)
  ☆62Updated last year
• liutianlin0121 / decoding-time-realignment
  Implementation of "Decoding-time Realignment of Language Models", ICML 2024.
  ☆21Updated last year
• sail-sg / dice
  Official implementation of Bootstrapping Language Models via DPO Implicit Rewards
  ☆47Updated 9 months ago