Alternatives and similar repositories for hyperdecoders:

Users that are interested in hyperdecoders are comparing it to the libraries listed below

• gmftbyGMFTBY / Rep-Dropout
  [NeurIPS 2023] Repetition In Repetition Out: Towards Understanding Neural Text Degeneration from the Data Perspective
  ☆30Updated last year
• Re-Align / AlignTDS
  Analyzing LLM Alignment via Token distribution shift
  ☆15Updated last year
• yuzhaouoe / pretraining-data-packing
  [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training
  ☆19Updated 5 months ago
• kernelmachine / demix
  DEMix Layers for Modular Language Modeling
  ☆53Updated 3 years ago
• shankarp8 / knowledge_distillation
  Repository for "Propagating Knowledge Updates to LMs Through Distillation" (NeurIPS 2023).
  ☆25Updated 5 months ago
• swj0419 / in-context-pretraining
  ☆47Updated 10 months ago
• SumilerGAO / SunGen
  ☆25Updated last year
• Leezekun / dialogic
  [EMNLP 2022] Code and data for "Controllable Dialogue Simulation with In-Context Learning"
  ☆34Updated last year
• yizhongw / llm-temporal-alignment
  Methods and evaluation for aligning language models temporally
  ☆27Updated 11 months ago
• KwanWaiChung / M4LE
  Code for M4LE: A Multi-Ability Multi-Range Multi-Task Multi-Domain Long-Context Evaluation Benchmark for Large Language Models
  ☆22Updated 6 months ago
• jzbjyb / ReAtt
  Retrieval as Attention
  ☆83Updated 2 years ago
• ekinakyurek / influence
  Code for "Tracing Knowledge in Language Models Back to the Training Data"
  ☆37Updated 2 years ago
• declare-lab / resta
  Restore safety in fine-tuned language models through task arithmetic
  ☆26Updated 10 months ago
• McGill-NLP / polytropon
  ☆52Updated last year
• txsun1997 / Metric-Fairness
  EMNLP'2022: BERTScore is Unfair: On Social Bias in Language Model-Based Metrics for Text Generation
  ☆40Updated 2 years ago
• gmftbyGMFTBY / MomentumDecoding
  Momentum Decoding: Open-ended Text Generation as Graph Exploration
  ☆19Updated 2 years ago
• swj0419 / kNN_prompt
  TBC
  ☆26Updated 2 years ago
• dqxiu / KAssess
  ☆14Updated last year
• PrasannS / rlhf-length-biases
  ☆27Updated 11 months ago
• yxuansu / Contrastive_Search_versus_Contrastive_Decoding
  An Empirical Study On Contrastive Search And Contrastive Decoding For Open-ended Text Generation
  ☆26Updated 8 months ago
• cxcscmu / MATES
  Official repository for MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models [NeurIPS 2024]
  ☆58Updated 3 months ago
• KaiLv69 / UDR
  ACL'23: Unified Demonstration Retriever for In-Context Learning
  ☆36Updated last year
• renll / SparseLT
  [EMNLP 2022] Language Model Pre-Training with Sparse Latent Typing
  ☆14Updated 2 years ago
• llyx97 / TAMT
  [NAACL 2022] "Learning to Win Lottery Tickets in BERT Transfer via Task-agnostic Mask Training", Yuanxin Liu, Fandong Meng, Zheng Lin, Pe…
  ☆15Updated 2 years ago
• jiacheng-ye / ZeroGen
  [EMNLP 2022] Code for our paper “ZeroGen: Efficient Zero-shot Learning via Dataset Generation”.
  ☆46Updated 2 years ago
• SimengSun / ChapterBreak
  ☆11Updated 8 months ago
• lancopku / MUKI
  [Findings of EMNLP22] From Mimicking to Integrating: Knowledge Integration for Pre-Trained Language Models
  ☆19Updated last year
• wzhouad / context-faithful-llm
  Code and data for paper "Context-faithful Prompting for Large Language Models".
  ☆39Updated last year
• OhadRubin / EPR
  ☆60Updated 2 years ago
• ndaheim / faithful-dialogue
  ☆23Updated last year