Alternatives and similar repositories for hyperdecoders

Users that are interested in hyperdecoders are comparing it to the libraries listed below

• swj0419 / in-context-pretraining
  ☆50Updated last year
• yuzhaouoe / pretraining-data-packing
  [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training
  ☆21Updated 8 months ago
• ekinakyurek / influence
  Code for "Tracing Knowledge in Language Models Back to the Training Data"
  ☆38Updated 2 years ago
• Re-Align / AlignTDS
  Analyzing LLM Alignment via Token distribution shift
  ☆16Updated last year
• wzhouad / context-faithful-llm
  Code and data for paper "Context-faithful Prompting for Large Language Models".
  ☆39Updated 2 years ago
• kernelmachine / demix
  DEMix Layers for Modular Language Modeling
  ☆53Updated 3 years ago
• Leezekun / dialogic
  [EMNLP 2022] Code and data for "Controllable Dialogue Simulation with In-Context Learning"
  ☆35Updated 2 years ago
• SimengSun / ChapterBreak
  ☆11Updated 11 months ago
• llyx97 / TAMT
  [NAACL 2022] "Learning to Win Lottery Tickets in BERT Transfer via Task-agnostic Mask Training", Yuanxin Liu, Fandong Meng, Zheng Lin, Pe…
  ☆15Updated 2 years ago
• gmftbyGMFTBY / Rep-Dropout
  [NeurIPS 2023] Repetition In Repetition Out: Towards Understanding Neural Text Degeneration from the Data Perspective
  ☆30Updated last year
• cxcscmu / MATES
  Official repository for MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models [NeurIPS 2024]
  ☆66Updated 6 months ago
• yizhongw / llm-temporal-alignment
  Methods and evaluation for aligning language models temporally
  ☆29Updated last year
• SumilerGAO / SunGen
  ☆26Updated 2 years ago
• gmftbyGMFTBY / MomentumDecoding
  Momentum Decoding: Open-ended Text Generation as Graph Exploration
  ☆19Updated 2 years ago
• KwanWaiChung / M4LE
  Code for M4LE: A Multi-Ability Multi-Range Multi-Task Multi-Domain Long-Context Evaluation Benchmark for Large Language Models
  ☆23Updated 9 months ago
• shankarp8 / knowledge_distillation
  Repository for "Propagating Knowledge Updates to LMs Through Distillation" (NeurIPS 2023).
  ☆25Updated 8 months ago
• KaiLv69 / UDR
  ACL'23: Unified Demonstration Retriever for In-Context Learning
  ☆37Updated last year
• swj0419 / kNN_prompt
  TBC
  ☆27Updated 2 years ago
• princeton-nlp / WhatICLLearns
  [ACL 2023 Findings] What In-Context Learning “Learns” In-Context: Disentangling Task Recognition and Task Learning
  ☆21Updated last year
• qtli / GSM-Plus
  GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.
  ☆61Updated 10 months ago
• sail-sg / symbolic-instruction-tuning
  The official repository for the paper "From Zero to Hero: Examining the Power of Symbolic Tasks in Instruction Tuning".
  ☆64Updated 2 years ago
• dqxiu / KAssess
  ☆14Updated last year
• Hunter-DDM / stablemoe
  Code for the ACL-2022 paper "StableMoE: Stable Routing Strategy for Mixture of Experts"
  ☆45Updated 2 years ago
• yxuansu / Contrastive_Search_versus_Contrastive_Decoding
  An Empirical Study On Contrastive Search And Contrastive Decoding For Open-ended Text Generation
  ☆27Updated 11 months ago
• McGill-NLP / polytropon
  ☆53Updated 2 years ago
• PrasannS / rlhf-length-biases
  ☆28Updated last year
• Nanami18 / Snowballed_Hallucination
  ☆44Updated 8 months ago
• Shentao-YANG / Preference_Grounded_Guidance
  Source codes for "Preference-grounded Token-level Guidance for Language Model Fine-tuning" (NeurIPS 2023).
  ☆16Updated 4 months ago
• aviclu / ffn-values
  ☆62Updated last year
• Zce1112zslx / IKE
  ☆41Updated last year