Alternatives and similar repositories for hyperdecoders:

Users that are interested in hyperdecoders are comparing it to the libraries listed below

• kernelmachine / demix
  DEMix Layers for Modular Language Modeling
  ☆53Updated 3 years ago
• swj0419 / in-context-pretraining
  ☆47Updated 9 months ago
• shankarp8 / knowledge_distillation
  Repository for "Propagating Knowledge Updates to LMs Through Distillation" (NeurIPS 2023).
  ☆24Updated 4 months ago
• yuzhaouoe / pretraining-data-packing
  [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training
  ☆18Updated 5 months ago
• Leooyii / LCEG
  Long Context Extension and Generalization in LLMs
  ☆40Updated 3 months ago
• swj0419 / kNN_prompt
  TBC
  ☆26Updated 2 years ago
• qtli / GSM-Plus
  GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.
  ☆55Updated 6 months ago
• PrasannS / rlhf-length-biases
  ☆27Updated 10 months ago
• Nanami18 / Snowballed_Hallucination
  ☆44Updated 4 months ago
• SimengSun / ChapterBreak
  ☆11Updated 7 months ago
• yizhongw / llm-temporal-alignment
  Methods and evaluation for aligning language models temporally
  ☆27Updated 10 months ago
• KwanWaiChung / M4LE
  Code for M4LE: A Multi-Ability Multi-Range Multi-Task Multi-Domain Long-Context Evaluation Benchmark for Large Language Models
  ☆22Updated 5 months ago
• Re-Align / AlignTDS
  Analyzing LLM Alignment via Token distribution shift
  ☆14Updated 11 months ago
• AkariAsai / ATTEMPT
  This is the oficial repository for "Parameter-Efficient Multi-task Tuning via Attentional Mixtures of Soft Prompts" (EMNLP 2022)
  ☆100Updated 2 years ago
• wzhouad / context-faithful-llm
  Code and data for paper "Context-faithful Prompting for Large Language Models".
  ☆39Updated last year
• princeton-nlp / LM-Kernel-FT
  A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643
  ☆74Updated last year
• google-research-datasets / GSM-IC
  Grade-School Math with Irrelevant Context (GSM-IC) benchmark is an arithmetic reasoning dataset built upon GSM8K, by adding irrelevant se…
  ☆58Updated last year
• nayeon7lee / FactualityPrompt
  ☆84Updated 2 years ago
• Leezekun / dialogic
  [EMNLP 2022] Code and data for "Controllable Dialogue Simulation with In-Context Learning"
  ☆34Updated last year
• declare-lab / resta
  Restore safety in fine-tuned language models through task arithmetic
  ☆26Updated 9 months ago
• ekinakyurek / influence
  Code for "Tracing Knowledge in Language Models Back to the Training Data"
  ☆35Updated 2 years ago
• yumeng5 / SuperGen
  [NeurIPS 2022] Generating Training Data with Language Models: Towards Zero-Shot Language Understanding
  ☆61Updated 2 years ago
• dmis-lab / TouR
  Findings of ACL'2023: Optimizing Test-Time Query Representations for Dense Retrieval
  ☆29Updated last year
• gmftbyGMFTBY / Rep-Dropout
  [NeurIPS 2023] Repetition In Repetition Out: Towards Understanding Neural Text Degeneration from the Data Perspective
  ☆30Updated last year
• RLHFlow / Directional-Preference-Alignment
  Directional Preference Alignment
  ☆54Updated 3 months ago
• princeton-nlp / WhatICLLearns
  [ACL 2023 Findings] What In-Context Learning “Learns” In-Context: Disentangling Task Recognition and Task Learning
  ☆22Updated last year
• cxcscmu / MATES
  Official repository for MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models [NeurIPS 2024]
  ☆56Updated 2 months ago
• McGill-NLP / polytropon
  ☆52Updated last year
• aviclu / ffn-values
  ☆61Updated last year
• edenbiran / RippleEdits
  Evaluating the Ripple Effects of Knowledge Editing in Language Models
  ☆53Updated 9 months ago