Alternatives and similar repositories for knowledge_distillation

Users that are interested in knowledge_distillation are comparing it to the libraries listed below

• swj0419 / in-context-pretraining
  ☆50Updated last year
• yuzhaouoe / pretraining-data-packing
  [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training
  ☆21Updated 9 months ago
• yasumasaonoe / entity_knowledge_propagation
  ☆17Updated last year
• Zce1112zslx / IKE
  ☆41Updated last year
• qtli / GSM-Plus
  GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.
  ☆62Updated 10 months ago
• eric-mitchell / serac
  Semi-Parametric Editing with a Retrieval-Augmented Counterfactual Model
  ☆68Updated 2 years ago
• wzhouad / context-faithful-llm
  Code and data for paper "Context-faithful Prompting for Large Language Models".
  ☆40Updated 2 years ago
• cxcscmu / MATES
  Official repository for MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models [NeurIPS 2024]
  ☆70Updated 6 months ago
• allenai / hyperdecoders
  Codebase for Hyperdecoders https://arxiv.org/abs/2203.08304
  ☆11Updated 2 years ago
• yizhongw / llm-temporal-alignment
  Methods and evaluation for aligning language models temporally
  ☆29Updated last year
• nayeon7lee / FactualityPrompt
  ☆85Updated 2 years ago
• archiki / ReCEval
  Supporting code for ReCEval paper
  ☆28Updated 8 months ago
• ChaosCodes / ProPETL
  One Network, Many Masks: Towards More Parameter-Efficient Transfer Learning
  ☆39Updated last year
• hbin0701 / Self-Explore
  [𝐄𝐌𝐍𝐋𝐏 𝐅𝐢𝐧𝐝𝐢𝐧𝐠𝐬 𝟐𝟎𝟐𝟒 & 𝐀𝐂𝐋 𝟐𝟎𝟐𝟒 𝐍𝐋𝐑𝐒𝐄 𝐎𝐫𝐚𝐥] 𝘌𝘯𝘩𝘢𝘯𝘤𝘪𝘯𝘨 𝘔𝘢𝘵𝘩𝘦𝘮𝘢𝘵𝘪𝘤𝘢𝘭 𝘙𝘦𝘢𝘴𝘰𝘯𝘪𝘯…
  ☆51Updated last year
• Nanami18 / Snowballed_Hallucination
  ☆44Updated 9 months ago
• jzbjyb / ReAtt
  Retrieval as Attention
  ☆83Updated 2 years ago
• chtmp223 / suri
  Suri: Multi-constraint instruction following for long-form text generation (EMNLP’24)
  ☆22Updated 6 months ago
• declare-lab / resta
  Restore safety in fine-tuned language models through task arithmetic
  ☆28Updated last year
• gmftbyGMFTBY / Rep-Dropout
  [NeurIPS 2023] Repetition In Repetition Out: Towards Understanding Neural Text Degeneration from the Data Perspective
  ☆31Updated last year
• INK-USC / FiD-ICL
  "FiD-ICL: A Fusion-in-Decoder Approach for Efficient In-Context Learning" (ACL 2023)
  ☆14Updated last year
• Zayne-sprague / MuSR
  ☆44Updated 9 months ago
• ThomasScialom / T0_continual_learning
  Adding new tasks to T0 without catastrophic forgetting
  ☆33Updated 2 years ago
• google-research-datasets / GSM-IC
  Grade-School Math with Irrelevant Context (GSM-IC) benchmark is an arithmetic reasoning dataset built upon GSM8K, by adding irrelevant se…
  ☆60Updated 2 years ago
• AkariAsai / ATTEMPT
  This is the oficial repository for "Parameter-Efficient Multi-task Tuning via Attentional Mixtures of Soft Prompts" (EMNLP 2022)
  ☆100Updated 2 years ago
• GAIR-NLP / MetaCritique
  Evaluate the Quality of Critique
  ☆35Updated last year
• nkandpa2 / long_tail_knowledge
  Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"
  ☆77Updated 2 years ago
• john-hewitt / implicit-ins
  Codebase for Instruction Following without Instruction Tuning
  ☆34Updated 8 months ago
• allenai / hyper-task-descriptions
  Learning adapter weights from task descriptions
  ☆18Updated last year
• ielab / PromptReps
  Prompting Large Language Models to Generate Dense and Sparse Representations for Zero-Shot Document Retrieval
  ☆50Updated 7 months ago
• JasonForJoy / Model-Editing-Hurt
  EMNLP 2024: Model Editing Harms General Abilities of Large Language Models: Regularization to the Rescue
  ☆35Updated last week