Alternatives and similar repositories for LM-Kernel-FT:

Users that are interested in LM-Kernel-FT are comparing it to the libraries listed below

• ekinakyurek / influence
  Code for "Tracing Knowledge in Language Models Back to the Training Data"
  ☆37Updated 2 years ago
• mega002 / ff-layers
  The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…
  ☆90Updated 3 years ago
• princeton-nlp / WhatICLLearns
  [ACL 2023 Findings] What In-Context Learning “Learns” In-Context: Disentangling Task Recognition and Task Learning
  ☆21Updated last year
• Shark-NLP / CAB
  ☆30Updated last year
• swj0419 / in-context-pretraining
  ☆48Updated last year
• kernelmachine / demix
  DEMix Layers for Modular Language Modeling
  ☆53Updated 3 years ago
• McGill-NLP / polytropon
  ☆52Updated last year
• tml-epfl / long-is-more-for-alignment
  Long Is More for Alignment: A Simple but Tough-to-Beat Baseline for Instruction Fine-Tuning [ICML 2024]
  ☆17Updated 11 months ago
• ruiqi-zhong / DescribeDistributionalDifferences
  Code for preprint: Summarizing Differences between Text Distributions with Natural Language
  ☆42Updated 2 years ago
• jzbjyb / lm-calibration
  ☆34Updated 3 years ago
• qkaren / COLD_decoding
  ☆106Updated 2 years ago
• yanaiela / pararel
  ☆44Updated last year
• yuzhaouoe / pretraining-data-packing
  [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training
  ☆20Updated 7 months ago
• nkandpa2 / long_tail_knowledge
  Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"
  ☆77Updated 2 years ago
• rabeehk / vibert
  Implementation for Variational Information Bottleneck for Effective Low-resource Fine-tuning, ICLR 2021
  ☆39Updated 3 years ago
• ThomasScialom / T0_continual_learning
  Adding new tasks to T0 without catastrophic forgetting
  ☆33Updated 2 years ago
• da03 / Residual-EBM
  Code for Residual Energy-Based Models for Text Generation in PyTorch.
  ☆23Updated 3 years ago
• shankarp8 / knowledge_distillation
  Repository for "Propagating Knowledge Updates to LMs Through Distillation" (NeurIPS 2023).
  ☆25Updated 7 months ago
• adihaviv / idiomem
  ☆9Updated last year
• aviclu / ffn-values
  ☆61Updated last year
• felixzli / synthetic_pretraining
  ☆39Updated 2 years ago
• allenai / hyper-task-descriptions
  Learning adapter weights from task descriptions
  ☆16Updated last year
• lmarena / PPE
  ☆40Updated this week
• nathanhu0 / CaMeLS
  Codebase for Context-aware Meta-learned Loss Scaling (CaMeLS). https://arxiv.org/abs/2305.15076.
  ☆25Updated last year
• SimengSun / ChapterBreak
  ☆11Updated 10 months ago
• FranxYao / Distributional-Generalization-in-Natural-Language-Processing
  Distributional Generalization in NLP. A roadmap.
  ☆88Updated 2 years ago
• jzbjyb / ReAtt
  Retrieval as Attention
  ☆83Updated 2 years ago
• google-research-datasets / GSM-IC
  Grade-School Math with Irrelevant Context (GSM-IC) benchmark is an arithmetic reasoning dataset built upon GSM8K, by adding irrelevant se…
  ☆59Updated 2 years ago
• p-lambda / incontext-learning
  Experiments and code to generate the GINC small-scale in-context learning dataset from "An Explanation for In-context Learning as Implici…
  ☆105Updated last year
• violet-zct / swarm-distillation-zero-shot
  ☆22Updated 2 years ago