Alternatives and similar repositories for LM-Kernel-FT

Users that are interested in LM-Kernel-FT are comparing it to the libraries listed below

• ekinakyurek / influence
  Code for "Tracing Knowledge in Language Models Back to the Training Data"
  ☆38Updated 2 years ago
• princeton-nlp / WhatICLLearns
  [ACL 2023 Findings] What In-Context Learning “Learns” In-Context: Disentangling Task Recognition and Task Learning
  ☆21Updated last year
• pietrolesci / memorisation-profiles
  This is the official implementation for our ACL 2024 paper: "Causal Estimation of Memorisation Profiles".
  ☆21Updated 2 months ago
• yuzhaouoe / pretraining-data-packing
  [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training
  ☆21Updated 9 months ago
• mega002 / ff-layers
  The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…
  ☆91Updated 3 years ago
• allenai / hyper-task-descriptions
  Learning adapter weights from task descriptions
  ☆18Updated last year
• allenai / hyperdecoders
  Codebase for Hyperdecoders https://arxiv.org/abs/2203.08304
  ☆11Updated 2 years ago
• Shark-NLP / CAB
  ☆31Updated last year
• McGill-NLP / polytropon
  ☆54Updated 2 years ago
• SimengSun / ChapterBreak
  ☆11Updated 11 months ago
• da03 / Residual-EBM
  Code for Residual Energy-Based Models for Text Generation in PyTorch.
  ☆23Updated 4 years ago
• swj0419 / in-context-pretraining
  ☆50Updated last year
• kernelmachine / demix
  DEMix Layers for Modular Language Modeling
  ☆53Updated 3 years ago
• yanaiela / pararel
  ☆44Updated last year
• violet-zct / swarm-distillation-zero-shot
  ☆22Updated 2 years ago
• nkandpa2 / long_tail_knowledge
  Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"
  ☆76Updated 2 years ago
• ThomasScialom / T0_continual_learning
  Adding new tasks to T0 without catastrophic forgetting
  ☆33Updated 2 years ago
• rabeehk / vibert
  Implementation for Variational Information Bottleneck for Effective Low-resource Fine-tuning, ICLR 2021
  ☆39Updated 4 years ago
• EleutherAI / pile_dedupe
  Pile Deduplication Code
  ☆19Updated 2 years ago
• Liuhong99 / implicitbiasmlmcode
  ☆11Updated 2 years ago
• HazyResearch / skill-it
  Skill-It! A Data-Driven Skills Framework for Understanding and Training Language Models
  ☆46Updated last year
• tml-epfl / long-is-more-for-alignment
  Long Is More for Alignment: A Simple but Tough-to-Beat Baseline for Instruction Fine-Tuning [ICML 2024]
  ☆17Updated last year
• aviclu / ffn-values
  ☆62Updated 2 years ago
• sylinrl / CalibratedMath
  Teaching Models to Express Their Uncertainty in Words
  ☆39Updated 3 years ago
• hsajjad / Interpretability-Tutorial-NAACL2021
  ☆24Updated 3 years ago
• Re-Align / AlignTDS
  Analyzing LLM Alignment via Token distribution shift
  ☆16Updated last year
• PrasannS / rlhf-length-biases
  ☆28Updated last year
• gl-ybnbxb / BoNBoN
  ☆17Updated last year
• felixzli / synthetic_pretraining
  ☆39Updated 2 years ago
• yizhongw / llm-temporal-alignment
  Methods and evaluation for aligning language models temporally
  ☆29Updated last year