Alternatives and similar repositories for LM-Kernel-FT:

Users that are interested in LM-Kernel-FT are comparing it to the libraries listed below

• ekinakyurek / influence
  Code for "Tracing Knowledge in Language Models Back to the Training Data"
  ☆37Updated 2 years ago
• McGill-NLP / polytropon
  ☆53Updated last year
• kernelmachine / demix
  DEMix Layers for Modular Language Modeling
  ☆53Updated 3 years ago
• princeton-nlp / WhatICLLearns
  [ACL 2023 Findings] What In-Context Learning “Learns” In-Context: Disentangling Task Recognition and Task Learning
  ☆21Updated last year
• Shark-NLP / CAB
  ☆31Updated last year
• mega002 / ff-layers
  The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…
  ☆91Updated 3 years ago
• allenai / hyper-task-descriptions
  Learning adapter weights from task descriptions
  ☆17Updated last year
• jzbjyb / lm-calibration
  ☆34Updated 3 years ago
• tml-epfl / long-is-more-for-alignment
  Long Is More for Alignment: A Simple but Tough-to-Beat Baseline for Instruction Fine-Tuning [ICML 2024]
  ☆17Updated last year
• yanaiela / pararel
  ☆44Updated last year
• nkandpa2 / long_tail_knowledge
  Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"
  ☆76Updated 2 years ago
• swj0419 / in-context-pretraining
  ☆49Updated last year
• r-three / mats
  ☆30Updated 9 months ago
• PrasannS / rlhf-length-biases
  ☆28Updated last year
• felixzli / synthetic_pretraining
  ☆39Updated 2 years ago
• pietrolesci / memorisation-profiles
  This is the official implementation for our ACL 2024 paper: "Causal Estimation of Memorisation Profiles".
  ☆21Updated last month
• yuzhaouoe / pretraining-data-packing
  [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training
  ☆21Updated 8 months ago
• shankarp8 / knowledge_distillation
  Repository for "Propagating Knowledge Updates to LMs Through Distillation" (NeurIPS 2023).
  ☆25Updated 8 months ago
• EleutherAI / pile_dedupe
  Pile Deduplication Code
  ☆19Updated last year
• ruiqi-zhong / DescribeDistributionalDifferences
  Code for preprint: Summarizing Differences between Text Distributions with Natural Language
  ☆42Updated 2 years ago
• SimengSun / ChapterBreak
  ☆11Updated 11 months ago
• frankxu2004 / knnlm-why
  Repo for ICML23 "Why do Nearest Neighbor Language Models Work?"
  ☆56Updated 2 years ago
• tatsu-lab / linguistic_calibration
  Align your LM to express calibrated verbal statements of confidence in its long-form generations.
  ☆24Updated 11 months ago
• sylinrl / CalibratedMath
  Teaching Models to Express Their Uncertainty in Words
  ☆38Updated 2 years ago
• alon-albalak / FLAD
  Few-shot Learning with Auxiliary Data
  ☆27Updated last year
• RobertCsordas / ndr
  The official repository for our paper "The Neural Data Router: Adaptive Control Flow in Transformers Improves Systematic Generalization".
  ☆33Updated 3 years ago
• hsajjad / Interpretability-Tutorial-NAACL2021
  ☆24Updated 3 years ago
• feyzaakyurek / dune
  Dataset for Unified Editing, EMNLP 2023. This is a model editing dataset where edits are natural language phrases.
  ☆23Updated 8 months ago
• xiamengzhou / training_trajectory_analysis
  [ACL 2023]: Training Trajectories of Language Models Across Scales https://arxiv.org/pdf/2212.09803.pdf
  ☆23Updated last year
• Nanami18 / Snowballed_Hallucination
  ☆44Updated 8 months ago