Alternatives and similar repositories for pretraining-tda:

Users that are interested in pretraining-tda are comparing it to the libraries listed below

• hadasah / btm
  ☆72Updated 9 months ago
• ekinakyurek / influence
  Code for "Tracing Knowledge in Language Models Back to the Training Data"
  ☆37Updated 2 years ago
• jmerullo / lm_vector_arithmetic
  ☆31Updated last year
• IBM / ColPret
  Efficient Scaling laws and collaborative pretraining.
  ☆13Updated this week
• babylm / evaluation-pipeline-2023
  Evaluation pipeline for the BabyLM Challenge 2023.
  ☆75Updated last year
• EleutherAI / w2s
  ☆20Updated 4 months ago
• EleutherAI / semantic-memorization
  ☆45Updated 2 months ago
• shauli-ravfogel / rlace-icml
  ☆35Updated 2 years ago
• JoshEngels / MultiDimensionalFeatures
  Code for reproducing our paper "Not All Language Model Features Are Linear"
  ☆66Updated 2 months ago
• ZurichNLP / mbr
  Minimum Bayes Risk Decoding for Hugging Face Transformers
  ☆56Updated 7 months ago
• nathanhu0 / CaMeLS
  Codebase for Context-aware Meta-learned Loss Scaling (CaMeLS). https://arxiv.org/abs/2305.15076.
  ☆24Updated last year
• PrasannS / rlhf-length-biases
  ☆27Updated 10 months ago
• peterbhase / SLAG-Belief-Updating
  Code for paper "Do Language Models Have Beliefs? Methods for Detecting, Updating, and Visualizing Model Beliefs"
  ☆28Updated 2 years ago
• allenai / OLMo-core
  PyTorch building blocks for OLMo
  ☆49Updated this week
• nrimsky / InfluenceFunctions
  Implementation of Influence Function approximations for differently sized ML models, using PyTorch
  ☆15Updated last year
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆18Updated this week
• SimengSun / ChapterBreak
  ☆11Updated 7 months ago
• evandez / relations
  How do transformer LMs encode relations?
  ☆46Updated 11 months ago
• logix-project / logix
  AI Logging for Interpretability and Explainability🔬
  ☆100Updated 7 months ago
• Nix07 / finetuning
  This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity…
  ☆21Updated 10 months ago
• guy-dar / embedding-space
  ☆52Updated last year
• ahans30 / goldfish-loss
  [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs
  ☆80Updated 2 months ago
• allenai / bff
  ☆38Updated 9 months ago
• UKPLab / on-emergence
  Codes and files for the paper Are Emergent Abilities in Large Language Models just In-Context Learning
  ☆33Updated 3 weeks ago
• dmis-lab / Monet
  [ICLR 2025] Monet: Mixture of Monosemantic Experts for Transformers
  ☆51Updated last week
• GSYfate / knnlm-limits
  Official code repo for paper "Great Memory, Shallow Reasoning: Limits of kNN-LMs"
  ☆21Updated 5 months ago
• kaistAI / InstructIR
  IntructIR, a novel benchmark specifically designed to evaluate the instruction following ability in information retrieval models. Our foc…
  ☆31Updated 7 months ago
• UFO-101 / auto-circuit
  A library for efficient patching and automatic circuit discovery.
  ☆48Updated 2 months ago
• KaiNylund / lm-weights-encode-time
  ☆67Updated 5 months ago
• r-three / RAD
  Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model
  ☆42Updated last year