Alternatives and similar repositories for finetuning:

Users that are interested in finetuning are comparing it to the libraries listed below

• UFO-101 / auto-circuit
  A library for efficient patching and automatic circuit discovery.
  ☆54Updated 2 weeks ago
• hannamw / EAP-IG
  ☆19Updated this week
• KoyenaPal / future-lens
  Code and Data Repo for the CoNLL Paper -- Future Lens: Anticipating Subsequent Tokens from a Single Hidden State
  ☆18Updated last year
• Aaquib111 / edge-attribution-patching
  Code for my NeurIPS 2024 ATTRIB paper titled "Attribution Patching Outperforms Automated Circuit Discovery"
  ☆29Updated 9 months ago
• KihoPark / linear_rep_geometry
  ☆88Updated 2 weeks ago
• saprmarks / geometry-of-truth
  ☆78Updated 6 months ago
• mega002 / ff-layers
  The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…
  ☆89Updated 3 years ago
• jacobdunefsky / transcoder_circuits
  ☆57Updated 3 months ago
• evandez / relations
  How do transformer LMs encode relations?
  ☆46Updated last year
• ericwtodd / function_vectors
  Function Vectors in Large Language Models (ICLR 2024)
  ☆140Updated 4 months ago
• roeehendel / icl_task_vectors
  ☆89Updated last year
• activatedgeek / calibration-tuning
  ☆45Updated 6 months ago
• montemac / activation_additions
  Algebraic value editing in pretrained language models
  ☆62Updated last year
• ckkissane / crosscoder-model-diff-replication
  Open source replication of Anthropic's Crosscoders for Model Diffing
  ☆40Updated 4 months ago
• adamkarvonen / SAEBench
  ☆58Updated this week
• TristanThrush / perplexity-correlations
  Simple and scalable tools for data-driven pretraining data selection.
  ☆15Updated 2 weeks ago
• nrimsky / CAA
  Steering Llama 2 with Contrastive Activation Addition
  ☆124Updated 9 months ago
• hbin0701 / Self-Explore
  [𝐄𝐌𝐍𝐋𝐏 𝐅𝐢𝐧𝐝𝐢𝐧𝐠𝐬 𝟐𝟎𝟐𝟒 & 𝐀𝐂𝐋 𝟐𝟎𝟐𝟒 𝐍𝐋𝐑𝐒𝐄 𝐎𝐫𝐚𝐥] 𝘌𝘯𝘩𝘢𝘯𝘤𝘪𝘯𝘨 𝘔𝘢𝘵𝘩𝘦𝘮𝘢𝘵𝘪𝘤𝘢𝘭 𝘙𝘦𝘢𝘴𝘰𝘯𝘪𝘯…
  ☆48Updated 9 months ago
• ApolloResearch / e2e_sae
  Sparse Autoencoder Training Library
  ☆42Updated 4 months ago
• tim-lawson / mlsae
  Multi-Layer Sparse Autoencoders (ICLR 2025)
  ☆18Updated 2 weeks ago
• EleutherAI / delphi
  ☆153Updated this week
• LoryPack / LLM-LieDetector
  Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"
  ☆65Updated 8 months ago
• ekinakyurek / influence
  Code for "Tracing Knowledge in Language Models Back to the Training Data"
  ☆37Updated 2 years ago
• PKU-ML / LongPPL
  ☆37Updated last week
• EleutherAI / w2s
  ☆21Updated 5 months ago
• OpenMOSS / Language-Model-SAEs
  For OpenMOSS Mechanistic Interpretability Team's Sparse Autoencoder (SAE) research.
  ☆94Updated this week
• redwoodresearch / Easy-Transformer
  ☆110Updated 6 months ago
• PrasannS / rlhf-length-biases
  ☆27Updated 11 months ago