Alternatives and similar repositories for finetuning:

Users that are interested in finetuning are comparing it to the libraries listed below

• saprmarks / geometry-of-truth
  ☆82Updated 7 months ago
• stanfordnlp / axbench
  Stanford NLP Python library for benchmarking the utility of LLM interpretability methods
  ☆62Updated this week
• UFO-101 / auto-circuit
  A library for efficient patching and automatic circuit discovery.
  ☆62Updated last month
• hannamw / EAP-IG
  ☆23Updated last month
• montemac / activation_additions
  Algebraic value editing in pretrained language models
  ☆63Updated last year
• KoyenaPal / future-lens
  Code and Data Repo for the CoNLL Paper -- Future Lens: Anticipating Subsequent Tokens from a Single Hidden State
  ☆18Updated last year
• KihoPark / linear_rep_geometry
  ☆90Updated last month
• jacobdunefsky / transcoder_circuits
  ☆66Updated 4 months ago
• ckkissane / crosscoder-model-diff-replication
  Open source replication of Anthropic's Crosscoders for Model Diffing
  ☆49Updated 5 months ago
• MaheepChaudhary / SAE-Ravel
  Providing the answer to "How to do patching on all available SAEs on GPT-2?". It is an official repository of the implementation of the p…
  ☆11Updated 2 months ago
• mega002 / ff-layers
  The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Le…
  ☆90Updated 3 years ago
• javiferran / sae_entities
  ☆17Updated 3 weeks ago
• EleutherAI / delphi
  Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …
  ☆165Updated last week
• berlino / seq_icl
  ☆51Updated 10 months ago
• princeton-nlp / Edge-Pruning
  [NeurIPS 2024 Spotlight] Code and data for the paper "Finding Transformer Circuits with Edge Pruning".
  ☆47Updated 3 weeks ago
• tim-lawson / mlsae
  Multi-Layer Sparse Autoencoders (ICLR 2025)
  ☆22Updated last month
• jmerullo / lm_vector_arithmetic
  ☆34Updated last year
• Aaquib111 / edge-attribution-patching
  Code for my NeurIPS 2024 ATTRIB paper titled "Attribution Patching Outperforms Automated Circuit Discovery"
  ☆30Updated 10 months ago
• ApolloResearch / e2e_sae
  Sparse Autoencoder Training Library
  ☆47Updated 5 months ago
• OpenMOSS / Language-Model-SAEs
  For OpenMOSS Mechanistic Interpretability Team's Sparse Autoencoder (SAE) research.
  ☆105Updated 2 weeks ago
• nrimsky / CAA
  Steering Llama 2 with Contrastive Activation Addition
  ☆134Updated 10 months ago
• wesg52 / sparse-probing-paper
  Sparse probing paper full code.
  ☆55Updated last year
• ajyl / dpo_toxic
  A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity.
  ☆71Updated 3 weeks ago
• IBM / activation-steering
  General-purpose activation steering library
  ☆54Updated 2 months ago
• roeehendel / icl_task_vectors
  ☆93Updated last year
• nouhadziri / faith-and-fate
  ☆34Updated last year
• ericwtodd / function_vectors
  Function Vectors in Large Language Models (ICLR 2024)
  ☆153Updated 2 weeks ago
• PrasannS / rlhf-length-biases
  ☆27Updated last year
• epfl-dlab / llm-latent-language
  Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".
  ☆71Updated last year
• kaistAI / factual-knowledge-acquisition
  ☆17Updated 5 months ago