Alternatives and similar repositories for task_vectors

Users that are interested in task_vectors are comparing it to the libraries listed below

• prateeky2806 / ties-merging
  ☆179Updated last year
• gortizji / tangent_task_arithmetic
  Source code of "Task arithmetic in the tangent space: Improved editing of pre-trained models".
  ☆101Updated last year
• davidbau / baukit
  ☆209Updated last year
• AlignmentResearch / tuned-lens
  Tools for understanding how transformer predictions are built layer-by-layer
  ☆493Updated last year
• openai / sparse_autoencoder
  ☆480Updated 10 months ago
• microsoft / rho
  Repo for Rho-1: Token-level Data Selection & Selective Pretraining of LLMs.
  ☆417Updated last year
• ericwtodd / function_vectors
  Function Vectors in Large Language Models (ICLR 2024)
  ☆167Updated last month
• kmeng01 / memit
  Mass-editing thousands of facts into a transformer memory (ICLR 2023)
  ☆494Updated last year
• HoagyC / sparse_coding
  Using sparse coding to find distributed representations used by neural networks.
  ☆247Updated last year
• gstoica27 / ZipIt
  A framework for merging models solving different tasks with different initializations into one multi-task model without any additional tr…
  ☆299Updated last year
• r-three / t-few
  Code for T-Few from "Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning"
  ☆451Updated last year
• bloomberg / dataless-model-merging
  Code release for Dataless Knowledge Fusion by Merging Weights of Language Models (https://openreview.net/forum?id=FCnohuR6AnM)
  ☆89Updated last year
• MadryLab / trak
  A fast, effective data attribution method for neural networks in PyTorch
  ☆211Updated 6 months ago
• calpt / awesome-adapter-resources
  Collection of Tools and Papers related to Adapters / Parameter-Efficient Transfer Learning/ Fine-Tuning
  ☆193Updated last year
• KihoPark / linear_rep_geometry
  ☆93Updated 3 months ago
• mmatena / model_merging
  ☆67Updated 3 years ago
• EnnengYang / Awesome-Model-Merging-Methods-Theories-Applications
  Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities. arXiv:2408.07666.
  ☆417Updated this week
• logix-project / logix
  AI Logging for Interpretability and Explainability🔬
  ☆119Updated 11 months ago
• benzakenelad / BitFit
  Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models
  ☆142Updated 2 years ago
• neelnanda-io / 1L-Sparse-Autoencoder
  ☆121Updated last year
• mlfoundations / model-soups
  Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time
  ☆467Updated 10 months ago
• locuslab / massive-activations
  Code accompanying the paper "Massive Activations in Large Language Models"
  ☆162Updated last year
• ArthurConmy / Automatic-Circuit-Discovery
  ☆223Updated 8 months ago
• likenneth / honest_llama
  Inference-Time Intervention: Eliciting Truthful Answers from a Language Model
  ☆527Updated 4 months ago
• EleutherAI / sparsify
  Sparsify transformers with SAEs and transcoders
  ☆547Updated last week
• EleutherAI / concept-erasure
  Erasing concepts from neural representations with provable guarantees
  ☆227Updated 4 months ago
• roeehendel / icl_task_vectors
  ☆94Updated last year
• Guitaricet / relora
  Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates
  ☆454Updated last year
• callummcdougall / sae_vis
  Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).
  ☆200Updated 5 months ago
• CASE-Lab-UMD / LLM-Drop
  The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".
  ☆173Updated 2 months ago