Alternatives and similar repositories for task_vectors:

Users that are interested in task_vectors are comparing it to the libraries listed below

• AlignmentResearch / tuned-lens
  Tools for understanding how transformer predictions are built layer-by-layer
  ☆490Updated 11 months ago
• prateeky2806 / ties-merging
  ☆176Updated last year
• openai / sparse_autoencoder
  ☆458Updated 9 months ago
• davidbau / baukit
  ☆205Updated last year
• gortizji / tangent_task_arithmetic
  Source code of "Task arithmetic in the tangent space: Improved editing of pre-trained models".
  ☆101Updated last year
• EnnengYang / Awesome-Model-Merging-Methods-Theories-Applications
  Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities. arXiv:2408.07666.
  ☆375Updated this week
• mlfoundations / model-soups
  Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time
  ☆462Updated 9 months ago
• ArthurConmy / Automatic-Circuit-Discovery
  ☆223Updated 7 months ago
• HoagyC / sparse_coding
  Using sparse coding to find distributed representations used by neural networks.
  ☆242Updated last year
• ericwtodd / function_vectors
  Function Vectors in Large Language Models (ICLR 2024)
  ☆163Updated 3 weeks ago
• locuslab / massive-activations
  Code accompanying the paper "Massive Activations in Large Language Models"
  ☆160Updated last year
• microsoft / rho
  Repo for Rho-1: Token-level Data Selection & Selective Pretraining of LLMs.
  ☆409Updated last year
• r-three / t-few
  Code for T-Few from "Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning"
  ☆450Updated last year
• huggingface / datablations
  Scaling Data-Constrained Language Models
  ☆334Updated 7 months ago
• llm-merging / LLM-Merging
  LLM-Merging: Building LLMs Efficiently through Merging
  ☆197Updated 7 months ago
• EleutherAI / sparsify
  Sparsify transformers with SAEs and transcoders
  ☆524Updated this week
• mmatena / model_merging
  ☆66Updated 3 years ago
• callummcdougall / sae_vis
  Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).
  ☆199Updated 4 months ago
• saprmarks / dictionary_learning
  ☆280Updated 2 months ago
• ruizheliUOA / Awesome-Interpretability-in-Large-Language-Models
  This repository collects all relevant resources about interpretability in LLMs
  ☆343Updated 6 months ago
• roeehendel / icl_task_vectors
  ☆93Updated last year
• bloomberg / dataless-model-merging
  Code release for Dataless Knowledge Fusion by Merging Weights of Language Models (https://openreview.net/forum?id=FCnohuR6AnM)
  ☆89Updated last year
• logix-project / logix
  AI Logging for Interpretability and Explainability🔬
  ☆115Updated 11 months ago
• stanfordnlp / pyvene
  Stanford NLP Python library for understanding and improving PyTorch models via interventions
  ☆740Updated last week
• likenneth / honest_llama
  Inference-Time Intervention: Eliciting Truthful Answers from a Language Model
  ☆522Updated 3 months ago
• sail-sg / lorahub
  [COLM 2024] LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition
  ☆633Updated 9 months ago
• kmeng01 / rome
  Locating and editing factual associations in GPT (NeurIPS 2022)
  ☆629Updated last year
• nrimsky / CAA
  Steering Llama 2 with Contrastive Activation Addition
  ☆147Updated 11 months ago
• KihoPark / linear_rep_geometry
  ☆92Updated 2 months ago
• mcleish7 / arithmetic
  Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)
  ☆189Updated 11 months ago