Alternatives and similar repositories for task_vectors:

Users that are interested in task_vectors are comparing it to the libraries listed below

• AlignmentResearch / tuned-lens
  Tools for understanding how transformer predictions are built layer-by-layer
  ☆459Updated 7 months ago
• gortizji / tangent_task_arithmetic
  Source code of "Task arithmetic in the tangent space: Improved editing of pre-trained models".
  ☆92Updated last year
• prateeky2806 / ties-merging
  ☆159Updated 11 months ago
• davidbau / baukit
  ☆184Updated 10 months ago
• lucidrains / st-moe-pytorch
  Implementation of ST-Moe, the latest incarnation of MoE after years of research at Brain, in Pytorch
  ☆297Updated 7 months ago
• likenneth / honest_llama
  Inference-Time Intervention: Eliciting Truthful Answers from a Language Model
  ☆493Updated 3 months ago
• HoagyC / sparse_coding
  Using sparse coding to find distributed representations used by neural networks.
  ☆207Updated last year
• MadryLab / trak
  A fast, effective data attribution method for neural networks in PyTorch
  ☆187Updated last month
• microsoft / rho
  Repo for Rho-1: Token-level Data Selection & Selective Pretraining of LLMs.
  ☆382Updated 9 months ago
• EleutherAI / sae
  Sparse autoencoders
  ☆407Updated this week
• openai / sparse_autoencoder
  ☆404Updated 5 months ago
• locuslab / massive-activations
  Code accompanying the paper "Massive Activations in Large Language Models"
  ☆133Updated 10 months ago
• EnnengYang / Awesome-Model-Merging-Methods-Theories-Applications
  Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities. arXiv:2408.07666.
  ☆286Updated this week
• dtsip / in-context-learning
  ☆210Updated 8 months ago
• callummcdougall / sae_vis
  Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).
  ☆176Updated last month
• mmatena / model_merging
  ☆63Updated 2 years ago
• KihoPark / linear_rep_geometry
  ☆82Updated 11 months ago
• ericwtodd / function_vectors
  Function Vectors in Large Language Models (ICLR 2024)
  ☆131Updated 3 months ago
• kmeng01 / memit
  Mass-editing thousands of facts into a transformer memory (ICLR 2023)
  ☆458Updated 11 months ago
• UIC-Liu-Lab / ContinualLM
  An Extensible Continual Learning Framework Focused on Language Models (LMs)
  ☆263Updated 11 months ago
• r-three / t-few
  Code for T-Few from "Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning"
  ☆438Updated last year
• ArthurConmy / Automatic-Circuit-Discovery
  ☆201Updated 3 months ago
• mlfoundations / model-soups
  Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time
  ☆436Updated 6 months ago
• EleutherAI / elk
  Keeping language models honest by directly eliciting knowledge encoded in their activations.
  ☆192Updated this week
• nrimsky / CAA
  Steering Llama 2 with Contrastive Activation Addition
  ☆113Updated 7 months ago
• llm-merging / LLM-Merging
  LLM-Merging: Building LLMs Efficiently through Merging
  ☆184Updated 3 months ago
• logix-project / logix
  AI Logging for Interpretability and Explainability🔬
  ☆97Updated 7 months ago
• collin-burns / discovering_latent_knowledge
  ☆258Updated 10 months ago
• sail-sg / lorahub
  [COLM 2024] LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition
  ☆609Updated 5 months ago
• ruizheliUOA / Awesome-Interpretability-in-Large-Language-Models
  This repository collects all relevant resources about interpretability in LLMs
  ☆305Updated 2 months ago