Alternatives and similar repositories for task_vectors

Users that are interested in task_vectors are comparing it to the libraries listed below

• prateeky2806 / ties-merging
  ☆194Updated last year
• gortizji / tangent_task_arithmetic
  Source code of "Task arithmetic in the tangent space: Improved editing of pre-trained models".
  ☆105Updated 2 years ago
• AlignmentResearch / tuned-lens
  Tools for understanding how transformer predictions are built layer-by-layer
  ☆535Updated 2 months ago
• davidbau / baukit
  ☆234Updated last year
• mmatena / model_merging
  ☆77Updated 3 years ago
• ericwtodd / function_vectors
  Function Vectors in Large Language Models (ICLR 2024)
  ☆181Updated 6 months ago
• llm-merging / LLM-Merging
  LLM-Merging: Building LLMs Efficiently through Merging
  ☆204Updated last year
• HoagyC / sparse_coding
  Using sparse coding to find distributed representations used by neural networks.
  ☆280Updated last year
• openai / sparse_autoencoder
  ☆532Updated last year
• MadryLab / trak
  A fast, effective data attribution method for neural networks in PyTorch
  ☆220Updated 11 months ago
• locuslab / massive-activations
  Code accompanying the paper "Massive Activations in Large Language Models"
  ☆184Updated last year
• dtsip / in-context-learning
  ☆240Updated last year
• microsoft / rho
  Repo for Rho-1: Token-level Data Selection & Selective Pretraining of LLMs.
  ☆439Updated last year
• jacobdunefsky / transcoder_circuits
  ☆181Updated 11 months ago
• Prisma-Multimodal / ViT-Prisma
  ViT Prisma is a mechanistic interpretability library for Vision and Video Transformers (ViTs).
  ☆315Updated 3 months ago
• mlfoundations / model-soups
  Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time
  ☆488Updated last year
• EnnengYang / Awesome-Model-Merging-Methods-Theories-Applications
  Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunities. arXiv:2408.07666.
  ☆572Updated last week
• lucidrains / st-moe-pytorch
  Implementation of ST-Moe, the latest incarnation of MoE after years of research at Brain, in Pytorch
  ☆366Updated last year
• logix-project / logix
  AI Logging for Interpretability and Explainability🔬
  ☆129Updated last year
• KihoPark / linear_rep_geometry
  ☆107Updated 8 months ago
• roeehendel / icl_task_vectors
  ☆98Updated last year
• ArthurConmy / Automatic-Circuit-Discovery
  ☆247Updated last year
• collin-burns / discovering_latent_knowledge
  ☆279Updated last year
• bloomberg / dataless-model-merging
  Code release for Dataless Knowledge Fusion by Merging Weights of Language Models (https://openreview.net/forum?id=FCnohuR6AnM)
  ☆90Updated 2 years ago
• nrimsky / CAA
  Steering Llama 2 with Contrastive Activation Addition
  ☆191Updated last year
• ruizheliUOA / Awesome-Interpretability-in-Large-Language-Models
  This repository collects all relevant resources about interpretability in LLMs
  ☆375Updated 11 months ago
• UIC-Liu-Lab / ContinualLM
  An Extensible Continual Learning Framework Focused on Language Models (LMs)
  ☆288Updated last year
• calpt / awesome-adapter-resources
  Collection of Tools and Papers related to Adapters / Parameter-Efficient Transfer Learning/ Fine-Tuning
  ☆199Updated last year
• adamkarvonen / SAEBench
  ☆131Updated last week
• gstoica27 / ZipIt
  A framework for merging models solving different tasks with different initializations into one multi-task model without any additional tr…
  ☆309Updated last year