Alternatives and similar repositories for task_vectors_are_cross_modal:

Users that are interested in task_vectors_are_cross_modal are comparing it to the libraries listed below

• locuslab / diffusion-model-hallucination
  ☆27Updated 3 months ago
• AtsuMiyai / UPD
  Unsolvable Problem Detection: Evaluating Trustworthiness of Vision Language Models
  ☆72Updated 3 months ago
• EvolvingLMMs-Lab / multimodal-sae
  Auto Interpretation Pipeline and many other functionalities for Multimodal SAE Analysis.
  ☆69Updated 3 weeks ago
• chenllliang / DnD-Transformer
  Source code for paper "A Spark of Vision-Language Intelligence: 2-Dimensional Autoregressive Transformer for Efficient Finegrained Image …
  ☆57Updated last week
• RobertCsordas / moeut
  ☆65Updated 3 months ago
• nickjiang2378 / vl-interp
  Official Pytorch implementation of "Interpreting and Editing Vision-Language Representations to Mitigate Hallucinations"
  ☆46Updated 3 weeks ago
• ML-GSAI / SMDM
  ☆41Updated last month
• alhojel / visual_task_vectors
  ☆35Updated 4 months ago
• yegcjs / DiffusionLLM
  Code for paper "Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuning"
  ☆63Updated 10 months ago
• LZY-the-boys / Twin-Merging
  [NeurIPS2024] Twin-Merging: Dynamic Integration of Modular Expertise in Model Merging
  ☆43Updated 2 weeks ago
• Victorwz / MLM_Filter
  Official implementation of our paper "Finetuned Multimodal Language Models are High-Quality Image-Text Data Filters".
  ☆42Updated last month
• multimodal-interpretability / maia
  Official implementation of MAIA, A Multimodal Automated Interpretability Agent
  ☆66Updated 4 months ago
• MikaStars39 / StableMask
  PyTorch implementation of StableMask (ICML'24)
  ☆12Updated 5 months ago
• chuanyang-Zheng / DAPE
  The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"
  ☆33Updated 2 months ago
• sail-sg / Attention-Sink
  [ATTRIB @ NeurIPS 2024 Oral] When Attention Sink Emerges in Language Models: An Empirical View
  ☆36Updated 2 months ago
• HKUNLP / DiffuLLaMA
  DiffuGPT and DiffuLLaMA: Scaling Diffusion Language Models via Adaptation from Autoregressive Models
  ☆66Updated 3 weeks ago
• OpenSparseLLMs / CLIP-MoE
  CLIP-MoE: Mixture of Experts for CLIP
  ☆22Updated 2 months ago
• yihedeng9 / STIC
  Enhancing Large Vision Language Models with Self-Training on Image Comprehension.
  ☆61Updated 6 months ago
• amitakamath / whatsup_vlms
  Code and datasets for "What’s “up” with vision-language models? Investigating their struggle with spatial reasoning".
  ☆36Updated 9 months ago
• lucidrains / coconut-pytorch
  Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch
  ☆60Updated this week
• sail-sg / dice
  Official implementation of Bootstrapping Language Models via DPO Implicit Rewards
  ☆41Updated 4 months ago
• orrzohar / Video-STaR
  Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision
  ☆48Updated 5 months ago
• hila-chefer / Conceptor
  Official implementation of the paper The Hidden Language of Diffusion Models
  ☆69Updated 10 months ago
• wang-kee / LiNeS
  ☆23Updated last month
• NVlabs / GatedDeltaNet
  Official PyTorch Implementation of Gated Delta Networks: Improving Mamba2 with Delta Rule
  ☆45Updated this week
• mu-cai / matryoshka-mm
  Matryoshka Multimodal Models
  ☆85Updated 3 weeks ago
• TencentARC / pi-Tuning
  Official code for "pi-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation", ICML 2023.
  ☆32Updated last year
• YiyangZhou / CSR
  [NeurIPS 2024] Calibrated Self-Rewarding Vision Language Models
  ☆51Updated 6 months ago
• luka-group / vlm-knowledge-conflict
  Code for paper "Unraveling Cross-Modality Knowledge Conflicts in Large Vision-Language Models."
  ☆35Updated last month
• YiyangZhou / POVID
  [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning
  ☆74Updated 7 months ago