g-luo / task_vectors_are_cross_modal
Official PyTorch Implementation for Task Vectors are Cross-Modal
☆21Updated 2 months ago
Alternatives and similar repositories for task_vectors_are_cross_modal:
Users that are interested in task_vectors_are_cross_modal are comparing it to the libraries listed below
- Auto Interpretation Pipeline and many other functionalities for Multimodal SAE Analysis.☆104Updated 3 weeks ago
- Official Code Repository for EnvGen: Generating and Adapting Environments via LLMs for Training Embodied Agents (COLM 2024)☆27Updated 7 months ago
- [ICLR 2025] Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision☆59Updated 7 months ago
- [EMNLP 2024 Findings] ProSA: Assessing and Understanding the Prompt Sensitivity of LLMs☆24Updated 3 months ago
- ☆71Updated 6 months ago
- ☆32Updated last month
- Official implementation of the paper "MMInA: Benchmarking Multihop Multimodal Internet Agents"☆41Updated last week
- [ICLR 2025] SuperCorrect: Supervising and Correcting Language Models with Error-Driven Insights☆53Updated last week
- ☆26Updated last month
- Enhancing Large Vision Language Models with Self-Training on Image Comprehension.☆63Updated 8 months ago
- [ICLR 2025] Source code for paper "A Spark of Vision-Language Intelligence: 2-Dimensional Autoregressive Transformer for Efficient Finegr…☆67Updated 2 months ago
- Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"☆25Updated 10 months ago
- Unsolvable Problem Detection: Evaluating Trustworthiness of Vision Language Models☆73Updated 5 months ago
- This repository is maintained to release dataset and models for multimodal puzzle reasoning.☆63Updated 2 weeks ago
- [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning☆79Updated 9 months ago
- Preference Learning for LLaVA☆37Updated 3 months ago
- ☆39Updated 6 months ago
- [ICLR2025] DiffuGPT and DiffuLLaMA: Scaling Diffusion Language Models via Adaptation from Autoregressive Models☆89Updated 2 months ago
- ☆33Updated 5 months ago
- ☆12Updated last month
- Official Repository of Multi-Object Hallucination in Vision-Language Models (NeurIPS 2024)☆26Updated 3 months ago
- ☆61Updated last month
- [Under Review] Official PyTorch implementation code for realizing the technical part of Phantom of Latent representing equipped with enla…☆49Updated 4 months ago
- official code for "BoostStep: Boosting mathematical capability of Large Language Models via improved single-step reasoning"☆29Updated last month
- Official Pytorch implementation of "Interpreting and Editing Vision-Language Representations to Mitigate Hallucinations" (ICLR '25)☆59Updated 3 weeks ago
- Holistic evaluation of multimodal foundation models☆42Updated 6 months ago
- Official Pytorch Implementation of "Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LN" by Pengxiang Li, Lu Yi…☆16Updated 2 months ago
- PhysGame Benchmark for Physical Commonsense Evaluation in Gameplay Videos☆37Updated 2 weeks ago
- HGRN2: Gated Linear RNNs with State Expansion☆52Updated 6 months ago