ys-zong / FoolyourVLLMs

Related projects ⓘ

Alternatives and complementary repositories for FoolyourVLLMs

• Yangyi-Chen / CoTConsistency
  The released data for paper "Measuring and Improving Chain-of-Thought Reasoning in Vision-Language Models".
  ☆32Updated last year
• ajd12342 / why-winoground-hard
  Code for 'Why is Winoground Hard? Investigating Failures in Visuolinguistic Compositionality', EMNLP 2022
  ☆30Updated last year
• shizhediao / DaVinci
  Source code for the paper "Prefix Language Models are Unified Modal Learners"
  ☆42Updated last year
• mlfoundations / clip_quality_not_quantity
  ☆29Updated 2 years ago
• edchengg / infoseek_eval
  EMNLP2023 - InfoSeek: A New VQA Benchmark focus on Visual Info-Seeking Questions
  ☆16Updated 5 months ago
• gzcch / Bingo
  ☆53Updated 7 months ago
• BaohaoLiao / mefts
  [NeurIPS 2023] Make Your Pre-trained Model Reversible: From Parameter to Memory Efficient Fine-Tuning
  ☆29Updated last year
• UCSC-VLAA / Sight-Beyond-Text
  This repository includes the official implementation of our paper "Sight Beyond Text: Multi-Modal Training Enhances LLMs in Truthfulness …
  ☆19Updated last year
• swaggy-TN / EfficientVLM
  EfficientVLM: Fast and Accurate Vision-Language Models via Knowledge Distillation and Modal-adaptive Pruning (ACL 2023)
  ☆20Updated last year
• Victorwz / VaLM
  VaLM: Visually-augmented Language Modeling. ICLR 2023.
  ☆56Updated last year
• HYPJUDY / Sparkles
  Sparkles: Unlocking Chats Across Multiple Images for Multimodal Instruction-Following Models
  ☆41Updated 4 months ago
• locuslab / T-MARS
  Code for T-MARS data filtering
  ☆35Updated last year
• yiren-jian / NonLing-CSE
  [NeurIPS 2022] Non-Linguistic Supervision for Contrastive Learning of Sentence Embeddings
  ☆20Updated last year
• umd-huang-lab / Mementos
  ☆24Updated 9 months ago
• ylsung / vl-merging
  PyTorch codes for the paper "An Empirical Study of Multimodal Model Merging"
  ☆36Updated last year
• ShujinWu-0814 / MACAROON
  Public code repo for EMNLP 2024 Findings paper "MACAROON: Training Vision-Language Models To Be Your Engaged Partners"
  ☆11Updated last month
• BierOne / Attention-Faithfulness
  [ICML 2022] This is the pytorch implementation of "Rethinking Attention-Model Explainability through Faithfulness Violation Test" (https:…
  ☆18Updated 2 years ago
• fuzihaofzh / AnalyzeParameterEfficientFinetune
  On the Effectiveness of Parameter-Efficient Fine-Tuning
  ☆38Updated last year
• yuhui-zh15 / drml
  Official Code Release for "Diagnosing and Rectifying Vision Models using Language" (ICLR 2023)
  ☆32Updated last year
• allenai / gpv2
  ☆32Updated 2 years ago
• AllanYangZhou / generative-invariance-transfer
  ☆26Updated 2 years ago
• Pranjal2041 / AdaptiveConsistency
  Let's Sample Step by Step: Adaptive-Consistency for Efficient Reasoning with LLMs
  ☆31Updated 9 months ago
• google-deepmind / svo_probes
  The SVO-Probes Dataset for Verb Understanding
  ☆31Updated 2 years ago
• TencentARC / pi-Tuning
  Official code for "pi-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation", ICML 2023.
  ☆32Updated last year
• zmykevin / UVLP
  CVPR 2022 (Oral) Pytorch Code for Unsupervised Vision-and-Language Pre-training via Retrieval-based Multi-Granular Alignment
  ☆22Updated 2 years ago
• uclaml / PDE
  Official repo of Progressive Data Expansion: data, code and evaluation
  ☆27Updated 11 months ago
• lancopku / clip-openness
  [ACL 2023] Delving into the Openness of CLIP
  ☆23Updated last year
• yegcjs / DiffusionLLM
  Code for paper "Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuning"
  ☆63Updated 9 months ago
• easonnie / mlp-vil
  MLPs for Vision and Langauge Modeling (Coming Soon)
  ☆27Updated 2 years ago
• Hritikbansal / dove
  ☆12Updated 4 months ago