Alternatives and similar repositories for Sight-Beyond-Text:

Users that are interested in Sight-Beyond-Text are comparing it to the libraries listed below

• ImKeTT / ZeroGen
  [NLPCC'23] ZeroGen: Zero-shot Multimodal Controllable Text Generation with Multiple Oracles PyTorch Implementation
  ☆12Updated last year
• Yangyi-Chen / CoTConsistency
  The released data for paper "Measuring and Improving Chain-of-Thought Reasoning in Vision-Language Models".
  ☆32Updated last year
• locuslab / llava-token-compression
  ☆37Updated 2 months ago
• ImKeTT / ReSee
  [EMNLP'23 Oral] ReSee: Responding through Seeing Fine-grained Visual Knowledge in Open-domain Dialogue PyTorch Implementation
  ☆12Updated last year
• gzcch / Bingo
  ☆54Updated 9 months ago
• k1rezaei / Text-to-concept
  ☆31Updated 11 months ago
• yonatanbitton / wysiwyr
  ☆34Updated last year
• sail-sg / MMCBench
  ☆27Updated 11 months ago
• psunlpgroup / VisOnlyQA
  This repository contains the code and data for the paper "VisOnlyQA: Large Vision Language Models Still Struggle with Visual Perception o…
  ☆20Updated last month
• shizhediao / DaVinci
  Source code for the paper "Prefix Language Models are Unified Modal Learners"
  ☆43Updated last year
• sled-group / world-to-words
  Official Code for ACL 2023 Outstanding Paper: World-to-Words: Grounded Open Vocabulary Acquisition through Fast Mapping in Vision-Languag…
  ☆19Updated last year
• locuslab / T-MARS
  Code for T-MARS data filtering
  ☆35Updated last year
• NewsStoriesData / newsstories.github.io
  ☆22Updated 2 years ago
• AllanYangZhou / generative-invariance-transfer
  ☆26Updated 2 years ago
• ylsung / vl-merging
  PyTorch codes for the paper "An Empirical Study of Multimodal Model Merging"
  ☆37Updated last year
• amitakamath / whatsup_vlms
  Code and datasets for "What’s “up” with vision-language models? Investigating their struggle with spatial reasoning".
  ☆38Updated 10 months ago
• YiyangZhou / POVID
  [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning
  ☆78Updated 8 months ago
• luka-group / vlm-knowledge-conflict
  Code for paper "Unraveling Cross-Modality Knowledge Conflicts in Large Vision-Language Models."
  ☆38Updated 2 months ago
• VisualWebBench / VisualWebBench
  Evaluation framework for paper "VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?"
  ☆47Updated 2 months ago
• clemneo / llava-interp
  ☆31Updated 2 months ago
• ajd12342 / why-winoground-hard
  Code for 'Why is Winoground Hard? Investigating Failures in Visuolinguistic Compositionality', EMNLP 2022
  ☆30Updated last year
• MJ-Bench / MJ-Bench
  Official implementation for "MJ-Bench: Is Your Multimodal Reward Model Really a Good Judge for Text-to-Image Generation?"
  ☆41Updated last month
• TencentARC / pi-Tuning
  Official code for "pi-Tuning: Transferring Multimodal Foundation Models with Optimal Multi-task Interpolation", ICML 2023.
  ☆32Updated last year
• HYPJUDY / Sparkles
  Sparkles: Unlocking Chats Across Multiple Images for Multimodal Instruction-Following Models
  ☆43Updated 7 months ago
• Vinoground / Vinoground
  ☆10Updated 2 months ago
• yihedeng9 / STIC
  Enhancing Large Vision Language Models with Self-Training on Image Comprehension.
  ☆62Updated 7 months ago
• M3-IT / YING-VLM
  Vision Large Language Models trained on M3IT instruction tuning dataset
  ☆17Updated last year
• HenryHZY / VL-PET
  [ICCV2023] Official code for "VL-PET: Vision-and-Language Parameter-Efficient Tuning via Granularity Control"
  ☆53Updated last year
• MikaStars39 / StableMask
  PyTorch implementation of StableMask (ICML'24)
  ☆12Updated 6 months ago