Alternatives and similar repositories for mmml-course:

Users that are interested in mmml-course are comparing it to the libraries listed below

• CMU-MultiComp-Lab / adv-mmml-course
  ☆35Updated 10 months ago
• CMU-MultiComp-Lab / mmml-tutorial
  ☆28Updated last year
• sayakpaul / robustness-foundation-models
  This repository holds code and other relevant files for the NeurIPS 2022 tutorial: Foundational Robustness of Foundation Models.
  ☆71Updated 2 years ago
• YeonwooSung / LIMoE-pytorch
  PyTorch implementation of LIMoE
  ☆53Updated 11 months ago
• pliang279 / HighMMT
  [TMLR 2022] High-Modality Multimodal Transformer
  ☆113Updated 4 months ago
• marslanm / Multimodality-Representation-Learning
  This repository provides a comprehensive collection of research papers focused on multimodal representation learning, all of which have b…
  ☆71Updated last year
• dondongwon / LPMDataset
  ☆39Updated last year
• IntelLabs / VL-InterpreT
  Visual Language Transformer Interpreter - An interactive visualization tool for interpreting vision-language transformers
  ☆90Updated last year
• Weixin-Liang / Modality-Gap
  Mind the Gap: Understanding the Modality Gap in Multi-modal Contrastive Representation Learning
  ☆150Updated 2 years ago
• neubig / minllama-assignment
  ☆82Updated 6 months ago
• vincentlux / Awesome-Multimodal-LLM
  Reading list for Multimodal Large Language Models
  ☆68Updated last year
• fawazsammani / nlxgpt
  NLX-GPT: A Model for Natural Language Explanations in Vision and Vision-Language Tasks, CVPR 2022 (Oral)
  ☆48Updated last year
• pliang279 / MultiViz
  [ICLR 2023] MultiViz: Towards Visualizing and Understanding Multimodal Models
  ☆95Updated 7 months ago
• goel-shashank / CyCLIP
  ☆117Updated 2 years ago
• YiyangZhou / POVID
  [Arxiv] Aligning Modalities in Vision Large Language Models via Preference Fine-tuning
  ☆81Updated 10 months ago
• TRI-ML / vlm-evaluation
  VLM Evaluation: Benchmark for VLMs, spanning text generation tasks from VQA to Captioning
  ☆104Updated 6 months ago
• microsoft / FIBER
  Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbone
  ☆128Updated last year
• albanie / foundation-models
  Video descriptions of research papers relating to foundation models and scaling
  ☆30Updated 2 years ago
• microsoft / BridgeTower
  Open source code for AAAI 2023 Paper "BridgeTower: Building Bridges Between Encoders in Vision-Language Representation Learning"
  ☆161Updated last year
• thunlp / Muffin
  ☆61Updated last year
• yfzhang114 / LLaVA-Align
  This is the official repo for Debiasing Large Visual Language Models, including a Post-Hoc debias method and Visual Debias Decoding strat…
  ☆76Updated last month
• FreedomIntelligence / MLLM-Bench
  MLLM-Bench: Evaluating Multimodal LLMs with Per-sample Criteria
  ☆66Updated 5 months ago
• AGI-Edgerunners / LLM-Continual-Learning-Papers
  Must-read Papers on Large Language Model (LLM) Continual Learning
  ☆141Updated last year
• ylsung / VL_adapter
  PyTorch code for "VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks" (CVPR2022)
  ☆204Updated 2 years ago
• sarthmit / Mod_Arch
  ☆33Updated 11 months ago
• MichiganNLP / In-the-wild-QA
  In-the-wild Question Answering
  ☆15Updated last year
• fkodom / soft-mixture-of-experts
  PyTorch implementation of Soft MoE by Google Brain in "From Sparse to Soft Mixtures of Experts" (https://arxiv.org/pdf/2308.00951.pdf)
  ☆71Updated last year
• OFA-Sys / TouchStone
  Touchstone: Evaluating Vision-Language Models by Language Models
  ☆82Updated last year
• facebookresearch / CiT
  Code for the paper titled "CiT Curation in Training for Effective Vision-Language Data".
  ☆78Updated 2 years ago
• TIGER-AI-Lab / UniIR
  Official code for paper "UniIR: Training and Benchmarking Universal Multimodal Information Retrievers" (ECCV 2024)
  ☆135Updated 5 months ago