MicPie / clasp

Related projects ⓘ

Alternatives and complementary repositories for clasp

• intersun / LightningDOT
  source code and pre-trained/fine-tuned checkpoint for NAACL 2021 paper LightningDOT
  ☆73Updated last year
• zhegan27 / VILLA
  Research Code for NeurIPS 2020 Spotlight paper "Large-Scale Adversarial Training for Vision-and-Language Representation Learning": UNITER…
  ☆119Updated 3 years ago
• igorbrigadir / DownloadConceptualCaptions
  Reliably download millions of images efficiently
  ☆111Updated 3 years ago
• researchmm / soho
  [CVPR'21 Oral] Seeing Out of tHe bOx: End-to-End Pre-training for Vision-Language Representation Learning
  ☆206Updated 2 years ago
• rowanz / merlot
  MERLOT: Multimodal Neural Script Knowledge Models
  ☆223Updated 2 years ago
• IntelLabs / VL-InterpreT
  Visual Language Transformer Interpreter - An interactive visualization tool for interpreting vision-language transformers
  ☆86Updated last year
• jayleicn / singularity
  [ACL 2023] Official PyTorch code for Singularity model in "Revealing Single Frame Bias for Video-and-Language Learning"
  ☆130Updated last year
• HendrikStrobelt / miniClip
  ☆47Updated 3 years ago
• airsplay / vokenization
  PyTorch code for EMNLP 2020 Paper "Vokenization: Improving Language Understanding with Visual Supervision"
  ☆186Updated 3 years ago
• LAION-AI / Big-Interleaved-Dataset
  Big-Interleaved-Dataset
  ☆57Updated last year
• LuoweiZhou / coco-caption
  kdexd/coco-caption@de6f385
  ☆26Updated 4 years ago
• VALUE-Leaderboard / StarterCode
  Starter Code for VALUE benchmark
  ☆79Updated 2 years ago
• e-bug / volta
  [TACL 2021] Code and data for the framework in "Multimodal Pretraining Unmasked: A Meta-Analysis and a Unified Framework of Vision-and-La…
  ☆114Updated 2 years ago
• jimmy646 / violin
  Data and code for CVPR 2020 paper: "VIOLIN: A Large-Scale Dataset for Video-and-Language Inference"
  ☆159Updated 4 years ago
• rowanz / merlot_reserve
  Code release for "MERLOT Reserve: Neural Script Knowledge through Vision and Language and Sound"
  ☆137Updated 2 years ago
• facebookresearch / data2vec_vision
  Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
  ☆78Updated 2 years ago
• microsoft / M3P
  Multitask Multilingual Multimodal Pre-training
  ☆70Updated last year
• mshukor / ViCHA
  [BMVC22] Official Implementation of ViCHA: "Efficient Vision-Language Pretraining with Visual Concepts and Hierarchical Alignment"
  ☆54Updated 2 years ago
• google-research-datasets / Crisscrossed-Captions
  Extended Intramodal and Intermodal Semantic Similarity Judgments for MS-COCO
  ☆51Updated 4 years ago
• lichengunc / pretrain-vl-data
  Pre-trained V+L Data Preparation
  ☆45Updated 4 years ago
• bearcatt / LaBERT
  A length-controllable and non-autoregressive image captioning model.
  ☆66Updated 3 years ago
• MILVLG / rosita
  ROSITA: Enhancing Vision-and-Language Semantic Alignments via Cross- and Intra-modal Knowledge Integration
  ☆56Updated last year
• zengyan-97 / CCLM
  Cross-View Language Modeling: Towards Unified Cross-Lingual Cross-Modal Pre-training (ACL 2023))
  ☆87Updated last year
• j-min / VL-T5
  PyTorch code for "Unifying Vision-and-Language Tasks via Text Generation" (ICML 2021)
  ☆361Updated last year
• UKPLab / MMT-Retrieval
  ☆129Updated last year
• microsoft / BridgeTower
  Open source code for AAAI 2023 Paper "BridgeTower: Building Bridges Between Encoders in Vision-Language Representation Learning"
  ☆157Updated last year
• yxuansu / MAGIC
  Language Models Can See: Plugging Visual Controls in Text Generation
  ☆254Updated 2 years ago
• e-bug / iglue
  [ICML 2022] Code and data for our paper "IGLUE: A Benchmark for Transfer Learning across Modalities, Tasks, and Languages"
  ☆49Updated last year
• ylsung / VL_adapter
  PyTorch code for "VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks" (CVPR2022)
  ☆202Updated last year