TXH-mercury / COSALinks
[ICLR2024] Codes and Models for COSA: Concatenated Sample Pretrained Vision-Language Foundation Model
☆43Updated 10 months ago
Alternatives and similar repositories for COSA
Users that are interested in COSA are comparing it to the libraries listed below
Sorting:
- (ACL'2023) MultiCapCLIP: Auto-Encoding Prompts for Zero-Shot Multilingual Visual Captioning☆36Updated last year
- FunQA benchmarks funny, creative, and magic videos for challenging tasks including timestamp localization, video description, reasoning, …☆104Updated 10 months ago
- [ICLR2024] The official implementation of paper "UniAdapter: Unified Parameter-Efficient Transfer Learning for Cross-modal Modeling", by …☆76Updated last year
- Official PyTorch implementation of the paper "Revisiting Temporal Modeling for CLIP-based Image-to-Video Knowledge Transferring"☆107Updated last year
- ☆110Updated 2 years ago
- [CVPR-2023] The official dataset of Advancing Visual Grounding with Scene Knowledge: Benchmark and Method.☆32Updated 2 years ago
- A Unified Framework for Video-Language Understanding☆60Updated 2 years ago
- Using LLMs and pre-trained caption models for super-human performance on image captioning.☆42Updated 2 years ago
- LAVIS - A One-stop Library for Language-Vision Intelligence☆48Updated last year
- [ICCV 2023] Accurate and Fast Compressed Video Captioning☆47Updated 3 months ago
- A PyTorch implementation of EmpiricalMVM☆41Updated last year
- ☆57Updated last year
- ☆36Updated last year
- Turning to Video for Transcript Sorting☆48Updated 2 years ago
- [PR 2024] A large Cross-Modal Video Retrieval Dataset with Reading Comprehension☆28Updated last year
- ☆72Updated last year
- Hierarchical Video-Moment Retrieval and Step-Captioning (CVPR 2023)☆106Updated 9 months ago
- This repo contains source code for Glance and Focus: Memory Prompting for Multi-Event Video Question Answering (Accepted in NeurIPS 2023)☆29Updated last year
- ☆80Updated 11 months ago
- Narrative movie understanding benchmark☆76Updated 4 months ago
- 🦩 Visual Instruction Tuning with Polite Flamingo - training multi-modal LLMs to be both clever and polite! (AAAI-24 Oral)☆63Updated last year
- Offical PyTorch implementation of Clover: Towards A Unified Video-Language Alignment and Fusion Model (CVPR2023)☆40Updated 2 years ago
- ACM Multimedia 2023 (Oral) - RTQ: Rethinking Video-language Understanding Based on Image-text Model☆16Updated last year
- Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".☆58Updated 2 years ago
- ☆138Updated last year
- [ECCV2024] Official code implementation of Merlin: Empowering Multimodal LLMs with Foresight Minds☆94Updated last year
- Code and Dataset for the CVPRW Paper "Where did I leave my keys? — Episodic-Memory-Based Question Answering on Egocentric Videos"☆28Updated 2 years ago
- This is an official pytorch implementation of Learning To Recognize Procedural Activities with Distant Supervision. In this repository, w…☆43Updated 2 years ago
- ☆31Updated last year
- ☆33Updated 2 years ago