SotA text-only image/video method (IJCAI 2023)
☆15Jan 9, 2024Updated 2 years ago
Alternatives and similar repositories for Knight
Users that are interested in Knight are comparing it to the libraries listed below
Sorting:
- ☆25Jul 10, 2023Updated 2 years ago
- ICLR 2023 DeCap: Decoding CLIP Latents for Zero-shot Captioning☆138Mar 16, 2023Updated 3 years ago
- Retrieval-augmented Image Captioning☆13Feb 16, 2023Updated 3 years ago
- SmallCap: Lightweight Image Captioning Prompted with Retrieval Augmentation☆127Feb 13, 2024Updated 2 years ago
- Code repository for "Post-pre-training for Modality Alignment in Vision-Language Foundation Models" (CVPR2025)☆38Jul 25, 2025Updated 7 months ago
- [EMNLP 2024] IFCap: Image-like Retrieval and Frequency-based Entity Filtering for Zero-shot Captioning☆15May 13, 2025Updated 10 months ago
- An automatic MLLM hallucination detection framework☆19Sep 26, 2023Updated 2 years ago
- text-only training or language-free training for multimodal tasks (image/audio/video caption, retrieval, text2image)☆12Oct 15, 2024Updated last year
- Code for the paper "Understanding and Evaluating Racial Biases in Image Captioning"☆12Oct 19, 2021Updated 4 years ago
- Microsoft COCO Caption Evaluation Tool - Python 3☆33May 23, 2019Updated 6 years ago
- ☆20May 3, 2025Updated 10 months ago
- Official implementation of "Connect, Collapse, Corrupt: Learning Cross-Modal Tasks with Uni-Modal Data" (ICLR 2024)☆34Oct 16, 2024Updated last year
- CapDec: SOTA Zero Shot Image Captioning Using CLIP and GPT2, EMNLP 2022 (findings)☆203Jan 28, 2024Updated 2 years ago
- CaMML:Context-Aware MultiModal Learner for Large Models (ACL 2024 SAC Award)☆15May 21, 2025Updated 10 months ago
- The codes and datasets about our ACL 2024 Main Conference paper titled "Cognitive Visual-Language Mapper: Advancing Multimodal Comprehens…☆18Jan 24, 2025Updated last year
- ☆59Aug 30, 2023Updated 2 years ago
- The code repository for "Cross-Modal and Hierarchical Modeling of Video and Text" in PyTorch☆16Apr 22, 2019Updated 6 years ago
- ☆14Dec 31, 2024Updated last year
- Code & data accompanying the paper ["Unveiling Implicit Deceptive Patterns in Multi-modal Fake News via Neuro-Symbolic Reasoning"].☆13Dec 21, 2023Updated 2 years ago
- [ACL 2023] Multi-source Semantic Graph-based Multimodal Sarcasm Explanation Generation.☆10Dec 19, 2024Updated last year
- Publication sources, algorithm, code, result, conference poster, scientific paper for ICDAR, CIFED, VISAPP☆15Jul 8, 2022Updated 3 years ago
- natual language guided image captioning☆87Feb 11, 2024Updated 2 years ago
- some object detection algo☆14Jul 25, 2024Updated last year
- Dynamic Early Exit for Image Captioning☆17Oct 25, 2022Updated 3 years ago
- same script☆12Nov 25, 2019Updated 6 years ago
- Using LLMs and pre-trained caption models for super-human performance on image captioning.☆42Oct 13, 2023Updated 2 years ago
- Entity-Aware Dual Co-Attention Network for Fake News Detection, EACL 2023 Findings☆10Jun 11, 2023Updated 2 years ago
- The first unofficial implementation of CLIP4Caption: CLIP for Video Caption (ACMMM 2021)☆15Jan 2, 2023Updated 3 years ago
- (CVPR2024) MeaCap: Memory-Augmented Zero-shot Image Captioning☆57Aug 16, 2024Updated last year
- 生成对抗网络综述☆10May 22, 2022Updated 3 years ago
- [EACL'23] COVID-VTS: Fact Extraction and Verification on Short Video Platforms☆11Sep 26, 2023Updated 2 years ago
- [ICCV 2021] Official code for "Learning to Generate Scene Graph from Natural Language Supervision"☆100Apr 4, 2023Updated 2 years ago
- Code repo for "Read Anywhere Pointed: Layout-aware GUI Screen Reading with Tree-of-Lens Grounding"☆29Jul 31, 2024Updated last year
- MMBERT: Multimodal BERT Pretraining for Improved Medical VQA☆39Mar 22, 2021Updated 5 years ago
- Repo for our work "Systematic Evaluation of Large Vision-Language Models for Surgical Artificial Intelligence"☆19Jun 2, 2025Updated 9 months ago
- kdexd/coco-caption@de6f385☆26Apr 21, 2020Updated 5 years ago
- the official repo for EMNLP 2024 (main) paper "EFUF: Efficient Fine-grained Unlearning Framework for Mitigating Hallucinations in Multimo…☆21Apr 9, 2025Updated 11 months ago
- ☆18Sep 13, 2023Updated 2 years ago
- Convert sketch to face image using Conditional Adversarial Nets (https://phillipi.github.io/pix2pix/)☆17May 31, 2017Updated 8 years ago