ChatBridge, an approach to learning a unified multimodal model to interpret, correlate, and reason about various modalities without relying on all combinations of paired data.
☆54Sep 4, 2023Updated 2 years ago
Alternatives and similar repositories for ChatBridge
Users that are interested in ChatBridge are comparing it to the libraries listed below
Sorting:
- Official PyTorch implementation of the paper "Enhancing Vision-Language Pre-Training with Jointly Learned Questioner and Dense Captioner"☆15Aug 9, 2023Updated 2 years ago
- [ICLR2024] Codes and Models for COSA: Concatenated Sample Pretrained Vision-Language Foundation Model☆43Dec 25, 2024Updated last year
- This repo holds the official code and data for "Unveiling Parts Beyond Objects: Towards Finer-Granularity Referring Expression Segmentati…☆72Jun 3, 2024Updated last year
- ☆22May 16, 2023Updated 2 years ago
- Med-DANet Series (ECCV 2022 & WACV 2024)☆13Jan 2, 2024Updated 2 years ago
- Implementation of ''VPUFormer: Visual Prompt Unified Transformer for Interactive Image Segmentation''☆15Sep 16, 2025Updated 5 months ago
- VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs☆54Mar 9, 2025Updated 11 months ago
- Heterformer: Transformer-based Deep Node Representation Learning on Heterogeneous Text-Rich Networks (KDD 2023)☆28Feb 16, 2024Updated 2 years ago
- This repo contains evaluation code for the paper "AV-Odyssey: Can Your Multimodal LLMs Really Understand Audio-Visual Information?"☆31Dec 23, 2024Updated last year
- 基于微信的多服务器GPU监控工具☆27Jun 1, 2017Updated 8 years ago
- [ECCV’24] Official Implementation for CAT: Enhancing Multimodal Large Language Model to Answer Questions in Dynamic Audio-Visual Scenario…☆58Sep 4, 2024Updated last year
- ☆101May 16, 2024Updated last year
- Rethinking the Form of Latent States in Image Captioning☆20Aug 31, 2018Updated 7 years ago
- X-LLM: Bootstrapping Advanced Large Language Models by Treating Multi-Modalities as Foreign Languages☆316Aug 10, 2023Updated 2 years ago
- The implementation for "Empowering Whisper as a Joint Multi-Talker and Target-Talker Speech Recognition System".☆30Aug 2, 2025Updated 6 months ago
- ☆66Jun 16, 2023Updated 2 years ago
- ☆32Jan 11, 2024Updated 2 years ago
- Generate image from anything with ImageBind and Stable Diffusion☆201Aug 3, 2023Updated 2 years ago
- 双路视频拼接☆13Nov 13, 2022Updated 3 years ago
- Segment-Anything-2 (SAM 2) fine tune with COCO data☆14Aug 20, 2024Updated last year
- Infographiq, ie intelligent interactive infographics, core JavaScript library☆11Jan 17, 2024Updated 2 years ago
- StreamlitとLangGraphで実装したHuman-in-the-loop広告コピー文生成アプリケーション☆11Feb 15, 2025Updated last year
- Align 3D Point Cloud with Multi-modalities for Large Language Models☆459Dec 9, 2023Updated 2 years ago
- A reinforcement learning package implemented in Torch☆11Jan 24, 2016Updated 10 years ago
- ☆11Jun 23, 2023Updated 2 years ago
- This branch of Asteroid contains code for the vocal harmony and chamber ensemble separation related papers.☆12Nov 7, 2024Updated last year
- 一个支持跨模态大语言模型的webui. A chatbot webui that supports various multi-modal large language models☆11May 8, 2023Updated 2 years ago
- ☆13Aug 28, 2024Updated last year
- Building a multi-agent RAG system with advanced RAG methods☆12Jan 12, 2025Updated last year
- ☆14Apr 14, 2025Updated 10 months ago
- Frequency tracking in time-frequency representations☆13Jan 19, 2021Updated 5 years ago
- [CVPR 2024] OneLLM: One Framework to Align All Modalities with Language☆666Oct 22, 2024Updated last year
- PG-Video-LLaVA: Pixel Grounding in Large Multimodal Video Models☆262Aug 5, 2025Updated 6 months ago
- This repository is the official implementation of "Look-Back: Implicit Visual Re-focusing in MLLM Reasoning".☆84Jul 10, 2025Updated 7 months ago
- [WACV'25 Oral] Enhancing Zero-Shot Facial Expression Recognition by LLM Knowledge Transfer☆56Feb 25, 2025Updated last year
- The repository provides code for running inference with the SegmentAnything Model (SAM), links for downloading the trained model checkpoi…☆42Apr 8, 2023Updated 2 years ago
- ☆10Nov 23, 2023Updated 2 years ago
- ☆13Nov 25, 2020Updated 5 years ago
- ☆10Oct 18, 2024Updated last year