ChatBridge, an approach to learning a unified multimodal model to interpret, correlate, and reason about various modalities without relying on all combinations of paired data.
☆55Sep 4, 2023Updated 3 years ago
Alternatives and similar repositories for ChatBridge
Users that are interested in ChatBridge are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official PyTorch implementation of the paper "Enhancing Vision-Language Pre-Training with Jointly Learned Questioner and Dense Captioner"☆15Aug 9, 2023Updated 3 years ago
- [ICLR2024] Codes and Models for COSA: Concatenated Sample Pretrained Vision-Language Foundation Model☆44Dec 25, 2024Updated last year
- This repo holds the official code and data for "Unveiling Parts Beyond Objects: Towards Finer-Granularity Referring Expression Segmentati…☆74Jun 3, 2024Updated 2 years ago
- [TPAMI2024] Codes and Models for VALOR: Vision-Audio-Language Omni-Perception Pretraining Model and Dataset☆311Dec 25, 2024Updated last year
- Med-DANet Series (ECCV 2022 & WACV 2024)☆13Jan 2, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆35Jun 6, 2023Updated 3 years ago
- VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs☆57Mar 9, 2025Updated last year
- This repo holds the official code and data for "Beyond Literal Descriptions: Understanding and Locating Open-World Objects Aligned with H…☆15May 21, 2024Updated 2 years ago
- Code and dataset for NAACL 2022 paper "CoSIm: Commonsense Reasoning for Counterfactual Scene Imagination" Hyounghun Kim, Abhay Zala, Mohi…☆16Nov 26, 2022Updated 3 years ago
- Rethinking the Form of Latent States in Image Captioning☆20Aug 31, 2018Updated 8 years ago
- An all in one few-shot audio classification evaluation framework.☆10Aug 19, 2024Updated 2 years ago
- Heterformer: Transformer-based Deep Node Representation Learning on Heterogeneous Text-Rich Networks (KDD 2023)☆28Feb 16, 2024Updated 2 years ago
- [ICLR 2025] Diffusion Feedback Helps CLIP See Better☆303Jan 23, 2025Updated last year
- ☆16Aug 28, 2024Updated 2 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Official PyTorch implementation for NeurIPS'23 paper: STREAMER: Streaming Representation Learning and Event Segmentation in a Hierarchica…☆10Nov 17, 2023Updated 2 years ago
- Code for ACL22 findings paper: Inverse is Better! Fast and Accurate Prompt for Slot Tagging☆27Jul 13, 2022Updated 4 years ago
- A Dynamic Visual Benchmark for Evaluating Mathematical Reasoning Robustness of Vision Language Models☆29Nov 25, 2024Updated last year
- [CVPR 2024] OneLLM: One Framework to Align All Modalities with Language☆667Oct 22, 2024Updated 2 years ago
- ☆28Jul 18, 2025Updated last year
- ☆10Nov 23, 2023Updated 2 years ago
- ☆14Aug 13, 2021Updated 5 years ago
- [ECCV’24] Official Implementation for CAT: Enhancing Multimodal Large Language Model to Answer Questions in Dynamic Audio-Visual Scenario…☆59Sep 4, 2024Updated 2 years ago
- 📖Curated list about reasoning abilitiy of MLLM, including OpenAI o1, OpenAI o3-mini, and Slow-Thinking.☆14Feb 7, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- The implementation for "Empowering Whisper as a Joint Multi-Talker and Target-Talker Speech Recognition System".☆34Aug 2, 2025Updated last year
- Extending context length of visual language models☆12Dec 18, 2024Updated last year
- Python3 version of UC Berkeley's CS 188 Pacman Capture the Flag project☆10Mar 14, 2024Updated 2 years ago
- [CVPR 2024] Official PyTorch implementation of the paper "One For All: Video Conversation is Feasible Without Video Instruction Tuning"☆35Feb 2, 2024Updated 2 years ago
- An awesome YAML-based CV that works with your existing Jekyll site☆11Jan 10, 2019Updated 7 years ago
- ☆12Oct 30, 2022Updated 4 years ago
- An Empirical Study of Training Multi-modal Sequential Recommendation Models☆12Aug 22, 2023Updated 3 years ago
- An official repo for the paper "Adapting Language-Audio Models as Few-Shot Audio Learners"☆31May 31, 2023Updated 3 years ago
- Quokka: An Open-source Large Language Model ChatBot for Material Science☆11Jan 29, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆100May 16, 2024Updated 2 years ago
- ☆12Feb 18, 2025Updated last year
- The implementation for "Large Language Model Can Transcribe Speech in Multi-Talker Scenarios with Versatile Instructions"☆52Apr 7, 2025Updated last year
- Multi-Scale Attention for Audio Question Answering☆28Jul 19, 2023Updated 3 years ago
- An extension to original TIN, which combines partpair cues to improve the HOI detection result. The experiments are done for different wa…☆10Nov 22, 2022Updated 3 years ago
- Official implementation for paper Learning Grounded Vision-Language Representation for Versatile Understanding in Untrimmed Videos☆28Dec 8, 2023Updated 2 years ago
- The implement of LLMTreeRec☆14Dec 9, 2024Updated last year