HyperGAI / HPT
HPT - Open Multimodal LLMs from HyperGAI
☆312Updated 5 months ago
Related projects ⓘ
Alternatives and complementary repositories for HPT
- LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills☆709Updated 9 months ago
- [TMLR23] Official implementation of UnIVAL: Unified Model for Image, Video, Audio and Language Tasks.☆224Updated 11 months ago
- Long Context Transfer from Language to Vision☆334Updated this week
- a family of highly capabale yet efficient large multimodal models☆166Updated 3 months ago
- ☆152Updated 4 months ago
- ☆573Updated 9 months ago
- (CVPR2024)A benchmark for evaluating Multimodal LLMs using multiple-choice questions.☆315Updated 4 months ago
- LLaVA-UHD: an LMM Perceiving Any Aspect Ratio and High-Resolution Images☆319Updated last month
- ControlLLM: Augment Language Models with Tools by Searching on Graphs☆186Updated 4 months ago
- Code/Data for the paper: "LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image Understanding"☆258Updated 5 months ago
- Official code for Paper "Mantis: Multi-Image Instruction Tuning" (TMLR2024)☆184Updated this week
- VCoder: Versatile Vision Encoders for Multimodal Large Language Models, arXiv 2023 / CVPR 2024☆262Updated 7 months ago
- ☆286Updated 2 weeks ago
- This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for E…☆358Updated this week
- RLAIF-V: Aligning MLLMs through Open-Source AI Feedback for Super GPT-4V Trustworthiness☆246Updated 2 weeks ago
- Aligning LMMs with Factually Augmented RLHF☆323Updated last year
- Implementation of PALI3 from the paper PALI-3 VISION LANGUAGE MODELS: SMALLER, FASTER, STRONGER"☆142Updated last week
- LLaVA-HR: High-Resolution Large Language-Vision Assistant☆212Updated 3 months ago
- LLaVA-Interactive-Demo☆352Updated 3 months ago
- Official implementation of SEED-LLaMA (ICLR 2024).☆583Updated 2 months ago
- [ACL 2024] Progressive LLaMA with Block Expansion.☆480Updated 6 months ago
- A minimal codebase for finetuning large multimodal models, supporting llava-1.5/1.6, llava-interleave, llava-next-video, llava-onevision,…☆182Updated last month
- E5-V: Universal Embeddings with Multimodal Large Language Models☆175Updated 4 months ago
- Anole: An Open, Autoregressive and Native Multimodal Models for Interleaved Image-Text Generation☆677Updated 3 months ago
- Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model☆246Updated 4 months ago
- MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities (ICML 2024)☆266Updated 2 weeks ago
- LLM2CLIP makes SOTA pretrained CLIP model more SOTA ever.☆275Updated this week
- Research Trends in LLM-guided Multimodal Learning.☆355Updated last year
- MM-Interleaved: Interleaved Image-Text Generative Modeling via Multi-modal Feature Synchronizer☆198Updated 7 months ago
- [NeurIPS 2023] Official implementations of "Cheap and Quick: Efficient Vision-Language Instruction Tuning for Large Language Models"☆509Updated 9 months ago