haotian-liu / transformers_llava
☆13Updated last year
Related projects ⓘ
Alternatives and complementary repositories for transformers_llava
- A Data Source for Reasoning Embodied Agents☆19Updated last year
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated 8 months ago
- ☆13Updated last year
- The open source implementation of the base model behind GPT-4 from OPENAI [Language + Multi-Modal]☆11Updated last year
- Pytorch implementation of HyperLLaVA: Dynamic Visual and Language Expert Tuning for Multimodal Large Language Models☆28Updated 7 months ago
- PyTorch Implementation of the paper "MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training"☆23Updated this week
- ☆57Updated last month
- My personal implementation of the model from "Qwen-VL: A Frontier Large Vision-Language Model with Versatile Abilities", they haven't rel…☆11Updated 9 months ago
- Finetune any model on HF in less than 30 seconds☆56Updated this week
- Lottery Ticket Adaptation☆35Updated last month
- Official implementation of ECCV24 paper: POA☆24Updated 3 months ago
- LoRA fine-tuned Stable Diffusion Deployment☆31Updated last year
- Simple Implementation of TinyGPTV in super simple Zeta lego blocks☆15Updated this week
- Evaluate the performance of computer vision models and prompts for zero-shot models (Grounding DINO, CLIP, BLIP, DINOv2, ImageBind, model…☆34Updated last year
- An plug in and play pipeline that utilizes segment anything to segment datasets with rich detail for downstream fine-tuning on vision mod…☆21Updated 8 months ago
- Modified Beam Search with periodical restart☆12Updated last month
- A list of language models with permissive licenses such as MIT or Apache 2.0☆22Updated this week
- The open source community's implementation of the all-new Multi-Modal Causal Attention from "DeepSpeed-VisualChat: Multi-Round Multi-Imag…☆12Updated 7 months ago
- Github repo for Peifeng's internship project☆12Updated last year
- Implementation of the LDP module block in PyTorch and Zeta from the paper: "MobileVLM: A Fast, Strong and Open Vision Language Assistant …☆14Updated 7 months ago
- Visualize multi-model embedding spaces. The first goal is to quickly get a lay of the land of any embedding space. Then be able to scroll…☆26Updated 5 months ago
- Tools for content datamining and NLP at scale☆42Updated 4 months ago
- Visual RAG using less than 300 lines of code.☆23Updated 8 months ago
- A testbed for agents and environments that can automatically improve models through data generation.☆12Updated last month
- arXiv 23 "Towards Improving Document Understanding: An Exploration on Text-Grounding via MLLMs"☆13Updated 9 months ago
- Official Code Repository for EnvGen: Generating and Adapting Environments via LLMs for Training Embodied Agents (COLM 2024)☆25Updated 3 months ago
- Representing Rule-based Chatbots with Transformers☆18Updated 3 months ago
- NeurIPS 2023 - Cappy: Outperforming and Boosting Large Multi-Task LMs with a Small Scorer☆36Updated 7 months ago
- ☆14Updated 11 months ago
- Official implementation of "Gemini in Reasoning: Unveiling Commonsense in Multimodal Large Language Models"☆35Updated 10 months ago