aszala / EnvGen
Official Code Repository for EnvGen: Generating and Adapting Environments via LLMs for Training Embodied Agents (COLM 2024)
☆26Updated 2 months ago
Related projects: ⓘ
- Official implementation of "Gemini in Reasoning: Unveiling Commonsense in Multimodal Large Language Models"☆35Updated 8 months ago
- Repository for Skill Set Optimization☆12Updated last month
- ☆24Updated 7 months ago
- We introduce EMMET and unify model editing with popular algorithms ROME and MEMIT.☆11Updated 3 weeks ago
- Implementation of the model: "(MC-ViT)" from the paper: "Memory Consolidation Enables Long-Context Video Understanding"☆15Updated last week
- Official implementation of ECCV24 paper: POA☆23Updated last month
- Code for T-MARS data filtering☆34Updated last year
- Code repo for "Read Anywhere Pointed: Layout-aware GUI Screen Reading with Tree-of-Lens Grounding"☆19Updated last month
- Code for LaMPP: Language Models as Probabilistic Priors for Perception and Action☆35Updated last year
- Official implementation of the paper "MMInA: Benchmarking Multihop Multimodal Internet Agents"☆36Updated 5 months ago
- ☆21Updated 2 months ago
- Code for "Merging Text Transformers from Different Initializations"☆18Updated last month
- ☆19Updated 10 months ago
- ☆17Updated this week
- Official Repository of VideoLLaMB: Long Video Understanding with Recurrent Memory Bridges☆27Updated this week
- This repository includes the official implementation of our paper "Sight Beyond Text: Multi-Modal Training Enhances LLMs in Truthfulness …☆19Updated last year
- Official implementation of MAIA, A Multimodal Automated Interpretability Agent☆56Updated last month
- Video-STaR: Self-Training Enables Video Instruction Tuning with Any Supervision☆44Updated 2 months ago
- Code repository for the public reproduction of the language modelling experiments on "MatFormer: Nested Transformer for Elastic Inference…☆17Updated 10 months ago
- Pytorch implementation of HyperLLaVA: Dynamic Visual and Language Expert Tuning for Multimodal Large Language Models☆27Updated 5 months ago
- A Data Source for Reasoning Embodied Agents☆19Updated last year
- An official codebase for paper " CHAMPAGNE: Learning Real-world Conversation from Large-Scale Web Videos (ICCV 23)"☆52Updated last year
- ☆24Updated 2 weeks ago
- Advantage Leftover Lunch Reinforcement Learning (A-LoL RL): Improving Language Models with Advantage-based Offline Policy Gradients☆24Updated last week
- LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture☆115Updated 2 weeks ago
- This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"☆14Updated 6 months ago
- Official implementation of our paper "Finetuned Multimodal Language Models are High-Quality Image-Text Data Filters".☆40Updated 2 months ago
- A repository for research on medium sized language models.☆71Updated 3 months ago
- Code release for "SPIQA: A Dataset for Multimodal Question Answering on Scientific Papers"☆30Updated last month
- The Official Code Repository for GUI-World.☆33Updated last month