BolinLai / LEGO
[ECCV2024, Oral, Best Paper Finalist]This is the official implementation of the paper "LEGO: Learning EGOcentric Action Frame Generation via Visual Instruction Tuning".
☆37Updated last month
Alternatives and similar repositories for LEGO:
Users that are interested in LEGO are comparing it to the libraries listed below
- [CVPR 2024] Data and benchmark code for the EgoExoLearn dataset☆56Updated 7 months ago
- Official code for MotionBench (CVPR 2025)☆32Updated last month
- ☆37Updated 3 weeks ago
- [ICLR 2024] Seer: Language Instructed Video Prediction with Latent Diffusion Models☆30Updated 10 months ago
- IMProv: Inpainting-based Multimodal Prompting for Computer Vision Tasks☆58Updated 6 months ago
- [BMVC2022, IJCV2023, Best Student Paper, Spotlight] Official codes for the paper "In the Eye of Transformer: Global-Local Correlation for…☆24Updated last month
- [arXiv: 2502.05178] QLIP: Text-Aligned Visual Tokenization Unifies Auto-Regressive Multimodal Understanding and Generation☆66Updated last month
- Code release for NeurIPS 2023 paper SlotDiffusion: Object-centric Learning with Diffusion Models☆85Updated last year
- Code and data release for the paper "Learning Object State Changes in Videos: An Open-World Perspective" (CVPR 2024)☆32Updated 7 months ago
- Code for the paper "GenHowTo: Learning to Generate Actions and State Transformations from Instructional Videos" published at CVPR 2024☆51Updated last year
- Code implementation for paper titled "HOI-Ref: Hand-Object Interaction Referral in Egocentric Vision"☆26Updated 11 months ago
- [ICML 2024] A Touch, Vision, and Language Dataset for Multimodal Alignment☆71Updated 2 months ago
- [ECCV 2024 Oral] ActionVOS: Actions as Prompts for Video Object Segmentation☆31Updated 4 months ago
- Action Scene Graphs for Long-Form Understanding of Egocentric Videos (CVPR 2024)☆38Updated last month
- Vinci: A Real-time Embodied Smart Assistant based on Egocentric Vision-Language Model☆55Updated 3 months ago
- ☆59Updated last year
- Code release for "EgoVLPv2: Egocentric Video-Language Pre-training with Fusion in the Backbone" [ICCV, 2023]☆96Updated 9 months ago
- EgoVid-5M: A Large-Scale Video-Action Dataset for Egocentric Video Generation☆100Updated 5 months ago
- ☆25Updated this week
- Can 3D Vision-Language Models Truly Understand Natural Language?☆21Updated last year
- Egocentric Video Understanding Dataset (EVUD)☆28Updated 9 months ago
- Accepted by CVPR 2024☆33Updated 10 months ago
- [ICLR 2025] CREMA: Generalizable and Efficient Video-Language Reasoning via Multimodal Modular Fusion☆41Updated 2 months ago
- Code and data release for the paper "Learning Fine-grained View-Invariant Representations from Unpaired Ego-Exo Videos via Temporal Align…☆17Updated last year
- [CVPR 2025] OVO-Bench: How Far is Your Video-LLMs from Real-World Online Video Understanding?☆50Updated last week
- This repo contains the official implementation of ICLR 2024 paper "Is ImageNet worth 1 video? Learning strong image encoders from 1 long …☆85Updated 10 months ago
- Code for our paper: Learning Camera Movement Control from Real-World Drone Videos☆27Updated 2 months ago
- Language Repository for Long Video Understanding☆31Updated 9 months ago
- Ego4D Goal-Step: Toward Hierarchical Understanding of Procedural Activities (NeurIPS 2023)☆40Updated 11 months ago
- Code for paper "Grounding Video Models to Actions through Goal Conditioned Exploration".☆44Updated 3 months ago