OFA-Sys / ONE-PEACE
A general representation model across vision, audio, language modalities. Paper: ONE-PEACE: Exploring One General Representation Model Toward Unlimited Modalities
β1,029Updated 6 months ago
Alternatives and similar repositories for ONE-PEACE:
Users that are interested in ONE-PEACE are comparing it to the libraries listed below
- EVA Series: Visual Representation Fantasies from BAAIβ2,468Updated 8 months ago
- VisionLLM Seriesβ1,044Updated last month
- Implementation of 𦩠Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorchβ1,237Updated 2 years ago
- Multimodal-GPTβ1,497Updated last year
- [CVPR 2023] Official Implementation of X-Decoder for generalized decoding for pixel, image and languageβ1,308Updated last year
- γICLR 2024π₯γ Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignmentβ803Updated last year
- Meta-Transformer for Unified Multimodal Learningβ1,591Updated last year
- Project Page for "LISA: Reasoning Segmentation via Large Language Model"β2,156Updated 2 months ago
- Code release for "Cut and Learn for Unsupervised Object Detection and Instance Segmentation" and "VideoCutLER: Surprisingly Simple Unsupeβ¦β1,002Updated last year
- Grounded Language-Image Pre-trainingβ2,378Updated last year
- This is the official PyTorch implementation of the paper Open-Vocabulary Semantic Segmentation with Mask-adapted CLIP.β721Updated last year
- GPT4RoI: Instruction Tuning Large Language Model on Region-of-Interestβ526Updated 10 months ago
- Official PyTorch implementation of ODISE: Open-Vocabulary Panoptic Segmentation with Text-to-Image Diffusion Models [CVPR 2023 Highlight]β894Updated 9 months ago
- Hiera: A fast, powerful, and simple hierarchical vision transformer.β971Updated last year
- β776Updated 9 months ago
- ICLR2024 Spotlight: curation/training code, metadata, distribution and pre-trained models for MetaCLIP; CVPR 2024: MoDE: CLIP Data Expertβ¦β1,420Updated last month
- Implementation of CoCa, Contrastive Captioners are Image-Text Foundation Models, in Pytorchβ1,129Updated last year
- Robust fine-tuning of zero-shot modelsβ695Updated 2 years ago
- Awesome list for research on CLIP (Contrastive Language-Image Pre-Training).β1,191Updated 9 months ago
- [ICLR 2023 Spotlight] Vision Transformer Adapter for Dense Predictionsβ1,357Updated last year
- [CVPR 2024 π₯] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses thaβ¦β864Updated 4 months ago
- A method to increase the speed and lower the memory footprint of existing vision transformers.β1,042Updated 10 months ago
- [ECCV2024] Video Foundation Models & Data for Multimodal Understandingβ1,810Updated last week
- [ECCV 2024] Official implementation of the paper "Semantic-SAM: Segment and Recognize Anything at Any Granularity"β2,581Updated 9 months ago
- Pix2Seq codebase: multi-tasks with generative modeling (autoregressive and diffusion)β905Updated last year
- [CVPR 2022] Official code for "RegionCLIP: Region-based Language-Image Pretraining"β756Updated last year
- [ICCV 2023] Official implementation of the paper "A Simple Framework for Open-Vocabulary Segmentation and Detection"β703Updated last year
- [CVPR 2023] Official implementation of the paper "Mask DINO: Towards A Unified Transformer-based Framework for Object Detection and Segmeβ¦β1,303Updated last year
- Personalize Segment Anything Model (SAM) with 1 shot in 10 secondsβ1,574Updated 8 months ago
- Emu Series: Generative Multimodal Models from BAAIβ1,711Updated 6 months ago