facebookresearch / ssl-data-curation
PyTorch code for hierarchical k-means -- a data curation method for self-supervised learning
☆131Updated 5 months ago
Related projects ⓘ
Alternatives and complementary repositories for ssl-data-curation
- ☆196Updated last year
- When do we not need larger vision models?☆336Updated this week
- Learning from synthetic data - code and models☆303Updated 10 months ago
- Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time☆429Updated 4 months ago
- Official code for "TOAST: Transfer Learning via Attention Steering"☆186Updated last year
- Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.☆151Updated 7 months ago
- VLM Evaluation: Benchmark for VLMs, spanning text generation tasks from VQA to Captioning☆87Updated 2 months ago
- [NeurIPS 2023] This repository includes the official implementation of our paper "An Inverse Scaling Law for CLIP Training"☆298Updated 5 months ago
- Implementation of Soft MoE, proposed by Brain's Vision team, in Pytorch☆246Updated 6 months ago
- The official repo for the paper "VeCLIP: Improving CLIP Training via Visual-enriched Captions"☆228Updated 2 months ago
- The most impactful papers related to contrastive pretraining for multimodal models!☆44Updated 8 months ago
- A framework for merging models solving different tasks with different initializations into one multi-task model without any additional tr…☆285Updated 10 months ago
- Object Recognition as Next Token Prediction (CVPR 2024 Highlight)☆161Updated last month
- FFCV-SSL Fast Forward Computer Vision for Self-Supervised Learning.☆203Updated last year
- ☆61Updated last month
- Reproducible scaling laws for contrastive language-image learning (https://arxiv.org/abs/2212.07143)☆153Updated 11 months ago
- ☆462Updated 2 weeks ago
- (ICLR 2023) Official PyTorch implementation of "What Do Self-Supervised Vision Transformers Learn?"☆102Updated 8 months ago
- Conference schedule, top papers, and analysis of the data for NeurIPS 2023!☆108Updated 11 months ago
- [CVPR 2024] Official implementation of "ViTamin: Designing Scalable Vision Models in the Vision-language Era"☆175Updated 5 months ago
- The official CLIP training codebase of Inf-CL: "Breaking the Memory Barrier: Near Infinite Batch Size Scaling for Contrastive Loss". A su…☆178Updated 3 weeks ago
- Code release for "Improved baselines for vision-language pre-training"☆57Updated 6 months ago
- Implementation of ST-Moe, the latest incarnation of MoE after years of research at Brain, in Pytorch☆293Updated 5 months ago
- Code for Finetune like you pretrain: Improved finetuning of zero-shot vision models☆90Updated last year
- Filtering, Distillation, and Hard Negatives for Vision-Language Pre-Training☆132Updated last year
- Code for experiments for "ConvNet vs Transformer, Supervised vs CLIP: Beyond ImageNet Accuracy"☆96Updated 2 months ago
- Experiments and data for the paper "When and why vision-language models behave like bags-of-words, and what to do about it?" Oral @ ICLR …☆254Updated last year
- Code and models for the paper "The effectiveness of MAE pre-pretraining for billion-scale pretraining" https://arxiv.org/abs/2303.13496☆81Updated 3 months ago
- Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"☆49Updated 2 months ago
- Probing the representations of Vision Transformers.☆316Updated 2 years ago