mlfoundations / model-soups
Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time
☆454Updated 8 months ago
Alternatives and similar repositories for model-soups:
Users that are interested in model-soups are comparing it to the libraries listed below
- Robust fine-tuning of zero-shot models☆690Updated 2 years ago
- A framework for merging models solving different tasks with different initializations into one multi-task model without any additional tr…☆298Updated last year
- PyTorch code for hierarchical k-means -- a data curation method for self-supervised learning☆150Updated 9 months ago
- ☆618Updated 2 months ago
- Official code for our CVPR'22 paper “Vision Transformer Slimming: Multi-Dimension Searching in Continuous Optimization Space”☆249Updated last year
- A collection of parameter-efficient transfer learning papers focusing on computer vision and multimodal domains.☆401Updated 6 months ago
- A method to increase the speed and lower the memory footprint of existing vision transformers.☆1,035Updated 9 months ago
- [NeurIPS 2023] This repository includes the official implementation of our paper "An Inverse Scaling Law for CLIP Training"☆314Updated 10 months ago
- A simple way to keep track of an Exponential Moving Average (EMA) version of your Pytorch model☆567Updated 4 months ago
- Learning from synthetic data - code and models☆313Updated last year
- Code release for "Dropout Reduces Underfitting"☆312Updated last year
- iBOT : Image BERT Pre-Training with Online Tokenizer (ICLR 2022)☆720Updated 2 years ago
- ☆201Updated last year
- Compare neural networks by their feature similarity☆358Updated last year
- This repository contains the implementation for the paper "EMP-SSL: Towards Self-Supervised Learning in One Training Epoch."☆226Updated last year
- Masked Siamese Networks for Label-Efficient Learning (https://arxiv.org/abs/2204.07141)☆456Updated 2 years ago
- Editing Models with Task Arithmetic☆460Updated last year
- Official Open Source code for "Scaling Language-Image Pre-training via Masking"☆417Updated 2 years ago
- (ICLR 2022 Spotlight) Official PyTorch implementation of "How Do Vision Transformers Work?"☆813Updated 2 years ago
- EsViT: Efficient self-supervised Vision Transformers☆410Updated last year
- Supervision Exists Everywhere: A Data Efficient Contrastive Language-Image Pre-training Paradigm☆649Updated 2 years ago
- CLIP-like model evaluation☆686Updated 2 weeks ago
- Implementation of ST-Moe, the latest incarnation of MoE after years of research at Brain, in Pytorch☆325Updated 9 months ago
- When do we not need larger vision models?☆383Updated 2 months ago
- Collection of Tools and Papers related to Adapters / Parameter-Efficient Transfer Learning/ Fine-Tuning☆188Updated 11 months ago
- DataComp: In search of the next generation of multimodal datasets☆692Updated last year
- Official code for "TOAST: Transfer Learning via Attention Steering"☆190Updated last year
- FFCV-SSL Fast Forward Computer Vision for Self-Supervised Learning.☆207Updated last year
- Official Pytorch Implementation of: "ImageNet-21K Pretraining for the Masses"(NeurIPS, 2021) paper☆757Updated 2 years ago
- Implementation of Soft MoE, proposed by Brain's Vision team, in Pytorch☆280Updated last week