mlfoundations / model-soupsLinks
Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time
☆474Updated last year
Alternatives and similar repositories for model-soups
Users that are interested in model-soups are comparing it to the libraries listed below
Sorting:
- A framework for merging models solving different tasks with different initializations into one multi-task model without any additional tr…☆301Updated last year
- Robust fine-tuning of zero-shot models☆721Updated 3 years ago
- ☆654Updated 3 weeks ago
- Code release for "Dropout Reduces Underfitting"☆313Updated 2 years ago
- Editing Models with Task Arithmetic☆482Updated last year
- Official code for our CVPR'22 paper “Vision Transformer Slimming: Multi-Dimension Searching in Continuous Optimization Space”☆250Updated last year
- Collection of Tools and Papers related to Adapters / Parameter-Efficient Transfer Learning/ Fine-Tuning☆194Updated last year
- PyTorch code for hierarchical k-means -- a data curation method for self-supervised learning☆157Updated last year
- Implementation of Soft MoE, proposed by Brain's Vision team, in Pytorch☆304Updated 3 months ago
- Implementation of ST-Moe, the latest incarnation of MoE after years of research at Brain, in Pytorch☆345Updated last year
- This repository contains the implementation for the paper "EMP-SSL: Towards Self-Supervised Learning in One Training Epoch."☆227Updated last year
- Official code for "TOAST: Transfer Learning via Attention Steering"☆189Updated last year
- Compare neural networks by their feature similarity☆365Updated 2 years ago
- ☆203Updated last year
- [NeurIPS 2023] This repository includes the official implementation of our paper "An Inverse Scaling Law for CLIP Training"☆315Updated last year
- A collection of parameter-efficient transfer learning papers focusing on computer vision and multimodal domains.☆401Updated 9 months ago
- DataComp: In search of the next generation of multimodal datasets☆722Updated 2 months ago
- Reproducible scaling laws for contrastive language-image learning (https://arxiv.org/abs/2212.07143)☆169Updated 3 weeks ago
- Learning from synthetic data - code and models☆319Updated last year
- CLIP-like model evaluation☆737Updated 3 weeks ago
- Official Pytorch Implementation of: "ImageNet-21K Pretraining for the Masses"(NeurIPS, 2021) paper☆768Updated 2 years ago
- When do we not need larger vision models?☆400Updated 5 months ago
- Fine-tuning Vision Transformers on various classification datasets☆109Updated 10 months ago
- FFCV-SSL Fast Forward Computer Vision for Self-Supervised Learning.☆208Updated last year
- A Pytorch implementation of Sparsely-Gated Mixture of Experts, for massively increasing the parameter count of language models☆776Updated last year
- A method to increase the speed and lower the memory footprint of existing vision transformers.☆1,073Updated last year
- ☆208Updated 2 years ago
- ☆180Updated 9 months ago
- (ICLR 2022 Spotlight) Official PyTorch implementation of "How Do Vision Transformers Work?"☆818Updated 3 years ago
- EsViT: Efficient self-supervised Vision Transformers☆413Updated last year