Alternatives and similar repositories for vmoe:

Users that are interested in vmoe are comparing it to the libraries listed below

• lucidrains / mixture-of-experts
  A Pytorch implementation of Sparsely-Gated Mixture of Experts, for massively increasing the parameter count of language models
  ☆736Updated last year
• microsoft / Tutel
  Tutel MoE: Optimized Mixture-of-Experts Library, Support DeepSeek FP8/FP4
  ☆818Updated this week
• lucidrains / soft-moe-pytorch
  Implementation of Soft MoE, proposed by Brain's Vision team, in Pytorch
  ☆287Updated last month
• mlfoundations / model-soups
  Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time
  ☆462Updated 9 months ago
• lucidrains / st-moe-pytorch
  Implementation of ST-Moe, the latest incarnation of MoE after years of research at Brain, in Pytorch
  ☆328Updated 10 months ago
• facebookresearch / ToMe
  A method to increase the speed and lower the memory footprint of existing vision transformers.
  ☆1,049Updated 10 months ago
• Arnav0400 / ViT-Slim
  Official code for our CVPR'22 paper “Vision Transformer Slimming: Multi-Dimension Searching in Continuous Optimization Space”
  ☆249Updated last year
• bytedance / ibot
  iBOT : Image BERT Pre-Training with Online Tokenizer (ICLR 2022)
  ☆721Updated 3 years ago
• davidmrau / mixture-of-experts
  PyTorch Re-Implementation of "The Sparsely-Gated Mixture-of-Experts Layer" by Noam Shazeer et al. https://arxiv.org/abs/1701.06538
  ☆1,100Updated last year
• facebookresearch / flip
  Official Open Source code for "Scaling Language-Image Pre-training via Masking"
  ☆420Updated 2 years ago
• lucidrains / memory-efficient-attention-pytorch
  Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attention Does Not Need O(n²) Memory"
  ☆377Updated last year
• tsb0601 / EMP-SSL
  This repository contains the implementation for the paper "EMP-SSL: Towards Self-Supervised Learning in One Training Epoch."
  ☆227Updated last year
• Sense-GVT / DeCLIP
  Supervision Exists Everywhere: A Data Efficient Contrastive Language-Image Pre-training Paradigm
  ☆653Updated 2 years ago
• OpenNLPLab / TransnormerLLM
  Official implementation of TransNormerLLM: A Faster and Better LLM
  ☆243Updated last year
• mlfoundations / wise-ft
  Robust fine-tuning of zero-shot models
  ☆698Updated 3 years ago
• lucidrains / ema-pytorch
  A simple way to keep track of an Exponential Moving Average (EMA) version of your Pytorch model
  ☆577Updated 5 months ago
• jxhe / unify-parameter-efficient-tuning
  Implementation of paper "Towards a Unified View of Parameter-Efficient Transfer Learning" (ICLR 2022)
  ☆527Updated 3 years ago
• LAION-AI / CLIP_benchmark
  CLIP-like model evaluation
  ☆703Updated last month
• sail-sg / Adan
  Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models
  ☆789Updated 10 months ago
• JamesQFreeman / LoRA-ViT
  Low rank adaptation for Vision Transformer
  ☆403Updated last year
• lucidrains / flamingo-pytorch
  Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch
  ☆1,240Updated 2 years ago
• codecaution / Awesome-Mixture-of-Experts-Papers
  A curated reading list of research in Mixture-of-Experts(MoE).
  ☆621Updated 6 months ago
• NUS-HPC-AI-Lab / InfoBatch
  Lossless Training Speed Up by Unbiased Dynamic Data Pruning
  ☆334Updated 7 months ago
• jianghaojun / Awesome-Parameter-Efficient-Transfer-Learning
  A collection of parameter-efficient transfer learning papers focusing on computer vision and multimodal domains.
  ☆400Updated 7 months ago
• EdisonLeeeee / Awesome-Masked-Autoencoders
  A collection of literature after or concurrent with Masked Autoencoder (MAE) (Kaiming He el al.).
  ☆822Updated 9 months ago
• KMnP / vpt
  ❄️🔥 Visual Prompt Tuning [ECCV 2022] https://arxiv.org/abs/2203.12119
  ☆1,105Updated last year
• facebookresearch / moco-v3
  PyTorch implementation of MoCo v3 https//arxiv.org/abs/2104.02057
  ☆1,264Updated 3 years ago
• XueFuzhao / awesome-mixture-of-experts
  A collection of AWESOME things about mixture-of-experts
  ☆1,103Updated 5 months ago
• lucidrains / ring-attention-pytorch
  Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch
  ☆511Updated 6 months ago
• fundamentalvision / Uni-Perceiver
  ☆275Updated 2 years ago