Alternatives and similar repositories for weight-selection:

Users that are interested in weight-selection are comparing it to the libraries listed below

• kirill-vish / Beyond-INet
  Code for experiments for "ConvNet vs Transformer, Supervised vs CLIP: Beyond ImageNet Accuracy"
  ☆101Updated 6 months ago
• bfshi / TOAST
  Official code for "TOAST: Transfer Learning via Attention Steering"
  ☆189Updated last year
• Arnav0400 / ViT-Slim
  Official code for our CVPR'22 paper “Vision Transformer Slimming: Multi-Dimension Searching in Continuous Optimization Space”
  ☆249Updated last year
• kaiyuyue / nxtp
  Object Recognition as Next Token Prediction (CVPR 2024 Highlight)
  ☆174Updated 2 months ago
• TomerRonen34 / mixed-resolution-vit
  ☆50Updated last year
• sdc17 / UPop
  [ICML 2023] UPop: Unified and Progressive Pruning for Compressing Vision-Language Transformers.
  ☆101Updated 2 months ago
• karttikeya / minREV
  A simple minimal implementation of Reversible Vision Transformers
  ☆122Updated last year
• kyegomez / Mixture-of-Depths
  Implementation of the paper: "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆85Updated last week
• RobertCsordas / moe_attention
  Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"
  ☆97Updated 5 months ago
• berlino / gated_linear_attention
  ☆101Updated last year
• eric-ai-lab / PEViT
  Official implementation of AAAI 2023 paper "Parameter-efficient Model Adaptation for Vision Transformers"
  ☆104Updated last year
• OpenNLPLab / Transnormer
  [EMNLP 2022] Official implementation of Transnormer in our EMNLP 2022 paper - The Devil in Linear Transformer
  ☆60Updated last year
• UCDvision / NOLA
  Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"
  ☆52Updated 6 months ago
• WailordHe / DenseSSM
  A repository for DenseSSMs
  ☆87Updated 11 months ago
• hahnyuan / PB-LLM
  PB-LLM: Partially Binarized Large Language Models
  ☆151Updated last year
• YuchuanTian / DiJiang
  [ICML'24 Oral] The official code of "DiJiang: Efficient Large Language Models through Compact Kernelization", a novel DCT-based linear at…
  ☆99Updated 9 months ago
• fkodom / soft-mixture-of-experts
  PyTorch implementation of Soft MoE by Google Brain in "From Sparse to Soft Mixtures of Experts" (https://arxiv.org/pdf/2308.00951.pdf)
  ☆71Updated last year
• NVlabs / A-ViT
  Official PyTorch implementation of A-ViT: Adaptive Tokens for Efficient Vision Transformer (CVPR 2022)
  ☆153Updated 2 years ago
• mu-cai / matryoshka-mm
  Matryoshka Multimodal Models
  ☆98Updated last month
• nbasyl / DoRA
  Official implementation of "DoRA: Weight-Decomposed Low-Rank Adaptation"
  ☆123Updated 10 months ago
• jxiw / MambaInLlama
  [NeurIPS 2024] Official Repository of The Mamba in the Llama: Distilling and Accelerating Hybrid Models
  ☆205Updated 2 weeks ago
• AILab-CVC / M2PT
  [CVPR'24] Multimodal Pathway: Improve Transformers with Irrelevant Data from Other Modalities
  ☆99Updated last year
• AnonymousAlethiometer / SGD_SaI
  Official PyTorch Implementation for Paper "No More Adam: Learning Rate Scaling at Initialization is All You Need"
  ☆50Updated last month
• lucidrains / soft-moe-pytorch
  Implementation of Soft MoE, proposed by Brain's Vision team, in Pytorch
  ☆269Updated 10 months ago
• naver-ai / model-stock
  Model Stock: All we need is just a few fine-tuned models
  ☆106Updated 5 months ago
• kyleliang919 / C-Optim
  When it comes to optimizers, it's always better to be safe than sorry
  ☆214Updated 3 weeks ago
• DAMO-NLP-SG / Inf-CLIP
  [CVPR 2025] The official CLIP training codebase of Inf-CL: "Breaking the Memory Barrier: Near Infinite Batch Size Scaling for Contrastive…
  ☆235Updated 2 months ago
• iancovert / locality-alignment
  ☆42Updated 2 months ago
• itsnamgyu / block-transformer
  Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)
  ☆150Updated 3 months ago
• haoliuhl / language-quantized-autoencoders
  Language Quantized AutoEncoders
  ☆102Updated 2 years ago