Alternatives and similar repositories for dropout

Users that are interested in dropout are comparing it to the libraries listed below

• facebookresearch / FFCV-SSL
  FFCV-SSL Fast Forward Computer Vision for Self-Supervised Learning.
  ☆210Updated 2 years ago
• lucidrains / Adan-pytorch
  Implementation of the Adan (ADAptive Nesterov momentum algorithm) Optimizer in Pytorch
  ☆252Updated 3 years ago
• hamidkazemi22 / vit-visualization
  ☆190Updated 2 years ago
• lucidrains / soft-moe-pytorch
  Implementation of Soft MoE, proposed by Brain's Vision team, in Pytorch
  ☆337Updated 8 months ago
• lucidrains / flash-cosine-sim-attention
  Implementation of fused cosine similarity attention in the same style as Flash Attention
  ☆219Updated 2 years ago
• lucidrains / memory-efficient-attention-pytorch
  Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attention Does Not Need O(n²) Memory"
  ☆388Updated 2 years ago
• hila-chefer / RobustViT
  [NeurIPS 2022] Official PyTorch implementation of Optimizing Relevance Maps of Vision Transformers Improves Robustness. This code allows …
  ☆133Updated 3 years ago
• lucidrains / CoLT5-attention
  Implementation of the conditionally routed attention in the CoLT5 architecture, in Pytorch
  ☆231Updated last year
• mlfoundations / model-soups
  Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time
  ☆500Updated last year
• NVlabs / GCVit
  [ICML 2023] Official PyTorch implementation of Global Context Vision Transformers
  ☆443Updated 2 years ago
• lucidrains / Mega-pytorch
  Implementation of Mega, the Single-head Attention with Multi-headed EMA architecture that currently holds SOTA on Long Range Arena
  ☆207Updated 2 years ago
• lucidrains / block-recurrent-transformer-pytorch
  Implementation of Block Recurrent Transformer - Pytorch
  ☆223Updated last year
• sayakpaul / probing-vits
  Probing the representations of Vision Transformers.
  ☆336Updated 3 years ago
• bobby-he / simplified_transformers
  ☆293Updated last year
• hsouri / Battle-of-the-Backbones
  ☆209Updated 2 years ago
• lucidrains / pytorch-custom-utils
  Just some miscellaneous utility functions / decorators / modules related to Pytorch and Accelerate to help speed up implementation of new…
  ☆125Updated last year
• OATML / RHO-Loss
  ☆210Updated 3 years ago
• gstoica27 / ZipIt
  A framework for merging models solving different tasks with different initializations into one multi-task model without any additional tr…
  ☆308Updated last year
• OscarXZQ / weight-selection
  ☆189Updated last year
• kyegomez / Sophia
  Effortless plugin and play Optimizer to cut model training costs by 50%. New optimizer that is 2x faster than Adam on LLMs.
  ☆383Updated last year
• facebookresearch / SWAG
  Official repository for "Revisiting Weakly Supervised Pre-Training of Visual Perception Models". https://arxiv.org/abs/2201.08371.
  ☆182Updated 3 years ago
• google-research / diffstride
  TF/Keras code for DiffStride, a pooling layer with learnable strides.
  ☆124Updated 3 years ago
• facebookresearch / data2vec_vision
  Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities
  ☆80Updated 3 years ago
• facebookresearch / imagenetx
  understanding model mistakes with human annotations
  ☆106Updated 2 years ago
• facebookresearch / active_indexing
  Official implementation of "Active Image Indexing"
  ☆60Updated 2 years ago
• iejMac / video2numpy
  Optimized library for large-scale extraction of frames and audio from video.
  ☆205Updated 2 years ago
• lucidrains / discrete-key-value-bottleneck-pytorch
  Implementation of Discrete Key / Value Bottleneck, in Pytorch
  ☆88Updated 2 years ago
• facebookresearch / clip-rocket
  Code release for "Improved baselines for vision-language pre-training"
  ☆61Updated last year
• facebookresearch / VICRegL
  VICRegL official code base
  ☆231Updated 2 years ago
• rasbt / cvpr2023
  ☆134Updated 2 years ago