Alternatives and similar repositories for dropout

Users that are interested in dropout are comparing it to the libraries listed below

• facebookresearch / FFCV-SSL
  FFCV-SSL Fast Forward Computer Vision for Self-Supervised Learning.
  ☆207Updated last year
• lucidrains / flash-cosine-sim-attention
  Implementation of fused cosine similarity attention in the same style as Flash Attention
  ☆213Updated 2 years ago
• lucidrains / Adan-pytorch
  Implementation of the Adan (ADAptive Nesterov momentum algorithm) Optimizer in Pytorch
  ☆252Updated 2 years ago
• lucidrains / Mega-pytorch
  Implementation of Mega, the Single-head Attention with Multi-headed EMA architecture that currently holds SOTA on Long Range Arena
  ☆203Updated last year
• sayakpaul / probing-vits
  Probing the representations of Vision Transformers.
  ☆325Updated 2 years ago
• lucidrains / CoLT5-attention
  Implementation of the conditionally routed attention in the CoLT5 architecture, in Pytorch
  ☆228Updated 8 months ago
• kyegomez / Sophia
  Effortless plugin and play Optimizer to cut model training costs by 50%. New optimizer that is 2x faster than Adam on LLMs.
  ☆380Updated 11 months ago
• mlfoundations / model-soups
  Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time
  ☆467Updated 10 months ago
• hsouri / Battle-of-the-Backbones
  ☆203Updated last year
• BlackHC / toma
  Helps you write algorithms in PyTorch that adapt to the available (CUDA) memory
  ☆438Updated 9 months ago
• hamidkazemi22 / vit-visualization
  ☆183Updated last year
• archinetai / surgeon-pytorch
  A library to inspect and extract intermediate layers of PyTorch models.
  ☆473Updated 3 years ago
• facebookresearch / imagenetx
  understanding model mistakes with human annotations
  ☆106Updated 2 years ago
• wpeebles / G.pt
  Official PyTorch Implementation of "Learning to Learn with Generative Models of Neural Network Checkpoints"
  ☆340Updated 2 years ago
• hila-chefer / RobustViT
  [NeurIPS 2022] Official PyTorch implementation of Optimizing Relevance Maps of Vision Transformers Improves Robustness. This code allows …
  ☆128Updated 2 years ago
• facebookresearch / mega
  Sequence modeling with Mega.
  ☆295Updated 2 years ago
• lucidrains / memory-efficient-attention-pytorch
  Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attention Does Not Need O(n²) Memory"
  ☆378Updated last year
• facebookresearch / torchdim
  Named tensors with first-class dimensions for PyTorch
  ☆329Updated last year
• NVlabs / GCVit
  [ICML 2023] Official PyTorch implementation of Global Context Vision Transformers
  ☆435Updated last year
• apple / ml-sigma-reparam
  ☆301Updated 11 months ago
• OATML / RHO-Loss
  ☆207Updated 2 years ago
• huggingface / chug
  Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.
  ☆157Updated last year
• facebookresearch / VICRegL
  VICRegL official code base
  ☆229Updated 2 years ago
• lucidrains / soft-moe-pytorch
  Implementation of Soft MoE, proposed by Brain's Vision team, in Pytorch
  ☆294Updated 2 months ago
• NVIDIA / transformer-ls
  Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).
  ☆225Updated 3 years ago
• DarshanDeshpande / jax-models
  Unofficial JAX implementations of deep learning research papers
  ☆156Updated 2 years ago
• facebookresearch / active_indexing
  Official implementation of "Active Image Indexing"
  ☆59Updated 2 years ago
• lucidrains / discrete-key-value-bottleneck-pytorch
  Implementation of Discrete Key / Value Bottleneck, in Pytorch
  ☆88Updated last year
• iejMac / video2numpy
  Optimized library for large-scale extraction of frames and audio from video.
  ☆205Updated last year
• lucidrains / ema-pytorch
  A simple way to keep track of an Exponential Moving Average (EMA) version of your Pytorch model
  ☆590Updated 6 months ago