Alternatives and similar repositories for Adan-pytorch:

Users that are interested in Adan-pytorch are comparing it to the libraries listed below

• lucidrains / Mega-pytorch
  Implementation of Mega, the Single-head Attention with Multi-headed EMA architecture that currently holds SOTA on Long Range Arena
  ☆204Updated last year
• archinetai / surgeon-pytorch
  A library to inspect and extract intermediate layers of PyTorch models.
  ☆470Updated 2 years ago
• lucidrains / x-unet
  Implementation of a U-net complete with efficient attention as well as the latest research findings
  ☆271Updated 8 months ago
• HomebrewNLP / revlib
  Simple and efficient RevNet-Library for PyTorch with XLA and DeepSpeed support and parameter offload
  ☆125Updated 2 years ago
• lucidrains / flash-cosine-sim-attention
  Implementation of fused cosine similarity attention in the same style as Flash Attention
  ☆210Updated last year
• facebookresearch / torchdim
  Named tensors with first-class dimensions for PyTorch
  ☆322Updated last year
• lucidrains / recurrent-interface-network-pytorch
  Implementation of Recurrent Interface Network (RIN), for highly efficient generation of images and video without cascading networks, in P…
  ☆197Updated 11 months ago
• brohrer / sharpened-cosine-similarity
  An alternative to convolution in neural networks
  ☆254Updated 9 months ago
• AminRezaei0x443 / memory-efficient-attention
  Memory Efficient Attention (O(sqrt(n)) for Jax and PyTorch
  ☆181Updated 2 years ago
• DarshanDeshpande / jax-models
  Unofficial JAX implementations of deep learning research papers
  ☆152Updated 2 years ago
• jiaweizzhao / ZerO-initialization
  ☆72Updated 2 years ago
• facebookresearch / FFCV-SSL
  FFCV-SSL Fast Forward Computer Vision for Self-Supervised Learning.
  ☆202Updated last year
• unixpickle / sk2torch
  Convert scikit-learn models to PyTorch modules
  ☆159Updated 8 months ago
• facebookresearch / dropout
  Code release for "Dropout Reduces Underfitting"
  ☆311Updated last year
• ctlllll / SGConv
  ☆164Updated last year
• lucidrains / PaLM-jax
  Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)
  ☆184Updated 2 years ago
• infocusp / diffusion_models
  Minimal standalone example of diffusion model
  ☆154Updated 2 years ago
• hristo-vrigazov / mmap.ninja
  Memory mapped numpy arrays of varying shapes
  ☆291Updated 6 months ago
• lucidrains / memory-efficient-attention-pytorch
  Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attention Does Not Need O(n²) Memory"
  ☆370Updated last year
• zhuchen03 / gradinit
  Learning to Initialize Neural Networks for Stable and Efficient Training
  ☆138Updated 2 years ago
• lucidrains / nystrom-attention
  Implementation of Nyström Self-attention, from the paper Nyströmformer
  ☆124Updated 11 months ago
• lucidrains / pytorch-custom-utils
  Just some miscellaneous utility functions / decorators / modules related to Pytorch and Accelerate to help speed up implementation of new…
  ☆119Updated 5 months ago
• lucidrains / hourglass-transformer-pytorch
  Implementation of Hourglass Transformer, in Pytorch, from Google and OpenAI
  ☆84Updated 3 years ago
• pytorch / torcheval
  A library that contains a rich collection of performant PyTorch model metrics, a simple interface to create new metrics, a toolkit to fac…
  ☆224Updated last month
• yiyixuxu / denoising-diffusion-flax
  Implementing the Denoising Diffusion Probabilistic Model in Flax
  ☆144Updated 2 years ago
• kach / gradient-descent-the-ultimate-optimizer
  Code for our NeurIPS 2022 paper
  ☆366Updated 2 years ago
• krasserm / perceiver-io
  A PyTorch implementation of Perceiver, Perceiver IO and Perceiver AR with PyTorch Lightning scripts for distributed training
  ☆446Updated last year
• OATML / RHO-Loss
  ☆197Updated 2 years ago
• iejMac / video2numpy
  Optimized library for large-scale extraction of frames and audio from video.
  ☆202Updated last year