Alternatives and similar repositories for layer-to-layer-pytorch

Users that are interested in layer-to-layer-pytorch are comparing it to the libraries listed below

• utsaslab / MONeT
  MONeT framework for reducing memory consumption of DNN training
  ☆173Updated 4 years ago
• pytorch / torchdistx
  Torch Distributed Experimental
  ☆116Updated 10 months ago
• lucidrains / triton-transformer
  Implementation of a Transformer, but completely in Triton
  ☆268Updated 3 years ago
• ptillet / torch-blocksparse
  Block-sparse primitives for PyTorch
  ☆156Updated 4 years ago
• DeMoriarty / custom_matmul_kernels
  Customized matrix multiplication kernels
  ☆56Updated 3 years ago
• cybertronai / imagenet18
  Train ImageNet in 18 minutes on AWS
  ☆130Updated last year
• lmnt-com / graftr
  graftr: an interactive shell to view and edit PyTorch checkpoints.
  ☆113Updated 4 years ago
• yandex-research / DeDLOC
  Official code for "Distributed Deep Learning in Open Collaborations" (NeurIPS 2021)
  ☆116Updated 3 years ago
• MathInf / toroidal
  a lightweight transformer library for PyTorch
  ☆72Updated 3 years ago
• davda54 / ada-hessian
  Easy-to-use AdaHessian optimizer (PyTorch)
  ☆79Updated 4 years ago
• spcl / substation
  Research and development for optimizing transformers
  ☆129Updated 4 years ago
• adityaiitb / pyprof2
  PyProf2: PyTorch Profiling tool
  ☆82Updated 5 years ago
• kaiyuyue / torchshard
  Slicing a PyTorch Tensor Into Parallel Shards
  ☆299Updated 2 weeks ago
• parasj / checkmate
  Training neural networks in TensorFlow 2.0 with 5x less memory
  ☆131Updated 3 years ago
• t-vi / lod2021
  PyTorch Tutorial at the LOD2021 conference
  ☆21Updated 3 years ago
• sIncerass / powernorm
  [ICML 2020] code for "PowerNorm: Rethinking Batch Normalization in Transformers" https://arxiv.org/abs/2003.07845
  ☆120Updated 4 years ago
• facebookresearch / fairring
  Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …
  ☆65Updated 3 years ago
• mlcommons / training_results_v0.7
  This repository contains the results and code for the MLPerf™ Training v0.7 benchmark.
  ☆56Updated 2 years ago
• lucidrains / feedback-transformer-pytorch
  Implementation of Feedback Transformer in Pytorch
  ☆107Updated 4 years ago
• kshitij12345 / torchnnprofiler
  Context Manager to profile the forward and backward times of PyTorch's nn.Module
  ☆83Updated last year
• skolai / fewbit
  Compression schema for gradients of activations in backward pass
  ☆44Updated last year
• clovaai / length-adaptive-transformer
  Official Pytorch Implementation of Length-Adaptive Transformer (ACL 2021)
  ☆101Updated 4 years ago
• zhuchen03 / gradinit
  Learning to Initialize Neural Networks for Stable and Efficient Training
  ☆139Updated 3 years ago
• noahgolmant / pytorch-lars
  "Layer-wise Adaptive Rate Scaling" in PyTorch
  ☆87Updated 4 years ago
• huggingface / pytorch_block_sparse
  Fast Block Sparse Matrices for Pytorch
  ☆547Updated 4 years ago
• NVlabs / tensorcom
  ☆109Updated 4 years ago
• izmailovpavel / torch_swa_examples
  ☆47Updated 4 years ago
• marsupialtail / sparsednn
  Fast sparse deep learning on CPUs
  ☆53Updated 2 years ago
• pytorch / torchsnapshot
  A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…
  ☆157Updated this week
• pytorch-tpu / examples
  This repository contains example code to build models on TPUs
  ☆30Updated 2 years ago