Alternatives and similar repositories for layer-to-layer-pytorch:

Users that are interested in layer-to-layer-pytorch are comparing it to the libraries listed below

• utsaslab / MONeT
  MONeT framework for reducing memory consumption of DNN training
  ☆173Updated 3 years ago
• cybertronai / imagenet18
  Train ImageNet in 18 minutes on AWS
  ☆129Updated last year
• DeMoriarty / custom_matmul_kernels
  Customized matrix multiplication kernels
  ☆54Updated 3 years ago
• ptillet / torch-blocksparse
  Block-sparse primitives for PyTorch
  ☆154Updated 3 years ago
• lucidrains / triton-transformer
  Implementation of a Transformer, but completely in Triton
  ☆263Updated 2 years ago
• MathInf / toroidal
  a lightweight transformer library for PyTorch
  ☆71Updated 3 years ago
• spcl / substation
  Research and development for optimizing transformers
  ☆125Updated 4 years ago
• yandex-research / DeDLOC
  Official code for "Distributed Deep Learning in Open Collaborations" (NeurIPS 2021)
  ☆116Updated 3 years ago
• davda54 / ada-hessian
  Easy-to-use AdaHessian optimizer (PyTorch)
  ☆77Updated 4 years ago
• huggingface / pytorch_block_sparse
  Fast Block Sparse Matrices for Pytorch
  ☆546Updated 4 years ago
• skolai / fewbit
  Compression schema for gradients of activations in backward pass
  ☆44Updated last year
• pytorch / torchdistx
  Torch Distributed Experimental
  ☆115Updated 7 months ago
• adityaiitb / pyprof2
  PyProf2: PyTorch Profiling tool
  ☆82Updated 4 years ago
• universome / loss-patterns
  Loss Patterns of Neural Networks
  ☆84Updated 3 years ago
• facebookresearch / fairring
  Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …
  ☆65Updated 3 years ago
• parasj / checkmate
  Training neural networks in TensorFlow 2.0 with 5x less memory
  ☆129Updated 3 years ago
• r0mainK / outperformer
  Code for scaling Transformers
  ☆26Updated 4 years ago
• kaiyuyue / torchshard
  Slicing a PyTorch Tensor Into Parallel Shards
  ☆298Updated 3 years ago
• stevenygd / SWALP
  Code for paper "SWALP: Stochastic Weight Averaging forLow-Precision Training".
  ☆62Updated 5 years ago
• facebookresearch / FBTT-Embedding
  This is a Tensor Train based compression library to compress sparse embedding tables used in large-scale machine learning models such as …
  ☆193Updated 2 years ago
• NVlabs / tensorcom
  ☆109Updated 3 years ago
• digantamisra98 / EvoNorm
  Unofficial PyTorch Implementation of EvoNorm
  ☆121Updated 3 years ago
• zhuchen03 / gradinit
  Learning to Initialize Neural Networks for Stable and Efficient Training
  ☆138Updated 2 years ago
• GATECH-EIC / Early-Bird-Tickets
  [ICLR 2020] Drawing Early-Bird Tickets: Toward More Efficient Training of Deep Networks
  ☆137Updated 4 years ago
• microsoft / infinibatch
  Efficient, check-pointed data loading for deep learning with massive data sets.
  ☆205Updated last year
• mit-han-lab / neurips-micronet
  [JMLR'20] NeurIPS 2019 MicroNet Challenge Efficient Language Modeling, Champion
  ☆40Updated 4 years ago
• pytorch / nestedtensor
  [Prototype] Tools for the concurrent manipulation of variably sized Tensors.
  ☆252Updated 2 years ago
• mit-han-lab / hardware-aware-transformers
  [ACL'20] HAT: Hardware-Aware Transformers for Efficient Natural Language Processing
  ☆331Updated 8 months ago
• mlcommons / training_results_v0.7
  This repository contains the results and code for the MLPerf™ Training v0.7 benchmark.
  ☆56Updated last year
• lucidrains / feedback-transformer-pytorch
  Implementation of Feedback Transformer in Pytorch
  ☆105Updated 4 years ago