Alternatives and similar repositories for pytorch-learning

Users that are interested in pytorch-learning are comparing it to the libraries listed below

• microsoft / infinibatch
  Efficient, check-pointed data loading for deep learning with massive data sets.
  ☆208Updated 2 years ago
• lucidrains / triton-transformer
  Implementation of a Transformer, but completely in Triton
  ☆273Updated 3 years ago
• toshas / torch-discounted-cumsum
  Fast Discounted Cumulative Sums in PyTorch
  ☆96Updated 3 years ago
• microsoft / varuna
  ☆251Updated last year
• spcl / substation
  Research and development for optimizing transformers
  ☆129Updated 4 years ago
• li-js / gpu_memory_profiling
  Profile the GPU memory usage of every line in a Pytorch code
  ☆83Updated 7 years ago
• ray-project / distml
  Distributed ML Optimizer
  ☆32Updated 4 years ago
• SeanNaren / minGPT
  A minimal PyTorch Lightning OpenAI GPT w DeepSpeed Training!
  ☆112Updated 2 years ago
• pytorch / torchdistx
  Torch Distributed Experimental
  ☆117Updated last year
• pytorch / torchsnapshot
  A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…
  ☆158Updated last month
• teddykoker / tinyloader
  ☆66Updated 4 months ago
• yandex-research / DeDLOC
  Official code for "Distributed Deep Learning in Open Collaborations" (NeurIPS 2021)
  ☆117Updated 3 years ago
• HomebrewML / HomebrewNLP-torch
  A case study of efficient training of large language models using commodity hardware.
  ☆68Updated 3 years ago
• mgmalek / efficient_cross_entropy
  ☆114Updated last year
• Lightning-AI / forked-pdb
  Python pdb for multiple processes
  ☆51Updated 2 months ago
• Sea-Snell / JAXSeq
  Train very large language models in Jax.
  ☆206Updated last year
• google / praxis
  ☆187Updated last week
• google / flaxformer
  ☆361Updated last year
• XuezheMax / fairseq-apollo
  FairSeq repo with Apollo optimizer
  ☆114Updated last year
• clovaai / length-adaptive-transformer
  Official Pytorch Implementation of Length-Adaptive Transformer (ACL 2021)
  ☆101Updated 4 years ago
• epfml / dynamic-sparse-flash-attention
  ☆147Updated 2 years ago
• tnq177 / transformers_without_tears
  Transformers without Tears: Improving the Normalization of Self-Attention
  ☆132Updated last year
• microsoft / mutransformers
  some common Huggingface transformers in maximal update parametrization (µP)
  ☆82Updated 3 years ago
• TezRomacH / layer-to-layer-pytorch
  PyTorch implementation of L2L execution algorithm
  ☆107Updated 2 years ago
• pytorch-tpu / examples
  This repository contains example code to build models on TPUs
  ☆30Updated 2 years ago
• ronghanghu / vit_10b_fsdp_example
  See details in https://github.com/pytorch/xla/blob/r1.12/torch_xla/distributed/fsdp/README.md
  ☆24Updated 2 years ago
• kshitij12345 / torchnnprofiler
  Context Manager to profile the forward and backward times of PyTorch's nn.Module
  ☆83Updated last year
• parasj / checkmate
  Training neural networks in TensorFlow 2.0 with 5x less memory
  ☆132Updated 3 years ago
• Edward-Sun / gpt-accelera
  Simple and efficient pytorch-native transformer training and inference (batched)
  ☆78Updated last year
• ptillet / torch-blocksparse
  Block-sparse primitives for PyTorch
  ☆157Updated 4 years ago