Stonesjtu / pytorch-learning

Related projects ⓘ

Alternatives and complementary repositories for pytorch-learning

• ray-project / distml
  Distributed ML Optimizer
  ☆30Updated 3 years ago
• toshas / torch-discounted-cumsum
  Fast Discounted Cumulative Sums in PyTorch
  ☆95Updated 3 years ago
• HomebrewNLP / HomebrewNLP
  A case study of efficient training of large language models using commodity hardware.
  ☆68Updated 2 years ago
• clovaai / length-adaptive-transformer
  Official Pytorch Implementation of Length-Adaptive Transformer (ACL 2021)
  ☆100Updated 4 years ago
• mgmalek / efficient_cross_entropy
  ☆77Updated 5 months ago
• lucidrains / triton-transformer
  Implementation of a Transformer, but completely in Triton
  ☆248Updated 2 years ago
• pytorch-tpu / examples
  This repository contains example code to build models on TPUs
  ☆30Updated last year
• microsoft / mutransformers
  some common Huggingface transformers in maximal update parametrization (µP)
  ☆76Updated 2 years ago
• mit-han-lab / neurips-micronet
  [JMLR'20] NeurIPS 2019 MicroNet Challenge Efficient Language Modeling, Champion
  ☆40Updated 3 years ago
• lucidrains / token-shift-gpt
  Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing
  ☆47Updated 2 years ago
• krandiash / quinine
  A library to create and manage configuration files, especially for machine learning projects.
  ☆77Updated 2 years ago
• li-js / gpu_memory_profiling
  Profile the GPU memory usage of every line in a Pytorch code
  ☆82Updated 6 years ago
• pytorch / torchdistx
  Torch Distributed Experimental
  ☆116Updated 3 months ago
• stanford-futuredata / stk
  ☆88Updated 2 months ago
• yandex-research / DeDLOC
  Official code for "Distributed Deep Learning in Open Collaborations" (NeurIPS 2021)
  ☆116Updated 2 years ago
• JonasGeiping / linear_cross_entropy_loss
  A fusion of a linear layer and a cross entropy loss, written for pytorch in triton.
  ☆54Updated 3 months ago
• microsoft / varuna
  ☆237Updated 3 months ago
• SeanNaren / minGPT
  A minimal PyTorch Lightning OpenAI GPT w DeepSpeed Training!
  ☆110Updated last year
• epfml / dynamic-sparse-flash-attention
  ☆132Updated last year
• lucidrains / panoptic-transformer
  Another attempt at a long-context / efficient transformer by me
  ☆37Updated 2 years ago
• hadasah / btm
  ☆71Updated 6 months ago
• asappresearch / flop
  Pytorch library for factorized L0-based pruning.
  ☆43Updated last year
• sholtodouglas / scalingExperiments
  ☆57Updated 2 years ago
• spcl / substation
  Research and development for optimizing transformers
  ☆125Updated 3 years ago
• lucaslingle / mu_transformer
  Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.
  ☆29Updated 2 weeks ago
• lucidrains / ponder-transformer
  Implementation of a Transformer that Ponders, using the scheme from the PonderNet paper
  ☆79Updated 3 years ago
• Edward-Sun / gpt-accelera
  Simple and efficient pytorch-native transformer training and inference (batched)
  ☆61Updated 7 months ago
• IST-DASLab / SparseFinetuning
  Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry
  ☆38Updated 10 months ago