Stonesjtu / pytorch-learning

Related projects ⓘ

Alternatives and complementary repositories for pytorch-learning

• ray-project / distml
  Distributed ML Optimizer
  ☆31Updated 3 years ago
• lucidrains / triton-transformer
  Implementation of a Transformer, but completely in Triton
  ☆248Updated 2 years ago
• li-js / gpu_memory_profiling
  Profile the GPU memory usage of every line in a Pytorch code
  ☆82Updated 6 years ago
• clovaai / length-adaptive-transformer
  Official Pytorch Implementation of Length-Adaptive Transformer (ACL 2021)
  ☆100Updated 4 years ago
• mgmalek / efficient_cross_entropy
  ☆76Updated 5 months ago
• toshas / torch-discounted-cumsum
  Fast Discounted Cumulative Sums in PyTorch
  ☆95Updated 3 years ago
• Edward-Sun / gpt-accelera
  Simple and efficient pytorch-native transformer training and inference (batched)
  ☆61Updated 7 months ago
• allenai / sledgehammer
  ☆47Updated 4 years ago
• epfml / dynamic-sparse-flash-attention
  ☆132Updated last year
• pytorch-tpu / llama
  Inference code for LLaMA models
  ☆19Updated 5 months ago
• microsoft / mutransformers
  some common Huggingface transformers in maximal update parametrization (µP)
  ☆76Updated 2 years ago
• pytorch / torchdistx
  Torch Distributed Experimental
  ☆116Updated 3 months ago
• huggingface / block_movement_pruning
  Block Sparse movement pruning
  ☆78Updated 3 years ago
• HomebrewNLP / HomebrewNLP
  A case study of efficient training of large language models using commodity hardware.
  ☆68Updated 2 years ago
• xrsrke / pipegoose
  Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*
  ☆80Updated 10 months ago
• IBM / PoWER-BERT
  Method to improve inference time for BERT. This is an implementation of the paper titled "PoWER-BERT: Accelerating BERT Inference via Pro…
  ☆58Updated last year
• facebookresearch / fairring
  Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …
  ☆63Updated 2 years ago
• IST-DASLab / SparseFinetuning
  Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry
  ☆38Updated 9 months ago
• mit-han-lab / neurips-micronet
  [JMLR'20] NeurIPS 2019 MicroNet Challenge Efficient Language Modeling, Champion
  ☆40Updated 3 years ago
• tanyuqian / redco
  NAACL '24 (Best Demo Paper RunnerUp) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Training and Inference
  ☆60Updated 2 weeks ago
• shawntan / scattermoe
  Triton-based implementation of Sparse Mixture of Experts.
  ☆184Updated last month
• jungokasai / deep-shallow
  ☆42Updated 4 years ago
• RulinShao / LightSeq
  Official repository for LightSeq: Sequence Level Parallelism for Distributed Training of Long Context Transformers
  ☆196Updated 2 months ago
• xflash96 / pybind11_package_example
  Example python package with pybind11 cpp extension
  ☆57Updated 3 years ago
• krandiash / quinine
  A library to create and manage configuration files, especially for machine learning projects.
  ☆77Updated 2 years ago
• pytorch-labs / superblock
  A block oriented training approach for inference time optimization.
  ☆29Updated 2 months ago
• asappresearch / flop
  Pytorch library for factorized L0-based pruning.
  ☆43Updated last year
• eth-easl / fmengine
  Utilities for Training Very Large Models
  ☆56Updated last month