guanh01 / CS692-mlsys

Related projects: ⓘ

• spcl / substation
  Research and development for optimizing transformers
  ☆121Updated 3 years ago
• saareliad / FTPipe
  FTPipe and related pipeline model parallelism research.
  ☆41Updated last year
• jasperzhong / read-papers-and-code
  My paper/code reading notes in Chinese
  ☆44Updated 4 months ago
• DachengLi1 / AMP
  (NeurIPS 2022) Automatically finding good model-parallel strategies, especially for complex models and clusters.
  ☆33Updated last year
• parasj / checkmate
  Training neural networks in TensorFlow 2.0 with 5x less memory
  ☆127Updated 2 years ago
• YuhanLiu11 / AutoFreeze
  ☆22Updated 3 years ago
• awslabs / lorien
  ☆45Updated last year
• kanonjz / paper
  Machine Learning System
  ☆14Updated 4 years ago
• Harry-Chen / InfMoE
  Inference framework for MoE layers based on TensorRT with Python binding
  ☆41Updated 3 years ago
• thu-pacman / PET
  PET: Optimizing Tensor Programs with Partially Equivalent Transformations and Automated Corrections
  ☆112Updated 2 years ago
• uwsampl / dtr-prototype
  Dynamic Tensor Rematerialization prototype (modified PyTorch) and simulator. Paper: https://arxiv.org/abs/2006.09616
  ☆129Updated last year
• Hsword / Hetu
  A high-performance distributed deep learning system targeting large-scale and automated distributed training. If you have any interests, …
  ☆101Updated 9 months ago
• UofT-EcoSystem / Tempo
  Memory footprint reduction for transformer models
  ☆11Updated last year
• zhuohan123 / terapipe
  ☆62Updated 3 years ago
• facebookresearch / fairring
  Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …
  ☆61Updated 2 years ago
• Distributed-AI / PipeTransformer
  PipeTransformer: Automated Elastic Pipelining for Distributed Training of Large-scale Models. ICML 2021
  ☆54Updated 3 years ago
• netx-repo / PipeSwitch
  PipeSwitch: Fast Pipelined Context Switching for Deep Learning Applications
  ☆124Updated 2 years ago
• RulinShao / FastCkpt
  Python package for rematerialization-aware gradient checkpointing
  ☆22Updated 10 months ago
• byteps / examples
  BytePS examples (Vision, NLP, GAN, etc)
  ☆19Updated last year
• eedalong / Dpex
  Distributed DataLoader For Pytorch Based On Ray
  ☆24Updated 2 years ago
• dlsys10714 / notebooks
  ☆18Updated this week
• shriramsb / vdnn-plus-plus
  Implementation of vDNN++; an improvement over vDNN
  ☆16Updated 5 years ago
• cmu-catalyst / collage
  System for automated integration of deep learning backends.
  ☆48Updated 2 years ago
• msr-fiddle / harmony
  ☆14Updated last year
• stanford-futuredata / stk
  ☆83Updated 3 weeks ago
• facebookresearch / dlrm_datasets
  Set of datasets for the deep learning recommendation model (DLRM).
  ☆39Updated last year
• amazon-science / FeatGraph
  ☆71Updated 3 years ago
• HPDL-Group / Merak
  ☆68Updated 9 months ago
• microsoft / DeepSpeed-Kernels
  ☆50Updated 3 months ago
• UofT-EcoSystem / hotline
  ☆31Updated last year