Alternatives and similar repositories for PyTorchMemTracer:

Users that are interested in PyTorchMemTracer are comparing it to the libraries listed below

• zhuzilin / pytorch-malloc
  An external memory allocator example for PyTorch.
  ☆14Updated 3 years ago
• facebookresearch / fairring
  Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …
  ☆65Updated 3 years ago
• eedalong / Dpex
  Distributed DataLoader For Pytorch Based On Ray
  ☆24Updated 3 years ago
• megvii-research / IntLLaMA
  IntLLaMA: A fast and light quantization solution for LLaMA
  ☆18Updated last year
• L1aoXingyu / llm-infer-bench
  ☆11Updated last year
• feifeibear / PSTensor
  PSTensor provides a way to hack the memory management of tensors in TensorFlow and PyTorch by defining your own C++ Tensor Class.
  ☆10Updated 3 years ago
• megvii-research / basedet
  An object detection codebase based on MegEngine.
  ☆28Updated 2 years ago
• cli99 / flops-profiler
  pytorch-profiler
  ☆51Updated last year
• Oneflow-Inc / serving
  OneFlow Serving
  ☆20Updated last month
• ModelTC / awesome-lm-system
  Summary of system papers/frameworks/codes/tools on training or serving large model
  ☆56Updated last year
• megvii-research / Arch-Net
  Arch-Net: Model Distillation for Architecture Agnostic Model Deployment
  ☆22Updated 3 years ago
• NVlabs / SMCP
  ☆21Updated 2 years ago
• feifeibear / ChituAttention
  Quantized Attention on GPU
  ☆45Updated 5 months ago
• Distributed-AI / PipeTransformer
  PipeTransformer: Automated Elastic Pipelining for Distributed Training of Large-scale Models. ICML 2021
  ☆56Updated 3 years ago
• BBuf / oneflow-cifar
  ☆13Updated 2 years ago
• lucasjinreal / wnnx_models
  Various test models in WNNX format. It can view with `pip install wnetron && wnetron`
  ☆12Updated 2 years ago
• yuzhenmao / IceFormer
  Implementation of IceFormer: Accelerated Inference with Long-Sequence Transformers on CPUs (ICLR 2024).
  ☆25Updated 10 months ago
• YukeWang96 / DSXplore_IPDPS21
  Artifact for IPDPS'21: DSXplore: Optimizing Convolutional Neural Networks via Sliding-Channel Convolutions.
  ☆13Updated 4 years ago
• usyd-fsalab / NeuralNetworkRandomness
  ☆14Updated 3 years ago
• yanring / Megatron-MoE-ModelZoo
  Best practices for testing advanced Mixtral, DeepSeek, and Qwen series MoE models using Megatron Core MoE.
  ☆10Updated 2 weeks ago
• octoml / deformable-attention-kernel
  TVMScript kernel for deformable attention
  ☆25Updated 3 years ago
• LeiWang1999 / AutoGPTQ.tvm
  GPTQ inference TVM kernel
  ☆38Updated last year
• hangxu0304 / DeepReduce
  A Sparse-tensor Communication Framework for Distributed Deep Learning
  ☆13Updated 3 years ago
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆64Updated last year
• chips-compilers-mlsys-21 / chips-compilers-mlsys-21.github.io
  ☆11Updated 4 years ago
• feifeibear / Odysseus-Transformer
  Odysseus: Playground of LLM Sequence Parallelism
  ☆69Updated 10 months ago
• bytedance / QSync
  Official resporitory for "IPDPS' 24 QSync: Quantization-Minimized Synchronous Distributed Training Across Hybrid Devices".
  ☆20Updated last year
• chenjoya / dropit
  DropIT: Dropping Intermediate Tensors for Memory-Efficient DNN Training (ICLR 2023)
  ☆30Updated 2 years ago
• vedantroy / gpu_kernels
  ☆26Updated last year
• MingSun-Tse / Why-the-State-of-Pruning-so-Confusing
  [Preprint] Why is the State of Neural Network Pruning so Confusing? On the Fairness, Comparison Setup, and Trainability in Network Prunin…
  ☆40Updated 2 years ago