Alternatives and similar repositories for PyTorchMemTracer

Users that are interested in PyTorchMemTracer are comparing it to the libraries listed below

• facebookresearch / fairring
  Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …
  ☆65Updated 3 years ago
• zhuzilin / pytorch-malloc
  An external memory allocator example for PyTorch.
  ☆14Updated 3 years ago
• L1aoXingyu / llm-infer-bench
  ☆11Updated last year
• eedalong / Dpex
  Distributed DataLoader For Pytorch Based On Ray
  ☆24Updated 3 years ago
• YukeWang96 / DSXplore_IPDPS21
  Artifact for IPDPS'21: DSXplore: Optimizing Convolutional Neural Networks via Sliding-Channel Convolutions.
  ☆13Updated 4 years ago
• ModelTC / awesome-lm-system
  Summary of system papers/frameworks/codes/tools on training or serving large model
  ☆57Updated last year
• cli99 / flops-profiler
  pytorch-profiler
  ☆51Updated 2 years ago
• megvii-research / basedet
  An object detection codebase based on MegEngine.
  ☆28Updated 2 years ago
• feifeibear / PSTensor
  PSTensor provides a way to hack the memory management of tensors in TensorFlow and PyTorch by defining your own C++ Tensor Class.
  ☆10Updated 3 years ago
• BBuf / oneflow-cifar
  ☆13Updated 2 years ago
• megvii-research / IntLLaMA
  IntLLaMA: A fast and light quantization solution for LLaMA
  ☆18Updated last year
• Distributed-AI / PipeTransformer
  PipeTransformer: Automated Elastic Pipelining for Distributed Training of Large-scale Models. ICML 2021
  ☆56Updated 3 years ago
• megvii-research / Arch-Net
  Arch-Net: Model Distillation for Architecture Agnostic Model Deployment
  ☆23Updated 3 years ago
• octoml / deformable-attention-kernel
  TVMScript kernel for deformable attention
  ☆25Updated 3 years ago
• Oneflow-Inc / one-fx
  A toolkit for developers to simplify the transformation of nn.Module instances. It's now corresponding to Pytorch.fx.
  ☆13Updated 2 years ago
• NVlabs / SMCP
  ☆21Updated 2 years ago
• Oneflow-Inc / serving
  OneFlow Serving
  ☆20Updated 2 months ago
• feifeibear / ChituAttention
  Quantized Attention on GPU
  ☆44Updated 7 months ago
• feifeibear / Odysseus-Transformer
  Odysseus: Playground of LLM Sequence Parallelism
  ☆70Updated last year
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆64Updated last year
• yuzhenmao / IceFormer
  Implementation of IceFormer: Accelerated Inference with Long-Sequence Transformers on CPUs (ICLR 2024).
  ☆25Updated last year
• LeiWang1999 / AutoGPTQ.tvm
  GPTQ inference TVM kernel
  ☆40Updated last year
• vedantroy / gpu_kernels
  ☆26Updated last year
• Oneflow-Inc / oneflow-lite
  ☆18Updated last year
• hpcaitech / Elixir
  Elixir: Train a Large Language Model on a Small GPU Cluster
  ☆15Updated 2 years ago
• tile-ai / TileAttention
  ☆39Updated this week
• lucasjinreal / wnnx_models
  Various test models in WNNX format. It can view with `pip install wnetron && wnetron`
  ☆12Updated 3 years ago
• ModelTC / pyvlova
  Yet another Polyhedra Compiler for DeepLearning
  ☆19Updated 2 years ago
• jiazhihao / attention_superoptimizer
  An Attention Superoptimizer
  ☆21Updated 5 months ago
• bytedance / QSync
  Official resporitory for "IPDPS' 24 QSync: Quantization-Minimized Synchronous Distributed Training Across Hybrid Devices".
  ☆20Updated last year