Alternatives and similar repositories for PyTorchMemTracer:

Users that are interested in PyTorchMemTracer are comparing it to the libraries listed below

• facebookresearch / fairring
  Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …
  ☆65Updated 3 years ago
• zhuzilin / pytorch-malloc
  An external memory allocator example for PyTorch.
  ☆14Updated 3 years ago
• eedalong / Dpex
  Distributed DataLoader For Pytorch Based On Ray
  ☆24Updated 3 years ago
• L1aoXingyu / llm-infer-bench
  ☆11Updated last year
• megvii-research / IntLLaMA
  IntLLaMA: A fast and light quantization solution for LLaMA
  ☆18Updated last year
• feifeibear / PSTensor
  PSTensor provides a way to hack the memory management of tensors in TensorFlow and PyTorch by defining your own C++ Tensor Class.
  ☆10Updated 3 years ago
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆62Updated last year
• Distributed-AI / PipeTransformer
  PipeTransformer: Automated Elastic Pipelining for Distributed Training of Large-scale Models. ICML 2021
  ☆56Updated 3 years ago
• yuzhenmao / IceFormer
  Implementation of IceFormer: Accelerated Inference with Long-Sequence Transformers on CPUs (ICLR 2024).
  ☆23Updated 9 months ago
• chips-compilers-mlsys-21 / chips-compilers-mlsys-21.github.io
  ☆11Updated 4 years ago
• ziplab / QLLM
  [ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Mod…
  ☆26Updated last year
• feifeibear / Odysseus-Transformer
  Odysseus: Playground of LLM Sequence Parallelism
  ☆68Updated 9 months ago
• ModelTC / awesome-lm-system
  Summary of system papers/frameworks/codes/tools on training or serving large model
  ☆56Updated last year
• feifeibear / ChituAttention
  Quantized Attention on GPU
  ☆45Updated 4 months ago
• rayleizhu / vllm-ra
  [ACL 2024] RelayAttention for Efficient Large Language Model Serving with Long System Prompts
  ☆39Updated last year
• Aleph-Alpha / NeurIPS-WANT-submission-efficient-parallelization-layouts
  ☆22Updated last year
• cli99 / flops-profiler
  pytorch-profiler
  ☆51Updated last year
• vedantroy / gpu_kernels
  ☆25Updated last year
• tensorchord / inference-benchmark
  Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)
  ☆28Updated last year
• merrymercy / Awesome-Efficient-LLM
  A curated list for Efficient Large Language Models
  ☆11Updated last year
• megvii-research / Arch-Net
  Arch-Net: Model Distillation for Architecture Agnostic Model Deployment
  ☆22Updated 3 years ago
• bytedance / QSync
  Official resporitory for "IPDPS' 24 QSync: Quantization-Minimized Synchronous Distributed Training Across Hybrid Devices".
  ☆19Updated last year
• YukeWang96 / DSXplore_IPDPS21
  Artifact for IPDPS'21: DSXplore: Optimizing Convolutional Neural Networks via Sliding-Channel Convolutions.
  ☆13Updated 4 years ago
• great8nctu / FOX-NAS
  FOX-NAS: Fast, On-device and Explainable NeuralArchitecture Search
  ☆10Updated 3 years ago
• bojone / softtopk
  differentiable top-k operator
  ☆21Updated 3 months ago
• jianweif / OptimalGradCheckpointing
  ☆40Updated 3 years ago
• BBuf / flash-rwkv
  ☆30Updated 10 months ago
• TiledTensor / TiledBench
  Benchmark tests supporting the TiledCUDA library.
  ☆16Updated 4 months ago
• IBM / triton-dejavu
  Framework to reduce autotune overhead to zero for well known deployments.
  ☆63Updated this week
• Oneflow-Inc / serving
  OneFlow Serving
  ☆20Updated this week