feifeibear / PyTorchMemTracer

Related projects ⓘ

Alternatives and complementary repositories for PyTorchMemTracer

• zhuzilin / pytorch-malloc
  An external memory allocator example for PyTorch.
  ☆13Updated 3 years ago
• feifeibear / PSTensor
  PSTensor provides a way to hack the memory management of tensors in TensorFlow and PyTorch by defining your own C++ Tensor Class.
  ☆10Updated 2 years ago
• facebookresearch / fairring
  Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …
  ☆63Updated 2 years ago
• eedalong / Dpex
  Distributed DataLoader For Pytorch Based On Ray
  ☆24Updated 3 years ago
• chips-compilers-mlsys-21 / chips-compilers-mlsys-21.github.io
  ☆11Updated 3 years ago
• jiazhihao / sosp19ae
  Artifacts for SOSP'19 paper Optimizing Deep Learning Computation with Automatic Generation of Graph Substitutions
  ☆21Updated 2 years ago
• yuzhenmao / IceFormer
  Implementation of IceFormer: Accelerated Inference with Long-Sequence Transformers on CPUs (ICLR 2024).
  ☆20Updated 5 months ago
• NVlabs / COAT
  ☆35Updated this week
• jiazhihao / attention_superoptimizer
  An Attention Superoptimizer
  ☆20Updated 6 months ago
• sgl-project / tensorrt-demo
  TensorRT LLM Benchmark Configuration
  ☆11Updated 3 months ago
• sjtu-epcc / Tacker
  Tacker: Tensor-CUDA Core Kernel Fusion for Improving the GPU Utilization while Ensuring QoS
  ☆17Updated 2 years ago
• megvii-research / IntLLaMA
  IntLLaMA: A fast and light quantization solution for LLaMA
  ☆18Updated last year
• mlcommons / logging
  MLPerf™ logging library
  ☆30Updated this week
• NVIDIA / HMM_sample_code
  CUDA 12.2 HMM demos
  ☆17Updated 3 months ago
• feifeibear / Odysseus-Transformer
  Odysseus: Playground of LLM Sequence Parallelism
  ☆57Updated 5 months ago
• L1aoXingyu / llm-infer-bench
  ☆11Updated last year
• ModelTC / awesome-lm-system
  Summary of system papers/frameworks/codes/tools on training or serving large model
  ☆56Updated 11 months ago
• cli99 / flops-profiler
  pytorch-profiler
  ☆50Updated last year
• bytedance / QSync
  Official resporitory for "IPDPS' 24 QSync: Quantization-Minimized Synchronous Distributed Training Across Hybrid Devices".
  ☆19Updated 9 months ago
• LeiWang1999 / AutoGPTQ.tvm
  GPTQ inference TVM kernel
  ☆36Updated 6 months ago
• octoml / deformable-attention-kernel
  TVMScript kernel for deformable attention
  ☆24Updated 2 years ago
• INT-FlashAttention2024 / INT-FlashAttention
  ☆47Updated 2 months ago
• Distributed-AI / PipeTransformer
  PipeTransformer: Automated Elastic Pipelining for Distributed Training of Large-scale Models. ICML 2021
  ☆55Updated 3 years ago
• Aleph-Alpha / NeurIPS-WANT-submission-efficient-parallelization-layouts
  ☆22Updated 11 months ago
• stepbuystep / LightNAS
  You Only Search Once: On Lightweight Differentiable Architecture Search for Resource-Constrained Embedded Platforms
  ☆10Updated last year
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆60Updated 8 months ago
• microsoft / DeepSpeed-Kernels
  ☆55Updated 6 months ago
• YukeWang96 / DSXplore_IPDPS21
  Artifact for IPDPS'21: DSXplore: Optimizing Convolutional Neural Networks via Sliding-Channel Convolutions.
  ☆13Updated 3 years ago