Alternatives and similar repositories for RAM-multiprocess-dataloader

Users that are interested in RAM-multiprocess-dataloader are comparing it to the libraries listed below

• kaiyuyue / torchshard
  Slicing a PyTorch Tensor Into Parallel Shards
  ☆299Updated 2 weeks ago
• pytorch / torcheval
  A library that contains a rich collection of performant PyTorch model metrics, a simple interface to create new metrics, a toolkit to fac…
  ☆233Updated 5 months ago
• lucidrains / triton-transformer
  Implementation of a Transformer, but completely in Triton
  ☆268Updated 3 years ago
• NVIDIA / PyProf
  A GPU performance profiling tool for PyTorch models
  ☆503Updated 3 years ago
• lucidrains / flash-cosine-sim-attention
  Implementation of fused cosine similarity attention in the same style as Flash Attention
  ☆214Updated 2 years ago
• frgfm / torch-scan
  Seamless analysis of your PyTorch models (RAM usage, FLOPs, MACs, receptive field, etc.)
  ☆218Updated 3 months ago
• PhilJd / contiguous_pytorch_params
  Accelerate training by storing parameters in one contiguous chunk of memory.
  ☆291Updated 4 years ago
• ucbrise / actnn
  ActNN: Reducing Training Memory Footprint via 2-Bit Activation Compressed Training
  ☆200Updated 2 years ago
• DeMoriarty / TorchPQ
  Approximate nearest neighbor search with product quantization on GPU in pytorch and cuda
  ☆225Updated last year
• pytorch / torchdistx
  Torch Distributed Experimental
  ☆116Updated 10 months ago
• kakaobrain / torchlars
  A LARS implementation in PyTorch
  ☆346Updated 5 years ago
• jundaf2 / INT8-Flash-Attention-FMHA-Quantization
  ☆157Updated last year
• zhijian-liu / torchprofile
  A general and accurate MACs / FLOPs profiler for PyTorch models
  ☆617Updated last year
• utsaslab / MONeT
  MONeT framework for reducing memory consumption of DNN training
  ☆173Updated 4 years ago
• pytorch-labs / float8_experimental
  This repository contains the experimental PyTorch native float8 training UX
  ☆224Updated 10 months ago
• pytorch / nestedtensor
  [Prototype] Tools for the concurrent manipulation of variably sized Tensors.
  ☆251Updated 2 years ago
• tmbdev-archive / webdataset-examples
  Examples for the WebDataset PyTorch Dataset Library
  ☆50Updated 4 years ago
• 1adrianb / pytorch-estimate-flops
  Estimate/count FLOPS for a given neural network using pytorch
  ☆304Updated 3 years ago
• fuzihaofzh / cstl
  The C++ Standard Template Library (STL) for Python.
  ☆23Updated last year
• pytorch / multipy
  torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…
  ☆180Updated 2 weeks ago
• NVIDIA / transformer-ls
  Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).
  ☆225Updated 3 years ago
• graphcore-research / unit-scaling
  A library for unit scaling in PyTorch
  ☆125Updated 6 months ago
• ivan-chai / torch-linear-assignment
  Batch computation of the linear assignment problem on GPU.
  ☆83Updated 4 months ago
• Lightning-AI / forked-pdb
  Python pdb for multiple processes
  ☆49Updated last month
• pytorch / torchsnapshot
  A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…
  ☆157Updated this week
• lucidrains / memory-efficient-attention-pytorch
  Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attention Does Not Need O(n²) Memory"
  ☆379Updated last year
• cli99 / flops-profiler
  pytorch-profiler
  ☆51Updated 2 years ago
• pytorch / kineto
  A CPU+GPU Profiling library that provides access to timeline traces and hardware performance counters.
  ☆821Updated this week
• facebookresearch / HolisticTraceAnalysis
  A library to analyze PyTorch traces.
  ☆391Updated last week
• tmbdev-archive / webdataset-lightning
  A small demonstration of using WebDataset with ImageNet and PyTorch Lightning
  ☆74Updated last year