Alternatives and similar repositories for RAM-multiprocess-dataloader

Users that are interested in RAM-multiprocess-dataloader are comparing it to the libraries listed below

• kaiyuyue / torchshard
  Slicing a PyTorch Tensor Into Parallel Shards
  ☆298Updated 3 years ago
• pytorch / torcheval
  A library that contains a rich collection of performant PyTorch model metrics, a simple interface to create new metrics, a toolkit to fac…
  ☆228Updated 3 months ago
• PhilJd / contiguous_pytorch_params
  Accelerate training by storing parameters in one contiguous chunk of memory.
  ☆291Updated 4 years ago
• lucidrains / flash-cosine-sim-attention
  Implementation of fused cosine similarity attention in the same style as Flash Attention
  ☆213Updated 2 years ago
• lucidrains / triton-transformer
  Implementation of a Transformer, but completely in Triton
  ☆265Updated 3 years ago
• lucidrains / memory-efficient-attention-pytorch
  Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attention Does Not Need O(n²) Memory"
  ☆378Updated last year
• zhijian-liu / torchprofile
  A general and accurate MACs / FLOPs profiler for PyTorch models
  ☆604Updated last year
• pytorch-labs / attention-gym
  Helpful tools and examples for working with flex-attention
  ☆766Updated last week
• pytorch-labs / float8_experimental
  This repository contains the experimental PyTorch native float8 training UX
  ☆224Updated 9 months ago
• fuzihaofzh / cstl
  The C++ Standard Template Library (STL) for Python.
  ☆23Updated last year
• 1adrianb / pytorch-estimate-flops
  Estimate/count FLOPS for a given neural network using pytorch
  ☆303Updated 2 years ago
• prigoyal / pytorch_memonger
  Experimental ground for optimizing memory of pytorch models
  ☆365Updated 7 years ago
• facebookresearch / torchdim
  Named tensors with first-class dimensions for PyTorch
  ☆320Updated last year
• ucbrise / actnn
  ActNN: Reducing Training Memory Footprint via 2-Bit Activation Compressed Training
  ☆200Updated 2 years ago
• pytorch / torchdistx
  Torch Distributed Experimental
  ☆115Updated 9 months ago
• jundaf2 / INT8-Flash-Attention-FMHA-Quantization
  ☆158Updated last year
• kakaobrain / torchlars
  A LARS implementation in PyTorch
  ☆345Updated 5 years ago
• frgfm / torch-scan
  Seamless analysis of your PyTorch models (RAM usage, FLOPs, MACs, receptive field, etc.)
  ☆218Updated last month
• NVIDIA / PyProf
  A GPU performance profiling tool for PyTorch models
  ☆504Updated 3 years ago
• tmbdev-archive / webdataset-examples
  Examples for the WebDataset PyTorch Dataset Library
  ☆49Updated 3 years ago
• pytorch / torchsnapshot
  A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…
  ☆157Updated 5 months ago
• NVIDIA / transformer-ls
  Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).
  ☆225Updated 3 years ago
• pytorch / PiPPy
  Pipeline Parallelism for PyTorch
  ☆765Updated 8 months ago
• pytorch / multipy
  torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…
  ☆180Updated 5 months ago
• jianweif / OptimalGradCheckpointing
  ☆40Updated 3 years ago
• DeMoriarty / TorchPQ
  Approximate nearest neighbor search with product quantization on GPU in pytorch and cuda
  ☆223Updated last year
• richardkxu / distributed-pytorch
  Distributed, mixed-precision training with PyTorch
  ☆90Updated 4 years ago
• facebookresearch / HolisticTraceAnalysis
  A library to analyze PyTorch traces.
  ☆370Updated this week
• fadel / pytorch_ema
  Tiny PyTorch library for maintaining a moving average of a collection of parameters.
  ☆428Updated 7 months ago
• facebookresearch / dropout
  Code release for "Dropout Reduces Underfitting"
  ☆313Updated 2 years ago