Alternatives and similar repositories for RAM-multiprocess-dataloader:

Users that are interested in RAM-multiprocess-dataloader are comparing it to the libraries listed below

• kaiyuyue / torchshard
  Slicing a PyTorch Tensor Into Parallel Shards
  ☆298Updated 3 years ago
• PhilJd / contiguous_pytorch_params
  Accelerate training by storing parameters in one contiguous chunk of memory.
  ☆292Updated 4 years ago
• pytorch / torcheval
  A library that contains a rich collection of performant PyTorch model metrics, a simple interface to create new metrics, a toolkit to fac…
  ☆227Updated last month
• lucidrains / triton-transformer
  Implementation of a Transformer, but completely in Triton
  ☆259Updated 2 years ago
• lucidrains / flash-cosine-sim-attention
  Implementation of fused cosine similarity attention in the same style as Flash Attention
  ☆210Updated 2 years ago
• ucbrise / actnn
  ActNN: Reducing Training Memory Footprint via 2-Bit Activation Compressed Training
  ☆201Updated 2 years ago
• 1adrianb / pytorch-estimate-flops
  Estimate/count FLOPS for a given neural network using pytorch
  ☆304Updated 2 years ago
• facebookresearch / torchdim
  Named tensors with first-class dimensions for PyTorch
  ☆321Updated last year
• tmbdev-archive / webdataset-examples
  Examples for the WebDataset PyTorch Dataset Library
  ☆47Updated 3 years ago
• NVIDIA / transformer-ls
  Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).
  ☆225Updated 2 years ago
• frgfm / torch-scan
  Seamless analysis of your PyTorch models (RAM usage, FLOPs, MACs, receptive field, etc.)
  ☆217Updated this week
• kakaobrain / torchlars
  A LARS implementation in PyTorch
  ☆342Updated 5 years ago
• zhijian-liu / torchprofile
  A general and accurate MACs / FLOPs profiler for PyTorch models
  ☆599Updated 9 months ago
• lucidrains / memory-efficient-attention-pytorch
  Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attention Does Not Need O(n²) Memory"
  ☆370Updated last year
• NVIDIA / PyProf
  A GPU performance profiling tool for PyTorch models
  ☆501Updated 3 years ago
• pytorch-labs / float8_experimental
  This repository contains the experimental PyTorch native float8 training UX
  ☆221Updated 7 months ago
• jundaf2 / INT8-Flash-Attention-FMHA-Quantization
  ☆157Updated last year
• pytorch / torchdistx
  Torch Distributed Experimental
  ☆115Updated 6 months ago
• fuzihaofzh / cstl
  The C++ Standard Template Library (STL) for Python.
  ☆23Updated last year
• pytorch / multipy
  torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…
  ☆179Updated 2 months ago
• pytorch-labs / attention-gym
  Helpful tools and examples for working with flex-attention
  ☆662Updated last week
• facebookresearch / dropout
  Code release for "Dropout Reduces Underfitting"
  ☆312Updated last year
• DeMoriarty / TorchPQ
  Approximate nearest neighbor search with product quantization on GPU in pytorch and cuda
  ☆217Updated last year
• utsaslab / MONeT
  MONeT framework for reducing memory consumption of DNN training
  ☆174Updated 3 years ago
• ivan-chai / torch-linear-assignment
  Batch computation of the linear assignment problem on GPU.
  ☆65Updated last month
• zzd1992 / Image-Local-Attention
  A better PyTorch implementation of image local attention which reduces the GPU memory by an order of magnitude.
  ☆137Updated 3 years ago
• pytorch / hydra-torch
  Configuration classes enabling type-safe PyTorch configuration for Hydra apps
  ☆209Updated 2 years ago
• prigoyal / pytorch_memonger
  Experimental ground for optimizing memory of pytorch models
  ☆366Updated 6 years ago
• facebookresearch / SWAG
  Official repository for "Revisiting Weakly Supervised Pre-Training of Visual Perception Models". https://arxiv.org/abs/2201.08371.
  ☆178Updated 2 years ago
• tmbdev-archive / webdataset-lightning
  A small demonstration of using WebDataset with ImageNet and PyTorch Lightning
  ☆74Updated last year