ppwwyyxx / RAM-multiprocess-dataloader

Related projects ⓘ

Alternatives and complementary repositories for RAM-multiprocess-dataloader

• kaiyuyue / torchshard
  Slicing a PyTorch Tensor Into Parallel Shards
  ☆296Updated 3 years ago
• pytorch / torcheval
  A library that contains a rich collection of performant PyTorch model metrics, a simple interface to create new metrics, a toolkit to fac…
  ☆216Updated last week
• lucidrains / triton-transformer
  Implementation of a Transformer, but completely in Triton
  ☆249Updated 2 years ago
• kakaobrain / torchlars
  A LARS implementation in PyTorch
  ☆335Updated 4 years ago
• fuzihaofzh / cstl
  The C++ Standard Template Library (STL) for Python.
  ☆23Updated last year
• PhilJd / contiguous_pytorch_params
  Accelerate training by storing parameters in one contiguous chunk of memory.
  ☆291Updated 4 years ago
• lucidrains / flash-cosine-sim-attention
  Implementation of fused cosine similarity attention in the same style as Flash Attention
  ☆207Updated last year
• NVIDIA / PyProf
  A GPU performance profiling tool for PyTorch models
  ☆495Updated 3 years ago
• pytorch / kineto
  A CPU+GPU Profiling library that provides access to timeline traces and hardware performance counters.
  ☆734Updated this week
• zhijian-liu / torchprofile
  A general and accurate MACs / FLOPs profiler for PyTorch models
  ☆571Updated 6 months ago
• 1adrianb / pytorch-estimate-flops
  Estimate/count FLOPS for a given neural network using pytorch
  ☆304Updated 2 years ago
• pytorch-labs / attention-gym
  Helpful tools and examples for working with flex-attention
  ☆469Updated 3 weeks ago
• utsaslab / MONeT
  MONeT framework for reducing memory consumption of DNN training
  ☆173Updated 3 years ago
• lucidrains / memory-efficient-attention-pytorch
  Implementation of a memory efficient multi-head attention as proposed in the paper, "Self-attention Does Not Need O(n²) Memory"
  ☆360Updated last year
• jundaf2 / INT8-Flash-Attention-FMHA-Quantization
  ☆156Updated last year
• ivan-chai / torch-linear-assignment
  Batch computation of the linear assignment problem on GPU.
  ☆42Updated last week
• pytorch / PiPPy
  Pipeline Parallelism for PyTorch
  ☆726Updated 2 months ago
• NVIDIA / transformer-ls
  Official PyTorch Implementation of Long-Short Transformer (NeurIPS 2021).
  ☆222Updated 2 years ago
• facebookresearch / torchdim
  Named tensors with first-class dimensions for PyTorch
  ☆322Updated last year
• tmbdev-archive / webdataset-examples
  Examples for the WebDataset PyTorch Dataset Library
  ☆47Updated 3 years ago
• pytorch / multipy
  torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…
  ☆175Updated last week
• facebookresearch / dropout
  Code release for "Dropout Reduces Underfitting"
  ☆312Updated last year
• pytorch / nestedtensor
  [Prototype] Tools for the concurrent manipulation of variably sized Tensors.
  ☆253Updated 2 years ago
• facebookresearch / SWAG
  Official repository for "Revisiting Weakly Supervised Pre-Training of Visual Perception Models". https://arxiv.org/abs/2201.08371.
  ☆173Updated 2 years ago
• ucbrise / actnn
  ActNN: Reducing Training Memory Footprint via 2-Bit Activation Compressed Training
  ☆201Updated last year
• pytorch / torchdistx
  Torch Distributed Experimental
  ☆116Updated 3 months ago
• frgfm / torch-scan
  Seamless analysis of your PyTorch models (RAM usage, FLOPs, MACs, receptive field, etc.)
  ☆208Updated this week
• fadel / pytorch_ema
  Tiny PyTorch library for maintaining a moving average of a collection of parameters.
  ☆406Updated last month
• pytorch-labs / float8_experimental
  This repository contains the experimental PyTorch native float8 training UX
  ☆211Updated 3 months ago
• vra / flopth
  A simple program to calculate and visualize the FLOPs and Parameters of Pytorch models, with handy CLI and easy-to-use Python API.
  ☆119Updated 11 months ago