rom1504 / gpu-tester

Related projects ⓘ

Alternatives and complementary repositories for gpu-tester

• rom1504 / python-template
  Simple python template
  ☆40Updated 6 months ago
• ronghanghu / vit_10b_fsdp_example
  See details in https://github.com/pytorch/xla/blob/r1.12/torch_xla/distributed/fsdp/README.md
  ☆23Updated last year
• cloneofsimo / min-fsdp
  ☆73Updated 4 months ago
• crowsonkb / cloob-training
  CLOOB training (JAX) and inference (JAX and PyTorch)
  ☆70Updated 2 years ago
• ClashLuke / tpucare
  Automatically take good care of your preemptible TPUs
  ☆32Updated last year
• sholtodouglas / scalingExperiments
  ☆57Updated 2 years ago
• HomebrewNLP / Olmax
  HomebrewNLP in JAX flavour for maintable TPU-Training
  ☆46Updated 10 months ago
• facebookresearch / spdl
  Scalable and Performant Data Loading
  ☆68Updated this week
• HomebrewNLP / HomebrewNLP
  A case study of efficient training of large language models using commodity hardware.
  ☆68Updated 2 years ago
• ClashLuke / HeavyBall
  Efficient optimizers
  ☆87Updated this week
• HomebrewNLP / revlib
  Simple and efficient RevNet-Library for PyTorch with XLA and DeepSpeed support and parameter offload
  ☆124Updated 2 years ago
• kingoflolz / CLIP_JAX
  Contrastive Language-Image Pretraining
  ☆143Updated 2 years ago
• mgmalek / efficient_cross_entropy
  ☆77Updated 5 months ago
• patil-suraj / vit-vqgan
  JAX implementation ViT-VQGAN
  ☆77Updated 2 years ago
• warner-benjamin / optimi
  Fast, Modern, Memory Efficient, and Low Precision PyTorch Optimizers
  ☆59Updated 4 months ago
• lucidrains / panoptic-transformer
  Another attempt at a long-context / efficient transformer by me
  ☆37Updated 2 years ago
• facebookresearch / torchdim
  Named tensors with first-class dimensions for PyTorch
  ☆322Updated last year
• arogozhnikov / eindex
  Multidimensional indexing for tensors
  ☆113Updated last year
• TomFrederik / grokking
  Re-implementation of 'Grokking: Generalization beyond overfitting on small algorithmic datasets'
  ☆38Updated 2 years ago
• huggingface / m4-logs
  M4 experiment logbook
  ☆56Updated last year
• lucidrains / hourglass-transformer-pytorch
  Implementation of Hourglass Transformer, in Pytorch, from Google and OpenAI
  ☆84Updated 2 years ago
• pytorch / maskedtensor
  MaskedTensors for PyTorch
  ☆38Updated 2 years ago
• graphcore-research / unit-scaling
  A library for unit scaling in PyTorch
  ☆105Updated 2 weeks ago
• crowsonkb / LDLM
  Latent Diffusion Language Models
  ☆67Updated last year
• AranKomat / Diff-DALLE
  ☆64Updated 3 years ago
• cloneofsimo / ezmup
  Simple implementation of muP, based on Spectral Condition for Feature Learning. The implementation is SGD only, dont use it for Adam
  ☆68Updated 3 months ago
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆72Updated 10 months ago
• ClashLuke / TrueGrad
  PyTorch interface for TrueGrad Optimizers
  ☆39Updated last year