rom1504 / gpu-tester

Related projects ⓘ

Alternatives and complementary repositories for gpu-tester

• cloneofsimo / min-fsdp
  ☆72Updated 4 months ago
• rom1504 / python-template
  Simple python template
  ☆40Updated 6 months ago
• crowsonkb / cloob-training
  CLOOB training (JAX) and inference (JAX and PyTorch)
  ☆70Updated 2 years ago
• ClashLuke / tpucare
  Automatically take good care of your preemptible TPUs
  ☆31Updated last year
• warner-benjamin / optimi
  Fast, Modern, Memory Efficient, and Low Precision PyTorch Optimizers
  ☆58Updated 3 months ago
• borisdayma / clip-jax
  Train vision models using JAX and 🤗 transformers
  ☆95Updated 2 weeks ago
• mgmalek / efficient_cross_entropy
  ☆76Updated 5 months ago
• HomebrewNLP / Olmax
  HomebrewNLP in JAX flavour for maintable TPU-Training
  ☆46Updated 9 months ago
• HomebrewNLP / HomebrewNLP
  A case study of efficient training of large language models using commodity hardware.
  ☆68Updated 2 years ago
• lucidrains / hourglass-transformer-pytorch
  Implementation of Hourglass Transformer, in Pytorch, from Google and OpenAI
  ☆84Updated 2 years ago
• huggingface / m4-logs
  M4 experiment logbook
  ☆56Updated last year
• sholtodouglas / scalingExperiments
  ☆56Updated 2 years ago
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆71Updated 9 months ago
• graphcore-research / unit-scaling
  A library for unit scaling in PyTorch
  ☆105Updated this week
• kingoflolz / CLIP_JAX
  Contrastive Language-Image Pretraining
  ☆143Updated 2 years ago
• HomebrewNLP / revlib
  Simple and efficient RevNet-Library for PyTorch with XLA and DeepSpeed support and parameter offload
  ☆124Updated 2 years ago
• patil-suraj / vit-vqgan
  JAX implementation ViT-VQGAN
  ☆77Updated 2 years ago
• ronghanghu / vit_10b_fsdp_example
  See details in https://github.com/pytorch/xla/blob/r1.12/torch_xla/distributed/fsdp/README.md
  ☆23Updated last year
• LAION-AI / Big-Interleaved-Dataset
  Big-Interleaved-Dataset
  ☆57Updated last year
• lucidrains / gated-state-spaces-pytorch
  Implementation of Gated State Spaces, from the paper "Long Range Language Modeling via Gated State Spaces", in Pytorch
  ☆94Updated last year
• ayaka14732 / jax-smi
  JAX Synergistic Memory Inspector
  ☆163Updated 3 months ago
• cat-state / tinypar
  ☆20Updated last year
• cloneofsimo / ezmup
  Simple implementation of muP, based on Spectral Condition for Feature Learning. The implementation is SGD only, dont use it for Adam
  ☆69Updated 3 months ago
• lucidrains / ponder-transformer
  Implementation of a Transformer that Ponders, using the scheme from the PonderNet paper
  ☆78Updated 3 years ago
• lucidrains / logavgexp-torch
  Implementation of LogAvgExp for Pytorch
  ☆32Updated 2 years ago
• microsoft / mutransformers
  some common Huggingface transformers in maximal update parametrization (µP)
  ☆76Updated 2 years ago
• jxbz / modula
  Scalable neural net training via automatic normalization in the modular norm.
  ☆118Updated 2 months ago
• lucidrains / discrete-key-value-bottleneck-pytorch
  Implementation of Discrete Key / Value Bottleneck, in Pytorch
  ☆87Updated last year
• ClashLuke / HeavyBall
  Efficient optimizers
  ☆42Updated this week