Alternatives and similar repositories for wandview

Users that are interested in wandview are comparing it to the libraries listed below

• lucidrains / pytorch-custom-utils
  Just some miscellaneous utility functions / decorators / modules related to Pytorch and Accelerate to help speed up implementation of new…
  ☆123Updated last year
• lucidrains / taylor-series-linear-attention
  Explorations into the recently proposed Taylor Series Linear Attention
  ☆99Updated last year
• cloneofsimo / min-fsdp
  ☆91Updated last year
• lucidrains / grokfast-pytorch
  Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"
  ☆103Updated 10 months ago
• ClashLuke / tpucare
  Automatically take good care of your preemptible TPUs
  ☆37Updated 2 years ago
• cloneofsimo / min-max-gpt
  Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training
  ☆132Updated last year
• lucidrains / autoregressive-linear-attention-cuda
  CUDA implementation of autoregressive linear attention, with all the latest research findings
  ☆45Updated 2 years ago
• apoorvkh / torchrunx
  Easily run PyTorch on multiple GPUs & machines
  ☆47Updated this week
• lucidrains / mixture-of-attention
  Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts
  ☆119Updated last year
• lucidrains / GAF-microbatch-pytorch
  Implementation of Gradient Agreement Filtering, from Chaubard et al. of Stanford, but for single machine microbatches, in Pytorch
  ☆25Updated 9 months ago
• lucidrains / infini-transformer-pytorch
  Implementation of Infini-Transformer in Pytorch
  ☆113Updated 9 months ago
• warner-benjamin / optimi
  Fast, Modern, and Low Precision PyTorch Optimizers
  ☆116Updated last month
• matthias-wright / jax-fid
  FID computation in Jax/Flax.
  ☆28Updated last year
• lucidrains / llama-qrlhf
  Implementation of the Llama architecture with RLHF + Q-learning
  ☆167Updated 9 months ago
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆80Updated last year
• crowsonkb / torch-dist-utils
  Utilities for PyTorch distributed
  ☆25Updated 8 months ago
• andravin / spio
  Memory-Efficient CUDA kernels for training ConvNets with PyTorch.
  ☆42Updated 8 months ago
• cloneofsimo / zeroshampoo
  ☆34Updated last year
• huggingface / chug
  Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.
  ☆159Updated last year
• graphcore-research / unit-scaling
  A library for unit scaling in PyTorch
  ☆132Updated 3 months ago
• lucidrains / transformer-lm-gan
  Explorations into adversarial losses on top of autoregressive loss for language modeling
  ☆38Updated 8 months ago
• HomebrewML / TrueGrad
  PyTorch interface for TrueGrad Optimizers
  ☆43Updated 2 years ago
• epfml / DenseFormer
  ☆81Updated last year
• softmax1 / Flash-Attention-Softmax-N
  CUDA and Triton implementations of Flash Attention with SoftmaxN.
  ☆73Updated last year
• HomebrewML / Olmax
  HomebrewNLP in JAX flavour for maintable TPU-Training
  ☆51Updated last year
• ml-gde / jflux
  JAX Implementation of Black Forest Labs' Flux.1 family of models
  ☆39Updated last month
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆48Updated last year
• drisspg / transformer_nuggets
  A place to store reusable transformer components of my own creation or found on the interwebs
  ☆59Updated 2 weeks ago
• eth-easl / fmengine
  Utilities for Training Very Large Models
  ☆58Updated last year
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆64Updated last year