Alternatives and similar repositories for learning-at-home

Users that are interested in learning-at-home are comparing it to the libraries listed below

• yandex-research / DeDLOC
  Official code for "Distributed Deep Learning in Open Collaborations" (NeurIPS 2021)
  ☆117Updated 3 years ago
• lucidrains / mlp-gpt-jax
  A GPT, made only of MLPs, in Jax
  ☆58Updated 4 years ago
• zhuchen03 / gradinit
  Learning to Initialize Neural Networks for Stable and Efficient Training
  ☆139Updated 3 years ago
• learning-at-home / lean_transformer
  Memory-efficient transformer. Work in progress.
  ☆19Updated 3 years ago
• lucidrains / isab-pytorch
  An implementation of (Induced) Set Attention Block, from the Set Transformers paper
  ☆61Updated 2 years ago
• HomebrewML / revlib
  Simple and efficient RevNet-Library for PyTorch with XLA and DeepSpeed support and parameter offload
  ☆129Updated 3 years ago
• Holmeswww / PPOGAN
  ☆25Updated last year
• learning-at-home / collaborative-latent-diffusion
  Collaborative inference of latent diffusion via hivemind
  ☆12Updated 2 years ago
• TomFrederik / grokking
  Re-implementation of 'Grokking: Generalization beyond overfitting on small algorithmic datasets'
  ☆38Updated 3 years ago
• lucidrains / token-shift-gpt
  Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing
  ☆50Updated 3 years ago
• princeton-nlp / DataMUX
  [NeurIPS 2022] DataMUX: Data Multiplexing for Neural Networks
  ☆60Updated 2 years ago
• yandex-research / moshpit-sgd
  "Moshpit SGD: Communication-Efficient Decentralized Training on Heterogeneous Unreliable Devices", official implementation
  ☆29Updated 7 months ago
• lucidrains / g-mlp-gpt
  GPT, but made only out of MLPs
  ☆89Updated 4 years ago
• Lightning-Universe / paper-AAVAE
  ☆47Updated 2 years ago
• lucidrains / feedback-transformer-pytorch
  Implementation of Feedback Transformer in Pytorch
  ☆107Updated 4 years ago
• lucidrains / product-key-memory
  Standalone Product Key Memory module in Pytorch - for augmenting Transformer models
  ☆82Updated last year
• sjunhongshen / DASH
  ☆23Updated 2 years ago
• sIncerass / powernorm
  [ICML 2020] code for "PowerNorm: Rethinking Batch Normalization in Transformers" https://arxiv.org/abs/2003.07845
  ☆120Updated 4 years ago
• lucidrains / panoptic-transformer
  Another attempt at a long-context / efficient transformer by me
  ☆38Updated 3 years ago
• RAIVNLab / supsup
  Code for "Supermasks in Superposition"
  ☆124Updated last year
• HomebrewML / HomebrewNLP-torch
  A case study of efficient training of large language models using commodity hardware.
  ☆68Updated 3 years ago
• learning-at-home / dalle-hivemind
  Training a model similar to OpenAI DALL-E with volunteers from all over the Internet using hivemind and dalle-pytorch (NeurIPS 2021 demo)
  ☆27Updated 2 years ago
• lucidrains / kronecker-attention-pytorch
  Implementation of Kronecker Attention in Pytorch
  ☆19Updated 5 years ago
• yedidh / glann
  Official code for paper "Non-Adversarial Image Synthesis with Generative Latent Nearest Neighbors"
  ☆28Updated 5 years ago
• RobertCsordas / transformer_generalization
  The official repository for our paper "The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers". We s…
  ☆67Updated 2 years ago
• EleutherAI / pyfra
  Python Research Framework
  ☆106Updated 2 years ago
• lucidrains / ponder-transformer
  Implementation of a Transformer that Ponders, using the scheme from the PonderNet paper
  ☆81Updated 3 years ago
• cybertronai / imagenet18
  Train ImageNet in 18 minutes on AWS
  ☆133Updated last year
• gcastex / PruNet
  Pruning applied to Facial Recognition.
  ☆15Updated 6 years ago
• AranKomat / Metroplex
  ☆21Updated 2 years ago