Alternatives and similar repositories for holodeck-pytorch

Users that are interested in holodeck-pytorch are comparing it to the libraries listed below

• crowsonkb / LDLM
  Latent Diffusion Language Models
  ☆70Updated 2 years ago
• lucidrains / quartic-transformer
  Exploring an idea where one forgets about efficiency and carries out attention across each edge of the nodes (tokens)
  ☆55Updated 9 months ago
• lucidrains / GAF-microbatch-pytorch
  Implementation of Gradient Agreement Filtering, from Chaubard et al. of Stanford, but for single machine microbatches, in Pytorch
  ☆25Updated 11 months ago
• crowsonkb / dice-mc
  DiCE: The Infinitely Differentiable Monte-Carlo Estimator
  ☆32Updated 2 years ago
• lucidrains / token-shift-gpt
  Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing
  ☆49Updated 3 years ago
• EleutherAI / rnngineering
  Engineering the state of RNN language models (Mamba, RWKV, etc.)
  ☆32Updated last year
• lucidrains / coordinate-descent-attention
  Implementation of an Attention layer where each head can attend to more than just one token, using coordinate descent to pick topk
  ☆47Updated 2 years ago
• crowsonkb / torch-dist-utils
  Utilities for PyTorch distributed
  ☆25Updated 10 months ago
• lucidrains / metaformer-gpt
  Implementation of Metaformer, but in an autoregressive manner
  ☆26Updated 3 years ago
• nshepperd / jaxtorch
  A JAX nn library
  ☆22Updated 4 months ago
• google-research / precondition
  ☆31Updated this week
• lucidrains / memory-editable-transformer
  My explorations into editing the knowledge and memories of an attention network
  ☆35Updated 3 years ago
• cloneofsimo / zeroshampoo
  ☆34Updated last year
• lucidrains / self-reasoning-tokens-pytorch
  Exploration into the proposed "Self Reasoning Tokens" by Felipe Bonetto
  ☆57Updated last year
• EleutherAI / training-jacobian
  ☆24Updated last year
• lucidrains / transformer-lm-gan
  Explorations into adversarial losses on top of autoregressive loss for language modeling
  ☆41Updated 3 weeks ago
• lucidrains / autoregressive-linear-attention-cuda
  CUDA implementation of autoregressive linear attention, with all the latest research findings
  ☆46Updated 2 years ago
• lucidrains / discrete-key-value-bottleneck-pytorch
  Implementation of Discrete Key / Value Bottleneck, in Pytorch
  ☆88Updated 2 years ago
• AranKomat / Metroplex
  ☆21Updated 2 years ago
• crypdick / timm-lr-scheduler-explorer
  A dashboard for exploring timm learning rate schedulers
  ☆19Updated last year
• lucidrains / gateloop-transformer
  Implementation of GateLoop Transformer in Pytorch and Jax
  ☆91Updated last year
• theAdamColton / ijepa-enhanced
  recipe for training fully-featured self supervised image jepa models
  ☆12Updated 7 months ago
• lucidrains / einops-exts
  Implementation of some personal helper functions for Einops, my most favorite tensor manipulation library ❤️
  ☆57Updated 3 years ago
• antofuller / configaformers
  A python library for highly configurable transformers - easing model architecture search and experimentation.
  ☆49Updated 4 years ago
• lucidrains / mlp-gpt-jax
  A GPT, made only of MLPs, in Jax
  ☆58Updated 4 years ago
• ColinQiyangLi / AdaCat
  AdaCat
  ☆49Updated 3 years ago
• lucidrains / mixture-of-attention
  Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts
  ☆121Updated last year
• eth-easl / fmengine
  Utilities for Training Very Large Models
  ☆58Updated last year
• crowsonkb / consistency-models
  A JAX implementation of the continuous time formulation of Consistency Models
  ☆85Updated 2 years ago
• data2ml / all-clip
  Load any clip model with a standardized interface
  ☆22Updated 2 months ago