Alternatives and similar repositories for platonic-rep:

Users that are interested in platonic-rep are comparing it to the libraries listed below

• Haiyang-W / TokenFormer
  [ICLR2025 Spotlight🔥] Official Implementation of TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parameters
  ☆514Updated last week
• openai / sparse_autoencoder
  ☆421Updated 7 months ago
• louaaron / Score-Entropy-Discrete-Diffusion
  [ICML 2024 Best Paper] Discrete Diffusion Modeling by Estimating the Ratios of the Data Distribution (https://arxiv.org/abs/2310.16834)
  ☆475Updated 11 months ago
• ekinakyurek / marc
  Public repository for "The Surprising Effectiveness of Test-Time Training for Abstract Reasoning"
  ☆291Updated 3 months ago
• test-time-training / ttt-lm-jax
  Official JAX implementation of Learning to (Learn at Test Time): RNNs with Expressive Hidden States
  ☆397Updated 6 months ago
• srush / annotated-mamba
  Annotated version of the Mamba paper
  ☆473Updated 11 months ago
• lucidrains / ring-attention-pytorch
  Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch
  ☆502Updated 3 months ago
• facebookresearch / memory
  Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…
  ☆297Updated 2 months ago
• jzhang38 / LongMamba
  Some preliminary explorations of Mamba's context scaling.
  ☆213Updated last year
• HazyResearch / m2
  Repo for "Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture"
  ☆547Updated last month
• soniajoseph / ViT-Prisma
  ViT Prisma is a mechanistic interpretability library for Vision Transformers (ViTs).
  ☆205Updated this week
• pytorch-labs / attention-gym
  Helpful tools and examples for working with flex-attention
  ☆647Updated this week
• zyushun / Adam-mini
  Code for Adam-mini: Use Fewer Learning Rates To Gain More https://arxiv.org/abs/2406.16793
  ☆385Updated 2 months ago
• apple / ml-sigmoid-attention
  ☆253Updated 5 months ago
• lucidrains / st-moe-pytorch
  Implementation of ST-Moe, the latest incarnation of MoE after years of research at Brain, in Pytorch
  ☆306Updated 8 months ago
• kuleshov-group / mdlm
  Simplified Masked Diffusion Language Model
  ☆273Updated 2 months ago
• microsoft / rho
  Repo for Rho-1: Token-level Data Selection & Selective Pretraining of LLMs.
  ☆398Updated 10 months ago
• buoyancy99 / diffusion-forcing
  code for "Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusion"
  ☆730Updated this week
• EleutherAI / sparsify
  Sparsify transformers with SAEs and transcoders
  ☆464Updated this week
• lucidrains / nGPT-pytorch
  Quick implementation of nGPT, learning entirely on the hypersphere, from NvidiaAI
  ☆273Updated 3 months ago
• KellerJordan / Muon
  Muon optimizer: +~30% sample efficiency with <3% wallclock overhead
  ☆254Updated last week
• lucidrains / PEER-pytorch
  Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmind
  ☆118Updated 5 months ago
• mlfoundations / open_lm
  A repository for research on medium sized language models.
  ☆491Updated last month
• NVlabs / DoRA
  [ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation
  ☆717Updated 4 months ago
• GFNOrg / gfn-lm-tuning
  ☆171Updated last year
• wesg52 / world-models
  Extracting spatial and temporal world models from LLMs
  ☆249Updated last year
• srush / awesome-o1
  A bibliography and survey of the papers surrounding o1
  ☆1,160Updated 3 months ago