Alternatives and similar repositories for picogpt

Users that are interested in picogpt are comparing it to the libraries listed below

• BlackHC / neural_net_checklist
  ☆214Updated last year
• Sohl-Dickstein / fractal
  The boundary of neural network trainability is fractal
  ☆221Updated last year
• KindXiaoming / grow-crystals
  Getting crystal-like representations with harmonic loss
  ☆194Updated 9 months ago
• dvruette / barrel-rec-pytorch
  ☆53Updated last year
• evanatyourservice / kron_torch
  An implementation of PSGD Kron second-order optimizer for PyTorch
  ☆97Updated 5 months ago
• riverstone496 / awesome-second-order-optimization
  ☆27Updated 3 months ago
• lucidrains / grokfast-pytorch
  Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"
  ☆103Updated last year
• Artur-Galstyan / statedict2pytree
  ☆44Updated 2 months ago
• idiap / sigma-gpt
  σ-GPT: A New Approach to Autoregressive Models
  ☆70Updated last year
• ludocomito / learning-diffusion
  A practical guide to diffusion models, implemented from scratch.
  ☆232Updated last week
• okarthikb / state-space-models
  ☆27Updated last year
• lucidrains / GAF-microbatch-pytorch
  Implementation of Gradient Agreement Filtering, from Chaubard et al. of Stanford, but for single machine microbatches, in Pytorch
  ☆25Updated 11 months ago
• apoorvkh / academic-pretraining
  $100K or 100 Days: Trade-offs when Pre-Training with Academic Resources
  ☆149Updated 3 months ago
• keyonvafa / world-model-evaluation
  ☆75Updated last year
• epfml / DenseFormer
  ☆82Updated last year
• joey00072 / microjax
  Jax like function transformation engine but micro, microjax
  ☆34Updated last year
• cloneofsimo / zeroshampoo
  ☆34Updated last year
• apple / ml-pararnn
  ☆158Updated 2 months ago
• srush / Tensor-Puzzles-Penzai
  ☆21Updated last year
• AhmedImtiazPrio / grok-adversarial
  Deep Networks Grok All the Time and Here is Why
  ☆38Updated last year
• cgarciae / einop
  ☆60Updated 3 years ago
• vtabbott / Algebraic-NCD
  A package for defining deep learning models using categorical algebraic expressions.
  ☆61Updated last year
• cloneofsimo / min-max-gpt
  Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training
  ☆132Updated last year
• main-horse / hnet-old
  H-Net Dynamic Hierarchical Architecture
  ☆80Updated 4 months ago
• CLAIRE-Labo / flash_attention
  A basic pure pytorch implementation of flash attention
  ☆16Updated last year
• jfpuget / ARC-AGI-Challenge-2024
  ☆56Updated last year
• edwardmilsom / function-space-learning-rates-paper
  Code for the paper "Function-Space Learning Rates"
  ☆23Updated 7 months ago
• itsdaniele / jeometric
  Graph neural networks in JAX.
  ☆68Updated last year
• shikaiqiu / compute-better-spent
  ☆62Updated last year
• probabilists / azula
  Diffusion models in PyTorch
  ☆120Updated this week