Alternatives and similar repositories for picogpt

Users that are interested in picogpt are comparing it to the libraries listed below

• joey00072 / microjax
  Jax like function transformation engine but micro, microjax
  ☆33Updated last year
• Sohl-Dickstein / fractal
  The boundary of neural network trainability is fractal
  ☆221Updated last year
• KindXiaoming / grow-crystals
  Getting crystal-like representations with harmonic loss
  ☆192Updated 8 months ago
• vtabbott / Algebraic-NCD
  A package for defining deep learning models using categorical algebraic expressions.
  ☆61Updated last year
• BlackHC / neural_net_checklist
  ☆211Updated last year
• ludocomito / learning-diffusion
  A practical guide to diffusion models, implemented from scratch.
  ☆164Updated this week
• Artur-Galstyan / statedict2pytree
  ☆44Updated last month
• yobibyte / report
  Because we don't want a jupyter notebook mess...
  ☆61Updated 6 months ago
• dvruette / barrel-rec-pytorch
  ☆53Updated last year
• evanatyourservice / kron_torch
  An implementation of PSGD Kron second-order optimizer for PyTorch
  ☆97Updated 4 months ago
• lucidrains / grokfast-pytorch
  Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"
  ☆103Updated 11 months ago
• Francesco215 / autoregressive_diffusion
  Video Diffusion Model. Autoregressive, long context, efficient training and inference. WIP
  ☆34Updated 3 months ago
• lucidrains / spline-based-transformer
  Implementation of the proposed Spline-Based Transformer from Disney Research
  ☆105Updated last year
• itsdaniele / jeometric
  Graph neural networks in JAX.
  ☆68Updated last year
• epfml / DenseFormer
  ☆82Updated last year
• uzulim / hades
  Fast singularity detection with kernel
  ☆37Updated last year
• idiap / sigma-gpt
  σ-GPT: A New Approach to Autoregressive Models
  ☆70Updated last year
• okarthikb / state-space-models
  ☆28Updated last year
• cloneofsimo / zeroshampoo
  ☆34Updated last year
• zaydzuhri / softpick-attention
  Landing repository for the paper "Softpick: No Attention Sink, No Massive Activations with Rectified Softmax"
  ☆85Updated 3 months ago
• jxmorris12 / gptzip
  Losslessly encode text natively with arithmetic coding and HuggingFace Transformers
  ☆76Updated last month
• Aleph-Alpha-Research / trigrams
  ☆58Updated 3 weeks ago
• pchlenski / manify
  A Python Library for Learning Non-Euclidean Representations
  ☆67Updated 4 months ago
• jxmorris12 / embzip
  lossily compress representation vectors using product quantization
  ☆59Updated last month
• jfpuget / ARC-AGI-Challenge-2024
  ☆56Updated last year
• crowsonkb / dice-mc
  DiCE: The Infinitely Differentiable Monte-Carlo Estimator
  ☆32Updated 2 years ago
• Pleias / Quest-Best-Tokens
  An introduction to LLM Sampling
  ☆79Updated 11 months ago
• lucidrains / GAF-microbatch-pytorch
  Implementation of Gradient Agreement Filtering, from Chaubard et al. of Stanford, but for single machine microbatches, in Pytorch
  ☆25Updated 10 months ago
• probabilists / azula
  Diffusion models in PyTorch
  ☆116Updated last week
• cgarciae / einop
  ☆60Updated 3 years ago