evanatyourservice / psgd_jax

Related projects ⓘ

Alternatives and complementary repositories for psgd_jax

• GallagherCommaJack / modulax
  ☆16Updated 2 months ago
• MatX-inc / seqax
  seqax = sequence modeling + JAX
  ☆132Updated 3 months ago
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆72Updated 9 months ago
• ClashLuke / tpucare
  Automatically take good care of your preemptible TPUs
  ☆31Updated last year
• dvruette / barrel-rec-pytorch
  ☆53Updated 9 months ago
• young-geng / scalax
  A simple library for scaling up JAX programs
  ☆125Updated last week
• johnryan465 / pscan
  ☆36Updated 10 months ago
• cloneofsimo / min-fsdp
  ☆72Updated 4 months ago
• jxbz / modula
  Scalable neural net training via automatic normalization in the modular norm.
  ☆119Updated 2 months ago
• cloneofsimo / min-max-gpt
  Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training
  ☆112Updated 6 months ago
• berlino / seq_icl
  ☆50Updated 5 months ago
• young-geng / mintext
  Minimal but scalable implementation of large language models in JAX
  ☆25Updated last week
• athms / mad-lab
  A MAD laboratory to improve AI architecture designs 🧪
  ☆95Updated 6 months ago
• davisyoshida / lorax
  LoRA for arbitrary JAX models and functions
  ☆132Updated 8 months ago
• davisyoshida / qax
  If it quacks like a tensor...
  ☆52Updated this week
• EleutherAI / nanoGPT-mup
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆84Updated 2 weeks ago
• google-deepmind / nanodo
  ☆197Updated 3 months ago
• ethansmith2000 / TransformerExperiments
  ☆18Updated last month
• google-deepmind / spectral_ssm
  ☆27Updated 7 months ago
• KellerJordan / Muon
  Muon optimizer for neural networks: >30% extra sample efficiency, <3% wallclock overhead
  ☆69Updated this week
• HazyResearch / zoology
  Understand and test language model architectures on synthetic tasks.
  ☆161Updated 6 months ago
• apple / ml-ademamix
  ☆46Updated last month
• shikaiqiu / compute-better-spent
  ☆46Updated last month
• nikhilvyas / SOAP
  ☆122Updated this week
• srush / Tensor-Puzzles-Penzai
  ☆19Updated 6 months ago
• maximzubkov / fft-scan
  Efficient PScan implementation in PyTorch
  ☆15Updated 10 months ago
• thecharlieblake / lovely-llama
  An implementation of the Llama architecture, to instruct and delight
  ☆21Updated 2 months ago
• CLAIRE-Labo / StructuredFFN
  The official code of "Building on Efficient Foundations: Effectively Training LLMs with Structured Feedforward Layers"
  ☆14Updated 3 months ago
• borisdayma / clip-jax
  Train vision models using JAX and 🤗 transformers
  ☆95Updated 3 weeks ago