languini-kitchen / languini-kitchen

Related projects ⓘ

Alternatives and complementary repositories for languini-kitchen

• shikaiqiu / compute-better-spent
  ☆46Updated last month
• berlino / seq_icl
  ☆50Updated 6 months ago
• ethancaballero / broken_neural_scaling_laws
  Code Release for "Broken Neural Scaling Laws" (BNSL) paper
  ☆57Updated last year
• tml-epfl / why-weight-decay
  Why Do We Need Weight Decay in Modern Deep Learning? [NeurIPS 2024]
  ☆52Updated last month
• sustcsonglin / mamba-triton
  ☆45Updated 9 months ago
• michaelsdr / sinkformers
  Transformers with doubly stochastic attention
  ☆40Updated 2 years ago
• sustcsonglin / gated_linear_attention_layer
  ☆31Updated 10 months ago
• GallagherCommaJack / modulax
  ☆16Updated 3 months ago
• mechanistic-interpretability-grokking / progress-measures-paper
  ☆54Updated 2 years ago
• lixilinx / psgd_torch
  Pytorch implementation of preconditioned stochastic gradient descent (affine group preconditioner, low-rank approximation preconditioner …
  ☆128Updated last month
• RobertCsordas / transformer_generalization
  The official repository for our paper "The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers". We s…
  ☆66Updated last year
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆36Updated last year
• johnryan465 / pscan
  ☆36Updated 10 months ago
• lucidrains / product-key-memory
  Standalone Product Key Memory module in Pytorch - for augmenting Transformer models
  ☆73Updated 3 months ago
• proger / hippogriff
  Griffin MQA + Hawk Linear RNN Hybrid
  ☆85Updated 6 months ago
• zhangjiong724 / spectral-RNN
  STABILIZING GRADIENTS FOR DEEP NEURAL NETWORKS VIA EFFICIENT SVD PARAMETERIZATION
  ☆16Updated 6 years ago
• google-deepmind / emergent_in_context_learning
  ☆77Updated 3 months ago
• lucaslingle / mu_transformer
  Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.
  ☆29Updated 3 weeks ago
• lucidrains / gated-state-spaces-pytorch
  Implementation of Gated State Spaces, from the paper "Long Range Language Modeling via Gated State Spaces", in Pytorch
  ☆95Updated last year
• codekansas / rwkv
  RWKV model implementation
  ☆38Updated last year
• nikhilvyas / SOAP
  ☆129Updated last week
• stanislavfort / dissect-git-re-basin
  Replicating and dissecting the git-re-basin project in one-click-replication Colabs
  ☆36Updated 2 years ago
• ejmichaud / grokking-squared
  ☆22Updated last year
• athms / mad-lab
  A MAD laboratory to improve AI architecture designs 🧪
  ☆95Updated 6 months ago
• ag1988 / dss
  Sequence Modeling with Structured State Spaces
  ☆60Updated 2 years ago
• epfml / llm-baselines
  NanoGPT-like codebase for LLM training
  ☆75Updated this week
• bhoov / energy-transformer-jax
  The Energy Transformer block, in JAX
  ☆53Updated 11 months ago
• radarFudan / mamba-minimal-jax
  ☆29Updated this week
• f-dangel / sirfshampoo
  [ICML 2024] SIRFShampoo: Structured inverse- and root-free Shampoo in PyTorch (https://arxiv.org/abs/2402.03496)
  ☆13Updated 2 weeks ago
• ClashLuke / tpucare
  Automatically take good care of your preemptible TPUs
  ☆32Updated last year