gregorbachmann / scaling_mlps

Related projects: ⓘ

• RobertCsordas / linear_layer_as_attention
  The official repository for our paper "The Dual Form of Neural Networks Revisited: Connecting Test Time Predictions to Training Patterns …
  ☆15Updated 10 months ago
• ahennequ / pytorch-custom-mma
  ☆29Updated last year
• lucidrains / einops-exts
  Implementation of some personal helper functions for Einops, my most favorite tensor manipulation library ❤️
  ☆52Updated last year
• SamsungSAILMontreal / ghn3
  Code for "Can We Scale Transformers to Predict Parameters of Diverse ImageNet Models?" [ICML 2023]
  ☆30Updated 3 weeks ago
• lucidrains / autoregressive-linear-attention-cuda
  CUDA implementation of autoregressive linear attention, with all the latest research findings
  ☆43Updated last year
• lucidrains / hourglass-transformer-pytorch
  Implementation of Hourglass Transformer, in Pytorch, from Google and OpenAI
  ☆74Updated 2 years ago
• shikaiqiu / compute-better-spent
  ☆42Updated 3 months ago
• smonsays / hypernetwork-attention
  Official code for the paper "Attention as a Hypernetwork"
  ☆20Updated 2 months ago
• tml-epfl / why-weight-decay
  Why Do We Need Weight Decay in Modern Deep Learning? [arXiv, Oct 2023]
  ☆41Updated 11 months ago
• facebookresearch / ViP-MAE
  This is a PyTorch implementation of the paperViP A Differentially Private Foundation Model for Computer Vision
  ☆38Updated last year
• JeanKaddour / LAWA
  Latest Weight Averaging (NeurIPS HITY 2022)
  ☆21Updated last year
• google-research / growneuron
  ☆52Updated last month
• lucidrains / discrete-key-value-bottleneck-pytorch
  Implementation of Discrete Key / Value Bottleneck, in Pytorch
  ☆87Updated last year
• Newbeeer / stf
  Code for ICLR 2023 Paper, "Stable Target Field for Reduced Variance Score Estimation in Diffusion Models”
  ☆66Updated last year
• matthias-wright / jax-fid
  FID computation in Jax/Flax.
  ☆23Updated 2 months ago
• Cranial-XIX / longhorn
  Official PyTorch Implementation of the Longhorn Deep State Space Model
  ☆35Updated last month
• cloneofsimo / karras-power-ema-tutorial
  ☆48Updated 8 months ago
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆28Updated last week
• ermongroup / fast_feedforward_computation
  Official code for "Accelerating Feedforward Computation via Parallel Nonlinear Equation Solving", ICML 2021
  ☆25Updated 2 years ago
• wjxts / RegularizedBN
  ☆20Updated last year
• lucidrains / compositional-attention-pytorch
  Implementation of "compositional attention" from MILA, a multi-head attention variant that is reframed as a two-step attention process wi…
  ☆50Updated 2 years ago
• lucidrains / frame-averaging-pytorch
  Pytorch implementation of a simple way to enable (Stochastic) Frame Averaging for any network
  ☆45Updated last month
• lucidrains / logavgexp-torch
  Implementation of LogAvgExp for Pytorch
  ☆32Updated 2 years ago
• oripress / EntropyEnigma
  Official code for the ICML 2024 paper "The Entropy Enigma: Success and Failure of Entropy Minimization"
  ☆44Updated 3 months ago
• lucidrains / infini-transformer-pytorch
  Implementation of Infini-Transformer in Pytorch
  ☆100Updated last month
• apple / ml-agm
  ☆38Updated 4 months ago
• epfml / schedules-and-scaling
  ☆47Updated 3 months ago
• lucidrains / kalman-filtering-attention
  Implementation of the Kalman Filtering Attention proposed in "Kalman Filtering Attention for User Behavior Modeling in CTR Prediction"
  ☆56Updated 10 months ago
• TomerRonen34 / mixed-resolution-vit
  ☆48Updated 11 months ago
• LeslieTrue / CPP
  This is the official implementation for Image Clustering via the Principle of Rate Reduction in the Age of Pretrained Models.
  ☆23Updated last year