gregorbachmann / scaling_mlpsLinks
☆51Updated last year
Alternatives and similar repositories for scaling_mlps
Users that are interested in scaling_mlps are comparing it to the libraries listed below
Sorting:
- Latest Weight Averaging (NeurIPS HITY 2022)☆30Updated 2 years ago
- Why Do We Need Weight Decay in Modern Deep Learning? [NeurIPS 2024]☆66Updated 8 months ago
- The official repository for our paper "The Dual Form of Neural Networks Revisited: Connecting Test Time Predictions to Training Patterns …☆16Updated last week
- Official code for the paper "Attention as a Hypernetwork"☆39Updated last year
- Implementation of some personal helper functions for Einops, my most favorite tensor manipulation library ❤️☆54Updated 2 years ago
- ☆21Updated 2 years ago
- ☆22Updated 5 months ago
- CUDA implementation of autoregressive linear attention, with all the latest research findings☆44Updated 2 years ago
- ☆53Updated 8 months ago
- Deep Networks Grok All the Time and Here is Why☆37Updated last year
- ☆29Updated 2 years ago
- This is a PyTorch implementation of the paperViP A Differentially Private Foundation Model for Computer Vision☆36Updated last year
- ☆50Updated last year
- Implementation of Hourglass Transformer, in Pytorch, from Google and OpenAI☆91Updated 3 years ago
- Code for "Can We Scale Transformers to Predict Parameters of Diverse ImageNet Models?" [ICML 2023]☆34Updated 9 months ago
- ImageNet-12k subset of ImageNet-21k (fall11)☆21Updated 2 years ago
- Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)☆80Updated last year
- Implementation of "compositional attention" from MILA, a multi-head attention variant that is reframed as a two-step attention process wi…☆51Updated 3 years ago
- Official PyTorch Implementation of "Rosetta Neurons: Mining the Common Units in a Model Zoo"☆30Updated last year
- Implementation of Discrete Key / Value Bottleneck, in Pytorch☆88Updated last year
- Official PyTorch Implementation of the Longhorn Deep State Space Model☆51Updated 6 months ago
- ☆41Updated 2 years ago
- These papers will provide unique insightful concepts that will broaden your perspective on neural networks and deep learning☆48Updated last year
- Official code for the paper: "Metadata Archaeology"☆19Updated 2 years ago
- ☆55Updated 10 months ago
- Experimental scripts for researching data adaptive learning rate scheduling.☆23Updated last year
- ☆18Updated 3 years ago
- Exploration into the proposed "Self Reasoning Tokens" by Felipe Bonetto☆56Updated last year
- [Oral; Neurips OPT2024 ] μLO: Compute-Efficient Meta-Generalization of Learned Optimizers☆13Updated 3 months ago
- Patching open-vocabulary models by interpolating weights☆91Updated last year