AnonymousAlethiometer / SGD_SaILinks
Official PyTorch Implementation for Paper "No More Adam: Learning Rate Scaling at Initialization is All You Need"
☆56Updated last year
Alternatives and similar repositories for SGD_SaI
Users that are interested in SGD_SaI are comparing it to the libraries listed below
Sorting:
- A big_vision inspired repo that implements a generic Auto-Encoder class capable in representation learning and generative modeling.☆34Updated last year
- Implementation of the proposed MaskBit from Bytedance AI☆83Updated last year
- ☆39Updated last year
- Implementation of a multimodal diffusion transformer in Pytorch☆107Updated last year
- Official implementation of the paper: "ZClip: Adaptive Spike Mitigation for LLM Pre-Training".☆144Updated 2 months ago
- Implementation of the proposed LVMAE, from the paper, Extending Video Masked Autoencoders to 128 frames, in Pytorch☆55Updated last year
- ☆71Updated last year
- Implementation of TiTok, proposed by Bytedance in "An Image is Worth 32 Tokens for Reconstruction and Generation"☆182Updated last year
- ☆27Updated last year
- Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmind☆135Updated 3 months ago
- Minimal Differentiable Image Reward Functions☆106Updated 5 months ago
- Autoregressive Image Generation☆31Updated 8 months ago
- Tiny re-implementation of MDM in style of LLaDA and nano-gpt speedrun