AnonymousAlethiometer / SGD_SaILinks
Official PyTorch Implementation for Paper "No More Adam: Learning Rate Scaling at Initialization is All You Need"
☆54Updated 11 months ago
Alternatives and similar repositories for SGD_SaI
Users that are interested in SGD_SaI are comparing it to the libraries listed below
Sorting:
- ☆39Updated last year
- A big_vision inspired repo that implements a generic Auto-Encoder class capable in representation learning and generative modeling.☆34Updated last year
- Implementation of the proposed MaskBit from Bytedance AI☆83Updated last year
- Implementation of TiTok, proposed by Bytedance in "An Image is Worth 32 Tokens for Reconstruction and Generation"☆183Updated last year
- ☆27Updated last year
- ☆71Updated last year
- Tiny re-implementation of MDM in style of LLaDA and nano-gpt speedrun☆56Updated 10 months ago
- Recaption large (Web)Datasets with vllm and save the artifacts.☆52Updated last year
- Implementation of a multimodal diffusion transformer in Pytorch☆107Updated last year
- Autoregressive Image Generation☆31Updated 7 months ago
- Official implementation of the paper: "ZClip: Adaptive Spike Mitigation for LLM Pre-Training".☆141Updated last month
- imagetokenizer is a python package, helps you encoder visuals and generate visuals token ids from codebook, supports both image and video…☆37Updated last year
- ☆95Updated last year
- Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmind☆132Updated 2 months ago
- TerDiT: Ternary Diffusion Models with Transformers☆74Updated last year
- Exploration into the proposed "Self Reasoning Tokens" by Felipe Bonetto☆57Updated last year
- Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"☆102Updated last year
- Repository for "TESS-2: A Large-Scale, Generalist Diffusion Language Model"☆53Updated 10 months ago
- ☆32Updated last year
- [Preprint] GMem: A Modular Approach for Ultra-Efficient Generative Models☆42Updated 10 months ago
- Train vector quantized CLIP models using pytorch lightning☆20Updated last year
- ☆34Updated 6 months ago
- Official implementation of ECCV24 paper: POA☆24Updated last year
- Attempt to make multiple residual streams from Bytedance's Hyper-Connections paper accessible to the public☆139Updated this week
- Minimal Differentiable Image Reward Functions☆106Updated 4 months ago
- Official PyTorch implementation of TokenSet.☆127Updated 9 months ago
- ☆53Updated 2 years ago
- research impl of Native Sparse Attention (2502.11089)☆63Updated 10 months ago
- Official Repo for Error-Free Linear Attention is a Free Lunch: Exact Solution from Continuous-Time Dynamics☆69Updated this week
- Focused on fast experimentation and simplicity☆79Updated last year