AnonymousAlethiometer / SGD_SaI
Official PyTorch Implementation for Paper "No More Adam: Learning Rate Scaling at Initialization is All You Need"
☆51Updated 3 months ago
Alternatives and similar repositories for SGD_SaI:
Users that are interested in SGD_SaI are comparing it to the libraries listed below
- Implementation of the proposed MaskBit from Bytedance AI☆76Updated 5 months ago
- Focused on fast experimentation and simplicity☆71Updated 4 months ago
- Tiny re-implementation of MDM in style of LLaDA and nano-gpt speedrun☆49Updated last month
- ☆70Updated 5 months ago
- imagetokenizer is a python package, helps you encoder visuals and generate visuals token ids from codebook, supports both image and video…☆33Updated 10 months ago
- ☆37Updated last year
- ☆27Updated last year
- A big_vision inspired repo that implements a generic Auto-Encoder class capable in representation learning and generative modeling.☆35Updated 10 months ago
- Minimal Differentiable Image Reward Functions☆55Updated 3 weeks ago
- [ICLR 2025] Source code for paper "A Spark of Vision-Language Intelligence: 2-Dimensional Autoregressive Transformer for Efficient Finegr…☆75Updated 4 months ago
- Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"☆97Updated 7 months ago
- Exploration into the proposed "Self Reasoning Tokens" by Felipe Bonetto☆55Updated 11 months ago
- Recaption large (Web)Datasets with vllm and save the artifacts.☆52Updated 5 months ago
- Explorations into adversarial losses on top of autoregressive loss for language modeling☆35Updated 2 months ago
- Train vector quantized CLIP models using pytorch lightning☆20Updated 9 months ago
- When it comes to optimizers, it's always better to be safe than sorry☆222Updated last month
- [ICLR 2025] Official PyTorch implementation of "Forgetting Transformer: Softmax Attention with a Forget Gate"☆97Updated 3 weeks ago
- Code for the paper "Vamba: Understanding Hour-Long Videos with Hybrid Mamba-Transformers"☆64Updated last month
- Implementation of Infini-Transformer in Pytorch☆110Updated 4 months ago
- research impl of Native Sparse Attention (2502.11089)☆53Updated 2 months ago
- Official codebase for Margin-aware Preference Optimization for Aligning Diffusion Models without Reference (MaPO).☆74Updated 10 months ago
- Matryoshka Multimodal Models☆101Updated 3 months ago
- ☆27Updated last month
- The official implementation of OmniFlow: Any-to-Any Generation with Multi-Modal Rectified Flows☆57Updated last month
- UniDisc: A discrete diffusion model for joint multimodal generation, enabling controllable and efficient text-image synthesis, editing, a…☆94Updated last month
- Model Merging with SVD to Tie the KnOTS [ICLR 2025]☆52Updated last month
- Official repository for VQDM:Accurate Compression of Text-to-Image Diffusion Models via Vector Quantization paper☆33Updated 7 months ago
- Implementation of the proposed Adam-atan2 from Google Deepmind in Pytorch☆103Updated 5 months ago
- ☆51Updated last year
- ☆33Updated 6 months ago