dvruette / giddLinks
Code accompanying the paper "Generalized Interpolating Discrete Diffusion"
☆108Updated 5 months ago
Alternatives and similar repositories for gidd
Users that are interested in gidd are comparing it to the libraries listed below
Sorting:
- Official Jax Implementation of MD4 Masked Diffusion Models☆144Updated 8 months ago
- Tiny re-implementation of MDM in style of LLaDA and nano-gpt speedrun☆57Updated 8 months ago
- Flash Attention Triton kernel with support for second-order derivatives☆112Updated 3 weeks ago
- Official Code for Paper "Think While You Generate: Discrete Diffusion with Planned Denoising" [ICLR 2025]☆82Updated 6 months ago
- Official implementation of the paper: "ZClip: Adaptive Spike Mitigation for LLM Pre-Training".☆139Updated last month
- Official PyTorch implementation and models for paper "Diffusion Beats Autoregressive in Data-Constrained Settings". We find diffusion mod…☆108Updated 3 weeks ago
- Official PyTorch implementation for ICLR2025 paper "Scaling up Masked Diffusion Models on Text"☆339Updated 10 months ago
- [ICLR 2025 & COLM 2025] Official PyTorch implementation of the Forgetting Transformer and Adaptive Computation Pruning☆133Updated 2 weeks ago
- A general framework for inference-time scaling and steering of diffusion models with arbitrary rewards.☆194Updated 4 months ago
- ☆108Updated 2 years ago
- Normalized Transformer (nGPT)☆192Updated last year
- ☆65Updated 7 months ago
- The official github repo for "Diffusion Language Models are Super Data Learners".☆186Updated 2 weeks ago
- Quick implementation of nGPT, learning entirely on the hypersphere, from NvidiaAI☆291Updated 5 months ago
- research impl of Native Sparse Attention (2502.11089)☆63Updated 9 months ago
- Supporting code for the blog post on modular manifolds.☆102Updated last month
- [ICLR2025] DiffuGPT and DiffuLLaMA: Scaling Diffusion Language Models via Adaptation from Autoregressive Models☆334Updated 5 months ago
- supporting pytorch FSDP for optimizers☆83Updated 11 months ago
- [ICLR 2025] Code for the paper "Beyond Autoregression: Discrete Diffusion for Complex Reasoning and Planning"☆84Updated 9 months ago
- WIP☆93Updated last year
- Some preliminary explorations of Mamba's context scaling.☆216Updated last year
- ☆254Updated 5 months ago
- Flash-Muon: An Efficient Implementation of Muon Optimizer☆206Updated 5 months ago
- Explorations into whether a transformer with RL can direct a genetic algorithm to converge faster☆71Updated 6 months ago
- Code for the paper: "Fine-Tuning Discrete Diffusion Models with Policy Gradient Methods"☆28Updated 6 months ago
- [NeurIPS 2024] Simple and Effective Masked Diffusion Language Model☆561Updated last month
- Landing repository for the paper "Softpick: No Attention Sink, No Massive Activations with Rectified Softmax"☆85Updated 2 months ago
- ☆61Updated last year
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆130Updated 11 months ago
- ☆24Updated 5 months ago