jdeschena / sdttLinks
[ICLR 2025] SDTT: a simple and effective distillation method for discrete diffusion models
☆43Updated 3 months ago
Alternatives and similar repositories for sdtt
Users that are interested in sdtt are comparing it to the libraries listed below
Sorting:
- Official PyTorch implementation and models for paper "Diffusion Beats Autoregressive in Data-Constrained Settings". We find diffusion mod…☆113Updated last month
- CycleQD is a framework for parameter space model merging.☆45Updated 10 months ago
- [ICML 2025] Roll the dice & look before you leap: Going beyond the creative limits of next-token prediction☆80Updated 6 months ago
- The official github repo for "Diffusion Language Models are Super Data Learners".☆208Updated last month
- Memory Mosaics are networks of associative memories working in concert to achieve a prediction task.☆55Updated 10 months ago
- Official Jax Implementation of MD4 Masked Diffusion Models☆147Updated 9 months ago
- [ICLR 2025 & COLM 2025] Official PyTorch implementation of the Forgetting Transformer and Adaptive Computation Pruning☆134Updated last month
- Code for Discovering Preference Optimization Algorithms with and for Large Language Models☆64Updated last year
- An AI benchmark for creative, human-like problem solving using Sudoku variants☆141Updated last month
- Flash Attention Triton kernel with support for second-order derivatives☆117Updated last month
- Remasking Discrete Diffusion Models with Inference-Time Scaling☆59Updated 9 months ago
- Code accompanying the paper "Generalized Interpolating Discrete Diffusion"☆109Updated 6 months ago
- [ICLR2025] DiffuGPT and DiffuLLaMA: Scaling Diffusion Language Models via Adaptation from Autoregressive Models☆348Updated 6 months ago
- Mamba training library developed by kotoba technologies☆70Updated last year
- Plug in & Play Pytorch Implementation of the paper: "Evolutionary Optimization of Model Merging Recipes" by Sakana AI☆31Updated last year
- [ICLR 2025] Code for the paper "Beyond Autoregression: Discrete Diffusion for Complex Reasoning and Planning"☆85Updated 10 months ago
- Landing repository for the paper "Softpick: No Attention Sink, No Massive Activations with Rectified Softmax"☆85Updated 3 months ago
- Tiny re-implementation of MDM in style of LLaDA and nano-gpt speedrun☆57Updated 9 months ago
- ☆257Updated 6 months ago
- A MAD laboratory to improve AI architecture designs 🧪☆135Updated 11 months ago
- Official PyTorch Implementation of the Longhorn Deep State Space Model☆56Updated last year
- Quick implementation of nGPT, learning entirely on the hypersphere, from NvidiaAI☆294Updated 6 months ago
- Official implementation of Phi-Mamba. A MOHAWK-distilled model (Transformers to SSMs: Distilling Quadratic Knowledge to Subquadratic Mode…☆116Updated last year
- Official implementation of the paper: "ZClip: Adaptive Spike Mitigation for LLM Pre-Training".☆141Updated 3 weeks ago
- WIP☆93Updated last year
- 📄Small Batch Size Training for Language Models☆68Updated 2 months ago
- ☆36Updated 9 months ago
- ☆89Updated last year
- Implementation of a multimodal diffusion transformer in Pytorch☆107Updated last year
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆132Updated last year