jdeschena / sdttLinks
[ICLR 2025] SDTT: a simple and effective distillation method for discrete diffusion models
☆42Updated 2 months ago
Alternatives and similar repositories for sdtt
Users that are interested in sdtt are comparing it to the libraries listed below
Sorting:
- Official Jax Implementation of MD4 Masked Diffusion Models☆144Updated 8 months ago
- CycleQD is a framework for parameter space model merging.☆44Updated 9 months ago
- Code for Discovering Preference Optimization Algorithms with and for Large Language Models☆64Updated last year
- 📄Small Batch Size Training for Language Models☆63Updated last month
- Code accompanying the paper "Generalized Interpolating Discrete Diffusion"☆108Updated 5 months ago
- [ICML 2025] Roll the dice & look before you leap: Going beyond the creative limits of next-token prediction☆75Updated 5 months ago
- Tiny re-implementation of MDM in style of LLaDA and nano-gpt speedrun☆57Updated 8 months ago
- [ICLR2025] DiffuGPT and DiffuLLaMA: Scaling Diffusion Language Models via Adaptation from Autoregressive Models☆334Updated 5 months ago
- Remasking Discrete Diffusion Models with Inference-Time Scaling☆54Updated 8 months ago
- An AI benchmark for creative, human-like problem solving using Sudoku variants☆120Updated 2 weeks ago
- Memory Mosaics are networks of associative memories working in concert to achieve a prediction task.☆51Updated 9 months ago
- Mamba training library developed by kotoba technologies☆70Updated last year
- [ICLR 2025] Code for the paper "Beyond Autoregression: Discrete Diffusion for Complex Reasoning and Planning"☆84Updated 9 months ago
- The official github repo for "Diffusion Language Models are Super Data Learners".☆200Updated 2 weeks ago
- Official PyTorch implementation and models for paper "Diffusion Beats Autoregressive in Data-Constrained Settings". We find diffusion mod…☆108Updated 3 weeks ago
- [ICLR 2025 & COLM 2025] Official PyTorch implementation of the Forgetting Transformer and Adaptive Computation Pruning☆133Updated 2 weeks ago
- ☆108Updated 2 years ago
- Supporting code for the blog post on modular manifolds.☆102Updated last month
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆173Updated 4 months ago
- ☆47Updated last month
- Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"☆85Updated last year
- Official implementation of Phi-Mamba. A MOHAWK-distilled model (Transformers to SSMs: Distilling Quadratic Knowledge to Subquadratic Mode…☆116Updated last year
- Flash Attention Triton kernel with support for second-order derivatives☆112Updated last month
- Plug in & Play Pytorch Implementation of the paper: "Evolutionary Optimization of Model Merging Recipes" by Sakana AI☆31Updated last year
- A general framework for inference-time scaling and steering of diffusion models with arbitrary rewards.☆196Updated 4 months ago
- WIP☆93Updated last year
- Quick implementation of nGPT, learning entirely on the hypersphere, from NvidiaAI☆292Updated 5 months ago
- ☆41Updated 3 weeks ago
- Implementation of a multimodal diffusion transformer in Pytorch☆106Updated last year
- Official implementation of "TAID: Temporally Adaptive Interpolated Distillation for Efficient Knowledge Transfer in Language Models"☆118Updated last month