madaan / minimal-text-diffusionLinks
A minimal implementation of diffusion models for text generation
☆399Updated 2 years ago
Alternatives and similar repositories for minimal-text-diffusion
Users that are interested in minimal-text-diffusion are comparing it to the libraries listed below
Sorting:
- ☆142Updated last year
- [ICML 2024 Best Paper] Discrete Diffusion Modeling by Estimating the Ratios of the Data Distribution (https://arxiv.org/abs/2310.16834)☆651Updated last year
- Implementation of Self-conditioned Embedding Diffusion for Text Generation☆39Updated 2 years ago
- [NeurIPS 2024] Simple and Effective Masked Diffusion Language Model☆543Updated last month
- ACL'2023: DiffusionBERT: Improving Generative Masked Language Models with Diffusion Models☆332Updated last year
- [ICLR'23] DiffuSeq: Sequence to Sequence Text Generation with Diffusion Models☆817Updated last year
- Reparameterized Discrete Diffusion Models for Text Generation☆101Updated 2 years ago
- ☆108Updated 2 years ago
- Diffusion-LM☆1,192Updated last year
- Auto get diffusion nlp papers in Axriv. More papers Information can be found in another repository "Diffusion-LM-Papers".☆205Updated last week
- Implementation of the conditionally routed attention in the CoLT5 architecture, in Pytorch☆230Updated last year
- Semi-autoregressive Simplex-based Diffusion Language Model for Text Generation and Modular Control☆75Updated 2 years ago
- Code for the ALiBi method for transformer language models (ICLR 2022)☆544Updated 2 years ago
- A simple implimentation of Bayesian Flow Networks (BFN)☆240Updated last year
- Experiments around a simple idea for inducing multiple hierarchical predictive model within a GPT☆222Updated last year
- The official codebase for "Empowering Diffusion Models on the Embedding Space for Text Generation" (NAACL 2024)☆55Updated last year
- Implementation of ST-Moe, the latest incarnation of MoE after years of research at Brain, in Pytorch☆366Updated last year
- A curated list for awesome discrete diffusion models resources.☆476Updated last month
- ☆184Updated last year
- Official PyTorch implementation for ICLR2025 paper "Scaling up Masked Diffusion Models on Text"☆329Updated 10 months ago
- Sequence modeling with Mega.☆300Updated 2 years ago
- Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch☆654Updated 10 months ago
- Implementation of Bit Diffusion, Hinton's group's attempt at discrete denoising diffusion, in Pytorch☆353Updated 2 years ago
- Minimal Implementation of a D3PM in pytorch☆267Updated last year
- Implementation of Recurrent Memory Transformer, Neurips 2022 paper, in Pytorch☆417Updated 9 months ago
- Code for the paper "The Impact of Positional Encoding on Length Generalization in Transformers", NeurIPS 2023☆136Updated last year
- DiffusER: Discrete Diffusion via Edit-based Reconstruction (Reid, Hellendoorn & Neubig, 2022)☆54Updated 2 months ago
- Implementation of CALM from the paper "LLM Augmented LLMs: Expanding Capabilities through Composition", out of Google Deepmind☆177Updated last year
- An implementation of masked language modeling for Pytorch, made as concise and simple as possible☆179Updated 2 years ago
- Recurrent Memory Transformer☆151Updated 2 years ago