madaan / minimal-text-diffusion
A minimal implementation of diffusion models for text generation
☆313Updated last year
Related projects ⓘ
Alternatives and complementary repositories for minimal-text-diffusion
- ☆109Updated 8 months ago
- [ICLR'23] DiffuSeq: Sequence to Sequence Text Generation with Diffusion Models☆734Updated 8 months ago
- ACL'2023: DiffusionBERT: Improving Generative Masked Language Models with Diffusion Models☆296Updated 9 months ago
- Implementation of Self-conditioned Embedding Diffusion for Text Generation☆37Updated last year
- [ICML 2024 Best Paper] Discrete Diffusion Modeling by Estimating the Ratios of the Data Distribution (https://arxiv.org/abs/2310.16834)☆404Updated 8 months ago
- Experiments around a simple idea for inducing multiple hierarchical predictive model within a GPT☆205Updated 3 months ago
- Diffusion-LM☆1,058Updated 3 months ago
- Implementation of the conditionally routed attention in the CoLT5 architecture, in Pytorch☆225Updated 2 months ago
- Simplified Masked Diffusion Language Model☆207Updated last week
- Reparameterized Discrete Diffusion Models for Text Generation☆90Updated last year
- Implementation of Bit Diffusion, Hinton's group's attempt at discrete denoising diffusion, in Pytorch☆333Updated last year
- Code for the ALiBi method for transformer language models (ICLR 2022)☆507Updated last year
- An implementation of masked language modeling for Pytorch, made as concise and simple as possible☆177Updated last year
- A simple implimentation of Bayesian Flow Networks (BFN)☆239Updated 10 months ago
- Implementation of Rotary Embeddings, from the Roformer paper, in Pytorch☆571Updated last week
- Implementation of Recurrent Memory Transformer, Neurips 2022 paper, in Pytorch☆394Updated this week
- The official codebase for "Empowering Diffusion Models on the Embedding Space for Text Generation" (NAACL 2024)☆52Updated 6 months ago
- ☆75Updated last year
- Minimal Implementation of a D3PM in pytorch☆183Updated 6 months ago
- Understand and test language model architectures on synthetic tasks.☆162Updated 6 months ago
- Sequence modeling with Mega.☆298Updated last year
- Implementation of ST-Moe, the latest incarnation of MoE after years of research at Brain, in Pytorch☆293Updated 5 months ago
- A curated list for awesome discrete diffusion models resources.☆67Updated last week
- Implementation of Classifier Free Guidance in Pytorch, with emphasis on text conditioning, and flexibility to include multiple text embed…☆364Updated last month
- Auto get diffusion nlp papers in Axriv. More papers Information can be found in another repository "Diffusion_NLP_Papers".☆64Updated this week
- minLoRA: a minimal PyTorch library that allows you to apply LoRA to any PyTorch model.☆434Updated last year
- Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch☆624Updated 2 months ago
- Semi-autoregressive Simplex-based Diffusion Language Model for Text Generation and Modular Control☆66Updated 2 years ago
- A mini-library for training consistency models.☆215Updated 10 months ago
- Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates☆435Updated 7 months ago