XiangLi1999 / Diffusion-LM
Diffusion-LM
☆1,031Updated last month
Related projects: ⓘ
- [ICLR'23] DiffuSeq: Sequence to Sequence Text Generation with Diffusion Models☆711Updated 6 months ago
- Prefix-Tuning: Optimizing Continuous Prompts for Generation☆882Updated 4 months ago
- ACL'2023: DiffusionBERT: Improving Generative Masked Language Models with Diffusion Models☆286Updated 7 months ago
- Code for the ALiBi method for transformer language models (ICLR 2022)☆497Updated 10 months ago
- Paper List for In-context Learning 🌷☆783Updated 2 months ago
- A minimal implementation of diffusion models for text generation☆298Updated last year
- Implementation of paper "Towards a Unified View of Parameter-Efficient Transfer Learning" (ICLR 2022)☆510Updated 2 years ago
- [NeurIPS'22 Spotlight] A Contrastive Framework for Neural Text Generation☆457Updated 6 months ago
- Original Implementation of Prompt Tuning from Lester, et al, 2021☆641Updated 3 months ago
- Rotary Transformer☆782Updated 2 years ago
- A novel method to tune language models. Codes and datasets for paper ``GPT understands, too''.☆912Updated last year
- A research project for natural language generation, containing the official implementations by MSRA NLC team.☆681Updated last month
- Code for ALBEF: a new vision-language pre-training method☆1,505Updated last year
- A plug-and-play library for parameter-efficient-tuning (Delta Tuning)☆978Updated last year
- ☆334Updated 3 years ago
- A fast MoE impl for PyTorch☆1,520Updated 2 months ago
- Optimus: the first large-scale pre-trained VAE language model☆367Updated last year
- Reading list of Instruction-tuning. A trend starts from Natrural-Instruction (ACL 2022), FLAN (ICLR 2022) and T0 (ICLR 2022).☆748Updated last year
- Paper List for Contrastive Learning for Natural Language Processing☆531Updated last year
- PyTorch Re-Implementation of "The Sparsely-Gated Mixture-of-Experts Layer" by Noam Shazeer et al. https://arxiv.org/abs/1701.06538☆941Updated 5 months ago
- A Pytorch implementation of Sparsely-Gated Mixture of Experts, for massively increasing the parameter count of language models☆610Updated last year
- Reference implementation for DPO (Direct Preference Optimization)☆2,024Updated last month
- Fusion-in-Decoder☆548Updated 11 months ago
- Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch☆1,192Updated last year
- A modular RL library to fine-tune language models to human preferences☆2,173Updated 6 months ago
- ☆476Updated 10 months ago
- A Unified Library for Parameter-Efficient and Modular Transfer Learning☆2,525Updated 3 weeks ago
- [ACL 2021] LM-BFF: Better Few-shot Fine-tuning of Language Models https://arxiv.org/abs/2012.15723☆714Updated 2 years ago
- Implementation of Rotary Embeddings, from the Roformer paper, in Pytorch☆528Updated last week
- Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch☆850Updated 10 months ago