microsoft / BANG

BANG is a new pretraining model to Bridge the gap between Autoregressive (AR) and Non-autoregressive (NAR) Generation. AR and NAR generation can be uniformly regarded as to what extent previous tokens can be attended, and BANG bridges AR and NAR generation by designing a novel model structure for large-scale pretraining. The pretrained BANG mode…
28Updated 2 years ago

Alternatives and similar repositories for BANG:

Users that are interested in BANG are comparing it to the libraries listed below