manueldeprada / Pretraining-T5-PyTorch-Lightning

Collection of scripts to pretrain T5 in unsupervised text, using PyTorch Lightning. CORD-19 pretraining provided as example.
31Updated 3 years ago

Alternatives and similar repositories for Pretraining-T5-PyTorch-Lightning:

Users that are interested in Pretraining-T5-PyTorch-Lightning are comparing it to the libraries listed below