Lightning-Universe / lightning-transformers
Flexible components pairing š¤ Transformers with Pytorch Lightning
ā609Updated 2 years ago
Alternatives and similar repositories for lightning-transformers:
Users that are interested in lightning-transformers are comparing it to the libraries listed below
- FastFormers - highly efficient transformer models for NLUā706Updated last month
- Understanding the Difficulty of Training Transformersā329Updated 2 years ago
- Pretrain and finetune ELECTRA with fastai and huggingface. (Results of the paper replicated !)ā328Updated last year
- Library for 8-bit optimizers and quantization routines.