Mantissagithub / transformer-labView on GitHub
Plug-and-play PyTorch transformer research framework. Swap attention, FFN, norm, positional, connection, projection, optimizer, scheduler, loss, and dataset via Hydra config groups. Encoder-decoder summarization + decoder-only causal-LM pretraining (DDP/FSDP, bf16, KV-cache generation, HF Hub push).
☆18Oct 18, 2026Updated this week

Alternatives and similar repositories for transformer-lab

Users that are interested in transformer-lab are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?