princeton-nlp / ProLong

Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"
174Updated last month

Alternatives and similar repositories for ProLong:

Users that are interested in ProLong are comparing it to the libraries listed below