microsoft / LongRoPE

LongRoPE is a novel method that can extends the context window of pre-trained LLMs to an impressive 2048k tokens.
201Updated 6 months ago

Alternatives and similar repositories for LongRoPE:

Users that are interested in LongRoPE are comparing it to the libraries listed below