VITA-Group / Ms-PoE

"Found in the Middle: How Language Models Use Long Contexts Better via Plug-and-Play Positional Encoding" Zhenyu Zhang, Runjin Chen, Shiwei Liu, Zhewei Yao, Olatunji Ruwase, Beidi Chen, Xiaoxia Wu, Zhangyang Wang.
26Updated 10 months ago

Alternatives and similar repositories for Ms-PoE:

Users that are interested in Ms-PoE are comparing it to the libraries listed below