aju22 / RoPE-PyTorch
View external linksLinks

This repository contains an educational implementation of Rotary Positional Encodings (RoPE) in PyTorch. RoPE is a method introduced in the paper RoFormer: Enhanced Transformer with Rotary Position Embedding by Jianlin Su, Yu Lu, Shengfeng Pan, Ahmed Murtadha, Bo Wen, and Yunfeng Liu.
19Aug 18, 2023Updated 2 years ago

Alternatives and similar repositories for RoPE-PyTorch

Users that are interested in RoPE-PyTorch are comparing it to the libraries listed below

Sorting:

Are these results useful?