Group Representational Position Encoding
IntermediateYifan Zhang, Zixiang Chen et al.Dec 8arXiv
GRAPE is a new way to tell Transformers where each word is in a sentence by using neat math moves called group actions.
#GRAPE#positional encoding#group actions