What matters for Representation Alignment: Global Information or Spatial Structure?
IntermediateJaskirat Singh, Xingjian Leng et al.Dec 11arXiv
This paper asks whether generation training benefits more from an encoderβs big-picture meaning (global semantics) or from how features are arranged across space (spatial structure).
#representation alignment#REPA#iREPA