Deep Delta Learning
IntermediateYifan Zhang, Yifeng Liu et al.Jan 1arXiv
Deep Delta Learning (DDL) replaces the usual “add the shortcut” rule in deep networks with a smarter, learnable move that can gently erase old info and write new info along a chosen direction.
#Deep Delta Learning#Delta Operator#Residual connection