Memory Caching: RNNs with Growing Memory
BeginnerAli Behrouz, Zeman Li et al.Feb 27arXiv
Recurrent neural networks (RNNs) are fast but forgetful because they squeeze everything they’ve seen into a tiny, fixed memory.
#Memory Caching#Recurrent Neural Networks#Attention