Tag Archives: territory

The Map Just Isn’t The Territory

The attention mechanism folks mostly refer to when discussing self-attention is the scaled dot-product mechanism. 2017 have largely given strategy to the now-dominant scaled dot-product mechanism used within the archetypal Transformer. One of the neatest instruments is the pronunciation key