Attention Weight Matrix
A matrix where each entry represents how much one position attends to another, with rows forming probability distributions over the input sequence.
learn more?
Subscribe and we'll send new content to your inbox.
A matrix where each entry represents how much one position attends to another, with rows forming probability distributions over the input sequence.
Subscribe and we'll send new content to your inbox.