Softmax Normalization
A function that converts a vector of real numbers into a probability distribution, used in attention mechanisms to produce weights that sum to 1.
learn more?
Subscribe and we'll send new content to your inbox.
A function that converts a vector of real numbers into a probability distribution, used in attention mechanisms to produce weights that sum to 1.
Subscribe and we'll send new content to your inbox.