Number of dimensions of the inputs
Private dimReadonly lengthReadonly nameReturns the name of the function. Function names are read-only and can not be changed.
Private scaleDetermines whether the given value inherits from this function if this function was used as a constructor function.
A constructor function can control which objects are recognized as its instances by 'instanceof' by overriding this method.
Calls the function, substituting the specified object for the this value of the function, and the specified array for the arguments of the function.
The object to be used as the this object.
Optional argArray: anyA set of arguments to be passed to the function.
For a given function, creates a bound function that has the same body as the original function. The this object of the bound function is associated with the specified object, and has the specified initial parameters.
An object to which the this keyword can refer inside the new function.
Rest ...argArray: any[]A list of arguments to be passed to the new function.
Calls a method of an object, substituting another object for the current object.
The object to be used as the current object.
Rest ...argArray: any[]A list of arguments to be passed to the method.
A Tensor of shape [..., queryTokens, dim]
Tensor of query embeddings, shape [..., queryTokens, dim]
Tensor of key embeddings, shape [..., keyTokens, dim]
Tensor of value embeddings each corresponding to a key, shape [..., keyTokens, dim]
Optional mask: TensorTensor mask of shape [queryTokens, keyTokens] where a 1 in position $(i, j)$ indicates that the $i$th query should not attend to the $j$th key
Protected scaleGenerated using TypeDoc
Scaled dot-product mechanism as described by Vaswani et al. The scaleFactor is computed during object creation as $\frac{1}{\sqrt{d}}$, where $d$ is the dimensionality of the inputs.