Class TransformerDecoder

Transformer decoder as described by Vaswani et al containing an arbitrary number of TransformerDecoderLayers.

Hierarchy

Constructors

  • Parameters

    • dim: number

      Number of dimensions of the input embeddings

    • heads: number

      Number of heads for the multi-head attention

    • depth: number

      Number of encoder layers

    • Optional attentionDim: number

      Number of dimensions of the embeddings used in the scaled dot-product attention, or dim if not specified

    • Optional feedForwardDim: number

      Number of dimensions in the hidden layer of the feed forward network, or dim if not specified

    • Optional initSequenceLength: number

      Initial sequence length that the positional encoding should be computed for, or DEFAULT_SEQUENCE_LENGTH if not specified

    Returns TransformerDecoder

Properties

arguments: any
attentionDim: number
caller: Function
depth: number
dim: number
feedForwardDim: number
heads: number
layers: Sequential
length: number
name: string

Returns the name of the function. Function names are read-only and can not be changed.

prototype: any

Methods

  • Determines whether the given value inherits from this function if this function was used as a constructor function.

    A constructor function can control which objects are recognized as its instances by 'instanceof' by overriding this method.

    Parameters

    • value: any

    Returns boolean

  • Calls the function, substituting the specified object for the this value of the function, and the specified array for the arguments of the function.

    Parameters

    • this: Function
    • thisArg: any

      The object to be used as the this object.

    • Optional argArray: any

      A set of arguments to be passed to the function.

    Returns any

  • For a given function, creates a bound function that has the same body as the original function. The this object of the bound function is associated with the specified object, and has the specified initial parameters.

    Parameters

    • this: Function
    • thisArg: any

      An object to which the this keyword can refer inside the new function.

    • Rest ...argArray: any[]

      A list of arguments to be passed to the new function.

    Returns any

  • Calls a method of an object, substituting another object for the current object.

    Parameters

    • this: Function
    • thisArg: any

      The object to be used as the current object.

    • Rest ...argArray: any[]

      A list of arguments to be passed to the method.

    Returns any

  • Returns a string representation of a function.

    Returns string

Generated using TypeDoc