modelzoo.common.pytorch.layers.TransformerEncoder
modelzoo.common.pytorch.layers.TransformerEncoder¶
import path: modelzoo.common.pytorch.layers.TransformerEncoder
TransformerEncoder (encoder_layer, num_layers, norm=None, enable_nested_tensor=False):
encoder_layer: an instance of the TransformerEncoderLayer() class (required).
num_layers: the number of sub-encoder-layers in the encoder (required).
norm: the layer normalization component (optional).
forward (src, mask=None, src_key_padding_mask=None):
src (Tensor): the sequence to the encoder (required). shape
[batch_size, src_seq_length, embed_dim].mask (Tensor): the mask for the src sequence (optional). shape
[src_seq_length, src_seq_length].src_key_padding_mask (Tensor): the mask for the src keys per batch (optional). shape
[batch_size, src_seq_length].