AI-Glimpse

/

bert

like 0

Follow

AI Glimpse 1

• "toynlp.bert.model.BertEmbedding",
• "toynlp.bert.model.EncoderTransformerBlock",
• "toynlp.bert.model.PositionwiseFeedForward",
• "torch.nn.modules.normalization.LayerNorm",
• "torch.device",
• "toynlp.bert.model.NSPHead",
• "torch.nn.modules.sparse.Embedding",
• "toynlp.bert.model.ScaleDotProductionAttention",
• "torch._utils._rebuild_tensor_v2",
• "torch.nn.modules.activation.GELU",
• "toynlp.bert.model.MultiHeadAttention",
• "torch._utils._rebuild_parameter",
• "toynlp.bert.config.BertConfig",
• "torch.nn.modules.dropout.Dropout",
• "toynlp.bert.model.MLMHead",
• "collections.OrderedDict",
• "toynlp.bert.model.BertPretrainModel",
• "torch.FloatStorage",
• "torch.nn.modules.container.ModuleList",
• "toynlp.bert.model.Bert",
• "__builtin__.set",
• "toynlp.bert.model.Encoder",
• "torch.nn.modules.linear.Linear"

How to fix it?