Skip to content

Commit

Permalink
📝 comment for removed dropout
Browse files Browse the repository at this point in the history
  • Loading branch information
lkaesberg committed Jul 26, 2023
1 parent e27c697 commit 3bf89d0
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions classifier.py
Original file line number Diff line number Diff line change
Expand Up @@ -59,6 +59,7 @@ def forward(self, input_ids, attention_mask):
# HINT: you should consider what is the appropriate output to return given that
# the training loop currently uses F.cross_entropy as the loss function.
# Cross entropy already has a softmax therefore this should be okay
# No Dropout because it is the last layer before softmax, else worse performance
result = self.bert(input_ids, attention_mask)
return self.linear_layer(result['pooler_output'])

Expand Down

0 comments on commit 3bf89d0

Please sign in to comment.