-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathtraining_log.txt
9708 lines (9708 loc) · 606 KB
/
training_log.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
Epoch [1/3], Step [1/3236], Loss: 9.0682, Perplexity: 8674.6896
Epoch [1/3], Step [2/3236], Loss: 8.8373, Perplexity: 6886.1006
Epoch [1/3], Step [3/3236], Loss: 8.5312, Perplexity: 5070.6885
Epoch [1/3], Step [4/3236], Loss: 8.1503, Perplexity: 3464.4051
Epoch [1/3], Step [5/3236], Loss: 7.8329, Perplexity: 2522.1444
Epoch [1/3], Step [6/3236], Loss: 7.1537, Perplexity: 1278.8397
Epoch [1/3], Step [7/3236], Loss: 6.3560, Perplexity: 575.9561
Epoch [1/3], Step [8/3236], Loss: 5.6349, Perplexity: 280.0386
Epoch [1/3], Step [9/3236], Loss: 5.2733, Perplexity: 195.0588
Epoch [1/3], Step [10/3236], Loss: 5.0766, Perplexity: 160.2240
Epoch [1/3], Step [11/3236], Loss: 4.8657, Perplexity: 129.7561
Epoch [1/3], Step [12/3236], Loss: 4.6662, Perplexity: 106.2969
Epoch [1/3], Step [13/3236], Loss: 4.6198, Perplexity: 101.4743
Epoch [1/3], Step [14/3236], Loss: 4.7851, Perplexity: 119.7137
Epoch [1/3], Step [15/3236], Loss: 4.6419, Perplexity: 103.7432
Epoch [1/3], Step [16/3236], Loss: 4.6647, Perplexity: 106.1324
Epoch [1/3], Step [17/3236], Loss: 4.5843, Perplexity: 97.9332
Epoch [1/3], Step [18/3236], Loss: 5.0362, Perplexity: 153.8801
Epoch [1/3], Step [19/3236], Loss: 5.0095, Perplexity: 149.8302
Epoch [1/3], Step [20/3236], Loss: 5.4238, Perplexity: 226.7323
Epoch [1/3], Step [21/3236], Loss: 4.4219, Perplexity: 83.2533
Epoch [1/3], Step [22/3236], Loss: 4.4422, Perplexity: 84.9629
Epoch [1/3], Step [23/3236], Loss: 5.0164, Perplexity: 150.8741
Epoch [1/3], Step [24/3236], Loss: 4.4786, Perplexity: 88.1127
Epoch [1/3], Step [25/3236], Loss: 4.3430, Perplexity: 76.9357
Epoch [1/3], Step [26/3236], Loss: 4.2976, Perplexity: 73.5200
Epoch [1/3], Step [27/3236], Loss: 4.7041, Perplexity: 110.3941
Epoch [1/3], Step [28/3236], Loss: 4.2854, Perplexity: 72.6338
Epoch [1/3], Step [29/3236], Loss: 4.6782, Perplexity: 107.5752
Epoch [1/3], Step [30/3236], Loss: 4.3322, Perplexity: 76.1136
Epoch [1/3], Step [31/3236], Loss: 4.2094, Perplexity: 67.3169
Epoch [1/3], Step [32/3236], Loss: 4.1521, Perplexity: 63.5676
Epoch [1/3], Step [33/3236], Loss: 4.1443, Perplexity: 63.0725
Epoch [1/3], Step [34/3236], Loss: 4.2556, Perplexity: 70.5001
Epoch [1/3], Step [35/3236], Loss: 4.3512, Perplexity: 77.5739
Epoch [1/3], Step [36/3236], Loss: 4.1216, Perplexity: 61.6555
Epoch [1/3], Step [37/3236], Loss: 4.1985, Perplexity: 66.5884
Epoch [1/3], Step [38/3236], Loss: 4.1373, Perplexity: 62.6314
Epoch [1/3], Step [39/3236], Loss: 4.2257, Perplexity: 68.4239
Epoch [1/3], Step [40/3236], Loss: 4.0212, Perplexity: 55.7673
Epoch [1/3], Step [41/3236], Loss: 4.2451, Perplexity: 69.7596
Epoch [1/3], Step [42/3236], Loss: 4.0424, Perplexity: 56.9643
Epoch [1/3], Step [43/3236], Loss: 4.3819, Perplexity: 79.9894
Epoch [1/3], Step [44/3236], Loss: 4.0174, Perplexity: 55.5585
Epoch [1/3], Step [45/3236], Loss: 3.9930, Perplexity: 54.2167
Epoch [1/3], Step [46/3236], Loss: 4.1469, Perplexity: 63.2405
Epoch [1/3], Step [47/3236], Loss: 4.2582, Perplexity: 70.6858
Epoch [1/3], Step [48/3236], Loss: 3.9840, Perplexity: 53.7314
Epoch [1/3], Step [49/3236], Loss: 3.9950, Perplexity: 54.3243
Epoch [1/3], Step [50/3236], Loss: 4.0183, Perplexity: 55.6063
Epoch [1/3], Step [51/3236], Loss: 3.9823, Perplexity: 53.6415
Epoch [1/3], Step [52/3236], Loss: 3.8895, Perplexity: 48.8864
Epoch [1/3], Step [53/3236], Loss: 4.1579, Perplexity: 63.9385
Epoch [1/3], Step [54/3236], Loss: 3.8859, Perplexity: 48.7107
Epoch [1/3], Step [55/3236], Loss: 4.1147, Perplexity: 61.2340
Epoch [1/3], Step [56/3236], Loss: 3.8210, Perplexity: 45.6498
Epoch [1/3], Step [57/3236], Loss: 3.9588, Perplexity: 52.3939
Epoch [1/3], Step [58/3236], Loss: 4.6105, Perplexity: 100.5374
Epoch [1/3], Step [59/3236], Loss: 4.0335, Perplexity: 56.4605
Epoch [1/3], Step [60/3236], Loss: 3.8658, Perplexity: 47.7403
Epoch [1/3], Step [61/3236], Loss: 3.7177, Perplexity: 41.1707
Epoch [1/3], Step [62/3236], Loss: 3.9000, Perplexity: 49.4015
Epoch [1/3], Step [63/3236], Loss: 3.9704, Perplexity: 53.0083
Epoch [1/3], Step [64/3236], Loss: 3.8657, Perplexity: 47.7389
Epoch [1/3], Step [65/3236], Loss: 3.8071, Perplexity: 45.0187
Epoch [1/3], Step [66/3236], Loss: 3.7278, Perplexity: 41.5866
Epoch [1/3], Step [67/3236], Loss: 3.6480, Perplexity: 38.3973
Epoch [1/3], Step [68/3236], Loss: 3.8783, Perplexity: 48.3418
Epoch [1/3], Step [69/3236], Loss: 3.7802, Perplexity: 43.8243
Epoch [1/3], Step [70/3236], Loss: 3.7373, Perplexity: 41.9825
Epoch [1/3], Step [71/3236], Loss: 3.9426, Perplexity: 51.5509
Epoch [1/3], Step [72/3236], Loss: 4.3343, Perplexity: 76.2705
Epoch [1/3], Step [73/3236], Loss: 4.6529, Perplexity: 104.8902
Epoch [1/3], Step [74/3236], Loss: 3.7356, Perplexity: 41.9120
Epoch [1/3], Step [75/3236], Loss: 3.6707, Perplexity: 39.2783
Epoch [1/3], Step [76/3236], Loss: 3.6837, Perplexity: 39.7951
Epoch [1/3], Step [77/3236], Loss: 3.5805, Perplexity: 35.8917
Epoch [1/3], Step [78/3236], Loss: 3.5926, Perplexity: 36.3271
Epoch [1/3], Step [79/3236], Loss: 4.0666, Perplexity: 58.3593
Epoch [1/3], Step [80/3236], Loss: 3.8849, Perplexity: 48.6642
Epoch [1/3], Step [81/3236], Loss: 3.8594, Perplexity: 47.4367
Epoch [1/3], Step [82/3236], Loss: 3.8084, Perplexity: 45.0780
Epoch [1/3], Step [83/3236], Loss: 3.7092, Perplexity: 40.8213
Epoch [1/3], Step [84/3236], Loss: 3.6178, Perplexity: 37.2544
Epoch [1/3], Step [85/3236], Loss: 3.9975, Perplexity: 54.4636
Epoch [1/3], Step [86/3236], Loss: 3.6438, Perplexity: 38.2380
Epoch [1/3], Step [87/3236], Loss: 3.8330, Perplexity: 46.2012
Epoch [1/3], Step [88/3236], Loss: 3.5764, Perplexity: 35.7440
Epoch [1/3], Step [89/3236], Loss: 3.5052, Perplexity: 33.2871
Epoch [1/3], Step [90/3236], Loss: 3.6195, Perplexity: 37.3177
Epoch [1/3], Step [91/3236], Loss: 4.0452, Perplexity: 57.1200
Epoch [1/3], Step [92/3236], Loss: 3.7150, Perplexity: 41.0591
Epoch [1/3], Step [93/3236], Loss: 3.7451, Perplexity: 42.3121
Epoch [1/3], Step [94/3236], Loss: 3.6631, Perplexity: 38.9801
Epoch [1/3], Step [95/3236], Loss: 4.0922, Perplexity: 59.8710
Epoch [1/3], Step [96/3236], Loss: 4.1055, Perplexity: 60.6720
Epoch [1/3], Step [97/3236], Loss: 3.4194, Perplexity: 30.5516
Epoch [1/3], Step [98/3236], Loss: 3.5235, Perplexity: 33.9044
Epoch [1/3], Step [99/3236], Loss: 3.7883, Perplexity: 44.1821
Epoch [1/3], Step [100/3236], Loss: 3.6563, Perplexity: 38.7193
Epoch [1/3], Step [101/3236], Loss: 4.4191, Perplexity: 83.0232
Epoch [1/3], Step [102/3236], Loss: 4.1958, Perplexity: 66.4045
Epoch [1/3], Step [103/3236], Loss: 3.6878, Perplexity: 39.9588
Epoch [1/3], Step [104/3236], Loss: 3.6017, Perplexity: 36.6616
Epoch [1/3], Step [105/3236], Loss: 4.2120, Perplexity: 67.4881
Epoch [1/3], Step [106/3236], Loss: 3.6515, Perplexity: 38.5341
Epoch [1/3], Step [107/3236], Loss: 3.7012, Perplexity: 40.4952
Epoch [1/3], Step [108/3236], Loss: 3.7724, Perplexity: 43.4860
Epoch [1/3], Step [109/3236], Loss: 3.6344, Perplexity: 37.8804
Epoch [1/3], Step [110/3236], Loss: 3.6446, Perplexity: 38.2683
Epoch [1/3], Step [111/3236], Loss: 4.0651, Perplexity: 58.2729
Epoch [1/3], Step [112/3236], Loss: 3.7433, Perplexity: 42.2373
Epoch [1/3], Step [113/3236], Loss: 3.4286, Perplexity: 30.8344
Epoch [1/3], Step [114/3236], Loss: 3.7140, Perplexity: 41.0188
Epoch [1/3], Step [115/3236], Loss: 3.4611, Perplexity: 31.8536
Epoch [1/3], Step [116/3236], Loss: 3.4001, Perplexity: 29.9660
Epoch [1/3], Step [117/3236], Loss: 4.1323, Perplexity: 62.3210
Epoch [1/3], Step [118/3236], Loss: 3.4216, Perplexity: 30.6182
Epoch [1/3], Step [119/3236], Loss: 3.3658, Perplexity: 28.9566
Epoch [1/3], Step [120/3236], Loss: 3.7918, Perplexity: 44.3380
Epoch [1/3], Step [121/3236], Loss: 3.5965, Perplexity: 36.4696
Epoch [1/3], Step [122/3236], Loss: 3.8282, Perplexity: 45.9774
Epoch [1/3], Step [123/3236], Loss: 3.4733, Perplexity: 32.2441
Epoch [1/3], Step [124/3236], Loss: 3.7171, Perplexity: 41.1431
Epoch [1/3], Step [125/3236], Loss: 3.4796, Perplexity: 32.4455
Epoch [1/3], Step [126/3236], Loss: 3.5718, Perplexity: 35.5817
Epoch [1/3], Step [127/3236], Loss: 3.5915, Perplexity: 36.2876
Epoch [1/3], Step [128/3236], Loss: 3.8653, Perplexity: 47.7156
Epoch [1/3], Step [129/3236], Loss: 3.3673, Perplexity: 28.9987
Epoch [1/3], Step [130/3236], Loss: 5.5649, Perplexity: 261.0920
Epoch [1/3], Step [131/3236], Loss: 3.4663, Perplexity: 32.0179
Epoch [1/3], Step [132/3236], Loss: 3.7397, Perplexity: 42.0856
Epoch [1/3], Step [133/3236], Loss: 3.6772, Perplexity: 39.5374
Epoch [1/3], Step [134/3236], Loss: 3.4619, Perplexity: 31.8780
Epoch [1/3], Step [135/3236], Loss: 3.5347, Perplexity: 34.2863
Epoch [1/3], Step [136/3236], Loss: 3.4679, Perplexity: 32.0679
Epoch [1/3], Step [137/3236], Loss: 3.4871, Perplexity: 32.6894
Epoch [1/3], Step [138/3236], Loss: 3.4586, Perplexity: 31.7712
Epoch [1/3], Step [139/3236], Loss: 3.5747, Perplexity: 35.6855
Epoch [1/3], Step [140/3236], Loss: 3.4970, Perplexity: 33.0148
Epoch [1/3], Step [141/3236], Loss: 3.2216, Perplexity: 25.0687
Epoch [1/3], Step [142/3236], Loss: 3.4242, Perplexity: 30.6975
Epoch [1/3], Step [143/3236], Loss: 3.4504, Perplexity: 31.5133
Epoch [1/3], Step [144/3236], Loss: 3.5642, Perplexity: 35.3104
Epoch [1/3], Step [145/3236], Loss: 3.4426, Perplexity: 31.2679
Epoch [1/3], Step [146/3236], Loss: 3.3448, Perplexity: 28.3555
Epoch [1/3], Step [147/3236], Loss: 3.4334, Perplexity: 30.9813
Epoch [1/3], Step [148/3236], Loss: 3.3020, Perplexity: 27.1673
Epoch [1/3], Step [149/3236], Loss: 3.4996, Perplexity: 33.1014
Epoch [1/3], Step [150/3236], Loss: 3.4806, Perplexity: 32.4798
Epoch [1/3], Step [151/3236], Loss: 3.3409, Perplexity: 28.2458
Epoch [1/3], Step [152/3236], Loss: 3.5638, Perplexity: 35.2982
Epoch [1/3], Step [153/3236], Loss: 3.5078, Perplexity: 33.3741
Epoch [1/3], Step [154/3236], Loss: 3.3804, Perplexity: 29.3838
Epoch [1/3], Step [155/3236], Loss: 3.9405, Perplexity: 51.4462
Epoch [1/3], Step [156/3236], Loss: 3.3815, Perplexity: 29.4142
Epoch [1/3], Step [157/3236], Loss: 3.4959, Perplexity: 32.9798
Epoch [1/3], Step [158/3236], Loss: 3.3284, Perplexity: 27.8948
Epoch [1/3], Step [159/3236], Loss: 3.2098, Perplexity: 24.7731
Epoch [1/3], Step [160/3236], Loss: 3.5441, Perplexity: 34.6068
Epoch [1/3], Step [161/3236], Loss: 3.4731, Perplexity: 32.2363
Epoch [1/3], Step [162/3236], Loss: 3.3395, Perplexity: 28.2044
Epoch [1/3], Step [163/3236], Loss: 4.0437, Perplexity: 57.0364
Epoch [1/3], Step [164/3236], Loss: 3.2925, Perplexity: 26.9108
Epoch [1/3], Step [165/3236], Loss: 3.3890, Perplexity: 29.6367
Epoch [1/3], Step [166/3236], Loss: 3.4700, Perplexity: 32.1358
Epoch [1/3], Step [167/3236], Loss: 3.5309, Perplexity: 34.1536
Epoch [1/3], Step [168/3236], Loss: 3.4594, Perplexity: 31.7993
Epoch [1/3], Step [169/3236], Loss: 3.2363, Perplexity: 25.4389
Epoch [1/3], Step [170/3236], Loss: 3.2645, Perplexity: 26.1659
Epoch [1/3], Step [171/3236], Loss: 3.6258, Perplexity: 37.5539
Epoch [1/3], Step [172/3236], Loss: 3.3525, Perplexity: 28.5752
Epoch [1/3], Step [173/3236], Loss: 3.2218, Perplexity: 25.0741
Epoch [1/3], Step [174/3236], Loss: 3.2596, Perplexity: 26.0393
Epoch [1/3], Step [175/3236], Loss: 3.3425, Perplexity: 28.2889
Epoch [1/3], Step [176/3236], Loss: 3.3987, Perplexity: 29.9250
Epoch [1/3], Step [177/3236], Loss: 3.5433, Perplexity: 34.5804
Epoch [1/3], Step [178/3236], Loss: 3.5126, Perplexity: 33.5346
Epoch [1/3], Step [179/3236], Loss: 3.3616, Perplexity: 28.8350
Epoch [1/3], Step [180/3236], Loss: 3.3956, Perplexity: 29.8312
Epoch [1/3], Step [181/3236], Loss: 3.3397, Perplexity: 28.2093
Epoch [1/3], Step [182/3236], Loss: 3.2805, Perplexity: 26.5890
Epoch [1/3], Step [183/3236], Loss: 3.4221, Perplexity: 30.6324
Epoch [1/3], Step [184/3236], Loss: 3.4589, Perplexity: 31.7815
Epoch [1/3], Step [185/3236], Loss: 3.7801, Perplexity: 43.8203
Epoch [1/3], Step [186/3236], Loss: 3.3126, Perplexity: 27.4555
Epoch [1/3], Step [187/3236], Loss: 3.3506, Perplexity: 28.5199
Epoch [1/3], Step [188/3236], Loss: 3.3358, Perplexity: 28.1020
Epoch [1/3], Step [189/3236], Loss: 3.6104, Perplexity: 36.9811
Epoch [1/3], Step [190/3236], Loss: 3.3927, Perplexity: 29.7449
Epoch [1/3], Step [191/3236], Loss: 3.3581, Perplexity: 28.7346
Epoch [1/3], Step [192/3236], Loss: 3.2579, Perplexity: 25.9960
Epoch [1/3], Step [193/3236], Loss: 3.5782, Perplexity: 35.8077
Epoch [1/3], Step [194/3236], Loss: 3.4662, Perplexity: 32.0146
Epoch [1/3], Step [195/3236], Loss: 3.3615, Perplexity: 28.8327
Epoch [1/3], Step [196/3236], Loss: 3.3471, Perplexity: 28.4195
Epoch [1/3], Step [197/3236], Loss: 3.1574, Perplexity: 23.5085
Epoch [1/3], Step [198/3236], Loss: 4.1971, Perplexity: 66.4925
Epoch [1/3], Step [199/3236], Loss: 3.4277, Perplexity: 30.8047
Epoch [1/3], Step [200/3236], Loss: 3.2864, Perplexity: 26.7456
Epoch [1/3], Step [201/3236], Loss: 3.2004, Perplexity: 24.5415
Epoch [1/3], Step [202/3236], Loss: 3.3693, Perplexity: 29.0594
Epoch [1/3], Step [203/3236], Loss: 3.1580, Perplexity: 23.5224
Epoch [1/3], Step [204/3236], Loss: 3.2599, Perplexity: 26.0465
Epoch [1/3], Step [205/3236], Loss: 3.2803, Perplexity: 26.5825
Epoch [1/3], Step [206/3236], Loss: 3.2844, Perplexity: 26.6925
Epoch [1/3], Step [207/3236], Loss: 3.2148, Perplexity: 24.8980
Epoch [1/3], Step [208/3236], Loss: 3.2435, Perplexity: 25.6220
Epoch [1/3], Step [209/3236], Loss: 3.3017, Perplexity: 27.1585
Epoch [1/3], Step [210/3236], Loss: 3.3187, Perplexity: 27.6234
Epoch [1/3], Step [211/3236], Loss: 3.3355, Perplexity: 28.0926
Epoch [1/3], Step [212/3236], Loss: 3.3529, Perplexity: 28.5856
Epoch [1/3], Step [213/3236], Loss: 3.2311, Perplexity: 25.3066
Epoch [1/3], Step [214/3236], Loss: 3.3396, Perplexity: 28.2077
Epoch [1/3], Step [215/3236], Loss: 4.2321, Perplexity: 68.8639
Epoch [1/3], Step [216/3236], Loss: 2.9469, Perplexity: 19.0461
Epoch [1/3], Step [217/3236], Loss: 3.2960, Perplexity: 27.0056
Epoch [1/3], Step [218/3236], Loss: 3.3514, Perplexity: 28.5425
Epoch [1/3], Step [219/3236], Loss: 3.3699, Perplexity: 29.0769
Epoch [1/3], Step [220/3236], Loss: 3.2058, Perplexity: 24.6754
Epoch [1/3], Step [221/3236], Loss: 3.1238, Perplexity: 22.7336
Epoch [1/3], Step [222/3236], Loss: 3.1542, Perplexity: 23.4352
Epoch [1/3], Step [223/3236], Loss: 3.3030, Perplexity: 27.1942
Epoch [1/3], Step [224/3236], Loss: 3.2786, Perplexity: 26.5391
Epoch [1/3], Step [225/3236], Loss: 3.1631, Perplexity: 23.6430
Epoch [1/3], Step [226/3236], Loss: 3.2156, Perplexity: 24.9171
Epoch [1/3], Step [227/3236], Loss: 3.3760, Perplexity: 29.2533
Epoch [1/3], Step [228/3236], Loss: 3.2382, Perplexity: 25.4868
Epoch [1/3], Step [229/3236], Loss: 3.8272, Perplexity: 45.9321
Epoch [1/3], Step [230/3236], Loss: 3.5540, Perplexity: 34.9533
Epoch [1/3], Step [231/3236], Loss: 3.2246, Perplexity: 25.1447
Epoch [1/3], Step [232/3236], Loss: 3.2235, Perplexity: 25.1157
Epoch [1/3], Step [233/3236], Loss: 3.0763, Perplexity: 21.6790
Epoch [1/3], Step [234/3236], Loss: 3.1658, Perplexity: 23.7068
Epoch [1/3], Step [235/3236], Loss: 3.2957, Perplexity: 26.9973
Epoch [1/3], Step [236/3236], Loss: 3.2637, Perplexity: 26.1462
Epoch [1/3], Step [237/3236], Loss: 3.7864, Perplexity: 44.0994
Epoch [1/3], Step [238/3236], Loss: 3.1959, Perplexity: 24.4311
Epoch [1/3], Step [239/3236], Loss: 3.2995, Perplexity: 27.1001
Epoch [1/3], Step [240/3236], Loss: 3.3952, Perplexity: 29.8219
Epoch [1/3], Step [241/3236], Loss: 3.2283, Perplexity: 25.2375
Epoch [1/3], Step [242/3236], Loss: 3.1710, Perplexity: 23.8305
Epoch [1/3], Step [243/3236], Loss: 3.3115, Perplexity: 27.4269
Epoch [1/3], Step [244/3236], Loss: 3.1623, Perplexity: 23.6247
Epoch [1/3], Step [245/3236], Loss: 3.4990, Perplexity: 33.0813
Epoch [1/3], Step [246/3236], Loss: 3.3004, Perplexity: 27.1238
Epoch [1/3], Step [247/3236], Loss: 3.1830, Perplexity: 24.1200
Epoch [1/3], Step [248/3236], Loss: 3.6023, Perplexity: 36.6811
Epoch [1/3], Step [249/3236], Loss: 3.1904, Perplexity: 24.2980
Epoch [1/3], Step [250/3236], Loss: 3.2401, Perplexity: 25.5354
Epoch [1/3], Step [251/3236], Loss: 3.1692, Perplexity: 23.7881
Epoch [1/3], Step [252/3236], Loss: 3.2866, Perplexity: 26.7531
Epoch [1/3], Step [253/3236], Loss: 3.2293, Perplexity: 25.2614
Epoch [1/3], Step [254/3236], Loss: 3.5351, Perplexity: 34.2989
Epoch [1/3], Step [255/3236], Loss: 3.3159, Perplexity: 27.5479
Epoch [1/3], Step [256/3236], Loss: 2.9913, Perplexity: 19.9114
Epoch [1/3], Step [257/3236], Loss: 3.1732, Perplexity: 23.8832
Epoch [1/3], Step [258/3236], Loss: 3.1328, Perplexity: 22.9380
Epoch [1/3], Step [259/3236], Loss: 3.0655, Perplexity: 21.4450
Epoch [1/3], Step [260/3236], Loss: 3.1362, Perplexity: 23.0152
Epoch [1/3], Step [261/3236], Loss: 3.6980, Perplexity: 40.3675
Epoch [1/3], Step [262/3236], Loss: 3.2047, Perplexity: 24.6472
Epoch [1/3], Step [263/3236], Loss: 3.3086, Perplexity: 27.3472
Epoch [1/3], Step [264/3236], Loss: 3.2943, Perplexity: 26.9585
Epoch [1/3], Step [265/3236], Loss: 3.2254, Perplexity: 25.1635
Epoch [1/3], Step [266/3236], Loss: 3.0207, Perplexity: 20.5058
Epoch [1/3], Step [267/3236], Loss: 3.0877, Perplexity: 21.9265
Epoch [1/3], Step [268/3236], Loss: 4.0367, Perplexity: 56.6389
Epoch [1/3], Step [269/3236], Loss: 3.5446, Perplexity: 34.6257
Epoch [1/3], Step [270/3236], Loss: 3.2524, Perplexity: 25.8532
Epoch [1/3], Step [271/3236], Loss: 3.4920, Perplexity: 32.8510
Epoch [1/3], Step [272/3236], Loss: 3.0629, Perplexity: 21.3896
Epoch [1/3], Step [273/3236], Loss: 3.6423, Perplexity: 38.1783
Epoch [1/3], Step [274/3236], Loss: 3.3591, Perplexity: 28.7636
Epoch [1/3], Step [275/3236], Loss: 3.2806, Perplexity: 26.5930
Epoch [1/3], Step [276/3236], Loss: 3.9056, Perplexity: 49.6777
Epoch [1/3], Step [277/3236], Loss: 3.2261, Perplexity: 25.1813
Epoch [1/3], Step [278/3236], Loss: 3.2068, Perplexity: 24.7001
Epoch [1/3], Step [279/3236], Loss: 2.9798, Perplexity: 19.6830
Epoch [1/3], Step [280/3236], Loss: 3.2356, Perplexity: 25.4226
Epoch [1/3], Step [281/3236], Loss: 3.0539, Perplexity: 21.1971
Epoch [1/3], Step [282/3236], Loss: 3.1809, Perplexity: 24.0688
Epoch [1/3], Step [283/3236], Loss: 3.1668, Perplexity: 23.7316
Epoch [1/3], Step [284/3236], Loss: 3.1828, Perplexity: 24.1133
Epoch [1/3], Step [285/3236], Loss: 3.3600, Perplexity: 28.7897
Epoch [1/3], Step [286/3236], Loss: 3.2604, Perplexity: 26.0607
Epoch [1/3], Step [287/3236], Loss: 3.9599, Perplexity: 52.4499
Epoch [1/3], Step [288/3236], Loss: 3.1244, Perplexity: 22.7463
Epoch [1/3], Step [289/3236], Loss: 3.1286, Perplexity: 22.8420
Epoch [1/3], Step [290/3236], Loss: 3.2588, Perplexity: 26.0182
Epoch [1/3], Step [291/3236], Loss: 3.0365, Perplexity: 20.8324
Epoch [1/3], Step [292/3236], Loss: 3.5708, Perplexity: 35.5445
Epoch [1/3], Step [293/3236], Loss: 3.2815, Perplexity: 26.6153
Epoch [1/3], Step [294/3236], Loss: 2.9229, Perplexity: 18.5956
Epoch [1/3], Step [295/3236], Loss: 3.1281, Perplexity: 22.8298
Epoch [1/3], Step [296/3236], Loss: 3.0465, Perplexity: 21.0412
Epoch [1/3], Step [297/3236], Loss: 2.9514, Perplexity: 19.1328
Epoch [1/3], Step [298/3236], Loss: 3.1041, Perplexity: 22.2886
Epoch [1/3], Step [299/3236], Loss: 3.0293, Perplexity: 20.6824
Epoch [1/3], Step [300/3236], Loss: 3.2781, Perplexity: 26.5259
Epoch [1/3], Step [301/3236], Loss: 3.1727, Perplexity: 23.8715
Epoch [1/3], Step [302/3236], Loss: 3.1187, Perplexity: 22.6161
Epoch [1/3], Step [303/3236], Loss: 3.1693, Perplexity: 23.7903
Epoch [1/3], Step [304/3236], Loss: 3.1478, Perplexity: 23.2839
Epoch [1/3], Step [305/3236], Loss: 3.0624, Perplexity: 21.3782
Epoch [1/3], Step [306/3236], Loss: 2.9144, Perplexity: 18.4385
Epoch [1/3], Step [307/3236], Loss: 3.4244, Perplexity: 30.7041
Epoch [1/3], Step [308/3236], Loss: 3.1603, Perplexity: 23.5781
Epoch [1/3], Step [309/3236], Loss: 3.5344, Perplexity: 34.2748
Epoch [1/3], Step [310/3236], Loss: 3.1167, Perplexity: 22.5717
Epoch [1/3], Step [311/3236], Loss: 3.7083, Perplexity: 40.7842
Epoch [1/3], Step [312/3236], Loss: 3.1370, Perplexity: 23.0339
Epoch [1/3], Step [313/3236], Loss: 3.0209, Perplexity: 20.5089
Epoch [1/3], Step [314/3236], Loss: 3.2458, Perplexity: 25.6812
Epoch [1/3], Step [315/3236], Loss: 2.8396, Perplexity: 17.1085
Epoch [1/3], Step [316/3236], Loss: 3.1905, Perplexity: 24.3014
Epoch [1/3], Step [317/3236], Loss: 3.4514, Perplexity: 31.5447
Epoch [1/3], Step [318/3236], Loss: 3.0992, Perplexity: 22.1794
Epoch [1/3], Step [319/3236], Loss: 3.1005, Perplexity: 22.2098
Epoch [1/3], Step [320/3236], Loss: 2.9908, Perplexity: 19.9010
Epoch [1/3], Step [321/3236], Loss: 3.0669, Perplexity: 21.4747
Epoch [1/3], Step [322/3236], Loss: 3.3920, Perplexity: 29.7259
Epoch [1/3], Step [323/3236], Loss: 3.1885, Perplexity: 24.2526
Epoch [1/3], Step [324/3236], Loss: 3.0325, Perplexity: 20.7494
Epoch [1/3], Step [325/3236], Loss: 3.2129, Perplexity: 24.8519
Epoch [1/3], Step [326/3236], Loss: 2.9624, Perplexity: 19.3439
Epoch [1/3], Step [327/3236], Loss: 3.1879, Perplexity: 24.2367
Epoch [1/3], Step [328/3236], Loss: 2.9817, Perplexity: 19.7220
Epoch [1/3], Step [329/3236], Loss: 3.2060, Perplexity: 24.6795
Epoch [1/3], Step [330/3236], Loss: 3.0600, Perplexity: 21.3266
Epoch [1/3], Step [331/3236], Loss: 2.9059, Perplexity: 18.2816
Epoch [1/3], Step [332/3236], Loss: 3.4117, Perplexity: 30.3177
Epoch [1/3], Step [333/3236], Loss: 3.1453, Perplexity: 23.2259
Epoch [1/3], Step [334/3236], Loss: 2.9983, Perplexity: 20.0505
Epoch [1/3], Step [335/3236], Loss: 3.5221, Perplexity: 33.8559
Epoch [1/3], Step [336/3236], Loss: 3.2376, Perplexity: 25.4733
Epoch [1/3], Step [337/3236], Loss: 3.1243, Perplexity: 22.7438
Epoch [1/3], Step [338/3236], Loss: 3.1123, Perplexity: 22.4725
Epoch [1/3], Step [339/3236], Loss: 3.0163, Perplexity: 20.4159
Epoch [1/3], Step [340/3236], Loss: 3.3283, Perplexity: 27.8910
Epoch [1/3], Step [341/3236], Loss: 3.0051, Perplexity: 20.1879
Epoch [1/3], Step [342/3236], Loss: 2.9656, Perplexity: 19.4062
Epoch [1/3], Step [343/3236], Loss: 3.5156, Perplexity: 33.6351
Epoch [1/3], Step [344/3236], Loss: 3.0519, Perplexity: 21.1564
Epoch [1/3], Step [345/3236], Loss: 3.0330, Perplexity: 20.7593
Epoch [1/3], Step [346/3236], Loss: 2.9659, Perplexity: 19.4118
Epoch [1/3], Step [347/3236], Loss: 3.5531, Perplexity: 34.9201
Epoch [1/3], Step [348/3236], Loss: 3.0253, Perplexity: 20.5994
Epoch [1/3], Step [349/3236], Loss: 2.8496, Perplexity: 17.2815
Epoch [1/3], Step [350/3236], Loss: 3.0695, Perplexity: 21.5305
Epoch [1/3], Step [351/3236], Loss: 3.8121, Perplexity: 45.2476
Epoch [1/3], Step [352/3236], Loss: 3.1062, Perplexity: 22.3356
Epoch [1/3], Step [353/3236], Loss: 2.9668, Perplexity: 19.4290
Epoch [1/3], Step [354/3236], Loss: 2.9738, Perplexity: 19.5662
Epoch [1/3], Step [355/3236], Loss: 2.8440, Perplexity: 17.1837
Epoch [1/3], Step [356/3236], Loss: 3.2126, Perplexity: 24.8438
Epoch [1/3], Step [357/3236], Loss: 2.9247, Perplexity: 18.6279
Epoch [1/3], Step [358/3236], Loss: 2.9887, Perplexity: 19.8608
Epoch [1/3], Step [359/3236], Loss: 3.1466, Perplexity: 23.2567
Epoch [1/3], Step [360/3236], Loss: 3.1437, Perplexity: 23.1884
Epoch [1/3], Step [361/3236], Loss: 2.8645, Perplexity: 17.5405
Epoch [1/3], Step [362/3236], Loss: 3.3465, Perplexity: 28.4018
Epoch [1/3], Step [363/3236], Loss: 3.0333, Perplexity: 20.7652
Epoch [1/3], Step [364/3236], Loss: 2.9532, Perplexity: 19.1668
Epoch [1/3], Step [365/3236], Loss: 3.0750, Perplexity: 21.6498
Epoch [1/3], Step [366/3236], Loss: 2.9928, Perplexity: 19.9424
Epoch [1/3], Step [367/3236], Loss: 3.2918, Perplexity: 26.8922
Epoch [1/3], Step [368/3236], Loss: 3.1152, Perplexity: 22.5391
Epoch [1/3], Step [369/3236], Loss: 3.0034, Perplexity: 20.1539
Epoch [1/3], Step [370/3236], Loss: 3.0942, Perplexity: 22.0696
Epoch [1/3], Step [371/3236], Loss: 3.0869, Perplexity: 21.9097
Epoch [1/3], Step [372/3236], Loss: 2.9633, Perplexity: 19.3624
Epoch [1/3], Step [373/3236], Loss: 2.9953, Perplexity: 19.9921
Epoch [1/3], Step [374/3236], Loss: 3.2337, Perplexity: 25.3722
Epoch [1/3], Step [375/3236], Loss: 3.1404, Perplexity: 23.1122
Epoch [1/3], Step [376/3236], Loss: 2.9363, Perplexity: 18.8457
Epoch [1/3], Step [377/3236], Loss: 2.9167, Perplexity: 18.4804
Epoch [1/3], Step [378/3236], Loss: 3.1882, Perplexity: 24.2439
Epoch [1/3], Step [379/3236], Loss: 2.9337, Perplexity: 18.7969
Epoch [1/3], Step [380/3236], Loss: 2.8790, Perplexity: 17.7964
Epoch [1/3], Step [381/3236], Loss: 3.1254, Perplexity: 22.7697
Epoch [1/3], Step [382/3236], Loss: 3.0199, Perplexity: 20.4894
Epoch [1/3], Step [383/3236], Loss: 2.9900, Perplexity: 19.8863
Epoch [1/3], Step [384/3236], Loss: 2.8682, Perplexity: 17.6053
Epoch [1/3], Step [385/3236], Loss: 2.9048, Perplexity: 18.2624
Epoch [1/3], Step [386/3236], Loss: 2.9037, Perplexity: 18.2417
Epoch [1/3], Step [387/3236], Loss: 3.0819, Perplexity: 21.7989
Epoch [1/3], Step [388/3236], Loss: 2.8379, Perplexity: 17.0793
Epoch [1/3], Step [389/3236], Loss: 3.1195, Perplexity: 22.6357
Epoch [1/3], Step [390/3236], Loss: 3.1147, Perplexity: 22.5264
Epoch [1/3], Step [391/3236], Loss: 3.0523, Perplexity: 21.1640
Epoch [1/3], Step [392/3236], Loss: 2.7360, Perplexity: 15.4245
Epoch [1/3], Step [393/3236], Loss: 3.0346, Perplexity: 20.7926
Epoch [1/3], Step [394/3236], Loss: 2.9587, Perplexity: 19.2732
Epoch [1/3], Step [395/3236], Loss: 3.1844, Perplexity: 24.1528
Epoch [1/3], Step [396/3236], Loss: 2.9416, Perplexity: 18.9458
Epoch [1/3], Step [397/3236], Loss: 2.9577, Perplexity: 19.2539
Epoch [1/3], Step [398/3236], Loss: 3.2820, Perplexity: 26.6285
Epoch [1/3], Step [399/3236], Loss: 3.1142, Perplexity: 22.5150
Epoch [1/3], Step [400/3236], Loss: 3.3584, Perplexity: 28.7426
Epoch [1/3], Step [401/3236], Loss: 3.0478, Perplexity: 21.0684
Epoch [1/3], Step [402/3236], Loss: 2.9279, Perplexity: 18.6875
Epoch [1/3], Step [403/3236], Loss: 3.0552, Perplexity: 21.2250
Epoch [1/3], Step [404/3236], Loss: 3.1435, Perplexity: 23.1855
Epoch [1/3], Step [405/3236], Loss: 2.9543, Perplexity: 19.1875
Epoch [1/3], Step [406/3236], Loss: 2.8624, Perplexity: 17.5035
Epoch [1/3], Step [407/3236], Loss: 2.9324, Perplexity: 18.7733
Epoch [1/3], Step [408/3236], Loss: 2.9561, Perplexity: 19.2224
Epoch [1/3], Step [409/3236], Loss: 2.8734, Perplexity: 17.6970
Epoch [1/3], Step [410/3236], Loss: 3.7872, Perplexity: 44.1328
Epoch [1/3], Step [411/3236], Loss: 2.9257, Perplexity: 18.6479
Epoch [1/3], Step [412/3236], Loss: 3.0963, Perplexity: 22.1163
Epoch [1/3], Step [413/3236], Loss: 2.9410, Perplexity: 18.9353
Epoch [1/3], Step [414/3236], Loss: 3.0840, Perplexity: 21.8450
Epoch [1/3], Step [415/3236], Loss: 3.1922, Perplexity: 24.3430
Epoch [1/3], Step [416/3236], Loss: 3.0101, Perplexity: 20.2903
Epoch [1/3], Step [417/3236], Loss: 3.1509, Perplexity: 23.3577
Epoch [1/3], Step [418/3236], Loss: 3.0417, Perplexity: 20.9404
Epoch [1/3], Step [419/3236], Loss: 2.9956, Perplexity: 19.9978
Epoch [1/3], Step [420/3236], Loss: 3.1539, Perplexity: 23.4273
Epoch [1/3], Step [421/3236], Loss: 2.9087, Perplexity: 18.3331
Epoch [1/3], Step [422/3236], Loss: 3.3424, Perplexity: 28.2862
Epoch [1/3], Step [423/3236], Loss: 3.1245, Perplexity: 22.7481
Epoch [1/3], Step [424/3236], Loss: 2.8991, Perplexity: 18.1582
Epoch [1/3], Step [425/3236], Loss: 3.1135, Perplexity: 22.5007
Epoch [1/3], Step [426/3236], Loss: 2.9660, Perplexity: 19.4146
Epoch [1/3], Step [427/3236], Loss: 2.9397, Perplexity: 18.9097
Epoch [1/3], Step [428/3236], Loss: 3.1463, Perplexity: 23.2508
Epoch [1/3], Step [429/3236], Loss: 3.4176, Perplexity: 30.4967
Epoch [1/3], Step [430/3236], Loss: 3.0290, Perplexity: 20.6757
Epoch [1/3], Step [431/3236], Loss: 3.2201, Perplexity: 25.0309
Epoch [1/3], Step [432/3236], Loss: 3.0761, Perplexity: 21.6735
Epoch [1/3], Step [433/3236], Loss: 2.9437, Perplexity: 18.9852
Epoch [1/3], Step [434/3236], Loss: 3.0093, Perplexity: 20.2724
Epoch [1/3], Step [435/3236], Loss: 2.7757, Perplexity: 16.0501
Epoch [1/3], Step [436/3236], Loss: 2.8933, Perplexity: 18.0529
Epoch [1/3], Step [437/3236], Loss: 3.0559, Perplexity: 21.2413
Epoch [1/3], Step [438/3236], Loss: 3.0411, Perplexity: 20.9290
Epoch [1/3], Step [439/3236], Loss: 3.1048, Perplexity: 22.3037
Epoch [1/3], Step [440/3236], Loss: 2.9336, Perplexity: 18.7959
Epoch [1/3], Step [441/3236], Loss: 3.0389, Perplexity: 20.8817
Epoch [1/3], Step [442/3236], Loss: 2.8004, Perplexity: 16.4520
Epoch [1/3], Step [443/3236], Loss: 3.2462, Perplexity: 25.6918
Epoch [1/3], Step [444/3236], Loss: 2.9348, Perplexity: 18.8187
Epoch [1/3], Step [445/3236], Loss: 2.9830, Perplexity: 19.7479
Epoch [1/3], Step [446/3236], Loss: 3.0037, Perplexity: 20.1604
Epoch [1/3], Step [447/3236], Loss: 3.3263, Perplexity: 27.8339
Epoch [1/3], Step [448/3236], Loss: 2.8129, Perplexity: 16.6576
Epoch [1/3], Step [449/3236], Loss: 2.9425, Perplexity: 18.9637
Epoch [1/3], Step [450/3236], Loss: 2.9660, Perplexity: 19.4147
Epoch [1/3], Step [451/3236], Loss: 2.9996, Perplexity: 20.0767
Epoch [1/3], Step [452/3236], Loss: 2.8715, Perplexity: 17.6642
Epoch [1/3], Step [453/3236], Loss: 2.8520, Perplexity: 17.3223
Epoch [1/3], Step [454/3236], Loss: 3.2545, Perplexity: 25.9055
Epoch [1/3], Step [455/3236], Loss: 3.0362, Perplexity: 20.8267
Epoch [1/3], Step [456/3236], Loss: 2.9859, Perplexity: 19.8047
Epoch [1/3], Step [457/3236], Loss: 3.0570, Perplexity: 21.2627
Epoch [1/3], Step [458/3236], Loss: 2.9545, Perplexity: 19.1929
Epoch [1/3], Step [459/3236], Loss: 2.8781, Perplexity: 17.7797
Epoch [1/3], Step [460/3236], Loss: 2.9413, Perplexity: 18.9397
Epoch [1/3], Step [461/3236], Loss: 2.9330, Perplexity: 18.7836
Epoch [1/3], Step [462/3236], Loss: 2.9708, Perplexity: 19.5079
Epoch [1/3], Step [463/3236], Loss: 2.8149, Perplexity: 16.6914
Epoch [1/3], Step [464/3236], Loss: 3.0503, Perplexity: 21.1221
Epoch [1/3], Step [465/3236], Loss: 2.8880, Perplexity: 17.9581
Epoch [1/3], Step [466/3236], Loss: 2.7938, Perplexity: 16.3427
Epoch [1/3], Step [467/3236], Loss: 2.9150, Perplexity: 18.4494
Epoch [1/3], Step [468/3236], Loss: 2.9994, Perplexity: 20.0740
Epoch [1/3], Step [469/3236], Loss: 2.9776, Perplexity: 19.6408
Epoch [1/3], Step [470/3236], Loss: 2.7861, Perplexity: 16.2173
Epoch [1/3], Step [471/3236], Loss: 2.8036, Perplexity: 16.5045
Epoch [1/3], Step [472/3236], Loss: 3.0324, Perplexity: 20.7466
Epoch [1/3], Step [473/3236], Loss: 2.9893, Perplexity: 19.8712
Epoch [1/3], Step [474/3236], Loss: 3.0364, Perplexity: 20.8304
Epoch [1/3], Step [475/3236], Loss: 2.9165, Perplexity: 18.4773
Epoch [1/3], Step [476/3236], Loss: 2.9518, Perplexity: 19.1411
Epoch [1/3], Step [477/3236], Loss: 3.0964, Perplexity: 22.1180
Epoch [1/3], Step [478/3236], Loss: 2.8743, Perplexity: 17.7134
Epoch [1/3], Step [479/3236], Loss: 3.4034, Perplexity: 30.0650
Epoch [1/3], Step [480/3236], Loss: 2.8785, Perplexity: 17.7881
Epoch [1/3], Step [481/3236], Loss: 2.9036, Perplexity: 18.2388
Epoch [1/3], Step [482/3236], Loss: 2.8595, Perplexity: 17.4530
Epoch [1/3], Step [483/3236], Loss: 2.8504, Perplexity: 17.2942
Epoch [1/3], Step [484/3236], Loss: 3.4536, Perplexity: 31.6132
Epoch [1/3], Step [485/3236], Loss: 2.8199, Perplexity: 16.7753
Epoch [1/3], Step [486/3236], Loss: 3.0067, Perplexity: 20.2202
Epoch [1/3], Step [487/3236], Loss: 3.0327, Perplexity: 20.7538
Epoch [1/3], Step [488/3236], Loss: 2.8690, Perplexity: 17.6194
Epoch [1/3], Step [489/3236], Loss: 2.7480, Perplexity: 15.6121
Epoch [1/3], Step [490/3236], Loss: 2.7124, Perplexity: 15.0651
Epoch [1/3], Step [491/3236], Loss: 3.0247, Perplexity: 20.5886
Epoch [1/3], Step [492/3236], Loss: 3.0554, Perplexity: 21.2302
Epoch [1/3], Step [493/3236], Loss: 2.8738, Perplexity: 17.7044
Epoch [1/3], Step [494/3236], Loss: 2.7575, Perplexity: 15.7598
Epoch [1/3], Step [495/3236], Loss: 3.0014, Perplexity: 20.1138
Epoch [1/3], Step [496/3236], Loss: 3.2711, Perplexity: 26.3400
Epoch [1/3], Step [497/3236], Loss: 2.9247, Perplexity: 18.6283
Epoch [1/3], Step [498/3236], Loss: 3.0645, Perplexity: 21.4243
Epoch [1/3], Step [499/3236], Loss: 3.3982, Perplexity: 29.9101
Epoch [1/3], Step [500/3236], Loss: 2.8666, Perplexity: 17.5778
Epoch [1/3], Step [501/3236], Loss: 2.8385, Perplexity: 17.0906
Epoch [1/3], Step [502/3236], Loss: 2.9023, Perplexity: 18.2153
Epoch [1/3], Step [503/3236], Loss: 2.9805, Perplexity: 19.6975
Epoch [1/3], Step [504/3236], Loss: 3.1776, Perplexity: 23.9897
Epoch [1/3], Step [505/3236], Loss: 2.8725, Perplexity: 17.6809
Epoch [1/3], Step [506/3236], Loss: 3.0275, Perplexity: 20.6450
Epoch [1/3], Step [507/3236], Loss: 2.8518, Perplexity: 17.3189
Epoch [1/3], Step [508/3236], Loss: 2.7831, Perplexity: 16.1698
Epoch [1/3], Step [509/3236], Loss: 3.3089, Perplexity: 27.3542
Epoch [1/3], Step [510/3236], Loss: 2.9243, Perplexity: 18.6215
Epoch [1/3], Step [511/3236], Loss: 3.2752, Perplexity: 26.4477
Epoch [1/3], Step [512/3236], Loss: 3.0265, Perplexity: 20.6245
Epoch [1/3], Step [513/3236], Loss: 2.9778, Perplexity: 19.6451
Epoch [1/3], Step [514/3236], Loss: 3.0522, Perplexity: 21.1612
Epoch [1/3], Step [515/3236], Loss: 2.7117, Perplexity: 15.0545
Epoch [1/3], Step [516/3236], Loss: 3.0585, Perplexity: 21.2949
Epoch [1/3], Step [517/3236], Loss: 2.8393, Perplexity: 17.1036
Epoch [1/3], Step [518/3236], Loss: 2.8485, Perplexity: 17.2623
Epoch [1/3], Step [519/3236], Loss: 3.0975, Perplexity: 22.1428
Epoch [1/3], Step [520/3236], Loss: 3.3675, Perplexity: 29.0064
Epoch [1/3], Step [521/3236], Loss: 2.9509, Perplexity: 19.1232
Epoch [1/3], Step [522/3236], Loss: 2.7827, Perplexity: 16.1629
Epoch [1/3], Step [523/3236], Loss: 3.2737, Perplexity: 26.4099
Epoch [1/3], Step [524/3236], Loss: 2.8903, Perplexity: 17.9988
Epoch [1/3], Step [525/3236], Loss: 2.9177, Perplexity: 18.4982
Epoch [1/3], Step [526/3236], Loss: 2.8660, Perplexity: 17.5674
Epoch [1/3], Step [527/3236], Loss: 3.2805, Perplexity: 26.5884
Epoch [1/3], Step [528/3236], Loss: 3.0086, Perplexity: 20.2597
Epoch [1/3], Step [529/3236], Loss: 3.0086, Perplexity: 20.2583
Epoch [1/3], Step [530/3236], Loss: 3.0307, Perplexity: 20.7117
Epoch [1/3], Step [531/3236], Loss: 3.0444, Perplexity: 20.9981
Epoch [1/3], Step [532/3236], Loss: 3.3538, Perplexity: 28.6102
Epoch [1/3], Step [533/3236], Loss: 2.8100, Perplexity: 16.6100
Epoch [1/3], Step [534/3236], Loss: 2.9863, Perplexity: 19.8130
Epoch [1/3], Step [535/3236], Loss: 2.9903, Perplexity: 19.8912
Epoch [1/3], Step [536/3236], Loss: 2.9310, Perplexity: 18.7472
Epoch [1/3], Step [537/3236], Loss: 2.9333, Perplexity: 18.7888
Epoch [1/3], Step [538/3236], Loss: 3.1865, Perplexity: 24.2040
Epoch [1/3], Step [539/3236], Loss: 3.0834, Perplexity: 21.8325
Epoch [1/3], Step [540/3236], Loss: 2.7907, Perplexity: 16.2931
Epoch [1/3], Step [541/3236], Loss: 3.2483, Perplexity: 25.7467
Epoch [1/3], Step [542/3236], Loss: 3.0111, Perplexity: 20.3103
Epoch [1/3], Step [543/3236], Loss: 2.8473, Perplexity: 17.2420
Epoch [1/3], Step [544/3236], Loss: 3.4002, Perplexity: 29.9689
Epoch [1/3], Step [545/3236], Loss: 2.8006, Perplexity: 16.4547
Epoch [1/3], Step [546/3236], Loss: 2.7948, Perplexity: 16.3596
Epoch [1/3], Step [547/3236], Loss: 2.8678, Perplexity: 17.5990
Epoch [1/3], Step [548/3236], Loss: 2.9831, Perplexity: 19.7484
Epoch [1/3], Step [549/3236], Loss: 2.9445, Perplexity: 19.0007
Epoch [1/3], Step [550/3236], Loss: 2.9249, Perplexity: 18.6317
Epoch [1/3], Step [551/3236], Loss: 2.7404, Perplexity: 15.4930
Epoch [1/3], Step [552/3236], Loss: 2.7878, Perplexity: 16.2446
Epoch [1/3], Step [553/3236], Loss: 2.9336, Perplexity: 18.7946
Epoch [1/3], Step [554/3236], Loss: 3.3424, Perplexity: 28.2856
Epoch [1/3], Step [555/3236], Loss: 3.0332, Perplexity: 20.7638
Epoch [1/3], Step [556/3236], Loss: 2.8474, Perplexity: 17.2423
Epoch [1/3], Step [557/3236], Loss: 2.9347, Perplexity: 18.8159
Epoch [1/3], Step [558/3236], Loss: 2.8624, Perplexity: 17.5042
Epoch [1/3], Step [559/3236], Loss: 2.9731, Perplexity: 19.5532
Epoch [1/3], Step [560/3236], Loss: 2.7645, Perplexity: 15.8714
Epoch [1/3], Step [561/3236], Loss: 3.2845, Perplexity: 26.6958
Epoch [1/3], Step [562/3236], Loss: 3.0260, Perplexity: 20.6146
Epoch [1/3], Step [563/3236], Loss: 2.7308, Perplexity: 15.3451
Epoch [1/3], Step [564/3236], Loss: 2.9973, Perplexity: 20.0309
Epoch [1/3], Step [565/3236], Loss: 3.1954, Perplexity: 24.4207
Epoch [1/3], Step [566/3236], Loss: 3.3420, Perplexity: 28.2762
Epoch [1/3], Step [567/3236], Loss: 2.9177, Perplexity: 18.4994
Epoch [1/3], Step [568/3236], Loss: 3.0057, Perplexity: 20.1996
Epoch [1/3], Step [569/3236], Loss: 2.9014, Perplexity: 18.1991
Epoch [1/3], Step [570/3236], Loss: 2.8259, Perplexity: 16.8759
Epoch [1/3], Step [571/3236], Loss: 2.8141, Perplexity: 16.6788
Epoch [1/3], Step [572/3236], Loss: 2.9545, Perplexity: 19.1925
Epoch [1/3], Step [573/3236], Loss: 2.9572, Perplexity: 19.2447
Epoch [1/3], Step [574/3236], Loss: 2.8458, Perplexity: 17.2157
Epoch [1/3], Step [575/3236], Loss: 2.8179, Perplexity: 16.7413
Epoch [1/3], Step [576/3236], Loss: 3.0631, Perplexity: 21.3947
Epoch [1/3], Step [577/3236], Loss: 2.8638, Perplexity: 17.5280
Epoch [1/3], Step [578/3236], Loss: 2.8598, Perplexity: 17.4578
Epoch [1/3], Step [579/3236], Loss: 2.9415, Perplexity: 18.9436
Epoch [1/3], Step [580/3236], Loss: 2.9201, Perplexity: 18.5428
Epoch [1/3], Step [581/3236], Loss: 2.7840, Perplexity: 16.1831
Epoch [1/3], Step [582/3236], Loss: 2.9338, Perplexity: 18.7984
Epoch [1/3], Step [583/3236], Loss: 2.7584, Perplexity: 15.7749
Epoch [1/3], Step [584/3236], Loss: 2.7016, Perplexity: 14.9031
Epoch [1/3], Step [585/3236], Loss: 2.9102, Perplexity: 18.3605
Epoch [1/3], Step [586/3236], Loss: 3.0193, Perplexity: 20.4771
Epoch [1/3], Step [587/3236], Loss: 2.8209, Perplexity: 16.7924
Epoch [1/3], Step [588/3236], Loss: 2.9264, Perplexity: 18.6603
Epoch [1/3], Step [589/3236], Loss: 2.7932, Perplexity: 16.3339
Epoch [1/3], Step [590/3236], Loss: 2.7835, Perplexity: 16.1752
Epoch [1/3], Step [591/3236], Loss: 3.1317, Perplexity: 22.9121
Epoch [1/3], Step [592/3236], Loss: 2.8643, Perplexity: 17.5366
Epoch [1/3], Step [593/3236], Loss: 2.7779, Perplexity: 16.0846
Epoch [1/3], Step [594/3236], Loss: 2.7277, Perplexity: 15.2983
Epoch [1/3], Step [595/3236], Loss: 2.7716, Perplexity: 15.9847
Epoch [1/3], Step [596/3236], Loss: 2.6474, Perplexity: 14.1173
Epoch [1/3], Step [597/3236], Loss: 2.7822, Perplexity: 16.1538
Epoch [1/3], Step [598/3236], Loss: 2.7859, Perplexity: 16.2143
Epoch [1/3], Step [599/3236], Loss: 2.8099, Perplexity: 16.6080
Epoch [1/3], Step [600/3236], Loss: 2.9123, Perplexity: 18.3991
Epoch [1/3], Step [601/3236], Loss: 2.7704, Perplexity: 15.9642
Epoch [1/3], Step [602/3236], Loss: 3.1719, Perplexity: 23.8538
Epoch [1/3], Step [603/3236], Loss: 3.2689, Perplexity: 26.2820
Epoch [1/3], Step [604/3236], Loss: 3.2272, Perplexity: 25.2102
Epoch [1/3], Step [605/3236], Loss: 2.7774, Perplexity: 16.0779
Epoch [1/3], Step [606/3236], Loss: 2.9158, Perplexity: 18.4634
Epoch [1/3], Step [607/3236], Loss: 2.8241, Perplexity: 16.8454
Epoch [1/3], Step [608/3236], Loss: 3.1652, Perplexity: 23.6923
Epoch [1/3], Step [609/3236], Loss: 3.0010, Perplexity: 20.1048
Epoch [1/3], Step [610/3236], Loss: 2.7756, Perplexity: 16.0490
Epoch [1/3], Step [611/3236], Loss: 2.8196, Perplexity: 16.7706
Epoch [1/3], Step [612/3236], Loss: 3.1607, Perplexity: 23.5867
Epoch [1/3], Step [613/3236], Loss: 2.9489, Perplexity: 19.0851
Epoch [1/3], Step [614/3236], Loss: 2.7397, Perplexity: 15.4822
Epoch [1/3], Step [615/3236], Loss: 2.7959, Perplexity: 16.3780
Epoch [1/3], Step [616/3236], Loss: 2.7974, Perplexity: 16.4025
Epoch [1/3], Step [617/3236], Loss: 2.7334, Perplexity: 15.3845
Epoch [1/3], Step [618/3236], Loss: 3.0406, Perplexity: 20.9170
Epoch [1/3], Step [619/3236], Loss: 3.6205, Perplexity: 37.3571
Epoch [1/3], Step [620/3236], Loss: 2.9919, Perplexity: 19.9240
Epoch [1/3], Step [621/3236], Loss: 2.7290, Perplexity: 15.3177
Epoch [1/3], Step [622/3236], Loss: 2.7503, Perplexity: 15.6476
Epoch [1/3], Step [623/3236], Loss: 2.9019, Perplexity: 18.2085
Epoch [1/3], Step [624/3236], Loss: 3.0937, Perplexity: 22.0589
Epoch [1/3], Step [625/3236], Loss: 3.1667, Perplexity: 23.7302
Epoch [1/3], Step [626/3236], Loss: 3.0142, Perplexity: 20.3725
Epoch [1/3], Step [627/3236], Loss: 3.1489, Perplexity: 23.3110
Epoch [1/3], Step [628/3236], Loss: 3.0745, Perplexity: 21.6393
Epoch [1/3], Step [629/3236], Loss: 2.8030, Perplexity: 16.4936
Epoch [1/3], Step [630/3236], Loss: 3.2912, Perplexity: 26.8748
Epoch [1/3], Step [631/3236], Loss: 2.7599, Perplexity: 15.7976
Epoch [1/3], Step [632/3236], Loss: 3.1421, Perplexity: 23.1515
Epoch [1/3], Step [633/3236], Loss: 3.1091, Perplexity: 22.4014
Epoch [1/3], Step [634/3236], Loss: 2.9341, Perplexity: 18.8049
Epoch [1/3], Step [635/3236], Loss: 2.6763, Perplexity: 14.5308
Epoch [1/3], Step [636/3236], Loss: 3.1390, Perplexity: 23.0818
Epoch [1/3], Step [637/3236], Loss: 2.7224, Perplexity: 15.2161
Epoch [1/3], Step [638/3236], Loss: 2.8199, Perplexity: 16.7759
Epoch [1/3], Step [639/3236], Loss: 2.8615, Perplexity: 17.4886
Epoch [1/3], Step [640/3236], Loss: 2.7198, Perplexity: 15.1776
Epoch [1/3], Step [641/3236], Loss: 2.7641, Perplexity: 15.8641
Epoch [1/3], Step [642/3236], Loss: 2.7297, Perplexity: 15.3278
Epoch [1/3], Step [643/3236], Loss: 2.7319, Perplexity: 15.3617
Epoch [1/3], Step [644/3236], Loss: 2.8612, Perplexity: 17.4827
Epoch [1/3], Step [645/3236], Loss: 3.1265, Perplexity: 22.7945
Epoch [1/3], Step [646/3236], Loss: 2.8709, Perplexity: 17.6528
Epoch [1/3], Step [647/3236], Loss: 2.9865, Perplexity: 19.8165
Epoch [1/3], Step [648/3236], Loss: 2.7885, Perplexity: 16.2564
Epoch [1/3], Step [649/3236], Loss: 2.8084, Perplexity: 16.5834
Epoch [1/3], Step [650/3236], Loss: 2.9200, Perplexity: 18.5409
Epoch [1/3], Step [651/3236], Loss: 2.8439, Perplexity: 17.1834
Epoch [1/3], Step [652/3236], Loss: 2.8640, Perplexity: 17.5320
Epoch [1/3], Step [653/3236], Loss: 2.7986, Perplexity: 16.4223
Epoch [1/3], Step [654/3236], Loss: 2.8054, Perplexity: 16.5337
Epoch [1/3], Step [655/3236], Loss: 3.5814, Perplexity: 35.9236
Epoch [1/3], Step [656/3236], Loss: 3.3894, Perplexity: 29.6496
Epoch [1/3], Step [657/3236], Loss: 2.8558, Perplexity: 17.3886
Epoch [1/3], Step [658/3236], Loss: 2.9093, Perplexity: 18.3443
Epoch [1/3], Step [659/3236], Loss: 2.7813, Perplexity: 16.1393
Epoch [1/3], Step [660/3236], Loss: 2.7922, Perplexity: 16.3173
Epoch [1/3], Step [661/3236], Loss: 2.7169, Perplexity: 15.1332
Epoch [1/3], Step [662/3236], Loss: 2.9673, Perplexity: 19.4400
Epoch [1/3], Step [663/3236], Loss: 2.7042, Perplexity: 14.9428
Epoch [1/3], Step [664/3236], Loss: 2.7497, Perplexity: 15.6383
Epoch [1/3], Step [665/3236], Loss: 2.8226, Perplexity: 16.8210
Epoch [1/3], Step [666/3236], Loss: 2.8224, Perplexity: 16.8164
Epoch [1/3], Step [667/3236], Loss: 2.7904, Perplexity: 16.2869
Epoch [1/3], Step [668/3236], Loss: 2.8739, Perplexity: 17.7054
Epoch [1/3], Step [669/3236], Loss: 2.7674, Perplexity: 15.9173
Epoch [1/3], Step [670/3236], Loss: 2.7730, Perplexity: 16.0070
Epoch [1/3], Step [671/3236], Loss: 2.9140, Perplexity: 18.4296
Epoch [1/3], Step [672/3236], Loss: 2.7884, Perplexity: 16.2556
Epoch [1/3], Step [673/3236], Loss: 2.7257, Perplexity: 15.2674
Epoch [1/3], Step [674/3236], Loss: 2.8862, Perplexity: 17.9253
Epoch [1/3], Step [675/3236], Loss: 2.6236, Perplexity: 13.7849
Epoch [1/3], Step [676/3236], Loss: 2.7556, Perplexity: 15.7307
Epoch [1/3], Step [677/3236], Loss: 2.8334, Perplexity: 17.0028
Epoch [1/3], Step [678/3236], Loss: 2.9369, Perplexity: 18.8565
Epoch [1/3], Step [679/3236], Loss: 2.6503, Perplexity: 14.1577
Epoch [1/3], Step [680/3236], Loss: 3.0006, Perplexity: 20.0972
Epoch [1/3], Step [681/3236], Loss: 3.0141, Perplexity: 20.3700
Epoch [1/3], Step [682/3236], Loss: 2.8284, Perplexity: 16.9188
Epoch [1/3], Step [683/3236], Loss: 3.0853, Perplexity: 21.8744
Epoch [1/3], Step [684/3236], Loss: 2.6491, Perplexity: 14.1412
Epoch [1/3], Step [685/3236], Loss: 2.7469, Perplexity: 15.5936
Epoch [1/3], Step [686/3236], Loss: 2.8803, Perplexity: 17.8197
Epoch [1/3], Step [687/3236], Loss: 2.8854, Perplexity: 17.9100
Epoch [1/3], Step [688/3236], Loss: 3.1154, Perplexity: 22.5433
Epoch [1/3], Step [689/3236], Loss: 2.7842, Perplexity: 16.1869
Epoch [1/3], Step [690/3236], Loss: 2.8916, Perplexity: 18.0223
Epoch [1/3], Step [691/3236], Loss: 2.7818, Perplexity: 16.1487
Epoch [1/3], Step [692/3236], Loss: 2.9709, Perplexity: 19.5086
Epoch [1/3], Step [693/3236], Loss: 2.8041, Perplexity: 16.5124
Epoch [1/3], Step [694/3236], Loss: 2.7407, Perplexity: 15.4977
Epoch [1/3], Step [695/3236], Loss: 2.7786, Perplexity: 16.0966
Epoch [1/3], Step [696/3236], Loss: 2.7480, Perplexity: 15.6118
Epoch [1/3], Step [697/3236], Loss: 2.9761, Perplexity: 19.6120
Epoch [1/3], Step [698/3236], Loss: 2.8729, Perplexity: 17.6889
Epoch [1/3], Step [699/3236], Loss: 2.7534, Perplexity: 15.6957
Epoch [1/3], Step [700/3236], Loss: 3.4674, Perplexity: 32.0522
Epoch [1/3], Step [701/3236], Loss: 2.8912, Perplexity: 18.0149
Epoch [1/3], Step [702/3236], Loss: 2.7833, Perplexity: 16.1718
Epoch [1/3], Step [703/3236], Loss: 3.2405, Perplexity: 25.5467
Epoch [1/3], Step [704/3236], Loss: 2.8037, Perplexity: 16.5052
Epoch [1/3], Step [705/3236], Loss: 2.8832, Perplexity: 17.8711
Epoch [1/3], Step [706/3236], Loss: 2.6827, Perplexity: 14.6251
Epoch [1/3], Step [707/3236], Loss: 2.6966, Perplexity: 14.8287
Epoch [1/3], Step [708/3236], Loss: 2.8120, Perplexity: 16.6435
Epoch [1/3], Step [709/3236], Loss: 2.7300, Perplexity: 15.3326
Epoch [1/3], Step [710/3236], Loss: 2.6851, Perplexity: 14.6597
Epoch [1/3], Step [711/3236], Loss: 2.6849, Perplexity: 14.6573
Epoch [1/3], Step [712/3236], Loss: 2.9586, Perplexity: 19.2702
Epoch [1/3], Step [713/3236], Loss: 2.7358, Perplexity: 15.4223
Epoch [1/3], Step [714/3236], Loss: 2.9115, Perplexity: 18.3835
Epoch [1/3], Step [715/3236], Loss: 2.8422, Perplexity: 17.1530
Epoch [1/3], Step [716/3236], Loss: 2.7404, Perplexity: 15.4929
Epoch [1/3], Step [717/3236], Loss: 3.0175, Perplexity: 20.4408
Epoch [1/3], Step [718/3236], Loss: 2.8557, Perplexity: 17.3858
Epoch [1/3], Step [719/3236], Loss: 2.7153, Perplexity: 15.1089
Epoch [1/3], Step [720/3236], Loss: 2.8341, Perplexity: 17.0159
Epoch [1/3], Step [721/3236], Loss: 2.7985, Perplexity: 16.4204
Epoch [1/3], Step [722/3236], Loss: 2.8310, Perplexity: 16.9617
Epoch [1/3], Step [723/3236], Loss: 2.6637, Perplexity: 14.3486
Epoch [1/3], Step [724/3236], Loss: 2.6235, Perplexity: 13.7840
Epoch [1/3], Step [725/3236], Loss: 2.6339, Perplexity: 13.9279
Epoch [1/3], Step [726/3236], Loss: 2.7977, Perplexity: 16.4068
Epoch [1/3], Step [727/3236], Loss: 2.8867, Perplexity: 17.9348
Epoch [1/3], Step [728/3236], Loss: 2.7385, Perplexity: 15.4633
Epoch [1/3], Step [729/3236], Loss: 2.7349, Perplexity: 15.4082
Epoch [1/3], Step [730/3236], Loss: 2.6863, Perplexity: 14.6768
Epoch [1/3], Step [731/3236], Loss: 2.8733, Perplexity: 17.6958
Epoch [1/3], Step [732/3236], Loss: 2.7222, Perplexity: 15.2133
Epoch [1/3], Step [733/3236], Loss: 2.7453, Perplexity: 15.5692
Epoch [1/3], Step [734/3236], Loss: 2.7724, Perplexity: 15.9970
Epoch [1/3], Step [735/3236], Loss: 2.7657, Perplexity: 15.8908
Epoch [1/3], Step [736/3236], Loss: 2.7347, Perplexity: 15.4049
Epoch [1/3], Step [737/3236], Loss: 3.1781, Perplexity: 24.0020
Epoch [1/3], Step [738/3236], Loss: 3.0234, Perplexity: 20.5603
Epoch [1/3], Step [739/3236], Loss: 3.0459, Perplexity: 21.0280
Epoch [1/3], Step [740/3236], Loss: 3.0431, Perplexity: 20.9700
Epoch [1/3], Step [741/3236], Loss: 2.8435, Perplexity: 17.1751
Epoch [1/3], Step [742/3236], Loss: 2.7339, Perplexity: 15.3929
Epoch [1/3], Step [743/3236], Loss: 2.7382, Perplexity: 15.4587
Epoch [1/3], Step [744/3236], Loss: 2.9354, Perplexity: 18.8295
Epoch [1/3], Step [745/3236], Loss: 2.8937, Perplexity: 18.0605
Epoch [1/3], Step [746/3236], Loss: 2.7021, Perplexity: 14.9115
Epoch [1/3], Step [747/3236], Loss: 2.7252, Perplexity: 15.2596
Epoch [1/3], Step [748/3236], Loss: 2.7221, Perplexity: 15.2118
Epoch [1/3], Step [749/3236], Loss: 2.6589, Perplexity: 14.2812
Epoch [1/3], Step [750/3236], Loss: 2.8548, Perplexity: 17.3706
Epoch [1/3], Step [751/3236], Loss: 2.6502, Perplexity: 14.1569
Epoch [1/3], Step [752/3236], Loss: 2.8620, Perplexity: 17.4965
Epoch [1/3], Step [753/3236], Loss: 2.7055, Perplexity: 14.9613
Epoch [1/3], Step [754/3236], Loss: 2.7265, Perplexity: 15.2799
Epoch [1/3], Step [755/3236], Loss: 2.8784, Perplexity: 17.7859
Epoch [1/3], Step [756/3236], Loss: 2.6325, Perplexity: 13.9090
Epoch [1/3], Step [757/3236], Loss: 2.7694, Perplexity: 15.9484
Epoch [1/3], Step [758/3236], Loss: 2.8752, Perplexity: 17.7282
Epoch [1/3], Step [759/3236], Loss: 3.0085, Perplexity: 20.2565
Epoch [1/3], Step [760/3236], Loss: 2.6718, Perplexity: 14.4666
Epoch [1/3], Step [761/3236], Loss: 2.5288, Perplexity: 12.5385
Epoch [1/3], Step [762/3236], Loss: 2.8380, Perplexity: 17.0824
Epoch [1/3], Step [763/3236], Loss: 2.8962, Perplexity: 18.1061
Epoch [1/3], Step [764/3236], Loss: 2.6447, Perplexity: 14.0789
Epoch [1/3], Step [765/3236], Loss: 2.7320, Perplexity: 15.3635
Epoch [1/3], Step [766/3236], Loss: 3.7524, Perplexity: 42.6218
Epoch [1/3], Step [767/3236], Loss: 2.6884, Perplexity: 14.7080
Epoch [1/3], Step [768/3236], Loss: 2.6657, Perplexity: 14.3784
Epoch [1/3], Step [769/3236], Loss: 3.1270, Perplexity: 22.8044
Epoch [1/3], Step [770/3236], Loss: 2.5962, Perplexity: 13.4121
Epoch [1/3], Step [771/3236], Loss: 2.8303, Perplexity: 16.9511
Epoch [1/3], Step [772/3236], Loss: 2.6831, Perplexity: 14.6307
Epoch [1/3], Step [773/3236], Loss: 2.8295, Perplexity: 16.9372
Epoch [1/3], Step [774/3236], Loss: 2.6273, Perplexity: 13.8362
Epoch [1/3], Step [775/3236], Loss: 2.7164, Perplexity: 15.1265
Epoch [1/3], Step [776/3236], Loss: 2.7371, Perplexity: 15.4423
Epoch [1/3], Step [777/3236], Loss: 2.6817, Perplexity: 14.6093
Epoch [1/3], Step [778/3236], Loss: 2.6312, Perplexity: 13.8907
Epoch [1/3], Step [779/3236], Loss: 2.9086, Perplexity: 18.3313
Epoch [1/3], Step [780/3236], Loss: 2.6689, Perplexity: 14.4242
Epoch [1/3], Step [781/3236], Loss: 2.6673, Perplexity: 14.4005
Epoch [1/3], Step [782/3236], Loss: 2.6422, Perplexity: 14.0439
Epoch [1/3], Step [783/3236], Loss: 3.0305, Perplexity: 20.7072
Epoch [1/3], Step [784/3236], Loss: 2.7102, Perplexity: 15.0321
Epoch [1/3], Step [785/3236], Loss: 2.6107, Perplexity: 13.6090
Epoch [1/3], Step [786/3236], Loss: 2.5524, Perplexity: 12.8385
Epoch [1/3], Step [787/3236], Loss: 2.7839, Perplexity: 16.1816
Epoch [1/3], Step [788/3236], Loss: 2.7491, Perplexity: 15.6286
Epoch [1/3], Step [789/3236], Loss: 2.8651, Perplexity: 17.5508
Epoch [1/3], Step [790/3236], Loss: 2.6870, Perplexity: 14.6874
Epoch [1/3], Step [791/3236], Loss: 2.7484, Perplexity: 15.6171
Epoch [1/3], Step [792/3236], Loss: 2.7364, Perplexity: 15.4318
Epoch [1/3], Step [793/3236], Loss: 2.5224, Perplexity: 12.4583
Epoch [1/3], Step [794/3236], Loss: 2.6474, Perplexity: 14.1177
Epoch [1/3], Step [795/3236], Loss: 2.6917, Perplexity: 14.7565
Epoch [1/3], Step [796/3236], Loss: 2.7543, Perplexity: 15.7106
Epoch [1/3], Step [797/3236], Loss: 2.9984, Perplexity: 20.0535
Epoch [1/3], Step [798/3236], Loss: 2.8128, Perplexity: 16.6569
Epoch [1/3], Step [799/3236], Loss: 2.7153, Perplexity: 15.1085
Epoch [1/3], Step [800/3236], Loss: 2.5282, Perplexity: 12.5308
Epoch [1/3], Step [801/3236], Loss: 3.0101, Perplexity: 20.2903
Epoch [1/3], Step [802/3236], Loss: 2.5837, Perplexity: 13.2455
Epoch [1/3], Step [803/3236], Loss: 2.7598, Perplexity: 15.7961
Epoch [1/3], Step [804/3236], Loss: 2.6538, Perplexity: 14.2081
Epoch [1/3], Step [805/3236], Loss: 2.7055, Perplexity: 14.9621
Epoch [1/3], Step [806/3236], Loss: 3.2580, Perplexity: 25.9972
Epoch [1/3], Step [807/3236], Loss: 2.6098, Perplexity: 13.5963
Epoch [1/3], Step [808/3236], Loss: 2.6514, Perplexity: 14.1738
Epoch [1/3], Step [809/3236], Loss: 2.6483, Perplexity: 14.1295
Epoch [1/3], Step [810/3236], Loss: 2.5578, Perplexity: 12.9074
Epoch [1/3], Step [811/3236], Loss: 2.5711, Perplexity: 13.0797
Epoch [1/3], Step [812/3236], Loss: 2.6947, Perplexity: 14.8012
Epoch [1/3], Step [813/3236], Loss: 2.7189, Perplexity: 15.1630
Epoch [1/3], Step [814/3236], Loss: 2.8459, Perplexity: 17.2175
Epoch [1/3], Step [815/3236], Loss: 2.5028, Perplexity: 12.2163
Epoch [1/3], Step [816/3236], Loss: 2.6162, Perplexity: 13.6832
Epoch [1/3], Step [817/3236], Loss: 2.6773, Perplexity: 14.5457
Epoch [1/3], Step [818/3236], Loss: 2.6678, Perplexity: 14.4076
Epoch [1/3], Step [819/3236], Loss: 3.5658, Perplexity: 35.3664
Epoch [1/3], Step [820/3236], Loss: 2.6834, Perplexity: 14.6352
Epoch [1/3], Step [821/3236], Loss: 2.7249, Perplexity: 15.2546
Epoch [1/3], Step [822/3236], Loss: 2.5616, Perplexity: 12.9567
Epoch [1/3], Step [823/3236], Loss: 2.7221, Perplexity: 15.2127
Epoch [1/3], Step [824/3236], Loss: 3.0775, Perplexity: 21.7051
Epoch [1/3], Step [825/3236], Loss: 2.6935, Perplexity: 14.7828
Epoch [1/3], Step [826/3236], Loss: 2.5780, Perplexity: 13.1702
Epoch [1/3], Step [827/3236], Loss: 2.6632, Perplexity: 14.3424
Epoch [1/3], Step [828/3236], Loss: 2.5637, Perplexity: 12.9832
Epoch [1/3], Step [829/3236], Loss: 2.8151, Perplexity: 16.6954
Epoch [1/3], Step [830/3236], Loss: 2.7208, Perplexity: 15.1928
Epoch [1/3], Step [831/3236], Loss: 2.9444, Perplexity: 19.0001
Epoch [1/3], Step [832/3236], Loss: 2.6723, Perplexity: 14.4737
Epoch [1/3], Step [833/3236], Loss: 2.6448, Perplexity: 14.0801
Epoch [1/3], Step [834/3236], Loss: 2.6239, Perplexity: 13.7894
Epoch [1/3], Step [835/3236], Loss: 2.7336, Perplexity: 15.3882
Epoch [1/3], Step [836/3236], Loss: 2.6060, Perplexity: 13.5448
Epoch [1/3], Step [837/3236], Loss: 2.6806, Perplexity: 14.5939
Epoch [1/3], Step [838/3236], Loss: 2.8642, Perplexity: 17.5351
Epoch [1/3], Step [839/3236], Loss: 2.7378, Perplexity: 15.4522
Epoch [1/3], Step [840/3236], Loss: 2.6775, Perplexity: 14.5484
Epoch [1/3], Step [841/3236], Loss: 2.8013, Perplexity: 16.4664
Epoch [1/3], Step [842/3236], Loss: 2.5443, Perplexity: 12.7348
Epoch [1/3], Step [843/3236], Loss: 2.5538, Perplexity: 12.8562
Epoch [1/3], Step [844/3236], Loss: 2.5444, Perplexity: 12.7358
Epoch [1/3], Step [845/3236], Loss: 2.8404, Perplexity: 17.1234
Epoch [1/3], Step [846/3236], Loss: 2.6898, Perplexity: 14.7288
Epoch [1/3], Step [847/3236], Loss: 2.7823, Perplexity: 16.1559
Epoch [1/3], Step [848/3236], Loss: 2.6614, Perplexity: 14.3157
Epoch [1/3], Step [849/3236], Loss: 2.8267, Perplexity: 16.8903
Epoch [1/3], Step [850/3236], Loss: 2.6516, Perplexity: 14.1763
Epoch [1/3], Step [851/3236], Loss: 2.5102, Perplexity: 12.3069
Epoch [1/3], Step [852/3236], Loss: 2.6221, Perplexity: 13.7644
Epoch [1/3], Step [853/3236], Loss: 2.9455, Perplexity: 19.0199
Epoch [1/3], Step [854/3236], Loss: 2.7578, Perplexity: 15.7656
Epoch [1/3], Step [855/3236], Loss: 2.6261, Perplexity: 13.8203
Epoch [1/3], Step [856/3236], Loss: 2.6557, Perplexity: 14.2349
Epoch [1/3], Step [857/3236], Loss: 3.1493, Perplexity: 23.3194
Epoch [1/3], Step [858/3236], Loss: 2.8453, Perplexity: 17.2063
Epoch [1/3], Step [859/3236], Loss: 2.6851, Perplexity: 14.6591
Epoch [1/3], Step [860/3236], Loss: 2.6035, Perplexity: 13.5111
Epoch [1/3], Step [861/3236], Loss: 2.6054, Perplexity: 13.5364
Epoch [1/3], Step [862/3236], Loss: 2.5526, Perplexity: 12.8406
Epoch [1/3], Step [863/3236], Loss: 2.6512, Perplexity: 14.1704
Epoch [1/3], Step [864/3236], Loss: 2.5383, Perplexity: 12.6582
Epoch [1/3], Step [865/3236], Loss: 2.8109, Perplexity: 16.6247
Epoch [1/3], Step [866/3236], Loss: 2.5532, Perplexity: 12.8483
Epoch [1/3], Step [867/3236], Loss: 2.4292, Perplexity: 11.3496
Epoch [1/3], Step [868/3236], Loss: 2.6491, Perplexity: 14.1418
Epoch [1/3], Step [869/3236], Loss: 3.4194, Perplexity: 30.5506
Epoch [1/3], Step [870/3236], Loss: 2.5462, Perplexity: 12.7588
Epoch [1/3], Step [871/3236], Loss: 3.0358, Perplexity: 20.8171
Epoch [1/3], Step [872/3236], Loss: 2.5818, Perplexity: 13.2204
Epoch [1/3], Step [873/3236], Loss: 2.4828, Perplexity: 11.9753
Epoch [1/3], Step [874/3236], Loss: 2.8366, Perplexity: 17.0569
Epoch [1/3], Step [875/3236], Loss: 2.5987, Perplexity: 13.4461
Epoch [1/3], Step [876/3236], Loss: 2.5748, Perplexity: 13.1283
Epoch [1/3], Step [877/3236], Loss: 2.6458, Perplexity: 14.0941
Epoch [1/3], Step [878/3236], Loss: 2.6807, Perplexity: 14.5948
Epoch [1/3], Step [879/3236], Loss: 2.4623, Perplexity: 11.7312
Epoch [1/3], Step [880/3236], Loss: 2.6058, Perplexity: 13.5427
Epoch [1/3], Step [881/3236], Loss: 2.5400, Perplexity: 12.6799
Epoch [1/3], Step [882/3236], Loss: 2.6692, Perplexity: 14.4281
Epoch [1/3], Step [883/3236], Loss: 2.7697, Perplexity: 15.9540
Epoch [1/3], Step [884/3236], Loss: 2.5081, Perplexity: 12.2818
Epoch [1/3], Step [885/3236], Loss: 3.0116, Perplexity: 20.3208
Epoch [1/3], Step [886/3236], Loss: 2.6426, Perplexity: 14.0501
Epoch [1/3], Step [887/3236], Loss: 2.9985, Perplexity: 20.0545
Epoch [1/3], Step [888/3236], Loss: 2.4216, Perplexity: 11.2638
Epoch [1/3], Step [889/3236], Loss: 2.6058, Perplexity: 13.5415
Epoch [1/3], Step [890/3236], Loss: 2.7407, Perplexity: 15.4973
Epoch [1/3], Step [891/3236], Loss: 3.9787, Perplexity: 53.4493
Epoch [1/3], Step [892/3236], Loss: 2.6160, Perplexity: 13.6813
Epoch [1/3], Step [893/3236], Loss: 2.5682, Perplexity: 13.0427
Epoch [1/3], Step [894/3236], Loss: 2.5407, Perplexity: 12.6888
Epoch [1/3], Step [895/3236], Loss: 2.9629, Perplexity: 19.3535
Epoch [1/3], Step [896/3236], Loss: 3.0277, Perplexity: 20.6502
Epoch [1/3], Step [897/3236], Loss: 2.6468, Perplexity: 14.1087
Epoch [1/3], Step [898/3236], Loss: 2.4088, Perplexity: 11.1204
Epoch [1/3], Step [899/3236], Loss: 2.8407, Perplexity: 17.1286
Epoch [1/3], Step [900/3236], Loss: 2.6232, Perplexity: 13.7804
Epoch [1/3], Step [901/3236], Loss: 2.7209, Perplexity: 15.1937
Epoch [1/3], Step [902/3236], Loss: 2.6537, Perplexity: 14.2061
Epoch [1/3], Step [903/3236], Loss: 2.6345, Perplexity: 13.9357
Epoch [1/3], Step [904/3236], Loss: 2.5948, Perplexity: 13.3946
Epoch [1/3], Step [905/3236], Loss: 2.5634, Perplexity: 12.9804
Epoch [1/3], Step [906/3236], Loss: 2.6883, Perplexity: 14.7067
Epoch [1/3], Step [907/3236], Loss: 2.6877, Perplexity: 14.6976
Epoch [1/3], Step [908/3236], Loss: 2.6498, Perplexity: 14.1512
Epoch [1/3], Step [909/3236], Loss: 2.6858, Perplexity: 14.6704
Epoch [1/3], Step [910/3236], Loss: 2.6946, Perplexity: 14.7995
Epoch [1/3], Step [911/3236], Loss: 2.6011, Perplexity: 13.4785
Epoch [1/3], Step [912/3236], Loss: 3.0636, Perplexity: 21.4036
Epoch [1/3], Step [913/3236], Loss: 2.4282, Perplexity: 11.3388
Epoch [1/3], Step [914/3236], Loss: 3.0399, Perplexity: 20.9038
Epoch [1/3], Step [915/3236], Loss: 2.5913, Perplexity: 13.3476
Epoch [1/3], Step [916/3236], Loss: 2.7715, Perplexity: 15.9830
Epoch [1/3], Step [917/3236], Loss: 2.6000, Perplexity: 13.4631
Epoch [1/3], Step [918/3236], Loss: 3.1207, Perplexity: 22.6627
Epoch [1/3], Step [919/3236], Loss: 2.5923, Perplexity: 13.3608
Epoch [1/3], Step [920/3236], Loss: 2.5950, Perplexity: 13.3967
Epoch [1/3], Step [921/3236], Loss: 2.5964, Perplexity: 13.4154
Epoch [1/3], Step [922/3236], Loss: 2.6088, Perplexity: 13.5828
Epoch [1/3], Step [923/3236], Loss: 2.7347, Perplexity: 15.4052
Epoch [1/3], Step [924/3236], Loss: 2.6964, Perplexity: 14.8266
Epoch [1/3], Step [925/3236], Loss: 2.4982, Perplexity: 12.1605
Epoch [1/3], Step [926/3236], Loss: 2.8116, Perplexity: 16.6372
Epoch [1/3], Step [927/3236], Loss: 2.7848, Perplexity: 16.1959
Epoch [1/3], Step [928/3236], Loss: 2.6186, Perplexity: 13.7162
Epoch [1/3], Step [929/3236], Loss: 2.5389, Perplexity: 12.6663
Epoch [1/3], Step [930/3236], Loss: 2.9083, Perplexity: 18.3262
Epoch [1/3], Step [931/3236], Loss: 2.6623, Perplexity: 14.3291
Epoch [1/3], Step [932/3236], Loss: 3.0133, Perplexity: 20.3547
Epoch [1/3], Step [933/3236], Loss: 3.1212, Perplexity: 22.6727
Epoch [1/3], Step [934/3236], Loss: 2.7189, Perplexity: 15.1640
Epoch [1/3], Step [935/3236], Loss: 2.9157, Perplexity: 18.4610
Epoch [1/3], Step [936/3236], Loss: 2.5820, Perplexity: 13.2241
Epoch [1/3], Step [937/3236], Loss: 2.6275, Perplexity: 13.8386
Epoch [1/3], Step [938/3236], Loss: 2.8899, Perplexity: 17.9920
Epoch [1/3], Step [939/3236], Loss: 2.8367, Perplexity: 17.0596
Epoch [1/3], Step [940/3236], Loss: 2.7669, Perplexity: 15.9086
Epoch [1/3], Step [941/3236], Loss: 2.7769, Perplexity: 16.0684
Epoch [1/3], Step [942/3236], Loss: 3.0448, Perplexity: 21.0066
Epoch [1/3], Step [943/3236], Loss: 2.6330, Perplexity: 13.9157
Epoch [1/3], Step [944/3236], Loss: 2.4823, Perplexity: 11.9683
Epoch [1/3], Step [945/3236], Loss: 2.7024, Perplexity: 14.9162
Epoch [1/3], Step [946/3236], Loss: 2.5259, Perplexity: 12.5016
Epoch [1/3], Step [947/3236], Loss: 2.5656, Perplexity: 13.0091
Epoch [1/3], Step [948/3236], Loss: 2.5978, Perplexity: 13.4339
Epoch [1/3], Step [949/3236], Loss: 2.4692, Perplexity: 11.8133
Epoch [1/3], Step [950/3236], Loss: 2.8244, Perplexity: 16.8515
Epoch [1/3], Step [951/3236], Loss: 2.6329, Perplexity: 13.9135
Epoch [1/3], Step [952/3236], Loss: 2.6515, Perplexity: 14.1751
Epoch [1/3], Step [953/3236], Loss: 2.5866, Perplexity: 13.2846
Epoch [1/3], Step [954/3236], Loss: 2.8365, Perplexity: 17.0560
Epoch [1/3], Step [955/3236], Loss: 2.6251, Perplexity: 13.8065
Epoch [1/3], Step [956/3236], Loss: 2.8982, Perplexity: 18.1422
Epoch [1/3], Step [957/3236], Loss: 2.6186, Perplexity: 13.7163
Epoch [1/3], Step [958/3236], Loss: 2.9538, Perplexity: 19.1792
Epoch [1/3], Step [959/3236], Loss: 2.7313, Perplexity: 15.3535
Epoch [1/3], Step [960/3236], Loss: 2.5509, Perplexity: 12.8191
Epoch [1/3], Step [961/3236], Loss: 2.5038, Perplexity: 12.2294
Epoch [1/3], Step [962/3236], Loss: 2.6802, Perplexity: 14.5882
Epoch [1/3], Step [963/3236], Loss: 2.5734, Perplexity: 13.1109
Epoch [1/3], Step [964/3236], Loss: 2.5190, Perplexity: 12.4166
Epoch [1/3], Step [965/3236], Loss: 2.9351, Perplexity: 18.8240
Epoch [1/3], Step [966/3236], Loss: 2.7169, Perplexity: 15.1330
Epoch [1/3], Step [967/3236], Loss: 2.6408, Perplexity: 14.0247
Epoch [1/3], Step [968/3236], Loss: 2.6024, Perplexity: 13.4961
Epoch [1/3], Step [969/3236], Loss: 2.4421, Perplexity: 11.4970
Epoch [1/3], Step [970/3236], Loss: 2.5564, Perplexity: 12.8893
Epoch [1/3], Step [971/3236], Loss: 2.6492, Perplexity: 14.1432
Epoch [1/3], Step [972/3236], Loss: 2.7428, Perplexity: 15.5298
Epoch [1/3], Step [973/3236], Loss: 2.6799, Perplexity: 14.5837
Epoch [1/3], Step [974/3236], Loss: 3.0183, Perplexity: 20.4566
Epoch [1/3], Step [975/3236], Loss: 2.8507, Perplexity: 17.2996
Epoch [1/3], Step [976/3236], Loss: 2.5544, Perplexity: 12.8633
Epoch [1/3], Step [977/3236], Loss: 2.6502, Perplexity: 14.1562
Epoch [1/3], Step [978/3236], Loss: 2.6062, Perplexity: 13.5472
Epoch [1/3], Step [979/3236], Loss: 2.6182, Perplexity: 13.7114
Epoch [1/3], Step [980/3236], Loss: 2.8648, Perplexity: 17.5464
Epoch [1/3], Step [981/3236], Loss: 2.5574, Perplexity: 12.9021
Epoch [1/3], Step [982/3236], Loss: 3.4838, Perplexity: 32.5834
Epoch [1/3], Step [983/3236], Loss: 2.8068, Perplexity: 16.5576
Epoch [1/3], Step [984/3236], Loss: 2.4912, Perplexity: 12.0754
Epoch [1/3], Step [985/3236], Loss: 2.5045, Perplexity: 12.2371
Epoch [1/3], Step [986/3236], Loss: 2.5446, Perplexity: 12.7380
Epoch [1/3], Step [987/3236], Loss: 2.6637, Perplexity: 14.3490
Epoch [1/3], Step [988/3236], Loss: 2.7392, Perplexity: 15.4747
Epoch [1/3], Step [989/3236], Loss: 3.0082, Perplexity: 20.2501
Epoch [1/3], Step [990/3236], Loss: 3.0020, Perplexity: 20.1263
Epoch [1/3], Step [991/3236], Loss: 2.6541, Perplexity: 14.2121
Epoch [1/3], Step [992/3236], Loss: 2.6466, Perplexity: 14.1066
Epoch [1/3], Step [993/3236], Loss: 2.6098, Perplexity: 13.5958
Epoch [1/3], Step [994/3236], Loss: 2.5833, Perplexity: 13.2402
Epoch [1/3], Step [995/3236], Loss: 2.5227, Perplexity: 12.4624
Epoch [1/3], Step [996/3236], Loss: 2.5919, Perplexity: 13.3553
Epoch [1/3], Step [997/3236], Loss: 2.5632, Perplexity: 12.9776
Epoch [1/3], Step [998/3236], Loss: 2.6483, Perplexity: 14.1297
Epoch [1/3], Step [999/3236], Loss: 2.6141, Perplexity: 13.6550
Epoch [1/3], Step [1000/3236], Loss: 2.4696, Perplexity: 11.8176