-
Notifications
You must be signed in to change notification settings - Fork 20
/
Copy pathtripadvisor.log
318 lines (318 loc) · 30.5 KB
/
tripadvisor.log
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
----------------------------------------ARGUMENTS----------------------------------------
data_path ../TripAdvisor/reviews.pickle
index_dir ../TripAdvisor/1/
emsize 512
nhead 2
nhid 2048
nlayers 2
dropout 0.2
lr 1.0
clip 1.0
epochs 100
batch_size 128
seed 1111
cuda True
log_interval 200
checkpoint ./tripadvisor/
outf generated.txt
vocab_size 20000
endure_times 5
rating_reg 0.1
context_reg 1.0
text_reg 1.0
peter_mask True
use_feature False
words 15
----------------------------------------ARGUMENTS----------------------------------------
[2020-12-29 14:11:35.050022]: Loading data
[2020-12-29 14:11:50.856955]: epoch 1
[2020-12-29 14:12:21.730064]: context ppl 1836.4891 | text ppl 1106.4780 | rating loss 3.2073 | 200/ 2001 batches
[2020-12-29 14:12:52.517633]: context ppl 694.3680 | text ppl 286.2935 | rating loss 1.4360 | 400/ 2001 batches
[2020-12-29 14:13:23.578007]: context ppl 599.3858 | text ppl 196.3800 | rating loss 1.1004 | 600/ 2001 batches
[2020-12-29 14:13:54.868208]: context ppl 543.7926 | text ppl 151.2607 | rating loss 0.9808 | 800/ 2001 batches
[2020-12-29 14:14:26.412160]: context ppl 516.1203 | text ppl 129.3417 | rating loss 0.9052 | 1000/ 2001 batches
[2020-12-29 14:14:58.061599]: context ppl 496.4487 | text ppl 113.7153 | rating loss 0.9224 | 1200/ 2001 batches
[2020-12-29 14:15:29.802045]: context ppl 491.3880 | text ppl 106.7144 | rating loss 0.9187 | 1400/ 2001 batches
[2020-12-29 14:16:01.629564]: context ppl 475.5303 | text ppl 98.4890 | rating loss 0.8942 | 1600/ 2001 batches
[2020-12-29 14:16:33.478477]: context ppl 468.0623 | text ppl 91.8357 | rating loss 0.8760 | 1800/ 2001 batches
[2020-12-29 14:17:05.395962]: context ppl 462.8390 | text ppl 87.6161 | rating loss 0.8925 | 2000/ 2001 batches
[2020-12-29 14:17:05.447562]: context ppl 527.2747 | text ppl 125.7638 | rating loss 0.5788 | 2001/ 2001 batches
[2020-12-29 14:17:19.618336]: context ppl 446.4529 | text ppl 76.3601 | rating loss 0.8230 | valid loss 5.1585 on validation
[2020-12-29 14:17:20.296436]: epoch 2
[2020-12-29 14:17:52.548445]: context ppl 464.4520 | text ppl 81.7132 | rating loss 0.8468 | 200/ 2001 batches
[2020-12-29 14:18:25.751177]: context ppl 457.3040 | text ppl 79.3563 | rating loss 0.8300 | 400/ 2001 batches
[2020-12-29 14:18:59.264277]: context ppl 457.9934 | text ppl 77.3199 | rating loss 0.8367 | 600/ 2001 batches
[2020-12-29 14:19:33.070287]: context ppl 452.1996 | text ppl 73.8356 | rating loss 0.8163 | 800/ 2001 batches
[2020-12-29 14:20:06.967757]: context ppl 447.9152 | text ppl 71.8837 | rating loss 0.8318 | 1000/ 2001 batches
[2020-12-29 14:20:41.681177]: context ppl 448.5761 | text ppl 71.4536 | rating loss 0.8388 | 1200/ 2001 batches
[2020-12-29 14:21:15.890003]: context ppl 442.8861 | text ppl 69.6038 | rating loss 0.8383 | 1400/ 2001 batches
[2020-12-29 14:21:50.459367]: context ppl 444.8922 | text ppl 68.7888 | rating loss 0.8480 | 1600/ 2001 batches
[2020-12-29 14:22:24.980556]: context ppl 441.9836 | text ppl 66.5362 | rating loss 0.8423 | 1800/ 2001 batches
[2020-12-29 14:22:59.544469]: context ppl 439.9047 | text ppl 65.5409 | rating loss 0.8385 | 2000/ 2001 batches
[2020-12-29 14:22:59.594272]: context ppl 411.7820 | text ppl 88.4304 | rating loss 1.1164 | 2001/ 2001 batches
[2020-12-29 14:23:14.426399]: context ppl 427.9917 | text ppl 60.6693 | rating loss 0.8359 | valid loss 4.9414 on validation
[2020-12-29 14:23:15.115889]: epoch 3
[2020-12-29 14:23:47.742930]: context ppl 439.2449 | text ppl 61.9902 | rating loss 0.8193 | 200/ 2001 batches
[2020-12-29 14:24:20.851150]: context ppl 434.2343 | text ppl 60.6941 | rating loss 0.8405 | 400/ 2001 batches
[2020-12-29 14:24:53.619015]: context ppl 439.3744 | text ppl 61.1224 | rating loss 0.8525 | 600/ 2001 batches
[2020-12-29 14:25:27.260145]: context ppl 439.0577 | text ppl 60.9220 | rating loss 0.8370 | 800/ 2001 batches
[2020-12-29 14:26:00.958513]: context ppl 435.4294 | text ppl 59.9073 | rating loss 0.8126 | 1000/ 2001 batches
[2020-12-29 14:26:35.022472]: context ppl 433.5999 | text ppl 58.6897 | rating loss 0.8403 | 1200/ 2001 batches
[2020-12-29 14:27:09.343608]: context ppl 432.9772 | text ppl 58.6206 | rating loss 0.8421 | 1400/ 2001 batches
[2020-12-29 14:27:43.361147]: context ppl 435.4720 | text ppl 58.4726 | rating loss 0.8280 | 1600/ 2001 batches
[2020-12-29 14:28:17.641727]: context ppl 431.6056 | text ppl 57.7315 | rating loss 0.8299 | 1800/ 2001 batches
[2020-12-29 14:28:51.876623]: context ppl 430.6541 | text ppl 56.8596 | rating loss 0.8320 | 2000/ 2001 batches
[2020-12-29 14:28:51.926959]: context ppl 463.5776 | text ppl 66.9253 | rating loss 0.7922 | 2001/ 2001 batches
[2020-12-29 14:29:07.311434]: context ppl 424.4478 | text ppl 53.1160 | rating loss 0.8248 | valid loss 4.7972 on validation
[2020-12-29 14:29:07.957124]: epoch 4
[2020-12-29 14:29:41.699259]: context ppl 432.0171 | text ppl 54.0047 | rating loss 0.8242 | 200/ 2001 batches
[2020-12-29 14:30:16.062907]: context ppl 429.8864 | text ppl 53.9049 | rating loss 0.8424 | 400/ 2001 batches
[2020-12-29 14:30:50.216031]: context ppl 428.2489 | text ppl 53.7603 | rating loss 0.8039 | 600/ 2001 batches
[2020-12-29 14:31:24.733390]: context ppl 428.4649 | text ppl 53.5584 | rating loss 0.8380 | 800/ 2001 batches
[2020-12-29 14:31:59.602581]: context ppl 426.6162 | text ppl 52.7816 | rating loss 0.8290 | 1000/ 2001 batches
[2020-12-29 14:32:34.564809]: context ppl 429.0897 | text ppl 53.3115 | rating loss 0.8261 | 1200/ 2001 batches
[2020-12-29 14:33:09.278940]: context ppl 426.4484 | text ppl 52.9490 | rating loss 0.8370 | 1400/ 2001 batches
[2020-12-29 14:33:44.350071]: context ppl 429.7043 | text ppl 53.0609 | rating loss 0.8259 | 1600/ 2001 batches
[2020-12-29 14:34:19.491460]: context ppl 429.2980 | text ppl 52.6857 | rating loss 0.8530 | 1800/ 2001 batches
[2020-12-29 14:34:54.826845]: context ppl 429.9296 | text ppl 52.3883 | rating loss 0.8186 | 2000/ 2001 batches
[2020-12-29 14:34:54.877294]: context ppl 378.9901 | text ppl 38.0178 | rating loss 1.1184 | 2001/ 2001 batches
[2020-12-29 14:35:10.551495]: context ppl 425.8264 | text ppl 49.8472 | rating loss 0.8384 | valid loss 4.7474 on validation
[2020-12-29 14:35:11.193265]: epoch 5
[2020-12-29 14:35:46.591003]: context ppl 424.8838 | text ppl 49.2134 | rating loss 0.8266 | 200/ 2001 batches
[2020-12-29 14:36:21.760549]: context ppl 427.4821 | text ppl 49.7842 | rating loss 0.8283 | 400/ 2001 batches
[2020-12-29 14:36:56.642837]: context ppl 424.4872 | text ppl 49.4916 | rating loss 0.8198 | 600/ 2001 batches
[2020-12-29 14:37:30.561254]: context ppl 424.1673 | text ppl 49.6128 | rating loss 0.8164 | 800/ 2001 batches
[2020-12-29 14:38:05.030283]: context ppl 426.5820 | text ppl 49.9538 | rating loss 0.8254 | 1000/ 2001 batches
[2020-12-29 14:38:39.076091]: context ppl 419.2555 | text ppl 49.0287 | rating loss 0.8348 | 1200/ 2001 batches
[2020-12-29 14:39:13.192420]: context ppl 424.4686 | text ppl 49.4375 | rating loss 0.8022 | 1400/ 2001 batches
[2020-12-29 14:39:47.395085]: context ppl 417.9657 | text ppl 48.7663 | rating loss 0.7992 | 1600/ 2001 batches
[2020-12-29 14:40:21.582462]: context ppl 421.8316 | text ppl 49.0125 | rating loss 0.8079 | 1800/ 2001 batches
[2020-12-29 14:40:55.211979]: context ppl 418.7921 | text ppl 48.8841 | rating loss 0.8035 | 2000/ 2001 batches
[2020-12-29 14:40:55.263158]: context ppl 518.4349 | text ppl 67.0438 | rating loss 0.8022 | 2001/ 2001 batches
[2020-12-29 14:41:10.247683]: context ppl 418.3504 | text ppl 47.6164 | rating loss 0.7775 | valid loss 4.6407 on validation
[2020-12-29 14:41:10.896729]: epoch 6
[2020-12-29 14:41:44.253932]: context ppl 418.0905 | text ppl 46.5090 | rating loss 0.8064 | 200/ 2001 batches
[2020-12-29 14:42:18.178298]: context ppl 416.2428 | text ppl 46.3101 | rating loss 0.7842 | 400/ 2001 batches
[2020-12-29 14:42:51.861592]: context ppl 412.8406 | text ppl 46.0159 | rating loss 0.7868 | 600/ 2001 batches
[2020-12-29 14:43:25.799432]: context ppl 414.4428 | text ppl 46.2942 | rating loss 0.7810 | 800/ 2001 batches
[2020-12-29 14:43:59.329259]: context ppl 413.7394 | text ppl 46.1983 | rating loss 0.7722 | 1000/ 2001 batches
[2020-12-29 14:44:32.826402]: context ppl 414.1241 | text ppl 46.5927 | rating loss 0.7701 | 1200/ 2001 batches
[2020-12-29 14:45:06.830555]: context ppl 418.2089 | text ppl 46.8941 | rating loss 0.7705 | 1400/ 2001 batches
[2020-12-29 14:45:41.271569]: context ppl 417.5336 | text ppl 46.9962 | rating loss 0.7733 | 1600/ 2001 batches
[2020-12-29 14:46:15.777150]: context ppl 412.7497 | text ppl 46.3830 | rating loss 0.7720 | 1800/ 2001 batches
[2020-12-29 14:46:50.096077]: context ppl 413.7396 | text ppl 46.3798 | rating loss 0.7677 | 2000/ 2001 batches
[2020-12-29 14:46:50.147504]: context ppl 339.6064 | text ppl 44.2098 | rating loss 0.8491 | 2001/ 2001 batches
[2020-12-29 14:47:05.523946]: context ppl 413.8967 | text ppl 46.2380 | rating loss 0.7355 | valid loss 4.5693 on validation
[2020-12-29 14:47:06.196139]: epoch 7
[2020-12-29 14:47:39.862744]: context ppl 408.6144 | text ppl 43.3952 | rating loss 0.7494 | 200/ 2001 batches
[2020-12-29 14:48:14.239239]: context ppl 406.8658 | text ppl 43.5377 | rating loss 0.7419 | 400/ 2001 batches
[2020-12-29 14:48:48.657894]: context ppl 409.1504 | text ppl 44.0829 | rating loss 0.7469 | 600/ 2001 batches
[2020-12-29 14:49:23.542431]: context ppl 405.0648 | text ppl 44.1887 | rating loss 0.7459 | 800/ 2001 batches
[2020-12-29 14:49:58.446339]: context ppl 405.3415 | text ppl 44.1271 | rating loss 0.7534 | 1000/ 2001 batches
[2020-12-29 14:50:33.533211]: context ppl 404.3802 | text ppl 43.9864 | rating loss 0.7327 | 1200/ 2001 batches
[2020-12-29 14:51:08.316226]: context ppl 406.7367 | text ppl 44.5738 | rating loss 0.7376 | 1400/ 2001 batches
[2020-12-29 14:51:42.534214]: context ppl 405.1585 | text ppl 43.9049 | rating loss 0.7341 | 1600/ 2001 batches
[2020-12-29 14:52:16.763734]: context ppl 405.9404 | text ppl 44.2410 | rating loss 0.7235 | 1800/ 2001 batches
[2020-12-29 14:52:51.113819]: context ppl 404.7403 | text ppl 44.5746 | rating loss 0.7276 | 2000/ 2001 batches
[2020-12-29 14:52:51.164906]: context ppl 483.4615 | text ppl 49.8120 | rating loss 1.0936 | 2001/ 2001 batches
[2020-12-29 14:53:06.377310]: context ppl 410.3192 | text ppl 44.6065 | rating loss 0.7222 | valid loss 4.5201 on validation
[2020-12-29 14:53:07.027157]: epoch 8
[2020-12-29 14:53:40.896570]: context ppl 394.6344 | text ppl 41.1680 | rating loss 0.7091 | 200/ 2001 batches
[2020-12-29 14:54:15.483630]: context ppl 397.2153 | text ppl 41.7242 | rating loss 0.7133 | 400/ 2001 batches
[2020-12-29 14:54:49.738249]: context ppl 401.1291 | text ppl 42.0736 | rating loss 0.7117 | 600/ 2001 batches
[2020-12-29 14:55:24.177440]: context ppl 398.7657 | text ppl 42.2741 | rating loss 0.6835 | 800/ 2001 batches
[2020-12-29 14:55:58.583364]: context ppl 399.8539 | text ppl 42.6555 | rating loss 0.7203 | 1000/ 2001 batches
[2020-12-29 14:56:32.887821]: context ppl 398.8840 | text ppl 42.3791 | rating loss 0.6950 | 1200/ 2001 batches
[2020-12-29 14:57:06.929598]: context ppl 392.5401 | text ppl 41.9314 | rating loss 0.7081 | 1400/ 2001 batches
[2020-12-29 14:57:40.957158]: context ppl 398.8708 | text ppl 42.8220 | rating loss 0.7081 | 1600/ 2001 batches
[2020-12-29 14:58:14.978904]: context ppl 395.8408 | text ppl 42.4480 | rating loss 0.7133 | 1800/ 2001 batches
[2020-12-29 14:58:49.351942]: context ppl 396.4183 | text ppl 42.2554 | rating loss 0.6977 | 2000/ 2001 batches
[2020-12-29 14:58:49.402984]: context ppl 507.4609 | text ppl 49.9719 | rating loss 0.8048 | 2001/ 2001 batches
[2020-12-29 14:59:04.470163]: context ppl 404.1415 | text ppl 43.4060 | rating loss 0.6906 | valid loss 4.4612 on validation
[2020-12-29 14:59:05.124938]: epoch 9
[2020-12-29 14:59:38.994912]: context ppl 388.5742 | text ppl 39.3786 | rating loss 0.6765 | 200/ 2001 batches
[2020-12-29 15:00:13.254084]: context ppl 385.8133 | text ppl 40.0581 | rating loss 0.6775 | 400/ 2001 batches
[2020-12-29 15:00:47.680677]: context ppl 390.9036 | text ppl 40.5130 | rating loss 0.6849 | 600/ 2001 batches
[2020-12-29 15:01:22.080491]: context ppl 387.2760 | text ppl 40.2077 | rating loss 0.6845 | 800/ 2001 batches
[2020-12-29 15:01:56.758619]: context ppl 389.5659 | text ppl 40.6337 | rating loss 0.6890 | 1000/ 2001 batches
[2020-12-29 15:02:31.096625]: context ppl 388.5596 | text ppl 40.5029 | rating loss 0.6851 | 1200/ 2001 batches
[2020-12-29 15:03:05.436436]: context ppl 389.3451 | text ppl 40.6608 | rating loss 0.6902 | 1400/ 2001 batches
[2020-12-29 15:03:40.024757]: context ppl 388.1493 | text ppl 40.7764 | rating loss 0.6706 | 1600/ 2001 batches
[2020-12-29 15:04:14.436243]: context ppl 391.8809 | text ppl 41.3353 | rating loss 0.6834 | 1800/ 2001 batches
[2020-12-29 15:04:48.784549]: context ppl 388.2154 | text ppl 40.8195 | rating loss 0.6779 | 2000/ 2001 batches
[2020-12-29 15:04:48.836218]: context ppl 409.1436 | text ppl 36.6627 | rating loss 1.5261 | 2001/ 2001 batches
[2020-12-29 15:05:03.992302]: context ppl 400.8732 | text ppl 42.7443 | rating loss 0.7505 | valid loss 4.5057 on validation
[2020-12-29 15:05:03.992722]: Endured 1 time(s)
[2020-12-29 15:05:03.992837]: Learning rate set to 0.25000000
[2020-12-29 15:05:03.992859]: epoch 10
[2020-12-29 15:05:38.689277]: context ppl 369.6563 | text ppl 36.1532 | rating loss 0.6422 | 200/ 2001 batches
[2020-12-29 15:06:12.929282]: context ppl 370.5445 | text ppl 35.4919 | rating loss 0.6436 | 400/ 2001 batches
[2020-12-29 15:06:47.592905]: context ppl 370.1465 | text ppl 35.3163 | rating loss 0.6260 | 600/ 2001 batches
[2020-12-29 15:07:22.387755]: context ppl 370.3558 | text ppl 35.2964 | rating loss 0.6469 | 800/ 2001 batches
[2020-12-29 15:07:57.218903]: context ppl 369.3630 | text ppl 35.2208 | rating loss 0.6351 | 1000/ 2001 batches
[2020-12-29 15:08:31.830255]: context ppl 368.4427 | text ppl 35.3281 | rating loss 0.6377 | 1200/ 2001 batches
[2020-12-29 15:09:06.562912]: context ppl 367.1030 | text ppl 35.0270 | rating loss 0.6387 | 1400/ 2001 batches
[2020-12-29 15:09:41.702421]: context ppl 369.9432 | text ppl 35.3397 | rating loss 0.6469 | 1600/ 2001 batches
[2020-12-29 15:10:16.507404]: context ppl 371.4621 | text ppl 35.2489 | rating loss 0.6295 | 1800/ 2001 batches
[2020-12-29 15:10:51.242094]: context ppl 372.2979 | text ppl 35.1187 | rating loss 0.6377 | 2000/ 2001 batches
[2020-12-29 15:10:51.291449]: context ppl 371.5290 | text ppl 40.1409 | rating loss 0.6036 | 2001/ 2001 batches
[2020-12-29 15:11:06.630028]: context ppl 396.0717 | text ppl 39.9762 | rating loss 0.6679 | valid loss 4.3561 on validation
[2020-12-29 15:11:07.254739]: epoch 11
[2020-12-29 15:11:41.803585]: context ppl 361.7413 | text ppl 33.4464 | rating loss 0.6314 | 200/ 2001 batches
[2020-12-29 15:12:16.793861]: context ppl 365.2861 | text ppl 33.9487 | rating loss 0.6265 | 400/ 2001 batches
[2020-12-29 15:12:51.891340]: context ppl 365.7936 | text ppl 34.2649 | rating loss 0.6273 | 600/ 2001 batches
[2020-12-29 15:13:27.200201]: context ppl 367.0496 | text ppl 34.3936 | rating loss 0.6301 | 800/ 2001 batches
[2020-12-29 15:14:01.754719]: context ppl 364.3956 | text ppl 34.1354 | rating loss 0.6416 | 1000/ 2001 batches
[2020-12-29 15:14:36.503509]: context ppl 366.6417 | text ppl 34.6968 | rating loss 0.6397 | 1200/ 2001 batches
[2020-12-29 15:15:11.407832]: context ppl 366.0114 | text ppl 34.3398 | rating loss 0.6282 | 1400/ 2001 batches
[2020-12-29 15:15:45.996271]: context ppl 366.3227 | text ppl 34.1659 | rating loss 0.6404 | 1600/ 2001 batches
[2020-12-29 15:16:20.236354]: context ppl 367.9795 | text ppl 34.3626 | rating loss 0.6258 | 1800/ 2001 batches
[2020-12-29 15:16:54.895290]: context ppl 366.2408 | text ppl 34.1553 | rating loss 0.6331 | 2000/ 2001 batches
[2020-12-29 15:16:54.957657]: context ppl 501.8646 | text ppl 44.6527 | rating loss 0.5209 | 2001/ 2001 batches
[2020-12-29 15:17:09.942128]: context ppl 396.6296 | text ppl 39.7269 | rating loss 0.6580 | valid loss 4.3400 on validation
[2020-12-29 15:17:10.568222]: epoch 12
[2020-12-29 15:17:44.114260]: context ppl 362.1960 | text ppl 33.2377 | rating loss 0.6246 | 200/ 2001 batches
[2020-12-29 15:18:18.357339]: context ppl 359.3000 | text ppl 33.0440 | rating loss 0.6191 | 400/ 2001 batches
[2020-12-29 15:18:52.684405]: context ppl 362.1997 | text ppl 33.4096 | rating loss 0.6298 | 600/ 2001 batches
[2020-12-29 15:19:27.364175]: context ppl 365.1554 | text ppl 33.5341 | rating loss 0.6389 | 800/ 2001 batches
[2020-12-29 15:20:01.475799]: context ppl 362.3110 | text ppl 33.6160 | rating loss 0.6292 | 1000/ 2001 batches
[2020-12-29 15:20:35.704990]: context ppl 361.2778 | text ppl 33.3846 | rating loss 0.6261 | 1200/ 2001 batches
[2020-12-29 15:21:09.794269]: context ppl 364.7855 | text ppl 33.8860 | rating loss 0.6324 | 1400/ 2001 batches
[2020-12-29 15:21:43.747477]: context ppl 359.9407 | text ppl 33.5113 | rating loss 0.6190 | 1600/ 2001 batches
[2020-12-29 15:22:18.004312]: context ppl 362.4733 | text ppl 33.8521 | rating loss 0.6309 | 1800/ 2001 batches
[2020-12-29 15:22:52.404311]: context ppl 364.0018 | text ppl 33.8369 | rating loss 0.6239 | 2000/ 2001 batches
[2020-12-29 15:22:52.467383]: context ppl 371.4834 | text ppl 41.7608 | rating loss 0.6519 | 2001/ 2001 batches
[2020-12-29 15:23:07.368955]: context ppl 396.6000 | text ppl 39.5217 | rating loss 0.6557 | valid loss 4.3325 on validation
[2020-12-29 15:23:08.003536]: epoch 13
[2020-12-29 15:23:42.274753]: context ppl 357.3040 | text ppl 32.8301 | rating loss 0.6266 | 200/ 2001 batches
[2020-12-29 15:24:16.564899]: context ppl 357.6059 | text ppl 32.8661 | rating loss 0.6296 | 400/ 2001 batches
[2020-12-29 15:24:51.256842]: context ppl 358.4692 | text ppl 32.6426 | rating loss 0.6142 | 600/ 2001 batches
[2020-12-29 15:25:26.444987]: context ppl 358.2129 | text ppl 32.8128 | rating loss 0.6300 | 800/ 2001 batches
[2020-12-29 15:26:01.168461]: context ppl 359.9562 | text ppl 32.9047 | rating loss 0.6175 | 1000/ 2001 batches
[2020-12-29 15:26:36.264873]: context ppl 358.4324 | text ppl 32.9809 | rating loss 0.6143 | 1200/ 2001 batches
[2020-12-29 15:27:11.079250]: context ppl 359.5548 | text ppl 33.1832 | rating loss 0.6316 | 1400/ 2001 batches
[2020-12-29 15:27:46.036230]: context ppl 359.7895 | text ppl 32.9755 | rating loss 0.6297 | 1600/ 2001 batches
[2020-12-29 15:28:20.509179]: context ppl 360.9312 | text ppl 33.1937 | rating loss 0.6302 | 1800/ 2001 batches
[2020-12-29 15:28:54.897744]: context ppl 361.4689 | text ppl 33.2124 | rating loss 0.6129 | 2000/ 2001 batches
[2020-12-29 15:28:54.947815]: context ppl 403.3680 | text ppl 35.8533 | rating loss 1.4392 | 2001/ 2001 batches
[2020-12-29 15:29:09.965002]: context ppl 395.1228 | text ppl 39.3427 | rating loss 0.6546 | valid loss 4.3269 on validation
[2020-12-29 15:29:10.664970]: epoch 14
[2020-12-29 15:29:44.292141]: context ppl 352.5157 | text ppl 31.9569 | rating loss 0.6223 | 200/ 2001 batches
[2020-12-29 15:30:18.544787]: context ppl 353.8296 | text ppl 32.0289 | rating loss 0.6128 | 400/ 2001 batches
[2020-12-29 15:30:53.246353]: context ppl 354.1137 | text ppl 32.1413 | rating loss 0.6237 | 600/ 2001 batches
[2020-12-29 15:31:27.956422]: context ppl 355.6361 | text ppl 32.2837 | rating loss 0.6202 | 800/ 2001 batches
[2020-12-29 15:32:02.676946]: context ppl 356.9558 | text ppl 32.5010 | rating loss 0.6217 | 1000/ 2001 batches
[2020-12-29 15:32:37.391146]: context ppl 355.1213 | text ppl 32.2743 | rating loss 0.6116 | 1200/ 2001 batches
[2020-12-29 15:33:11.956303]: context ppl 359.1270 | text ppl 32.6635 | rating loss 0.6151 | 1400/ 2001 batches
[2020-12-29 15:33:46.615399]: context ppl 357.7959 | text ppl 32.7596 | rating loss 0.6200 | 1600/ 2001 batches
[2020-12-29 15:34:21.399551]: context ppl 358.3766 | text ppl 32.7963 | rating loss 0.6194 | 1800/ 2001 batches
[2020-12-29 15:34:56.489999]: context ppl 358.5211 | text ppl 33.0364 | rating loss 0.6264 | 2000/ 2001 batches
[2020-12-29 15:34:56.539742]: context ppl 352.9991 | text ppl 38.4578 | rating loss 0.6575 | 2001/ 2001 batches
[2020-12-29 15:35:11.902860]: context ppl 392.8261 | text ppl 39.1278 | rating loss 0.6549 | valid loss 4.3217 on validation
[2020-12-29 15:35:12.554361]: epoch 15
[2020-12-29 15:35:46.681949]: context ppl 352.5132 | text ppl 31.6620 | rating loss 0.6121 | 200/ 2001 batches
[2020-12-29 15:36:21.950587]: context ppl 350.5404 | text ppl 31.4732 | rating loss 0.6162 | 400/ 2001 batches
[2020-12-29 15:36:57.005310]: context ppl 352.6712 | text ppl 31.8949 | rating loss 0.6083 | 600/ 2001 batches
[2020-12-29 15:37:31.760077]: context ppl 349.1597 | text ppl 31.6382 | rating loss 0.6261 | 800/ 2001 batches
[2020-12-29 15:38:06.713046]: context ppl 351.9651 | text ppl 31.9320 | rating loss 0.6152 | 1000/ 2001 batches
[2020-12-29 15:38:42.640768]: context ppl 355.5831 | text ppl 32.1573 | rating loss 0.6210 | 1200/ 2001 batches
[2020-12-29 15:39:18.131054]: context ppl 356.8129 | text ppl 32.3768 | rating loss 0.6207 | 1400/ 2001 batches
[2020-12-29 15:39:54.017776]: context ppl 353.5014 | text ppl 32.4123 | rating loss 0.6212 | 1600/ 2001 batches
[2020-12-29 15:40:29.410809]: context ppl 356.3606 | text ppl 32.3378 | rating loss 0.6133 | 1800/ 2001 batches
[2020-12-29 15:41:04.621717]: context ppl 353.2834 | text ppl 31.8944 | rating loss 0.6133 | 2000/ 2001 batches
[2020-12-29 15:41:04.670949]: context ppl 342.8535 | text ppl 34.6568 | rating loss 0.4514 | 2001/ 2001 batches
[2020-12-29 15:41:19.943573]: context ppl 394.4943 | text ppl 39.2647 | rating loss 0.6600 | valid loss 4.3303 on validation
[2020-12-29 15:41:19.943855]: Endured 2 time(s)
[2020-12-29 15:41:19.943964]: Learning rate set to 0.06250000
[2020-12-29 15:41:19.943989]: epoch 16
[2020-12-29 15:41:55.218115]: context ppl 348.5091 | text ppl 30.7884 | rating loss 0.6078 | 200/ 2001 batches
[2020-12-29 15:42:30.058624]: context ppl 345.4799 | text ppl 30.5204 | rating loss 0.6032 | 400/ 2001 batches
[2020-12-29 15:43:04.560657]: context ppl 345.2172 | text ppl 30.6474 | rating loss 0.6137 | 600/ 2001 batches
[2020-12-29 15:43:39.357884]: context ppl 344.6052 | text ppl 30.7292 | rating loss 0.6087 | 800/ 2001 batches
[2020-12-29 15:44:14.407095]: context ppl 344.5854 | text ppl 30.6325 | rating loss 0.6046 | 1000/ 2001 batches
[2020-12-29 15:44:48.854489]: context ppl 347.2406 | text ppl 30.9105 | rating loss 0.6101 | 1200/ 2001 batches
[2020-12-29 15:45:23.243838]: context ppl 346.1687 | text ppl 30.7738 | rating loss 0.6099 | 1400/ 2001 batches
[2020-12-29 15:45:57.504280]: context ppl 347.7462 | text ppl 30.8068 | rating loss 0.6128 | 1600/ 2001 batches
[2020-12-29 15:46:31.640196]: context ppl 349.0297 | text ppl 30.9413 | rating loss 0.5943 | 1800/ 2001 batches
[2020-12-29 15:47:05.855529]: context ppl 346.9147 | text ppl 30.7624 | rating loss 0.6152 | 2000/ 2001 batches
[2020-12-29 15:47:05.904810]: context ppl 352.0581 | text ppl 23.0554 | rating loss 0.6005 | 2001/ 2001 batches
[2020-12-29 15:47:20.948598]: context ppl 394.1882 | text ppl 38.7740 | rating loss 0.6518 | valid loss 4.3096 on validation
[2020-12-29 15:47:21.592880]: epoch 17
[2020-12-29 15:47:55.114470]: context ppl 346.0752 | text ppl 30.3150 | rating loss 0.6103 | 200/ 2001 batches
[2020-12-29 15:48:29.769754]: context ppl 345.8561 | text ppl 30.3828 | rating loss 0.6053 | 400/ 2001 batches
[2020-12-29 15:49:03.873667]: context ppl 345.5364 | text ppl 30.4811 | rating loss 0.6247 | 600/ 2001 batches
[2020-12-29 15:49:38.373793]: context ppl 347.2043 | text ppl 30.7062 | rating loss 0.6040 | 800/ 2001 batches
[2020-12-29 15:50:12.684082]: context ppl 341.9201 | text ppl 30.1605 | rating loss 0.6062 | 1000/ 2001 batches
[2020-12-29 15:50:46.932929]: context ppl 344.6902 | text ppl 30.4667 | rating loss 0.5998 | 1200/ 2001 batches
[2020-12-29 15:51:21.261588]: context ppl 347.2047 | text ppl 30.7572 | rating loss 0.5894 | 1400/ 2001 batches
[2020-12-29 15:51:55.806570]: context ppl 343.3411 | text ppl 30.4188 | rating loss 0.6058 | 1600/ 2001 batches
[2020-12-29 15:52:30.013914]: context ppl 345.0965 | text ppl 30.5414 | rating loss 0.6050 | 1800/ 2001 batches
[2020-12-29 15:53:04.461637]: context ppl 348.0309 | text ppl 30.6954 | rating loss 0.6145 | 2000/ 2001 batches
[2020-12-29 15:53:04.511785]: context ppl 275.4755 | text ppl 16.5427 | rating loss 0.4445 | 2001/ 2001 batches
[2020-12-29 15:53:19.623279]: context ppl 395.7018 | text ppl 38.8281 | rating loss 0.6510 | valid loss 4.3101 on validation
[2020-12-29 15:53:19.623647]: Endured 3 time(s)
[2020-12-29 15:53:19.623753]: Learning rate set to 0.01562500
[2020-12-29 15:53:19.623776]: epoch 18
[2020-12-29 15:53:54.374299]: context ppl 344.6011 | text ppl 30.3108 | rating loss 0.5949 | 200/ 2001 batches
[2020-12-29 15:54:28.996307]: context ppl 342.1878 | text ppl 30.1172 | rating loss 0.6005 | 400/ 2001 batches
[2020-12-29 15:55:03.421550]: context ppl 342.1783 | text ppl 29.9795 | rating loss 0.6074 | 600/ 2001 batches
[2020-12-29 15:55:37.701994]: context ppl 343.9766 | text ppl 30.2481 | rating loss 0.6145 | 800/ 2001 batches
[2020-12-29 15:56:11.878933]: context ppl 344.7865 | text ppl 30.0976 | rating loss 0.6029 | 1000/ 2001 batches
[2020-12-29 15:56:46.074223]: context ppl 340.1428 | text ppl 29.8538 | rating loss 0.6011 | 1200/ 2001 batches
[2020-12-29 15:57:20.096056]: context ppl 346.3088 | text ppl 30.4084 | rating loss 0.6015 | 1400/ 2001 batches
[2020-12-29 15:57:54.504232]: context ppl 342.2334 | text ppl 29.9569 | rating loss 0.5942 | 1600/ 2001 batches
[2020-12-29 15:58:28.770611]: context ppl 345.0831 | text ppl 30.1650 | rating loss 0.6049 | 1800/ 2001 batches
[2020-12-29 15:59:02.618908]: context ppl 344.5256 | text ppl 30.2972 | rating loss 0.6090 | 2000/ 2001 batches
[2020-12-29 15:59:02.668943]: context ppl 300.5888 | text ppl 23.7656 | rating loss 0.9339 | 2001/ 2001 batches
[2020-12-29 15:59:17.592082]: context ppl 395.4287 | text ppl 38.7425 | rating loss 0.6504 | valid loss 4.3074 on validation
[2020-12-29 15:59:18.239941]: epoch 19
[2020-12-29 15:59:51.668871]: context ppl 344.1554 | text ppl 29.9203 | rating loss 0.5981 | 200/ 2001 batches
[2020-12-29 16:00:25.163247]: context ppl 343.3947 | text ppl 30.0768 | rating loss 0.6058 | 400/ 2001 batches
[2020-12-29 16:00:58.745303]: context ppl 342.9296 | text ppl 30.3359 | rating loss 0.6112 | 600/ 2001 batches
[2020-12-29 16:01:32.308903]: context ppl 344.6417 | text ppl 30.1940 | rating loss 0.6047 | 800/ 2001 batches
[2020-12-29 16:02:05.794371]: context ppl 341.5166 | text ppl 30.0337 | rating loss 0.6017 | 1000/ 2001 batches
[2020-12-29 16:02:39.196021]: context ppl 343.0947 | text ppl 29.9806 | rating loss 0.6010 | 1200/ 2001 batches
[2020-12-29 16:03:12.407650]: context ppl 343.6408 | text ppl 29.8546 | rating loss 0.5963 | 1400/ 2001 batches
[2020-12-29 16:03:45.622016]: context ppl 343.1862 | text ppl 30.0975 | rating loss 0.6122 | 1600/ 2001 batches
[2020-12-29 16:04:18.997675]: context ppl 343.4317 | text ppl 30.0708 | rating loss 0.6113 | 1800/ 2001 batches
[2020-12-29 16:04:52.332077]: context ppl 343.0828 | text ppl 30.0764 | rating loss 0.5951 | 2000/ 2001 batches
[2020-12-29 16:04:52.382309]: context ppl 309.2121 | text ppl 28.0281 | rating loss 0.3567 | 2001/ 2001 batches
[2020-12-29 16:05:06.892851]: context ppl 395.3541 | text ppl 38.7625 | rating loss 0.6506 | valid loss 4.3081 on validation
[2020-12-29 16:05:06.892923]: Endured 4 time(s)
[2020-12-29 16:05:06.893014]: Learning rate set to 0.00390625
[2020-12-29 16:05:06.893036]: epoch 20
[2020-12-29 16:05:40.578055]: context ppl 345.9404 | text ppl 30.1349 | rating loss 0.6135 | 200/ 2001 batches
[2020-12-29 16:06:13.971210]: context ppl 342.5267 | text ppl 29.9329 | rating loss 0.6013 | 400/ 2001 batches
[2020-12-29 16:06:47.363386]: context ppl 341.1284 | text ppl 29.8117 | rating loss 0.5858 | 600/ 2001 batches
[2020-12-29 16:07:20.976542]: context ppl 344.5768 | text ppl 29.8561 | rating loss 0.6164 | 800/ 2001 batches
[2020-12-29 16:07:54.393200]: context ppl 342.1289 | text ppl 30.1475 | rating loss 0.6027 | 1000/ 2001 batches
[2020-12-29 16:08:27.775790]: context ppl 341.9915 | text ppl 30.0103 | rating loss 0.5965 | 1200/ 2001 batches
[2020-12-29 16:09:01.442851]: context ppl 342.7010 | text ppl 30.0719 | rating loss 0.5948 | 1400/ 2001 batches
[2020-12-29 16:09:35.140330]: context ppl 340.0566 | text ppl 29.7141 | rating loss 0.6030 | 1600/ 2001 batches
[2020-12-29 16:10:08.752192]: context ppl 341.7476 | text ppl 29.8181 | rating loss 0.6173 | 1800/ 2001 batches
[2020-12-29 16:10:42.472660]: context ppl 344.8339 | text ppl 30.2161 | rating loss 0.5923 | 2000/ 2001 batches
[2020-12-29 16:10:42.522888]: context ppl 411.3247 | text ppl 43.8311 | rating loss 0.4395 | 2001/ 2001 batches
[2020-12-29 16:10:57.189684]: context ppl 395.7044 | text ppl 38.7624 | rating loss 0.6503 | valid loss 4.3078 on validation
[2020-12-29 16:10:57.190184]: Endured 5 time(s)
[2020-12-29 16:10:57.190211]: Cannot endure it anymore | Exiting from early stop
=========================================================================================
[2020-12-29 16:11:11.948272]: context ppl 393.9209 | text ppl 38.7750 | rating loss 0.6570 on test | End of training
[2020-12-29 16:11:11.948382]: Generating text
[2020-12-29 16:12:18.178239]: RMSE 0.8106
[2020-12-29 16:12:18.184085]: MAE 0.6262
[2020-12-29 16:12:19.641443]: BLEU-1 16.1342
[2020-12-29 16:12:22.709480]: BLEU-4 1.1163
[2020-12-29 16:12:24.411476]: USR 0.0607 | USN 1941
[2020-12-29 16:16:17.043539]: DIV 3.1048
[2020-12-29 16:16:17.153890]: FCR 0.1073
[2020-12-29 16:16:17.168433]: FMR 0.0691
[2020-12-29 16:16:20.305214]: rouge_1/f_score 16.5982
[2020-12-29 16:16:20.305662]: rouge_1/r_score 16.1682
[2020-12-29 16:16:20.305691]: rouge_1/p_score 19.1385
[2020-12-29 16:16:20.305705]: rouge_2/f_score 2.0979
[2020-12-29 16:16:20.305716]: rouge_2/r_score 2.1783
[2020-12-29 16:16:20.305725]: rouge_2/p_score 2.3165
[2020-12-29 16:16:20.305735]: rouge_l/f_score 13.1541
[2020-12-29 16:16:20.305744]: rouge_l/r_score 14.8805
[2020-12-29 16:16:20.305753]: rouge_l/p_score 15.7750
[2020-12-29 16:16:20.356809]: Generated text saved to (./tripadvisor/generated.txt)