Skip to content

Commit

Permalink
Fix the incorrect implementation of -rm3.fbTerms (#461)
Browse files Browse the repository at this point in the history
  • Loading branch information
@Peilin-Yang
Peilin-Yang authored Oct 23, 2018
1 parent 40e5ad8 commit 10255e0
Show file tree
Hide file tree
Showing 27 changed files with 205 additions and 175 deletions.
4 changes: 2 additions & 2 deletions docs/experiments-car17.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -63,11 +63,11 @@ With the above commands, you should be able to replicate the following results:

MAP | BM25 | BM25+RM3 | BM25+AX | QL | QL+RM3 | QL+AX |
:---------------------------------------|-----------|-----------|-----------|-----------|-----------|-----------|
All Topics | 0.1650 | 0.1354 | 0.1318 | 0.1515 | 0.1220 | 0.1083 |
All Topics | 0.1650 | 0.1343 | 0.1318 | 0.1515 | 0.1211 | 0.1083 |


RECIP_RANK | BM25 | BM25+RM3 | BM25+AX | QL | QL+RM3 | QL+AX |
:---------------------------------------|-----------|-----------|-----------|-----------|-----------|-----------|
All Topics | 0.2270 | 0.1860 | 0.1817 | 0.2085 | 0.1687 | 0.1503 |
All Topics | 0.2270 | 0.1852 | 0.1817 | 0.2085 | 0.1672 | 0.1503 |


4 changes: 2 additions & 2 deletions docs/experiments-core17.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -63,11 +63,11 @@ With the above commands, you should be able to replicate the following results:

MAP | BM25 | BM25+RM3 | BM25+AX | QL | QL+RM3 | QL+AX |
:---------------------------------------|-----------|-----------|-----------|-----------|-----------|-----------|
All Topics | 0.1996 | 0.2633 | 0.2719 | 0.1928 | 0.2409 | 0.2498 |
All Topics | 0.1996 | 0.2639 | 0.2719 | 0.1928 | 0.2427 | 0.2498 |


P30 | BM25 | BM25+RM3 | BM25+AX | QL | QL+RM3 | QL+AX |
:---------------------------------------|-----------|-----------|-----------|-----------|-----------|-----------|
All Topics | 0.4207 | 0.4893 | 0.4900 | 0.4327 | 0.4647 | 0.4813 |
All Topics | 0.4207 | 0.4880 | 0.4900 | 0.4327 | 0.4640 | 0.4813 |


24 changes: 12 additions & 12 deletions docs/experiments-cw09b.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -110,29 +110,29 @@ With the above commands, you should be able to replicate the following results:

MAP | BM25 | BM25+RM3 | BM25+AX | QL | QL+RM3 | QL+AX |
:---------------------------------------|-----------|-----------|-----------|-----------|-----------|-----------|
TREC 2010 Web Track: Topics 51-100 | 0.1094 | 0.1077 | 0.0966 | 0.1027 | 0.1061 | 0.1088 |
TREC 2011 Web Track: Topics 101-150 | 0.1095 | 0.1147 | 0.0996 | 0.0971 | 0.0963 | 0.0914 |
TREC 2012 Web Track: Topics 151-200 | 0.1072 | 0.1319 | 0.1242 | 0.1035 | 0.1140 | 0.1215 |
TREC 2010 Web Track: Topics 51-100 | 0.1094 | 0.1075 | 0.0966 | 0.1027 | 0.1060 | 0.1088 |
TREC 2011 Web Track: Topics 101-150 | 0.1095 | 0.1146 | 0.0996 | 0.0971 | 0.0961 | 0.0914 |
TREC 2012 Web Track: Topics 151-200 | 0.1072 | 0.1318 | 0.1242 | 0.1035 | 0.1132 | 0.1215 |


P30 | BM25 | BM25+RM3 | BM25+AX | QL | QL+RM3 | QL+AX |
:---------------------------------------|-----------|-----------|-----------|-----------|-----------|-----------|
TREC 2010 Web Track: Topics 51-100 | 0.2653 | 0.2556 | 0.2521 | 0.2417 | 0.2535 | 0.2618 |
TREC 2011 Web Track: Topics 101-150 | 0.2540 | 0.2687 | 0.2420 | 0.2220 | 0.2187 | 0.2267 |
TREC 2012 Web Track: Topics 151-200 | 0.2180 | 0.2400 | 0.2313 | 0.2013 | 0.2053 | 0.2100 |
TREC 2010 Web Track: Topics 51-100 | 0.2653 | 0.2604 | 0.2521 | 0.2417 | 0.2507 | 0.2618 |
TREC 2011 Web Track: Topics 101-150 | 0.2540 | 0.2713 | 0.2420 | 0.2220 | 0.2207 | 0.2267 |
TREC 2012 Web Track: Topics 151-200 | 0.2180 | 0.2387 | 0.2313 | 0.2013 | 0.2040 | 0.2100 |


NDCG20 | BM25 | BM25+RM3 | BM25+AX | QL | QL+RM3 | QL+AX |
:---------------------------------------|-----------|-----------|-----------|-----------|-----------|-----------|
TREC 2010 Web Track: Topics 51-100 | 0.1328 | 0.1430 | 0.1715 | 0.1132 | 0.1328 | 0.1470 |
TREC 2011 Web Track: Topics 101-150 | 0.1914 | 0.1885 | 0.1877 | 0.1635 | 0.1608 | 0.1592 |
TREC 2012 Web Track: Topics 151-200 | 0.0976 | 0.1254 | 0.1187 | 0.0862 | 0.1084 | 0.1055 |
TREC 2010 Web Track: Topics 51-100 | 0.1328 | 0.1423 | 0.1715 | 0.1132 | 0.1314 | 0.1470 |
TREC 2011 Web Track: Topics 101-150 | 0.1914 | 0.1861 | 0.1877 | 0.1635 | 0.1608 | 0.1592 |
TREC 2012 Web Track: Topics 151-200 | 0.0976 | 0.1308 | 0.1187 | 0.0862 | 0.1075 | 0.1055 |


ERR20 | BM25 | BM25+RM3 | BM25+AX | QL | QL+RM3 | QL+AX |
:---------------------------------------|-----------|-----------|-----------|-----------|-----------|-----------|
TREC 2010 Web Track: Topics 51-100 | 0.0717 | 0.0791 | 0.1007 | 0.0586 | 0.0653 | 0.0802 |
TREC 2011 Web Track: Topics 101-150 | 0.0947 | 0.1092 | 0.1064 | 0.0842 | 0.0934 | 0.0879 |
TREC 2012 Web Track: Topics 151-200 | 0.1382 | 0.2079 | 0.1921 | 0.1315 | 0.1576 | 0.1583 |
TREC 2010 Web Track: Topics 51-100 | 0.0717 | 0.0784 | 0.1007 | 0.0586 | 0.0649 | 0.0802 |
TREC 2011 Web Track: Topics 101-150 | 0.0947 | 0.1081 | 0.1064 | 0.0842 | 0.0921 | 0.0879 |
TREC 2012 Web Track: Topics 151-200 | 0.1382 | 0.2179 | 0.1921 | 0.1315 | 0.1574 | 0.1583 |


16 changes: 8 additions & 8 deletions docs/experiments-cw12.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -73,25 +73,25 @@ With the above commands, you should be able to replicate the following results:

MAP | BM25 | BM25+RM3 | QL | QL+RM3 |
:---------------------------------------|-----------|-----------|-----------|-----------|
[TREC 2013 Web Track: Topics 201-250](http://trec.nist.gov/data/web2013.html)| 0.1673 | 0.1483 | 0.1438 | 0.1245 |
[TREC 2014 Web Track: Topics 251-300](http://trec.nist.gov/data/web2014.html)| 0.2432 | 0.2481 | 0.2401 | 0.2334 |
[TREC 2013 Web Track: Topics 201-250](http://trec.nist.gov/data/web2013.html)| 0.1673 | 0.1489 | 0.1438 | 0.1235 |
[TREC 2014 Web Track: Topics 251-300](http://trec.nist.gov/data/web2014.html)| 0.2432 | 0.2468 | 0.2401 | 0.2331 |


P30 | BM25 | BM25+RM3 | QL | QL+RM3 |
:---------------------------------------|-----------|-----------|-----------|-----------|
[TREC 2013 Web Track: Topics 201-250](http://trec.nist.gov/data/web2013.html)| 0.2827 | 0.2360 | 0.2507 | 0.2053 |
[TREC 2014 Web Track: Topics 251-300](http://trec.nist.gov/data/web2014.html)| 0.4500 | 0.4233 | 0.4367 | 0.3973 |
[TREC 2013 Web Track: Topics 201-250](http://trec.nist.gov/data/web2013.html)| 0.2827 | 0.2347 | 0.2507 | 0.2047 |
[TREC 2014 Web Track: Topics 251-300](http://trec.nist.gov/data/web2014.html)| 0.4500 | 0.4200 | 0.4367 | 0.4013 |


NDCG20 | BM25 | BM25+RM3 | QL | QL+RM3 |
:---------------------------------------|-----------|-----------|-----------|-----------|
[TREC 2013 Web Track: Topics 201-250](http://trec.nist.gov/data/web2013.html)| 0.2066 | 0.1752 | 0.1905 | 0.1563 |
[TREC 2014 Web Track: Topics 251-300](http://trec.nist.gov/data/web2014.html)| 0.2646 | 0.2484 | 0.2327 | 0.2148 |
[TREC 2013 Web Track: Topics 201-250](http://trec.nist.gov/data/web2013.html)| 0.2066 | 0.1757 | 0.1905 | 0.1557 |
[TREC 2014 Web Track: Topics 251-300](http://trec.nist.gov/data/web2014.html)| 0.2646 | 0.2435 | 0.2327 | 0.2168 |


ERR20 | BM25 | BM25+RM3 | QL | QL+RM3 |
:---------------------------------------|-----------|-----------|-----------|-----------|
[TREC 2013 Web Track: Topics 201-250](http://trec.nist.gov/data/web2013.html)| 0.1213 | 0.0917 | 0.1169 | 0.0868 |
[TREC 2014 Web Track: Topics 251-300](http://trec.nist.gov/data/web2014.html)| 0.1737 | 0.1785 | 0.1451 | 0.1312 |
[TREC 2013 Web Track: Topics 201-250](http://trec.nist.gov/data/web2013.html)| 0.1213 | 0.0915 | 0.1169 | 0.0859 |
[TREC 2014 Web Track: Topics 251-300](http://trec.nist.gov/data/web2014.html)| 0.1737 | 0.1741 | 0.1451 | 0.1344 |


16 changes: 8 additions & 8 deletions docs/experiments-cw12b13.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -88,25 +88,25 @@ With the above commands, you should be able to replicate the following results:

MAP | BM25 | BM25+RM3 | BM25+AX | QL | QL+RM3 | QL+AX |
:---------------------------------------|-----------|-----------|-----------|-----------|-----------|-----------|
[TREC 2013 Web Track: Topics 201-250](http://trec.nist.gov/data/web2013.html)| 0.0457 | 0.0438 | 0.0411 | 0.0389 | 0.0314 | 0.0354 |
[TREC 2014 Web Track: Topics 251-300](http://trec.nist.gov/data/web2014.html)| 0.0219 | 0.0188 | 0.0177 | 0.0228 | 0.0204 | 0.0189 |
[TREC 2013 Web Track: Topics 201-250](http://trec.nist.gov/data/web2013.html)| 0.0457 | 0.0440 | 0.0411 | 0.0389 | 0.0314 | 0.0354 |
[TREC 2014 Web Track: Topics 251-300](http://trec.nist.gov/data/web2014.html)| 0.0219 | 0.0192 | 0.0177 | 0.0228 | 0.0202 | 0.0189 |


P30 | BM25 | BM25+RM3 | BM25+AX | QL | QL+RM3 | QL+AX |
:---------------------------------------|-----------|-----------|-----------|-----------|-----------|-----------|
[TREC 2013 Web Track: Topics 201-250](http://trec.nist.gov/data/web2013.html)| 0.2000 | 0.1773 | 0.1800 | 0.1720 | 0.1433 | 0.1513 |
[TREC 2014 Web Track: Topics 251-300](http://trec.nist.gov/data/web2014.html)| 0.1293 | 0.1140 | 0.1173 | 0.1313 | 0.1160 | 0.1180 |
[TREC 2013 Web Track: Topics 201-250](http://trec.nist.gov/data/web2013.html)| 0.2000 | 0.1767 | 0.1800 | 0.1720 | 0.1420 | 0.1513 |
[TREC 2014 Web Track: Topics 251-300](http://trec.nist.gov/data/web2014.html)| 0.1293 | 0.1113 | 0.1173 | 0.1313 | 0.1160 | 0.1180 |


NDCG20 | BM25 | BM25+RM3 | BM25+AX | QL | QL+RM3 | QL+AX |
:---------------------------------------|-----------|-----------|-----------|-----------|-----------|-----------|
[TREC 2013 Web Track: Topics 201-250](http://trec.nist.gov/data/web2013.html)| 0.1242 | 0.1172 | 0.1245 | 0.1158 | 0.0878 | 0.1117 |
[TREC 2014 Web Track: Topics 251-300](http://trec.nist.gov/data/web2014.html)| 0.1190 | 0.0987 | 0.0969 | 0.1133 | 0.0961 | 0.0999 |
[TREC 2013 Web Track: Topics 201-250](http://trec.nist.gov/data/web2013.html)| 0.1242 | 0.1197 | 0.1245 | 0.1158 | 0.0852 | 0.1117 |
[TREC 2014 Web Track: Topics 251-300](http://trec.nist.gov/data/web2014.html)| 0.1190 | 0.1002 | 0.0969 | 0.1133 | 0.0959 | 0.0999 |


ERR20 | BM25 | BM25+RM3 | BM25+AX | QL | QL+RM3 | QL+AX |
:---------------------------------------|-----------|-----------|-----------|-----------|-----------|-----------|
[TREC 2013 Web Track: Topics 201-250](http://trec.nist.gov/data/web2013.html)| 0.0821 | 0.0776 | 0.0915 | 0.0764 | 0.0512 | 0.0705 |
[TREC 2014 Web Track: Topics 251-300](http://trec.nist.gov/data/web2014.html)| 0.1237 | 0.1010 | 0.0959 | 0.1040 | 0.0912 | 0.0994 |
[TREC 2013 Web Track: Topics 201-250](http://trec.nist.gov/data/web2013.html)| 0.0821 | 0.0777 | 0.0915 | 0.0764 | 0.0511 | 0.0705 |
[TREC 2014 Web Track: Topics 251-300](http://trec.nist.gov/data/web2014.html)| 0.1237 | 0.1014 | 0.0959 | 0.1040 | 0.0911 | 0.0994 |


12 changes: 6 additions & 6 deletions docs/experiments-disk12.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -90,15 +90,15 @@ With the above commands, you should be able to replicate the following results:

MAP | BM25 | BM25+RM3 | BM25+AX | QL | QL+RM3 | QL+AX |
:---------------------------------------|-----------|-----------|-----------|-----------|-----------|-----------|
TREC-1 Ad Hoc Track: Topics 51-100 | 0.2254 | 0.2612 | 0.2675 | 0.2188 | 0.2502 | 0.2519 |
TREC-2 Ad Hoc Track: Topics 101-150 | 0.2003 | 0.2582 | 0.2708 | 0.2013 | 0.2477 | 0.2606 |
TREC-3 Ad Hoc Track: Topics 151-200 | 0.2571 | 0.3214 | 0.3349 | 0.2530 | 0.3015 | 0.3113 |
TREC-1 Ad Hoc Track: Topics 51-100 | 0.2254 | 0.2607 | 0.2675 | 0.2188 | 0.2500 | 0.2519 |
TREC-2 Ad Hoc Track: Topics 101-150 | 0.2003 | 0.2579 | 0.2708 | 0.2013 | 0.2475 | 0.2606 |
TREC-3 Ad Hoc Track: Topics 151-200 | 0.2571 | 0.3224 | 0.3349 | 0.2530 | 0.3019 | 0.3113 |


P30 | BM25 | BM25+RM3 | BM25+AX | QL | QL+RM3 | QL+AX |
:---------------------------------------|-----------|-----------|-----------|-----------|-----------|-----------|
TREC-1 Ad Hoc Track: Topics 51-100 | 0.4493 | 0.4853 | 0.5167 | 0.4453 | 0.4700 | 0.4967 |
TREC-2 Ad Hoc Track: Topics 101-150 | 0.4213 | 0.4573 | 0.4787 | 0.4153 | 0.4407 | 0.4660 |
TREC-3 Ad Hoc Track: Topics 151-200 | 0.4740 | 0.5087 | 0.5160 | 0.4647 | 0.4993 | 0.5160 |
TREC-1 Ad Hoc Track: Topics 51-100 | 0.4493 | 0.4813 | 0.5167 | 0.4453 | 0.4687 | 0.4967 |
TREC-2 Ad Hoc Track: Topics 101-150 | 0.4213 | 0.4580 | 0.4787 | 0.4153 | 0.4427 | 0.4660 |
TREC-3 Ad Hoc Track: Topics 151-200 | 0.4740 | 0.5100 | 0.5160 | 0.4647 | 0.5013 | 0.5160 |


12 changes: 6 additions & 6 deletions docs/experiments-gov2.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -90,15 +90,15 @@ With the above commands, you should be able to replicate the following results:

MAP | BM25 | BM25+RM3 | BM25+AX | QL | QL+RM3 | QL+AX |
:---------------------------------------|-----------|-----------|-----------|-----------|-----------|-----------|
[TREC 2004 Terabyte Track: Topics 701-750](http://trec.nist.gov/data/terabyte04.html)| 0.2673 | 0.2981 | 0.2735 | 0.2636 | 0.2777 | 0.2638 |
[TREC 2005 Terabyte Track: Topics 751-800](http://trec.nist.gov/data/terabyte05.html)| 0.3366 | 0.3843 | 0.3669 | 0.3264 | 0.3620 | 0.3670 |
[TREC 2006 Terabyte Track: Topics 801-850](http://trec.nist.gov/data/terabyte06.html)| 0.3055 | 0.3439 | 0.3061 | 0.2957 | 0.3168 | 0.3112 |
[TREC 2004 Terabyte Track: Topics 701-750](http://trec.nist.gov/data/terabyte04.html)| 0.2673 | 0.2974 | 0.2735 | 0.2636 | 0.2770 | 0.2638 |
[TREC 2005 Terabyte Track: Topics 751-800](http://trec.nist.gov/data/terabyte05.html)| 0.3366 | 0.3846 | 0.3669 | 0.3264 | 0.3610 | 0.3670 |
[TREC 2006 Terabyte Track: Topics 801-850](http://trec.nist.gov/data/terabyte06.html)| 0.3055 | 0.3438 | 0.3061 | 0.2957 | 0.3160 | 0.3112 |


P30 | BM25 | BM25+RM3 | BM25+AX | QL | QL+RM3 | QL+AX |
:---------------------------------------|-----------|-----------|-----------|-----------|-----------|-----------|
[TREC 2004 Terabyte Track: Topics 701-750](http://trec.nist.gov/data/terabyte04.html)| 0.4837 | 0.5333 | 0.5082 | 0.4667 | 0.4912 | 0.4837 |
[TREC 2005 Terabyte Track: Topics 751-800](http://trec.nist.gov/data/terabyte05.html)| 0.5520 | 0.5933 | 0.5947 | 0.5160 | 0.5700 | 0.5880 |
[TREC 2006 Terabyte Track: Topics 801-850](http://trec.nist.gov/data/terabyte06.html)| 0.4900 | 0.5240 | 0.5007 | 0.4753 | 0.4840 | 0.5007 |
[TREC 2004 Terabyte Track: Topics 701-750](http://trec.nist.gov/data/terabyte04.html)| 0.4837 | 0.5347 | 0.5082 | 0.4667 | 0.4878 | 0.4837 |
[TREC 2005 Terabyte Track: Topics 751-800](http://trec.nist.gov/data/terabyte05.html)| 0.5520 | 0.5960 | 0.5947 | 0.5160 | 0.5673 | 0.5880 |
[TREC 2006 Terabyte Track: Topics 801-850](http://trec.nist.gov/data/terabyte06.html)| 0.4900 | 0.5227 | 0.5007 | 0.4753 | 0.4853 | 0.5007 |


8 changes: 4 additions & 4 deletions docs/experiments-mb11.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -88,13 +88,13 @@ With the above commands, you should be able to replicate the following results:

MAP | BM25 | BM25+RM3 | BM25+AX | QL | QL+RM3 | QL+AX |
:---------------------------------------|-----------|-----------|-----------|-----------|-----------|-----------|
[TREC 2011 Microblog Track](http://trec.nist.gov/data/microblog2011.html)| 0.3351 | 0.3472 | 0.4042 | 0.3614 | 0.4100 | 0.4179 |
[TREC 2012 Microblog Track](http://trec.nist.gov/data/microblog2012.html)| 0.1912 | 0.2056 | 0.2310 | 0.2100 | 0.2413 | 0.2502 |
[TREC 2011 Microblog Track](http://trec.nist.gov/data/microblog2011.html)| 0.3351 | 0.3477 | 0.4042 | 0.3614 | 0.4093 | 0.4179 |
[TREC 2012 Microblog Track](http://trec.nist.gov/data/microblog2012.html)| 0.1912 | 0.2055 | 0.2310 | 0.2100 | 0.2412 | 0.2502 |


P30 | BM25 | BM25+RM3 | BM25+AX | QL | QL+RM3 | QL+AX |
:---------------------------------------|-----------|-----------|-----------|-----------|-----------|-----------|
[TREC 2011 Microblog Track](http://trec.nist.gov/data/microblog2011.html)| 0.3837 | 0.4027 | 0.4558 | 0.4095 | 0.4463 | 0.4367 |
[TREC 2012 Microblog Track](http://trec.nist.gov/data/microblog2012.html)| 0.3328 | 0.3418 | 0.3588 | 0.3322 | 0.3531 | 0.3864 |
[TREC 2011 Microblog Track](http://trec.nist.gov/data/microblog2011.html)| 0.3837 | 0.4027 | 0.4558 | 0.4095 | 0.4483 | 0.4367 |
[TREC 2012 Microblog Track](http://trec.nist.gov/data/microblog2012.html)| 0.3328 | 0.3424 | 0.3588 | 0.3322 | 0.3542 | 0.3864 |


8 changes: 4 additions & 4 deletions docs/experiments-mb13.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -88,13 +88,13 @@ With the above commands, you should be able to replicate the following results:

MAP | BM25 | BM25+RM3 | BM25+AX | QL | QL+RM3 | QL+AX |
:---------------------------------------|-----------|-----------|-----------|-----------|-----------|-----------|
[TREC 2013 Microblog Track](http://trec.nist.gov/data/microblog2013.html)| 0.2306 | 0.2356 | 0.2770 | 0.2599 | 0.2804 | 0.3167 |
[TREC 2014 Microblog Track](http://trec.nist.gov/data/microblog2014.html)| 0.3836 | 0.4043 | 0.4673 | 0.4184 | 0.4763 | 0.4943 |
[TREC 2013 Microblog Track](http://trec.nist.gov/data/microblog2013.html)| 0.2306 | 0.2356 | 0.2770 | 0.2599 | 0.2796 | 0.3167 |
[TREC 2014 Microblog Track](http://trec.nist.gov/data/microblog2014.html)| 0.3836 | 0.4036 | 0.4673 | 0.4184 | 0.4763 | 0.4943 |


P30 | BM25 | BM25+RM3 | BM25+AX | QL | QL+RM3 | QL+AX |
:---------------------------------------|-----------|-----------|-----------|-----------|-----------|-----------|
[TREC 2013 Microblog Track](http://trec.nist.gov/data/microblog2013.html)| 0.4222 | 0.4061 | 0.4611 | 0.4517 | 0.4606 | 0.5117 |
[TREC 2014 Microblog Track](http://trec.nist.gov/data/microblog2014.html)| 0.6176 | 0.6048 | 0.6479 | 0.6424 | 0.6612 | 0.6770 |
[TREC 2013 Microblog Track](http://trec.nist.gov/data/microblog2013.html)| 0.4222 | 0.4044 | 0.4611 | 0.4517 | 0.4600 | 0.5117 |
[TREC 2014 Microblog Track](http://trec.nist.gov/data/microblog2014.html)| 0.6176 | 0.6061 | 0.6479 | 0.6424 | 0.6606 | 0.6770 |


Loading

0 comments on commit 10255e0

Please sign in to comment.