| dataset | embedding | weighting | p_0.25 | p_0.5 | p_0.75 | p_1.0 | p_mean1 | p_mean2 | r_norm | p_norm | |-----------+---------------------------------+-------------+----------+---------+----------+---------+-----------+-----------+----------+----------| | cacm | one-hot | mean | 0.319 | 0.1823 | 0.1066 | 0.0531 | 0.2026 | 0.2098 | 0.8372 | 0.5562 | | cacm | one-hot | tf-idf | 0.4571 | 0.2723 | 0.1751 | 0.079 | 0.3015 | 0.3014 | 0.8681 | 0.6566 | | cisi | one-hot | mean | 0.2673 | 0.1401 | 0.0822 | 0.0372 | 0.1632 | 0.1618 | 0.7782 | 0.5017 | | cisi | one-hot | tf-idf | 0.3622 | 0.2137 | 0.1003 | 0.0388 | 0.2254 | 0.2189 | 0.8052 | 0.5577 | | med | one-hot | mean | 0.6726 | 0.4527 | 0.285 | 0.0874 | 0.4701 | 0.442 | 0.9001 | 0.7507 | | med | one-hot | tf-idf | 0.7346 | 0.5342 | 0.3599 | 0.0921 | 0.5429 | 0.4973 | 0.9122 | 0.7895 | | cran | one-hot | mean | 0.5722 | 0.3527 | 0.2151 | 0.0941 | 0.38 | 0.3704 | 0.901 | 0.6807 | | cran | one-hot | tf-idf | 0.6323 | 0.4226 | 0.2611 | 0.119 | 0.4386 | 0.4202 | 0.9111 | 0.7163 | | cacm | word2vec-google-news-300 | mean | 0.2535 | 0.129 | 0.0634 | 0.0178 | 0.1487 | 0.1656 | 0.8469 | 0.5152 | | cacm | word2vec-google-news-300 | tf-idf | 0.2882 | 0.147 | 0.0682 | 0.0167 | 0.1678 | 0.1776 | 0.8465 | 0.5183 | | cacm | word2vec-google-news-300 | sif | 0.2636 | 0.142 | 0.0641 | 0.0214 | 0.1566 | 0.1693 | 0.8548 | 0.5224 | | cacm | word2vec-google-news-300 | usif | 0.2994 | 0.1686 | 0.0879 | 0.039 | 0.1853 | 0.1906 | 0.8624 | 0.539 | | cacm | glove-twitter-100 | mean | 0.1647 | 0.0775 | 0.0345 | 0.0098 | 0.0922 | 0.1063 | 0.7798 | 0.406 | | cacm | glove-twitter-100 | tf-idf | 0.1846 | 0.0742 | 0.0339 | 0.0089 | 0.0976 | 0.1091 | 0.772 | 0.4015 | | cacm | glove-twitter-100 | sif | 0.1709 | 0.0808 | 0.0335 | 0.0099 | 0.0951 | 0.1099 | 0.7643 | 0.395 | | cacm | glove-twitter-100 | usif | 0.1747 | 0.0778 | 0.0339 | 0.0093 | 0.0955 | 0.1097 | 0.7906 | 0.4169 | | cacm | glove-wiki-gigaword-100 | mean | 0.2026 | 0.0972 | 0.0447 | 0.01 | 0.1148 | 0.1274 | 0.8333 | 0.4593 | | cacm | glove-wiki-gigaword-100 | tf-idf | 0.232 | 0.1143 | 0.0423 | 0.0092 | 0.1295 | 0.1397 | 0.8292 | 0.4636 | | cacm | glove-wiki-gigaword-100 | sif | 0.1939 | 0.094 | 0.0411 | 0.0127 | 0.1097 | 0.1253 | 0.806 | 0.4419 | | cacm | glove-wiki-gigaword-100 | usif | 0.2082 | 0.1031 | 0.0442 | 0.012 | 0.1185 | 0.1314 | 0.8366 | 0.4673 | | cacm | glove-wiki-gigaword-200 | mean | 0.2394 | 0.1183 | 0.0502 | 0.0123 | 0.136 | 0.1501 | 0.8512 | 0.4986 | | cacm | glove-wiki-gigaword-200 | tf-idf | 0.2838 | 0.1323 | 0.0491 | 0.011 | 0.1551 | 0.1642 | 0.8484 | 0.5055 | | cacm | glove-wiki-gigaword-200 | sif | 0.2192 | 0.11 | 0.0477 | 0.0171 | 0.1256 | 0.1427 | 0.8365 | 0.4874 | | cacm | glove-wiki-gigaword-200 | usif | 0.2355 | 0.1163 | 0.0513 | 0.0153 | 0.1344 | 0.1491 | 0.8599 | 0.5101 | | cacm | fasttext-wiki-news-subwords-300 | mean | 0.2874 | 0.1335 | 0.0648 | 0.013 | 0.1619 | 0.1689 | 0.8157 | 0.4918 | | cacm | fasttext-wiki-news-subwords-300 | tf-idf | 0.3072 | 0.1444 | 0.0645 | 0.0121 | 0.172 | 0.1788 | 0.8136 | 0.4974 | | cacm | fasttext-wiki-news-subwords-300 | sif | 0.2912 | 0.1404 | 0.0684 | 0.0128 | 0.1667 | 0.1757 | 0.8293 | 0.5009 | | cacm | fasttext-wiki-news-subwords-300 | usif | 0.304 | 0.1454 | 0.0718 | 0.013 | 0.1738 | 0.1825 | 0.8384 | 0.5163 | | cisi | word2vec-google-news-300 | mean | 0.2293 | 0.1285 | 0.0821 | 0.037 | 0.1466 | 0.1523 | 0.7901 | 0.5053 | | cisi | word2vec-google-news-300 | tf-idf | 0.2378 | 0.1331 | 0.0844 | 0.0366 | 0.1517 | 0.1585 | 0.7957 | 0.5127 | | cisi | word2vec-google-news-300 | sif | 0.2657 | 0.1526 | 0.0944 | 0.04 | 0.1709 | 0.1741 | 0.8289 | 0.5428 | | cisi | word2vec-google-news-300 | usif | 0.2592 | 0.1546 | 0.096 | 0.0409 | 0.1699 | 0.1749 | 0.8316 | 0.5451 | | cisi | glove-twitter-100 | mean | 0.1626 | 0.1028 | 0.0618 | 0.0318 | 0.109 | 0.1133 | 0.7235 | 0.4343 | | cisi | glove-twitter-100 | tf-idf | 0.1584 | 0.0936 | 0.0594 | 0.0319 | 0.1038 | 0.1095 | 0.7139 | 0.424 | | cisi | glove-twitter-100 | sif | 0.1748 | 0.1115 | 0.0676 | 0.0346 | 0.118 | 0.1237 | 0.7641 | 0.4617 | | cisi | glove-twitter-100 | usif | 0.1808 | 0.1123 | 0.0691 | 0.035 | 0.1207 | 0.1268 | 0.7663 | 0.4645 | | cisi | glove-wiki-gigaword-100 | mean | 0.2019 | 0.1189 | 0.0749 | 0.0344 | 0.1319 | 0.1372 | 0.7706 | 0.4828 | | cisi | glove-wiki-gigaword-100 | tf-idf | 0.2132 | 0.1226 | 0.0753 | 0.0344 | 0.137 | 0.1413 | 0.7727 | 0.4846 | | cisi | glove-wiki-gigaword-100 | sif | 0.227 | 0.1367 | 0.084 | 0.0379 | 0.1493 | 0.1538 | 0.8088 | 0.517 | | cisi | glove-wiki-gigaword-100 | usif | 0.2308 | 0.137 | 0.0837 | 0.0383 | 0.1505 | 0.1544 | 0.8093 | 0.5168 | | cisi | glove-wiki-gigaword-200 | mean | 0.2134 | 0.1257 | 0.0776 | 0.0346 | 0.1389 | 0.1439 | 0.7769 | 0.4945 | | cisi | glove-wiki-gigaword-200 | tf-idf | 0.2289 | 0.1278 | 0.0806 | 0.0344 | 0.1458 | 0.1519 | 0.7812 | 0.4993 | | cisi | glove-wiki-gigaword-200 | sif | 0.2431 | 0.1481 | 0.0909 | 0.0392 | 0.1607 | 0.1661 | 0.8205 | 0.5356 | | cisi | glove-wiki-gigaword-200 | usif | 0.243 | 0.1497 | 0.0909 | 0.0396 | 0.1612 | 0.1653 | 0.8213 | 0.5352 | | cisi | fasttext-wiki-news-subwords-300 | mean | 0.1967 | 0.1082 | 0.061 | 0.0333 | 0.122 | 0.1276 | 0.7219 | 0.4554 | | cisi | fasttext-wiki-news-subwords-300 | tf-idf | 0.234 | 0.1225 | 0.0672 | 0.0325 | 0.1412 | 0.1469 | 0.7398 | 0.4773 | | cisi | fasttext-wiki-news-subwords-300 | sif | 0.2006 | 0.1136 | 0.0716 | 0.0362 | 0.1286 | 0.1353 | 0.7678 | 0.4851 | | cisi | fasttext-wiki-news-subwords-300 | usif | 0.1996 | 0.1128 | 0.0703 | 0.0359 | 0.1276 | 0.1351 | 0.7653 | 0.4838 | | med | word2vec-google-news-300 | mean | 0.5805 | 0.389 | 0.2021 | 0.0633 | 0.3905 | 0.3676 | 0.8896 | 0.6992 | | med | word2vec-google-news-300 | tf-idf | 0.5335 | 0.3686 | 0.1866 | 0.0552 | 0.3629 | 0.337 | 0.8797 | 0.6779 | | med | word2vec-google-news-300 | sif | 0.5861 | 0.429 | 0.2347 | 0.0771 | 0.4166 | 0.3904 | 0.9042 | 0.7249 | | med | word2vec-google-news-300 | usif | 0.626 | 0.4336 | 0.2505 | 0.0806 | 0.4367 | 0.4034 | 0.9078 | 0.7325 | | med | glove-twitter-100 | mean | 0.3746 | 0.1858 | 0.0972 | 0.0417 | 0.2192 | 0.2157 | 0.7805 | 0.5414 | | med | glove-twitter-100 | tf-idf | 0.3622 | 0.1511 | 0.0803 | 0.0365 | 0.1979 | 0.1955 | 0.7652 | 0.5203 | | med | glove-twitter-100 | sif | 0.396 | 0.2031 | 0.1099 | 0.0456 | 0.2363 | 0.2308 | 0.7975 | 0.5609 | | med | glove-twitter-100 | usif | 0.4065 | 0.2081 | 0.1121 | 0.0474 | 0.2422 | 0.2373 | 0.7997 | 0.5652 | | med | glove-wiki-gigaword-100 | mean | 0.4346 | 0.2505 | 0.122 | 0.0439 | 0.269 | 0.2648 | 0.8224 | 0.5943 | | med | glove-wiki-gigaword-100 | tf-idf | 0.3977 | 0.2706 | 0.1086 | 0.0435 | 0.259 | 0.25 | 0.812 | 0.5808 | | med | glove-wiki-gigaword-100 | sif | 0.4503 | 0.3096 | 0.1261 | 0.0495 | 0.2953 | 0.2831 | 0.8335 | 0.6102 | | med | glove-wiki-gigaword-100 | usif | 0.4504 | 0.2856 | 0.1233 | 0.0488 | 0.2865 | 0.2801 | 0.8314 | 0.6069 | | med | glove-wiki-gigaword-200 | mean | 0.5305 | 0.3399 | 0.1635 | 0.054 | 0.3446 | 0.3219 | 0.855 | 0.649 | | med | glove-wiki-gigaword-200 | tf-idf | 0.5041 | 0.3239 | 0.1466 | 0.0518 | 0.3249 | 0.3029 | 0.8446 | 0.6337 | | med | glove-wiki-gigaword-200 | sif | 0.5424 | 0.368 | 0.1717 | 0.0577 | 0.3607 | 0.3348 | 0.8667 | 0.6644 | | med | glove-wiki-gigaword-200 | usif | 0.5287 | 0.3698 | 0.1685 | 0.0573 | 0.3557 | 0.3343 | 0.8651 | 0.6621 | | med | fasttext-wiki-news-subwords-300 | mean | 0.5118 | 0.3082 | 0.1415 | 0.0348 | 0.3205 | 0.3051 | 0.8144 | 0.6247 | | med | fasttext-wiki-news-subwords-300 | tf-idf | 0.5307 | 0.3069 | 0.1346 | 0.0383 | 0.3241 | 0.3041 | 0.8238 | 0.6286 | | med | fasttext-wiki-news-subwords-300 | sif | 0.5357 | 0.3425 | 0.1784 | 0.0515 | 0.3522 | 0.3293 | 0.8639 | 0.6618 | | med | fasttext-wiki-news-subwords-300 | usif | 0.5402 | 0.3552 | 0.18 | 0.0519 | 0.3585 | 0.3338 | 0.8647 | 0.6649 | | cran | word2vec-google-news-300 | mean | 0.4683 | 0.2577 | 0.1434 | 0.0527 | 0.2898 | 0.2873 | 0.8579 | 0.6009 | | cran | word2vec-google-news-300 | tf-idf | 0.4992 | 0.2789 | 0.157 | 0.0569 | 0.3117 | 0.3068 | 0.8395 | 0.5966 | | cran | word2vec-google-news-300 | sif | 0.4801 | 0.2782 | 0.1569 | 0.0672 | 0.3051 | 0.301 | 0.8816 | 0.6247 | | cran | word2vec-google-news-300 | usif | 0.4811 | 0.2882 | 0.1646 | 0.0697 | 0.3113 | 0.3066 | 0.8835 | 0.6305 | | cran | glove-twitter-100 | mean | 0.3118 | 0.1393 | 0.0735 | 0.0237 | 0.1749 | 0.1891 | 0.783 | 0.4847 | | cran | glove-twitter-100 | tf-idf | 0.3161 | 0.1354 | 0.0656 | 0.0263 | 0.1724 | 0.1869 | 0.7561 | 0.4629 | | cran | glove-twitter-100 | sif | 0.35 | 0.1575 | 0.0846 | 0.0275 | 0.1974 | 0.2077 | 0.8093 | 0.5113 | | cran | glove-twitter-100 | usif | 0.3525 | 0.1576 | 0.0836 | 0.0277 | 0.1979 | 0.2084 | 0.8108 | 0.5136 | | cran | glove-wiki-gigaword-100 | mean | 0.3486 | 0.1532 | 0.0792 | 0.0278 | 0.1937 | 0.2046 | 0.8099 | 0.514 | | cran | glove-wiki-gigaword-100 | tf-idf | 0.3495 | 0.1568 | 0.0812 | 0.0326 | 0.1958 | 0.2073 | 0.7903 | 0.5011 | | cran | glove-wiki-gigaword-100 | sif | 0.3606 | 0.1659 | 0.087 | 0.0338 | 0.2045 | 0.2159 | 0.8326 | 0.5335 | | cran | glove-wiki-gigaword-100 | usif | 0.3525 | 0.1581 | 0.0847 | 0.033 | 0.1984 | 0.2101 | 0.8299 | 0.5289 | | cran | glove-wiki-gigaword-200 | mean | 0.4123 | 0.2047 | 0.1061 | 0.0389 | 0.241 | 0.2465 | 0.8393 | 0.5612 | | cran | glove-wiki-gigaword-200 | tf-idf | 0.4353 | 0.216 | 0.1143 | 0.0471 | 0.2552 | 0.2596 | 0.8211 | 0.554 | | cran | glove-wiki-gigaword-200 | sif | 0.4267 | 0.225 | 0.1184 | 0.05 | 0.2567 | 0.2625 | 0.8638 | 0.5869 | | cran | glove-wiki-gigaword-200 | usif | 0.4225 | 0.2249 | 0.1168 | 0.0482 | 0.2547 | 0.2605 | 0.8618 | 0.5829 | | cran | fasttext-wiki-news-subwords-300 | mean | 0.4306 | 0.2156 | 0.1048 | 0.0318 | 0.2503 | 0.2563 | 0.804 | 0.5489 | | cran | fasttext-wiki-news-subwords-300 | tf-idf | 0.4517 | 0.218 | 0.1085 | 0.0354 | 0.2594 | 0.2651 | 0.7793 | 0.5387 | | cran | fasttext-wiki-news-subwords-300 | sif | 0.4585 | 0.2431 | 0.1338 | 0.0529 | 0.2785 | 0.2831 | 0.8619 | 0.595 | | cran | fasttext-wiki-news-subwords-300 | usif | 0.4594 | 0.2428 | 0.1355 | 0.0525 | 0.2792 | 0.2837 | 0.8618 | 0.5959 | | cacm | doc2vec | - | 0.1515 | 0.0758 | 0.0401 | 0.01 | 0.0891 | 0.1013 | 0.7135 | 0.3746 | | cisi | doc2vec | - | 0.1677 | 0.1021 | 0.0668 | 0.0385 | 0.1122 | 0.1148 | 0.744 | 0.45 | | med | doc2vec | - | 0.2551 | 0.1661 | 0.1146 | 0.0339 | 0.1786 | 0.1724 | 0.7251 | 0.4818 | | cran | doc2vec | - | 0.2423 | 0.0883 | 0.0412 | 0.017 | 0.1239 | 0.1423 | 0.764 | 0.4367 |