Document (#34107)

Author

Vu, Q.M.
Takasu, A.
Adachi, J.

Title

Improving the performance of personal name disambiguation using web directories

Source

Information processing and management. 44(2008) no.4, S.1546-1561

Year

2008

Abstract

Frequent requests from users to search engines on the World Wide Web are to search for information about people using personal names. Current search engines only return sets of documents containing the name queried, but, as several people usually share a personal name, the resulting sets often contain documents relevant to several people. It is necessary to disambiguate people in these result sets in order to to help users find the person of interest more readily. In the task of name disambiguation, effective measurement of similarities in the documents is a crucial step towards the final disambiguation. We propose a new method that uses web directories as a knowledge base to find common contexts in documents and uses the common contexts measure to determine document similarities. Experiments, conducted on documents mentioning real people on the web, together with several famous web directory structures, suggest that there are significant advantages in using web directories to disambiguate people compared with other conventional methods.

Similar documents (content)

1. Spink, A.; Jansen, B.J.; Pedersen , J.: Searching for people on Web search engines (2004) 0.24

   0.24309193 = sum of:
     0.24309193 = product of:
       0.86818546 = sum of:
         0.032170776 = weight(abstract_txt:common in 427) [ClassicSimilarity], result of:
           0.032170776 = score(doc=427,freq=1.0), product of:
             0.10685846 = queryWeight, product of:
               1.3887978 = boost
               4.816955 = idf(docFreq=957, maxDocs=43556)
               0.015973398 = queryNorm
             0.3010597 = fieldWeight in 427, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.816955 = idf(docFreq=957, maxDocs=43556)
               0.0625 = fieldNorm(doc=427)
         0.018057158 = weight(abstract_txt:using in 427) [ClassicSimilarity], result of:
           0.018057158 = score(doc=427,freq=1.0), product of:
             0.08323345 = queryWeight, product of:
               1.5011674 = boost
               3.4711347 = idf(docFreq=3679, maxDocs=43556)
               0.015973398 = queryNorm
             0.21694592 = fieldWeight in 427, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4711347 = idf(docFreq=3679, maxDocs=43556)
               0.0625 = fieldNorm(doc=427)
         0.10466426 = weight(abstract_txt:engines in 427) [ClassicSimilarity], result of:
           0.10466426 = score(doc=427,freq=6.0), product of:
             0.1291169 = queryWeight, product of:
               1.5266029 = boost
               5.2949233 = idf(docFreq=593, maxDocs=43556)
               0.015973398 = queryNorm
             0.8106163 = fieldWeight in 427, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.2949233 = idf(docFreq=593, maxDocs=43556)
               0.0625 = fieldNorm(doc=427)
         0.05960989 = weight(abstract_txt:search in 427) [ClassicSimilarity], result of:
           0.05960989 = score(doc=427,freq=8.0), product of:
             0.09226717 = queryWeight, product of:
               1.5805337 = boost
               3.6546526 = idf(docFreq=3062, maxDocs=43556)
               0.015973398 = queryNorm
             0.6460574 = fieldWeight in 427, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               3.6546526 = idf(docFreq=3062, maxDocs=43556)
               0.0625 = fieldNorm(doc=427)
         0.17790368 = weight(abstract_txt:personal in 427) [ClassicSimilarity], result of:
           0.17790368 = score(doc=427,freq=8.0), product of:
             0.19126035 = queryWeight, product of:
               2.2755828 = boost
               5.261808 = idf(docFreq=613, maxDocs=43556)
               0.015973398 = queryNorm
             0.930165 = fieldWeight in 427, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               5.261808 = idf(docFreq=613, maxDocs=43556)
               0.0625 = fieldNorm(doc=427)
         0.26875553 = weight(abstract_txt:name in 427) [ClassicSimilarity], result of:
           0.26875553 = score(doc=427,freq=6.0), product of:
             0.3050463 = queryWeight, product of:
               3.318428 = boost
               5.7548766 = idf(docFreq=374, maxDocs=43556)
               0.015973398 = queryNorm
             0.881032 = fieldWeight in 427, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.7548766 = idf(docFreq=374, maxDocs=43556)
               0.0625 = fieldNorm(doc=427)
         0.20702417 = weight(abstract_txt:people in 427) [ClassicSimilarity], result of:
           0.20702417 = score(doc=427,freq=4.0), product of:
             0.33589408 = queryWeight, product of:
               4.264777 = boost
               4.9307013 = idf(docFreq=854, maxDocs=43556)
               0.015973398 = queryNorm
             0.61633766 = fieldWeight in 427, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.9307013 = idf(docFreq=854, maxDocs=43556)
               0.0625 = fieldNorm(doc=427)
       0.28 = coord(7/25)
   

2. Kim, J.; Kim, J.; Owen-Smith, J.: Ethnicity-based name partitioning for author name disambiguation using supervised machine learning (2021) 0.22

   0.22011809 = sum of:
     0.22011809 = product of:
       1.1005905 = sum of:
         0.08230286 = weight(abstract_txt:similarities in 2598) [ClassicSimilarity], result of:
           0.08230286 = score(doc=2598,freq=1.0), product of:
             0.19988392 = queryWeight, product of:
               1.8994308 = boost
               6.5880527 = idf(docFreq=162, maxDocs=43556)
               0.015973398 = queryNorm
             0.4117533 = fieldWeight in 2598, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.5880527 = idf(docFreq=162, maxDocs=43556)
               0.0625 = fieldNorm(doc=2598)
         0.040822994 = weight(abstract_txt:several in 2598) [ClassicSimilarity], result of:
           0.040822994 = score(doc=2598,freq=1.0), product of:
             0.14337328 = queryWeight, product of:
               1.970218 = boost
               4.5557156 = idf(docFreq=1243, maxDocs=43556)
               0.015973398 = queryNorm
             0.28473222 = fieldWeight in 2598, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5557156 = idf(docFreq=1243, maxDocs=43556)
               0.0625 = fieldNorm(doc=2598)
         0.18547049 = weight(abstract_txt:disambiguate in 2598) [ClassicSimilarity], result of:
           0.18547049 = score(doc=2598,freq=1.0), product of:
             0.34357202 = queryWeight, product of:
               2.4902527 = boost
               8.63728 = idf(docFreq=20, maxDocs=43556)
               0.015973398 = queryNorm
             0.53983 = fieldWeight in 2598, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.63728 = idf(docFreq=20, maxDocs=43556)
               0.0625 = fieldNorm(doc=2598)
         0.38146326 = weight(abstract_txt:disambiguation in 2598) [ClassicSimilarity], result of:
           0.38146326 = score(doc=2598,freq=5.0), product of:
             0.37197188 = queryWeight, product of:
               3.173476 = boost
               7.3379974 = idf(docFreq=76, maxDocs=43556)
               0.015973398 = queryNorm
             1.0255164 = fieldWeight in 2598, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               7.3379974 = idf(docFreq=76, maxDocs=43556)
               0.0625 = fieldNorm(doc=2598)
         0.41053087 = weight(abstract_txt:name in 2598) [ClassicSimilarity], result of:
           0.41053087 = score(doc=2598,freq=14.0), product of:
             0.3050463 = queryWeight, product of:
               3.318428 = boost
               5.7548766 = idf(docFreq=374, maxDocs=43556)
               0.015973398 = queryNorm
             1.3457986 = fieldWeight in 2598, product of:
               3.7416575 = tf(freq=14.0), with freq of:
                 14.0 = termFreq=14.0
               5.7548766 = idf(docFreq=374, maxDocs=43556)
               0.0625 = fieldNorm(doc=2598)
       0.2 = coord(5/25)
   

3. Dumais, S.T.: Latent semantic analysis (2003) 0.17

   0.17347766 = sum of:
     0.17347766 = product of:
       0.3942674 = sum of:
         0.0065590283 = weight(abstract_txt:users in 4460) [ClassicSimilarity], result of:
           0.0065590283 = score(doc=4460,freq=1.0), product of:
             0.05875988 = queryWeight, product of:
               1.0298524 = boost
               3.5719764 = idf(docFreq=3326, maxDocs=43556)
               0.015973398 = queryNorm
             0.11162426 = fieldWeight in 4460, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.5719764 = idf(docFreq=3326, maxDocs=43556)
               0.03125 = fieldNorm(doc=4460)
         0.038796272 = weight(abstract_txt:return in 4460) [ClassicSimilarity], result of:
           0.038796272 = score(doc=4460,freq=2.0), product of:
             0.12106758 = queryWeight, product of:
               1.045282 = boost
               7.250986 = idf(docFreq=83, maxDocs=43556)
               0.015973398 = queryNorm
             0.32045135 = fieldWeight in 4460, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.250986 = idf(docFreq=83, maxDocs=43556)
               0.03125 = fieldNorm(doc=4460)
         0.029319666 = weight(abstract_txt:find in 4460) [ClassicSimilarity], result of:
           0.029319666 = score(doc=4460,freq=3.0), product of:
             0.110557154 = queryWeight, product of:
               1.4126285 = boost
               4.8996105 = idf(docFreq=881, maxDocs=43556)
               0.015973398 = queryNorm
             0.26519918 = fieldWeight in 4460, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.8996105 = idf(docFreq=881, maxDocs=43556)
               0.03125 = fieldNorm(doc=4460)
         0.012768338 = weight(abstract_txt:using in 4460) [ClassicSimilarity], result of:
           0.012768338 = score(doc=4460,freq=2.0), product of:
             0.08323345 = queryWeight, product of:
               1.5011674 = boost
               3.4711347 = idf(docFreq=3679, maxDocs=43556)
               0.015973398 = queryNorm
             0.15340392 = fieldWeight in 4460, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4711347 = idf(docFreq=3679, maxDocs=43556)
               0.03125 = fieldNorm(doc=4460)
         0.0213645 = weight(abstract_txt:engines in 4460) [ClassicSimilarity], result of:
           0.0213645 = score(doc=4460,freq=1.0), product of:
             0.1291169 = queryWeight, product of:
               1.5266029 = boost
               5.2949233 = idf(docFreq=593, maxDocs=43556)
               0.015973398 = queryNorm
             0.16546635 = fieldWeight in 4460, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2949233 = idf(docFreq=593, maxDocs=43556)
               0.03125 = fieldNorm(doc=4460)
         0.018251726 = weight(abstract_txt:search in 4460) [ClassicSimilarity], result of:
           0.018251726 = score(doc=4460,freq=3.0), product of:
             0.09226717 = queryWeight, product of:
               1.5805337 = boost
               3.6546526 = idf(docFreq=3062, maxDocs=43556)
               0.015973398 = queryNorm
             0.19781387 = fieldWeight in 4460, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.6546526 = idf(docFreq=3062, maxDocs=43556)
               0.03125 = fieldNorm(doc=4460)
         0.027937345 = weight(abstract_txt:contexts in 4460) [ClassicSimilarity], result of:
           0.027937345 = score(doc=4460,freq=1.0), product of:
             0.15439905 = queryWeight, product of:
               1.6693864 = boost
               5.7901587 = idf(docFreq=361, maxDocs=43556)
               0.015973398 = queryNorm
             0.18094246 = fieldWeight in 4460, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7901587 = idf(docFreq=361, maxDocs=43556)
               0.03125 = fieldNorm(doc=4460)
         0.04115143 = weight(abstract_txt:similarities in 4460) [ClassicSimilarity], result of:
           0.04115143 = score(doc=4460,freq=1.0), product of:
             0.19988392 = queryWeight, product of:
               1.8994308 = boost
               6.5880527 = idf(docFreq=162, maxDocs=43556)
               0.015973398 = queryNorm
             0.20587665 = fieldWeight in 4460, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.5880527 = idf(docFreq=162, maxDocs=43556)
               0.03125 = fieldNorm(doc=4460)
         0.028866215 = weight(abstract_txt:several in 4460) [ClassicSimilarity], result of:
           0.028866215 = score(doc=4460,freq=2.0), product of:
             0.14337328 = queryWeight, product of:
               1.970218 = boost
               4.5557156 = idf(docFreq=1243, maxDocs=43556)
               0.015973398 = queryNorm
             0.20133609 = fieldWeight in 4460, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.5557156 = idf(docFreq=1243, maxDocs=43556)
               0.03125 = fieldNorm(doc=4460)
         0.07960877 = weight(abstract_txt:documents in 4460) [ClassicSimilarity], result of:
           0.07960877 = score(doc=4460,freq=10.0), product of:
             0.19549778 = queryWeight, product of:
               2.97013 = boost
               4.1206813 = idf(docFreq=1921, maxDocs=43556)
               0.015973398 = queryNorm
             0.4072106 = fieldWeight in 4460, product of:
               3.1622777 = tf(freq=10.0), with freq of:
                 10.0 = termFreq=10.0
               4.1206813 = idf(docFreq=1921, maxDocs=43556)
               0.03125 = fieldNorm(doc=4460)
         0.0896441 = weight(abstract_txt:people in 4460) [ClassicSimilarity], result of:
           0.0896441 = score(doc=4460,freq=3.0), product of:
             0.33589408 = queryWeight, product of:
               4.264777 = boost
               4.9307013 = idf(docFreq=854, maxDocs=43556)
               0.015973398 = queryNorm
             0.26688203 = fieldWeight in 4460, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.9307013 = idf(docFreq=854, maxDocs=43556)
               0.03125 = fieldNorm(doc=4460)
       0.44 = coord(11/25)
   

4. Khoo, C.S.G.; Ng, K.; Ou, S.: ¬An exploratory study of human clustering of Web pages (2003) 0.13

   0.13177265 = sum of:
     0.13177265 = product of:
       0.36603513 = sum of:
         0.02199965 = weight(abstract_txt:users in 3739) [ClassicSimilarity], result of:
           0.02199965 = score(doc=3739,freq=5.0), product of:
             0.05875988 = queryWeight, product of:
               1.0298524 = boost
               3.5719764 = idf(docFreq=3326, maxDocs=43556)
               0.015973398 = queryNorm
             0.37439916 = fieldWeight in 3739, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.5719764 = idf(docFreq=3326, maxDocs=43556)
               0.046875 = fieldNorm(doc=3739)
         0.024128081 = weight(abstract_txt:common in 3739) [ClassicSimilarity], result of:
           0.024128081 = score(doc=3739,freq=1.0), product of:
             0.10685846 = queryWeight, product of:
               1.3887978 = boost
               4.816955 = idf(docFreq=957, maxDocs=43556)
               0.015973398 = queryNorm
             0.22579476 = fieldWeight in 3739, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.816955 = idf(docFreq=957, maxDocs=43556)
               0.046875 = fieldNorm(doc=3739)
         0.035909113 = weight(abstract_txt:find in 3739) [ClassicSimilarity], result of:
           0.035909113 = score(doc=3739,freq=2.0), product of:
             0.110557154 = queryWeight, product of:
               1.4126285 = boost
               4.8996105 = idf(docFreq=881, maxDocs=43556)
               0.015973398 = queryNorm
             0.32480136 = fieldWeight in 3739, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.8996105 = idf(docFreq=881, maxDocs=43556)
               0.046875 = fieldNorm(doc=3739)
         0.013542869 = weight(abstract_txt:using in 3739) [ClassicSimilarity], result of:
           0.013542869 = score(doc=3739,freq=1.0), product of:
             0.08323345 = queryWeight, product of:
               1.5011674 = boost
               3.4711347 = idf(docFreq=3679, maxDocs=43556)
               0.015973398 = queryNorm
             0.16270944 = fieldWeight in 3739, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4711347 = idf(docFreq=3679, maxDocs=43556)
               0.046875 = fieldNorm(doc=3739)
         0.0640935 = weight(abstract_txt:engines in 3739) [ClassicSimilarity], result of:
           0.0640935 = score(doc=3739,freq=4.0), product of:
             0.1291169 = queryWeight, product of:
               1.5266029 = boost
               5.2949233 = idf(docFreq=593, maxDocs=43556)
               0.015973398 = queryNorm
             0.49639904 = fieldWeight in 3739, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.2949233 = idf(docFreq=593, maxDocs=43556)
               0.046875 = fieldNorm(doc=3739)
         0.04470742 = weight(abstract_txt:search in 3739) [ClassicSimilarity], result of:
           0.04470742 = score(doc=3739,freq=8.0), product of:
             0.09226717 = queryWeight, product of:
               1.5805337 = boost
               3.6546526 = idf(docFreq=3062, maxDocs=43556)
               0.015973398 = queryNorm
             0.48454309 = fieldWeight in 3739, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               3.6546526 = idf(docFreq=3062, maxDocs=43556)
               0.046875 = fieldNorm(doc=3739)
         0.030617245 = weight(abstract_txt:several in 3739) [ClassicSimilarity], result of:
           0.030617245 = score(doc=3739,freq=1.0), product of:
             0.14337328 = queryWeight, product of:
               1.970218 = boost
               4.5557156 = idf(docFreq=1243, maxDocs=43556)
               0.015973398 = queryNorm
             0.21354917 = fieldWeight in 3739, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5557156 = idf(docFreq=1243, maxDocs=43556)
               0.046875 = fieldNorm(doc=3739)
         0.053403184 = weight(abstract_txt:documents in 3739) [ClassicSimilarity], result of:
           0.053403184 = score(doc=3739,freq=2.0), product of:
             0.19549778 = queryWeight, product of:
               2.97013 = boost
               4.1206813 = idf(docFreq=1921, maxDocs=43556)
               0.015973398 = queryNorm
             0.27316517 = fieldWeight in 3739, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1206813 = idf(docFreq=1921, maxDocs=43556)
               0.046875 = fieldNorm(doc=3739)
         0.07763407 = weight(abstract_txt:people in 3739) [ClassicSimilarity], result of:
           0.07763407 = score(doc=3739,freq=1.0), product of:
             0.33589408 = queryWeight, product of:
               4.264777 = boost
               4.9307013 = idf(docFreq=854, maxDocs=43556)
               0.015973398 = queryNorm
             0.23112662 = fieldWeight in 3739, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9307013 = idf(docFreq=854, maxDocs=43556)
               0.046875 = fieldNorm(doc=3739)
       0.36 = coord(9/25)
   

5. Krovetz, R.; Croft, W.B.: Lexical ambiguity and information retrieval (1992) 0.13

   0.13153133 = sum of:
     0.13153133 = product of:
       0.6576566 = sum of:
         0.048256163 = weight(abstract_txt:common in 4028) [ClassicSimilarity], result of:
           0.048256163 = score(doc=4028,freq=1.0), product of:
             0.10685846 = queryWeight, product of:
               1.3887978 = boost
               4.816955 = idf(docFreq=957, maxDocs=43556)
               0.015973398 = queryNorm
             0.45158952 = fieldWeight in 4028, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.816955 = idf(docFreq=957, maxDocs=43556)
               0.09375 = fieldNorm(doc=4028)
         0.055467624 = weight(abstract_txt:uses in 4028) [ClassicSimilarity], result of:
           0.055467624 = score(doc=4028,freq=1.0), product of:
             0.11725556 = queryWeight, product of:
               1.4547932 = boost
               5.045856 = idf(docFreq=761, maxDocs=43556)
               0.015973398 = queryNorm
             0.47304899 = fieldWeight in 4028, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.045856 = idf(docFreq=761, maxDocs=43556)
               0.09375 = fieldNorm(doc=4028)
         0.06123449 = weight(abstract_txt:several in 4028) [ClassicSimilarity], result of:
           0.06123449 = score(doc=4028,freq=1.0), product of:
             0.14337328 = queryWeight, product of:
               1.970218 = boost
               4.5557156 = idf(docFreq=1243, maxDocs=43556)
               0.015973398 = queryNorm
             0.42709833 = fieldWeight in 4028, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5557156 = idf(docFreq=1243, maxDocs=43556)
               0.09375 = fieldNorm(doc=4028)
         0.13081054 = weight(abstract_txt:documents in 4028) [ClassicSimilarity], result of:
           0.13081054 = score(doc=4028,freq=3.0), product of:
             0.19549778 = queryWeight, product of:
               2.97013 = boost
               4.1206813 = idf(docFreq=1921, maxDocs=43556)
               0.015973398 = queryNorm
             0.66911525 = fieldWeight in 4028, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.1206813 = idf(docFreq=1921, maxDocs=43556)
               0.09375 = fieldNorm(doc=4028)
         0.3618878 = weight(abstract_txt:disambiguation in 4028) [ClassicSimilarity], result of:
           0.3618878 = score(doc=4028,freq=2.0), product of:
             0.37197188 = queryWeight, product of:
               3.173476 = boost
               7.3379974 = idf(docFreq=76, maxDocs=43556)
               0.015973398 = queryNorm
             0.97289026 = fieldWeight in 4028, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.3379974 = idf(docFreq=76, maxDocs=43556)
               0.09375 = fieldNorm(doc=4028)
       0.2 = coord(5/25)