Document (#38090)

Author

Berendsen, R.
Rijke, M. de
Balog, K.
Bogers, T.
Bosch, A. van den

Title

On the assessment of expertise profiles

Source

Journal of the American Society for Information Science and Technology. 64(2013) no.10, S.2024-2044

Year

2013

Abstract

Expertise retrieval has attracted significant interest in the field of information retrieval. Expert finding has been studied extensively, with less attention going to the complementary task of expert profiling, that is, automatically identifying topics about which a person is knowledgeable. We describe a test collection for expert profiling in which expert users have self-selected their knowledge areas. Motivated by the sparseness of this set of knowledge areas, we report on an assessment experiment in which academic experts judge a profile that has been automatically generated by state-of-the-art expert-profiling algorithms; optionally, experts can indicate a level of expertise for relevant areas. Experts may also give feedback on the quality of the system-generated knowledge areas. We report on a content analysis of these comments and gain insights into what aspects of profiles matter to experts. We provide an error analysis of the system-generated profiles, identifying factors that help explain why certain experts may be harder to profile than others. We also analyze the impact on evaluating expert-profiling systems of using self-selected versus judged system-generated knowledge areas as ground truth; they rank systems somewhat differently but detect about the same amount of pairwise significant differences despite the fact that the judged system-generated assessments are more sparse.

Similar documents (author)

1. Balog, K.; Azzopardi, L.; Rijke, M. de: ¬A language modeling framework for expert finding (2009) 2.67

   2.668653 = sum of:
     2.668653 = product of:
       4.0029793 = sum of:
         1.6010047 = weight(author_txt:rijke in 2447) [ClassicSimilarity], result of:
           1.6010047 = score(doc=2447,freq=1.0), product of:
             0.49343112 = queryWeight, product of:
               8.652365 = idf(docFreq=20, maxDocs=44218)
               0.05702847 = queryNorm
             3.2446368 = fieldWeight in 2447, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.652365 = idf(docFreq=20, maxDocs=44218)
               0.375 = fieldNorm(doc=2447)
         2.4019744 = weight(author_txt:balog in 2447) [ClassicSimilarity], result of:
           2.4019744 = score(doc=2447,freq=1.0), product of:
             0.6466616 = queryWeight, product of:
               1.1447885 = boost
               9.905128 = idf(docFreq=5, maxDocs=44218)
               0.05702847 = queryNorm
             3.7144227 = fieldWeight in 2447, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.905128 = idf(docFreq=5, maxDocs=44218)
               0.375 = fieldNorm(doc=2447)
       0.6666667 = coord(2/3)
   

2. Kenter, T.; Balog, K.; Rijke, M. de: Evaluating document filtering systems over time (2015) 2.67

   2.668653 = sum of:
     2.668653 = product of:
       4.0029793 = sum of:
         1.6010047 = weight(author_txt:rijke in 2672) [ClassicSimilarity], result of:
           1.6010047 = score(doc=2672,freq=1.0), product of:
             0.49343112 = queryWeight, product of:
               8.652365 = idf(docFreq=20, maxDocs=44218)
               0.05702847 = queryNorm
             3.2446368 = fieldWeight in 2672, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.652365 = idf(docFreq=20, maxDocs=44218)
               0.375 = fieldNorm(doc=2672)
         2.4019744 = weight(author_txt:balog in 2672) [ClassicSimilarity], result of:
           2.4019744 = score(doc=2672,freq=1.0), product of:
             0.6466616 = queryWeight, product of:
               1.1447885 = boost
               9.905128 = idf(docFreq=5, maxDocs=44218)
               0.05702847 = queryNorm
             3.7144227 = fieldWeight in 2672, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.905128 = idf(docFreq=5, maxDocs=44218)
               0.375 = fieldNorm(doc=2672)
       0.6666667 = coord(2/3)
   

3. Hofmann, K.; Balog, K.; Bogers, T.; Rijke, M. de: Contextual factors for finding similar experts (2010) 2.22

   2.2238777 = sum of:
     2.2238777 = product of:
       3.3358164 = sum of:
         1.3341707 = weight(author_txt:rijke in 3456) [ClassicSimilarity], result of:
           1.3341707 = score(doc=3456,freq=1.0), product of:
             0.49343112 = queryWeight, product of:
               8.652365 = idf(docFreq=20, maxDocs=44218)
               0.05702847 = queryNorm
             2.703864 = fieldWeight in 3456, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.652365 = idf(docFreq=20, maxDocs=44218)
               0.3125 = fieldNorm(doc=3456)
         2.0016456 = weight(author_txt:balog in 3456) [ClassicSimilarity], result of:
           2.0016456 = score(doc=3456,freq=1.0), product of:
             0.6466616 = queryWeight, product of:
               1.1447885 = boost
               9.905128 = idf(docFreq=5, maxDocs=44218)
               0.05702847 = queryNorm
             3.0953524 = fieldWeight in 3456, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.905128 = idf(docFreq=5, maxDocs=44218)
               0.3125 = fieldNorm(doc=3456)
       0.6666667 = coord(2/3)
   

4. Bosch, M.: Ontologies, different reasoning strategies, different logics, different kinds of knowledge representation : working together (2006) 1.14

   1.1384377 = sum of:
     1.1384377 = product of:
       3.4153132 = sum of:
         3.4153132 = weight(author_txt:bosch in 166) [ClassicSimilarity], result of:
           3.4153132 = score(doc=166,freq=1.0), product of:
             0.5816825 = queryWeight, product of:
               1.0857497 = boost
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.05702847 = queryNorm
             5.871439 = fieldWeight in 166, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.625 = fieldNorm(doc=166)
       0.33333334 = coord(1/3)
   

5. Nofsinger, M.M.; Bosch, A.W.: Roles of the head of reference : from the 1990s to the 21st century (1994) 0.91

   0.91075027 = sum of:
     0.91075027 = product of:
       2.7322507 = sum of:
         2.7322507 = weight(author_txt:bosch in 999) [ClassicSimilarity], result of:
           2.7322507 = score(doc=999,freq=1.0), product of:
             0.5816825 = queryWeight, product of:
               1.0857497 = boost
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.05702847 = queryNorm
             4.697151 = fieldWeight in 999, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.394302 = idf(docFreq=9, maxDocs=44218)
               0.5 = fieldNorm(doc=999)
       0.33333334 = coord(1/3)
   

Similar documents (content)

1. Koshman, S.: Testing user interaction with a prototype visualization-based information retrieval system (2005) 0.19

   0.1943177 = sum of:
     0.1943177 = product of:
       0.6072428 = sum of:
         0.011935954 = weight(abstract_txt:which in 3562) [ClassicSimilarity], result of:
           0.011935954 = score(doc=3562,freq=2.0), product of:
             0.046298634 = queryWeight, product of:
               1.0460819 = boost
               2.9167147 = idf(docFreq=6503, maxDocs=44218)
               0.015174296 = queryNorm
             0.2578036 = fieldWeight in 3562, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.9167147 = idf(docFreq=6503, maxDocs=44218)
               0.0625 = fieldNorm(doc=3562)
         0.008532385 = weight(abstract_txt:that in 3562) [ClassicSimilarity], result of:
           0.008532385 = score(doc=3562,freq=2.0), product of:
             0.040740214 = queryWeight, product of:
               1.1330854 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.015174296 = queryNorm
             0.20943399 = fieldWeight in 3562, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0625 = fieldNorm(doc=3562)
         0.024570033 = weight(abstract_txt:significant in 3562) [ClassicSimilarity], result of:
           0.024570033 = score(doc=3562,freq=1.0), product of:
             0.082460664 = queryWeight, product of:
               1.1398807 = boost
               4.76737 = idf(docFreq=1021, maxDocs=44218)
               0.015174296 = queryNorm
             0.29796064 = fieldWeight in 3562, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.76737 = idf(docFreq=1021, maxDocs=44218)
               0.0625 = fieldNorm(doc=3562)
         0.032482296 = weight(abstract_txt:selected in 3562) [ClassicSimilarity], result of:
           0.032482296 = score(doc=3562,freq=1.0), product of:
             0.09932856 = queryWeight, product of:
               1.2510453 = boost
               5.232299 = idf(docFreq=641, maxDocs=44218)
               0.015174296 = queryNorm
             0.32701868 = fieldWeight in 3562, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.232299 = idf(docFreq=641, maxDocs=44218)
               0.0625 = fieldNorm(doc=3562)
         0.034786515 = weight(abstract_txt:system in 3562) [ClassicSimilarity], result of:
           0.034786515 = score(doc=3562,freq=4.0), product of:
             0.082522735 = queryWeight, product of:
               1.6126413 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.015174296 = queryNorm
             0.42153856 = fieldWeight in 3562, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.0625 = fieldNorm(doc=3562)
         0.07577555 = weight(abstract_txt:expertise in 3562) [ClassicSimilarity], result of:
           0.07577555 = score(doc=3562,freq=1.0), product of:
             0.19999823 = queryWeight, product of:
               2.174176 = boost
               6.0620975 = idf(docFreq=279, maxDocs=44218)
               0.015174296 = queryNorm
             0.3788811 = fieldWeight in 3562, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0620975 = idf(docFreq=279, maxDocs=44218)
               0.0625 = fieldNorm(doc=3562)
         0.23929863 = weight(abstract_txt:experts in 3562) [ClassicSimilarity], result of:
           0.23929863 = score(doc=3562,freq=4.0), product of:
             0.32153615 = queryWeight, product of:
               3.5589418 = boost
               5.953884 = idf(docFreq=311, maxDocs=44218)
               0.015174296 = queryNorm
             0.7442355 = fieldWeight in 3562, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.953884 = idf(docFreq=311, maxDocs=44218)
               0.0625 = fieldNorm(doc=3562)
         0.17986146 = weight(abstract_txt:expert in 3562) [ClassicSimilarity], result of:
           0.17986146 = score(doc=3562,freq=2.0), product of:
             0.3558761 = queryWeight, product of:
               4.101531 = boost
               5.7180014 = idf(docFreq=394, maxDocs=44218)
               0.015174296 = queryNorm
             0.5054047 = fieldWeight in 3562, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.7180014 = idf(docFreq=394, maxDocs=44218)
               0.0625 = fieldNorm(doc=3562)
       0.32 = coord(8/25)
   

2. Hofmann, K.; Balog, K.; Bogers, T.; Rijke, M. de: Contextual factors for finding similar experts (2010) 0.18

   0.18354341 = sum of:
     0.18354341 = product of:
       0.6555122 = sum of:
         0.007384995 = weight(abstract_txt:which in 3456) [ClassicSimilarity], result of:
           0.007384995 = score(doc=3456,freq=1.0), product of:
             0.046298634 = queryWeight, product of:
               1.0460819 = boost
               2.9167147 = idf(docFreq=6503, maxDocs=44218)
               0.015174296 = queryNorm
             0.15950784 = fieldWeight in 3456, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.9167147 = idf(docFreq=6503, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3456)
         0.01293121 = weight(abstract_txt:that in 3456) [ClassicSimilarity], result of:
           0.01293121 = score(doc=3456,freq=6.0), product of:
             0.040740214 = queryWeight, product of:
               1.1330854 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.015174296 = queryNorm
             0.31740654 = fieldWeight in 3456, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3456)
         0.0152191 = weight(abstract_txt:system in 3456) [ClassicSimilarity], result of:
           0.0152191 = score(doc=3456,freq=1.0), product of:
             0.082522735 = queryWeight, product of:
               1.6126413 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.015174296 = queryNorm
             0.18442312 = fieldWeight in 3456, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3456)
         0.017795708 = weight(abstract_txt:knowledge in 3456) [ClassicSimilarity], result of:
           0.017795708 = score(doc=3456,freq=1.0), product of:
             0.09159205 = queryWeight, product of:
               1.6989472 = boost
               3.5527887 = idf(docFreq=3442, maxDocs=44218)
               0.015174296 = queryNorm
             0.19429314 = fieldWeight in 3456, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.5527887 = idf(docFreq=3442, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3456)
         0.14825937 = weight(abstract_txt:expertise in 3456) [ClassicSimilarity], result of:
           0.14825937 = score(doc=3456,freq=5.0), product of:
             0.19999823 = queryWeight, product of:
               2.174176 = boost
               6.0620975 = idf(docFreq=279, maxDocs=44218)
               0.015174296 = queryNorm
             0.74130344 = fieldWeight in 3456, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               6.0620975 = idf(docFreq=279, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3456)
         0.18133384 = weight(abstract_txt:experts in 3456) [ClassicSimilarity], result of:
           0.18133384 = score(doc=3456,freq=3.0), product of:
             0.32153615 = queryWeight, product of:
               3.5589418 = boost
               5.953884 = idf(docFreq=311, maxDocs=44218)
               0.015174296 = queryNorm
             0.56396097 = fieldWeight in 3456, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.953884 = idf(docFreq=311, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3456)
         0.272588 = weight(abstract_txt:expert in 3456) [ClassicSimilarity], result of:
           0.272588 = score(doc=3456,freq=6.0), product of:
             0.3558761 = queryWeight, product of:
               4.101531 = boost
               5.7180014 = idf(docFreq=394, maxDocs=44218)
               0.015174296 = queryNorm
             0.7659633 = fieldWeight in 3456, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.7180014 = idf(docFreq=394, maxDocs=44218)
               0.0546875 = fieldNorm(doc=3456)
       0.28 = coord(7/25)
   

3. Özel, S.A.; Altingövde, I.S.; Ulusoy, Ö.; Özsoyoglu, G.; Özsoyoglu, Z.M.: Metadata-Based Modeling of Information Resources an the Web (2004) 0.18

   0.18297993 = sum of:
     0.18297993 = product of:
       0.6534997 = sum of:
         0.008439994 = weight(abstract_txt:which in 2093) [ClassicSimilarity], result of:
           0.008439994 = score(doc=2093,freq=1.0), product of:
             0.046298634 = queryWeight, product of:
               1.0460819 = boost
               2.9167147 = idf(docFreq=6503, maxDocs=44218)
               0.015174296 = queryNorm
             0.18229467 = fieldWeight in 2093, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.9167147 = idf(docFreq=6503, maxDocs=44218)
               0.0625 = fieldNorm(doc=2093)
         0.010449995 = weight(abstract_txt:that in 2093) [ClassicSimilarity], result of:
           0.010449995 = score(doc=2093,freq=3.0), product of:
             0.040740214 = queryWeight, product of:
               1.1330854 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.015174296 = queryNorm
             0.2565032 = fieldWeight in 2093, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0625 = fieldNorm(doc=2093)
         0.017393257 = weight(abstract_txt:system in 2093) [ClassicSimilarity], result of:
           0.017393257 = score(doc=2093,freq=1.0), product of:
             0.082522735 = queryWeight, product of:
               1.6126413 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.015174296 = queryNorm
             0.21076928 = fieldWeight in 2093, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.0625 = fieldNorm(doc=2093)
         0.028762206 = weight(abstract_txt:knowledge in 2093) [ClassicSimilarity], result of:
           0.028762206 = score(doc=2093,freq=2.0), product of:
             0.09159205 = queryWeight, product of:
               1.6989472 = boost
               3.5527887 = idf(docFreq=3442, maxDocs=44218)
               0.015174296 = queryNorm
             0.31402513 = fieldWeight in 2093, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.5527887 = idf(docFreq=3442, maxDocs=44218)
               0.0625 = fieldNorm(doc=2093)
         0.10908207 = weight(abstract_txt:profiles in 2093) [ClassicSimilarity], result of:
           0.10908207 = score(doc=2093,freq=1.0), product of:
             0.2549817 = queryWeight, product of:
               2.4549131 = boost
               6.8448567 = idf(docFreq=127, maxDocs=44218)
               0.015174296 = queryNorm
             0.42780355 = fieldWeight in 2093, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8448567 = idf(docFreq=127, maxDocs=44218)
               0.0625 = fieldNorm(doc=2093)
         0.11964931 = weight(abstract_txt:experts in 2093) [ClassicSimilarity], result of:
           0.11964931 = score(doc=2093,freq=1.0), product of:
             0.32153615 = queryWeight, product of:
               3.5589418 = boost
               5.953884 = idf(docFreq=311, maxDocs=44218)
               0.015174296 = queryNorm
             0.37211776 = fieldWeight in 2093, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.953884 = idf(docFreq=311, maxDocs=44218)
               0.0625 = fieldNorm(doc=2093)
         0.3597229 = weight(abstract_txt:expert in 2093) [ClassicSimilarity], result of:
           0.3597229 = score(doc=2093,freq=8.0), product of:
             0.3558761 = queryWeight, product of:
               4.101531 = boost
               5.7180014 = idf(docFreq=394, maxDocs=44218)
               0.015174296 = queryNorm
             1.0108094 = fieldWeight in 2093, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               5.7180014 = idf(docFreq=394, maxDocs=44218)
               0.0625 = fieldNorm(doc=2093)
       0.28 = coord(7/25)
   

4. Bonnardel, N.: Expertise transfer, knowledge elicitation, and delayed recall in a design context (1993) 0.17

   0.1695472 = sum of:
     0.1695472 = product of:
       0.7064467 = sum of:
         0.012659991 = weight(abstract_txt:which in 7467) [ClassicSimilarity], result of:
           0.012659991 = score(doc=7467,freq=1.0), product of:
             0.046298634 = queryWeight, product of:
               1.0460819 = boost
               2.9167147 = idf(docFreq=6503, maxDocs=44218)
               0.015174296 = queryNorm
             0.273442 = fieldWeight in 7467, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.9167147 = idf(docFreq=6503, maxDocs=44218)
               0.09375 = fieldNorm(doc=7467)
         0.009049961 = weight(abstract_txt:that in 7467) [ClassicSimilarity], result of:
           0.009049961 = score(doc=7467,freq=1.0), product of:
             0.040740214 = queryWeight, product of:
               1.1330854 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.015174296 = queryNorm
             0.22213829 = fieldWeight in 7467, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.09375 = fieldNorm(doc=7467)
         0.0747264 = weight(abstract_txt:knowledge in 7467) [ClassicSimilarity], result of:
           0.0747264 = score(doc=7467,freq=6.0), product of:
             0.09159205 = queryWeight, product of:
               1.6989472 = boost
               3.5527887 = idf(docFreq=3442, maxDocs=44218)
               0.015174296 = queryNorm
             0.8158612 = fieldWeight in 7467, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               3.5527887 = idf(docFreq=3442, maxDocs=44218)
               0.09375 = fieldNorm(doc=7467)
         0.1607442 = weight(abstract_txt:expertise in 7467) [ClassicSimilarity], result of:
           0.1607442 = score(doc=7467,freq=2.0), product of:
             0.19999823 = queryWeight, product of:
               2.174176 = boost
               6.0620975 = idf(docFreq=279, maxDocs=44218)
               0.015174296 = queryNorm
             0.8037281 = fieldWeight in 7467, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.0620975 = idf(docFreq=279, maxDocs=44218)
               0.09375 = fieldNorm(doc=7467)
         0.17947397 = weight(abstract_txt:experts in 7467) [ClassicSimilarity], result of:
           0.17947397 = score(doc=7467,freq=1.0), product of:
             0.32153615 = queryWeight, product of:
               3.5589418 = boost
               5.953884 = idf(docFreq=311, maxDocs=44218)
               0.015174296 = queryNorm
             0.55817664 = fieldWeight in 7467, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.953884 = idf(docFreq=311, maxDocs=44218)
               0.09375 = fieldNorm(doc=7467)
         0.26979217 = weight(abstract_txt:expert in 7467) [ClassicSimilarity], result of:
           0.26979217 = score(doc=7467,freq=2.0), product of:
             0.3558761 = queryWeight, product of:
               4.101531 = boost
               5.7180014 = idf(docFreq=394, maxDocs=44218)
               0.015174296 = queryNorm
             0.75810707 = fieldWeight in 7467, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.7180014 = idf(docFreq=394, maxDocs=44218)
               0.09375 = fieldNorm(doc=7467)
       0.24 = coord(6/25)
   

5. Evens, M.W.: Natural language interface for an expert system (2002) 0.17

   0.16515137 = sum of:
     0.16515137 = product of:
       0.58982635 = sum of:
         0.014109108 = weight(abstract_txt:that in 3719) [ClassicSimilarity], result of:
           0.014109108 = score(doc=3719,freq=14.0), product of:
             0.040740214 = queryWeight, product of:
               1.1330854 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.015174296 = queryNorm
             0.34631893 = fieldWeight in 3719, product of:
               3.7416575 = tf(freq=14.0), with freq of:
                 14.0 = termFreq=14.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0390625 = fieldNorm(doc=3719)
         0.0498162 = weight(abstract_txt:system in 3719) [ClassicSimilarity], result of:
           0.0498162 = score(doc=3719,freq=21.0), product of:
             0.082522735 = queryWeight, product of:
               1.6126413 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.015174296 = queryNorm
             0.60366637 = fieldWeight in 3719, product of:
               4.582576 = tf(freq=21.0), with freq of:
                 21.0 = termFreq=21.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.0390625 = fieldNorm(doc=3719)
         0.022016477 = weight(abstract_txt:knowledge in 3719) [ClassicSimilarity], result of:
           0.022016477 = score(doc=3719,freq=3.0), product of:
             0.09159205 = queryWeight, product of:
               1.6989472 = boost
               3.5527887 = idf(docFreq=3442, maxDocs=44218)
               0.015174296 = queryNorm
             0.24037541 = fieldWeight in 3719, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.5527887 = idf(docFreq=3442, maxDocs=44218)
               0.0390625 = fieldNorm(doc=3719)
         0.047359716 = weight(abstract_txt:expertise in 3719) [ClassicSimilarity], result of:
           0.047359716 = score(doc=3719,freq=1.0), product of:
             0.19999823 = queryWeight, product of:
               2.174176 = boost
               6.0620975 = idf(docFreq=279, maxDocs=44218)
               0.015174296 = queryNorm
             0.23680069 = fieldWeight in 3719, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0620975 = idf(docFreq=279, maxDocs=44218)
               0.0390625 = fieldNorm(doc=3719)
         0.0843261 = weight(abstract_txt:generated in 3719) [ClassicSimilarity], result of:
           0.0843261 = score(doc=3719,freq=2.0), product of:
             0.27648252 = queryWeight, product of:
               3.3001966 = boost
               5.52102 = idf(docFreq=480, maxDocs=44218)
               0.015174296 = queryNorm
             0.30499613 = fieldWeight in 3719, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.52102 = idf(docFreq=480, maxDocs=44218)
               0.0390625 = fieldNorm(doc=3719)
         0.07478082 = weight(abstract_txt:experts in 3719) [ClassicSimilarity], result of:
           0.07478082 = score(doc=3719,freq=1.0), product of:
             0.32153615 = queryWeight, product of:
               3.5589418 = boost
               5.953884 = idf(docFreq=311, maxDocs=44218)
               0.015174296 = queryNorm
             0.2325736 = fieldWeight in 3719, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.953884 = idf(docFreq=311, maxDocs=44218)
               0.0390625 = fieldNorm(doc=3719)
         0.2974179 = weight(abstract_txt:expert in 3719) [ClassicSimilarity], result of:
           0.2974179 = score(doc=3719,freq=14.0), product of:
             0.3558761 = queryWeight, product of:
               4.101531 = boost
               5.7180014 = idf(docFreq=394, maxDocs=44218)
               0.015174296 = queryNorm
             0.8357345 = fieldWeight in 3719, product of:
               3.7416575 = tf(freq=14.0), with freq of:
                 14.0 = termFreq=14.0
               5.7180014 = idf(docFreq=394, maxDocs=44218)
               0.0390625 = fieldNorm(doc=3719)
       0.28 = coord(7/25)