Document (#34027)

Author

Petrelli, D.

Title

On the role of user-centred evaluation in the advancement of interactive information retrieval

Source

Information processing and management. 44(2008) no.1, S.22-38

Year

2008

Abstract

This paper discusses the role of user-centred evaluations as an essential method for researching interactive information retrieval. It draws mainly on the work carried out during the Clarity Project where different user-centred evaluations were run during the lifecycle of a cross-language information retrieval system. The iterative testing was not only instrumental to the development of a usable system, but it enhanced our knowledge of the potential, impact, and actual use of cross-language information retrieval technology. Indeed the role of the user evaluation was dual: by testing a specific prototype it was possible to gain a micro-view and assess the effectiveness of each component of the complex system; by cumulating the result of all the evaluations (in total 43 people were involved) it was possible to build a macro-view of how cross-language retrieval would impact on users and their tasks. By showing the richness of results that can be acquired, this paper aims at stimulating researchers into considering user-centred evaluations as a flexible, adaptable and comprehensive technique for investigating non-traditional information access systems.

Footnote

Beitrag eines Themenbereichs: Evaluation of Interactive Information Retrieval Systems

Theme

Retrievalstudien

Similar documents (content)

1. Petrelli, D.; Levin, S.; Beaulieu, M.; Sanderson, M.: Which user interaction for cross-language information retrieval? : design issues and reflections (2006) 0.35

   0.3507343 = sum of:
     0.3507343 = product of:
       0.8768357 = sum of:
         0.10126416 = weight(abstract_txt:instrumental in 5053) [ClassicSimilarity], result of:
           0.10126416 = score(doc=5053,freq=1.0), product of:
             0.1597587 = queryWeight, product of:
               1.047475 = boost
               8.113368 = idf(docFreq=35, maxDocs=44218)
               0.018798348 = queryNorm
             0.6338569 = fieldWeight in 5053, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.113368 = idf(docFreq=35, maxDocs=44218)
               0.078125 = fieldNorm(doc=5053)
         0.04317547 = weight(abstract_txt:during in 5053) [ClassicSimilarity], result of:
           0.04317547 = score(doc=5053,freq=1.0), product of:
             0.114023775 = queryWeight, product of:
               1.2514806 = boost
               4.846761 = idf(docFreq=943, maxDocs=44218)
               0.018798348 = queryNorm
             0.37865323 = fieldWeight in 5053, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.846761 = idf(docFreq=943, maxDocs=44218)
               0.078125 = fieldNorm(doc=5053)
         0.04782307 = weight(abstract_txt:view in 5053) [ClassicSimilarity], result of:
           0.04782307 = score(doc=5053,freq=1.0), product of:
             0.122066274 = queryWeight, product of:
               1.2948643 = boost
               5.0147786 = idf(docFreq=797, maxDocs=44218)
               0.018798348 = queryNorm
             0.39177957 = fieldWeight in 5053, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.0147786 = idf(docFreq=797, maxDocs=44218)
               0.078125 = fieldNorm(doc=5053)
         0.03085108 = weight(abstract_txt:system in 5053) [ClassicSimilarity], result of:
           0.03085108 = score(doc=5053,freq=2.0), product of:
             0.08280146 = queryWeight, product of:
               1.3061439 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.018798348 = queryNorm
             0.372591 = fieldWeight in 5053, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.078125 = fieldNorm(doc=5053)
         0.0190236 = weight(abstract_txt:information in 5053) [ClassicSimilarity], result of:
           0.0190236 = score(doc=5053,freq=2.0), product of:
             0.07112176 = queryWeight, product of:
               1.5627793 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.018798348 = queryNorm
             0.2674793 = fieldWeight in 5053, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.078125 = fieldNorm(doc=5053)
         0.083211385 = weight(abstract_txt:language in 5053) [ClassicSimilarity], result of:
           0.083211385 = score(doc=5053,freq=4.0), product of:
             0.1273414 = queryWeight, product of:
               1.6197832 = boost
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.018798348 = queryNorm
             0.65345114 = fieldWeight in 5053, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.078125 = fieldNorm(doc=5053)
         0.17311926 = weight(abstract_txt:cross in 5053) [ClassicSimilarity], result of:
           0.17311926 = score(doc=5053,freq=3.0), product of:
             0.22841483 = queryWeight, product of:
               2.1693728 = boost
               5.601063 = idf(docFreq=443, maxDocs=44218)
               0.018798348 = queryNorm
             0.75791603 = fieldWeight in 5053, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.601063 = idf(docFreq=443, maxDocs=44218)
               0.078125 = fieldNorm(doc=5053)
         0.06891274 = weight(abstract_txt:retrieval in 5053) [ClassicSimilarity], result of:
           0.06891274 = score(doc=5053,freq=3.0), product of:
             0.1465469 = queryWeight, product of:
               2.2432864 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.018798348 = queryNorm
             0.47024357 = fieldWeight in 5053, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.078125 = fieldNorm(doc=5053)
         0.08206925 = weight(abstract_txt:user in 5053) [ClassicSimilarity], result of:
           0.08206925 = score(doc=5053,freq=3.0), product of:
             0.16465083 = queryWeight, product of:
               2.3778167 = boost
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.018798348 = queryNorm
             0.49844417 = fieldWeight in 5053, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.078125 = fieldNorm(doc=5053)
         0.22738567 = weight(abstract_txt:evaluations in 5053) [ClassicSimilarity], result of:
           0.22738567 = score(doc=5053,freq=1.0), product of:
             0.43486664 = queryWeight, product of:
               3.456364 = boost
               6.6929407 = idf(docFreq=148, maxDocs=44218)
               0.018798348 = queryNorm
             0.522886 = fieldWeight in 5053, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.6929407 = idf(docFreq=148, maxDocs=44218)
               0.078125 = fieldNorm(doc=5053)
       0.4 = coord(10/25)
   

2. Díaz, A.; García, A.; Gervás, P.: User-centred versus system-centred evaluation of a personalization system (2008) 0.31

   0.30921897 = sum of:
     0.30921897 = product of:
       1.1043534 = sum of:
         0.054777216 = weight(abstract_txt:evaluation in 2094) [ClassicSimilarity], result of:
           0.054777216 = score(doc=2094,freq=4.0), product of:
             0.09768413 = queryWeight, product of:
               1.1583463 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.018798348 = queryNorm
             0.5607586 = fieldWeight in 2094, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=2094)
         0.034540374 = weight(abstract_txt:during in 2094) [ClassicSimilarity], result of:
           0.034540374 = score(doc=2094,freq=1.0), product of:
             0.114023775 = queryWeight, product of:
               1.2514806 = boost
               4.846761 = idf(docFreq=943, maxDocs=44218)
               0.018798348 = queryNorm
             0.30292258 = fieldWeight in 2094, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.846761 = idf(docFreq=943, maxDocs=44218)
               0.0625 = fieldNorm(doc=2094)
         0.04617366 = weight(abstract_txt:system in 2094) [ClassicSimilarity], result of:
           0.04617366 = score(doc=2094,freq=7.0), product of:
             0.08280146 = queryWeight, product of:
               1.3061439 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.018798348 = queryNorm
             0.55764306 = fieldWeight in 2094, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.0625 = fieldNorm(doc=2094)
         0.010761373 = weight(abstract_txt:information in 2094) [ClassicSimilarity], result of:
           0.010761373 = score(doc=2094,freq=1.0), product of:
             0.07112176 = queryWeight, product of:
               1.5627793 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.018798348 = queryNorm
             0.15130915 = fieldWeight in 2094, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0625 = fieldNorm(doc=2094)
         0.09285076 = weight(abstract_txt:user in 2094) [ClassicSimilarity], result of:
           0.09285076 = score(doc=2094,freq=6.0), product of:
             0.16465083 = queryWeight, product of:
               2.3778167 = boost
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.018798348 = queryNorm
             0.56392527 = fieldWeight in 2094, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.0625 = fieldNorm(doc=2094)
         0.18190853 = weight(abstract_txt:evaluations in 2094) [ClassicSimilarity], result of:
           0.18190853 = score(doc=2094,freq=1.0), product of:
             0.43486664 = queryWeight, product of:
               3.456364 = boost
               6.6929407 = idf(docFreq=148, maxDocs=44218)
               0.018798348 = queryNorm
             0.4183088 = fieldWeight in 2094, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.6929407 = idf(docFreq=148, maxDocs=44218)
               0.0625 = fieldNorm(doc=2094)
         0.6833415 = weight(abstract_txt:centred in 2094) [ClassicSimilarity], result of:
           0.6833415 = score(doc=2094,freq=7.0), product of:
             0.54934675 = queryWeight, product of:
               3.8847644 = boost
               7.5225 = idf(docFreq=64, maxDocs=44218)
               0.018798348 = queryNorm
             1.2439165 = fieldWeight in 2094, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               7.5225 = idf(docFreq=64, maxDocs=44218)
               0.0625 = fieldNorm(doc=2094)
       0.28 = coord(7/25)
   

3. Borlund, P.; Ruthven, I.: Introduction to the special issue on evaluating interactive information retrieval systems (2008) 0.26

   0.25839388 = sum of:
     0.25839388 = product of:
       0.80748093 = sum of:
         0.061624367 = weight(abstract_txt:evaluation in 2019) [ClassicSimilarity], result of:
           0.061624367 = score(doc=2019,freq=9.0), product of:
             0.09768413 = queryWeight, product of:
               1.1583463 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.018798348 = queryNorm
             0.6308534 = fieldWeight in 2019, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.046875 = fieldNorm(doc=2019)
         0.018510645 = weight(abstract_txt:system in 2019) [ClassicSimilarity], result of:
           0.018510645 = score(doc=2019,freq=2.0), product of:
             0.08280146 = queryWeight, product of:
               1.3061439 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.018798348 = queryNorm
             0.22355458 = fieldWeight in 2019, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.046875 = fieldNorm(doc=2019)
         0.06754777 = weight(abstract_txt:interactive in 2019) [ClassicSimilarity], result of:
           0.06754777 = score(doc=2019,freq=3.0), product of:
             0.14977412 = queryWeight, product of:
               1.4343158 = boost
               5.5548496 = idf(docFreq=464, maxDocs=44218)
               0.018798348 = queryNorm
             0.4509976 = fieldWeight in 2019, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.5548496 = idf(docFreq=464, maxDocs=44218)
               0.046875 = fieldNorm(doc=2019)
         0.00807103 = weight(abstract_txt:information in 2019) [ClassicSimilarity], result of:
           0.00807103 = score(doc=2019,freq=1.0), product of:
             0.07112176 = queryWeight, product of:
               1.5627793 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.018798348 = queryNorm
             0.113481864 = fieldWeight in 2019, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.046875 = fieldNorm(doc=2019)
         0.041347645 = weight(abstract_txt:retrieval in 2019) [ClassicSimilarity], result of:
           0.041347645 = score(doc=2019,freq=3.0), product of:
             0.1465469 = queryWeight, product of:
               2.2432864 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.018798348 = queryNorm
             0.28214616 = fieldWeight in 2019, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.046875 = fieldNorm(doc=2019)
         0.06357057 = weight(abstract_txt:user in 2019) [ClassicSimilarity], result of:
           0.06357057 = score(doc=2019,freq=5.0), product of:
             0.16465083 = queryWeight, product of:
               2.3778167 = boost
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.018798348 = queryNorm
             0.3860932 = fieldWeight in 2019, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.046875 = fieldNorm(doc=2019)
         0.27286282 = weight(abstract_txt:evaluations in 2019) [ClassicSimilarity], result of:
           0.27286282 = score(doc=2019,freq=4.0), product of:
             0.43486664 = queryWeight, product of:
               3.456364 = boost
               6.6929407 = idf(docFreq=148, maxDocs=44218)
               0.018798348 = queryNorm
             0.6274632 = fieldWeight in 2019, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.6929407 = idf(docFreq=148, maxDocs=44218)
               0.046875 = fieldNorm(doc=2019)
         0.27394605 = weight(abstract_txt:centred in 2019) [ClassicSimilarity], result of:
           0.27394605 = score(doc=2019,freq=2.0), product of:
             0.54934675 = queryWeight, product of:
               3.8847644 = boost
               7.5225 = idf(docFreq=64, maxDocs=44218)
               0.018798348 = queryNorm
             0.498676 = fieldWeight in 2019, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.5225 = idf(docFreq=64, maxDocs=44218)
               0.046875 = fieldNorm(doc=2019)
       0.32 = coord(8/25)
   

4. TREC: experiment and evaluation in information retrieval (2005) 0.18

   0.17742279 = sum of:
     0.17742279 = product of:
       0.5544462 = sum of:
         0.03873334 = weight(abstract_txt:evaluation in 636) [ClassicSimilarity], result of:
           0.03873334 = score(doc=636,freq=2.0), product of:
             0.09768413 = queryWeight, product of:
               1.1583463 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.018798348 = queryNorm
             0.3965162 = fieldWeight in 636, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=636)
         0.029294955 = weight(abstract_txt:impact in 636) [ClassicSimilarity], result of:
           0.029294955 = score(doc=636,freq=1.0), product of:
             0.10216589 = queryWeight, product of:
               1.1846209 = boost
               4.5878253 = idf(docFreq=1222, maxDocs=44218)
               0.018798348 = queryNorm
             0.28673908 = fieldWeight in 636, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5878253 = idf(docFreq=1222, maxDocs=44218)
               0.0625 = fieldNorm(doc=636)
         0.051998295 = weight(abstract_txt:interactive in 636) [ClassicSimilarity], result of:
           0.051998295 = score(doc=636,freq=1.0), product of:
             0.14977412 = queryWeight, product of:
               1.4343158 = boost
               5.5548496 = idf(docFreq=464, maxDocs=44218)
               0.018798348 = queryNorm
             0.3471781 = fieldWeight in 636, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5548496 = idf(docFreq=464, maxDocs=44218)
               0.0625 = fieldNorm(doc=636)
         0.015218879 = weight(abstract_txt:information in 636) [ClassicSimilarity], result of:
           0.015218879 = score(doc=636,freq=2.0), product of:
             0.07112176 = queryWeight, product of:
               1.5627793 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.018798348 = queryNorm
             0.21398345 = fieldWeight in 636, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0625 = fieldNorm(doc=636)
         0.04707147 = weight(abstract_txt:language in 636) [ClassicSimilarity], result of:
           0.04707147 = score(doc=636,freq=2.0), product of:
             0.1273414 = queryWeight, product of:
               1.6197832 = boost
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.018798348 = queryNorm
             0.3696478 = fieldWeight in 636, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1820874 = idf(docFreq=1834, maxDocs=44218)
               0.0625 = fieldNorm(doc=636)
         0.07996036 = weight(abstract_txt:cross in 636) [ClassicSimilarity], result of:
           0.07996036 = score(doc=636,freq=1.0), product of:
             0.22841483 = queryWeight, product of:
               2.1693728 = boost
               5.601063 = idf(docFreq=443, maxDocs=44218)
               0.018798348 = queryNorm
             0.35006642 = fieldWeight in 636, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.601063 = idf(docFreq=443, maxDocs=44218)
               0.0625 = fieldNorm(doc=636)
         0.11026038 = weight(abstract_txt:retrieval in 636) [ClassicSimilarity], result of:
           0.11026038 = score(doc=636,freq=12.0), product of:
             0.1465469 = queryWeight, product of:
               2.2432864 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.018798348 = queryNorm
             0.7523897 = fieldWeight in 636, product of:
               3.4641016 = tf(freq=12.0), with freq of:
                 12.0 = termFreq=12.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=636)
         0.18190853 = weight(abstract_txt:evaluations in 636) [ClassicSimilarity], result of:
           0.18190853 = score(doc=636,freq=1.0), product of:
             0.43486664 = queryWeight, product of:
               3.456364 = boost
               6.6929407 = idf(docFreq=148, maxDocs=44218)
               0.018798348 = queryNorm
             0.4183088 = fieldWeight in 636, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.6929407 = idf(docFreq=148, maxDocs=44218)
               0.0625 = fieldNorm(doc=636)
       0.32 = coord(8/25)
   

5. Gross, M.: ¬The imposed query : implications for library service evaluation (1998) 0.17

   0.1701723 = sum of:
     0.1701723 = product of:
       0.53178847 = sum of:
         0.06847152 = weight(abstract_txt:evaluation in 3702) [ClassicSimilarity], result of:
           0.06847152 = score(doc=3702,freq=4.0), product of:
             0.09768413 = queryWeight, product of:
               1.1583463 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.018798348 = queryNorm
             0.70094824 = fieldWeight in 3702, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.078125 = fieldNorm(doc=3702)
         0.036618695 = weight(abstract_txt:impact in 3702) [ClassicSimilarity], result of:
           0.036618695 = score(doc=3702,freq=1.0), product of:
             0.10216589 = queryWeight, product of:
               1.1846209 = boost
               4.5878253 = idf(docFreq=1222, maxDocs=44218)
               0.018798348 = queryNorm
             0.35842386 = fieldWeight in 3702, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5878253 = idf(docFreq=1222, maxDocs=44218)
               0.078125 = fieldNorm(doc=3702)
         0.03752371 = weight(abstract_txt:possible in 3702) [ClassicSimilarity], result of:
           0.03752371 = score(doc=3702,freq=1.0), product of:
             0.10384236 = queryWeight, product of:
               1.1943007 = boost
               4.6253138 = idf(docFreq=1177, maxDocs=44218)
               0.018798348 = queryNorm
             0.36135262 = fieldWeight in 3702, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.6253138 = idf(docFreq=1177, maxDocs=44218)
               0.078125 = fieldNorm(doc=3702)
         0.021815004 = weight(abstract_txt:system in 3702) [ClassicSimilarity], result of:
           0.021815004 = score(doc=3702,freq=1.0), product of:
             0.08280146 = queryWeight, product of:
               1.3061439 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.018798348 = queryNorm
             0.2634616 = fieldWeight in 3702, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.078125 = fieldNorm(doc=3702)
         0.023299057 = weight(abstract_txt:information in 3702) [ClassicSimilarity], result of:
           0.023299057 = score(doc=3702,freq=3.0), product of:
             0.07112176 = queryWeight, product of:
               1.5627793 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.018798348 = queryNorm
             0.32759392 = fieldWeight in 3702, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.078125 = fieldNorm(doc=3702)
         0.049665537 = weight(abstract_txt:role in 3702) [ClassicSimilarity], result of:
           0.049665537 = score(doc=3702,freq=1.0), product of:
             0.14329726 = queryWeight, product of:
               1.7182683 = boost
               4.4363647 = idf(docFreq=1422, maxDocs=44218)
               0.018798348 = queryNorm
             0.346591 = fieldWeight in 3702, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4363647 = idf(docFreq=1422, maxDocs=44218)
               0.078125 = fieldNorm(doc=3702)
         0.06700926 = weight(abstract_txt:user in 3702) [ClassicSimilarity], result of:
           0.06700926 = score(doc=3702,freq=2.0), product of:
             0.16465083 = queryWeight, product of:
               2.3778167 = boost
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.018798348 = queryNorm
             0.40697798 = fieldWeight in 3702, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6835442 = idf(docFreq=3020, maxDocs=44218)
               0.078125 = fieldNorm(doc=3702)
         0.22738567 = weight(abstract_txt:evaluations in 3702) [ClassicSimilarity], result of:
           0.22738567 = score(doc=3702,freq=1.0), product of:
             0.43486664 = queryWeight, product of:
               3.456364 = boost
               6.6929407 = idf(docFreq=148, maxDocs=44218)
               0.018798348 = queryNorm
             0.522886 = fieldWeight in 3702, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.6929407 = idf(docFreq=148, maxDocs=44218)
               0.078125 = fieldNorm(doc=3702)
       0.32 = coord(8/25)