Document (#34025)

Author
Petrelli, D.
Title
On the role of user-centred evaluation in the advancement of interactive information retrieval
Source
Information processing and management. 44(2008) no.1, S.22-38
Year
2008
Abstract
This paper discusses the role of user-centred evaluations as an essential method for researching interactive information retrieval. It draws mainly on the work carried out during the Clarity Project where different user-centred evaluations were run during the lifecycle of a cross-language information retrieval system. The iterative testing was not only instrumental to the development of a usable system, but it enhanced our knowledge of the potential, impact, and actual use of cross-language information retrieval technology. Indeed the role of the user evaluation was dual: by testing a specific prototype it was possible to gain a micro-view and assess the effectiveness of each component of the complex system; by cumulating the result of all the evaluations (in total 43 people were involved) it was possible to build a macro-view of how cross-language retrieval would impact on users and their tasks. By showing the richness of results that can be acquired, this paper aims at stimulating researchers into considering user-centred evaluations as a flexible, adaptable and comprehensive technique for investigating non-traditional information access systems.
Footnote
Beitrag eines Themenbereichs: Evaluation of Interactive Information Retrieval Systems
Theme
Retrievalstudien

Similar documents (content)

  1. Petrelli, D.; Levin, S.; Beaulieu, M.; Sanderson, M.: Which user interaction for cross-language information retrieval? : design issues and reflections (2006) 0.35
    0.3497406 = sum of:
      0.3497406 = product of:
        0.87435144 = sum of:
          0.10018639 = weight(abstract_txt:instrumental in 51) [ClassicSimilarity], result of:
            0.10018639 = score(doc=51,freq=1.0), product of:
              0.15835279 = queryWeight, product of:
                1.0368322 = boost
                8.098284 = idf(docFreq=35, maxDocs=43556)
                0.018859243 = queryNorm
              0.6326784 = fieldWeight in 51, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.098284 = idf(docFreq=35, maxDocs=43556)
                0.078125 = fieldNorm(doc=51)
          0.043531872 = weight(abstract_txt:during in 51) [ClassicSimilarity], result of:
            0.043531872 = score(doc=51,freq=1.0), product of:
              0.11445501 = queryWeight, product of:
                1.2466025 = boost
                4.868358 = idf(docFreq=909, maxDocs=43556)
                0.018859243 = queryNorm
              0.3803405 = fieldWeight in 51, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.868358 = idf(docFreq=909, maxDocs=43556)
                0.078125 = fieldNorm(doc=51)
          0.047726262 = weight(abstract_txt:view in 51) [ClassicSimilarity], result of:
            0.047726262 = score(doc=51,freq=1.0), product of:
              0.12169372 = queryWeight, product of:
                1.285419 = boost
                5.019948 = idf(docFreq=781, maxDocs=43556)
                0.018859243 = queryNorm
              0.39218342 = fieldWeight in 51, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.019948 = idf(docFreq=781, maxDocs=43556)
                0.078125 = fieldNorm(doc=51)
          0.030528104 = weight(abstract_txt:system in 51) [ClassicSimilarity], result of:
            0.030528104 = score(doc=51,freq=2.0), product of:
              0.082082435 = queryWeight, product of:
                1.292949 = boost
                3.3662362 = idf(docFreq=4086, maxDocs=43556)
                0.018859243 = queryNorm
              0.37192005 = fieldWeight in 51, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.3662362 = idf(docFreq=4086, maxDocs=43556)
                0.078125 = fieldNorm(doc=51)
          0.01902754 = weight(abstract_txt:information in 51) [ClassicSimilarity], result of:
            0.01902754 = score(doc=51,freq=2.0), product of:
              0.07101036 = queryWeight, product of:
                1.5525353 = boost
                2.425247 = idf(docFreq=10472, maxDocs=43556)
                0.018859243 = queryNorm
              0.26795444 = fieldWeight in 51, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.425247 = idf(docFreq=10472, maxDocs=43556)
                0.078125 = fieldNorm(doc=51)
          0.08326685 = weight(abstract_txt:language in 51) [ClassicSimilarity], result of:
            0.08326685 = score(doc=51,freq=4.0), product of:
              0.12718086 = queryWeight, product of:
                1.6094116 = boost
                4.1901574 = idf(docFreq=1792, maxDocs=43556)
                0.018859243 = queryNorm
              0.6547121 = fieldWeight in 51, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.1901574 = idf(docFreq=1792, maxDocs=43556)
                0.078125 = fieldNorm(doc=51)
          0.17337415 = weight(abstract_txt:cross in 51) [ClassicSimilarity], result of:
            0.17337415 = score(doc=51,freq=3.0), product of:
              0.2282493 = queryWeight, product of:
                2.1560607 = boost
                5.613377 = idf(docFreq=431, maxDocs=43556)
                0.018859243 = queryNorm
              0.7595824 = fieldWeight in 51, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                5.613377 = idf(docFreq=431, maxDocs=43556)
                0.078125 = fieldNorm(doc=51)
          0.06848504 = weight(abstract_txt:retrieval in 51) [ClassicSimilarity], result of:
            0.06848504 = score(doc=51,freq=3.0), product of:
              0.14569119 = queryWeight, product of:
                2.2238078 = boost
                3.4738557 = idf(docFreq=3669, maxDocs=43556)
                0.018859243 = queryNorm
              0.4700699 = fieldWeight in 51, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.4738557 = idf(docFreq=3669, maxDocs=43556)
                0.078125 = fieldNorm(doc=51)
          0.08146686 = weight(abstract_txt:user in 51) [ClassicSimilarity], result of:
            0.08146686 = score(doc=51,freq=3.0), product of:
              0.1635649 = queryWeight, product of:
                2.3562734 = boost
                3.6807828 = idf(docFreq=2983, maxDocs=43556)
                0.018859243 = queryNorm
              0.49807054 = fieldWeight in 51, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.6807828 = idf(docFreq=2983, maxDocs=43556)
                0.078125 = fieldNorm(doc=51)
          0.22675836 = weight(abstract_txt:evaluations in 51) [ClassicSimilarity], result of:
            0.22675836 = score(doc=51,freq=1.0), product of:
              0.4333267 = queryWeight, product of:
                3.4303098 = boost
                6.698196 = idf(docFreq=145, maxDocs=43556)
                0.018859243 = queryNorm
              0.52329654 = fieldWeight in 51, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.698196 = idf(docFreq=145, maxDocs=43556)
                0.078125 = fieldNorm(doc=51)
        0.4 = coord(10/25)
    
  2. Díaz, A.; García, A.; Gervás, P.: User-centred versus system-centred evaluation of a personalization system (2008) 0.31
    0.30908272 = sum of:
      0.30908272 = product of:
        1.1038668 = sum of:
          0.05476488 = weight(abstract_txt:evaluation in 4092) [ClassicSimilarity], result of:
            0.05476488 = score(doc=4092,freq=4.0), product of:
              0.09750301 = queryWeight, product of:
                1.1505874 = boost
                4.49339 = idf(docFreq=1323, maxDocs=43556)
                0.018859243 = queryNorm
              0.56167376 = fieldWeight in 4092, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.49339 = idf(docFreq=1323, maxDocs=43556)
                0.0625 = fieldNorm(doc=4092)
          0.034825496 = weight(abstract_txt:during in 4092) [ClassicSimilarity], result of:
            0.034825496 = score(doc=4092,freq=1.0), product of:
              0.11445501 = queryWeight, product of:
                1.2466025 = boost
                4.868358 = idf(docFreq=909, maxDocs=43556)
                0.018859243 = queryNorm
              0.30427238 = fieldWeight in 4092, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.868358 = idf(docFreq=909, maxDocs=43556)
                0.0625 = fieldNorm(doc=4092)
          0.04569028 = weight(abstract_txt:system in 4092) [ClassicSimilarity], result of:
            0.04569028 = score(doc=4092,freq=7.0), product of:
              0.082082435 = queryWeight, product of:
                1.292949 = boost
                3.3662362 = idf(docFreq=4086, maxDocs=43556)
                0.018859243 = queryNorm
              0.55663896 = fieldWeight in 4092, product of:
                2.6457512 = tf(freq=7.0), with freq of:
                  7.0 = termFreq=7.0
                3.3662362 = idf(docFreq=4086, maxDocs=43556)
                0.0625 = fieldNorm(doc=4092)
          0.010763603 = weight(abstract_txt:information in 4092) [ClassicSimilarity], result of:
            0.010763603 = score(doc=4092,freq=1.0), product of:
              0.07101036 = queryWeight, product of:
                1.5525353 = boost
                2.425247 = idf(docFreq=10472, maxDocs=43556)
                0.018859243 = queryNorm
              0.15157793 = fieldWeight in 4092, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.425247 = idf(docFreq=10472, maxDocs=43556)
                0.0625 = fieldNorm(doc=4092)
          0.09216923 = weight(abstract_txt:user in 4092) [ClassicSimilarity], result of:
            0.09216923 = score(doc=4092,freq=6.0), product of:
              0.1635649 = queryWeight, product of:
                2.3562734 = boost
                3.6807828 = idf(docFreq=2983, maxDocs=43556)
                0.018859243 = queryNorm
              0.5635025 = fieldWeight in 4092, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                3.6807828 = idf(docFreq=2983, maxDocs=43556)
                0.0625 = fieldNorm(doc=4092)
          0.18140669 = weight(abstract_txt:evaluations in 4092) [ClassicSimilarity], result of:
            0.18140669 = score(doc=4092,freq=1.0), product of:
              0.4333267 = queryWeight, product of:
                3.4303098 = boost
                6.698196 = idf(docFreq=145, maxDocs=43556)
                0.018859243 = queryNorm
              0.41863725 = fieldWeight in 4092, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.698196 = idf(docFreq=145, maxDocs=43556)
                0.0625 = fieldNorm(doc=4092)
          0.6842466 = weight(abstract_txt:centred in 4092) [ClassicSimilarity], result of:
            0.6842466 = score(doc=4092,freq=7.0), product of:
              0.54889464 = queryWeight, product of:
                3.8607361 = boost
                7.538668 = idf(docFreq=62, maxDocs=43556)
                0.018859243 = queryNorm
              1.24659 = fieldWeight in 4092, product of:
                2.6457512 = tf(freq=7.0), with freq of:
                  7.0 = termFreq=7.0
                7.538668 = idf(docFreq=62, maxDocs=43556)
                0.0625 = fieldNorm(doc=4092)
        0.28 = coord(7/25)
    
  3. Borlund, P.; Ruthven, I.: Introduction to the special issue on evaluating interactive information retrieval systems (2008) 0.26
    0.2578624 = sum of:
      0.2578624 = product of:
        0.80582 = sum of:
          0.06161049 = weight(abstract_txt:evaluation in 4017) [ClassicSimilarity], result of:
            0.06161049 = score(doc=4017,freq=9.0), product of:
              0.09750301 = queryWeight, product of:
                1.1505874 = boost
                4.49339 = idf(docFreq=1323, maxDocs=43556)
                0.018859243 = queryNorm
              0.63188297 = fieldWeight in 4017, product of:
                3.0 = tf(freq=9.0), with freq of:
                  9.0 = termFreq=9.0
                4.49339 = idf(docFreq=1323, maxDocs=43556)
                0.046875 = fieldNorm(doc=4017)
          0.018316863 = weight(abstract_txt:system in 4017) [ClassicSimilarity], result of:
            0.018316863 = score(doc=4017,freq=2.0), product of:
              0.082082435 = queryWeight, product of:
                1.292949 = boost
                3.3662362 = idf(docFreq=4086, maxDocs=43556)
                0.018859243 = queryNorm
              0.22315204 = fieldWeight in 4017, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.3662362 = idf(docFreq=4086, maxDocs=43556)
                0.046875 = fieldNorm(doc=4017)
          0.06720603 = weight(abstract_txt:interactive in 4017) [ClassicSimilarity], result of:
            0.06720603 = score(doc=4017,freq=3.0), product of:
              0.14901415 = queryWeight, product of:
                1.4224086 = boost
                5.5549335 = idf(docFreq=457, maxDocs=43556)
                0.018859243 = queryNorm
              0.4510044 = fieldWeight in 4017, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                5.5549335 = idf(docFreq=457, maxDocs=43556)
                0.046875 = fieldNorm(doc=4017)
          0.008072702 = weight(abstract_txt:information in 4017) [ClassicSimilarity], result of:
            0.008072702 = score(doc=4017,freq=1.0), product of:
              0.07101036 = queryWeight, product of:
                1.5525353 = boost
                2.425247 = idf(docFreq=10472, maxDocs=43556)
                0.018859243 = queryNorm
              0.11368345 = fieldWeight in 4017, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.425247 = idf(docFreq=10472, maxDocs=43556)
                0.046875 = fieldNorm(doc=4017)
          0.04109102 = weight(abstract_txt:retrieval in 4017) [ClassicSimilarity], result of:
            0.04109102 = score(doc=4017,freq=3.0), product of:
              0.14569119 = queryWeight, product of:
                2.2238078 = boost
                3.4738557 = idf(docFreq=3669, maxDocs=43556)
                0.018859243 = queryNorm
              0.2820419 = fieldWeight in 4017, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.4738557 = idf(docFreq=3669, maxDocs=43556)
                0.046875 = fieldNorm(doc=4017)
          0.06310396 = weight(abstract_txt:user in 4017) [ClassicSimilarity], result of:
            0.06310396 = score(doc=4017,freq=5.0), product of:
              0.1635649 = queryWeight, product of:
                2.3562734 = boost
                3.6807828 = idf(docFreq=2983, maxDocs=43556)
                0.018859243 = queryNorm
              0.38580376 = fieldWeight in 4017, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                3.6807828 = idf(docFreq=2983, maxDocs=43556)
                0.046875 = fieldNorm(doc=4017)
          0.27211004 = weight(abstract_txt:evaluations in 4017) [ClassicSimilarity], result of:
            0.27211004 = score(doc=4017,freq=4.0), product of:
              0.4333267 = queryWeight, product of:
                3.4303098 = boost
                6.698196 = idf(docFreq=145, maxDocs=43556)
                0.018859243 = queryNorm
              0.62795585 = fieldWeight in 4017, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                6.698196 = idf(docFreq=145, maxDocs=43556)
                0.046875 = fieldNorm(doc=4017)
          0.2743089 = weight(abstract_txt:centred in 4017) [ClassicSimilarity], result of:
            0.2743089 = score(doc=4017,freq=2.0), product of:
              0.54889464 = queryWeight, product of:
                3.8607361 = boost
                7.538668 = idf(docFreq=62, maxDocs=43556)
                0.018859243 = queryNorm
              0.4997478 = fieldWeight in 4017, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                7.538668 = idf(docFreq=62, maxDocs=43556)
                0.046875 = fieldNorm(doc=4017)
        0.32 = coord(8/25)
    
  4. TREC: experiment and evaluation in information retrieval (2005) 0.18
    0.17706315 = sum of:
      0.17706315 = product of:
        0.5533224 = sum of:
          0.03872462 = weight(abstract_txt:evaluation in 1759) [ClassicSimilarity], result of:
            0.03872462 = score(doc=1759,freq=2.0), product of:
              0.09750301 = queryWeight, product of:
                1.1505874 = boost
                4.49339 = idf(docFreq=1323, maxDocs=43556)
                0.018859243 = queryNorm
              0.39716333 = fieldWeight in 1759, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.49339 = idf(docFreq=1323, maxDocs=43556)
                0.0625 = fieldNorm(doc=1759)
          0.02947683 = weight(abstract_txt:impact in 1759) [ClassicSimilarity], result of:
            0.02947683 = score(doc=1759,freq=1.0), product of:
              0.102413476 = queryWeight, product of:
                1.1792046 = boost
                4.605149 = idf(docFreq=1183, maxDocs=43556)
                0.018859243 = queryNorm
              0.2878218 = fieldWeight in 1759, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.605149 = idf(docFreq=1183, maxDocs=43556)
                0.0625 = fieldNorm(doc=1759)
          0.05173523 = weight(abstract_txt:interactive in 1759) [ClassicSimilarity], result of:
            0.05173523 = score(doc=1759,freq=1.0), product of:
              0.14901415 = queryWeight, product of:
                1.4224086 = boost
                5.5549335 = idf(docFreq=457, maxDocs=43556)
                0.018859243 = queryNorm
              0.34718335 = fieldWeight in 1759, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.5549335 = idf(docFreq=457, maxDocs=43556)
                0.0625 = fieldNorm(doc=1759)
          0.0152220335 = weight(abstract_txt:information in 1759) [ClassicSimilarity], result of:
            0.0152220335 = score(doc=1759,freq=2.0), product of:
              0.07101036 = queryWeight, product of:
                1.5525353 = boost
                2.425247 = idf(docFreq=10472, maxDocs=43556)
                0.018859243 = queryNorm
              0.21436356 = fieldWeight in 1759, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.425247 = idf(docFreq=10472, maxDocs=43556)
                0.0625 = fieldNorm(doc=1759)
          0.047102842 = weight(abstract_txt:language in 1759) [ClassicSimilarity], result of:
            0.047102842 = score(doc=1759,freq=2.0), product of:
              0.12718086 = queryWeight, product of:
                1.6094116 = boost
                4.1901574 = idf(docFreq=1792, maxDocs=43556)
                0.018859243 = queryNorm
              0.3703611 = fieldWeight in 1759, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.1901574 = idf(docFreq=1792, maxDocs=43556)
                0.0625 = fieldNorm(doc=1759)
          0.08007809 = weight(abstract_txt:cross in 1759) [ClassicSimilarity], result of:
            0.08007809 = score(doc=1759,freq=1.0), product of:
              0.2282493 = queryWeight, product of:
                2.1560607 = boost
                5.613377 = idf(docFreq=431, maxDocs=43556)
                0.018859243 = queryNorm
              0.35083607 = fieldWeight in 1759, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.613377 = idf(docFreq=431, maxDocs=43556)
                0.0625 = fieldNorm(doc=1759)
          0.10957606 = weight(abstract_txt:retrieval in 1759) [ClassicSimilarity], result of:
            0.10957606 = score(doc=1759,freq=12.0), product of:
              0.14569119 = queryWeight, product of:
                2.2238078 = boost
                3.4738557 = idf(docFreq=3669, maxDocs=43556)
                0.018859243 = queryNorm
              0.7521118 = fieldWeight in 1759, product of:
                3.4641016 = tf(freq=12.0), with freq of:
                  12.0 = termFreq=12.0
                3.4738557 = idf(docFreq=3669, maxDocs=43556)
                0.0625 = fieldNorm(doc=1759)
          0.18140669 = weight(abstract_txt:evaluations in 1759) [ClassicSimilarity], result of:
            0.18140669 = score(doc=1759,freq=1.0), product of:
              0.4333267 = queryWeight, product of:
                3.4303098 = boost
                6.698196 = idf(docFreq=145, maxDocs=43556)
                0.018859243 = queryNorm
              0.41863725 = fieldWeight in 1759, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.698196 = idf(docFreq=145, maxDocs=43556)
                0.0625 = fieldNorm(doc=1759)
        0.32 = coord(8/25)
    
  5. Gross, M.: ¬The imposed query : implications for library service evaluation (1998) 0.17
    0.16983142 = sum of:
      0.16983142 = product of:
        0.5307232 = sum of:
          0.0684561 = weight(abstract_txt:evaluation in 4700) [ClassicSimilarity], result of:
            0.0684561 = score(doc=4700,freq=4.0), product of:
              0.09750301 = queryWeight, product of:
                1.1505874 = boost
                4.49339 = idf(docFreq=1323, maxDocs=43556)
                0.018859243 = queryNorm
              0.7020922 = fieldWeight in 4700, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.49339 = idf(docFreq=1323, maxDocs=43556)
                0.078125 = fieldNorm(doc=4700)
          0.036846038 = weight(abstract_txt:impact in 4700) [ClassicSimilarity], result of:
            0.036846038 = score(doc=4700,freq=1.0), product of:
              0.102413476 = queryWeight, product of:
                1.1792046 = boost
                4.605149 = idf(docFreq=1183, maxDocs=43556)
                0.018859243 = queryNorm
              0.35977724 = fieldWeight in 4700, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.605149 = idf(docFreq=1183, maxDocs=43556)
                0.078125 = fieldNorm(doc=4700)
          0.037465498 = weight(abstract_txt:possible in 4700) [ClassicSimilarity], result of:
            0.037465498 = score(doc=4700,freq=1.0), product of:
              0.10355814 = queryWeight, product of:
                1.1857762 = boost
                4.630813 = idf(docFreq=1153, maxDocs=43556)
                0.018859243 = queryNorm
              0.36178228 = fieldWeight in 4700, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.630813 = idf(docFreq=1153, maxDocs=43556)
                0.078125 = fieldNorm(doc=4700)
          0.02158663 = weight(abstract_txt:system in 4700) [ClassicSimilarity], result of:
            0.02158663 = score(doc=4700,freq=1.0), product of:
              0.082082435 = queryWeight, product of:
                1.292949 = boost
                3.3662362 = idf(docFreq=4086, maxDocs=43556)
                0.018859243 = queryNorm
              0.2629872 = fieldWeight in 4700, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.3662362 = idf(docFreq=4086, maxDocs=43556)
                0.078125 = fieldNorm(doc=4700)
          0.023303885 = weight(abstract_txt:information in 4700) [ClassicSimilarity], result of:
            0.023303885 = score(doc=4700,freq=3.0), product of:
              0.07101036 = queryWeight, product of:
                1.5525353 = boost
                2.425247 = idf(docFreq=10472, maxDocs=43556)
                0.018859243 = queryNorm
              0.32817584 = fieldWeight in 4700, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                2.425247 = idf(docFreq=10472, maxDocs=43556)
                0.078125 = fieldNorm(doc=4700)
          0.049789265 = weight(abstract_txt:role in 4700) [ClassicSimilarity], result of:
            0.049789265 = score(doc=4700,freq=1.0), product of:
              0.14329052 = queryWeight, product of:
                1.7083032 = boost
                4.4476256 = idf(docFreq=1385, maxDocs=43556)
                0.018859243 = queryNorm
              0.34747076 = fieldWeight in 4700, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.4476256 = idf(docFreq=1385, maxDocs=43556)
                0.078125 = fieldNorm(doc=4700)
          0.06651741 = weight(abstract_txt:user in 4700) [ClassicSimilarity], result of:
            0.06651741 = score(doc=4700,freq=2.0), product of:
              0.1635649 = queryWeight, product of:
                2.3562734 = boost
                3.6807828 = idf(docFreq=2983, maxDocs=43556)
                0.018859243 = queryNorm
              0.4066729 = fieldWeight in 4700, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.6807828 = idf(docFreq=2983, maxDocs=43556)
                0.078125 = fieldNorm(doc=4700)
          0.22675836 = weight(abstract_txt:evaluations in 4700) [ClassicSimilarity], result of:
            0.22675836 = score(doc=4700,freq=1.0), product of:
              0.4333267 = queryWeight, product of:
                3.4303098 = boost
                6.698196 = idf(docFreq=145, maxDocs=43556)
                0.018859243 = queryNorm
              0.52329654 = fieldWeight in 4700, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.698196 = idf(docFreq=145, maxDocs=43556)
                0.078125 = fieldNorm(doc=4700)
        0.32 = coord(8/25)