Document (#38756)

Author
Xie, I.
Benoit, E. III
Title
Search result list evaluation versus document evaluation : similarities and differences
Source
Journal of documentation. 69(2013) no.1, S.49-80
Year
2013
Abstract
Purpose - The purpose of this study is to compare the evaluation of search result lists and documents, in particular evaluation criteria, elements, association between criteria and elements, pre/post and evaluation activities, and the time spent on evaluation. Design/methodology/approach - The study analyzed the data collected from 31 general users through prequestionnaires, think aloud protocols and logs, and post questionnaires. Types of evaluation criteria, elements, associations between criteria and elements, evaluation activities and their associated pre/post activities, and time were analyzed based on open coding. Findings - The study identifies the similarities and differences of list and document evaluation by analyzing 21 evaluation criteria applied, 13 evaluation elements examined, pre/post and evaluation activities performed and time spent. In addition, the authors also explored the time spent in evaluating lists and documents for different types of tasks. Research limitations/implications - This study helps researchers understand the nature of list and document evaluation. Additionally, this study connects elements that participants examined to criteria they applied, and further reveals problems associated with the lack of integration between list and document evaluation. The findings of this study suggest more elements, especially at list level, be available to support users applying their evaluation criteria. Integration of list and document evaluation and integration of pre, evaluation and post evaluation activities for the interface design is the absolute solution for effective evaluation. Originality/value - This study fills a gap in current research in relation to the comparison of list and document evaluation.

Similar documents (content)

  1. Su, L.T.: ¬A comprehensive and systematic model of user evaluation of Web search engines : Il. An evaluation by undergraduates (2003) 0.22
    0.22387856 = sum of:
      0.22387856 = product of:
        0.69962054 = sum of:
          0.018544095 = weight(abstract_txt:applied in 3118) [ClassicSimilarity], result of:
            0.018544095 = score(doc=3118,freq=1.0), product of:
              0.07013491 = queryWeight, product of:
                1.1570998 = boost
                4.8348536 = idf(docFreq=913, maxDocs=42306)
                0.012536608 = queryNorm
              0.26440606 = fieldWeight in 3118, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.8348536 = idf(docFreq=913, maxDocs=42306)
                0.0546875 = fieldNorm(doc=3118)
          0.028890634 = weight(abstract_txt:differences in 3118) [ClassicSimilarity], result of:
            0.028890634 = score(doc=3118,freq=2.0), product of:
              0.074809805 = queryWeight, product of:
                1.1950415 = boost
                4.99339 = idf(docFreq=779, maxDocs=42306)
                0.012536608 = queryNorm
              0.3861878 = fieldWeight in 3118, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.99339 = idf(docFreq=779, maxDocs=42306)
                0.0546875 = fieldNorm(doc=3118)
          0.006065134 = weight(abstract_txt:this in 3118) [ClassicSimilarity], result of:
            0.006065134 = score(doc=3118,freq=1.0), product of:
              0.045186017 = queryWeight, product of:
                1.4685061 = boost
                2.4544165 = idf(docFreq=9879, maxDocs=42306)
                0.012536608 = queryNorm
              0.1342259 = fieldWeight in 3118, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.4544165 = idf(docFreq=9879, maxDocs=42306)
                0.0546875 = fieldNorm(doc=3118)
          0.033761244 = weight(abstract_txt:time in 3118) [ClassicSimilarity], result of:
            0.033761244 = score(doc=3118,freq=2.0), product of:
              0.10457057 = queryWeight, product of:
                1.9981287 = boost
                4.1745143 = idf(docFreq=1768, maxDocs=42306)
                0.012536608 = queryNorm
              0.3228561 = fieldWeight in 3118, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.1745143 = idf(docFreq=1768, maxDocs=42306)
                0.0546875 = fieldNorm(doc=3118)
          0.042123348 = weight(abstract_txt:study in 3118) [ClassicSimilarity], result of:
            0.042123348 = score(doc=3118,freq=3.0), product of:
              0.12758353 = queryWeight, product of:
                2.9196787 = boost
                3.485616 = idf(docFreq=3522, maxDocs=42306)
                0.012536608 = queryNorm
              0.33016288 = fieldWeight in 3118, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.485616 = idf(docFreq=3522, maxDocs=42306)
                0.0546875 = fieldNorm(doc=3118)
          0.09887031 = weight(abstract_txt:post in 3118) [ClassicSimilarity], result of:
            0.09887031 = score(doc=3118,freq=1.0), product of:
              0.29050553 = queryWeight, product of:
                3.7234964 = boost
                6.2233386 = idf(docFreq=227, maxDocs=42306)
                0.012536608 = queryNorm
              0.34033883 = fieldWeight in 3118, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.2233386 = idf(docFreq=227, maxDocs=42306)
                0.0546875 = fieldNorm(doc=3118)
          0.17364532 = weight(abstract_txt:criteria in 3118) [ClassicSimilarity], result of:
            0.17364532 = score(doc=3118,freq=3.0), product of:
              0.3280108 = queryWeight, product of:
                4.6814656 = boost
                5.588899 = idf(docFreq=429, maxDocs=42306)
                0.012536608 = queryNorm
              0.529389 = fieldWeight in 3118, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                5.588899 = idf(docFreq=429, maxDocs=42306)
                0.0546875 = fieldNorm(doc=3118)
          0.29772046 = weight(abstract_txt:evaluation in 3118) [ClassicSimilarity], result of:
            0.29772046 = score(doc=3118,freq=4.0), product of:
              0.60578185 = queryWeight, product of:
                10.753798 = boost
                4.4933925 = idf(docFreq=1285, maxDocs=42306)
                0.012536608 = queryNorm
              0.4914648 = fieldWeight in 3118, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.4933925 = idf(docFreq=1285, maxDocs=42306)
                0.0546875 = fieldNorm(doc=3118)
        0.32 = coord(8/25)
    
  2. Vakkari, P.; Huuskonen, S.: Search effort degrades search output but improves task outcome (2012) 0.22
    0.21639447 = sum of:
      0.21639447 = product of:
        0.5409862 = sum of:
          0.014509901 = weight(abstract_txt:findings in 2047) [ClassicSimilarity], result of:
            0.014509901 = score(doc=2047,freq=1.0), product of:
              0.05448105 = queryWeight, product of:
                1.0198269 = boost
                4.261269 = idf(docFreq=1621, maxDocs=42306)
                0.012536608 = queryNorm
              0.26632932 = fieldWeight in 2047, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.261269 = idf(docFreq=1621, maxDocs=42306)
                0.0625 = fieldNorm(doc=2047)
          0.04378894 = weight(abstract_txt:associated in 2047) [ClassicSimilarity], result of:
            0.04378894 = score(doc=2047,freq=3.0), product of:
              0.078886926 = queryWeight, product of:
                1.2271743 = boost
                5.1276546 = idf(docFreq=681, maxDocs=42306)
                0.012536608 = queryNorm
              0.5550849 = fieldWeight in 2047, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                5.1276546 = idf(docFreq=681, maxDocs=42306)
                0.0625 = fieldNorm(doc=2047)
          0.02541249 = weight(abstract_txt:result in 2047) [ClassicSimilarity], result of:
            0.02541249 = score(doc=2047,freq=1.0), product of:
              0.079159066 = queryWeight, product of:
                1.2292892 = boost
                5.1364913 = idf(docFreq=675, maxDocs=42306)
                0.012536608 = queryNorm
              0.3210307 = fieldWeight in 2047, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.1364913 = idf(docFreq=675, maxDocs=42306)
                0.0625 = fieldNorm(doc=2047)
          0.026792191 = weight(abstract_txt:examined in 2047) [ClassicSimilarity], result of:
            0.026792191 = score(doc=2047,freq=1.0), product of:
              0.08199889 = queryWeight, product of:
                1.2511452 = boost
                5.227815 = idf(docFreq=616, maxDocs=42306)
                0.012536608 = queryNorm
              0.32673845 = fieldWeight in 2047, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.227815 = idf(docFreq=616, maxDocs=42306)
                0.0625 = fieldNorm(doc=2047)
          0.012041116 = weight(abstract_txt:between in 2047) [ClassicSimilarity], result of:
            0.012041116 = score(doc=2047,freq=1.0), product of:
              0.05507368 = queryWeight, product of:
                1.2558026 = boost
                3.498184 = idf(docFreq=3478, maxDocs=42306)
                0.012536608 = queryNorm
              0.2186365 = fieldWeight in 2047, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.498184 = idf(docFreq=3478, maxDocs=42306)
                0.0625 = fieldNorm(doc=2047)
          0.028984517 = weight(abstract_txt:analyzed in 2047) [ClassicSimilarity], result of:
            0.028984517 = score(doc=2047,freq=1.0), product of:
              0.08641316 = queryWeight, product of:
                1.2843804 = boost
                5.366686 = idf(docFreq=536, maxDocs=42306)
                0.012536608 = queryNorm
              0.33541787 = fieldWeight in 2047, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.366686 = idf(docFreq=536, maxDocs=42306)
                0.0625 = fieldNorm(doc=2047)
          0.0069315815 = weight(abstract_txt:this in 2047) [ClassicSimilarity], result of:
            0.0069315815 = score(doc=2047,freq=1.0), product of:
              0.045186017 = queryWeight, product of:
                1.4685061 = boost
                2.4544165 = idf(docFreq=9879, maxDocs=42306)
                0.012536608 = queryNorm
              0.15340103 = fieldWeight in 2047, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.4544165 = idf(docFreq=9879, maxDocs=42306)
                0.0625 = fieldNorm(doc=2047)
          0.039306935 = weight(abstract_txt:study in 2047) [ClassicSimilarity], result of:
            0.039306935 = score(doc=2047,freq=2.0), product of:
              0.12758353 = queryWeight, product of:
                2.9196787 = boost
                3.485616 = idf(docFreq=3522, maxDocs=42306)
                0.012536608 = queryNorm
              0.30808783 = fieldWeight in 2047, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.485616 = idf(docFreq=3522, maxDocs=42306)
                0.0625 = fieldNorm(doc=2047)
          0.10262405 = weight(abstract_txt:list in 2047) [ClassicSimilarity], result of:
            0.10262405 = score(doc=2047,freq=1.0), product of:
              0.30478337 = queryWeight, product of:
                4.512668 = boost
                5.387383 = idf(docFreq=525, maxDocs=42306)
                0.012536608 = queryNorm
              0.33671144 = fieldWeight in 2047, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.387383 = idf(docFreq=525, maxDocs=42306)
                0.0625 = fieldNorm(doc=2047)
          0.24059446 = weight(abstract_txt:evaluation in 2047) [ClassicSimilarity], result of:
            0.24059446 = score(doc=2047,freq=2.0), product of:
              0.60578185 = queryWeight, product of:
                10.753798 = boost
                4.4933925 = idf(docFreq=1285, maxDocs=42306)
                0.012536608 = queryNorm
              0.39716354 = fieldWeight in 2047, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.4933925 = idf(docFreq=1285, maxDocs=42306)
                0.0625 = fieldNorm(doc=2047)
        0.4 = coord(10/25)
    
  3. Xie, H.I.: Users' evaluation of digital libraries (DLs) : their uses, their criteria, and their assessment (2008) 0.20
    0.20016408 = sum of:
      0.20016408 = product of:
        1.0008204 = sum of:
          0.021285888 = weight(abstract_txt:between in 4084) [ClassicSimilarity], result of:
            0.021285888 = score(doc=4084,freq=2.0), product of:
              0.05507368 = queryWeight, product of:
                1.2558026 = boost
                3.498184 = idf(docFreq=3478, maxDocs=42306)
                0.012536608 = queryNorm
              0.3864984 = fieldWeight in 4084, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.498184 = idf(docFreq=3478, maxDocs=42306)
                0.078125 = fieldNorm(doc=4084)
          0.008664477 = weight(abstract_txt:this in 4084) [ClassicSimilarity], result of:
            0.008664477 = score(doc=4084,freq=1.0), product of:
              0.045186017 = queryWeight, product of:
                1.4685061 = boost
                2.4544165 = idf(docFreq=9879, maxDocs=42306)
                0.012536608 = queryNorm
              0.19175129 = fieldWeight in 4084, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.4544165 = idf(docFreq=9879, maxDocs=42306)
                0.078125 = fieldNorm(doc=4084)
          0.049133666 = weight(abstract_txt:study in 4084) [ClassicSimilarity], result of:
            0.049133666 = score(doc=4084,freq=2.0), product of:
              0.12758353 = queryWeight, product of:
                2.9196787 = boost
                3.485616 = idf(docFreq=3522, maxDocs=42306)
                0.012536608 = queryNorm
              0.38510978 = fieldWeight in 4084, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.485616 = idf(docFreq=3522, maxDocs=42306)
                0.078125 = fieldNorm(doc=4084)
          0.32025024 = weight(abstract_txt:criteria in 4084) [ClassicSimilarity], result of:
            0.32025024 = score(doc=4084,freq=5.0), product of:
              0.3280108 = queryWeight, product of:
                4.6814656 = boost
                5.588899 = idf(docFreq=429, maxDocs=42306)
                0.012536608 = queryNorm
              0.97634053 = fieldWeight in 4084, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                5.588899 = idf(docFreq=429, maxDocs=42306)
                0.078125 = fieldNorm(doc=4084)
          0.60148615 = weight(abstract_txt:evaluation in 4084) [ClassicSimilarity], result of:
            0.60148615 = score(doc=4084,freq=8.0), product of:
              0.60578185 = queryWeight, product of:
                10.753798 = boost
                4.4933925 = idf(docFreq=1285, maxDocs=42306)
                0.012536608 = queryNorm
              0.99290884 = fieldWeight in 4084, product of:
                2.828427 = tf(freq=8.0), with freq of:
                  8.0 = termFreq=8.0
                4.4933925 = idf(docFreq=1285, maxDocs=42306)
                0.078125 = fieldNorm(doc=4084)
        0.2 = coord(5/25)
    
  4. Park, J.-r.: Semantic interoperability and metadata quality : an analysis of metadata item records of digital image collections (2006) 0.20
    0.19928871 = sum of:
      0.19928871 = product of:
        0.55357975 = sum of:
          0.020520099 = weight(abstract_txt:findings in 1298) [ClassicSimilarity], result of:
            0.020520099 = score(doc=1298,freq=2.0), product of:
              0.05448105 = queryWeight, product of:
                1.0198269 = boost
                4.261269 = idf(docFreq=1621, maxDocs=42306)
                0.012536608 = queryNorm
              0.37664652 = fieldWeight in 1298, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.261269 = idf(docFreq=1621, maxDocs=42306)
                0.0625 = fieldNorm(doc=1298)
          0.025281556 = weight(abstract_txt:associated in 1298) [ClassicSimilarity], result of:
            0.025281556 = score(doc=1298,freq=1.0), product of:
              0.078886926 = queryWeight, product of:
                1.2271743 = boost
                5.1276546 = idf(docFreq=681, maxDocs=42306)
                0.012536608 = queryNorm
              0.3204784 = fieldWeight in 1298, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.1276546 = idf(docFreq=681, maxDocs=42306)
                0.0625 = fieldNorm(doc=1298)
          0.026792191 = weight(abstract_txt:examined in 1298) [ClassicSimilarity], result of:
            0.026792191 = score(doc=1298,freq=1.0), product of:
              0.08199889 = queryWeight, product of:
                1.2511452 = boost
                5.227815 = idf(docFreq=616, maxDocs=42306)
                0.012536608 = queryNorm
              0.32673845 = fieldWeight in 1298, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.227815 = idf(docFreq=616, maxDocs=42306)
                0.0625 = fieldNorm(doc=1298)
          0.01702871 = weight(abstract_txt:between in 1298) [ClassicSimilarity], result of:
            0.01702871 = score(doc=1298,freq=2.0), product of:
              0.05507368 = queryWeight, product of:
                1.2558026 = boost
                3.498184 = idf(docFreq=3478, maxDocs=42306)
                0.012536608 = queryNorm
              0.3091987 = fieldWeight in 1298, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.498184 = idf(docFreq=3478, maxDocs=42306)
                0.0625 = fieldNorm(doc=1298)
          0.028984517 = weight(abstract_txt:analyzed in 1298) [ClassicSimilarity], result of:
            0.028984517 = score(doc=1298,freq=1.0), product of:
              0.08641316 = queryWeight, product of:
                1.2843804 = boost
                5.366686 = idf(docFreq=536, maxDocs=42306)
                0.012536608 = queryNorm
              0.33541787 = fieldWeight in 1298, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.366686 = idf(docFreq=536, maxDocs=42306)
                0.0625 = fieldNorm(doc=1298)
          0.009802736 = weight(abstract_txt:this in 1298) [ClassicSimilarity], result of:
            0.009802736 = score(doc=1298,freq=2.0), product of:
              0.045186017 = queryWeight, product of:
                1.4685061 = boost
                2.4544165 = idf(docFreq=9879, maxDocs=42306)
                0.012536608 = queryNorm
              0.21694182 = fieldWeight in 1298, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.4544165 = idf(docFreq=9879, maxDocs=42306)
                0.0625 = fieldNorm(doc=1298)
          0.039306935 = weight(abstract_txt:study in 1298) [ClassicSimilarity], result of:
            0.039306935 = score(doc=1298,freq=2.0), product of:
              0.12758353 = queryWeight, product of:
                2.9196787 = boost
                3.485616 = idf(docFreq=3522, maxDocs=42306)
                0.012536608 = queryNorm
              0.30808783 = fieldWeight in 1298, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.485616 = idf(docFreq=3522, maxDocs=42306)
                0.0625 = fieldNorm(doc=1298)
          0.21573704 = weight(abstract_txt:elements in 1298) [ClassicSimilarity], result of:
            0.21573704 = score(doc=1298,freq=5.0), product of:
              0.29249492 = queryWeight, product of:
                4.4207597 = boost
                5.2776594 = idf(docFreq=586, maxDocs=42306)
                0.012536608 = queryNorm
              0.73757535 = fieldWeight in 1298, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                5.2776594 = idf(docFreq=586, maxDocs=42306)
                0.0625 = fieldNorm(doc=1298)
          0.17012598 = weight(abstract_txt:evaluation in 1298) [ClassicSimilarity], result of:
            0.17012598 = score(doc=1298,freq=1.0), product of:
              0.60578185 = queryWeight, product of:
                10.753798 = boost
                4.4933925 = idf(docFreq=1285, maxDocs=42306)
                0.012536608 = queryNorm
              0.28083703 = fieldWeight in 1298, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.4933925 = idf(docFreq=1285, maxDocs=42306)
                0.0625 = fieldNorm(doc=1298)
        0.36 = coord(9/25)
    
  5. Hardré, P.; Mortensen, C.: Education journals : two decades of change and implications for the field (2014) 0.19
    0.19299164 = sum of:
      0.19299164 = product of:
        0.5360879 = sum of:
          0.020520099 = weight(abstract_txt:findings in 3193) [ClassicSimilarity], result of:
            0.020520099 = score(doc=3193,freq=2.0), product of:
              0.05448105 = queryWeight, product of:
                1.0198269 = boost
                4.261269 = idf(docFreq=1621, maxDocs=42306)
                0.012536608 = queryNorm
              0.37664652 = fieldWeight in 3193, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.261269 = idf(docFreq=1621, maxDocs=42306)
                0.0625 = fieldNorm(doc=3193)
          0.017110355 = weight(abstract_txt:types in 3193) [ClassicSimilarity], result of:
            0.017110355 = score(doc=3193,freq=1.0), product of:
              0.060810026 = queryWeight, product of:
                1.0774356 = boost
                4.5019827 = idf(docFreq=1274, maxDocs=42306)
                0.012536608 = queryNorm
              0.28137392 = fieldWeight in 3193, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.5019827 = idf(docFreq=1274, maxDocs=42306)
                0.0625 = fieldNorm(doc=3193)
          0.026792191 = weight(abstract_txt:examined in 3193) [ClassicSimilarity], result of:
            0.026792191 = score(doc=3193,freq=1.0), product of:
              0.08199889 = queryWeight, product of:
                1.2511452 = boost
                5.227815 = idf(docFreq=616, maxDocs=42306)
                0.012536608 = queryNorm
              0.32673845 = fieldWeight in 3193, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.227815 = idf(docFreq=616, maxDocs=42306)
                0.0625 = fieldNorm(doc=3193)
          0.028984517 = weight(abstract_txt:analyzed in 3193) [ClassicSimilarity], result of:
            0.028984517 = score(doc=3193,freq=1.0), product of:
              0.08641316 = queryWeight, product of:
                1.2843804 = boost
                5.366686 = idf(docFreq=536, maxDocs=42306)
                0.012536608 = queryNorm
              0.33541787 = fieldWeight in 3193, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.366686 = idf(docFreq=536, maxDocs=42306)
                0.0625 = fieldNorm(doc=3193)
          0.0069315815 = weight(abstract_txt:this in 3193) [ClassicSimilarity], result of:
            0.0069315815 = score(doc=3193,freq=1.0), product of:
              0.045186017 = queryWeight, product of:
                1.4685061 = boost
                2.4544165 = idf(docFreq=9879, maxDocs=42306)
                0.012536608 = queryNorm
              0.15340103 = fieldWeight in 3193, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.4544165 = idf(docFreq=9879, maxDocs=42306)
                0.0625 = fieldNorm(doc=3193)
          0.054566417 = weight(abstract_txt:time in 3193) [ClassicSimilarity], result of:
            0.054566417 = score(doc=3193,freq=4.0), product of:
              0.10457057 = queryWeight, product of:
                1.9981287 = boost
                4.1745143 = idf(docFreq=1768, maxDocs=42306)
                0.012536608 = queryNorm
              0.5218143 = fieldWeight in 3193, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.1745143 = idf(docFreq=1768, maxDocs=42306)
                0.0625 = fieldNorm(doc=3193)
          0.09648053 = weight(abstract_txt:elements in 3193) [ClassicSimilarity], result of:
            0.09648053 = score(doc=3193,freq=1.0), product of:
              0.29249492 = queryWeight, product of:
                4.4207597 = boost
                5.2776594 = idf(docFreq=586, maxDocs=42306)
                0.012536608 = queryNorm
              0.3298537 = fieldWeight in 3193, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.2776594 = idf(docFreq=586, maxDocs=42306)
                0.0625 = fieldNorm(doc=3193)
          0.114576206 = weight(abstract_txt:criteria in 3193) [ClassicSimilarity], result of:
            0.114576206 = score(doc=3193,freq=1.0), product of:
              0.3280108 = queryWeight, product of:
                4.6814656 = boost
                5.588899 = idf(docFreq=429, maxDocs=42306)
                0.012536608 = queryNorm
              0.3493062 = fieldWeight in 3193, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.588899 = idf(docFreq=429, maxDocs=42306)
                0.0625 = fieldNorm(doc=3193)
          0.17012598 = weight(abstract_txt:evaluation in 3193) [ClassicSimilarity], result of:
            0.17012598 = score(doc=3193,freq=1.0), product of:
              0.60578185 = queryWeight, product of:
                10.753798 = boost
                4.4933925 = idf(docFreq=1285, maxDocs=42306)
                0.012536608 = queryNorm
              0.28083703 = fieldWeight in 3193, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.4933925 = idf(docFreq=1285, maxDocs=42306)
                0.0625 = fieldNorm(doc=3193)
        0.36 = coord(9/25)