Document (#16505)

Author

Drabenstott, K.M.
Weller, M.S.

Title

¬A comparative approach to system evaluation : delegating control of retrieval tests to an experimental online system

Source

Global complexity: information, chaos and control. Proceedings of the 59th Annual Meeting of the American Society for Information Science, ASIS'96, Baltimore, Maryland, 21-24 Oct 1996. Ed.: S. Hardin

Imprint

Medford, NJ : Learned Information

Year

1996

Pages

S.34-40

Abstract

Describes the comparative approach to system evaluation used in this research project which delegated the administartion of an online retrieval test to an experimental online catalogue to produce data for evaluating the effectiveness of a new subject access design. Describes the methods enlisted to sort out problem test administration, e.g. to identify out-of-scope queries, incomplete system administration, and suspect post-search questionnaire responses. Covers how w the researchers handled problem search administrations and what actions they would use to reduce or eliminate the occurrence of such administrations in future online retrieval tests that delegate control of retrieval tests to online systems

Theme

Retrievalstudien

Similar documents (author)

1. Drabenstott, K.M.; Weller, M.S.: Testing a new design for subject searching in online catalogs (1994) 5.91

   5.911137 = sum of:
     5.911137 = sum of:
       2.7868462 = weight(author_txt:drabenstott in 7716) [ClassicSimilarity], result of:
         2.7868462 = score(doc=7716,freq=1.0), product of:
           0.67968714 = queryWeight, product of:
             8.200379 = idf(docFreq=32, maxDocs=44218)
             0.08288484 = queryNorm
           4.1001897 = fieldWeight in 7716, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.200379 = idf(docFreq=32, maxDocs=44218)
             0.5 = fieldNorm(doc=7716)
       3.124291 = weight(author_txt:weller in 7716) [ClassicSimilarity], result of:
         3.124291 = score(doc=7716,freq=1.0), product of:
           0.7335021 = queryWeight, product of:
             1.038834 = boost
             8.518833 = idf(docFreq=23, maxDocs=44218)
             0.08288484 = queryNorm
           4.2594166 = fieldWeight in 7716, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.518833 = idf(docFreq=23, maxDocs=44218)
             0.5 = fieldNorm(doc=7716)
   

2. Drabenstott, K.M.; Weller, M.S.: Failure analysis of subject searches in a test of a new design for subject access to online catalogs (1996) 5.91

   5.911137 = sum of:
     5.911137 = sum of:
       2.7868462 = weight(author_txt:drabenstott in 4382) [ClassicSimilarity], result of:
         2.7868462 = score(doc=4382,freq=1.0), product of:
           0.67968714 = queryWeight, product of:
             8.200379 = idf(docFreq=32, maxDocs=44218)
             0.08288484 = queryNorm
           4.1001897 = fieldWeight in 4382, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.200379 = idf(docFreq=32, maxDocs=44218)
             0.5 = fieldNorm(doc=4382)
       3.124291 = weight(author_txt:weller in 4382) [ClassicSimilarity], result of:
         3.124291 = score(doc=4382,freq=1.0), product of:
           0.7335021 = queryWeight, product of:
             1.038834 = boost
             8.518833 = idf(docFreq=23, maxDocs=44218)
             0.08288484 = queryNorm
           4.2594166 = fieldWeight in 4382, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.518833 = idf(docFreq=23, maxDocs=44218)
             0.5 = fieldNorm(doc=4382)
   

3. Drabenstott, K.M.; Weller, M.S.: Improving personal-name searching in online catalogs (1996) 5.91

   5.911137 = sum of:
     5.911137 = sum of:
       2.7868462 = weight(author_txt:drabenstott in 6742) [ClassicSimilarity], result of:
         2.7868462 = score(doc=6742,freq=1.0), product of:
           0.67968714 = queryWeight, product of:
             8.200379 = idf(docFreq=32, maxDocs=44218)
             0.08288484 = queryNorm
           4.1001897 = fieldWeight in 6742, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.200379 = idf(docFreq=32, maxDocs=44218)
             0.5 = fieldNorm(doc=6742)
       3.124291 = weight(author_txt:weller in 6742) [ClassicSimilarity], result of:
         3.124291 = score(doc=6742,freq=1.0), product of:
           0.7335021 = queryWeight, product of:
             1.038834 = boost
             8.518833 = idf(docFreq=23, maxDocs=44218)
             0.08288484 = queryNorm
           4.2594166 = fieldWeight in 6742, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.518833 = idf(docFreq=23, maxDocs=44218)
             0.5 = fieldNorm(doc=6742)
   

4. Drabenstott, K.M.; Weller, M.S.: ¬The exact-display approach for online catalog subject searching (1996) 5.91

   5.911137 = sum of:
     5.911137 = sum of:
       2.7868462 = weight(author_txt:drabenstott in 6930) [ClassicSimilarity], result of:
         2.7868462 = score(doc=6930,freq=1.0), product of:
           0.67968714 = queryWeight, product of:
             8.200379 = idf(docFreq=32, maxDocs=44218)
             0.08288484 = queryNorm
           4.1001897 = fieldWeight in 6930, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.200379 = idf(docFreq=32, maxDocs=44218)
             0.5 = fieldNorm(doc=6930)
       3.124291 = weight(author_txt:weller in 6930) [ClassicSimilarity], result of:
         3.124291 = score(doc=6930,freq=1.0), product of:
           0.7335021 = queryWeight, product of:
             1.038834 = boost
             8.518833 = idf(docFreq=23, maxDocs=44218)
             0.08288484 = queryNorm
           4.2594166 = fieldWeight in 6930, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.518833 = idf(docFreq=23, maxDocs=44218)
             0.5 = fieldNorm(doc=6930)
   

5. Drabenstott, K.M.; Weller, M.S.: Testing a new design for subject access to online catalogs (1995) 5.91

   5.911137 = sum of:
     5.911137 = sum of:
       2.7868462 = weight(author_txt:drabenstott in 385) [ClassicSimilarity], result of:
         2.7868462 = score(doc=385,freq=1.0), product of:
           0.67968714 = queryWeight, product of:
             8.200379 = idf(docFreq=32, maxDocs=44218)
             0.08288484 = queryNorm
           4.1001897 = fieldWeight in 385, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.200379 = idf(docFreq=32, maxDocs=44218)
             0.5 = fieldNorm(doc=385)
       3.124291 = weight(author_txt:weller in 385) [ClassicSimilarity], result of:
         3.124291 = score(doc=385,freq=1.0), product of:
           0.7335021 = queryWeight, product of:
             1.038834 = boost
             8.518833 = idf(docFreq=23, maxDocs=44218)
             0.08288484 = queryNorm
           4.2594166 = fieldWeight in 385, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             8.518833 = idf(docFreq=23, maxDocs=44218)
             0.5 = fieldNorm(doc=385)
   

Similar documents (content)

1. Fieldhouse, M.; Hancock-Beaulieu, M.: ¬The changing face of OKAPI (1994) 0.22

   0.21683884 = sum of:
     0.21683884 = product of:
       0.67762136 = sum of:
         0.030106967 = weight(abstract_txt:describes in 1493) [ClassicSimilarity], result of:
           0.030106967 = score(doc=1493,freq=1.0), product of:
             0.10077511 = queryWeight, product of:
               1.2392746 = boost
               3.8240511 = idf(docFreq=2624, maxDocs=44218)
               0.021264836 = queryNorm
             0.298754 = fieldWeight in 1493, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.8240511 = idf(docFreq=2624, maxDocs=44218)
               0.078125 = fieldNorm(doc=1493)
         0.06873987 = weight(abstract_txt:evaluation in 1493) [ClassicSimilarity], result of:
           0.06873987 = score(doc=1493,freq=2.0), product of:
             0.13868764 = queryWeight, product of:
               1.4538172 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.021264836 = queryNorm
             0.49564525 = fieldWeight in 1493, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.078125 = fieldNorm(doc=1493)
         0.08467975 = weight(abstract_txt:experimental in 1493) [ClassicSimilarity], result of:
           0.08467975 = score(doc=1493,freq=1.0), product of:
             0.20079906 = queryWeight, product of:
               1.74933 = boost
               5.397938 = idf(docFreq=543, maxDocs=44218)
               0.021264836 = queryNorm
             0.4217139 = fieldWeight in 1493, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.397938 = idf(docFreq=543, maxDocs=44218)
               0.078125 = fieldNorm(doc=1493)
         0.14137252 = weight(abstract_txt:comparative in 1493) [ClassicSimilarity], result of:
           0.14137252 = score(doc=1493,freq=1.0), product of:
             0.28258684 = queryWeight, product of:
               2.0752332 = boost
               6.4035826 = idf(docFreq=198, maxDocs=44218)
               0.021264836 = queryNorm
             0.5002799 = fieldWeight in 1493, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.4035826 = idf(docFreq=198, maxDocs=44218)
               0.078125 = fieldNorm(doc=1493)
         0.041295983 = weight(abstract_txt:system in 1493) [ClassicSimilarity], result of:
           0.041295983 = score(doc=1493,freq=1.0), product of:
             0.15674384 = queryWeight, product of:
               2.1857533 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.021264836 = queryNorm
             0.2634616 = fieldWeight in 1493, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.078125 = fieldNorm(doc=1493)
         0.063908346 = weight(abstract_txt:retrieval in 1493) [ClassicSimilarity], result of:
           0.063908346 = score(doc=1493,freq=2.0), product of:
             0.16644868 = queryWeight, product of:
               2.252403 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.021264836 = queryNorm
             0.38395226 = fieldWeight in 1493, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.078125 = fieldNorm(doc=1493)
         0.18119441 = weight(abstract_txt:tests in 1493) [ClassicSimilarity], result of:
           0.18119441 = score(doc=1493,freq=1.0), product of:
             0.3816825 = queryWeight, product of:
               2.9538448 = boost
               6.0764866 = idf(docFreq=275, maxDocs=44218)
               0.021264836 = queryNorm
             0.4747255 = fieldWeight in 1493, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0764866 = idf(docFreq=275, maxDocs=44218)
               0.078125 = fieldNorm(doc=1493)
         0.066323504 = weight(abstract_txt:online in 1493) [ClassicSimilarity], result of:
           0.066323504 = score(doc=1493,freq=1.0), product of:
             0.23156181 = queryWeight, product of:
               2.9702594 = boost
               3.6661522 = idf(docFreq=3073, maxDocs=44218)
               0.021264836 = queryNorm
             0.28641814 = fieldWeight in 1493, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6661522 = idf(docFreq=3073, maxDocs=44218)
               0.078125 = fieldNorm(doc=1493)
       0.32 = coord(8/25)
   

2. Larson, R.R.: Evaluation of advanced retrieval techniques in an experimental online catalog (1992) 0.18

   0.17826772 = sum of:
     0.17826772 = product of:
       0.6366704 = sum of:
         0.04564638 = weight(abstract_txt:search in 481) [ClassicSimilarity], result of:
           0.04564638 = score(doc=481,freq=3.0), product of:
             0.09221589 = queryWeight, product of:
               1.1854788 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.021264836 = queryNorm
             0.49499476 = fieldWeight in 481, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.078125 = fieldNorm(doc=481)
         0.030106967 = weight(abstract_txt:describes in 481) [ClassicSimilarity], result of:
           0.030106967 = score(doc=481,freq=1.0), product of:
             0.10077511 = queryWeight, product of:
               1.2392746 = boost
               3.8240511 = idf(docFreq=2624, maxDocs=44218)
               0.021264836 = queryNorm
             0.298754 = fieldWeight in 481, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.8240511 = idf(docFreq=2624, maxDocs=44218)
               0.078125 = fieldNorm(doc=481)
         0.08467975 = weight(abstract_txt:experimental in 481) [ClassicSimilarity], result of:
           0.08467975 = score(doc=481,freq=1.0), product of:
             0.20079906 = queryWeight, product of:
               1.74933 = boost
               5.397938 = idf(docFreq=543, maxDocs=44218)
               0.021264836 = queryNorm
             0.4217139 = fieldWeight in 481, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.397938 = idf(docFreq=543, maxDocs=44218)
               0.078125 = fieldNorm(doc=481)
         0.041295983 = weight(abstract_txt:system in 481) [ClassicSimilarity], result of:
           0.041295983 = score(doc=481,freq=1.0), product of:
             0.15674384 = queryWeight, product of:
               2.1857533 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.021264836 = queryNorm
             0.2634616 = fieldWeight in 481, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.078125 = fieldNorm(doc=481)
         0.078271426 = weight(abstract_txt:retrieval in 481) [ClassicSimilarity], result of:
           0.078271426 = score(doc=481,freq=3.0), product of:
             0.16644868 = queryWeight, product of:
               2.252403 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.021264836 = queryNorm
             0.47024357 = fieldWeight in 481, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.078125 = fieldNorm(doc=481)
         0.18119441 = weight(abstract_txt:tests in 481) [ClassicSimilarity], result of:
           0.18119441 = score(doc=481,freq=1.0), product of:
             0.3816825 = queryWeight, product of:
               2.9538448 = boost
               6.0764866 = idf(docFreq=275, maxDocs=44218)
               0.021264836 = queryNorm
             0.4747255 = fieldWeight in 481, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0764866 = idf(docFreq=275, maxDocs=44218)
               0.078125 = fieldNorm(doc=481)
         0.1754755 = weight(abstract_txt:online in 481) [ClassicSimilarity], result of:
           0.1754755 = score(doc=481,freq=7.0), product of:
             0.23156181 = queryWeight, product of:
               2.9702594 = boost
               3.6661522 = idf(docFreq=3073, maxDocs=44218)
               0.021264836 = queryNorm
             0.75779116 = fieldWeight in 481, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               3.6661522 = idf(docFreq=3073, maxDocs=44218)
               0.078125 = fieldNorm(doc=481)
       0.28 = coord(7/25)
   

3. Jacucci, G.; Barral, O.; Daee, P.; Wenzel, M.; Serim, B.; Ruotsalo, T.; Pluchino, P.; Freeman, J.; Gamberini, L.; Kaski, S.; Blankertz, B.: Integrating neurophysiologic relevance feedback in intent modeling for information retrieval (2019) 0.17

   0.17335168 = sum of:
     0.17335168 = product of:
       0.4815324 = sum of:
         0.058947876 = weight(abstract_txt:responses in 5356) [ClassicSimilarity], result of:
           0.058947876 = score(doc=5356,freq=1.0), product of:
             0.14526157 = queryWeight, product of:
               1.0520861 = boost
               6.4928803 = idf(docFreq=181, maxDocs=44218)
               0.021264836 = queryNorm
             0.40580502 = fieldWeight in 5356, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.4928803 = idf(docFreq=181, maxDocs=44218)
               0.0625 = fieldNorm(doc=5356)
         0.029816091 = weight(abstract_txt:search in 5356) [ClassicSimilarity], result of:
           0.029816091 = score(doc=5356,freq=2.0), product of:
             0.09221589 = queryWeight, product of:
               1.1854788 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.021264836 = queryNorm
             0.3233292 = fieldWeight in 5356, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0625 = fieldNorm(doc=5356)
         0.022628484 = weight(abstract_txt:approach in 5356) [ClassicSimilarity], result of:
           0.022628484 = score(doc=5356,freq=1.0), product of:
             0.09666864 = queryWeight, product of:
               1.2137625 = boost
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.021264836 = queryNorm
             0.234083 = fieldWeight in 5356, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.0625 = fieldNorm(doc=5356)
         0.09282056 = weight(abstract_txt:incomplete in 5356) [ClassicSimilarity], result of:
           0.09282056 = score(doc=5356,freq=1.0), product of:
             0.19660811 = queryWeight, product of:
               1.2239865 = boost
               7.5537524 = idf(docFreq=62, maxDocs=44218)
               0.021264836 = queryNorm
             0.47210953 = fieldWeight in 5356, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.5537524 = idf(docFreq=62, maxDocs=44218)
               0.0625 = fieldNorm(doc=5356)
         0.038885143 = weight(abstract_txt:evaluation in 5356) [ClassicSimilarity], result of:
           0.038885143 = score(doc=5356,freq=1.0), product of:
             0.13868764 = queryWeight, product of:
               1.4538172 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.021264836 = queryNorm
             0.2803793 = fieldWeight in 5356, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=5356)
         0.0677438 = weight(abstract_txt:experimental in 5356) [ClassicSimilarity], result of:
           0.0677438 = score(doc=5356,freq=1.0), product of:
             0.20079906 = queryWeight, product of:
               1.74933 = boost
               5.397938 = idf(docFreq=543, maxDocs=44218)
               0.021264836 = queryNorm
             0.3373711 = fieldWeight in 5356, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.397938 = idf(docFreq=543, maxDocs=44218)
               0.0625 = fieldNorm(doc=5356)
         0.033036787 = weight(abstract_txt:system in 5356) [ClassicSimilarity], result of:
           0.033036787 = score(doc=5356,freq=1.0), product of:
             0.15674384 = queryWeight, product of:
               2.1857533 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.021264836 = queryNorm
             0.21076928 = fieldWeight in 5356, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.0625 = fieldNorm(doc=5356)
         0.06261714 = weight(abstract_txt:retrieval in 5356) [ClassicSimilarity], result of:
           0.06261714 = score(doc=5356,freq=3.0), product of:
             0.16644868 = queryWeight, product of:
               2.252403 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.021264836 = queryNorm
             0.37619486 = fieldWeight in 5356, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=5356)
         0.07503647 = weight(abstract_txt:online in 5356) [ClassicSimilarity], result of:
           0.07503647 = score(doc=5356,freq=2.0), product of:
             0.23156181 = queryWeight, product of:
               2.9702594 = boost
               3.6661522 = idf(docFreq=3073, maxDocs=44218)
               0.021264836 = queryNorm
             0.32404512 = fieldWeight in 5356, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6661522 = idf(docFreq=3073, maxDocs=44218)
               0.0625 = fieldNorm(doc=5356)
       0.36 = coord(9/25)
   

4. Behnert, C.; Lewandowski, D.: ¬A framework for designing retrieval effectiveness studies of library information systems using human relevance assessments (2017) 0.17

   0.17197786 = sum of:
     0.17197786 = product of:
       0.5374308 = sum of:
         0.04216632 = weight(abstract_txt:search in 3700) [ClassicSimilarity], result of:
           0.04216632 = score(doc=3700,freq=4.0), product of:
             0.09221589 = queryWeight, product of:
               1.1854788 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.021264836 = queryNorm
             0.45725656 = fieldWeight in 3700, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.022628484 = weight(abstract_txt:approach in 3700) [ClassicSimilarity], result of:
           0.022628484 = score(doc=3700,freq=1.0), product of:
             0.09666864 = queryWeight, product of:
               1.2137625 = boost
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.021264836 = queryNorm
             0.234083 = fieldWeight in 3700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.077770285 = weight(abstract_txt:evaluation in 3700) [ClassicSimilarity], result of:
           0.077770285 = score(doc=3700,freq=4.0), product of:
             0.13868764 = queryWeight, product of:
               1.4538172 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.021264836 = queryNorm
             0.5607586 = fieldWeight in 3700, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.05535854 = weight(abstract_txt:test in 3700) [ClassicSimilarity], result of:
           0.05535854 = score(doc=3700,freq=1.0), product of:
             0.17551129 = queryWeight, product of:
               1.6354733 = boost
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.021264836 = queryNorm
             0.315413 = fieldWeight in 3700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.033036787 = weight(abstract_txt:system in 3700) [ClassicSimilarity], result of:
           0.033036787 = score(doc=3700,freq=1.0), product of:
             0.15674384 = queryWeight, product of:
               2.1857533 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.021264836 = queryNorm
             0.21076928 = fieldWeight in 3700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.10845607 = weight(abstract_txt:retrieval in 3700) [ClassicSimilarity], result of:
           0.10845607 = score(doc=3700,freq=9.0), product of:
             0.16644868 = queryWeight, product of:
               2.252403 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.021264836 = queryNorm
             0.6515886 = fieldWeight in 3700, product of:
               3.0 = tf(freq=9.0), with freq of:
                 9.0 = termFreq=9.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.14495553 = weight(abstract_txt:tests in 3700) [ClassicSimilarity], result of:
           0.14495553 = score(doc=3700,freq=1.0), product of:
             0.3816825 = queryWeight, product of:
               2.9538448 = boost
               6.0764866 = idf(docFreq=275, maxDocs=44218)
               0.021264836 = queryNorm
             0.3797804 = fieldWeight in 3700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.0764866 = idf(docFreq=275, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.053058803 = weight(abstract_txt:online in 3700) [ClassicSimilarity], result of:
           0.053058803 = score(doc=3700,freq=1.0), product of:
             0.23156181 = queryWeight, product of:
               2.9702594 = boost
               3.6661522 = idf(docFreq=3073, maxDocs=44218)
               0.021264836 = queryNorm
             0.22913451 = fieldWeight in 3700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6661522 = idf(docFreq=3073, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
       0.32 = coord(8/25)
   

5. Parapar, J.; Losada, D.E.; Presedo-Quindimil, M.A.; Barreiro, A.: Using score distributions to compare statistical significance tests for information retrieval evaluation (2020) 0.17

   0.16685888 = sum of:
     0.16685888 = product of:
       0.6952454 = sum of:
         0.036517102 = weight(abstract_txt:search in 5506) [ClassicSimilarity], result of:
           0.036517102 = score(doc=5506,freq=3.0), product of:
             0.09221589 = queryWeight, product of:
               1.1854788 = boost
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.021264836 = queryNorm
             0.3959958 = fieldWeight in 5506, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.6580524 = idf(docFreq=3098, maxDocs=44218)
               0.0625 = fieldNorm(doc=5506)
         0.022628484 = weight(abstract_txt:approach in 5506) [ClassicSimilarity], result of:
           0.022628484 = score(doc=5506,freq=1.0), product of:
             0.09666864 = queryWeight, product of:
               1.2137625 = boost
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.021264836 = queryNorm
             0.234083 = fieldWeight in 5506, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.0625 = fieldNorm(doc=5506)
         0.054991897 = weight(abstract_txt:evaluation in 5506) [ClassicSimilarity], result of:
           0.054991897 = score(doc=5506,freq=2.0), product of:
             0.13868764 = queryWeight, product of:
               1.4538172 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.021264836 = queryNorm
             0.3965162 = fieldWeight in 5506, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=5506)
         0.14646493 = weight(abstract_txt:test in 5506) [ClassicSimilarity], result of:
           0.14646493 = score(doc=5506,freq=7.0), product of:
             0.17551129 = queryWeight, product of:
               1.6354733 = boost
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.021264836 = queryNorm
             0.8345043 = fieldWeight in 5506, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.0625 = fieldNorm(doc=5506)
         0.051126678 = weight(abstract_txt:retrieval in 5506) [ClassicSimilarity], result of:
           0.051126678 = score(doc=5506,freq=2.0), product of:
             0.16644868 = queryWeight, product of:
               2.252403 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.021264836 = queryNorm
             0.3071618 = fieldWeight in 5506, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=5506)
         0.38351628 = weight(abstract_txt:tests in 5506) [ClassicSimilarity], result of:
           0.38351628 = score(doc=5506,freq=7.0), product of:
             0.3816825 = queryWeight, product of:
               2.9538448 = boost
               6.0764866 = idf(docFreq=275, maxDocs=44218)
               0.021264836 = queryNorm
             1.0048045 = fieldWeight in 5506, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               6.0764866 = idf(docFreq=275, maxDocs=44218)
               0.0625 = fieldNorm(doc=5506)
       0.24 = coord(6/25)