Document (#42100)

Author

White, H.D.

Title

Relevance theory and distributions of judgments in document retrieval

Source

Information processing and management. 53(2017) no.5, S.1080-1102

Year

2017

Abstract

This article extends relevance theory (RT) from linguistic pragmatics into information retrieval. Using more than 50 retrieval experiments from the literature as examples, it applies RT to explain the frequency distributions of documents on relevance scales with three or more points. The scale points, which judges in experiments must consider in addition to queries and documents, are communications from researchers. In RT, the relevance of a communication varies directly with its cognitive effects and inversely with the effort of processing it. Researchers define and/or label the scale points to measure the cognitive effects of documents on judges. However, they apparently assume that all scale points as presented are equally easy for judges to process. Yet the notion that points cost variable effort explains fairly well the frequency distributions of judgments across them. By hypothesis, points that cost more effort are chosen by judges less frequently. Effort varies with the vagueness or strictness of scale-point labels and definitions. It is shown that vague scales tend to produce U- or V-shaped distributions, while strict scales tend to produce right-skewed distributions. These results reinforce the paper's more general argument that RT clarifies the concept of relevance in the dialogues of retrieval evaluation.

Content

Vgl.: https://doi.org/10.1016/j.ipm.2017.02.010.

Theme

Retrievalstudien

Similar documents (author)

1. White, H.S.: OCR software : an introduction (1991) 4.56

   4.556355 = sum of:
     4.556355 = weight(author_txt:white in 3760) [ClassicSimilarity], result of:
       4.556355 = fieldWeight in 3760, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.290168 = idf(docFreq=81, maxDocs=44218)
         0.625 = fieldNorm(doc=3760)
   

2. White, S.: Compton's affiliate's program : a new type of publisher/developer partnership emerges (1993) 4.56

   4.556355 = sum of:
     4.556355 = weight(author_txt:white in 4634) [ClassicSimilarity], result of:
       4.556355 = fieldWeight in 4634, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.290168 = idf(docFreq=81, maxDocs=44218)
         0.625 = fieldNorm(doc=4634)
   

3. White, A.: Electronic copying of a cuttings library : a case of fari dealing? (1993) 4.56

   4.556355 = sum of:
     4.556355 = weight(author_txt:white in 6638) [ClassicSimilarity], result of:
       4.556355 = fieldWeight in 6638, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.290168 = idf(docFreq=81, maxDocs=44218)
         0.625 = fieldNorm(doc=6638)
   

4. White, F.: EndNote Plus: a bibliography maker for the researcher (1993) 4.56

   4.556355 = sum of:
     4.556355 = weight(author_txt:white in 6949) [ClassicSimilarity], result of:
       4.556355 = fieldWeight in 6949, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.290168 = idf(docFreq=81, maxDocs=44218)
         0.625 = fieldNorm(doc=6949)
   

5. White, A.: Copyright law, information services and the challenge of multimedia (1993) 4.56

   4.556355 = sum of:
     4.556355 = weight(author_txt:white in 7115) [ClassicSimilarity], result of:
       4.556355 = fieldWeight in 7115, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         7.290168 = idf(docFreq=81, maxDocs=44218)
         0.625 = fieldNorm(doc=7115)
   

Similar documents (content)

1. Tang, R.; Shaw, W.M.; Vevea, J.L.: Towards the identification of the optimal number of relevance categories (1999) 0.45

   0.4530158 = sum of:
     0.4530158 = product of:
       1.2583772 = sum of:
         0.012136491 = weight(abstract_txt:with in 3060) [ClassicSimilarity], result of:
           0.012136491 = score(doc=3060,freq=3.0), product of:
             0.044849623 = queryWeight, product of:
               1.1354018 = boost
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.015802125 = queryNorm
             0.27060407 = fieldWeight in 3060, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.0625 = fieldNorm(doc=3060)
         0.038669772 = weight(abstract_txt:effects in 3060) [ClassicSimilarity], result of:
           0.038669772 = score(doc=3060,freq=1.0), product of:
             0.11116674 = queryWeight, product of:
               1.2639871 = boost
               5.565661 = idf(docFreq=459, maxDocs=44218)
               0.015802125 = queryNorm
             0.3478538 = fieldWeight in 3060, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.565661 = idf(docFreq=459, maxDocs=44218)
               0.0625 = fieldNorm(doc=3060)
         0.01973635 = weight(abstract_txt:that in 3060) [ClassicSimilarity], result of:
           0.01973635 = score(doc=3060,freq=7.0), product of:
             0.05037159 = queryWeight, product of:
               1.3452966 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.015802125 = queryNorm
             0.3918151 = fieldWeight in 3060, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0625 = fieldNorm(doc=3060)
         0.017663958 = weight(abstract_txt:more in 3060) [ClassicSimilarity], result of:
           0.017663958 = score(doc=3060,freq=1.0), product of:
             0.08307349 = queryWeight, product of:
               1.5452595 = boost
               3.402088 = idf(docFreq=4002, maxDocs=44218)
               0.015802125 = queryNorm
             0.2126305 = fieldWeight in 3060, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.402088 = idf(docFreq=4002, maxDocs=44218)
               0.0625 = fieldNorm(doc=3060)
         0.16473934 = weight(abstract_txt:scale in 3060) [ClassicSimilarity], result of:
           0.16473934 = score(doc=3060,freq=5.0), product of:
             0.21525106 = queryWeight, product of:
               2.487384 = boost
               5.476297 = idf(docFreq=502, maxDocs=44218)
               0.015802125 = queryNorm
             0.7653358 = fieldWeight in 3060, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.476297 = idf(docFreq=502, maxDocs=44218)
               0.0625 = fieldNorm(doc=3060)
         0.33052996 = weight(abstract_txt:scales in 3060) [ClassicSimilarity], result of:
           0.33052996 = score(doc=3060,freq=4.0), product of:
             0.33512855 = queryWeight, product of:
               2.6878593 = boost
               7.890225 = idf(docFreq=44, maxDocs=44218)
               0.015802125 = queryNorm
             0.9862781 = fieldWeight in 3060, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               7.890225 = idf(docFreq=44, maxDocs=44218)
               0.0625 = fieldNorm(doc=3060)
         0.17796698 = weight(abstract_txt:relevance in 3060) [ClassicSimilarity], result of:
           0.17796698 = score(doc=3060,freq=7.0), product of:
             0.21822311 = queryWeight, product of:
               2.8001132 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.015802125 = queryNorm
             0.8155277 = fieldWeight in 3060, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=3060)
         0.23716336 = weight(abstract_txt:judges in 3060) [ClassicSimilarity], result of:
           0.23716336 = score(doc=3060,freq=1.0), product of:
             0.46928376 = queryWeight, product of:
               3.6727211 = boost
               8.085969 = idf(docFreq=36, maxDocs=44218)
               0.015802125 = queryNorm
             0.50537306 = fieldWeight in 3060, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.085969 = idf(docFreq=36, maxDocs=44218)
               0.0625 = fieldNorm(doc=3060)
         0.25977102 = weight(abstract_txt:points in 3060) [ClassicSimilarity], result of:
           0.25977102 = score(doc=3060,freq=6.0), product of:
             0.31413108 = queryWeight, product of:
               3.680199 = boost
               5.4016213 = idf(docFreq=541, maxDocs=44218)
               0.015802125 = queryNorm
             0.826951 = fieldWeight in 3060, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.4016213 = idf(docFreq=541, maxDocs=44218)
               0.0625 = fieldNorm(doc=3060)
       0.36 = coord(9/25)
   

2. White, H.D.: Relevance in theory (2009) 0.33

   0.32652184 = sum of:
     0.32652184 = product of:
       0.68025386 = sum of:
         0.05857253 = weight(abstract_txt:pragmatics in 3872) [ClassicSimilarity], result of:
           0.05857253 = score(doc=3872,freq=1.0), product of:
             0.14097397 = queryWeight, product of:
               1.0064905 = boost
               8.863674 = idf(docFreq=16, maxDocs=44218)
               0.015802125 = queryNorm
             0.41548473 = fieldWeight in 3872, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.863674 = idf(docFreq=16, maxDocs=44218)
               0.046875 = fieldNorm(doc=3872)
         0.015700506 = weight(abstract_txt:theory in 3872) [ClassicSimilarity], result of:
           0.015700506 = score(doc=3872,freq=1.0), product of:
             0.073840626 = queryWeight, product of:
               1.0301558 = boost
               4.5360413 = idf(docFreq=1287, maxDocs=44218)
               0.015802125 = queryNorm
             0.21262693 = fieldWeight in 3872, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5360413 = idf(docFreq=1287, maxDocs=44218)
               0.046875 = fieldNorm(doc=3872)
         0.009102368 = weight(abstract_txt:with in 3872) [ClassicSimilarity], result of:
           0.009102368 = score(doc=3872,freq=3.0), product of:
             0.044849623 = queryWeight, product of:
               1.1354018 = boost
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.015802125 = queryNorm
             0.20295306 = fieldWeight in 3872, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.046875 = fieldNorm(doc=3872)
         0.034668453 = weight(abstract_txt:cognitive in 3872) [ClassicSimilarity], result of:
           0.034668453 = score(doc=3872,freq=2.0), product of:
             0.09938006 = queryWeight, product of:
               1.1951016 = boost
               5.2623405 = idf(docFreq=622, maxDocs=44218)
               0.015802125 = queryNorm
             0.34884718 = fieldWeight in 3872, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.2623405 = idf(docFreq=622, maxDocs=44218)
               0.046875 = fieldNorm(doc=3872)
         0.04101549 = weight(abstract_txt:effects in 3872) [ClassicSimilarity], result of:
           0.04101549 = score(doc=3872,freq=2.0), product of:
             0.11116674 = queryWeight, product of:
               1.2639871 = boost
               5.565661 = idf(docFreq=459, maxDocs=44218)
               0.015802125 = queryNorm
             0.3689547 = fieldWeight in 3872, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.565661 = idf(docFreq=459, maxDocs=44218)
               0.046875 = fieldNorm(doc=3872)
         0.011189459 = weight(abstract_txt:that in 3872) [ClassicSimilarity], result of:
           0.011189459 = score(doc=3872,freq=4.0), product of:
             0.05037159 = queryWeight, product of:
               1.3452966 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.015802125 = queryNorm
             0.22213829 = fieldWeight in 3872, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.046875 = fieldNorm(doc=3872)
         0.03532705 = weight(abstract_txt:documents in 3872) [ClassicSimilarity], result of:
           0.03532705 = score(doc=3872,freq=4.0), product of:
             0.09143271 = queryWeight, product of:
               1.40395 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.015802125 = queryNorm
             0.38637212 = fieldWeight in 3872, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.046875 = fieldNorm(doc=3872)
         0.018735455 = weight(abstract_txt:more in 3872) [ClassicSimilarity], result of:
           0.018735455 = score(doc=3872,freq=2.0), product of:
             0.08307349 = queryWeight, product of:
               1.5452595 = boost
               3.402088 = idf(docFreq=4002, maxDocs=44218)
               0.015802125 = queryNorm
             0.22552869 = fieldWeight in 3872, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.402088 = idf(docFreq=4002, maxDocs=44218)
               0.046875 = fieldNorm(doc=3872)
         0.014119823 = weight(abstract_txt:retrieval in 3872) [ClassicSimilarity], result of:
           0.014119823 = score(doc=3872,freq=1.0), product of:
             0.08667938 = queryWeight, product of:
               1.5784401 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.015802125 = queryNorm
             0.16289715 = fieldWeight in 3872, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.046875 = fieldNorm(doc=3872)
         0.08919007 = weight(abstract_txt:effort in 3872) [ClassicSimilarity], result of:
           0.08919007 = score(doc=3872,freq=2.0), product of:
             0.2350881 = queryWeight, product of:
               2.5994742 = boost
               5.723078 = idf(docFreq=392, maxDocs=44218)
               0.015802125 = queryNorm
             0.37939 = fieldWeight in 3872, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.723078 = idf(docFreq=392, maxDocs=44218)
               0.046875 = fieldNorm(doc=3872)
         0.17476012 = weight(abstract_txt:relevance in 3872) [ClassicSimilarity], result of:
           0.17476012 = score(doc=3872,freq=12.0), product of:
             0.21822311 = queryWeight, product of:
               2.8001132 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.015802125 = queryNorm
             0.80083233 = fieldWeight in 3872, product of:
               3.4641016 = tf(freq=12.0), with freq of:
                 12.0 = termFreq=12.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.046875 = fieldNorm(doc=3872)
         0.17787254 = weight(abstract_txt:judges in 3872) [ClassicSimilarity], result of:
           0.17787254 = score(doc=3872,freq=1.0), product of:
             0.46928376 = queryWeight, product of:
               3.6727211 = boost
               8.085969 = idf(docFreq=36, maxDocs=44218)
               0.015802125 = queryNorm
             0.3790298 = fieldWeight in 3872, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.085969 = idf(docFreq=36, maxDocs=44218)
               0.046875 = fieldNorm(doc=3872)
       0.48 = coord(12/25)
   

3. White, H.D.: Combining bibliometrics, information retrieval, and relevance theory : part 2: some implications for information science (2007) 0.31

   0.31490576 = sum of:
     0.31490576 = product of:
       0.65605366 = sum of:
         0.018317256 = weight(abstract_txt:theory in 437) [ClassicSimilarity], result of:
           0.018317256 = score(doc=437,freq=1.0), product of:
             0.073840626 = queryWeight, product of:
               1.0301558 = boost
               4.5360413 = idf(docFreq=1287, maxDocs=44218)
               0.015802125 = queryNorm
             0.24806476 = fieldWeight in 437, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5360413 = idf(docFreq=1287, maxDocs=44218)
               0.0546875 = fieldNorm(doc=437)
         0.0061311307 = weight(abstract_txt:with in 437) [ClassicSimilarity], result of:
           0.0061311307 = score(doc=437,freq=1.0), product of:
             0.044849623 = queryWeight, product of:
               1.1354018 = boost
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.015802125 = queryNorm
             0.13670418 = fieldWeight in 437, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.0546875 = fieldNorm(doc=437)
         0.057200033 = weight(abstract_txt:cognitive in 437) [ClassicSimilarity], result of:
           0.057200033 = score(doc=437,freq=4.0), product of:
             0.09938006 = queryWeight, product of:
               1.1951016 = boost
               5.2623405 = idf(docFreq=622, maxDocs=44218)
               0.015802125 = queryNorm
             0.5755685 = fieldWeight in 437, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               5.2623405 = idf(docFreq=622, maxDocs=44218)
               0.0546875 = fieldNorm(doc=437)
         0.07565971 = weight(abstract_txt:effects in 437) [ClassicSimilarity], result of:
           0.07565971 = score(doc=437,freq=5.0), product of:
             0.11116674 = queryWeight, product of:
               1.2639871 = boost
               5.565661 = idf(docFreq=459, maxDocs=44218)
               0.015802125 = queryNorm
             0.68059665 = fieldWeight in 437, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               5.565661 = idf(docFreq=459, maxDocs=44218)
               0.0546875 = fieldNorm(doc=437)
         0.037237614 = weight(abstract_txt:cost in 437) [ClassicSimilarity], result of:
           0.037237614 = score(doc=437,freq=1.0), product of:
             0.118497625 = queryWeight, product of:
               1.3049985 = boost
               5.746245 = idf(docFreq=383, maxDocs=44218)
               0.015802125 = queryNorm
             0.31424776 = fieldWeight in 437, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.746245 = idf(docFreq=383, maxDocs=44218)
               0.0546875 = fieldNorm(doc=437)
         0.006527185 = weight(abstract_txt:that in 437) [ClassicSimilarity], result of:
           0.006527185 = score(doc=437,freq=1.0), product of:
             0.05037159 = queryWeight, product of:
               1.3452966 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.015802125 = queryNorm
             0.12958068 = fieldWeight in 437, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0546875 = fieldNorm(doc=437)
         0.05839108 = weight(abstract_txt:frequency in 437) [ClassicSimilarity], result of:
           0.05839108 = score(doc=437,freq=2.0), product of:
             0.12694319 = queryWeight, product of:
               1.3507031 = boost
               5.947494 = idf(docFreq=313, maxDocs=44218)
               0.015802125 = queryNorm
             0.45997804 = fieldWeight in 437, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.947494 = idf(docFreq=313, maxDocs=44218)
               0.0546875 = fieldNorm(doc=437)
         0.052277222 = weight(abstract_txt:tend in 437) [ClassicSimilarity], result of:
           0.052277222 = score(doc=437,freq=1.0), product of:
             0.14856964 = queryWeight, product of:
               1.4612355 = boost
               6.434197 = idf(docFreq=192, maxDocs=44218)
               0.015802125 = queryNorm
             0.35187015 = fieldWeight in 437, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.434197 = idf(docFreq=192, maxDocs=44218)
               0.0546875 = fieldNorm(doc=437)
         0.015455962 = weight(abstract_txt:more in 437) [ClassicSimilarity], result of:
           0.015455962 = score(doc=437,freq=1.0), product of:
             0.08307349 = queryWeight, product of:
               1.5452595 = boost
               3.402088 = idf(docFreq=4002, maxDocs=44218)
               0.015802125 = queryNorm
             0.18605168 = fieldWeight in 437, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.402088 = idf(docFreq=4002, maxDocs=44218)
               0.0546875 = fieldNorm(doc=437)
         0.016473128 = weight(abstract_txt:retrieval in 437) [ClassicSimilarity], result of:
           0.016473128 = score(doc=437,freq=1.0), product of:
             0.08667938 = queryWeight, product of:
               1.5784401 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.015802125 = queryNorm
             0.19004668 = fieldWeight in 437, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0546875 = fieldNorm(doc=437)
         0.19466926 = weight(abstract_txt:effort in 437) [ClassicSimilarity], result of:
           0.19466926 = score(doc=437,freq=7.0), product of:
             0.2350881 = queryWeight, product of:
               2.5994742 = boost
               5.723078 = idf(docFreq=392, maxDocs=44218)
               0.015802125 = queryNorm
             0.8280694 = fieldWeight in 437, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               5.723078 = idf(docFreq=392, maxDocs=44218)
               0.0546875 = fieldNorm(doc=437)
         0.11771411 = weight(abstract_txt:relevance in 437) [ClassicSimilarity], result of:
           0.11771411 = score(doc=437,freq=4.0), product of:
             0.21822311 = queryWeight, product of:
               2.8001132 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.015802125 = queryNorm
             0.5394209 = fieldWeight in 437, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0546875 = fieldNorm(doc=437)
       0.48 = coord(12/25)
   

4. Rajagopal, P.; Ravana, S.D.; Koh, Y.S.; Balakrishnan, V.: Evaluating the effectiveness of information retrieval systems using effort-based relevance judgment (2019) 0.25

   0.24554303 = sum of:
     0.24554303 = product of:
       0.8769394 = sum of:
         0.010549523 = weight(abstract_txt:that in 5287) [ClassicSimilarity], result of:
           0.010549523 = score(doc=5287,freq=2.0), product of:
             0.05037159 = queryWeight, product of:
               1.3452966 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.015802125 = queryNorm
             0.20943399 = fieldWeight in 5287, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0625 = fieldNorm(doc=5287)
         0.047102734 = weight(abstract_txt:documents in 5287) [ClassicSimilarity], result of:
           0.047102734 = score(doc=5287,freq=4.0), product of:
             0.09143271 = queryWeight, product of:
               1.40395 = boost
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.015802125 = queryNorm
             0.5151628 = fieldWeight in 5287, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.1213026 = idf(docFreq=1949, maxDocs=44218)
               0.0625 = fieldNorm(doc=5287)
         0.14690985 = weight(abstract_txt:judgments in 5287) [ClassicSimilarity], result of:
           0.14690985 = score(doc=5287,freq=4.0), product of:
             0.17050655 = queryWeight, product of:
               1.5654014 = boost
               6.892866 = idf(docFreq=121, maxDocs=44218)
               0.015802125 = queryNorm
             0.86160827 = fieldWeight in 5287, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.892866 = idf(docFreq=121, maxDocs=44218)
               0.0625 = fieldNorm(doc=5287)
         0.032608338 = weight(abstract_txt:retrieval in 5287) [ClassicSimilarity], result of:
           0.032608338 = score(doc=5287,freq=3.0), product of:
             0.08667938 = queryWeight, product of:
               1.5784401 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.015802125 = queryNorm
             0.37619486 = fieldWeight in 5287, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=5287)
         0.2378402 = weight(abstract_txt:effort in 5287) [ClassicSimilarity], result of:
           0.2378402 = score(doc=5287,freq=8.0), product of:
             0.2350881 = queryWeight, product of:
               2.5994742 = boost
               5.723078 = idf(docFreq=392, maxDocs=44218)
               0.015802125 = queryNorm
             1.0117067 = fieldWeight in 5287, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               5.723078 = idf(docFreq=392, maxDocs=44218)
               0.0625 = fieldNorm(doc=5287)
         0.16476543 = weight(abstract_txt:relevance in 5287) [ClassicSimilarity], result of:
           0.16476543 = score(doc=5287,freq=6.0), product of:
             0.21822311 = queryWeight, product of:
               2.8001132 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.015802125 = queryNorm
             0.755032 = fieldWeight in 5287, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=5287)
         0.23716336 = weight(abstract_txt:judges in 5287) [ClassicSimilarity], result of:
           0.23716336 = score(doc=5287,freq=1.0), product of:
             0.46928376 = queryWeight, product of:
               3.6727211 = boost
               8.085969 = idf(docFreq=36, maxDocs=44218)
               0.015802125 = queryNorm
             0.50537306 = fieldWeight in 5287, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.085969 = idf(docFreq=36, maxDocs=44218)
               0.0625 = fieldNorm(doc=5287)
       0.28 = coord(7/25)
   

5. White, H.D.: Combining bibliometrics, information retrieval, and relevance theory : part 1: first examples of a synthesis (2007) 0.22

   0.21824162 = sum of:
     0.21824162 = product of:
       0.68200505 = sum of:
         0.036258765 = weight(abstract_txt:theory in 436) [ClassicSimilarity], result of:
           0.036258765 = score(doc=436,freq=3.0), product of:
             0.073840626 = queryWeight, product of:
               1.0301558 = boost
               4.5360413 = idf(docFreq=1287, maxDocs=44218)
               0.015802125 = queryNorm
             0.49104086 = fieldWeight in 436, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.5360413 = idf(docFreq=1287, maxDocs=44218)
               0.0625 = fieldNorm(doc=436)
         0.015668143 = weight(abstract_txt:with in 436) [ClassicSimilarity], result of:
           0.015668143 = score(doc=436,freq=5.0), product of:
             0.044849623 = queryWeight, product of:
               1.1354018 = boost
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.015802125 = queryNorm
             0.34934837 = fieldWeight in 436, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               2.4997334 = idf(docFreq=9868, maxDocs=44218)
               0.0625 = fieldNorm(doc=436)
         0.032685734 = weight(abstract_txt:cognitive in 436) [ClassicSimilarity], result of:
           0.032685734 = score(doc=436,freq=1.0), product of:
             0.09938006 = queryWeight, product of:
               1.1951016 = boost
               5.2623405 = idf(docFreq=622, maxDocs=44218)
               0.015802125 = queryNorm
             0.32889628 = fieldWeight in 436, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.2623405 = idf(docFreq=622, maxDocs=44218)
               0.0625 = fieldNorm(doc=436)
         0.038669772 = weight(abstract_txt:effects in 436) [ClassicSimilarity], result of:
           0.038669772 = score(doc=436,freq=1.0), product of:
             0.11116674 = queryWeight, product of:
               1.2639871 = boost
               5.565661 = idf(docFreq=459, maxDocs=44218)
               0.015802125 = queryNorm
             0.3478538 = fieldWeight in 436, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.565661 = idf(docFreq=459, maxDocs=44218)
               0.0625 = fieldNorm(doc=436)
         0.037652865 = weight(abstract_txt:retrieval in 436) [ClassicSimilarity], result of:
           0.037652865 = score(doc=436,freq=4.0), product of:
             0.08667938 = queryWeight, product of:
               1.5784401 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.015802125 = queryNorm
             0.43439242 = fieldWeight in 436, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=436)
         0.1189201 = weight(abstract_txt:effort in 436) [ClassicSimilarity], result of:
           0.1189201 = score(doc=436,freq=2.0), product of:
             0.2350881 = queryWeight, product of:
               2.5994742 = boost
               5.723078 = idf(docFreq=392, maxDocs=44218)
               0.015802125 = queryNorm
             0.50585335 = fieldWeight in 436, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.723078 = idf(docFreq=392, maxDocs=44218)
               0.0625 = fieldNorm(doc=436)
         0.15040956 = weight(abstract_txt:relevance in 436) [ClassicSimilarity], result of:
           0.15040956 = score(doc=436,freq=5.0), product of:
             0.21822311 = queryWeight, product of:
               2.8001132 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.015802125 = queryNorm
             0.6892467 = fieldWeight in 436, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=436)
         0.25174007 = weight(abstract_txt:distributions in 436) [ClassicSimilarity], result of:
           0.25174007 = score(doc=436,freq=2.0), product of:
             0.4175085 = queryWeight, product of:
               3.8730927 = boost
               6.82169 = idf(docFreq=130, maxDocs=44218)
               0.015802125 = queryNorm
             0.6029579 = fieldWeight in 436, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.82169 = idf(docFreq=130, maxDocs=44218)
               0.0625 = fieldNorm(doc=436)
       0.32 = coord(8/25)