Document (#37685)

Author

Kelly, D.
Sugimoto, C.R.

Title

¬A systematic review of interactive information retrieval evaluation studies, 1967-2006

Source

Journal of the American Society for Information Science and Technology. 64(2013) no.4, S.745-770

Year

2013

Abstract

With the increasing number and diversity of search tools available, interest in the evaluation of search systems, particularly from a user perspective, has grown among researchers. More researchers are designing and evaluating interactive information retrieval (IIR) systems and beginning to innovate in evaluation methods. Maturation of a research specialty relies on the ability to replicate research, provide standards for measurement and analysis, and understand past endeavors. This article presents a historical overview of 40 years of IIR evaluation studies using the method of systematic review. A total of 2,791 journal and conference units were manually examined and 127 articles were selected for analysis in this study, based on predefined inclusion and exclusion criteria. These articles were systematically coded using features such as author, publication date, sources and references, and properties of the research method used in the articles, such as number of subjects, tasks, corpora, and measures. Results include data describing the growth of IIR studies over time, the most frequently occurring and cited authors and sources, and the most common types of corpora and measures used. An additional product of this research is a bibliography of IIR evaluation research that can be used by students, teachers, and those new to the area. To the authors' knowledge, this is the first historical, systematic characterization of the IIR evaluation literature, including the documentation of methods and measures used by researchers in this specialty.

Theme

Retrievalstudien

Similar documents (author)

1. Kelly, B.: ¬The XHTML interview (2000) 1.94

   1.9389155 = sum of:
     1.9389155 = product of:
       3.877831 = sum of:
         3.877831 = weight(author_txt:kelly in 4183) [ClassicSimilarity], result of:
           3.877831 = score(doc=4183,freq=1.0), product of:
             0.7283309 = queryWeight, product of:
               1.0309737 = boost
               8.518833 = idf(docFreq=23, maxDocs=44218)
               0.08292797 = queryNorm
             5.3242707 = fieldWeight in 4183, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.518833 = idf(docFreq=23, maxDocs=44218)
               0.625 = fieldNorm(doc=4183)
       0.5 = coord(1/2)
   

2. Kelly, J.: Downloading information using bibliographic management software (1994) 1.94

   1.9389155 = sum of:
     1.9389155 = product of:
       3.877831 = sum of:
         3.877831 = weight(author_txt:kelly in 8356) [ClassicSimilarity], result of:
           3.877831 = score(doc=8356,freq=1.0), product of:
             0.7283309 = queryWeight, product of:
               1.0309737 = boost
               8.518833 = idf(docFreq=23, maxDocs=44218)
               0.08292797 = queryNorm
             5.3242707 = fieldWeight in 8356, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.518833 = idf(docFreq=23, maxDocs=44218)
               0.625 = fieldNorm(doc=8356)
       0.5 = coord(1/2)
   

3. Kelly, J.A.: Downloading information using bibliographic management software (1997) 1.94

   1.9389155 = sum of:
     1.9389155 = product of:
       3.877831 = sum of:
         3.877831 = weight(author_txt:kelly in 3254) [ClassicSimilarity], result of:
           3.877831 = score(doc=3254,freq=1.0), product of:
             0.7283309 = queryWeight, product of:
               1.0309737 = boost
               8.518833 = idf(docFreq=23, maxDocs=44218)
               0.08292797 = queryNorm
             5.3242707 = fieldWeight in 3254, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.518833 = idf(docFreq=23, maxDocs=44218)
               0.625 = fieldNorm(doc=3254)
       0.5 = coord(1/2)
   

4. Kelly, R.A.: Digital archiving the physics literature : Author to archive and beyond. The American Physical Society (1997) 1.94

   1.9389155 = sum of:
     1.9389155 = product of:
       3.877831 = sum of:
         3.877831 = weight(author_txt:kelly in 804) [ClassicSimilarity], result of:
           3.877831 = score(doc=804,freq=1.0), product of:
             0.7283309 = queryWeight, product of:
               1.0309737 = boost
               8.518833 = idf(docFreq=23, maxDocs=44218)
               0.08292797 = queryNorm
             5.3242707 = fieldWeight in 804, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.518833 = idf(docFreq=23, maxDocs=44218)
               0.625 = fieldNorm(doc=804)
       0.5 = coord(1/2)
   

5. Kelly, D.: Measuring online information seeking context : Part 1: background and method (2006) 1.94

   1.9389155 = sum of:
     1.9389155 = product of:
       3.877831 = sum of:
         3.877831 = weight(author_txt:kelly in 206) [ClassicSimilarity], result of:
           3.877831 = score(doc=206,freq=1.0), product of:
             0.7283309 = queryWeight, product of:
               1.0309737 = boost
               8.518833 = idf(docFreq=23, maxDocs=44218)
               0.08292797 = queryNorm
             5.3242707 = fieldWeight in 206, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.518833 = idf(docFreq=23, maxDocs=44218)
               0.625 = fieldNorm(doc=206)
       0.5 = coord(1/2)
   

Similar documents (content)

1. Zhang, Y.; Sun, Y.; Xie, B.: Quality of health information for consumers on the web : a systematic review of indicators, criteria, tools, and evaluation results (2015) 0.32

   0.32124436 = sum of:
     0.32124436 = product of:
       0.7301008 = sum of:
         0.0952106 = weight(abstract_txt:predefined in 2218) [ClassicSimilarity], result of:
           0.0952106 = score(doc=2218,freq=1.0), product of:
             0.18644692 = queryWeight, product of:
               8.1705265 = idf(docFreq=33, maxDocs=44218)
               0.02281945 = queryNorm
             0.5106579 = fieldWeight in 2218, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.1705265 = idf(docFreq=33, maxDocs=44218)
               0.0625 = fieldNorm(doc=2218)
         0.040037498 = weight(abstract_txt:review in 2218) [ClassicSimilarity], result of:
           0.040037498 = score(doc=2218,freq=1.0), product of:
             0.13185188 = queryWeight, product of:
               1.1892703 = boost
               4.858482 = idf(docFreq=932, maxDocs=44218)
               0.02281945 = queryNorm
             0.30365512 = fieldWeight in 2218, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.858482 = idf(docFreq=932, maxDocs=44218)
               0.0625 = fieldNorm(doc=2218)
         0.025886733 = weight(abstract_txt:were in 2218) [ClassicSimilarity], result of:
           0.025886733 = score(doc=2218,freq=1.0), product of:
             0.11285573 = queryWeight, product of:
               1.3475498 = boost
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.02281945 = queryNorm
             0.22937898 = fieldWeight in 2218, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.0625 = fieldNorm(doc=2218)
         0.012262713 = weight(abstract_txt:this in 2218) [ClassicSimilarity], result of:
           0.012262713 = score(doc=2218,freq=1.0), product of:
             0.0813104 = queryWeight, product of:
               1.4766597 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.02281945 = queryNorm
             0.1508136 = fieldWeight in 2218, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.0625 = fieldNorm(doc=2218)
         0.057574805 = weight(abstract_txt:studies in 2218) [ClassicSimilarity], result of:
           0.057574805 = score(doc=2218,freq=2.0), product of:
             0.15262198 = queryWeight, product of:
               1.5670815 = boost
               4.26796 = idf(docFreq=1683, maxDocs=44218)
               0.02281945 = queryNorm
             0.37723795 = fieldWeight in 2218, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.26796 = idf(docFreq=1683, maxDocs=44218)
               0.0625 = fieldNorm(doc=2218)
         0.037433133 = weight(abstract_txt:used in 2218) [ClassicSimilarity], result of:
           0.037433133 = score(doc=2218,freq=2.0), product of:
             0.12607022 = queryWeight, product of:
               1.6445937 = boost
               3.3592992 = idf(docFreq=4177, maxDocs=44218)
               0.02281945 = queryNorm
             0.2969229 = fieldWeight in 2218, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.3592992 = idf(docFreq=4177, maxDocs=44218)
               0.0625 = fieldNorm(doc=2218)
         0.057270076 = weight(abstract_txt:articles in 2218) [ClassicSimilarity], result of:
           0.057270076 = score(doc=2218,freq=1.0), product of:
             0.19161256 = queryWeight, product of:
               1.7558807 = boost
               4.7821565 = idf(docFreq=1006, maxDocs=44218)
               0.02281945 = queryNorm
             0.29888478 = fieldWeight in 2218, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7821565 = idf(docFreq=1006, maxDocs=44218)
               0.0625 = fieldNorm(doc=2218)
         0.082171716 = weight(abstract_txt:researchers in 2218) [ClassicSimilarity], result of:
           0.082171716 = score(doc=2218,freq=2.0), product of:
             0.19346854 = queryWeight, product of:
               1.764364 = boost
               4.805261 = idf(docFreq=983, maxDocs=44218)
               0.02281945 = queryNorm
             0.42472908 = fieldWeight in 2218, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.805261 = idf(docFreq=983, maxDocs=44218)
               0.0625 = fieldNorm(doc=2218)
         0.027811334 = weight(abstract_txt:research in 2218) [ClassicSimilarity], result of:
           0.027811334 = score(doc=2218,freq=1.0), product of:
             0.1403577 = queryWeight, product of:
               1.9401063 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.02281945 = queryNorm
             0.19814612 = fieldWeight in 2218, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.0625 = fieldNorm(doc=2218)
         0.10533234 = weight(abstract_txt:systematic in 2218) [ClassicSimilarity], result of:
           0.10533234 = score(doc=2218,freq=1.0), product of:
             0.28763822 = queryWeight, product of:
               2.1513264 = boost
               5.8591566 = idf(docFreq=342, maxDocs=44218)
               0.02281945 = queryNorm
             0.3661973 = fieldWeight in 2218, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8591566 = idf(docFreq=342, maxDocs=44218)
               0.0625 = fieldNorm(doc=2218)
         0.18910985 = weight(abstract_txt:evaluation in 2218) [ClassicSimilarity], result of:
           0.18910985 = score(doc=2218,freq=4.0), product of:
             0.33723933 = queryWeight, product of:
               3.2943301 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.02281945 = queryNorm
             0.5607586 = fieldWeight in 2218, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=2218)
       0.44 = coord(11/25)
   

2. Zhao, D.; Strotmann, A.: Intellectual structure of information science 2011-2020 : an author co-citation analysis (2022) 0.30

   0.30014783 = sum of:
     0.30014783 = product of:
       0.6821542 = sum of:
         0.018670268 = weight(abstract_txt:methods in 610) [ClassicSimilarity], result of:
           0.018670268 = score(doc=610,freq=1.0), product of:
             0.09605085 = queryWeight, product of:
               1.0150514 = boost
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.02281945 = queryNorm
             0.194379 = fieldWeight in 610, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.046875 = fieldNorm(doc=610)
         0.03719462 = weight(abstract_txt:authors in 610) [ClassicSimilarity], result of:
           0.03719462 = score(doc=610,freq=2.0), product of:
             0.12070103 = queryWeight, product of:
               1.1378706 = boost
               4.648501 = idf(docFreq=1150, maxDocs=44218)
               0.02281945 = queryNorm
             0.30815497 = fieldWeight in 610, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.648501 = idf(docFreq=1150, maxDocs=44218)
               0.046875 = fieldNorm(doc=610)
         0.04755697 = weight(abstract_txt:were in 610) [ClassicSimilarity], result of:
           0.04755697 = score(doc=610,freq=6.0), product of:
             0.11285573 = queryWeight, product of:
               1.3475498 = boost
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.02281945 = queryNorm
             0.42139614 = fieldWeight in 610, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.046875 = fieldNorm(doc=610)
         0.044879016 = weight(abstract_txt:interactive in 610) [ClassicSimilarity], result of:
           0.044879016 = score(doc=610,freq=1.0), product of:
             0.17235732 = queryWeight, product of:
               1.3597287 = boost
               5.5548496 = idf(docFreq=464, maxDocs=44218)
               0.02281945 = queryNorm
             0.26038358 = fieldWeight in 610, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.5548496 = idf(docFreq=464, maxDocs=44218)
               0.046875 = fieldNorm(doc=610)
         0.018394072 = weight(abstract_txt:this in 610) [ClassicSimilarity], result of:
           0.018394072 = score(doc=610,freq=4.0), product of:
             0.0813104 = queryWeight, product of:
               1.4766597 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.02281945 = queryNorm
             0.2262204 = fieldWeight in 610, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.046875 = fieldNorm(doc=610)
         0.043181103 = weight(abstract_txt:studies in 610) [ClassicSimilarity], result of:
           0.043181103 = score(doc=610,freq=2.0), product of:
             0.15262198 = queryWeight, product of:
               1.5670815 = boost
               4.26796 = idf(docFreq=1683, maxDocs=44218)
               0.02281945 = queryNorm
             0.28292847 = fieldWeight in 610, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.26796 = idf(docFreq=1683, maxDocs=44218)
               0.046875 = fieldNorm(doc=610)
         0.01985192 = weight(abstract_txt:used in 610) [ClassicSimilarity], result of:
           0.01985192 = score(doc=610,freq=1.0), product of:
             0.12607022 = queryWeight, product of:
               1.6445937 = boost
               3.3592992 = idf(docFreq=4177, maxDocs=44218)
               0.02281945 = queryNorm
             0.15746716 = fieldWeight in 610, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3592992 = idf(docFreq=4177, maxDocs=44218)
               0.046875 = fieldNorm(doc=610)
         0.06074409 = weight(abstract_txt:articles in 610) [ClassicSimilarity], result of:
           0.06074409 = score(doc=610,freq=2.0), product of:
             0.19161256 = queryWeight, product of:
               1.7558807 = boost
               4.7821565 = idf(docFreq=1006, maxDocs=44218)
               0.02281945 = queryNorm
             0.31701517 = fieldWeight in 610, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.7821565 = idf(docFreq=1006, maxDocs=44218)
               0.046875 = fieldNorm(doc=610)
         0.046641026 = weight(abstract_txt:research in 610) [ClassicSimilarity], result of:
           0.046641026 = score(doc=610,freq=5.0), product of:
             0.1403577 = queryWeight, product of:
               1.9401063 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.02281945 = queryNorm
             0.33230114 = fieldWeight in 610, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.046875 = fieldNorm(doc=610)
         0.27412495 = weight(abstract_txt:specialty in 610) [ClassicSimilarity], result of:
           0.27412495 = score(doc=610,freq=4.0), product of:
             0.36281055 = queryWeight, product of:
               1.972774 = boost
               8.059301 = idf(docFreq=37, maxDocs=44218)
               0.02281945 = queryNorm
             0.7555595 = fieldWeight in 610, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               8.059301 = idf(docFreq=37, maxDocs=44218)
               0.046875 = fieldNorm(doc=610)
         0.07091619 = weight(abstract_txt:evaluation in 610) [ClassicSimilarity], result of:
           0.07091619 = score(doc=610,freq=1.0), product of:
             0.33723933 = queryWeight, product of:
               3.2943301 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.02281945 = queryNorm
             0.21028447 = fieldWeight in 610, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.046875 = fieldNorm(doc=610)
       0.44 = coord(11/25)
   

3. Cui, H.; Heidorn, P.B.: ¬The reusability of induced knowledge for the automatic semantic markup of taxonomic descriptions (2007) 0.29

   0.28842357 = sum of:
     0.28842357 = product of:
       0.80117655 = sum of:
         0.024640568 = weight(abstract_txt:number in 84) [ClassicSimilarity], result of:
           0.024640568 = score(doc=84,freq=1.0), product of:
             0.095398635 = queryWeight, product of:
               1.0115992 = boost
               4.132649 = idf(docFreq=1927, maxDocs=44218)
               0.02281945 = queryNorm
             0.25829056 = fieldWeight in 84, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.132649 = idf(docFreq=1927, maxDocs=44218)
               0.0625 = fieldNorm(doc=84)
         0.02489369 = weight(abstract_txt:methods in 84) [ClassicSimilarity], result of:
           0.02489369 = score(doc=84,freq=1.0), product of:
             0.09605085 = queryWeight, product of:
               1.0150514 = boost
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.02281945 = queryNorm
             0.259172 = fieldWeight in 84, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.0625 = fieldNorm(doc=84)
         0.060738564 = weight(abstract_txt:authors in 84) [ClassicSimilarity], result of:
           0.060738564 = score(doc=84,freq=3.0), product of:
             0.12070103 = queryWeight, product of:
               1.1378706 = boost
               4.648501 = idf(docFreq=1150, maxDocs=44218)
               0.02281945 = queryNorm
             0.50321496 = fieldWeight in 84, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.648501 = idf(docFreq=1150, maxDocs=44218)
               0.0625 = fieldNorm(doc=84)
         0.051773466 = weight(abstract_txt:were in 84) [ClassicSimilarity], result of:
           0.051773466 = score(doc=84,freq=4.0), product of:
             0.11285573 = queryWeight, product of:
               1.3475498 = boost
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.02281945 = queryNorm
             0.45875797 = fieldWeight in 84, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.0625 = fieldNorm(doc=84)
         0.012262713 = weight(abstract_txt:this in 84) [ClassicSimilarity], result of:
           0.012262713 = score(doc=84,freq=1.0), product of:
             0.0813104 = queryWeight, product of:
               1.4766597 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.02281945 = queryNorm
             0.1508136 = fieldWeight in 84, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.0625 = fieldNorm(doc=84)
         0.026469223 = weight(abstract_txt:used in 84) [ClassicSimilarity], result of:
           0.026469223 = score(doc=84,freq=1.0), product of:
             0.12607022 = queryWeight, product of:
               1.6445937 = boost
               3.3592992 = idf(docFreq=4177, maxDocs=44218)
               0.02281945 = queryNorm
             0.2099562 = fieldWeight in 84, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3592992 = idf(docFreq=4177, maxDocs=44218)
               0.0625 = fieldNorm(doc=84)
         0.38258636 = weight(abstract_txt:corpora in 84) [ClassicSimilarity], result of:
           0.38258636 = score(doc=84,freq=10.0), product of:
             0.27558866 = queryWeight, product of:
               1.7193649 = boost
               7.0240583 = idf(docFreq=106, maxDocs=44218)
               0.02281945 = queryNorm
             1.3882514 = fieldWeight in 84, product of:
               3.1622777 = tf(freq=10.0), with freq of:
                 10.0 = termFreq=10.0
               7.0240583 = idf(docFreq=106, maxDocs=44218)
               0.0625 = fieldNorm(doc=84)
         0.084091075 = weight(abstract_txt:measures in 84) [ClassicSimilarity], result of:
           0.084091075 = score(doc=84,freq=1.0), product of:
             0.2475362 = queryWeight, product of:
               1.9957327 = boost
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.02281945 = queryNorm
             0.33971223 = fieldWeight in 84, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.4353957 = idf(docFreq=523, maxDocs=44218)
               0.0625 = fieldNorm(doc=84)
         0.13372086 = weight(abstract_txt:evaluation in 84) [ClassicSimilarity], result of:
           0.13372086 = score(doc=84,freq=2.0), product of:
             0.33723933 = queryWeight, product of:
               3.2943301 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.02281945 = queryNorm
             0.3965162 = fieldWeight in 84, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=84)
       0.36 = coord(9/25)
   

4. Sinn, D.: Impact of digital archival collections on historical research (2012) 0.26

   0.2629693 = sum of:
     0.2629693 = product of:
       0.59765744 = sum of:
         0.024640568 = weight(abstract_txt:number in 368) [ClassicSimilarity], result of:
           0.024640568 = score(doc=368,freq=1.0), product of:
             0.095398635 = queryWeight, product of:
               1.0115992 = boost
               4.132649 = idf(docFreq=1927, maxDocs=44218)
               0.02281945 = queryNorm
             0.25829056 = fieldWeight in 368, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.132649 = idf(docFreq=1927, maxDocs=44218)
               0.0625 = fieldNorm(doc=368)
         0.037322283 = weight(abstract_txt:sources in 368) [ClassicSimilarity], result of:
           0.037322283 = score(doc=368,freq=1.0), product of:
             0.1258212 = queryWeight, product of:
               1.1617544 = boost
               4.7460723 = idf(docFreq=1043, maxDocs=44218)
               0.02281945 = queryNorm
             0.29662952 = fieldWeight in 368, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7460723 = idf(docFreq=1043, maxDocs=44218)
               0.0625 = fieldNorm(doc=368)
         0.040037498 = weight(abstract_txt:review in 368) [ClassicSimilarity], result of:
           0.040037498 = score(doc=368,freq=1.0), product of:
             0.13185188 = queryWeight, product of:
               1.1892703 = boost
               4.858482 = idf(docFreq=932, maxDocs=44218)
               0.02281945 = queryNorm
             0.30365512 = fieldWeight in 368, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.858482 = idf(docFreq=932, maxDocs=44218)
               0.0625 = fieldNorm(doc=368)
         0.044837136 = weight(abstract_txt:were in 368) [ClassicSimilarity], result of:
           0.044837136 = score(doc=368,freq=3.0), product of:
             0.11285573 = queryWeight, product of:
               1.3475498 = boost
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.02281945 = queryNorm
             0.39729604 = fieldWeight in 368, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.6700637 = idf(docFreq=3061, maxDocs=44218)
               0.0625 = fieldNorm(doc=368)
         0.14883037 = weight(abstract_txt:historical in 368) [ClassicSimilarity], result of:
           0.14883037 = score(doc=368,freq=6.0), product of:
             0.17412147 = queryWeight, product of:
               1.3666697 = boost
               5.583205 = idf(docFreq=451, maxDocs=44218)
               0.02281945 = queryNorm
             0.8547503 = fieldWeight in 368, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.583205 = idf(docFreq=451, maxDocs=44218)
               0.0625 = fieldNorm(doc=368)
         0.012262713 = weight(abstract_txt:this in 368) [ClassicSimilarity], result of:
           0.012262713 = score(doc=368,freq=1.0), product of:
             0.0813104 = queryWeight, product of:
               1.4766597 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.02281945 = queryNorm
             0.1508136 = fieldWeight in 368, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.0625 = fieldNorm(doc=368)
         0.057574805 = weight(abstract_txt:studies in 368) [ClassicSimilarity], result of:
           0.057574805 = score(doc=368,freq=2.0), product of:
             0.15262198 = queryWeight, product of:
               1.5670815 = boost
               4.26796 = idf(docFreq=1683, maxDocs=44218)
               0.02281945 = queryNorm
             0.37723795 = fieldWeight in 368, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.26796 = idf(docFreq=1683, maxDocs=44218)
               0.0625 = fieldNorm(doc=368)
         0.037433133 = weight(abstract_txt:used in 368) [ClassicSimilarity], result of:
           0.037433133 = score(doc=368,freq=2.0), product of:
             0.12607022 = queryWeight, product of:
               1.6445937 = boost
               3.3592992 = idf(docFreq=4177, maxDocs=44218)
               0.02281945 = queryNorm
             0.2969229 = fieldWeight in 368, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.3592992 = idf(docFreq=4177, maxDocs=44218)
               0.0625 = fieldNorm(doc=368)
         0.08099212 = weight(abstract_txt:articles in 368) [ClassicSimilarity], result of:
           0.08099212 = score(doc=368,freq=2.0), product of:
             0.19161256 = queryWeight, product of:
               1.7558807 = boost
               4.7821565 = idf(docFreq=1006, maxDocs=44218)
               0.02281945 = queryNorm
             0.4226869 = fieldWeight in 368, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.7821565 = idf(docFreq=1006, maxDocs=44218)
               0.0625 = fieldNorm(doc=368)
         0.05810418 = weight(abstract_txt:researchers in 368) [ClassicSimilarity], result of:
           0.05810418 = score(doc=368,freq=1.0), product of:
             0.19346854 = queryWeight, product of:
               1.764364 = boost
               4.805261 = idf(docFreq=983, maxDocs=44218)
               0.02281945 = queryNorm
             0.30032882 = fieldWeight in 368, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.805261 = idf(docFreq=983, maxDocs=44218)
               0.0625 = fieldNorm(doc=368)
         0.055622667 = weight(abstract_txt:research in 368) [ClassicSimilarity], result of:
           0.055622667 = score(doc=368,freq=4.0), product of:
             0.1403577 = queryWeight, product of:
               1.9401063 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.02281945 = queryNorm
             0.39629224 = fieldWeight in 368, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.0625 = fieldNorm(doc=368)
       0.44 = coord(11/25)
   

5. Behnert, C.; Lewandowski, D.: ¬A framework for designing retrieval effectiveness studies of library information systems using human relevance assessments (2017) 0.24

   0.24049194 = sum of:
     0.24049194 = product of:
       0.60122985 = sum of:
         0.02489369 = weight(abstract_txt:methods in 3700) [ClassicSimilarity], result of:
           0.02489369 = score(doc=3700,freq=1.0), product of:
             0.09605085 = queryWeight, product of:
               1.0150514 = boost
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.02281945 = queryNorm
             0.259172 = fieldWeight in 3700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.037322283 = weight(abstract_txt:sources in 3700) [ClassicSimilarity], result of:
           0.037322283 = score(doc=3700,freq=1.0), product of:
             0.1258212 = queryWeight, product of:
               1.1617544 = boost
               4.7460723 = idf(docFreq=1043, maxDocs=44218)
               0.02281945 = queryNorm
             0.29662952 = fieldWeight in 3700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7460723 = idf(docFreq=1043, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.017342096 = weight(abstract_txt:this in 3700) [ClassicSimilarity], result of:
           0.017342096 = score(doc=3700,freq=2.0), product of:
             0.0813104 = queryWeight, product of:
               1.4766597 = boost
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.02281945 = queryNorm
             0.21328263 = fieldWeight in 3700, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.4130175 = idf(docFreq=10762, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.057574805 = weight(abstract_txt:studies in 3700) [ClassicSimilarity], result of:
           0.057574805 = score(doc=3700,freq=2.0), product of:
             0.15262198 = queryWeight, product of:
               1.5670815 = boost
               4.26796 = idf(docFreq=1683, maxDocs=44218)
               0.02281945 = queryNorm
             0.37723795 = fieldWeight in 3700, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.26796 = idf(docFreq=1683, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.026469223 = weight(abstract_txt:used in 3700) [ClassicSimilarity], result of:
           0.026469223 = score(doc=3700,freq=1.0), product of:
             0.12607022 = queryWeight, product of:
               1.6445937 = boost
               3.3592992 = idf(docFreq=4177, maxDocs=44218)
               0.02281945 = queryNorm
             0.2099562 = fieldWeight in 3700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3592992 = idf(docFreq=4177, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.057270076 = weight(abstract_txt:articles in 3700) [ClassicSimilarity], result of:
           0.057270076 = score(doc=3700,freq=1.0), product of:
             0.19161256 = queryWeight, product of:
               1.7558807 = boost
               4.7821565 = idf(docFreq=1006, maxDocs=44218)
               0.02281945 = queryNorm
             0.29888478 = fieldWeight in 3700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.7821565 = idf(docFreq=1006, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.05810418 = weight(abstract_txt:researchers in 3700) [ClassicSimilarity], result of:
           0.05810418 = score(doc=3700,freq=1.0), product of:
             0.19346854 = queryWeight, product of:
               1.764364 = boost
               4.805261 = idf(docFreq=983, maxDocs=44218)
               0.02281945 = queryNorm
             0.30032882 = fieldWeight in 3700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.805261 = idf(docFreq=983, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.027811334 = weight(abstract_txt:research in 3700) [ClassicSimilarity], result of:
           0.027811334 = score(doc=3700,freq=1.0), product of:
             0.1403577 = queryWeight, product of:
               1.9401063 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.02281945 = queryNorm
             0.19814612 = fieldWeight in 3700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.10533234 = weight(abstract_txt:systematic in 3700) [ClassicSimilarity], result of:
           0.10533234 = score(doc=3700,freq=1.0), product of:
             0.28763822 = queryWeight, product of:
               2.1513264 = boost
               5.8591566 = idf(docFreq=342, maxDocs=44218)
               0.02281945 = queryNorm
             0.3661973 = fieldWeight in 3700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8591566 = idf(docFreq=342, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.18910985 = weight(abstract_txt:evaluation in 3700) [ClassicSimilarity], result of:
           0.18910985 = score(doc=3700,freq=4.0), product of:
             0.33723933 = queryWeight, product of:
               3.2943301 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.02281945 = queryNorm
             0.5607586 = fieldWeight in 3700, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
       0.4 = coord(10/25)