Document (#13452)

Author

Borgman, C.L.
Hirsh, S.G.
Hiller, J.

Title

Rethinking online monitoring methods for information retrieval systems : from search product to search process

Source

Journal of the American Society for Information Science. 47(1996) no.7, S.568-583

Year

1996

Abstract

Searching information retrieval systems is a highly interactive, iterative process that cannot be understood simply by comparing the output of a search session (the 'search product') to a query stated in advance. In this article, we examine evaluation goals and methods for studying information retrieval behavior, drawing examples from our own research and that of others. We limit our review to research that employs online monitoring, also known as transaction log analysis. Online monitoring is one of few methods that can capture detailed data on the search process at a reasonable cost; these data can be used to build quantitative models or to support qualitative interpretations of quatitative results. Monitoring is a data collection technique rather than a research design, and can be employed in experimental of field studies, whether alone or combined with other data collection methods. Based on the the research questions of interest, the researcher must determine what variables to collect from each data source, which to treat as independent varaibles to manipulate, and which to treat as dependent variables to observe effects. Studies of searching behavior often treat search task and searcher characteristics as independent variables and may manipulate other independent variables specific to the research questions addressed. Search outcomes, time, and search paths frequently are treated as dependent variables. We discuss each of these sets of variables, illustrating them with sample results from the literature and from our own research. Our examples are drawn from the Science Library Catalog project, a 7-year study of children's searching behavior on an experimental retrieval system. We close with a brief discussion of the implications of these results for the design of information retrieval systems

Theme

OPAC
Benutzerstudien

Similar documents (author)

1. Hirsh, S.G.; Borgman, C.L.: Comparing children's use of browsing and keyword searching on the Science Library catalog (1995) 3.20

   3.2046852 = sum of:
     3.2046852 = product of:
       4.807028 = sum of:
         1.7583215 = weight(author_txt:borgman in 3891) [ClassicSimilarity], result of:
           1.7583215 = score(doc=3891,freq=1.0), product of:
             0.43996957 = queryWeight, product of:
               7.9929233 = idf(docFreq=39, maxDocs=43556)
               0.05504489 = queryNorm
             3.9964616 = fieldWeight in 3891, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.9929233 = idf(docFreq=39, maxDocs=43556)
               0.5 = fieldNorm(doc=3891)
         3.048706 = weight(author_txt:hirsh in 3891) [ClassicSimilarity], result of:
           3.048706 = score(doc=3891,freq=1.0), product of:
             0.6349909 = queryWeight, product of:
               1.201358 = boost
               9.602362 = idf(docFreq=7, maxDocs=43556)
               0.05504489 = queryNorm
             4.801181 = fieldWeight in 3891, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.602362 = idf(docFreq=7, maxDocs=43556)
               0.5 = fieldNorm(doc=3891)
       0.6666667 = coord(2/3)
   

2. Borgman, C.L.; Hirsh, S.G.; Walter, V.A.; Gallagher, A.L.: Childrens searching behavior on browsing and keyword online catalogs : the Science Library Catalog project (1995) 2.00

   2.0029283 = sum of:
     2.0029283 = product of:
       3.0043921 = sum of:
         1.0989509 = weight(author_txt:borgman in 2657) [ClassicSimilarity], result of:
           1.0989509 = score(doc=2657,freq=1.0), product of:
             0.43996957 = queryWeight, product of:
               7.9929233 = idf(docFreq=39, maxDocs=43556)
               0.05504489 = queryNorm
             2.4977884 = fieldWeight in 2657, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.9929233 = idf(docFreq=39, maxDocs=43556)
               0.3125 = fieldNorm(doc=2657)
         1.9054413 = weight(author_txt:hirsh in 2657) [ClassicSimilarity], result of:
           1.9054413 = score(doc=2657,freq=1.0), product of:
             0.6349909 = queryWeight, product of:
               1.201358 = boost
               9.602362 = idf(docFreq=7, maxDocs=43556)
               0.05504489 = queryNorm
             3.0007381 = fieldWeight in 2657, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.602362 = idf(docFreq=7, maxDocs=43556)
               0.3125 = fieldNorm(doc=2657)
       0.6666667 = coord(2/3)
   

3. Hirsh, S.G.: Complexity of search tasks and children's information retrieval (1996) 1.27

   1.2702942 = sum of:
     1.2702942 = product of:
       3.8108826 = sum of:
         3.8108826 = weight(author_txt:hirsh in 4496) [ClassicSimilarity], result of:
           3.8108826 = score(doc=4496,freq=1.0), product of:
             0.6349909 = queryWeight, product of:
               1.201358 = boost
               9.602362 = idf(docFreq=7, maxDocs=43556)
               0.05504489 = queryNorm
             6.0014763 = fieldWeight in 4496, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.602362 = idf(docFreq=7, maxDocs=43556)
               0.625 = fieldNorm(doc=4496)
       0.33333334 = coord(1/3)
   

4. Hirsh, S.G.: Children's relevance criteria and information seeking on electronic resources (1999) 1.27

   1.2702942 = sum of:
     1.2702942 = product of:
       3.8108826 = sum of:
         3.8108826 = weight(author_txt:hirsh in 5295) [ClassicSimilarity], result of:
           3.8108826 = score(doc=5295,freq=1.0), product of:
             0.6349909 = queryWeight, product of:
               1.201358 = boost
               9.602362 = idf(docFreq=7, maxDocs=43556)
               0.05504489 = queryNorm
             6.0014763 = fieldWeight in 5295, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.602362 = idf(docFreq=7, maxDocs=43556)
               0.625 = fieldNorm(doc=5295)
       0.33333334 = coord(1/3)
   

5. Hiller, H.: Wörterbuch des Buches (1991) 1.27

   1.2702942 = sum of:
     1.2702942 = product of:
       3.8108826 = sum of:
         3.8108826 = weight(author_txt:hiller in 1212) [ClassicSimilarity], result of:
           3.8108826 = score(doc=1212,freq=1.0), product of:
             0.6349909 = queryWeight, product of:
               1.201358 = boost
               9.602362 = idf(docFreq=7, maxDocs=43556)
               0.05504489 = queryNorm
             6.0014763 = fieldWeight in 1212, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.602362 = idf(docFreq=7, maxDocs=43556)
               0.625 = fieldNorm(doc=1212)
       0.33333334 = coord(1/3)
   

Similar documents (content)

1. Fidel, R.: What is missing in research about online searching behaviour? (1987) 0.56

   0.5617362 = sum of:
     0.5617362 = product of:
       1.4043405 = sum of:
         0.027656736 = weight(abstract_txt:these in 3394) [ClassicSimilarity], result of:
           0.027656736 = score(doc=3394,freq=2.0), product of:
             0.065144725 = queryWeight, product of:
               1.0083406 = boost
               3.2021039 = idf(docFreq=4815, maxDocs=43556)
               0.02017607 = queryNorm
             0.424543 = fieldWeight in 3394, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.2021039 = idf(docFreq=4815, maxDocs=43556)
               0.09375 = fieldNorm(doc=3394)
         0.029381797 = weight(abstract_txt:online in 3394) [ClassicSimilarity], result of:
           0.029381797 = score(doc=3394,freq=1.0), product of:
             0.08545566 = queryWeight, product of:
               1.1548831 = boost
               3.667467 = idf(docFreq=3023, maxDocs=43556)
               0.02017607 = queryNorm
             0.34382504 = fieldWeight in 3394, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.667467 = idf(docFreq=3023, maxDocs=43556)
               0.09375 = fieldNorm(doc=3394)
         0.069274426 = weight(abstract_txt:process in 3394) [ClassicSimilarity], result of:
           0.069274426 = score(doc=3394,freq=3.0), product of:
             0.10496153 = queryWeight, product of:
               1.2799196 = boost
               4.064535 = idf(docFreq=2032, maxDocs=43556)
               0.02017607 = queryNorm
             0.65999824 = fieldWeight in 3394, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.064535 = idf(docFreq=2032, maxDocs=43556)
               0.09375 = fieldNorm(doc=3394)
         0.10377952 = weight(abstract_txt:dependent in 3394) [ClassicSimilarity], result of:
           0.10377952 = score(doc=3394,freq=1.0), product of:
             0.17314075 = queryWeight, product of:
               1.3422136 = boost
               6.3935356 = idf(docFreq=197, maxDocs=43556)
               0.02017607 = queryNorm
             0.59939396 = fieldWeight in 3394, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.3935356 = idf(docFreq=197, maxDocs=43556)
               0.09375 = fieldNorm(doc=3394)
         0.065928295 = weight(abstract_txt:searching in 3394) [ClassicSimilarity], result of:
           0.065928295 = score(doc=3394,freq=2.0), product of:
             0.11625006 = queryWeight, product of:
               1.3469895 = boost
               4.2775235 = idf(docFreq=1642, maxDocs=43556)
               0.02017607 = queryNorm
             0.56712484 = fieldWeight in 3394, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.2775235 = idf(docFreq=1642, maxDocs=43556)
               0.09375 = fieldNorm(doc=3394)
         0.03745014 = weight(abstract_txt:data in 3394) [ClassicSimilarity], result of:
           0.03745014 = score(doc=3394,freq=1.0), product of:
             0.11910787 = queryWeight, product of:
               1.7602009 = boost
               3.3538349 = idf(docFreq=4137, maxDocs=43556)
               0.02017607 = queryNorm
             0.314422 = fieldWeight in 3394, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3538349 = idf(docFreq=4137, maxDocs=43556)
               0.09375 = fieldNorm(doc=3394)
         0.11731112 = weight(abstract_txt:independent in 3394) [ClassicSimilarity], result of:
           0.11731112 = score(doc=3394,freq=1.0), product of:
             0.21507078 = queryWeight, product of:
               1.8321385 = boost
               5.8181715 = idf(docFreq=351, maxDocs=43556)
               0.02017607 = queryNorm
             0.54545355 = fieldWeight in 3394, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.8181715 = idf(docFreq=351, maxDocs=43556)
               0.09375 = fieldNorm(doc=3394)
         0.05465322 = weight(abstract_txt:research in 3394) [ClassicSimilarity], result of:
           0.05465322 = score(doc=3394,freq=2.0), product of:
             0.12925057 = queryWeight, product of:
               2.008625 = boost
               3.1893122 = idf(docFreq=4877, maxDocs=43556)
               0.02017607 = queryNorm
             0.42284703 = fieldWeight in 3394, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.1893122 = idf(docFreq=4877, maxDocs=43556)
               0.09375 = fieldNorm(doc=3394)
         0.1733691 = weight(abstract_txt:search in 3394) [ClassicSimilarity], result of:
           0.1733691 = score(doc=3394,freq=5.0), product of:
             0.22629206 = queryWeight, product of:
               3.0689275 = boost
               3.6546526 = idf(docFreq=3062, maxDocs=43556)
               0.02017607 = queryNorm
             0.76612985 = fieldWeight in 3394, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.6546526 = idf(docFreq=3062, maxDocs=43556)
               0.09375 = fieldNorm(doc=3394)
         0.7255362 = weight(abstract_txt:variables in 3394) [ClassicSimilarity], result of:
           0.7255362 = score(doc=3394,freq=6.0), product of:
             0.5024439 = queryWeight, product of:
               3.9602847 = boost
               6.288175 = idf(docFreq=219, maxDocs=43556)
               0.02017607 = queryNorm
             1.4440144 = fieldWeight in 3394, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               6.288175 = idf(docFreq=219, maxDocs=43556)
               0.09375 = fieldNorm(doc=3394)
       0.4 = coord(10/25)
   

2. Hsieh-Yee, I.: Effects of search experience and subject knowledge on the search tactics of novice and experienced searchers (1993) 0.42

   0.41716266 = sum of:
     0.41716266 = product of:
       0.94809693 = sum of:
         0.01430624 = weight(abstract_txt:that in 3403) [ClassicSimilarity], result of:
           0.01430624 = score(doc=3403,freq=4.0), product of:
             0.04805361 = queryWeight, product of:
               2.3817132 = idf(docFreq=10938, maxDocs=43556)
               0.02017607 = queryNorm
             0.29771414 = fieldWeight in 3403, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.3817132 = idf(docFreq=10938, maxDocs=43556)
               0.0625 = fieldNorm(doc=3403)
         0.054119457 = weight(abstract_txt:questions in 3403) [ClassicSimilarity], result of:
           0.054119457 = score(doc=3403,freq=3.0), product of:
             0.10191722 = queryWeight, product of:
               1.0297831 = boost
               4.905296 = idf(docFreq=876, maxDocs=43556)
               0.02017607 = queryNorm
             0.53101385 = fieldWeight in 3403, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.905296 = idf(docFreq=876, maxDocs=43556)
               0.0625 = fieldNorm(doc=3403)
         0.01696538 = weight(abstract_txt:results in 3403) [ClassicSimilarity], result of:
           0.01696538 = score(doc=3403,freq=1.0), product of:
             0.07764709 = queryWeight, product of:
               1.1008552 = boost
               3.4958951 = idf(docFreq=3589, maxDocs=43556)
               0.02017607 = queryNorm
             0.21849345 = fieldWeight in 3403, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4958951 = idf(docFreq=3589, maxDocs=43556)
               0.0625 = fieldNorm(doc=3403)
         0.019587865 = weight(abstract_txt:online in 3403) [ClassicSimilarity], result of:
           0.019587865 = score(doc=3403,freq=1.0), product of:
             0.08545566 = queryWeight, product of:
               1.1548831 = boost
               3.667467 = idf(docFreq=3023, maxDocs=43556)
               0.02017607 = queryNorm
             0.2292167 = fieldWeight in 3403, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.667467 = idf(docFreq=3023, maxDocs=43556)
               0.0625 = fieldNorm(doc=3403)
         0.02666374 = weight(abstract_txt:process in 3403) [ClassicSimilarity], result of:
           0.02666374 = score(doc=3403,freq=1.0), product of:
             0.10496153 = queryWeight, product of:
               1.2799196 = boost
               4.064535 = idf(docFreq=2032, maxDocs=43556)
               0.02017607 = queryNorm
             0.25403345 = fieldWeight in 3403, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.064535 = idf(docFreq=2032, maxDocs=43556)
               0.0625 = fieldNorm(doc=3403)
         0.05700435 = weight(abstract_txt:behavior in 3403) [ClassicSimilarity], result of:
           0.05700435 = score(doc=3403,freq=1.0), product of:
             0.1741893 = queryWeight, product of:
               1.6488394 = boost
               5.236083 = idf(docFreq=629, maxDocs=43556)
               0.02017607 = queryNorm
             0.3272552 = fieldWeight in 3403, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.236083 = idf(docFreq=629, maxDocs=43556)
               0.0625 = fieldNorm(doc=3403)
         0.017018376 = weight(abstract_txt:from in 3403) [ClassicSimilarity], result of:
           0.017018376 = score(doc=3403,freq=1.0), product of:
             0.098032825 = queryWeight, product of:
               1.7493165 = boost
               2.77758 = idf(docFreq=7362, maxDocs=43556)
               0.02017607 = queryNorm
             0.17359875 = fieldWeight in 3403, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.77758 = idf(docFreq=7362, maxDocs=43556)
               0.0625 = fieldNorm(doc=3403)
         0.024966758 = weight(abstract_txt:data in 3403) [ClassicSimilarity], result of:
           0.024966758 = score(doc=3403,freq=1.0), product of:
             0.11910787 = queryWeight, product of:
               1.7602009 = boost
               3.3538349 = idf(docFreq=4137, maxDocs=43556)
               0.02017607 = queryNorm
             0.20961468 = fieldWeight in 3403, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3538349 = idf(docFreq=4137, maxDocs=43556)
               0.0625 = fieldNorm(doc=3403)
         0.25183952 = weight(abstract_txt:monitoring in 3403) [ClassicSimilarity], result of:
           0.25183952 = score(doc=3403,freq=2.0), product of:
             0.40970218 = queryWeight, product of:
               2.9199212 = boost
               6.954415 = idf(docFreq=112, maxDocs=43556)
               0.02017607 = queryNorm
             0.61468923 = fieldWeight in 3403, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.954415 = idf(docFreq=112, maxDocs=43556)
               0.0625 = fieldNorm(doc=3403)
         0.18636619 = weight(abstract_txt:search in 3403) [ClassicSimilarity], result of:
           0.18636619 = score(doc=3403,freq=13.0), product of:
             0.22629206 = queryWeight, product of:
               3.0689275 = boost
               3.6546526 = idf(docFreq=3062, maxDocs=43556)
               0.02017607 = queryNorm
             0.8235648 = fieldWeight in 3403, product of:
               3.6055512 = tf(freq=13.0), with freq of:
                 13.0 = termFreq=13.0
               3.6546526 = idf(docFreq=3062, maxDocs=43556)
               0.0625 = fieldNorm(doc=3403)
         0.27925903 = weight(abstract_txt:variables in 3403) [ClassicSimilarity], result of:
           0.27925903 = score(doc=3403,freq=2.0), product of:
             0.5024439 = queryWeight, product of:
               3.9602847 = boost
               6.288175 = idf(docFreq=219, maxDocs=43556)
               0.02017607 = queryNorm
             0.5558014 = fieldWeight in 3403, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.288175 = idf(docFreq=219, maxDocs=43556)
               0.0625 = fieldNorm(doc=3403)
       0.44 = coord(11/25)
   

3. Hildreth, C.R.: Are Web-based OPACs more effective retrieval systems than their conventional predecessors? : an experimental study (2000) 0.34

   0.33774403 = sum of:
     0.33774403 = product of:
       0.7036334 = sum of:
         0.010116039 = weight(abstract_txt:that in 1111) [ClassicSimilarity], result of:
           0.010116039 = score(doc=1111,freq=2.0), product of:
             0.04805361 = queryWeight, product of:
               2.3817132 = idf(docFreq=10938, maxDocs=43556)
               0.02017607 = queryNorm
             0.2105157 = fieldWeight in 1111, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3817132 = idf(docFreq=10938, maxDocs=43556)
               0.0625 = fieldNorm(doc=1111)
         0.0075525753 = weight(abstract_txt:information in 1111) [ClassicSimilarity], result of:
           0.0075525753 = score(doc=1111,freq=1.0), product of:
             0.04982635 = queryWeight, product of:
               1.0182784 = boost
               2.425247 = idf(docFreq=10472, maxDocs=43556)
               0.02017607 = queryNorm
             0.15157793 = fieldWeight in 1111, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.425247 = idf(docFreq=10472, maxDocs=43556)
               0.0625 = fieldNorm(doc=1111)
         0.031245884 = weight(abstract_txt:questions in 1111) [ClassicSimilarity], result of:
           0.031245884 = score(doc=1111,freq=1.0), product of:
             0.10191722 = queryWeight, product of:
               1.0297831 = boost
               4.905296 = idf(docFreq=876, maxDocs=43556)
               0.02017607 = queryNorm
             0.306581 = fieldWeight in 1111, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.905296 = idf(docFreq=876, maxDocs=43556)
               0.0625 = fieldNorm(doc=1111)
         0.022377884 = weight(abstract_txt:systems in 1111) [ClassicSimilarity], result of:
           0.022377884 = score(doc=1111,freq=2.0), product of:
             0.07412285 = queryWeight, product of:
               1.0755824 = boost
               3.4156382 = idf(docFreq=3889, maxDocs=43556)
               0.02017607 = queryNorm
             0.30190262 = fieldWeight in 1111, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4156382 = idf(docFreq=3889, maxDocs=43556)
               0.0625 = fieldNorm(doc=1111)
         0.037935745 = weight(abstract_txt:results in 1111) [ClassicSimilarity], result of:
           0.037935745 = score(doc=1111,freq=5.0), product of:
             0.07764709 = queryWeight, product of:
               1.1008552 = boost
               3.4958951 = idf(docFreq=3589, maxDocs=43556)
               0.02017607 = queryNorm
             0.48856622 = fieldWeight in 1111, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.4958951 = idf(docFreq=3589, maxDocs=43556)
               0.0625 = fieldNorm(doc=1111)
         0.059368424 = weight(abstract_txt:experimental in 1111) [ClassicSimilarity], result of:
           0.059368424 = score(doc=1111,freq=2.0), product of:
             0.124092646 = queryWeight, product of:
               1.1363052 = boost
               5.4127064 = idf(docFreq=527, maxDocs=43556)
               0.02017607 = queryNorm
             0.47842017 = fieldWeight in 1111, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.4127064 = idf(docFreq=527, maxDocs=43556)
               0.0625 = fieldNorm(doc=1111)
         0.069186345 = weight(abstract_txt:dependent in 1111) [ClassicSimilarity], result of:
           0.069186345 = score(doc=1111,freq=1.0), product of:
             0.17314075 = queryWeight, product of:
               1.3422136 = boost
               6.3935356 = idf(docFreq=197, maxDocs=43556)
               0.02017607 = queryNorm
             0.39959598 = fieldWeight in 1111, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.3935356 = idf(docFreq=197, maxDocs=43556)
               0.0625 = fieldNorm(doc=1111)
         0.017018376 = weight(abstract_txt:from in 1111) [ClassicSimilarity], result of:
           0.017018376 = score(doc=1111,freq=1.0), product of:
             0.098032825 = queryWeight, product of:
               1.7493165 = boost
               2.77758 = idf(docFreq=7362, maxDocs=43556)
               0.02017607 = queryNorm
             0.17359875 = fieldWeight in 1111, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.77758 = idf(docFreq=7362, maxDocs=43556)
               0.0625 = fieldNorm(doc=1111)
         0.039236248 = weight(abstract_txt:retrieval in 1111) [ClassicSimilarity], result of:
           0.039236248 = score(doc=1111,freq=2.0), product of:
             0.12778524 = queryWeight, product of:
               1.8231916 = boost
               3.4738557 = idf(docFreq=3669, maxDocs=43556)
               0.02017607 = queryNorm
             0.30704835 = fieldWeight in 1111, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4738557 = idf(docFreq=3669, maxDocs=43556)
               0.0625 = fieldNorm(doc=1111)
         0.025763776 = weight(abstract_txt:research in 1111) [ClassicSimilarity], result of:
           0.025763776 = score(doc=1111,freq=1.0), product of:
             0.12925057 = queryWeight, product of:
               2.008625 = boost
               3.1893122 = idf(docFreq=4877, maxDocs=43556)
               0.02017607 = queryNorm
             0.19933201 = fieldWeight in 1111, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.1893122 = idf(docFreq=4877, maxDocs=43556)
               0.0625 = fieldNorm(doc=1111)
         0.18636619 = weight(abstract_txt:search in 1111) [ClassicSimilarity], result of:
           0.18636619 = score(doc=1111,freq=13.0), product of:
             0.22629206 = queryWeight, product of:
               3.0689275 = boost
               3.6546526 = idf(docFreq=3062, maxDocs=43556)
               0.02017607 = queryNorm
             0.8235648 = fieldWeight in 1111, product of:
               3.6055512 = tf(freq=13.0), with freq of:
                 13.0 = termFreq=13.0
               3.6546526 = idf(docFreq=3062, maxDocs=43556)
               0.0625 = fieldNorm(doc=1111)
         0.19746596 = weight(abstract_txt:variables in 1111) [ClassicSimilarity], result of:
           0.19746596 = score(doc=1111,freq=1.0), product of:
             0.5024439 = queryWeight, product of:
               3.9602847 = boost
               6.288175 = idf(docFreq=219, maxDocs=43556)
               0.02017607 = queryNorm
             0.39301094 = fieldWeight in 1111, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.288175 = idf(docFreq=219, maxDocs=43556)
               0.0625 = fieldNorm(doc=1111)
       0.48 = coord(12/25)
   

4. Yi, M.: Information organization and retrieval using a topic maps-based ontology : results of a task-based evaluation (2008) 0.34

   0.33719802 = sum of:
     0.33719802 = product of:
       0.7024959 = sum of:
         0.012645049 = weight(abstract_txt:that in 4367) [ClassicSimilarity], result of:
           0.012645049 = score(doc=4367,freq=2.0), product of:
             0.04805361 = queryWeight, product of:
               2.3817132 = idf(docFreq=10938, maxDocs=43556)
               0.02017607 = queryNorm
             0.2631446 = fieldWeight in 4367, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3817132 = idf(docFreq=10938, maxDocs=43556)
               0.078125 = fieldNorm(doc=4367)
         0.016296888 = weight(abstract_txt:these in 4367) [ClassicSimilarity], result of:
           0.016296888 = score(doc=4367,freq=1.0), product of:
             0.065144725 = queryWeight, product of:
               1.0083406 = boost
               3.2021039 = idf(docFreq=4815, maxDocs=43556)
               0.02017607 = queryNorm
             0.25016436 = fieldWeight in 4367, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.2021039 = idf(docFreq=4815, maxDocs=43556)
               0.078125 = fieldNorm(doc=4367)
         0.023124944 = weight(abstract_txt:information in 4367) [ClassicSimilarity], result of:
           0.023124944 = score(doc=4367,freq=6.0), product of:
             0.04982635 = queryWeight, product of:
               1.0182784 = boost
               2.425247 = idf(docFreq=10472, maxDocs=43556)
               0.02017607 = queryNorm
             0.46411073 = fieldWeight in 4367, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               2.425247 = idf(docFreq=10472, maxDocs=43556)
               0.078125 = fieldNorm(doc=4367)
         0.027972355 = weight(abstract_txt:systems in 4367) [ClassicSimilarity], result of:
           0.027972355 = score(doc=4367,freq=2.0), product of:
             0.07412285 = queryWeight, product of:
               1.0755824 = boost
               3.4156382 = idf(docFreq=3889, maxDocs=43556)
               0.02017607 = queryNorm
             0.37737828 = fieldWeight in 4367, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4156382 = idf(docFreq=3889, maxDocs=43556)
               0.078125 = fieldNorm(doc=4367)
         0.029990839 = weight(abstract_txt:results in 4367) [ClassicSimilarity], result of:
           0.029990839 = score(doc=4367,freq=2.0), product of:
             0.07764709 = queryWeight, product of:
               1.1008552 = boost
               3.4958951 = idf(docFreq=3589, maxDocs=43556)
               0.02017607 = queryNorm
             0.3862455 = fieldWeight in 4367, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4958951 = idf(docFreq=3589, maxDocs=43556)
               0.078125 = fieldNorm(doc=4367)
         0.086482935 = weight(abstract_txt:dependent in 4367) [ClassicSimilarity], result of:
           0.086482935 = score(doc=4367,freq=1.0), product of:
             0.17314075 = queryWeight, product of:
               1.3422136 = boost
               6.3935356 = idf(docFreq=197, maxDocs=43556)
               0.02017607 = queryNorm
             0.49949497 = fieldWeight in 4367, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.3935356 = idf(docFreq=197, maxDocs=43556)
               0.078125 = fieldNorm(doc=4367)
         0.03884862 = weight(abstract_txt:searching in 4367) [ClassicSimilarity], result of:
           0.03884862 = score(doc=4367,freq=1.0), product of:
             0.11625006 = queryWeight, product of:
               1.3469895 = boost
               4.2775235 = idf(docFreq=1642, maxDocs=43556)
               0.02017607 = queryNorm
             0.33418152 = fieldWeight in 4367, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.2775235 = idf(docFreq=1642, maxDocs=43556)
               0.078125 = fieldNorm(doc=4367)
         0.047587324 = weight(abstract_txt:methods in 4367) [ClassicSimilarity], result of:
           0.047587324 = score(doc=4367,freq=1.0), product of:
             0.14648165 = queryWeight, product of:
               1.7459371 = boost
               4.1583214 = idf(docFreq=1850, maxDocs=43556)
               0.02017607 = queryNorm
             0.32486886 = fieldWeight in 4367, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1583214 = idf(docFreq=1850, maxDocs=43556)
               0.078125 = fieldNorm(doc=4367)
         0.02127297 = weight(abstract_txt:from in 4367) [ClassicSimilarity], result of:
           0.02127297 = score(doc=4367,freq=1.0), product of:
             0.098032825 = queryWeight, product of:
               1.7493165 = boost
               2.77758 = idf(docFreq=7362, maxDocs=43556)
               0.02017607 = queryNorm
             0.21699844 = fieldWeight in 4367, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.77758 = idf(docFreq=7362, maxDocs=43556)
               0.078125 = fieldNorm(doc=4367)
         0.060067993 = weight(abstract_txt:retrieval in 4367) [ClassicSimilarity], result of:
           0.060067993 = score(doc=4367,freq=3.0), product of:
             0.12778524 = queryWeight, product of:
               1.8231916 = boost
               3.4738557 = idf(docFreq=3669, maxDocs=43556)
               0.02017607 = queryNorm
             0.4700699 = fieldWeight in 4367, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4738557 = idf(docFreq=3669, maxDocs=43556)
               0.078125 = fieldNorm(doc=4367)
         0.09137354 = weight(abstract_txt:search in 4367) [ClassicSimilarity], result of:
           0.09137354 = score(doc=4367,freq=2.0), product of:
             0.22629206 = queryWeight, product of:
               3.0689275 = boost
               3.6546526 = idf(docFreq=3062, maxDocs=43556)
               0.02017607 = queryNorm
             0.40378588 = fieldWeight in 4367, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6546526 = idf(docFreq=3062, maxDocs=43556)
               0.078125 = fieldNorm(doc=4367)
         0.24683245 = weight(abstract_txt:variables in 4367) [ClassicSimilarity], result of:
           0.24683245 = score(doc=4367,freq=1.0), product of:
             0.5024439 = queryWeight, product of:
               3.9602847 = boost
               6.288175 = idf(docFreq=219, maxDocs=43556)
               0.02017607 = queryNorm
             0.4912637 = fieldWeight in 4367, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.288175 = idf(docFreq=219, maxDocs=43556)
               0.078125 = fieldNorm(doc=4367)
       0.48 = coord(12/25)
   

5. Markey, K.: Twenty-five years of end-user searching : part 2: future research directions (2007) 0.32

   0.3206868 = sum of:
     0.3206868 = product of:
       0.61670536 = sum of:
         0.012389567 = weight(abstract_txt:that in 2441) [ClassicSimilarity], result of:
           0.012389567 = score(doc=2441,freq=3.0), product of:
             0.04805361 = queryWeight, product of:
               2.3817132 = idf(docFreq=10938, maxDocs=43556)
               0.02017607 = queryNorm
             0.257828 = fieldWeight in 2441, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3817132 = idf(docFreq=10938, maxDocs=43556)
               0.0625 = fieldNorm(doc=2441)
         0.018437825 = weight(abstract_txt:these in 2441) [ClassicSimilarity], result of:
           0.018437825 = score(doc=2441,freq=2.0), product of:
             0.065144725 = queryWeight, product of:
               1.0083406 = boost
               3.2021039 = idf(docFreq=4815, maxDocs=43556)
               0.02017607 = queryNorm
             0.28302866 = fieldWeight in 2441, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.2021039 = idf(docFreq=4815, maxDocs=43556)
               0.0625 = fieldNorm(doc=2441)
         0.015105151 = weight(abstract_txt:information in 2441) [ClassicSimilarity], result of:
           0.015105151 = score(doc=2441,freq=4.0), product of:
             0.04982635 = queryWeight, product of:
               1.0182784 = boost
               2.425247 = idf(docFreq=10472, maxDocs=43556)
               0.02017607 = queryNorm
             0.30315587 = fieldWeight in 2441, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               2.425247 = idf(docFreq=10472, maxDocs=43556)
               0.0625 = fieldNorm(doc=2441)
         0.031245884 = weight(abstract_txt:questions in 2441) [ClassicSimilarity], result of:
           0.031245884 = score(doc=2441,freq=1.0), product of:
             0.10191722 = queryWeight, product of:
               1.0297831 = boost
               4.905296 = idf(docFreq=876, maxDocs=43556)
               0.02017607 = queryNorm
             0.306581 = fieldWeight in 2441, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.905296 = idf(docFreq=876, maxDocs=43556)
               0.0625 = fieldNorm(doc=2441)
         0.031647105 = weight(abstract_txt:systems in 2441) [ClassicSimilarity], result of:
           0.031647105 = score(doc=2441,freq=4.0), product of:
             0.07412285 = queryWeight, product of:
               1.0755824 = boost
               3.4156382 = idf(docFreq=3889, maxDocs=43556)
               0.02017607 = queryNorm
             0.42695478 = fieldWeight in 2441, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.4156382 = idf(docFreq=3889, maxDocs=43556)
               0.0625 = fieldNorm(doc=2441)
         0.03917573 = weight(abstract_txt:online in 2441) [ClassicSimilarity], result of:
           0.03917573 = score(doc=2441,freq=4.0), product of:
             0.08545566 = queryWeight, product of:
               1.1548831 = boost
               3.667467 = idf(docFreq=3023, maxDocs=43556)
               0.02017607 = queryNorm
             0.4584334 = fieldWeight in 2441, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.667467 = idf(docFreq=3023, maxDocs=43556)
               0.0625 = fieldNorm(doc=2441)
         0.02666374 = weight(abstract_txt:process in 2441) [ClassicSimilarity], result of:
           0.02666374 = score(doc=2441,freq=1.0), product of:
             0.10496153 = queryWeight, product of:
               1.2799196 = boost
               4.064535 = idf(docFreq=2032, maxDocs=43556)
               0.02017607 = queryNorm
             0.25403345 = fieldWeight in 2441, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.064535 = idf(docFreq=2032, maxDocs=43556)
               0.0625 = fieldNorm(doc=2441)
         0.05383023 = weight(abstract_txt:searching in 2441) [ClassicSimilarity], result of:
           0.05383023 = score(doc=2441,freq=3.0), product of:
             0.11625006 = queryWeight, product of:
               1.3469895 = boost
               4.2775235 = idf(docFreq=1642, maxDocs=43556)
               0.02017607 = queryNorm
             0.4630555 = fieldWeight in 2441, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.2775235 = idf(docFreq=1642, maxDocs=43556)
               0.0625 = fieldNorm(doc=2441)
         0.024966758 = weight(abstract_txt:data in 2441) [ClassicSimilarity], result of:
           0.024966758 = score(doc=2441,freq=1.0), product of:
             0.11910787 = queryWeight, product of:
               1.7602009 = boost
               3.3538349 = idf(docFreq=4137, maxDocs=43556)
               0.02017607 = queryNorm
             0.20961468 = fieldWeight in 2441, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3538349 = idf(docFreq=4137, maxDocs=43556)
               0.0625 = fieldNorm(doc=2441)
         0.04805439 = weight(abstract_txt:retrieval in 2441) [ClassicSimilarity], result of:
           0.04805439 = score(doc=2441,freq=3.0), product of:
             0.12778524 = queryWeight, product of:
               1.8231916 = boost
               3.4738557 = idf(docFreq=3669, maxDocs=43556)
               0.02017607 = queryNorm
             0.3760559 = fieldWeight in 2441, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.4738557 = idf(docFreq=3669, maxDocs=43556)
               0.0625 = fieldNorm(doc=2441)
         0.04462417 = weight(abstract_txt:research in 2441) [ClassicSimilarity], result of:
           0.04462417 = score(doc=2441,freq=3.0), product of:
             0.12925057 = queryWeight, product of:
               2.008625 = boost
               3.1893122 = idf(docFreq=4877, maxDocs=43556)
               0.02017607 = queryNorm
             0.34525317 = fieldWeight in 2441, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.1893122 = idf(docFreq=4877, maxDocs=43556)
               0.0625 = fieldNorm(doc=2441)
         0.07309883 = weight(abstract_txt:search in 2441) [ClassicSimilarity], result of:
           0.07309883 = score(doc=2441,freq=2.0), product of:
             0.22629206 = queryWeight, product of:
               3.0689275 = boost
               3.6546526 = idf(docFreq=3062, maxDocs=43556)
               0.02017607 = queryNorm
             0.3230287 = fieldWeight in 2441, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6546526 = idf(docFreq=3062, maxDocs=43556)
               0.0625 = fieldNorm(doc=2441)
         0.19746596 = weight(abstract_txt:variables in 2441) [ClassicSimilarity], result of:
           0.19746596 = score(doc=2441,freq=1.0), product of:
             0.5024439 = queryWeight, product of:
               3.9602847 = boost
               6.288175 = idf(docFreq=219, maxDocs=43556)
               0.02017607 = queryNorm
             0.39301094 = fieldWeight in 2441, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.288175 = idf(docFreq=219, maxDocs=43556)
               0.0625 = fieldNorm(doc=2441)
       0.52 = coord(13/25)