Document (#13455)

Author
Borgman, C.L.
Hirsh, S.G.
Hiller, J.
Title
Rethinking online monitoring methods for information retrieval systems : from search product to search process
Source
Journal of the American Society for Information Science. 47(1996) no.7, S.568-583
Year
1996
Abstract
Searching information retrieval systems is a highly interactive, iterative process that cannot be understood simply by comparing the output of a search session (the 'search product') to a query stated in advance. In this article, we examine evaluation goals and methods for studying information retrieval behavior, drawing examples from our own research and that of others. We limit our review to research that employs online monitoring, also known as transaction log analysis. Online monitoring is one of few methods that can capture detailed data on the search process at a reasonable cost; these data can be used to build quantitative models or to support qualitative interpretations of quatitative results. Monitoring is a data collection technique rather than a research design, and can be employed in experimental of field studies, whether alone or combined with other data collection methods. Based on the the research questions of interest, the researcher must determine what variables to collect from each data source, which to treat as independent varaibles to manipulate, and which to treat as dependent variables to observe effects. Studies of searching behavior often treat search task and searcher characteristics as independent variables and may manipulate other independent variables specific to the research questions addressed. Search outcomes, time, and search paths frequently are treated as dependent variables. We discuss each of these sets of variables, illustrating them with sample results from the literature and from our own research. Our examples are drawn from the Science Library Catalog project, a 7-year study of children's searching behavior on an experimental retrieval system. We close with a brief discussion of the implications of these results for the design of information retrieval systems
Theme
OPAC
Benutzerstudien

Similar documents (author)

  1. Hirsh, S.G.; Borgman, C.L.: Comparing children's use of browsing and keyword searching on the Science Library catalog (1995) 3.17 
    3.167424 = sum of:
  3.167424 = product of:
    4.751136 = sum of:
      1.7798758 = weight(author_txt:borgman in 3825) [ClassicSimilarity], result of:
        1.7798758 = score(doc=3825,freq=1.0), product of:
          0.44452396 = queryWeight, product of:
            8.008008 = idf(docFreq=39, maxDocs=44218)
            0.05550993 = queryNorm
          4.004004 = fieldWeight in 3825, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            8.008008 = idf(docFreq=39, maxDocs=44218)
            0.5 = fieldNorm(doc=3825)
      2.97126 = weight(author_txt:hirsh in 3825) [ClassicSimilarity], result of:
        2.97126 = score(doc=3825,freq=1.0), product of:
          0.6255507 = queryWeight, product of:
            1.1862704 = boost
            9.499662 = idf(docFreq=8, maxDocs=44218)
            0.05550993 = queryNorm
          4.749831 = fieldWeight in 3825, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.499662 = idf(docFreq=8, maxDocs=44218)
            0.5 = fieldNorm(doc=3825)
    0.6666667 = coord(2/3)
  2. Borgman, C.L.; Hirsh, S.G.; Walter, V.A.; Gallagher, A.L.: Childrens searching behavior on browsing and keyword online catalogs : the Science Library Catalog project (1995) 1.98 
    1.97964 = sum of:
  1.97964 = product of:
    2.96946 = sum of:
      1.1124223 = weight(author_txt:borgman in 2591) [ClassicSimilarity], result of:
        1.1124223 = score(doc=2591,freq=1.0), product of:
          0.44452396 = queryWeight, product of:
            8.008008 = idf(docFreq=39, maxDocs=44218)
            0.05550993 = queryNorm
          2.5025024 = fieldWeight in 2591, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            8.008008 = idf(docFreq=39, maxDocs=44218)
            0.3125 = fieldNorm(doc=2591)
      1.8570377 = weight(author_txt:hirsh in 2591) [ClassicSimilarity], result of:
        1.8570377 = score(doc=2591,freq=1.0), product of:
          0.6255507 = queryWeight, product of:
            1.1862704 = boost
            9.499662 = idf(docFreq=8, maxDocs=44218)
            0.05550993 = queryNorm
          2.9686446 = fieldWeight in 2591, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.499662 = idf(docFreq=8, maxDocs=44218)
            0.3125 = fieldNorm(doc=2591)
    0.6666667 = coord(2/3)
  3. Hiller, H.: Wörterbuch des Buches (1991) 1.28 
    1.2846482 = sum of:
  1.2846482 = product of:
    3.8539443 = sum of:
      3.8539443 = weight(author_txt:hiller in 89) [ClassicSimilarity], result of:
        3.8539443 = score(doc=89,freq=1.0), product of:
          0.6411589 = queryWeight, product of:
            1.2009785 = boost
            9.617446 = idf(docFreq=7, maxDocs=44218)
            0.05550993 = queryNorm
          6.010904 = fieldWeight in 89, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.617446 = idf(docFreq=7, maxDocs=44218)
            0.625 = fieldNorm(doc=89)
    0.33333334 = coord(1/3)
  4. Hirsh, S.G.: Complexity of search tasks and children's information retrieval (1996) 1.24 
    1.2380252 = sum of:
  1.2380252 = product of:
    3.7140753 = sum of:
      3.7140753 = weight(author_txt:hirsh in 4430) [ClassicSimilarity], result of:
        3.7140753 = score(doc=4430,freq=1.0), product of:
          0.6255507 = queryWeight, product of:
            1.1862704 = boost
            9.499662 = idf(docFreq=8, maxDocs=44218)
            0.05550993 = queryNorm
          5.937289 = fieldWeight in 4430, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.499662 = idf(docFreq=8, maxDocs=44218)
            0.625 = fieldNorm(doc=4430)
    0.33333334 = coord(1/3)
  5. Hirsh, S.G.: Children's relevance criteria and information seeking on electronic resources (1999) 1.24 
    1.2380252 = sum of:
  1.2380252 = product of:
    3.7140753 = sum of:
      3.7140753 = weight(author_txt:hirsh in 4297) [ClassicSimilarity], result of:
        3.7140753 = score(doc=4297,freq=1.0), product of:
          0.6255507 = queryWeight, product of:
            1.1862704 = boost
            9.499662 = idf(docFreq=8, maxDocs=44218)
            0.05550993 = queryNorm
          5.937289 = fieldWeight in 4297, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.499662 = idf(docFreq=8, maxDocs=44218)
            0.625 = fieldNorm(doc=4297)
    0.33333334 = coord(1/3)

Similar documents (content)

  1. Fidel, R.: What is missing in research about online searching behaviour? (1987) 0.56 
    0.56233805 = sum of:
  0.56233805 = product of:
    1.4058452 = sum of:
      0.027436603 = weight(abstract_txt:these in 3328) [ClassicSimilarity], result of:
        0.027436603 = score(doc=3328,freq=2.0), product of:
          0.06490948 = queryWeight, product of:
            1.0091252 = boost
            3.1881294 = idf(docFreq=4957, maxDocs=44218)
            0.020175632 = queryNorm
          0.4226902 = fieldWeight in 3328, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.1881294 = idf(docFreq=4957, maxDocs=44218)
            0.09375 = fieldNorm(doc=3328)
      0.029501157 = weight(abstract_txt:online in 3328) [ClassicSimilarity], result of:
        0.029501157 = score(doc=3328,freq=1.0), product of:
          0.08583359 = queryWeight, product of:
            1.1604317 = boost
            3.6661522 = idf(docFreq=3073, maxDocs=44218)
            0.020175632 = queryNorm
          0.34370178 = fieldWeight in 3328, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.6661522 = idf(docFreq=3073, maxDocs=44218)
            0.09375 = fieldNorm(doc=3328)
      0.06893799 = weight(abstract_txt:process in 3328) [ClassicSimilarity], result of:
        0.06893799 = score(doc=3328,freq=3.0), product of:
          0.10480046 = queryWeight, product of:
            1.2822496 = boost
            4.0510116 = idf(docFreq=2091, maxDocs=44218)
            0.020175632 = queryNorm
          0.6578023 = fieldWeight in 3328, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            4.0510116 = idf(docFreq=2091, maxDocs=44218)
            0.09375 = fieldNorm(doc=3328)
      0.1048058 = weight(abstract_txt:dependent in 3328) [ClassicSimilarity], result of:
        0.1048058 = score(doc=3328,freq=1.0), product of:
          0.1745786 = queryWeight, product of:
            1.351266 = boost
            6.4035826 = idf(docFreq=198, maxDocs=44218)
            0.020175632 = queryNorm
          0.60033584 = fieldWeight in 3328, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.4035826 = idf(docFreq=198, maxDocs=44218)
            0.09375 = fieldNorm(doc=3328)
      0.06660274 = weight(abstract_txt:searching in 3328) [ClassicSimilarity], result of:
        0.06660274 = score(doc=3328,freq=2.0), product of:
          0.11724184 = queryWeight, product of:
            1.3562267 = boost
            4.284727 = idf(docFreq=1655, maxDocs=44218)
            0.020175632 = queryNorm
          0.56807995 = fieldWeight in 3328, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.284727 = idf(docFreq=1655, maxDocs=44218)
            0.09375 = fieldNorm(doc=3328)
      0.037057 = weight(abstract_txt:data in 3328) [ClassicSimilarity], result of:
        0.037057 = score(doc=3328,freq=1.0), product of:
          0.11847526 = queryWeight, product of:
            1.760067 = boost
            3.3363478 = idf(docFreq=4274, maxDocs=44218)
            0.020175632 = queryNorm
          0.31278262 = fieldWeight in 3328, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.3363478 = idf(docFreq=4274, maxDocs=44218)
            0.09375 = fieldNorm(doc=3328)
      0.11763461 = weight(abstract_txt:independent in 3328) [ClassicSimilarity], result of:
        0.11763461 = score(doc=3328,freq=1.0), product of:
          0.21583472 = queryWeight, product of:
            1.8401433 = boost
            5.813565 = idf(docFreq=358, maxDocs=44218)
            0.020175632 = queryNorm
          0.5450217 = fieldWeight in 3328, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.813565 = idf(docFreq=358, maxDocs=44218)
            0.09375 = fieldNorm(doc=3328)
      0.053959657 = weight(abstract_txt:research in 3328) [ClassicSimilarity], result of:
        0.053959657 = score(doc=3328,freq=2.0), product of:
          0.12837408 = queryWeight, product of:
            2.0069876 = boost
            3.170338 = idf(docFreq=5046, maxDocs=44218)
            0.020175632 = queryNorm
          0.4203314 = fieldWeight in 3328, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.170338 = idf(docFreq=5046, maxDocs=44218)
            0.09375 = fieldNorm(doc=3328)
      0.17474754 = weight(abstract_txt:search in 3328) [ClassicSimilarity], result of:
        0.17474754 = score(doc=3328,freq=5.0), product of:
          0.22787929 = queryWeight, product of:
            3.087648 = boost
            3.6580524 = idf(docFreq=3098, maxDocs=44218)
            0.020175632 = queryNorm
          0.7668426 = fieldWeight in 3328, product of:
            2.236068 = tf(freq=5.0), with freq of:
              5.0 = termFreq=5.0
            3.6580524 = idf(docFreq=3098, maxDocs=44218)
            0.09375 = fieldNorm(doc=3328)
      0.72516215 = weight(abstract_txt:variables in 3328) [ClassicSimilarity], result of:
        0.72516215 = score(doc=3328,freq=6.0), product of:
          0.5031308 = queryWeight, product of:
            3.973255 = boost
            6.2763524 = idf(docFreq=225, maxDocs=44218)
            0.020175632 = queryNorm
          1.4412994 = fieldWeight in 3328, product of:
            2.4494898 = tf(freq=6.0), with freq of:
              6.0 = termFreq=6.0
            6.2763524 = idf(docFreq=225, maxDocs=44218)
            0.09375 = fieldNorm(doc=3328)
    0.4 = coord(10/25)
  2. Hsieh-Yee, I.: Effects of search experience and subject knowledge on the search tactics of novice and experienced searchers (1993) 0.42 
    0.41717297 = sum of:
  0.41717297 = product of:
    0.94812036 = sum of:
      0.01415929 = weight(abstract_txt:that in 2405) [ClassicSimilarity], result of:
        0.01415929 = score(doc=2405,freq=4.0), product of:
          0.04780566 = queryWeight, product of:
            2.3694751 = idf(docFreq=11241, maxDocs=44218)
            0.020175632 = queryNorm
          0.2961844 = fieldWeight in 2405, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            2.3694751 = idf(docFreq=11241, maxDocs=44218)
            0.0625 = fieldNorm(doc=2405)
      0.054039173 = weight(abstract_txt:questions in 2405) [ClassicSimilarity], result of:
        0.054039173 = score(doc=2405,freq=3.0), product of:
          0.101990655 = queryWeight, product of:
            1.0328221 = boost
            4.8944926 = idf(docFreq=899, maxDocs=44218)
            0.020175632 = queryNorm
          0.52984434 = fieldWeight in 2405, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            4.8944926 = idf(docFreq=899, maxDocs=44218)
            0.0625 = fieldNorm(doc=2405)
      0.016856233 = weight(abstract_txt:results in 2405) [ClassicSimilarity], result of:
        0.016856233 = score(doc=2405,freq=1.0), product of:
          0.07744601 = queryWeight, product of:
            1.1022764 = boost
            3.482422 = idf(docFreq=3693, maxDocs=44218)
            0.020175632 = queryNorm
          0.21765138 = fieldWeight in 2405, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.482422 = idf(docFreq=3693, maxDocs=44218)
            0.0625 = fieldNorm(doc=2405)
      0.019667437 = weight(abstract_txt:online in 2405) [ClassicSimilarity], result of:
        0.019667437 = score(doc=2405,freq=1.0), product of:
          0.08583359 = queryWeight, product of:
            1.1604317 = boost
            3.6661522 = idf(docFreq=3073, maxDocs=44218)
            0.020175632 = queryNorm
          0.22913451 = fieldWeight in 2405, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.6661522 = idf(docFreq=3073, maxDocs=44218)
            0.0625 = fieldNorm(doc=2405)
      0.026534243 = weight(abstract_txt:process in 2405) [ClassicSimilarity], result of:
        0.026534243 = score(doc=2405,freq=1.0), product of:
          0.10480046 = queryWeight, product of:
            1.2822496 = boost
            4.0510116 = idf(docFreq=2091, maxDocs=44218)
            0.020175632 = queryNorm
          0.25318822 = fieldWeight in 2405, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.0510116 = idf(docFreq=2091, maxDocs=44218)
            0.0625 = fieldNorm(doc=2405)
      0.056419622 = weight(abstract_txt:behavior in 2405) [ClassicSimilarity], result of:
        0.056419622 = score(doc=2405,freq=1.0), product of:
          0.17329213 = queryWeight, product of:
            1.6488471 = boost
            5.2092032 = idf(docFreq=656, maxDocs=44218)
            0.020175632 = queryNorm
          0.3255752 = fieldWeight in 2405, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.2092032 = idf(docFreq=656, maxDocs=44218)
            0.0625 = fieldNorm(doc=2405)
      0.01685408 = weight(abstract_txt:from in 2405) [ClassicSimilarity], result of:
        0.01685408 = score(doc=2405,freq=1.0), product of:
          0.09756756 = queryWeight, product of:
            1.7496803 = boost
            2.7638826 = idf(docFreq=7577, maxDocs=44218)
            0.020175632 = queryNorm
          0.17274266 = fieldWeight in 2405, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            2.7638826 = idf(docFreq=7577, maxDocs=44218)
            0.0625 = fieldNorm(doc=2405)
      0.024704667 = weight(abstract_txt:data in 2405) [ClassicSimilarity], result of:
        0.024704667 = score(doc=2405,freq=1.0), product of:
          0.11847526 = queryWeight, product of:
            1.760067 = boost
            3.3363478 = idf(docFreq=4274, maxDocs=44218)
            0.020175632 = queryNorm
          0.20852174 = fieldWeight in 2405, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.3363478 = idf(docFreq=4274, maxDocs=44218)
            0.0625 = fieldNorm(doc=2405)
      0.25192264 = weight(abstract_txt:monitoring in 2405) [ClassicSimilarity], result of:
        0.25192264 = score(doc=2405,freq=2.0), product of:
          0.41049364 = queryWeight, product of:
            2.93031 = boost
            6.943297 = idf(docFreq=115, maxDocs=44218)
            0.020175632 = queryNorm
          0.6137065 = fieldWeight in 2405, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            6.943297 = idf(docFreq=115, maxDocs=44218)
            0.0625 = fieldNorm(doc=2405)
      0.18784796 = weight(abstract_txt:search in 2405) [ClassicSimilarity], result of:
        0.18784796 = score(doc=2405,freq=13.0), product of:
          0.22787929 = queryWeight, product of:
            3.087648 = boost
            3.6580524 = idf(docFreq=3098, maxDocs=44218)
            0.020175632 = queryNorm
          0.824331 = fieldWeight in 2405, product of:
            3.6055512 = tf(freq=13.0), with freq of:
              13.0 = termFreq=13.0
            3.6580524 = idf(docFreq=3098, maxDocs=44218)
            0.0625 = fieldNorm(doc=2405)
      0.27911502 = weight(abstract_txt:variables in 2405) [ClassicSimilarity], result of:
        0.27911502 = score(doc=2405,freq=2.0), product of:
          0.5031308 = queryWeight, product of:
            3.973255 = boost
            6.2763524 = idf(docFreq=225, maxDocs=44218)
            0.020175632 = queryNorm
          0.5547564 = fieldWeight in 2405, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            6.2763524 = idf(docFreq=225, maxDocs=44218)
            0.0625 = fieldNorm(doc=2405)
    0.44 = coord(11/25)
  3. Hildreth, C.R.: Are Web-based OPACs more effective retrieval systems than their conventional predecessors? : an experimental study (2000) 0.34 
    0.33835927 = sum of:
  0.33835927 = product of:
    0.70491517 = sum of:
      0.01001213 = weight(abstract_txt:that in 113) [ClassicSimilarity], result of:
        0.01001213 = score(doc=113,freq=2.0), product of:
          0.04780566 = queryWeight, product of:
            2.3694751 = idf(docFreq=11241, maxDocs=44218)
            0.020175632 = queryNorm
          0.20943399 = fieldWeight in 113, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            2.3694751 = idf(docFreq=11241, maxDocs=44218)
            0.0625 = fieldNorm(doc=113)
      0.007551105 = weight(abstract_txt:information in 113) [ClassicSimilarity], result of:
        0.007551105 = score(doc=113,freq=1.0), product of:
          0.049905147 = queryWeight, product of:
            1.0217227 = boost
            2.4209464 = idf(docFreq=10677, maxDocs=44218)
            0.020175632 = queryNorm
          0.15130915 = fieldWeight in 113, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            2.4209464 = idf(docFreq=10677, maxDocs=44218)
            0.0625 = fieldNorm(doc=113)
      0.031199532 = weight(abstract_txt:questions in 113) [ClassicSimilarity], result of:
        0.031199532 = score(doc=113,freq=1.0), product of:
          0.101990655 = queryWeight, product of:
            1.0328221 = boost
            4.8944926 = idf(docFreq=899, maxDocs=44218)
            0.020175632 = queryNorm
          0.3059058 = fieldWeight in 113, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.8944926 = idf(docFreq=899, maxDocs=44218)
            0.0625 = fieldNorm(doc=113)
      0.022418777 = weight(abstract_txt:systems in 113) [ClassicSimilarity], result of:
        0.022418777 = score(doc=113,freq=2.0), product of:
          0.074340135 = queryWeight, product of:
            1.0799475 = boost
            3.4118783 = idf(docFreq=3963, maxDocs=44218)
            0.020175632 = queryNorm
          0.3015703 = fieldWeight in 113, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.4118783 = idf(docFreq=3963, maxDocs=44218)
            0.0625 = fieldNorm(doc=113)
      0.03769168 = weight(abstract_txt:results in 113) [ClassicSimilarity], result of:
        0.03769168 = score(doc=113,freq=5.0), product of:
          0.07744601 = queryWeight, product of:
            1.1022764 = boost
            3.482422 = idf(docFreq=3693, maxDocs=44218)
            0.020175632 = queryNorm
          0.48668328 = fieldWeight in 113, product of:
            2.236068 = tf(freq=5.0), with freq of:
              5.0 = termFreq=5.0
            3.482422 = idf(docFreq=3693, maxDocs=44218)
            0.0625 = fieldNorm(doc=113)
      0.059186637 = weight(abstract_txt:experimental in 113) [ClassicSimilarity], result of:
        0.059186637 = score(doc=113,freq=2.0), product of:
          0.124051146 = queryWeight, product of:
            1.1390578 = boost
            5.397938 = idf(docFreq=543, maxDocs=44218)
            0.020175632 = queryNorm
          0.4771148 = fieldWeight in 113, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.397938 = idf(docFreq=543, maxDocs=44218)
            0.0625 = fieldNorm(doc=113)
      0.06987053 = weight(abstract_txt:dependent in 113) [ClassicSimilarity], result of:
        0.06987053 = score(doc=113,freq=1.0), product of:
          0.1745786 = queryWeight, product of:
            1.351266 = boost
            6.4035826 = idf(docFreq=198, maxDocs=44218)
            0.020175632 = queryNorm
          0.4002239 = fieldWeight in 113, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.4035826 = idf(docFreq=198, maxDocs=44218)
            0.0625 = fieldNorm(doc=113)
      0.01685408 = weight(abstract_txt:from in 113) [ClassicSimilarity], result of:
        0.01685408 = score(doc=113,freq=1.0), product of:
          0.09756756 = queryWeight, product of:
            1.7496803 = boost
            2.7638826 = idf(docFreq=7577, maxDocs=44218)
            0.020175632 = queryNorm
          0.17274266 = fieldWeight in 113, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            2.7638826 = idf(docFreq=7577, maxDocs=44218)
            0.0625 = fieldNorm(doc=113)
      0.039481778 = weight(abstract_txt:retrieval in 113) [ClassicSimilarity], result of:
        0.039481778 = score(doc=113,freq=2.0), product of:
          0.12853739 = queryWeight, product of:
            1.8332853 = boost
            3.4751394 = idf(docFreq=3720, maxDocs=44218)
            0.020175632 = queryNorm
          0.3071618 = fieldWeight in 113, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.4751394 = idf(docFreq=3720, maxDocs=44218)
            0.0625 = fieldNorm(doc=113)
      0.025436826 = weight(abstract_txt:research in 113) [ClassicSimilarity], result of:
        0.025436826 = score(doc=113,freq=1.0), product of:
          0.12837408 = queryWeight, product of:
            2.0069876 = boost
            3.170338 = idf(docFreq=5046, maxDocs=44218)
            0.020175632 = queryNorm
          0.19814612 = fieldWeight in 113, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.170338 = idf(docFreq=5046, maxDocs=44218)
            0.0625 = fieldNorm(doc=113)
      0.18784796 = weight(abstract_txt:search in 113) [ClassicSimilarity], result of:
        0.18784796 = score(doc=113,freq=13.0), product of:
          0.22787929 = queryWeight, product of:
            3.087648 = boost
            3.6580524 = idf(docFreq=3098, maxDocs=44218)
            0.020175632 = queryNorm
          0.824331 = fieldWeight in 113, product of:
            3.6055512 = tf(freq=13.0), with freq of:
              13.0 = termFreq=13.0
            3.6580524 = idf(docFreq=3098, maxDocs=44218)
            0.0625 = fieldNorm(doc=113)
      0.19736414 = weight(abstract_txt:variables in 113) [ClassicSimilarity], result of:
        0.19736414 = score(doc=113,freq=1.0), product of:
          0.5031308 = queryWeight, product of:
            3.973255 = boost
            6.2763524 = idf(docFreq=225, maxDocs=44218)
            0.020175632 = queryNorm
          0.39227203 = fieldWeight in 113, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.2763524 = idf(docFreq=225, maxDocs=44218)
            0.0625 = fieldNorm(doc=113)
    0.48 = coord(12/25)
  4. Yi, M.: Information organization and retrieval using a topic maps-based ontology : results of a task-based evaluation (2008) 0.34 
    0.3379003 = sum of:
  0.3379003 = product of:
    0.703959 = sum of:
      0.012515162 = weight(abstract_txt:that in 2369) [ClassicSimilarity], result of:
        0.012515162 = score(doc=2369,freq=2.0), product of:
          0.04780566 = queryWeight, product of:
            2.3694751 = idf(docFreq=11241, maxDocs=44218)
            0.020175632 = queryNorm
          0.26179248 = fieldWeight in 2369, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            2.3694751 = idf(docFreq=11241, maxDocs=44218)
            0.078125 = fieldNorm(doc=2369)
      0.016167173 = weight(abstract_txt:these in 2369) [ClassicSimilarity], result of:
        0.016167173 = score(doc=2369,freq=1.0), product of:
          0.06490948 = queryWeight, product of:
            1.0091252 = boost
            3.1881294 = idf(docFreq=4957, maxDocs=44218)
            0.020175632 = queryNorm
          0.24907261 = fieldWeight in 2369, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.1881294 = idf(docFreq=4957, maxDocs=44218)
            0.078125 = fieldNorm(doc=2369)
      0.023120444 = weight(abstract_txt:information in 2369) [ClassicSimilarity], result of:
        0.023120444 = score(doc=2369,freq=6.0), product of:
          0.049905147 = queryWeight, product of:
            1.0217227 = boost
            2.4209464 = idf(docFreq=10677, maxDocs=44218)
            0.020175632 = queryNorm
          0.46328777 = fieldWeight in 2369, product of:
            2.4494898 = tf(freq=6.0), with freq of:
              6.0 = termFreq=6.0
            2.4209464 = idf(docFreq=10677, maxDocs=44218)
            0.078125 = fieldNorm(doc=2369)
      0.02802347 = weight(abstract_txt:systems in 2369) [ClassicSimilarity], result of:
        0.02802347 = score(doc=2369,freq=2.0), product of:
          0.074340135 = queryWeight, product of:
            1.0799475 = boost
            3.4118783 = idf(docFreq=3963, maxDocs=44218)
            0.020175632 = queryNorm
          0.37696287 = fieldWeight in 2369, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.4118783 = idf(docFreq=3963, maxDocs=44218)
            0.078125 = fieldNorm(doc=2369)
      0.02979789 = weight(abstract_txt:results in 2369) [ClassicSimilarity], result of:
        0.02979789 = score(doc=2369,freq=2.0), product of:
          0.07744601 = queryWeight, product of:
            1.1022764 = boost
            3.482422 = idf(docFreq=3693, maxDocs=44218)
            0.020175632 = queryNorm
          0.38475692 = fieldWeight in 2369, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.482422 = idf(docFreq=3693, maxDocs=44218)
            0.078125 = fieldNorm(doc=2369)
      0.08733817 = weight(abstract_txt:dependent in 2369) [ClassicSimilarity], result of:
        0.08733817 = score(doc=2369,freq=1.0), product of:
          0.1745786 = queryWeight, product of:
            1.351266 = boost
            6.4035826 = idf(docFreq=198, maxDocs=44218)
            0.020175632 = queryNorm
          0.5002799 = fieldWeight in 2369, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.4035826 = idf(docFreq=198, maxDocs=44218)
            0.078125 = fieldNorm(doc=2369)
      0.039246038 = weight(abstract_txt:searching in 2369) [ClassicSimilarity], result of:
        0.039246038 = score(doc=2369,freq=1.0), product of:
          0.11724184 = queryWeight, product of:
            1.3562267 = boost
            4.284727 = idf(docFreq=1655, maxDocs=44218)
            0.020175632 = queryNorm
          0.3347443 = fieldWeight in 2369, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.284727 = idf(docFreq=1655, maxDocs=44218)
            0.078125 = fieldNorm(doc=2369)
      0.0210676 = weight(abstract_txt:from in 2369) [ClassicSimilarity], result of:
        0.0210676 = score(doc=2369,freq=1.0), product of:
          0.09756756 = queryWeight, product of:
            1.7496803 = boost
            2.7638826 = idf(docFreq=7577, maxDocs=44218)
            0.020175632 = queryNorm
          0.21592833 = fieldWeight in 2369, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            2.7638826 = idf(docFreq=7577, maxDocs=44218)
            0.078125 = fieldNorm(doc=2369)
      0.047433935 = weight(abstract_txt:methods in 2369) [ClassicSimilarity], result of:
        0.047433935 = score(doc=2369,freq=1.0), product of:
          0.14641686 = queryWeight, product of:
            1.7500719 = boost
            4.146752 = idf(docFreq=1900, maxDocs=44218)
            0.020175632 = queryNorm
          0.32396498 = fieldWeight in 2369, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.146752 = idf(docFreq=1900, maxDocs=44218)
            0.078125 = fieldNorm(doc=2369)
      0.06044388 = weight(abstract_txt:retrieval in 2369) [ClassicSimilarity], result of:
        0.06044388 = score(doc=2369,freq=3.0), product of:
          0.12853739 = queryWeight, product of:
            1.8332853 = boost
            3.4751394 = idf(docFreq=3720, maxDocs=44218)
            0.020175632 = queryNorm
          0.47024357 = fieldWeight in 2369, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            3.4751394 = idf(docFreq=3720, maxDocs=44218)
            0.078125 = fieldNorm(doc=2369)
      0.09210004 = weight(abstract_txt:search in 2369) [ClassicSimilarity], result of:
        0.09210004 = score(doc=2369,freq=2.0), product of:
          0.22787929 = queryWeight, product of:
            3.087648 = boost
            3.6580524 = idf(docFreq=3098, maxDocs=44218)
            0.020175632 = queryNorm
          0.4041615 = fieldWeight in 2369, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.6580524 = idf(docFreq=3098, maxDocs=44218)
            0.078125 = fieldNorm(doc=2369)
      0.24670516 = weight(abstract_txt:variables in 2369) [ClassicSimilarity], result of:
        0.24670516 = score(doc=2369,freq=1.0), product of:
          0.5031308 = queryWeight, product of:
            3.973255 = boost
            6.2763524 = idf(docFreq=225, maxDocs=44218)
            0.020175632 = queryNorm
          0.49034002 = fieldWeight in 2369, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.2763524 = idf(docFreq=225, maxDocs=44218)
            0.078125 = fieldNorm(doc=2369)
    0.48 = coord(12/25)
  5. Markey, K.: Twenty-five years of end-user searching : part 2: future research directions (2007) 0.32 
    0.32082537 = sum of:
  0.32082537 = product of:
    0.6169719 = sum of:
      0.012262304 = weight(abstract_txt:that in 443) [ClassicSimilarity], result of:
        0.012262304 = score(doc=443,freq=3.0), product of:
          0.04780566 = queryWeight, product of:
            2.3694751 = idf(docFreq=11241, maxDocs=44218)
            0.020175632 = queryNorm
          0.2565032 = fieldWeight in 443, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            2.3694751 = idf(docFreq=11241, maxDocs=44218)
            0.0625 = fieldNorm(doc=443)
      0.018291067 = weight(abstract_txt:these in 443) [ClassicSimilarity], result of:
        0.018291067 = score(doc=443,freq=2.0), product of:
          0.06490948 = queryWeight, product of:
            1.0091252 = boost
            3.1881294 = idf(docFreq=4957, maxDocs=44218)
            0.020175632 = queryNorm
          0.28179348 = fieldWeight in 443, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.1881294 = idf(docFreq=4957, maxDocs=44218)
            0.0625 = fieldNorm(doc=443)
      0.01510221 = weight(abstract_txt:information in 443) [ClassicSimilarity], result of:
        0.01510221 = score(doc=443,freq=4.0), product of:
          0.049905147 = queryWeight, product of:
            1.0217227 = boost
            2.4209464 = idf(docFreq=10677, maxDocs=44218)
            0.020175632 = queryNorm
          0.3026183 = fieldWeight in 443, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            2.4209464 = idf(docFreq=10677, maxDocs=44218)
            0.0625 = fieldNorm(doc=443)
      0.031199532 = weight(abstract_txt:questions in 443) [ClassicSimilarity], result of:
        0.031199532 = score(doc=443,freq=1.0), product of:
          0.101990655 = queryWeight, product of:
            1.0328221 = boost
            4.8944926 = idf(docFreq=899, maxDocs=44218)
            0.020175632 = queryNorm
          0.3059058 = fieldWeight in 443, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.8944926 = idf(docFreq=899, maxDocs=44218)
            0.0625 = fieldNorm(doc=443)
      0.031704936 = weight(abstract_txt:systems in 443) [ClassicSimilarity], result of:
        0.031704936 = score(doc=443,freq=4.0), product of:
          0.074340135 = queryWeight, product of:
            1.0799475 = boost
            3.4118783 = idf(docFreq=3963, maxDocs=44218)
            0.020175632 = queryNorm
          0.4264848 = fieldWeight in 443, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            3.4118783 = idf(docFreq=3963, maxDocs=44218)
            0.0625 = fieldNorm(doc=443)
      0.039334875 = weight(abstract_txt:online in 443) [ClassicSimilarity], result of:
        0.039334875 = score(doc=443,freq=4.0), product of:
          0.08583359 = queryWeight, product of:
            1.1604317 = boost
            3.6661522 = idf(docFreq=3073, maxDocs=44218)
            0.020175632 = queryNorm
          0.45826903 = fieldWeight in 443, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            3.6661522 = idf(docFreq=3073, maxDocs=44218)
            0.0625 = fieldNorm(doc=443)
      0.026534243 = weight(abstract_txt:process in 443) [ClassicSimilarity], result of:
        0.026534243 = score(doc=443,freq=1.0), product of:
          0.10480046 = queryWeight, product of:
            1.2822496 = boost
            4.0510116 = idf(docFreq=2091, maxDocs=44218)
            0.020175632 = queryNorm
          0.25318822 = fieldWeight in 443, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.0510116 = idf(docFreq=2091, maxDocs=44218)
            0.0625 = fieldNorm(doc=443)
      0.0543809 = weight(abstract_txt:searching in 443) [ClassicSimilarity], result of:
        0.0543809 = score(doc=443,freq=3.0), product of:
          0.11724184 = queryWeight, product of:
            1.3562267 = boost
            4.284727 = idf(docFreq=1655, maxDocs=44218)
            0.020175632 = queryNorm
          0.4638353 = fieldWeight in 443, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            4.284727 = idf(docFreq=1655, maxDocs=44218)
            0.0625 = fieldNorm(doc=443)
      0.024704667 = weight(abstract_txt:data in 443) [ClassicSimilarity], result of:
        0.024704667 = score(doc=443,freq=1.0), product of:
          0.11847526 = queryWeight, product of:
            1.760067 = boost
            3.3363478 = idf(docFreq=4274, maxDocs=44218)
            0.020175632 = queryNorm
          0.20852174 = fieldWeight in 443, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.3363478 = idf(docFreq=4274, maxDocs=44218)
            0.0625 = fieldNorm(doc=443)
      0.048355106 = weight(abstract_txt:retrieval in 443) [ClassicSimilarity], result of:
        0.048355106 = score(doc=443,freq=3.0), product of:
          0.12853739 = queryWeight, product of:
            1.8332853 = boost
            3.4751394 = idf(docFreq=3720, maxDocs=44218)
            0.020175632 = queryNorm
          0.37619486 = fieldWeight in 443, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            3.4751394 = idf(docFreq=3720, maxDocs=44218)
            0.0625 = fieldNorm(doc=443)
      0.044057876 = weight(abstract_txt:research in 443) [ClassicSimilarity], result of:
        0.044057876 = score(doc=443,freq=3.0), product of:
          0.12837408 = queryWeight, product of:
            2.0069876 = boost
            3.170338 = idf(docFreq=5046, maxDocs=44218)
            0.020175632 = queryNorm
          0.34319913 = fieldWeight in 443, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            3.170338 = idf(docFreq=5046, maxDocs=44218)
            0.0625 = fieldNorm(doc=443)
      0.07368003 = weight(abstract_txt:search in 443) [ClassicSimilarity], result of:
        0.07368003 = score(doc=443,freq=2.0), product of:
          0.22787929 = queryWeight, product of:
            3.087648 = boost
            3.6580524 = idf(docFreq=3098, maxDocs=44218)
            0.020175632 = queryNorm
          0.3233292 = fieldWeight in 443, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            3.6580524 = idf(docFreq=3098, maxDocs=44218)
            0.0625 = fieldNorm(doc=443)
      0.19736414 = weight(abstract_txt:variables in 443) [ClassicSimilarity], result of:
        0.19736414 = score(doc=443,freq=1.0), product of:
          0.5031308 = queryWeight, product of:
            3.973255 = boost
            6.2763524 = idf(docFreq=225, maxDocs=44218)
            0.020175632 = queryNorm
          0.39227203 = fieldWeight in 443, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.2763524 = idf(docFreq=225, maxDocs=44218)
            0.0625 = fieldNorm(doc=443)
    0.52 = coord(13/25)