Document (#32837)

Author
Ruthven, I.
Baillie, M.
Elsweiler, D.
Title
¬The relative effects of knowledge, interest and confidence in assessing relevance
Source
Journal of documentation. 63(2007) no.4, S.482-504
Year
2007
Abstract
Purpose - The purpose of this paper is to examine how different aspects of an assessor's context, in particular their knowledge of a search topic, their interest in the search topic and their confidence in assessing relevance for a topic, affect the relevance judgements made and the assessor's ability to predict which documents they will assess as being relevant. Design/methodology/approach - The study was conducted as part of the Text REtrieval Conference (TREC) HARD track. Using a specially constructed questionnaire information was sought on TREC assessors' personal context and, using the TREC assessments gathered, the responses were correlated to the questionnaire questions and the final relevance decisions. Findings - This study found that each of the three factors (interest, knowledge and confidence) had an affect on how many documents were assessed as relevant and the balance between how many documents were marked as marginally or highly relevant. Also these factors are shown to affect an assessors' ability to predict what information they will finally mark as being relevant. Research limitations/implications - The major limitation is that the research is conducted within the TREC initiative. This means that we can report on results but cannot report on discussions with the assessors. The research implications are numerous but mainly on the effect of personal context on the outcomes of a user study. Practical implications - One major consequence is that we should take more account of how we construct search tasks for IIR evaluation to create tasks that are interesting and relevant to experimental subjects. Originality/value - Examining different search variables within one study to compare the relative effects on these variables on the search outcomes.
Theme
Retrievalstudien

Similar documents (author)

  1. Elsweiler, D.; Ruthven, I.; Jones, C.: Towards memory supporting personal information management tools (2007) 2.50
    2.497901 = sum of:
      2.497901 = product of:
        3.7468514 = sum of:
          1.4172808 = weight(author_txt:ruthven in 58) [ClassicSimilarity], result of:
            1.4172808 = score(doc=58,freq=1.0), product of:
              0.45269606 = queryWeight, product of:
                8.348682 = idf(docFreq=26, maxDocs=41962)
                0.054223653 = queryNorm
              3.130756 = fieldWeight in 58, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.348682 = idf(docFreq=26, maxDocs=41962)
                0.375 = fieldNorm(doc=58)
          2.3295705 = weight(author_txt:elsweiler in 58) [ClassicSimilarity], result of:
            2.3295705 = score(doc=58,freq=1.0), product of:
              0.6305023 = queryWeight, product of:
                1.1801575 = boost
                9.85276 = idf(docFreq=5, maxDocs=41962)
                0.054223653 = queryNorm
              3.694785 = fieldWeight in 58, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                9.85276 = idf(docFreq=5, maxDocs=41962)
                0.375 = fieldNorm(doc=58)
        0.6666667 = coord(2/3)
    
  2. Baillie, M.; Azzopardi, L.; Ruthven, I.: Evaluating epistemic uncertainty under incomplete assessments (2008) 2.50
    2.497901 = sum of:
      2.497901 = product of:
        3.7468514 = sum of:
          1.4172808 = weight(author_txt:ruthven in 4066) [ClassicSimilarity], result of:
            1.4172808 = score(doc=4066,freq=1.0), product of:
              0.45269606 = queryWeight, product of:
                8.348682 = idf(docFreq=26, maxDocs=41962)
                0.054223653 = queryNorm
              3.130756 = fieldWeight in 4066, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.348682 = idf(docFreq=26, maxDocs=41962)
                0.375 = fieldNorm(doc=4066)
          2.3295705 = weight(author_txt:baillie in 4066) [ClassicSimilarity], result of:
            2.3295705 = score(doc=4066,freq=1.0), product of:
              0.6305023 = queryWeight, product of:
                1.1801575 = boost
                9.85276 = idf(docFreq=5, maxDocs=41962)
                0.054223653 = queryNorm
              3.694785 = fieldWeight in 4066, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                9.85276 = idf(docFreq=5, maxDocs=41962)
                0.375 = fieldNorm(doc=4066)
        0.6666667 = coord(2/3)
    
  3. Ruthven, I.; Baillie, M.; Azzopardi, L.; Bierig, R.; Nicol, E.; Sweeney, S.; Yaciki, M.: Contextual factors affecting the utility of surrogates within exploratory search (2008) 1.67
    1.6652673 = sum of:
      1.6652673 = product of:
        2.497901 = sum of:
          0.9448539 = weight(author_txt:ruthven in 4043) [ClassicSimilarity], result of:
            0.9448539 = score(doc=4043,freq=1.0), product of:
              0.45269606 = queryWeight, product of:
                8.348682 = idf(docFreq=26, maxDocs=41962)
                0.054223653 = queryNorm
              2.0871706 = fieldWeight in 4043, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.348682 = idf(docFreq=26, maxDocs=41962)
                0.25 = fieldNorm(doc=4043)
          1.553047 = weight(author_txt:baillie in 4043) [ClassicSimilarity], result of:
            1.553047 = score(doc=4043,freq=1.0), product of:
              0.6305023 = queryWeight, product of:
                1.1801575 = boost
                9.85276 = idf(docFreq=5, maxDocs=41962)
                0.054223653 = queryNorm
              2.46319 = fieldWeight in 4043, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                9.85276 = idf(docFreq=5, maxDocs=41962)
                0.25 = fieldNorm(doc=4043)
        0.6666667 = coord(2/3)
    
  4. Elsweiler, D.; Harvey, M.: Engaging and maintaining a sense of being informed : understanding the tasks motivating twitter search (2015) 1.04
    1.0353646 = sum of:
      1.0353646 = product of:
        3.106094 = sum of:
          3.106094 = weight(author_txt:elsweiler in 3636) [ClassicSimilarity], result of:
            3.106094 = score(doc=3636,freq=1.0), product of:
              0.6305023 = queryWeight, product of:
                1.1801575 = boost
                9.85276 = idf(docFreq=5, maxDocs=41962)
                0.054223653 = queryNorm
              4.92638 = fieldWeight in 3636, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                9.85276 = idf(docFreq=5, maxDocs=41962)
                0.5 = fieldNorm(doc=3636)
        0.33333334 = coord(1/3)
    
  5. Elsweiler, D.; Hammwöhner, R.: Information Behavior : ein zentrales Forschungsthema der Informationswissenschaft (2015) 1.04
    1.0353646 = sum of:
      1.0353646 = product of:
        3.106094 = sum of:
          3.106094 = weight(author_txt:elsweiler in 3714) [ClassicSimilarity], result of:
            3.106094 = score(doc=3714,freq=1.0), product of:
              0.6305023 = queryWeight, product of:
                1.1801575 = boost
                9.85276 = idf(docFreq=5, maxDocs=41962)
                0.054223653 = queryNorm
              4.92638 = fieldWeight in 3714, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                9.85276 = idf(docFreq=5, maxDocs=41962)
                0.5 = fieldNorm(doc=3714)
        0.33333334 = coord(1/3)
    

Similar documents (content)

  1. Chu, H.: Factors affecting relevance judgment : a report from TREC Legal track (2011) 0.49
    0.49470997 = sum of:
      0.49470997 = product of:
        1.2367749 = sum of:
          0.019936716 = weight(abstract_txt:were in 1541) [ClassicSimilarity], result of:
            0.019936716 = score(doc=1541,freq=1.0), product of:
              0.085971996 = queryWeight, product of:
                1.0274644 = boost
                3.7103646 = idf(docFreq=2790, maxDocs=41962)
                0.022551406 = queryNorm
              0.23189779 = fieldWeight in 1541, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.7103646 = idf(docFreq=2790, maxDocs=41962)
                0.0625 = fieldNorm(doc=1541)
          0.01581485 = weight(abstract_txt:that in 1541) [ClassicSimilarity], result of:
            0.01581485 = score(doc=1541,freq=3.0), product of:
              0.060562972 = queryWeight, product of:
                1.1133103 = boost
                2.4122221 = idf(docFreq=10221, maxDocs=41962)
                0.022551406 = queryNorm
              0.2611307 = fieldWeight in 1541, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                2.4122221 = idf(docFreq=10221, maxDocs=41962)
                0.0625 = fieldNorm(doc=1541)
          0.06314115 = weight(abstract_txt:questionnaire in 1541) [ClassicSimilarity], result of:
            0.06314115 = score(doc=1541,freq=1.0), product of:
              0.16196923 = queryWeight, product of:
                1.1514866 = boost
                6.237348 = idf(docFreq=222, maxDocs=41962)
                0.022551406 = queryNorm
              0.38983425 = fieldWeight in 1541, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.237348 = idf(docFreq=222, maxDocs=41962)
                0.0625 = fieldNorm(doc=1541)
          0.05203221 = weight(abstract_txt:implications in 1541) [ClassicSimilarity], result of:
            0.05203221 = score(doc=1541,freq=2.0), product of:
              0.12934792 = queryWeight, product of:
                1.2602828 = boost
                4.551115 = idf(docFreq=1203, maxDocs=41962)
                0.022551406 = queryNorm
              0.40226552 = fieldWeight in 1541, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.551115 = idf(docFreq=1203, maxDocs=41962)
                0.0625 = fieldNorm(doc=1541)
          0.044574376 = weight(abstract_txt:study in 1541) [ClassicSimilarity], result of:
            0.044574376 = score(doc=1541,freq=4.0), product of:
              0.10192272 = queryWeight, product of:
                1.2917937 = boost
                3.49868 = idf(docFreq=3448, maxDocs=41962)
                0.022551406 = queryNorm
              0.437335 = fieldWeight in 1541, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                3.49868 = idf(docFreq=3448, maxDocs=41962)
                0.0625 = fieldNorm(doc=1541)
          0.08486804 = weight(abstract_txt:affect in 1541) [ClassicSimilarity], result of:
            0.08486804 = score(doc=1541,freq=1.0), product of:
              0.22581393 = queryWeight, product of:
                1.6651894 = boost
                6.013308 = idf(docFreq=278, maxDocs=41962)
                0.022551406 = queryNorm
              0.37583175 = fieldWeight in 1541, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.013308 = idf(docFreq=278, maxDocs=41962)
                0.0625 = fieldNorm(doc=1541)
          0.031850044 = weight(abstract_txt:search in 1541) [ClassicSimilarity], result of:
            0.031850044 = score(doc=1541,freq=1.0), product of:
              0.13929778 = queryWeight, product of:
                1.6884366 = boost
                3.6583548 = idf(docFreq=2939, maxDocs=41962)
                0.022551406 = queryNorm
              0.22864717 = fieldWeight in 1541, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.6583548 = idf(docFreq=2939, maxDocs=41962)
                0.0625 = fieldNorm(doc=1541)
          0.20965034 = weight(abstract_txt:relevance in 1541) [ClassicSimilarity], result of:
            0.20965034 = score(doc=1541,freq=11.0), product of:
              0.20422095 = queryWeight, product of:
                1.8285539 = boost
                4.952436 = idf(docFreq=805, maxDocs=41962)
                0.022551406 = queryNorm
              1.0265858 = fieldWeight in 1541, product of:
                3.3166249 = tf(freq=11.0), with freq of:
                  11.0 = termFreq=11.0
                4.952436 = idf(docFreq=805, maxDocs=41962)
                0.0625 = fieldNorm(doc=1541)
          0.44517863 = weight(abstract_txt:assessors in 1541) [ClassicSimilarity], result of:
            0.44517863 = score(doc=1541,freq=3.0), product of:
              0.47268343 = queryWeight, product of:
                2.4092033 = boost
                8.700081 = idf(docFreq=18, maxDocs=41962)
                0.022551406 = queryNorm
              0.9418114 = fieldWeight in 1541, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                8.700081 = idf(docFreq=18, maxDocs=41962)
                0.0625 = fieldNorm(doc=1541)
          0.2697285 = weight(abstract_txt:trec in 1541) [ClassicSimilarity], result of:
            0.2697285 = score(doc=1541,freq=3.0), product of:
              0.37251604 = queryWeight, product of:
                2.46962 = boost
                6.6886926 = idf(docFreq=141, maxDocs=41962)
                0.022551406 = queryNorm
              0.7240722 = fieldWeight in 1541, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                6.6886926 = idf(docFreq=141, maxDocs=41962)
                0.0625 = fieldNorm(doc=1541)
        0.4 = coord(10/25)
    
  2. Ruthven, I.: Relevance behaviour in TREC (2014) 0.38
    0.3837682 = sum of:
      0.3837682 = product of:
        1.1992756 = sum of:
          0.024157584 = weight(abstract_txt:that in 3786) [ClassicSimilarity], result of:
            0.024157584 = score(doc=3786,freq=7.0), product of:
              0.060562972 = queryWeight, product of:
                1.1133103 = boost
                2.4122221 = idf(docFreq=10221, maxDocs=41962)
                0.022551406 = queryNorm
              0.39888373 = fieldWeight in 3786, product of:
                2.6457512 = tf(freq=7.0), with freq of:
                  7.0 = termFreq=7.0
                2.4122221 = idf(docFreq=10221, maxDocs=41962)
                0.0625 = fieldNorm(doc=3786)
          0.03679233 = weight(abstract_txt:implications in 3786) [ClassicSimilarity], result of:
            0.03679233 = score(doc=3786,freq=1.0), product of:
              0.12934792 = queryWeight, product of:
                1.2602828 = boost
                4.551115 = idf(docFreq=1203, maxDocs=41962)
                0.022551406 = queryNorm
              0.2844447 = fieldWeight in 3786, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.551115 = idf(docFreq=1203, maxDocs=41962)
                0.0625 = fieldNorm(doc=3786)
          0.0525963 = weight(abstract_txt:interest in 3786) [ClassicSimilarity], result of:
            0.0525963 = score(doc=3786,freq=1.0), product of:
              0.16414389 = queryWeight, product of:
                1.4197133 = boost
                5.126848 = idf(docFreq=676, maxDocs=41962)
                0.022551406 = queryNorm
              0.320428 = fieldWeight in 3786, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.126848 = idf(docFreq=676, maxDocs=41962)
                0.0625 = fieldNorm(doc=3786)
          0.12002154 = weight(abstract_txt:affect in 3786) [ClassicSimilarity], result of:
            0.12002154 = score(doc=3786,freq=2.0), product of:
              0.22581393 = queryWeight, product of:
                1.6651894 = boost
                6.013308 = idf(docFreq=278, maxDocs=41962)
                0.022551406 = queryNorm
              0.53150636 = fieldWeight in 3786, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                6.013308 = idf(docFreq=278, maxDocs=41962)
                0.0625 = fieldNorm(doc=3786)
          0.031850044 = weight(abstract_txt:search in 3786) [ClassicSimilarity], result of:
            0.031850044 = score(doc=3786,freq=1.0), product of:
              0.13929778 = queryWeight, product of:
                1.6884366 = boost
                3.6583548 = idf(docFreq=2939, maxDocs=41962)
                0.022551406 = queryNorm
              0.22864717 = fieldWeight in 3786, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.6583548 = idf(docFreq=2939, maxDocs=41962)
                0.0625 = fieldNorm(doc=3786)
          0.20965034 = weight(abstract_txt:relevance in 3786) [ClassicSimilarity], result of:
            0.20965034 = score(doc=3786,freq=11.0), product of:
              0.20422095 = queryWeight, product of:
                1.8285539 = boost
                4.952436 = idf(docFreq=805, maxDocs=41962)
                0.022551406 = queryNorm
              1.0265858 = fieldWeight in 3786, product of:
                3.3166249 = tf(freq=11.0), with freq of:
                  11.0 = termFreq=11.0
                4.952436 = idf(docFreq=805, maxDocs=41962)
                0.0625 = fieldNorm(doc=3786)
          0.257024 = weight(abstract_txt:assessors in 3786) [ClassicSimilarity], result of:
            0.257024 = score(doc=3786,freq=1.0), product of:
              0.47268343 = queryWeight, product of:
                2.4092033 = boost
                8.700081 = idf(docFreq=18, maxDocs=41962)
                0.022551406 = queryNorm
              0.54375505 = fieldWeight in 3786, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.700081 = idf(docFreq=18, maxDocs=41962)
                0.0625 = fieldNorm(doc=3786)
          0.4671835 = weight(abstract_txt:trec in 3786) [ClassicSimilarity], result of:
            0.4671835 = score(doc=3786,freq=9.0), product of:
              0.37251604 = queryWeight, product of:
                2.46962 = boost
                6.6886926 = idf(docFreq=141, maxDocs=41962)
                0.022551406 = queryNorm
              1.2541299 = fieldWeight in 3786, product of:
                3.0 = tf(freq=9.0), with freq of:
                  9.0 = termFreq=9.0
                6.6886926 = idf(docFreq=141, maxDocs=41962)
                0.0625 = fieldNorm(doc=3786)
        0.32 = coord(8/25)
    
  3. Ravana, S.D.; Rajagopal, P.; Balakrishnan, V.: Ranking retrieval systems using pseudo relevance judgments (2015) 0.28
    0.2824085 = sum of:
      0.2824085 = product of:
        1.0086018 = sum of:
          0.01581485 = weight(abstract_txt:that in 4592) [ClassicSimilarity], result of:
            0.01581485 = score(doc=4592,freq=3.0), product of:
              0.060562972 = queryWeight, product of:
                1.1133103 = boost
                2.4122221 = idf(docFreq=10221, maxDocs=41962)
                0.022551406 = queryNorm
              0.2611307 = fieldWeight in 4592, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                2.4122221 = idf(docFreq=10221, maxDocs=41962)
                0.0625 = fieldNorm(doc=4592)
          0.047276236 = weight(abstract_txt:documents in 4592) [ClassicSimilarity], result of:
            0.047276236 = score(doc=4592,freq=3.0), product of:
              0.10600087 = queryWeight, product of:
                1.140888 = boost
                4.1199584 = idf(docFreq=1852, maxDocs=41962)
                0.022551406 = queryNorm
              0.44599858 = fieldWeight in 4592, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.1199584 = idf(docFreq=1852, maxDocs=41962)
                0.0625 = fieldNorm(doc=4592)
          0.038602542 = weight(abstract_txt:study in 4592) [ClassicSimilarity], result of:
            0.038602542 = score(doc=4592,freq=3.0), product of:
              0.10192272 = queryWeight, product of:
                1.2917937 = boost
                3.49868 = idf(docFreq=3448, maxDocs=41962)
                0.022551406 = queryNorm
              0.37874323 = fieldWeight in 4592, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.49868 = idf(docFreq=3448, maxDocs=41962)
                0.0625 = fieldNorm(doc=4592)
          0.07425409 = weight(abstract_txt:topic in 4592) [ClassicSimilarity], result of:
            0.07425409 = score(doc=4592,freq=2.0), product of:
              0.16395506 = queryWeight, product of:
                1.4188964 = boost
                5.1238985 = idf(docFreq=678, maxDocs=41962)
                0.022551406 = queryNorm
              0.45289293 = fieldWeight in 4592, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.1238985 = idf(docFreq=678, maxDocs=41962)
                0.0625 = fieldNorm(doc=4592)
          0.1672431 = weight(abstract_txt:relevance in 4592) [ClassicSimilarity], result of:
            0.1672431 = score(doc=4592,freq=7.0), product of:
              0.20422095 = queryWeight, product of:
                1.8285539 = boost
                4.952436 = idf(docFreq=805, maxDocs=41962)
                0.022551406 = queryNorm
              0.8189321 = fieldWeight in 4592, product of:
                2.6457512 = tf(freq=7.0), with freq of:
                  7.0 = termFreq=7.0
                4.952436 = idf(docFreq=805, maxDocs=41962)
                0.0625 = fieldNorm(doc=4592)
          0.44517863 = weight(abstract_txt:assessors in 4592) [ClassicSimilarity], result of:
            0.44517863 = score(doc=4592,freq=3.0), product of:
              0.47268343 = queryWeight, product of:
                2.4092033 = boost
                8.700081 = idf(docFreq=18, maxDocs=41962)
                0.022551406 = queryNorm
              0.9418114 = fieldWeight in 4592, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                8.700081 = idf(docFreq=18, maxDocs=41962)
                0.0625 = fieldNorm(doc=4592)
          0.22023241 = weight(abstract_txt:trec in 4592) [ClassicSimilarity], result of:
            0.22023241 = score(doc=4592,freq=2.0), product of:
              0.37251604 = queryWeight, product of:
                2.46962 = boost
                6.6886926 = idf(docFreq=141, maxDocs=41962)
                0.022551406 = queryNorm
              0.5912025 = fieldWeight in 4592, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                6.6886926 = idf(docFreq=141, maxDocs=41962)
                0.0625 = fieldNorm(doc=4592)
        0.28 = coord(7/25)
    
  4. Osman, D.J.; Yearwood, J.; Vamplew, P.: Automated opinion detection : implications of the level of agreement between human raters (2010) 0.26
    0.25751624 = sum of:
      0.25751624 = product of:
        1.0729843 = sum of:
          0.04574204 = weight(abstract_txt:ability in 1233) [ClassicSimilarity], result of:
            0.04574204 = score(doc=1233,freq=1.0), product of:
              0.13064753 = queryWeight, product of:
                1.0341731 = boost
                5.6018867 = idf(docFreq=420, maxDocs=41962)
                0.022551406 = queryNorm
              0.35011792 = fieldWeight in 1233, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.6018867 = idf(docFreq=420, maxDocs=41962)
                0.0625 = fieldNorm(doc=1233)
          0.012912773 = weight(abstract_txt:that in 1233) [ClassicSimilarity], result of:
            0.012912773 = score(doc=1233,freq=2.0), product of:
              0.060562972 = queryWeight, product of:
                1.1133103 = boost
                2.4122221 = idf(docFreq=10221, maxDocs=41962)
                0.022551406 = queryNorm
              0.21321233 = fieldWeight in 1233, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.4122221 = idf(docFreq=10221, maxDocs=41962)
                0.0625 = fieldNorm(doc=1233)
          0.07912251 = weight(abstract_txt:assessing in 1233) [ClassicSimilarity], result of:
            0.07912251 = score(doc=1233,freq=1.0), product of:
              0.18825978 = queryWeight, product of:
                1.2414277 = boost
                6.724539 = idf(docFreq=136, maxDocs=41962)
                0.022551406 = queryNorm
              0.42028368 = fieldWeight in 1233, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.724539 = idf(docFreq=136, maxDocs=41962)
                0.0625 = fieldNorm(doc=1233)
          0.052505568 = weight(abstract_txt:topic in 1233) [ClassicSimilarity], result of:
            0.052505568 = score(doc=1233,freq=1.0), product of:
              0.16395506 = queryWeight, product of:
                1.4188964 = boost
                5.1238985 = idf(docFreq=678, maxDocs=41962)
                0.022551406 = queryNorm
              0.32024366 = fieldWeight in 1233, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.1238985 = idf(docFreq=678, maxDocs=41962)
                0.0625 = fieldNorm(doc=1233)
          0.72697365 = weight(abstract_txt:assessors in 1233) [ClassicSimilarity], result of:
            0.72697365 = score(doc=1233,freq=8.0), product of:
              0.47268343 = queryWeight, product of:
                2.4092033 = boost
                8.700081 = idf(docFreq=18, maxDocs=41962)
                0.022551406 = queryNorm
              1.5379715 = fieldWeight in 1233, product of:
                2.828427 = tf(freq=8.0), with freq of:
                  8.0 = termFreq=8.0
                8.700081 = idf(docFreq=18, maxDocs=41962)
                0.0625 = fieldNorm(doc=1233)
          0.15572783 = weight(abstract_txt:trec in 1233) [ClassicSimilarity], result of:
            0.15572783 = score(doc=1233,freq=1.0), product of:
              0.37251604 = queryWeight, product of:
                2.46962 = boost
                6.6886926 = idf(docFreq=141, maxDocs=41962)
                0.022551406 = queryNorm
              0.4180433 = fieldWeight in 1233, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.6886926 = idf(docFreq=141, maxDocs=41962)
                0.0625 = fieldNorm(doc=1233)
        0.24 = coord(6/25)
    
  5. Reichenbacher, T.; Sabbata, S. de; Purves, R.S.; Fabrikant, S.I.: Assessing geographic relevance for mobile search : a computational model and its validation via crowdsourcing (2016) 0.25
    0.25109035 = sum of:
      0.25109035 = product of:
        0.78465736 = sum of:
          0.019768564 = weight(abstract_txt:that in 146) [ClassicSimilarity], result of:
            0.019768564 = score(doc=146,freq=3.0), product of:
              0.060562972 = queryWeight, product of:
                1.1133103 = boost
                2.4122221 = idf(docFreq=10221, maxDocs=41962)
                0.022551406 = queryNorm
              0.32641336 = fieldWeight in 146, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                2.4122221 = idf(docFreq=10221, maxDocs=41962)
                0.078125 = fieldNorm(doc=146)
          0.034118686 = weight(abstract_txt:documents in 146) [ClassicSimilarity], result of:
            0.034118686 = score(doc=146,freq=1.0), product of:
              0.10600087 = queryWeight, product of:
                1.140888 = boost
                4.1199584 = idf(docFreq=1852, maxDocs=41962)
                0.022551406 = queryNorm
              0.32187176 = fieldWeight in 146, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.1199584 = idf(docFreq=1852, maxDocs=41962)
                0.078125 = fieldNorm(doc=146)
          0.04173055 = weight(abstract_txt:context in 146) [ClassicSimilarity], result of:
            0.04173055 = score(doc=146,freq=1.0), product of:
              0.12123201 = queryWeight, product of:
                1.2201042 = boost
                4.406023 = idf(docFreq=1391, maxDocs=41962)
                0.022551406 = queryNorm
              0.34422055 = fieldWeight in 146, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.406023 = idf(docFreq=1391, maxDocs=41962)
                0.078125 = fieldNorm(doc=146)
          0.09890315 = weight(abstract_txt:assessing in 146) [ClassicSimilarity], result of:
            0.09890315 = score(doc=146,freq=1.0), product of:
              0.18825978 = queryWeight, product of:
                1.2414277 = boost
                6.724539 = idf(docFreq=136, maxDocs=41962)
                0.022551406 = queryNorm
              0.5253546 = fieldWeight in 146, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.724539 = idf(docFreq=136, maxDocs=41962)
                0.078125 = fieldNorm(doc=146)
          0.027858984 = weight(abstract_txt:study in 146) [ClassicSimilarity], result of:
            0.027858984 = score(doc=146,freq=1.0), product of:
              0.10192272 = queryWeight, product of:
                1.2917937 = boost
                3.49868 = idf(docFreq=3448, maxDocs=41962)
                0.022551406 = queryNorm
              0.27333438 = fieldWeight in 146, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.49868 = idf(docFreq=3448, maxDocs=41962)
                0.078125 = fieldNorm(doc=146)
          0.15802987 = weight(abstract_txt:relevance in 146) [ClassicSimilarity], result of:
            0.15802987 = score(doc=146,freq=4.0), product of:
              0.20422095 = queryWeight, product of:
                1.8285539 = boost
                4.952436 = idf(docFreq=805, maxDocs=41962)
                0.022551406 = queryNorm
              0.77381814 = fieldWeight in 146, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.952436 = idf(docFreq=805, maxDocs=41962)
                0.078125 = fieldNorm(doc=146)
          0.08296758 = weight(abstract_txt:relevant in 146) [ClassicSimilarity], result of:
            0.08296758 = score(doc=146,freq=1.0), product of:
              0.22726703 = queryWeight, product of:
                2.156656 = boost
                4.672851 = idf(docFreq=1065, maxDocs=41962)
                0.022551406 = queryNorm
              0.3650665 = fieldWeight in 146, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.672851 = idf(docFreq=1065, maxDocs=41962)
                0.078125 = fieldNorm(doc=146)
          0.32128 = weight(abstract_txt:assessors in 146) [ClassicSimilarity], result of:
            0.32128 = score(doc=146,freq=1.0), product of:
              0.47268343 = queryWeight, product of:
                2.4092033 = boost
                8.700081 = idf(docFreq=18, maxDocs=41962)
                0.022551406 = queryNorm
              0.6796938 = fieldWeight in 146, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.700081 = idf(docFreq=18, maxDocs=41962)
                0.078125 = fieldNorm(doc=146)
        0.32 = coord(8/25)