Document (#39773)

Author
Ferro, N.
Silvello, G.
Keskustalo, H.
Pirkola, A.
Järvelin, K.
Title
¬The twist measure for IR evaluation : taking user's effort into account
Source
Journal of the Association for Information Science and Technology. 67(2016) no.3, S.620-648
Year
2016
Abstract
We present a novel measure for ranking evaluation, called Twist (t). It is a measure for informational intents, which handles both binary and graded relevance. t stems from the observation that searching is currently a that searching is currently taken for granted and it is natural for users to assume that search engines are available and work well. As a consequence, users may assume the utility they have in finding relevant documents, which is the focus of traditional measures, as granted. On the contrary, they may feel uneasy when the system returns nonrelevant documents because they are then forced to do additional work to get the desired information, and this causes avoidable effort. The latter is the focus of t, which evaluates the effectiveness of a system from the point of view of the effort required to the users to retrieve the desired information. We provide a formal definition of t, a demonstration of its properties, and introduce the notion of effort/gain plots, which complement traditional utility-based measures. By means of an extensive experimental evaluation, t is shown to grasp different aspects of system performances, to not require extensive and costly assessments, and to be a robust tool for detecting differences between systems.
Content
Vgl.: http://onlinelibrary.wiley.com/doi/10.1002/asi.23416/abstract.

Similar documents (author)

  1. Pirkola, A.; Hedlund, T.; Keskustalo, H.; Järvelin, K.: Dictionary-based cross-language information retrieval : problems, methods, and research findings (2001) 2.17
    2.1684163 = sum of:
      2.1684163 = product of:
        3.6140268 = sum of:
          0.8182825 = weight(author_txt:järvelin in 4909) [ClassicSimilarity], result of:
            0.8182825 = score(doc=4909,freq=1.0), product of:
              0.3264182 = queryWeight, product of:
                8.02193 = idf(docFreq=37, maxDocs=42596)
                0.04069073 = queryNorm
              2.506853 = fieldWeight in 4909, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.02193 = idf(docFreq=37, maxDocs=42596)
                0.3125 = fieldNorm(doc=4909)
          1.3429368 = weight(author_txt:pirkola in 4909) [ClassicSimilarity], result of:
            1.3429368 = score(doc=4909,freq=1.0), product of:
              0.45416036 = queryWeight, product of:
                1.1795529 = boost
                9.462291 = idf(docFreq=8, maxDocs=42596)
                0.04069073 = queryNorm
              2.956966 = fieldWeight in 4909, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                9.462291 = idf(docFreq=8, maxDocs=42596)
                0.3125 = fieldNorm(doc=4909)
          1.4528077 = weight(author_txt:keskustalo in 4909) [ClassicSimilarity], result of:
            1.4528077 = score(doc=4909,freq=1.0), product of:
              0.47860542 = queryWeight, product of:
                1.2108815 = boost
                9.713606 = idf(docFreq=6, maxDocs=42596)
                0.04069073 = queryNorm
              3.035502 = fieldWeight in 4909, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                9.713606 = idf(docFreq=6, maxDocs=42596)
                0.3125 = fieldNorm(doc=4909)
        0.6 = coord(3/5)
    
  2. Toivonen, J.; Pirkola, A.; Keskustalo, H.; Visala, K.; Järvelin, K.: Translating cross-lingual spelling variants using transformation rules (2005) 2.17
    2.1684163 = sum of:
      2.1684163 = product of:
        3.6140268 = sum of:
          0.8182825 = weight(author_txt:järvelin in 2232) [ClassicSimilarity], result of:
            0.8182825 = score(doc=2232,freq=1.0), product of:
              0.3264182 = queryWeight, product of:
                8.02193 = idf(docFreq=37, maxDocs=42596)
                0.04069073 = queryNorm
              2.506853 = fieldWeight in 2232, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.02193 = idf(docFreq=37, maxDocs=42596)
                0.3125 = fieldNorm(doc=2232)
          1.3429368 = weight(author_txt:pirkola in 2232) [ClassicSimilarity], result of:
            1.3429368 = score(doc=2232,freq=1.0), product of:
              0.45416036 = queryWeight, product of:
                1.1795529 = boost
                9.462291 = idf(docFreq=8, maxDocs=42596)
                0.04069073 = queryNorm
              2.956966 = fieldWeight in 2232, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                9.462291 = idf(docFreq=8, maxDocs=42596)
                0.3125 = fieldNorm(doc=2232)
          1.4528077 = weight(author_txt:keskustalo in 2232) [ClassicSimilarity], result of:
            1.4528077 = score(doc=2232,freq=1.0), product of:
              0.47860542 = queryWeight, product of:
                1.2108815 = boost
                9.713606 = idf(docFreq=6, maxDocs=42596)
                0.04069073 = queryNorm
              3.035502 = fieldWeight in 2232, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                9.713606 = idf(docFreq=6, maxDocs=42596)
                0.3125 = fieldNorm(doc=2232)
        0.6 = coord(3/5)
    
  3. Ferro, N.; Silvello, G.: NESTOR: a formal model for digital archives (2013) 1.86
    1.8595937 = sum of:
      1.8595937 = product of:
        4.6489844 = sum of:
          2.3244922 = weight(author_txt:silvello in 3708) [ClassicSimilarity], result of:
            2.3244922 = score(doc=3708,freq=1.0), product of:
              0.47860542 = queryWeight, product of:
                1.2108815 = boost
                9.713606 = idf(docFreq=6, maxDocs=42596)
                0.04069073 = queryNorm
              4.856803 = fieldWeight in 3708, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                9.713606 = idf(docFreq=6, maxDocs=42596)
                0.5 = fieldNorm(doc=3708)
          2.3244922 = weight(author_txt:ferro in 3708) [ClassicSimilarity], result of:
            2.3244922 = score(doc=3708,freq=1.0), product of:
              0.47860542 = queryWeight, product of:
                1.2108815 = boost
                9.713606 = idf(docFreq=6, maxDocs=42596)
                0.04069073 = queryNorm
              4.856803 = fieldWeight in 3708, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                9.713606 = idf(docFreq=6, maxDocs=42596)
                0.5 = fieldNorm(doc=3708)
        0.4 = coord(2/5)
    
  4. Ferro, N.; Silvello, G.: Toward an anatomy of IR system component performances (2018) 1.86
    1.8595937 = sum of:
      1.8595937 = product of:
        4.6489844 = sum of:
          2.3244922 = weight(author_txt:silvello in 36) [ClassicSimilarity], result of:
            2.3244922 = score(doc=36,freq=1.0), product of:
              0.47860542 = queryWeight, product of:
                1.2108815 = boost
                9.713606 = idf(docFreq=6, maxDocs=42596)
                0.04069073 = queryNorm
              4.856803 = fieldWeight in 36, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                9.713606 = idf(docFreq=6, maxDocs=42596)
                0.5 = fieldNorm(doc=36)
          2.3244922 = weight(author_txt:ferro in 36) [ClassicSimilarity], result of:
            2.3244922 = score(doc=36,freq=1.0), product of:
              0.47860542 = queryWeight, product of:
                1.2108815 = boost
                9.713606 = idf(docFreq=6, maxDocs=42596)
                0.04069073 = queryNorm
              4.856803 = fieldWeight in 36, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                9.713606 = idf(docFreq=6, maxDocs=42596)
                0.5 = fieldNorm(doc=36)
        0.4 = coord(2/5)
    
  5. Pirkola, A.; Järvelin, K.: Employing the resolution power of search keys (2001) 1.38
    1.3831803 = sum of:
      1.3831803 = product of:
        3.4579506 = sum of:
          1.3092519 = weight(author_txt:järvelin in 6908) [ClassicSimilarity], result of:
            1.3092519 = score(doc=6908,freq=1.0), product of:
              0.3264182 = queryWeight, product of:
                8.02193 = idf(docFreq=37, maxDocs=42596)
                0.04069073 = queryNorm
              4.010965 = fieldWeight in 6908, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.02193 = idf(docFreq=37, maxDocs=42596)
                0.5 = fieldNorm(doc=6908)
          2.1486988 = weight(author_txt:pirkola in 6908) [ClassicSimilarity], result of:
            2.1486988 = score(doc=6908,freq=1.0), product of:
              0.45416036 = queryWeight, product of:
                1.1795529 = boost
                9.462291 = idf(docFreq=8, maxDocs=42596)
                0.04069073 = queryNorm
              4.7311454 = fieldWeight in 6908, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                9.462291 = idf(docFreq=8, maxDocs=42596)
                0.5 = fieldNorm(doc=6908)
        0.4 = coord(2/5)
    

Similar documents (content)

  1. Hert, C.A.; Nilan, M.S.: User-based information retrieval evaluation : an examination of an online public access catalog (1991) 0.14
    0.13884233 = sum of:
      0.13884233 = product of:
        0.49586546 = sum of:
          0.044373285 = weight(abstract_txt:searching in 3671) [ClassicSimilarity], result of:
            0.044373285 = score(doc=3671,freq=1.0), product of:
              0.09512226 = queryWeight, product of:
                1.0286806 = boost
                4.2650228 = idf(docFreq=1626, maxDocs=42596)
                0.02168105 = queryNorm
              0.46648687 = fieldWeight in 3671, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.2650228 = idf(docFreq=1626, maxDocs=42596)
                0.109375 = fieldNorm(doc=3671)
          0.06827185 = weight(abstract_txt:focus in 3671) [ClassicSimilarity], result of:
            0.06827185 = score(doc=3671,freq=1.0), product of:
              0.12677363 = queryWeight, product of:
                1.1875554 = boost
                4.9237356 = idf(docFreq=841, maxDocs=42596)
                0.02168105 = queryNorm
              0.53853357 = fieldWeight in 3671, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.9237356 = idf(docFreq=841, maxDocs=42596)
                0.109375 = fieldNorm(doc=3671)
          0.04613556 = weight(abstract_txt:system in 3671) [ClassicSimilarity], result of:
            0.04613556 = score(doc=3671,freq=2.0), product of:
              0.08869764 = queryWeight, product of:
                1.2165812 = boost
                3.3627198 = idf(docFreq=4010, maxDocs=42596)
                0.02168105 = queryNorm
              0.52014416 = fieldWeight in 3671, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.3627198 = idf(docFreq=4010, maxDocs=42596)
                0.109375 = fieldNorm(doc=3671)
          0.039197642 = weight(abstract_txt:users in 3671) [ClassicSimilarity], result of:
            0.039197642 = score(doc=3671,freq=1.0), product of:
              0.100247025 = queryWeight, product of:
                1.2933642 = boost
                3.5749533 = idf(docFreq=3243, maxDocs=42596)
                0.02168105 = queryNorm
              0.39101052 = fieldWeight in 3671, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.5749533 = idf(docFreq=3243, maxDocs=42596)
                0.109375 = fieldNorm(doc=3671)
          0.15904008 = weight(abstract_txt:measures in 3671) [ClassicSimilarity], result of:
            0.15904008 = score(doc=3671,freq=3.0), product of:
              0.15446559 = queryWeight, product of:
                1.3108569 = boost
                5.434957 = idf(docFreq=504, maxDocs=42596)
                0.02168105 = queryNorm
              1.0296149 = fieldWeight in 3671, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                5.434957 = idf(docFreq=504, maxDocs=42596)
                0.109375 = fieldNorm(doc=3671)
          0.028896397 = weight(abstract_txt:which in 3671) [ClassicSimilarity], result of:
            0.028896397 = score(doc=3671,freq=1.0), product of:
              0.09004098 = queryWeight, product of:
                1.4153849 = boost
                2.9341707 = idf(docFreq=6156, maxDocs=42596)
                0.02168105 = queryNorm
              0.32092494 = fieldWeight in 3671, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.9341707 = idf(docFreq=6156, maxDocs=42596)
                0.109375 = fieldNorm(doc=3671)
          0.10995066 = weight(abstract_txt:evaluation in 3671) [ClassicSimilarity], result of:
            0.10995066 = score(doc=3671,freq=2.0), product of:
              0.15825355 = queryWeight, product of:
                1.6250315 = boost
                4.4917064 = idf(docFreq=1296, maxDocs=42596)
                0.02168105 = queryNorm
              0.69477534 = fieldWeight in 3671, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.4917064 = idf(docFreq=1296, maxDocs=42596)
                0.109375 = fieldNorm(doc=3671)
        0.28 = coord(7/25)
    
  2. White, H.D.: Relevance theory and distributions of judgments in document retrieval (2017) 0.13
    0.13004348 = sum of:
      0.13004348 = product of:
        0.5418478 = sum of:
          0.026546558 = weight(abstract_txt:they in 697) [ClassicSimilarity], result of:
            0.026546558 = score(doc=697,freq=1.0), product of:
              0.112269655 = queryWeight, product of:
                1.3687252 = boost
                3.7832568 = idf(docFreq=2633, maxDocs=42596)
                0.02168105 = queryNorm
              0.23645355 = fieldWeight in 697, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.7832568 = idf(docFreq=2633, maxDocs=42596)
                0.0625 = fieldNorm(doc=697)
          0.016512226 = weight(abstract_txt:which in 697) [ClassicSimilarity], result of:
            0.016512226 = score(doc=697,freq=1.0), product of:
              0.09004098 = queryWeight, product of:
                1.4153849 = boost
                2.9341707 = idf(docFreq=6156, maxDocs=42596)
                0.02168105 = queryNorm
              0.18338567 = fieldWeight in 697, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.9341707 = idf(docFreq=6156, maxDocs=42596)
                0.0625 = fieldNorm(doc=697)
          0.04442678 = weight(abstract_txt:evaluation in 697) [ClassicSimilarity], result of:
            0.04442678 = score(doc=697,freq=1.0), product of:
              0.15825355 = queryWeight, product of:
                1.6250315 = boost
                4.4917064 = idf(docFreq=1296, maxDocs=42596)
                0.02168105 = queryNorm
              0.28073165 = fieldWeight in 697, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.4917064 = idf(docFreq=1296, maxDocs=42596)
                0.0625 = fieldNorm(doc=697)
          0.13006108 = weight(abstract_txt:assume in 697) [ClassicSimilarity], result of:
            0.13006108 = score(doc=697,freq=1.0), product of:
              0.28291634 = queryWeight, product of:
                1.7740606 = boost
                7.3554506 = idf(docFreq=73, maxDocs=42596)
                0.02168105 = queryNorm
              0.45971566 = fieldWeight in 697, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.3554506 = idf(docFreq=73, maxDocs=42596)
                0.0625 = fieldNorm(doc=697)
          0.07870441 = weight(abstract_txt:measure in 697) [ClassicSimilarity], result of:
            0.07870441 = score(doc=697,freq=1.0), product of:
              0.23169835 = queryWeight, product of:
                1.9662853 = boost
                5.434957 = idf(docFreq=504, maxDocs=42596)
                0.02168105 = queryNorm
              0.3396848 = fieldWeight in 697, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.434957 = idf(docFreq=504, maxDocs=42596)
                0.0625 = fieldNorm(doc=697)
          0.24559675 = weight(abstract_txt:effort in 697) [ClassicSimilarity], result of:
            0.24559675 = score(doc=697,freq=4.0), product of:
              0.3430559 = queryWeight, product of:
                2.76272 = boost
                5.7272706 = idf(docFreq=376, maxDocs=42596)
                0.02168105 = queryNorm
              0.7159088 = fieldWeight in 697, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                5.7272706 = idf(docFreq=376, maxDocs=42596)
                0.0625 = fieldNorm(doc=697)
        0.24 = coord(6/25)
    
  3. Draper, S.W.; Dunlop, M.D.: New IR - new evaluation : the impact of interaction and multimedia on information retrieval and its evaluation (1997) 0.11
    0.111249074 = sum of:
      0.111249074 = product of:
        0.34765336 = sum of:
          0.039012488 = weight(abstract_txt:focus in 3463) [ClassicSimilarity], result of:
            0.039012488 = score(doc=3463,freq=1.0), product of:
              0.12677363 = queryWeight, product of:
                1.1875554 = boost
                4.9237356 = idf(docFreq=841, maxDocs=42596)
                0.02168105 = queryNorm
              0.30773348 = fieldWeight in 3463, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.9237356 = idf(docFreq=841, maxDocs=42596)
                0.0625 = fieldNorm(doc=3463)
          0.018641582 = weight(abstract_txt:system in 3463) [ClassicSimilarity], result of:
            0.018641582 = score(doc=3463,freq=1.0), product of:
              0.08869764 = queryWeight, product of:
                1.2165812 = boost
                3.3627198 = idf(docFreq=4010, maxDocs=42596)
                0.02168105 = queryNorm
              0.21016999 = fieldWeight in 3463, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.3627198 = idf(docFreq=4010, maxDocs=42596)
                0.0625 = fieldNorm(doc=3463)
          0.038795605 = weight(abstract_txt:users in 3463) [ClassicSimilarity], result of:
            0.038795605 = score(doc=3463,freq=3.0), product of:
              0.100247025 = queryWeight, product of:
                1.2933642 = boost
                3.5749533 = idf(docFreq=3243, maxDocs=42596)
                0.02168105 = queryNorm
              0.38700005 = fieldWeight in 3463, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.5749533 = idf(docFreq=3243, maxDocs=42596)
                0.0625 = fieldNorm(doc=3463)
          0.052241452 = weight(abstract_txt:currently in 3463) [ClassicSimilarity], result of:
            0.052241452 = score(doc=3463,freq=1.0), product of:
              0.15401746 = queryWeight, product of:
                1.3089541 = boost
                5.4270678 = idf(docFreq=508, maxDocs=42596)
                0.02168105 = queryNorm
              0.33919173 = fieldWeight in 3463, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.4270678 = idf(docFreq=508, maxDocs=42596)
                0.0625 = fieldNorm(doc=3463)
          0.026546558 = weight(abstract_txt:they in 3463) [ClassicSimilarity], result of:
            0.026546558 = score(doc=3463,freq=1.0), product of:
              0.112269655 = queryWeight, product of:
                1.3687252 = boost
                3.7832568 = idf(docFreq=2633, maxDocs=42596)
                0.02168105 = queryNorm
              0.23645355 = fieldWeight in 3463, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.7832568 = idf(docFreq=2633, maxDocs=42596)
                0.0625 = fieldNorm(doc=3463)
          0.023351813 = weight(abstract_txt:which in 3463) [ClassicSimilarity], result of:
            0.023351813 = score(doc=3463,freq=2.0), product of:
              0.09004098 = queryWeight, product of:
                1.4153849 = boost
                2.9341707 = idf(docFreq=6156, maxDocs=42596)
                0.02168105 = queryNorm
              0.2593465 = fieldWeight in 3463, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.9341707 = idf(docFreq=6156, maxDocs=42596)
                0.0625 = fieldNorm(doc=3463)
          0.07211444 = weight(abstract_txt:extensive in 3463) [ClassicSimilarity], result of:
            0.07211444 = score(doc=3463,freq=1.0), product of:
              0.19094487 = queryWeight, product of:
                1.4574492 = boost
                6.0427446 = idf(docFreq=274, maxDocs=42596)
                0.02168105 = queryNorm
              0.37767154 = fieldWeight in 3463, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.0427446 = idf(docFreq=274, maxDocs=42596)
                0.0625 = fieldNorm(doc=3463)
          0.07694944 = weight(abstract_txt:evaluation in 3463) [ClassicSimilarity], result of:
            0.07694944 = score(doc=3463,freq=3.0), product of:
              0.15825355 = queryWeight, product of:
                1.6250315 = boost
                4.4917064 = idf(docFreq=1296, maxDocs=42596)
                0.02168105 = queryNorm
              0.48624146 = fieldWeight in 3463, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.4917064 = idf(docFreq=1296, maxDocs=42596)
                0.0625 = fieldNorm(doc=3463)
        0.32 = coord(8/25)
    
  4. Su, L.T.: ¬The relevance of recall and precision in user evaluation (1994) 0.11
    0.1084893 = sum of:
      0.1084893 = product of:
        0.38746178 = sum of:
          0.022186643 = weight(abstract_txt:searching in 6933) [ClassicSimilarity], result of:
            0.022186643 = score(doc=6933,freq=1.0), product of:
              0.09512226 = queryWeight, product of:
                1.0286806 = boost
                4.2650228 = idf(docFreq=1626, maxDocs=42596)
                0.02168105 = queryNorm
              0.23324344 = fieldWeight in 6933, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.2650228 = idf(docFreq=1626, maxDocs=42596)
                0.0546875 = fieldNorm(doc=6933)
          0.028889958 = weight(abstract_txt:traditional in 6933) [ClassicSimilarity], result of:
            0.028889958 = score(doc=6933,freq=1.0), product of:
              0.11342768 = queryWeight, product of:
                1.1233083 = boost
                4.6573596 = idf(docFreq=1098, maxDocs=42596)
                0.02168105 = queryNorm
              0.25469935 = fieldWeight in 6933, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.6573596 = idf(docFreq=1098, maxDocs=42596)
                0.0546875 = fieldNorm(doc=6933)
          0.048007112 = weight(abstract_txt:users in 6933) [ClassicSimilarity], result of:
            0.048007112 = score(doc=6933,freq=6.0), product of:
              0.100247025 = queryWeight, product of:
                1.2933642 = boost
                3.5749533 = idf(docFreq=3243, maxDocs=42596)
                0.02168105 = queryNorm
              0.47888815 = fieldWeight in 6933, product of:
                2.4494898 = tf(freq=6.0), with freq of:
                  6.0 = termFreq=6.0
                3.5749533 = idf(docFreq=3243, maxDocs=42596)
                0.0546875 = fieldNorm(doc=6933)
          0.13773273 = weight(abstract_txt:measures in 6933) [ClassicSimilarity], result of:
            0.13773273 = score(doc=6933,freq=9.0), product of:
              0.15446559 = queryWeight, product of:
                1.3108569 = boost
                5.434957 = idf(docFreq=504, maxDocs=42596)
                0.02168105 = queryNorm
              0.8916726 = fieldWeight in 6933, product of:
                3.0 = tf(freq=9.0), with freq of:
                  9.0 = termFreq=9.0
                5.434957 = idf(docFreq=504, maxDocs=42596)
                0.0546875 = fieldNorm(doc=6933)
          0.0144481985 = weight(abstract_txt:which in 6933) [ClassicSimilarity], result of:
            0.0144481985 = score(doc=6933,freq=1.0), product of:
              0.09004098 = queryWeight, product of:
                1.4153849 = boost
                2.9341707 = idf(docFreq=6156, maxDocs=42596)
                0.02168105 = queryNorm
              0.16046247 = fieldWeight in 6933, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.9341707 = idf(docFreq=6156, maxDocs=42596)
                0.0546875 = fieldNorm(doc=6933)
          0.06733076 = weight(abstract_txt:evaluation in 6933) [ClassicSimilarity], result of:
            0.06733076 = score(doc=6933,freq=3.0), product of:
              0.15825355 = queryWeight, product of:
                1.6250315 = boost
                4.4917064 = idf(docFreq=1296, maxDocs=42596)
                0.02168105 = queryNorm
              0.4254613 = fieldWeight in 6933, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.4917064 = idf(docFreq=1296, maxDocs=42596)
                0.0546875 = fieldNorm(doc=6933)
          0.068866365 = weight(abstract_txt:measure in 6933) [ClassicSimilarity], result of:
            0.068866365 = score(doc=6933,freq=1.0), product of:
              0.23169835 = queryWeight, product of:
                1.9662853 = boost
                5.434957 = idf(docFreq=504, maxDocs=42596)
                0.02168105 = queryNorm
              0.29722422 = fieldWeight in 6933, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.434957 = idf(docFreq=504, maxDocs=42596)
                0.0546875 = fieldNorm(doc=6933)
        0.28 = coord(7/25)
    
  5. Vocht, L. De: Exploring semantic relationships in the Web of Data : Semantische relaties verkennen in data op het web (2017) 0.11
    0.10689406 = sum of:
      0.10689406 = product of:
        0.29692793 = sum of:
          0.019214196 = weight(abstract_txt:searching in 233) [ClassicSimilarity], result of:
            0.019214196 = score(doc=233,freq=3.0), product of:
              0.09512226 = queryWeight, product of:
                1.0286806 = boost
                4.2650228 = idf(docFreq=1626, maxDocs=42596)
                0.02168105 = queryNorm
              0.20199473 = fieldWeight in 233, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.2650228 = idf(docFreq=1626, maxDocs=42596)
                0.02734375 = fieldNorm(doc=233)
          0.06285997 = weight(abstract_txt:intents in 233) [ClassicSimilarity], result of:
            0.06285997 = score(doc=233,freq=1.0), product of:
              0.23996463 = queryWeight, product of:
                1.1553087 = boost
                9.580074 = idf(docFreq=7, maxDocs=42596)
                0.02168105 = queryNorm
              0.26195514 = fieldWeight in 233, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                9.580074 = idf(docFreq=7, maxDocs=42596)
                0.02734375 = fieldNorm(doc=233)
          0.024137745 = weight(abstract_txt:focus in 233) [ClassicSimilarity], result of:
            0.024137745 = score(doc=233,freq=2.0), product of:
              0.12677363 = queryWeight, product of:
                1.1875554 = boost
                4.9237356 = idf(docFreq=841, maxDocs=42596)
                0.02168105 = queryNorm
              0.19040036 = fieldWeight in 233, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.9237356 = idf(docFreq=841, maxDocs=42596)
                0.02734375 = fieldNorm(doc=233)
          0.008155692 = weight(abstract_txt:system in 233) [ClassicSimilarity], result of:
            0.008155692 = score(doc=233,freq=1.0), product of:
              0.08869764 = queryWeight, product of:
                1.2165812 = boost
                3.3627198 = idf(docFreq=4010, maxDocs=42596)
                0.02168105 = queryNorm
              0.091949366 = fieldWeight in 233, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.3627198 = idf(docFreq=4010, maxDocs=42596)
                0.02734375 = fieldNorm(doc=233)
          0.035332274 = weight(abstract_txt:users in 233) [ClassicSimilarity], result of:
            0.035332274 = score(doc=233,freq=13.0), product of:
              0.100247025 = queryWeight, product of:
                1.2933642 = boost
                3.5749533 = idf(docFreq=3243, maxDocs=42596)
                0.02168105 = queryNorm
              0.3524521 = fieldWeight in 233, product of:
                3.6055512 = tf(freq=13.0), with freq of:
                  13.0 = termFreq=13.0
                3.5749533 = idf(docFreq=3243, maxDocs=42596)
                0.02734375 = fieldNorm(doc=233)
          0.03072807 = weight(abstract_txt:they in 233) [ClassicSimilarity], result of:
            0.03072807 = score(doc=233,freq=7.0), product of:
              0.112269655 = queryWeight, product of:
                1.3687252 = boost
                3.7832568 = idf(docFreq=2633, maxDocs=42596)
                0.02168105 = queryNorm
              0.2736988 = fieldWeight in 233, product of:
                2.6457512 = tf(freq=7.0), with freq of:
                  7.0 = termFreq=7.0
                3.7832568 = idf(docFreq=2633, maxDocs=42596)
                0.02734375 = fieldNorm(doc=233)
          0.0144481985 = weight(abstract_txt:which in 233) [ClassicSimilarity], result of:
            0.0144481985 = score(doc=233,freq=4.0), product of:
              0.09004098 = queryWeight, product of:
                1.4153849 = boost
                2.9341707 = idf(docFreq=6156, maxDocs=42596)
                0.02168105 = queryNorm
              0.16046247 = fieldWeight in 233, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                2.9341707 = idf(docFreq=6156, maxDocs=42596)
                0.02734375 = fieldNorm(doc=233)
          0.027487665 = weight(abstract_txt:evaluation in 233) [ClassicSimilarity], result of:
            0.027487665 = score(doc=233,freq=2.0), product of:
              0.15825355 = queryWeight, product of:
                1.6250315 = boost
                4.4917064 = idf(docFreq=1296, maxDocs=42596)
                0.02168105 = queryNorm
              0.17369384 = fieldWeight in 233, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.4917064 = idf(docFreq=1296, maxDocs=42596)
                0.02734375 = fieldNorm(doc=233)
          0.07456411 = weight(abstract_txt:desired in 233) [ClassicSimilarity], result of:
            0.07456411 = score(doc=233,freq=2.0), product of:
              0.26889598 = queryWeight, product of:
                1.7295439 = boost
                7.1708794 = idf(docFreq=88, maxDocs=42596)
                0.02168105 = queryNorm
              0.2772972 = fieldWeight in 233, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                7.1708794 = idf(docFreq=88, maxDocs=42596)
                0.02734375 = fieldNorm(doc=233)
        0.36 = coord(9/25)