Document (#26797)

Author
Borlund, P.
Title
¬The concept of relevance in IR
Source
Journal of the American Society for Information Science and technology. 54(2003) no.10, S.913-925
Year
2003
Abstract
This article introduces the concept of relevance as viewed and applied in the context of IR evaluation, by presenting an overview of the multidimensional and dynamic nature of the concept. The literature an relevance reveals how the relevance concept, especially in regard to the multidimensionality of relevance, is many faceted, and does not just refer to the various relevance criteria users may apply in the process of judging relevance of retrieved information objects. From our point of view, the multidimensionality of relevance explains why some will argue that no consensus has been reached an the relevance concept. Thus, the objective of this article is to present an overview of the many different views and ways by which the concept of relevance is used-leading to a consistent and compatible understanding of the concept. In addition, special attention is paid to the type of situational relevance. Many researchers perceive situational relevance as the most realistic type of user relevance, and therefore situational relevance is discussed with reference to its potential dynamic nature, and as a requirement for interactive information retrieval (IIR) evaluation.

Similar documents (author)

  1. Borlund, P.: ¬The IIR evaluation model : a framework for evaluation of interactive information retrieval systems (2003) 5.57
    5.568259 = sum of:
      5.568259 = weight(author_txt:borlund in 1920) [ClassicSimilarity], result of:
        5.568259 = fieldWeight in 1920, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.909214 = idf(docFreq=15, maxDocs=43556)
          0.625 = fieldNorm(doc=1920)
    
  2. Borlund, P.: Evaluation of interactive information retrieval systems (2000) 5.57
    5.568259 = sum of:
      5.568259 = weight(author_txt:borlund in 3554) [ClassicSimilarity], result of:
        5.568259 = fieldWeight in 3554, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.909214 = idf(docFreq=15, maxDocs=43556)
          0.625 = fieldNorm(doc=3554)
    
  3. Borlund, P.: Experimental components for the evaluation of interactive information retrieval systems (2000) 5.57
    5.568259 = sum of:
      5.568259 = weight(author_txt:borlund in 547) [ClassicSimilarity], result of:
        5.568259 = fieldWeight in 547, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.909214 = idf(docFreq=15, maxDocs=43556)
          0.625 = fieldNorm(doc=547)
    
  4. Borlund, P.: ¬A study of the use of simulated work task situations in interactive information retrieval evaluations : a meta-evaluation (2016) 5.57
    5.568259 = sum of:
      5.568259 = weight(author_txt:borlund in 4878) [ClassicSimilarity], result of:
        5.568259 = fieldWeight in 4878, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.909214 = idf(docFreq=15, maxDocs=43556)
          0.625 = fieldNorm(doc=4878)
    
  5. Borlund, P.; Ingwersen, P.: ¬The development of a method for the evaluation of interactive information retrieval systems (1997) 4.45
    4.454607 = sum of:
      4.454607 = weight(author_txt:borlund in 536) [ClassicSimilarity], result of:
        4.454607 = fieldWeight in 536, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.909214 = idf(docFreq=15, maxDocs=43556)
          0.5 = fieldNorm(doc=536)
    

Similar documents (content)

  1. Eisenberg, M.; Schamber, L.: Relevance : the search for a definition (1988) 0.36
    0.35712087 = sum of:
      0.35712087 = product of:
        1.2754316 = sum of:
          0.066673025 = weight(abstract_txt:multidimensional in 3618) [ClassicSimilarity], result of:
            0.066673025 = score(doc=3618,freq=1.0), product of:
              0.102262944 = queryWeight, product of:
                1.1114877 = boost
                6.954415 = idf(docFreq=112, maxDocs=43556)
                0.013229792 = queryNorm
              0.6519764 = fieldWeight in 3618, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.954415 = idf(docFreq=112, maxDocs=43556)
                0.09375 = fieldNorm(doc=3618)
          0.06771496 = weight(abstract_txt:consensus in 3618) [ClassicSimilarity], result of:
            0.06771496 = score(doc=3618,freq=1.0), product of:
              0.103325605 = queryWeight, product of:
                1.1172478 = boost
                6.9904547 = idf(docFreq=108, maxDocs=43556)
                0.013229792 = queryNorm
              0.6553551 = fieldWeight in 3618, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.9904547 = idf(docFreq=108, maxDocs=43556)
                0.09375 = fieldNorm(doc=3618)
          0.08141693 = weight(abstract_txt:reached in 3618) [ClassicSimilarity], result of:
            0.08141693 = score(doc=3618,freq=1.0), product of:
              0.11683187 = queryWeight, product of:
                1.1880267 = boost
                7.4333076 = idf(docFreq=69, maxDocs=43556)
                0.013229792 = queryNorm
              0.6968726 = fieldWeight in 3618, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.4333076 = idf(docFreq=69, maxDocs=43556)
                0.09375 = fieldNorm(doc=3618)
          0.035968367 = weight(abstract_txt:evaluation in 3618) [ClassicSimilarity], result of:
            0.035968367 = score(doc=3618,freq=1.0), product of:
              0.08538377 = queryWeight, product of:
                1.43631 = boost
                4.49339 = idf(docFreq=1323, maxDocs=43556)
                0.013229792 = queryNorm
              0.42125532 = fieldWeight in 3618, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.49339 = idf(docFreq=1323, maxDocs=43556)
                0.09375 = fieldNorm(doc=3618)
          0.26506767 = weight(abstract_txt:situational in 3618) [ClassicSimilarity], result of:
            0.26506767 = score(doc=3618,freq=1.0), product of:
              0.3701375 = queryWeight, product of:
                3.662585 = boost
                7.6387515 = idf(docFreq=56, maxDocs=43556)
                0.013229792 = queryNorm
              0.71613294 = fieldWeight in 3618, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.6387515 = idf(docFreq=56, maxDocs=43556)
                0.09375 = fieldNorm(doc=3618)
          0.18114458 = weight(abstract_txt:concept in 3618) [ClassicSimilarity], result of:
            0.18114458 = score(doc=3618,freq=2.0), product of:
              0.30231366 = queryWeight, product of:
                5.0561905 = boost
                4.5194054 = idf(docFreq=1289, maxDocs=43556)
                0.013229792 = queryNorm
              0.59919417 = fieldWeight in 3618, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.5194054 = idf(docFreq=1289, maxDocs=43556)
                0.09375 = fieldNorm(doc=3618)
          0.5774461 = weight(abstract_txt:relevance in 3618) [ClassicSimilarity], result of:
            0.5774461 = score(doc=3618,freq=3.0), product of:
              0.72071147 = queryWeight, product of:
                11.040539 = boost
                4.934216 = idf(docFreq=851, maxDocs=43556)
                0.013229792 = queryNorm
              0.8012168 = fieldWeight in 3618, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.934216 = idf(docFreq=851, maxDocs=43556)
                0.09375 = fieldNorm(doc=3618)
        0.28 = coord(7/25)
    
  2. Tang, R.; Solomon, P.: Toward an understanding of the dynamics of relevance judgement : an analysis of one person's search behavior (1998) 0.27
    0.2739566 = sum of:
      0.2739566 = product of:
        1.3697829 = sum of:
          0.04504522 = weight(abstract_txt:nature in 4266) [ClassicSimilarity], result of:
            0.04504522 = score(doc=4266,freq=1.0), product of:
              0.09920357 = queryWeight, product of:
                1.5481898 = boost
                4.8433976 = idf(docFreq=932, maxDocs=43556)
                0.013229792 = queryNorm
              0.45406854 = fieldWeight in 4266, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.8433976 = idf(docFreq=932, maxDocs=43556)
                0.09375 = fieldNorm(doc=4266)
          0.076307185 = weight(abstract_txt:dynamic in 4266) [ClassicSimilarity], result of:
            0.076307185 = score(doc=4266,freq=1.0), product of:
              0.14097382 = queryWeight, product of:
                1.8455669 = boost
                5.77372 = idf(docFreq=367, maxDocs=43556)
                0.013229792 = queryNorm
              0.54128623 = fieldWeight in 4266, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.77372 = idf(docFreq=367, maxDocs=43556)
                0.09375 = fieldNorm(doc=4266)
          0.37486228 = weight(abstract_txt:situational in 4266) [ClassicSimilarity], result of:
            0.37486228 = score(doc=4266,freq=2.0), product of:
              0.3701375 = queryWeight, product of:
                3.662585 = boost
                7.6387515 = idf(docFreq=56, maxDocs=43556)
                0.013229792 = queryNorm
              1.0127649 = fieldWeight in 4266, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                7.6387515 = idf(docFreq=56, maxDocs=43556)
                0.09375 = fieldNorm(doc=4266)
          0.12808856 = weight(abstract_txt:concept in 4266) [ClassicSimilarity], result of:
            0.12808856 = score(doc=4266,freq=1.0), product of:
              0.30231366 = queryWeight, product of:
                5.0561905 = boost
                4.5194054 = idf(docFreq=1289, maxDocs=43556)
                0.013229792 = queryNorm
              0.42369425 = fieldWeight in 4266, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.5194054 = idf(docFreq=1289, maxDocs=43556)
                0.09375 = fieldNorm(doc=4266)
          0.74547976 = weight(abstract_txt:relevance in 4266) [ClassicSimilarity], result of:
            0.74547976 = score(doc=4266,freq=5.0), product of:
              0.72071147 = queryWeight, product of:
                11.040539 = boost
                4.934216 = idf(docFreq=851, maxDocs=43556)
                0.013229792 = queryNorm
              1.0343665 = fieldWeight in 4266, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                4.934216 = idf(docFreq=851, maxDocs=43556)
                0.09375 = fieldNorm(doc=4266)
        0.2 = coord(5/25)
    
  3. Huang, X.; Soergel, D.: Relevance: an improved framework for explicating the notion (2013) 0.23
    0.22706929 = sum of:
      0.22706929 = product of:
        1.1353464 = sum of:
          0.029468162 = weight(abstract_txt:article in 2525) [ClassicSimilarity], result of:
            0.029468162 = score(doc=2525,freq=4.0), product of:
              0.061712205 = queryWeight, product of:
                1.2210854 = boost
                3.8200758 = idf(docFreq=2595, maxDocs=43556)
                0.013229792 = queryNorm
              0.47750947 = fieldWeight in 2525, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                3.8200758 = idf(docFreq=2595, maxDocs=43556)
                0.0625 = fieldNorm(doc=2525)
          0.030030146 = weight(abstract_txt:nature in 2525) [ClassicSimilarity], result of:
            0.030030146 = score(doc=2525,freq=1.0), product of:
              0.09920357 = queryWeight, product of:
                1.5481898 = boost
                4.8433976 = idf(docFreq=932, maxDocs=43556)
                0.013229792 = queryNorm
              0.30271235 = fieldWeight in 2525, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.8433976 = idf(docFreq=932, maxDocs=43556)
                0.0625 = fieldNorm(doc=2525)
          0.038330387 = weight(abstract_txt:many in 2525) [ClassicSimilarity], result of:
            0.038330387 = score(doc=2525,freq=2.0), product of:
              0.106056735 = queryWeight, product of:
                1.9605381 = boost
                4.0889325 = idf(docFreq=1983, maxDocs=43556)
                0.013229792 = queryNorm
              0.361414 = fieldWeight in 2525, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.0889325 = idf(docFreq=1983, maxDocs=43556)
                0.0625 = fieldNorm(doc=2525)
          0.17671178 = weight(abstract_txt:situational in 2525) [ClassicSimilarity], result of:
            0.17671178 = score(doc=2525,freq=1.0), product of:
              0.3701375 = queryWeight, product of:
                3.662585 = boost
                7.6387515 = idf(docFreq=56, maxDocs=43556)
                0.013229792 = queryNorm
              0.47742197 = fieldWeight in 2525, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.6387515 = idf(docFreq=56, maxDocs=43556)
                0.0625 = fieldNorm(doc=2525)
          0.860806 = weight(abstract_txt:relevance in 2525) [ClassicSimilarity], result of:
            0.860806 = score(doc=2525,freq=15.0), product of:
              0.72071147 = queryWeight, product of:
                11.040539 = boost
                4.934216 = idf(docFreq=851, maxDocs=43556)
                0.013229792 = queryNorm
              1.1943836 = fieldWeight in 2525, product of:
                3.8729835 = tf(freq=15.0), with freq of:
                  15.0 = termFreq=15.0
                4.934216 = idf(docFreq=851, maxDocs=43556)
                0.0625 = fieldNorm(doc=2525)
        0.2 = coord(5/25)
    
  4. Harter, S.P.: Variations in relevance assessments and the measurement of retrieval effectiveness (1996) 0.19
    0.18946533 = sum of:
      0.18946533 = product of:
        0.7894389 = sum of:
          0.032370165 = weight(abstract_txt:argue in 3070) [ClassicSimilarity], result of:
            0.032370165 = score(doc=3070,freq=1.0), product of:
              0.08277686 = queryWeight, product of:
                6.2568526 = idf(docFreq=226, maxDocs=43556)
                0.013229792 = queryNorm
              0.3910533 = fieldWeight in 3070, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.2568526 = idf(docFreq=226, maxDocs=43556)
                0.0625 = fieldNorm(doc=3070)
          0.014734081 = weight(abstract_txt:article in 3070) [ClassicSimilarity], result of:
            0.014734081 = score(doc=3070,freq=1.0), product of:
              0.061712205 = queryWeight, product of:
                1.2210854 = boost
                3.8200758 = idf(docFreq=2595, maxDocs=43556)
                0.013229792 = queryNorm
              0.23875473 = fieldWeight in 3070, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.8200758 = idf(docFreq=2595, maxDocs=43556)
                0.0625 = fieldNorm(doc=3070)
          0.04153269 = weight(abstract_txt:evaluation in 3070) [ClassicSimilarity], result of:
            0.04153269 = score(doc=3070,freq=3.0), product of:
              0.08538377 = queryWeight, product of:
                1.43631 = boost
                4.49339 = idf(docFreq=1323, maxDocs=43556)
                0.013229792 = queryNorm
              0.48642373 = fieldWeight in 3070, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.49339 = idf(docFreq=1323, maxDocs=43556)
                0.0625 = fieldNorm(doc=3070)
          0.027103677 = weight(abstract_txt:many in 3070) [ClassicSimilarity], result of:
            0.027103677 = score(doc=3070,freq=1.0), product of:
              0.106056735 = queryWeight, product of:
                1.9605381 = boost
                4.0889325 = idf(docFreq=1983, maxDocs=43556)
                0.013229792 = queryNorm
              0.25555828 = fieldWeight in 3070, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.0889325 = idf(docFreq=1983, maxDocs=43556)
                0.0625 = fieldNorm(doc=3070)
          0.17671178 = weight(abstract_txt:situational in 3070) [ClassicSimilarity], result of:
            0.17671178 = score(doc=3070,freq=1.0), product of:
              0.3701375 = queryWeight, product of:
                3.662585 = boost
                7.6387515 = idf(docFreq=56, maxDocs=43556)
                0.013229792 = queryNorm
              0.47742197 = fieldWeight in 3070, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.6387515 = idf(docFreq=56, maxDocs=43556)
                0.0625 = fieldNorm(doc=3070)
          0.4969865 = weight(abstract_txt:relevance in 3070) [ClassicSimilarity], result of:
            0.4969865 = score(doc=3070,freq=5.0), product of:
              0.72071147 = queryWeight, product of:
                11.040539 = boost
                4.934216 = idf(docFreq=851, maxDocs=43556)
                0.013229792 = queryNorm
              0.68957764 = fieldWeight in 3070, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                4.934216 = idf(docFreq=851, maxDocs=43556)
                0.0625 = fieldNorm(doc=3070)
        0.24 = coord(6/25)
    
  5. White, H.D.: Relevance in theory (2009) 0.19
    0.18869771 = sum of:
      0.18869771 = product of:
        0.78624046 = sum of:
          0.033336513 = weight(abstract_txt:multidimensional in 870) [ClassicSimilarity], result of:
            0.033336513 = score(doc=870,freq=1.0), product of:
              0.102262944 = queryWeight, product of:
                1.1114877 = boost
                6.954415 = idf(docFreq=112, maxDocs=43556)
                0.013229792 = queryNorm
              0.3259882 = fieldWeight in 870, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.954415 = idf(docFreq=112, maxDocs=43556)
                0.046875 = fieldNorm(doc=870)
          0.017984184 = weight(abstract_txt:evaluation in 870) [ClassicSimilarity], result of:
            0.017984184 = score(doc=870,freq=1.0), product of:
              0.08538377 = queryWeight, product of:
                1.43631 = boost
                4.49339 = idf(docFreq=1323, maxDocs=43556)
                0.013229792 = queryNorm
              0.21062766 = fieldWeight in 870, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.49339 = idf(docFreq=1323, maxDocs=43556)
                0.046875 = fieldNorm(doc=870)
          0.038153592 = weight(abstract_txt:dynamic in 870) [ClassicSimilarity], result of:
            0.038153592 = score(doc=870,freq=1.0), product of:
              0.14097382 = queryWeight, product of:
                1.8455669 = boost
                5.77372 = idf(docFreq=367, maxDocs=43556)
                0.013229792 = queryNorm
              0.27064312 = fieldWeight in 870, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.77372 = idf(docFreq=367, maxDocs=43556)
                0.046875 = fieldNorm(doc=870)
          0.028747791 = weight(abstract_txt:many in 870) [ClassicSimilarity], result of:
            0.028747791 = score(doc=870,freq=2.0), product of:
              0.106056735 = queryWeight, product of:
                1.9605381 = boost
                4.0889325 = idf(docFreq=1983, maxDocs=43556)
                0.013229792 = queryNorm
              0.2710605 = fieldWeight in 870, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.0889325 = idf(docFreq=1983, maxDocs=43556)
                0.046875 = fieldNorm(doc=870)
          0.09057229 = weight(abstract_txt:concept in 870) [ClassicSimilarity], result of:
            0.09057229 = score(doc=870,freq=2.0), product of:
              0.30231366 = queryWeight, product of:
                5.0561905 = boost
                4.5194054 = idf(docFreq=1289, maxDocs=43556)
                0.013229792 = queryNorm
              0.29959708 = fieldWeight in 870, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.5194054 = idf(docFreq=1289, maxDocs=43556)
                0.046875 = fieldNorm(doc=870)
          0.5774461 = weight(abstract_txt:relevance in 870) [ClassicSimilarity], result of:
            0.5774461 = score(doc=870,freq=12.0), product of:
              0.72071147 = queryWeight, product of:
                11.040539 = boost
                4.934216 = idf(docFreq=851, maxDocs=43556)
                0.013229792 = queryNorm
              0.8012168 = fieldWeight in 870, product of:
                3.4641016 = tf(freq=12.0), with freq of:
                  12.0 = termFreq=12.0
                4.934216 = idf(docFreq=851, maxDocs=43556)
                0.046875 = fieldNorm(doc=870)
        0.24 = coord(6/25)