Document (#26799)

Author

Borlund, P.

Title

¬The concept of relevance in IR

Source

Journal of the American Society for Information Science and technology. 54(2003) no.10, S.913-925

Year

2003

Abstract

This article introduces the concept of relevance as viewed and applied in the context of IR evaluation, by presenting an overview of the multidimensional and dynamic nature of the concept. The literature an relevance reveals how the relevance concept, especially in regard to the multidimensionality of relevance, is many faceted, and does not just refer to the various relevance criteria users may apply in the process of judging relevance of retrieved information objects. From our point of view, the multidimensionality of relevance explains why some will argue that no consensus has been reached an the relevance concept. Thus, the objective of this article is to present an overview of the many different views and ways by which the concept of relevance is used-leading to a consistent and compatible understanding of the concept. In addition, special attention is paid to the type of situational relevance. Many researchers perceive situational relevance as the most realistic type of user relevance, and therefore situational relevance is discussed with reference to its potential dynamic nature, and as a requirement for interactive information retrieval (IIR) evaluation.

Similar documents (author)

1. Borlund, P.: ¬The IIR evaluation model : a framework for evaluation of interactive information retrieval systems (2003) 5.58

   5.5776863 = sum of:
     5.5776863 = weight(author_txt:borlund in 922) [ClassicSimilarity], result of:
       5.5776863 = fieldWeight in 922, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.924298 = idf(docFreq=15, maxDocs=44218)
         0.625 = fieldNorm(doc=922)
   

2. Borlund, P.: Evaluation of interactive information retrieval systems (2000) 5.58

   5.5776863 = sum of:
     5.5776863 = weight(author_txt:borlund in 2556) [ClassicSimilarity], result of:
       5.5776863 = fieldWeight in 2556, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.924298 = idf(docFreq=15, maxDocs=44218)
         0.625 = fieldNorm(doc=2556)
   

3. Borlund, P.: Experimental components for the evaluation of interactive information retrieval systems (2000) 5.58

   5.5776863 = sum of:
     5.5776863 = weight(author_txt:borlund in 4549) [ClassicSimilarity], result of:
       5.5776863 = fieldWeight in 4549, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.924298 = idf(docFreq=15, maxDocs=44218)
         0.625 = fieldNorm(doc=4549)
   

4. Borlund, P.: ¬A study of the use of simulated work task situations in interactive information retrieval evaluations : a meta-evaluation (2016) 5.58

   5.5776863 = sum of:
     5.5776863 = weight(author_txt:borlund in 2880) [ClassicSimilarity], result of:
       5.5776863 = fieldWeight in 2880, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.924298 = idf(docFreq=15, maxDocs=44218)
         0.625 = fieldNorm(doc=2880)
   

5. Borlund, P.; Ingwersen, P.: ¬The development of a method for the evaluation of interactive information retrieval systems (1997) 4.46

   4.462149 = sum of:
     4.462149 = weight(author_txt:borlund in 7469) [ClassicSimilarity], result of:
       4.462149 = fieldWeight in 7469, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.924298 = idf(docFreq=15, maxDocs=44218)
         0.5 = fieldNorm(doc=7469)
   

Similar documents (content)

1. Eisenberg, M.; Schamber, L.: Relevance : the search for a definition (1988) 0.36

   0.35579053 = sum of:
     0.35579053 = product of:
       1.2706804 = sum of:
         0.06656281 = weight(abstract_txt:consensus in 3552) [ClassicSimilarity], result of:
           0.06656281 = score(doc=3552,freq=1.0), product of:
             0.10225737 = queryWeight, product of:
               1.1162096 = boost
               6.943297 = idf(docFreq=115, maxDocs=44218)
               0.0131942015 = queryNorm
             0.6509341 = fieldWeight in 3552, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.943297 = idf(docFreq=115, maxDocs=44218)
               0.09375 = fieldNorm(doc=3552)
         0.066812135 = weight(abstract_txt:multidimensional in 3552) [ClassicSimilarity], result of:
           0.066812135 = score(doc=3552,freq=1.0), product of:
             0.10251257 = queryWeight, product of:
               1.1176016 = boost
               6.9519553 = idf(docFreq=114, maxDocs=44218)
               0.0131942015 = queryNorm
             0.6517458 = fieldWeight in 3552, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.9519553 = idf(docFreq=114, maxDocs=44218)
               0.09375 = fieldNorm(doc=3552)
         0.0807906 = weight(abstract_txt:reached in 3552) [ClassicSimilarity], result of:
           0.0807906 = score(doc=3552,freq=1.0), product of:
             0.116353855 = queryWeight, product of:
               1.190663 = boost
               7.406428 = idf(docFreq=72, maxDocs=44218)
               0.0131942015 = queryNorm
             0.6943526 = fieldWeight in 3552, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.406428 = idf(docFreq=72, maxDocs=44218)
               0.09375 = fieldNorm(doc=3552)
         0.0359056 = weight(abstract_txt:evaluation in 3552) [ClassicSimilarity], result of:
           0.0359056 = score(doc=3552,freq=1.0), product of:
             0.08537387 = queryWeight, product of:
               1.4423676 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0131942015 = queryNorm
             0.42056894 = fieldWeight in 3552, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.09375 = fieldNorm(doc=3552)
         0.2621394 = weight(abstract_txt:situational in 3552) [ClassicSimilarity], result of:
           0.2621394 = score(doc=3552,freq=1.0), product of:
             0.3677919 = queryWeight, product of:
               3.6665716 = boost
               7.602543 = idf(docFreq=59, maxDocs=44218)
               0.0131942015 = queryNorm
             0.7127384 = fieldWeight in 3552, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.602543 = idf(docFreq=59, maxDocs=44218)
               0.09375 = fieldNorm(doc=3552)
         0.18003802 = weight(abstract_txt:concept in 3552) [ClassicSimilarity], result of:
           0.18003802 = score(doc=3552,freq=2.0), product of:
             0.3013971 = queryWeight, product of:
               5.0701056 = boost
               4.505458 = idf(docFreq=1327, maxDocs=44218)
               0.0131942015 = queryNorm
             0.59734493 = fieldWeight in 3552, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.505458 = idf(docFreq=1327, maxDocs=44218)
               0.09375 = fieldNorm(doc=3552)
         0.5784318 = weight(abstract_txt:relevance in 3552) [ClassicSimilarity], result of:
           0.5784318 = score(doc=3552,freq=3.0), product of:
             0.72228825 = queryWeight, product of:
               11.099867 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0131942015 = queryNorm
             0.80083233 = fieldWeight in 3552, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.09375 = fieldNorm(doc=3552)
       0.28 = coord(7/25)
   

2. Tang, R.; Solomon, P.: Toward an understanding of the dynamics of relevance judgement : an analysis of one person's search behavior (1998) 0.27

   0.27325043 = sum of:
     0.27325043 = product of:
       1.3662522 = sum of:
         0.045074586 = weight(abstract_txt:nature in 3268) [ClassicSimilarity], result of:
           0.045074586 = score(doc=3268,freq=1.0), product of:
             0.099350795 = queryWeight, product of:
               1.5559626 = boost
               4.839373 = idf(docFreq=950, maxDocs=44218)
               0.0131942015 = queryNorm
             0.45369124 = fieldWeight in 3268, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.839373 = idf(docFreq=950, maxDocs=44218)
               0.09375 = fieldNorm(doc=3268)
         0.076398194 = weight(abstract_txt:dynamic in 3268) [ClassicSimilarity], result of:
           0.076398194 = score(doc=3268,freq=1.0), product of:
             0.14123389 = queryWeight, product of:
               1.8551667 = boost
               5.7699614 = idf(docFreq=374, maxDocs=44218)
               0.0131942015 = queryNorm
             0.54093385 = fieldWeight in 3268, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7699614 = idf(docFreq=374, maxDocs=44218)
               0.09375 = fieldNorm(doc=3268)
         0.37072113 = weight(abstract_txt:situational in 3268) [ClassicSimilarity], result of:
           0.37072113 = score(doc=3268,freq=2.0), product of:
             0.3677919 = queryWeight, product of:
               3.6665716 = boost
               7.602543 = idf(docFreq=59, maxDocs=44218)
               0.0131942015 = queryNorm
             1.0079644 = fieldWeight in 3268, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.602543 = idf(docFreq=59, maxDocs=44218)
               0.09375 = fieldNorm(doc=3268)
         0.12730612 = weight(abstract_txt:concept in 3268) [ClassicSimilarity], result of:
           0.12730612 = score(doc=3268,freq=1.0), product of:
             0.3013971 = queryWeight, product of:
               5.0701056 = boost
               4.505458 = idf(docFreq=1327, maxDocs=44218)
               0.0131942015 = queryNorm
             0.42238668 = fieldWeight in 3268, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.505458 = idf(docFreq=1327, maxDocs=44218)
               0.09375 = fieldNorm(doc=3268)
         0.7467522 = weight(abstract_txt:relevance in 3268) [ClassicSimilarity], result of:
           0.7467522 = score(doc=3268,freq=5.0), product of:
             0.72228825 = queryWeight, product of:
               11.099867 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0131942015 = queryNorm
             1.0338701 = fieldWeight in 3268, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.09375 = fieldNorm(doc=3268)
       0.2 = coord(5/25)
   

3. Huang, X.; Soergel, D.: Relevance: an improved framework for explicating the notion (2013) 0.23

   0.22690116 = sum of:
     0.22690116 = product of:
       1.1345057 = sum of:
         0.029190788 = weight(abstract_txt:article in 527) [ClassicSimilarity], result of:
           0.029190788 = score(doc=527,freq=4.0), product of:
             0.061388675 = queryWeight, product of:
               1.2230877 = boost
               3.8040617 = idf(docFreq=2677, maxDocs=44218)
               0.0131942015 = queryNorm
             0.4755077 = fieldWeight in 527, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.8040617 = idf(docFreq=2677, maxDocs=44218)
               0.0625 = fieldNorm(doc=527)
         0.030049723 = weight(abstract_txt:nature in 527) [ClassicSimilarity], result of:
           0.030049723 = score(doc=527,freq=1.0), product of:
             0.099350795 = queryWeight, product of:
               1.5559626 = boost
               4.839373 = idf(docFreq=950, maxDocs=44218)
               0.0131942015 = queryNorm
             0.30246082 = fieldWeight in 527, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.839373 = idf(docFreq=950, maxDocs=44218)
               0.0625 = fieldNorm(doc=527)
         0.03823049 = weight(abstract_txt:many in 527) [ClassicSimilarity], result of:
           0.03823049 = score(doc=527,freq=2.0), product of:
             0.10598344 = queryWeight, product of:
               1.9682403 = boost
               4.081096 = idf(docFreq=2029, maxDocs=44218)
               0.0131942015 = queryNorm
             0.36072135 = fieldWeight in 527, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.081096 = idf(docFreq=2029, maxDocs=44218)
               0.0625 = fieldNorm(doc=527)
         0.1747596 = weight(abstract_txt:situational in 527) [ClassicSimilarity], result of:
           0.1747596 = score(doc=527,freq=1.0), product of:
             0.3677919 = queryWeight, product of:
               3.6665716 = boost
               7.602543 = idf(docFreq=59, maxDocs=44218)
               0.0131942015 = queryNorm
             0.47515893 = fieldWeight in 527, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.602543 = idf(docFreq=59, maxDocs=44218)
               0.0625 = fieldNorm(doc=527)
         0.8622752 = weight(abstract_txt:relevance in 527) [ClassicSimilarity], result of:
           0.8622752 = score(doc=527,freq=15.0), product of:
             0.72228825 = queryWeight, product of:
               11.099867 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0131942015 = queryNorm
             1.1938103 = fieldWeight in 527, product of:
               3.8729835 = tf(freq=15.0), with freq of:
                 15.0 = termFreq=15.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=527)
       0.2 = coord(5/25)
   

4. Harter, S.P.: Variations in relevance assessments and the measurement of retrieval effectiveness (1996) 0.19

   0.18902192 = sum of:
     0.18902192 = product of:
       0.78759134 = sum of:
         0.031908255 = weight(abstract_txt:argue in 3004) [ClassicSimilarity], result of:
           0.031908255 = score(doc=3004,freq=1.0), product of:
             0.082073525 = queryWeight, product of:
               6.2204237 = idf(docFreq=238, maxDocs=44218)
               0.0131942015 = queryNorm
             0.38877648 = fieldWeight in 3004, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.2204237 = idf(docFreq=238, maxDocs=44218)
               0.0625 = fieldNorm(doc=3004)
         0.014595394 = weight(abstract_txt:article in 3004) [ClassicSimilarity], result of:
           0.014595394 = score(doc=3004,freq=1.0), product of:
             0.061388675 = queryWeight, product of:
               1.2230877 = boost
               3.8040617 = idf(docFreq=2677, maxDocs=44218)
               0.0131942015 = queryNorm
             0.23775385 = fieldWeight in 3004, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.8040617 = idf(docFreq=2677, maxDocs=44218)
               0.0625 = fieldNorm(doc=3004)
         0.041460212 = weight(abstract_txt:evaluation in 3004) [ClassicSimilarity], result of:
           0.041460212 = score(doc=3004,freq=3.0), product of:
             0.08537387 = queryWeight, product of:
               1.4423676 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0131942015 = queryNorm
             0.48563117 = fieldWeight in 3004, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=3004)
         0.027033038 = weight(abstract_txt:many in 3004) [ClassicSimilarity], result of:
           0.027033038 = score(doc=3004,freq=1.0), product of:
             0.10598344 = queryWeight, product of:
               1.9682403 = boost
               4.081096 = idf(docFreq=2029, maxDocs=44218)
               0.0131942015 = queryNorm
             0.2550685 = fieldWeight in 3004, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.081096 = idf(docFreq=2029, maxDocs=44218)
               0.0625 = fieldNorm(doc=3004)
         0.1747596 = weight(abstract_txt:situational in 3004) [ClassicSimilarity], result of:
           0.1747596 = score(doc=3004,freq=1.0), product of:
             0.3677919 = queryWeight, product of:
               3.6665716 = boost
               7.602543 = idf(docFreq=59, maxDocs=44218)
               0.0131942015 = queryNorm
             0.47515893 = fieldWeight in 3004, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.602543 = idf(docFreq=59, maxDocs=44218)
               0.0625 = fieldNorm(doc=3004)
         0.4978348 = weight(abstract_txt:relevance in 3004) [ClassicSimilarity], result of:
           0.4978348 = score(doc=3004,freq=5.0), product of:
             0.72228825 = queryWeight, product of:
               11.099867 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0131942015 = queryNorm
             0.6892467 = fieldWeight in 3004, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=3004)
       0.24 = coord(6/25)
   

5. White, H.D.: Relevance in theory (2009) 0.19

   0.1888036 = sum of:
     0.1888036 = product of:
       0.78668165 = sum of:
         0.033406068 = weight(abstract_txt:multidimensional in 3872) [ClassicSimilarity], result of:
           0.033406068 = score(doc=3872,freq=1.0), product of:
             0.10251257 = queryWeight, product of:
               1.1176016 = boost
               6.9519553 = idf(docFreq=114, maxDocs=44218)
               0.0131942015 = queryNorm
             0.3258729 = fieldWeight in 3872, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.9519553 = idf(docFreq=114, maxDocs=44218)
               0.046875 = fieldNorm(doc=3872)
         0.0179528 = weight(abstract_txt:evaluation in 3872) [ClassicSimilarity], result of:
           0.0179528 = score(doc=3872,freq=1.0), product of:
             0.08537387 = queryWeight, product of:
               1.4423676 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0131942015 = queryNorm
             0.21028447 = fieldWeight in 3872, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.046875 = fieldNorm(doc=3872)
         0.038199097 = weight(abstract_txt:dynamic in 3872) [ClassicSimilarity], result of:
           0.038199097 = score(doc=3872,freq=1.0), product of:
             0.14123389 = queryWeight, product of:
               1.8551667 = boost
               5.7699614 = idf(docFreq=374, maxDocs=44218)
               0.0131942015 = queryNorm
             0.27046692 = fieldWeight in 3872, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7699614 = idf(docFreq=374, maxDocs=44218)
               0.046875 = fieldNorm(doc=3872)
         0.028672868 = weight(abstract_txt:many in 3872) [ClassicSimilarity], result of:
           0.028672868 = score(doc=3872,freq=2.0), product of:
             0.10598344 = queryWeight, product of:
               1.9682403 = boost
               4.081096 = idf(docFreq=2029, maxDocs=44218)
               0.0131942015 = queryNorm
             0.270541 = fieldWeight in 3872, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.081096 = idf(docFreq=2029, maxDocs=44218)
               0.046875 = fieldNorm(doc=3872)
         0.09001901 = weight(abstract_txt:concept in 3872) [ClassicSimilarity], result of:
           0.09001901 = score(doc=3872,freq=2.0), product of:
             0.3013971 = queryWeight, product of:
               5.0701056 = boost
               4.505458 = idf(docFreq=1327, maxDocs=44218)
               0.0131942015 = queryNorm
             0.29867247 = fieldWeight in 3872, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.505458 = idf(docFreq=1327, maxDocs=44218)
               0.046875 = fieldNorm(doc=3872)
         0.5784318 = weight(abstract_txt:relevance in 3872) [ClassicSimilarity], result of:
           0.5784318 = score(doc=3872,freq=12.0), product of:
             0.72228825 = queryWeight, product of:
               11.099867 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0131942015 = queryNorm
             0.80083233 = fieldWeight in 3872, product of:
               3.4641016 = tf(freq=12.0), with freq of:
                 12.0 = termFreq=12.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.046875 = fieldNorm(doc=3872)
       0.24 = coord(6/25)