Document (#26800)

Author

Borlund, P.

Title

¬The concept of relevance in IR

Source

Journal of the American Society for Information Science and technology. 54(2003) no.10, S.913-925

Year

2003

Abstract

This article introduces the concept of relevance as viewed and applied in the context of IR evaluation, by presenting an overview of the multidimensional and dynamic nature of the concept. The literature an relevance reveals how the relevance concept, especially in regard to the multidimensionality of relevance, is many faceted, and does not just refer to the various relevance criteria users may apply in the process of judging relevance of retrieved information objects. From our point of view, the multidimensionality of relevance explains why some will argue that no consensus has been reached an the relevance concept. Thus, the objective of this article is to present an overview of the many different views and ways by which the concept of relevance is used-leading to a consistent and compatible understanding of the concept. In addition, special attention is paid to the type of situational relevance. Many researchers perceive situational relevance as the most realistic type of user relevance, and therefore situational relevance is discussed with reference to its potential dynamic nature, and as a requirement for interactive information retrieval (IIR) evaluation.

Similar documents (author)

1. Borlund, P.: ¬The IIR evaluation model : a framework for evaluation of interactive information retrieval systems (2003) 5.60

   5.5967755 = sum of:
     5.5967755 = weight(author_txt:borlund in 1923) [ClassicSimilarity], result of:
       5.5967755 = fieldWeight in 1923, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.954841 = idf(docFreq=14, maxDocs=42740)
         0.625 = fieldNorm(doc=1923)
   

2. Borlund, P.: Evaluation of interactive information retrieval systems (2000) 5.60

   5.5967755 = sum of:
     5.5967755 = weight(author_txt:borlund in 3557) [ClassicSimilarity], result of:
       5.5967755 = fieldWeight in 3557, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.954841 = idf(docFreq=14, maxDocs=42740)
         0.625 = fieldNorm(doc=3557)
   

3. Borlund, P.: Experimental components for the evaluation of interactive information retrieval systems (2000) 5.60

   5.5967755 = sum of:
     5.5967755 = weight(author_txt:borlund in 550) [ClassicSimilarity], result of:
       5.5967755 = fieldWeight in 550, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.954841 = idf(docFreq=14, maxDocs=42740)
         0.625 = fieldNorm(doc=550)
   

4. Borlund, P.: ¬A study of the use of simulated work task situations in interactive information retrieval evaluations : a meta-evaluation (2016) 5.60

   5.5967755 = sum of:
     5.5967755 = weight(author_txt:borlund in 4881) [ClassicSimilarity], result of:
       5.5967755 = fieldWeight in 4881, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.954841 = idf(docFreq=14, maxDocs=42740)
         0.625 = fieldNorm(doc=4881)
   

5. Borlund, P.; Ingwersen, P.: ¬The development of a method for the evaluation of interactive information retrieval systems (1997) 4.48

   4.4774203 = sum of:
     4.4774203 = weight(author_txt:borlund in 539) [ClassicSimilarity], result of:
       4.4774203 = fieldWeight in 539, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.954841 = idf(docFreq=14, maxDocs=42740)
         0.5 = fieldNorm(doc=539)
   

Similar documents (content)

1. Eisenberg, M.; Schamber, L.: Relevance : the search for a definition (1988) 0.36

   0.3572325 = sum of:
     0.3572325 = product of:
       1.2758304 = sum of:
         0.066839896 = weight(abstract_txt:multidimensional in 3621) [ClassicSimilarity], result of:
           0.066839896 = score(doc=3621,freq=1.0), product of:
             0.10240117 = queryWeight, product of:
               1.1015502 = boost
               6.96241 = idf(docFreq=109, maxDocs=42740)
               0.013351837 = queryNorm
             0.65272593 = fieldWeight in 3621, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.96241 = idf(docFreq=109, maxDocs=42740)
               0.09375 = fieldNorm(doc=3621)
         0.06903821 = weight(abstract_txt:consensus in 3621) [ClassicSimilarity], result of:
           0.06903821 = score(doc=3621,freq=1.0), product of:
             0.10463431 = queryWeight, product of:
               1.1134965 = boost
               7.0379176 = idf(docFreq=101, maxDocs=42740)
               0.013351837 = queryNorm
             0.65980476 = fieldWeight in 3621, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.0379176 = idf(docFreq=101, maxDocs=42740)
               0.09375 = fieldNorm(doc=3621)
         0.081191435 = weight(abstract_txt:reached in 3621) [ClassicSimilarity], result of:
           0.081191435 = score(doc=3621,freq=1.0), product of:
             0.116579235 = queryWeight, product of:
               1.1753371 = boost
               7.428784 = idf(docFreq=68, maxDocs=42740)
               0.013351837 = queryNorm
             0.6964485 = fieldWeight in 3621, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.428784 = idf(docFreq=68, maxDocs=42740)
               0.09375 = fieldNorm(doc=3621)
         0.03591947 = weight(abstract_txt:evaluation in 3621) [ClassicSimilarity], result of:
           0.03591947 = score(doc=3621,freq=1.0), product of:
             0.085279435 = queryWeight, product of:
               1.4216379 = boost
               4.492771 = idf(docFreq=1299, maxDocs=42740)
               0.013351837 = queryNorm
             0.4211973 = fieldWeight in 3621, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.492771 = idf(docFreq=1299, maxDocs=42740)
               0.09375 = fieldNorm(doc=3621)
         0.26285467 = weight(abstract_txt:situational in 3621) [ClassicSimilarity], result of:
           0.26285467 = score(doc=3621,freq=1.0), product of:
             0.36795828 = queryWeight, product of:
               3.616694 = boost
               7.619839 = idf(docFreq=56, maxDocs=42740)
               0.013351837 = queryNorm
             0.71435994 = fieldWeight in 3621, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.619839 = idf(docFreq=56, maxDocs=42740)
               0.09375 = fieldNorm(doc=3621)
         0.18307112 = weight(abstract_txt:concept in 3621) [ClassicSimilarity], result of:
           0.18307112 = score(doc=3621,freq=2.0), product of:
             0.30435723 = queryWeight, product of:
               5.024498 = boost
               4.5368032 = idf(docFreq=1243, maxDocs=42740)
               0.013351837 = queryNorm
             0.6015008 = fieldWeight in 3621, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.5368032 = idf(docFreq=1243, maxDocs=42740)
               0.09375 = fieldNorm(doc=3621)
         0.57691556 = weight(abstract_txt:relevance in 3621) [ClassicSimilarity], result of:
           0.57691556 = score(doc=3621,freq=3.0), product of:
             0.7200425 = queryWeight, product of:
               10.929365 = boost
               4.934262 = idf(docFreq=835, maxDocs=42740)
               0.013351837 = queryNorm
             0.8012243 = fieldWeight in 3621, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.934262 = idf(docFreq=835, maxDocs=42740)
               0.09375 = fieldNorm(doc=3621)
       0.28 = coord(7/25)
   

2. Tang, R.; Solomon, P.: Toward an understanding of the dynamics of relevance judgement : an analysis of one person's search behavior (1998) 0.27

   0.27365953 = sum of:
     0.27365953 = product of:
       1.3682976 = sum of:
         0.045294598 = weight(abstract_txt:nature in 4269) [ClassicSimilarity], result of:
           0.045294598 = score(doc=4269,freq=1.0), product of:
             0.09953795 = queryWeight, product of:
               1.5358938 = boost
               4.8538513 = idf(docFreq=905, maxDocs=42740)
               0.013351837 = queryNorm
             0.45504856 = fieldWeight in 4269, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8538513 = idf(docFreq=905, maxDocs=42740)
               0.09375 = fieldNorm(doc=4269)
         0.07702488 = weight(abstract_txt:dynamic in 4269) [ClassicSimilarity], result of:
           0.07702488 = score(doc=4269,freq=1.0), product of:
             0.1418116 = queryWeight, product of:
               1.8332543 = boost
               5.7935934 = idf(docFreq=353, maxDocs=42740)
               0.013351837 = queryNorm
             0.54314935 = fieldWeight in 4269, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7935934 = idf(docFreq=353, maxDocs=42740)
               0.09375 = fieldNorm(doc=4269)
         0.3717326 = weight(abstract_txt:situational in 4269) [ClassicSimilarity], result of:
           0.3717326 = score(doc=4269,freq=2.0), product of:
             0.36795828 = queryWeight, product of:
               3.616694 = boost
               7.619839 = idf(docFreq=56, maxDocs=42740)
               0.013351837 = queryNorm
             1.0102575 = fieldWeight in 4269, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.619839 = idf(docFreq=56, maxDocs=42740)
               0.09375 = fieldNorm(doc=4269)
         0.12945083 = weight(abstract_txt:concept in 4269) [ClassicSimilarity], result of:
           0.12945083 = score(doc=4269,freq=1.0), product of:
             0.30435723 = queryWeight, product of:
               5.024498 = boost
               4.5368032 = idf(docFreq=1243, maxDocs=42740)
               0.013351837 = queryNorm
             0.4253253 = fieldWeight in 4269, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.5368032 = idf(docFreq=1243, maxDocs=42740)
               0.09375 = fieldNorm(doc=4269)
         0.7447948 = weight(abstract_txt:relevance in 4269) [ClassicSimilarity], result of:
           0.7447948 = score(doc=4269,freq=5.0), product of:
             0.7200425 = queryWeight, product of:
               10.929365 = boost
               4.934262 = idf(docFreq=835, maxDocs=42740)
               0.013351837 = queryNorm
             1.0343761 = fieldWeight in 4269, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.934262 = idf(docFreq=835, maxDocs=42740)
               0.09375 = fieldNorm(doc=4269)
       0.2 = coord(5/25)
   

3. Huang, X.; Soergel, D.: Relevance: an improved framework for explicating the notion (2013) 0.23

   0.22678745 = sum of:
     0.22678745 = product of:
       1.1339372 = sum of:
         0.029848343 = weight(abstract_txt:article in 2528) [ClassicSimilarity], result of:
           0.029848343 = score(doc=2528,freq=4.0), product of:
             0.0622222 = queryWeight, product of:
               1.2143378 = boost
               3.8376453 = idf(docFreq=2502, maxDocs=42740)
               0.013351837 = queryNorm
             0.47970566 = fieldWeight in 2528, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.8376453 = idf(docFreq=2502, maxDocs=42740)
               0.0625 = fieldNorm(doc=2528)
         0.0301964 = weight(abstract_txt:nature in 2528) [ClassicSimilarity], result of:
           0.0301964 = score(doc=2528,freq=1.0), product of:
             0.09953795 = queryWeight, product of:
               1.5358938 = boost
               4.8538513 = idf(docFreq=905, maxDocs=42740)
               0.013351837 = queryNorm
             0.3033657 = fieldWeight in 2528, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8538513 = idf(docFreq=905, maxDocs=42740)
               0.0625 = fieldNorm(doc=2528)
         0.038641177 = weight(abstract_txt:many in 2528) [ClassicSimilarity], result of:
           0.038641177 = score(doc=2528,freq=2.0), product of:
             0.10659558 = queryWeight, product of:
               1.946624 = boost
               4.1012487 = idf(docFreq=1922, maxDocs=42740)
               0.013351837 = queryNorm
             0.3625026 = fieldWeight in 2528, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1012487 = idf(docFreq=1922, maxDocs=42740)
               0.0625 = fieldNorm(doc=2528)
         0.17523643 = weight(abstract_txt:situational in 2528) [ClassicSimilarity], result of:
           0.17523643 = score(doc=2528,freq=1.0), product of:
             0.36795828 = queryWeight, product of:
               3.616694 = boost
               7.619839 = idf(docFreq=56, maxDocs=42740)
               0.013351837 = queryNorm
             0.47623995 = fieldWeight in 2528, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.619839 = idf(docFreq=56, maxDocs=42740)
               0.0625 = fieldNorm(doc=2528)
         0.8600149 = weight(abstract_txt:relevance in 2528) [ClassicSimilarity], result of:
           0.8600149 = score(doc=2528,freq=15.0), product of:
             0.7200425 = queryWeight, product of:
               10.929365 = boost
               4.934262 = idf(docFreq=835, maxDocs=42740)
               0.013351837 = queryNorm
             1.1943946 = fieldWeight in 2528, product of:
               3.8729835 = tf(freq=15.0), with freq of:
                 15.0 = termFreq=15.0
               4.934262 = idf(docFreq=835, maxDocs=42740)
               0.0625 = fieldNorm(doc=2528)
       0.2 = coord(5/25)
   

4. Harter, S.P.: Variations in relevance assessments and the measurement of retrieval effectiveness (1996) 0.19

   0.18931861 = sum of:
     0.18931861 = product of:
       0.78882754 = sum of:
         0.033337392 = weight(abstract_txt:argue in 3073) [ClassicSimilarity], result of:
           0.033337392 = score(doc=3073,freq=1.0), product of:
             0.084391035 = queryWeight, product of:
               6.320556 = idf(docFreq=208, maxDocs=42740)
               0.013351837 = queryNorm
             0.39503476 = fieldWeight in 3073, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.320556 = idf(docFreq=208, maxDocs=42740)
               0.0625 = fieldNorm(doc=3073)
         0.014924171 = weight(abstract_txt:article in 3073) [ClassicSimilarity], result of:
           0.014924171 = score(doc=3073,freq=1.0), product of:
             0.0622222 = queryWeight, product of:
               1.2143378 = boost
               3.8376453 = idf(docFreq=2502, maxDocs=42740)
               0.013351837 = queryNorm
             0.23985283 = fieldWeight in 3073, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.8376453 = idf(docFreq=2502, maxDocs=42740)
               0.0625 = fieldNorm(doc=3073)
         0.041476227 = weight(abstract_txt:evaluation in 3073) [ClassicSimilarity], result of:
           0.041476227 = score(doc=3073,freq=3.0), product of:
             0.085279435 = queryWeight, product of:
               1.4216379 = boost
               4.492771 = idf(docFreq=1299, maxDocs=42740)
               0.013351837 = queryNorm
             0.48635674 = fieldWeight in 3073, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.492771 = idf(docFreq=1299, maxDocs=42740)
               0.0625 = fieldNorm(doc=3073)
         0.027323438 = weight(abstract_txt:many in 3073) [ClassicSimilarity], result of:
           0.027323438 = score(doc=3073,freq=1.0), product of:
             0.10659558 = queryWeight, product of:
               1.946624 = boost
               4.1012487 = idf(docFreq=1922, maxDocs=42740)
               0.013351837 = queryNorm
             0.25632805 = fieldWeight in 3073, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1012487 = idf(docFreq=1922, maxDocs=42740)
               0.0625 = fieldNorm(doc=3073)
         0.17523643 = weight(abstract_txt:situational in 3073) [ClassicSimilarity], result of:
           0.17523643 = score(doc=3073,freq=1.0), product of:
             0.36795828 = queryWeight, product of:
               3.616694 = boost
               7.619839 = idf(docFreq=56, maxDocs=42740)
               0.013351837 = queryNorm
             0.47623995 = fieldWeight in 3073, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.619839 = idf(docFreq=56, maxDocs=42740)
               0.0625 = fieldNorm(doc=3073)
         0.49652985 = weight(abstract_txt:relevance in 3073) [ClassicSimilarity], result of:
           0.49652985 = score(doc=3073,freq=5.0), product of:
             0.7200425 = queryWeight, product of:
               10.929365 = boost
               4.934262 = idf(docFreq=835, maxDocs=42740)
               0.013351837 = queryNorm
             0.6895841 = fieldWeight in 3073, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               4.934262 = idf(docFreq=835, maxDocs=42740)
               0.0625 = fieldNorm(doc=3073)
       0.24 = coord(6/25)
   

5. White, H.D.: Relevance in theory (2009) 0.19

   0.18895778 = sum of:
     0.18895778 = product of:
       0.78732413 = sum of:
         0.033419948 = weight(abstract_txt:multidimensional in 873) [ClassicSimilarity], result of:
           0.033419948 = score(doc=873,freq=1.0), product of:
             0.10240117 = queryWeight, product of:
               1.1015502 = boost
               6.96241 = idf(docFreq=109, maxDocs=42740)
               0.013351837 = queryNorm
             0.32636297 = fieldWeight in 873, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.96241 = idf(docFreq=109, maxDocs=42740)
               0.046875 = fieldNorm(doc=873)
         0.017959734 = weight(abstract_txt:evaluation in 873) [ClassicSimilarity], result of:
           0.017959734 = score(doc=873,freq=1.0), product of:
             0.085279435 = queryWeight, product of:
               1.4216379 = boost
               4.492771 = idf(docFreq=1299, maxDocs=42740)
               0.013351837 = queryNorm
             0.21059865 = fieldWeight in 873, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.492771 = idf(docFreq=1299, maxDocs=42740)
               0.046875 = fieldNorm(doc=873)
         0.03851244 = weight(abstract_txt:dynamic in 873) [ClassicSimilarity], result of:
           0.03851244 = score(doc=873,freq=1.0), product of:
             0.1418116 = queryWeight, product of:
               1.8332543 = boost
               5.7935934 = idf(docFreq=353, maxDocs=42740)
               0.013351837 = queryNorm
             0.27157468 = fieldWeight in 873, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7935934 = idf(docFreq=353, maxDocs=42740)
               0.046875 = fieldNorm(doc=873)
         0.028980883 = weight(abstract_txt:many in 873) [ClassicSimilarity], result of:
           0.028980883 = score(doc=873,freq=2.0), product of:
             0.10659558 = queryWeight, product of:
               1.946624 = boost
               4.1012487 = idf(docFreq=1922, maxDocs=42740)
               0.013351837 = queryNorm
             0.27187696 = fieldWeight in 873, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.1012487 = idf(docFreq=1922, maxDocs=42740)
               0.046875 = fieldNorm(doc=873)
         0.09153556 = weight(abstract_txt:concept in 873) [ClassicSimilarity], result of:
           0.09153556 = score(doc=873,freq=2.0), product of:
             0.30435723 = queryWeight, product of:
               5.024498 = boost
               4.5368032 = idf(docFreq=1243, maxDocs=42740)
               0.013351837 = queryNorm
             0.3007504 = fieldWeight in 873, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.5368032 = idf(docFreq=1243, maxDocs=42740)
               0.046875 = fieldNorm(doc=873)
         0.57691556 = weight(abstract_txt:relevance in 873) [ClassicSimilarity], result of:
           0.57691556 = score(doc=873,freq=12.0), product of:
             0.7200425 = queryWeight, product of:
               10.929365 = boost
               4.934262 = idf(docFreq=835, maxDocs=42740)
               0.013351837 = queryNorm
             0.8012243 = fieldWeight in 873, product of:
               3.4641016 = tf(freq=12.0), with freq of:
                 12.0 = termFreq=12.0
               4.934262 = idf(docFreq=835, maxDocs=42740)
               0.046875 = fieldNorm(doc=873)
       0.24 = coord(6/25)