Document (#38786)

Author

Ruthven, I.

Title

Relevance behaviour in TREC

Source

Journal of documentation. 70(2014) no.6, S.1098-1117

Year

2014

Abstract

Purpose - The purpose of this paper is to examine how various types of TREC data can be used to better understand relevance and serve as test-bed for exploring relevance. The author proposes that there are many interesting studies that can be performed on the TREC data collections that are not directly related to evaluating systems but to learning more about human judgements of information and relevance and that these studies can provide useful research questions for other types of investigation. Design/methodology/approach - Through several case studies the author shows how existing data from TREC can be used to learn more about the factors that may affect relevance judgements and interactive search decisions and answer new research questions for exploring relevance. Findings - The paper uncovers factors, such as familiarity, interest and strictness of relevance criteria, that affect the nature of relevance assessments within TREC, contrasting these against findings from user studies of relevance. Research limitations/implications - The research only considers certain uses of TREC data and assessment given by professional relevance assessors but motivates further exploration of the TREC data so that the research community can further exploit the effort involved in the construction of TREC test collections. Originality/value - The paper presents an original viewpoint on relevance investigations and TREC itself by motivating TREC as a source of inspiration on understanding relevance rather than purely as a source of evaluation material.

Content

Beitrag in einem Special Issue: Festschrift in honour of Nigel Ford

Theme

Retrievalstudien

Object

TREC

Similar documents (author)

1. Ruthven, R.: Interactive information retrieval (2008) 5.14

   5.1444697 = sum of:
     5.1444697 = weight(author_txt:ruthven in 2839) [ClassicSimilarity], result of:
       5.1444697 = fieldWeight in 2839, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.231152 = idf(docFreq=31, maxDocs=44218)
         0.625 = fieldNorm(doc=2839)
   

2. Ruthven, I.: Integrating approaches to relevance (2005) 5.14

   5.1444697 = sum of:
     5.1444697 = weight(author_txt:ruthven in 638) [ClassicSimilarity], result of:
       5.1444697 = fieldWeight in 638, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.231152 = idf(docFreq=31, maxDocs=44218)
         0.625 = fieldNorm(doc=638)
   

3. Ruthven, I.: ¬The language of information need : differentiating conscious and formalized information needs (2019) 5.14

   5.1444697 = sum of:
     5.1444697 = weight(author_txt:ruthven in 5035) [ClassicSimilarity], result of:
       5.1444697 = fieldWeight in 5035, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.231152 = idf(docFreq=31, maxDocs=44218)
         0.625 = fieldNorm(doc=5035)
   

4. Ruthven, I.: Resonance and the experience of relevance (2021) 5.14

   5.1444697 = sum of:
     5.1444697 = weight(author_txt:ruthven in 211) [ClassicSimilarity], result of:
       5.1444697 = fieldWeight in 211, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.231152 = idf(docFreq=31, maxDocs=44218)
         0.625 = fieldNorm(doc=211)
   

5. Ruthven, I.: ¬An information behavior theory of transitions (2022) 5.14

   5.1444697 = sum of:
     5.1444697 = weight(author_txt:ruthven in 530) [ClassicSimilarity], result of:
       5.1444697 = fieldWeight in 530, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         8.231152 = idf(docFreq=31, maxDocs=44218)
         0.625 = fieldNorm(doc=530)
   

Similar documents (content)

1. Chu, H.: Factors affecting relevance judgment : a report from TREC Legal track (2011) 0.60

   0.60183954 = sum of:
     0.60183954 = product of:
       1.3678172 = sum of:
         0.014608985 = weight(abstract_txt:findings in 4540) [ClassicSimilarity], result of:
           0.014608985 = score(doc=4540,freq=1.0), product of:
             0.056324974 = queryWeight, product of:
               1.019442 = boost
               4.1499133 = idf(docFreq=1894, maxDocs=44218)
               0.013313722 = queryNorm
             0.25936958 = fieldWeight in 4540, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1499133 = idf(docFreq=1894, maxDocs=44218)
               0.0625 = fieldNorm(doc=4540)
         0.118692204 = weight(abstract_txt:assessors in 4540) [ClassicSimilarity], result of:
           0.118692204 = score(doc=4540,freq=3.0), product of:
             0.12527142 = queryWeight, product of:
               1.075036 = boost
               8.752448 = idf(docFreq=18, maxDocs=44218)
               0.013313722 = queryNorm
             0.94748026 = fieldWeight in 4540, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               8.752448 = idf(docFreq=18, maxDocs=44218)
               0.0625 = fieldNorm(doc=4540)
         0.018176476 = weight(abstract_txt:purpose in 4540) [ClassicSimilarity], result of:
           0.018176476 = score(doc=4540,freq=1.0), product of:
             0.06515695 = queryWeight, product of:
               1.0964589 = boost
               4.463432 = idf(docFreq=1384, maxDocs=44218)
               0.013313722 = queryNorm
             0.2789645 = fieldWeight in 4540, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.463432 = idf(docFreq=1384, maxDocs=44218)
               0.0625 = fieldNorm(doc=4540)
         0.049919333 = weight(abstract_txt:factors in 4540) [ClassicSimilarity], result of:
           0.049919333 = score(doc=4540,freq=4.0), product of:
             0.080497086 = queryWeight, product of:
               1.2187147 = boost
               4.9611073 = idf(docFreq=841, maxDocs=44218)
               0.013313722 = queryNorm
             0.6201384 = fieldWeight in 4540, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.9611073 = idf(docFreq=841, maxDocs=44218)
               0.0625 = fieldNorm(doc=4540)
         0.042460196 = weight(abstract_txt:affect in 4540) [ClassicSimilarity], result of:
           0.042460196 = score(doc=4540,freq=1.0), product of:
             0.11471203 = queryWeight, product of:
               1.4548441 = boost
               5.9223356 = idf(docFreq=321, maxDocs=44218)
               0.013313722 = queryNorm
             0.37014598 = fieldWeight in 4540, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.9223356 = idf(docFreq=321, maxDocs=44218)
               0.0625 = fieldNorm(doc=4540)
         0.036412008 = weight(abstract_txt:research in 4540) [ClassicSimilarity], result of:
           0.036412008 = score(doc=4540,freq=5.0), product of:
             0.0821815 = queryWeight, product of:
               1.9470137 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.013313722 = queryNorm
             0.4430682 = fieldWeight in 4540, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.0625 = fieldNorm(doc=4540)
         0.016484968 = weight(abstract_txt:that in 4540) [ClassicSimilarity], result of:
           0.016484968 = score(doc=4540,freq=3.0), product of:
             0.06426808 = queryWeight, product of:
               2.037247 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.013313722 = queryNorm
             0.2565032 = fieldWeight in 4540, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0625 = fieldNorm(doc=4540)
         0.018978283 = weight(abstract_txt:data in 4540) [ClassicSimilarity], result of:
           0.018978283 = score(doc=4540,freq=1.0), product of:
             0.091013454 = queryWeight, product of:
               2.0489662 = boost
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.013313722 = queryNorm
             0.20852174 = fieldWeight in 4540, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.0625 = fieldNorm(doc=4540)
         0.031782936 = weight(abstract_txt:studies in 4540) [ClassicSimilarity], result of:
           0.031782936 = score(doc=4540,freq=1.0), product of:
             0.119149886 = queryWeight, product of:
               2.0968812 = boost
               4.26796 = idf(docFreq=1683, maxDocs=44218)
               0.013313722 = queryNorm
             0.2667475 = fieldWeight in 4540, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.26796 = idf(docFreq=1683, maxDocs=44218)
               0.0625 = fieldNorm(doc=4540)
         0.48795483 = weight(abstract_txt:relevance in 4540) [ClassicSimilarity], result of:
           0.48795483 = score(doc=4540,freq=11.0), product of:
             0.47730234 = queryWeight, product of:
               7.2691627 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.013313722 = queryNorm
             1.0223181 = fieldWeight in 4540, product of:
               3.3166249 = tf(freq=11.0), with freq of:
                 11.0 = termFreq=11.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=4540)
         0.532347 = weight(abstract_txt:trec in 4540) [ClassicSimilarity], result of:
           0.532347 = score(doc=4540,freq=3.0), product of:
             0.7340074 = queryWeight, product of:
               8.229003 = boost
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.013313722 = queryNorm
             0.7252611 = fieldWeight in 4540, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.0625 = fieldNorm(doc=4540)
       0.44 = coord(11/25)
   

2. Ruthven, I.; Baillie, M.; Elsweiler, D.: ¬The relative effects of knowledge, interest and confidence in assessing relevance (2007) 0.55

   0.5493934 = sum of:
     0.5493934 = product of:
       1.1445696 = sum of:
         0.0127828615 = weight(abstract_txt:findings in 835) [ClassicSimilarity], result of:
           0.0127828615 = score(doc=835,freq=1.0), product of:
             0.056324974 = queryWeight, product of:
               1.019442 = boost
               4.1499133 = idf(docFreq=1894, maxDocs=44218)
               0.013313722 = queryNorm
             0.22694838 = fieldWeight in 835, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1499133 = idf(docFreq=1894, maxDocs=44218)
               0.0546875 = fieldNorm(doc=835)
         0.10385568 = weight(abstract_txt:assessors in 835) [ClassicSimilarity], result of:
           0.10385568 = score(doc=835,freq=3.0), product of:
             0.12527142 = queryWeight, product of:
               1.075036 = boost
               8.752448 = idf(docFreq=18, maxDocs=44218)
               0.013313722 = queryNorm
             0.82904524 = fieldWeight in 835, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               8.752448 = idf(docFreq=18, maxDocs=44218)
               0.0546875 = fieldNorm(doc=835)
         0.022492241 = weight(abstract_txt:purpose in 835) [ClassicSimilarity], result of:
           0.022492241 = score(doc=835,freq=2.0), product of:
             0.06515695 = queryWeight, product of:
               1.0964589 = boost
               4.463432 = idf(docFreq=1384, maxDocs=44218)
               0.013313722 = queryNorm
             0.34520096 = fieldWeight in 835, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.463432 = idf(docFreq=1384, maxDocs=44218)
               0.0546875 = fieldNorm(doc=835)
         0.02097172 = weight(abstract_txt:questions in 835) [ClassicSimilarity], result of:
           0.02097172 = score(doc=835,freq=1.0), product of:
             0.07834987 = queryWeight, product of:
               1.2023506 = boost
               4.8944926 = idf(docFreq=899, maxDocs=44218)
               0.013313722 = queryNorm
             0.26766756 = fieldWeight in 835, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.8944926 = idf(docFreq=899, maxDocs=44218)
               0.0546875 = fieldNorm(doc=835)
         0.030886013 = weight(abstract_txt:factors in 835) [ClassicSimilarity], result of:
           0.030886013 = score(doc=835,freq=2.0), product of:
             0.080497086 = queryWeight, product of:
               1.2187147 = boost
               4.9611073 = idf(docFreq=841, maxDocs=44218)
               0.013313722 = queryNorm
             0.38369107 = fieldWeight in 835, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.9611073 = idf(docFreq=841, maxDocs=44218)
               0.0546875 = fieldNorm(doc=835)
         0.011184204 = weight(abstract_txt:paper in 835) [ClassicSimilarity], result of:
           0.011184204 = score(doc=835,freq=1.0), product of:
             0.058981538 = queryWeight, product of:
               1.2776611 = boost
               3.467376 = idf(docFreq=3749, maxDocs=44218)
               0.013313722 = queryNorm
             0.18962212 = fieldWeight in 835, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.467376 = idf(docFreq=3749, maxDocs=44218)
               0.0546875 = fieldNorm(doc=835)
         0.064350314 = weight(abstract_txt:affect in 835) [ClassicSimilarity], result of:
           0.064350314 = score(doc=835,freq=3.0), product of:
             0.11471203 = queryWeight, product of:
               1.4548441 = boost
               5.9223356 = idf(docFreq=321, maxDocs=44218)
               0.013313722 = queryNorm
             0.5609727 = fieldWeight in 835, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.9223356 = idf(docFreq=321, maxDocs=44218)
               0.0546875 = fieldNorm(doc=835)
         0.07390921 = weight(abstract_txt:judgements in 835) [ClassicSimilarity], result of:
           0.07390921 = score(doc=835,freq=1.0), product of:
             0.18144624 = queryWeight, product of:
               1.8297256 = boost
               7.448392 = idf(docFreq=69, maxDocs=44218)
               0.013313722 = queryNorm
             0.40733394 = fieldWeight in 835, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.448392 = idf(docFreq=69, maxDocs=44218)
               0.0546875 = fieldNorm(doc=835)
         0.02467904 = weight(abstract_txt:research in 835) [ClassicSimilarity], result of:
           0.02467904 = score(doc=835,freq=3.0), product of:
             0.0821815 = queryWeight, product of:
               1.9470137 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.013313722 = queryNorm
             0.30029923 = fieldWeight in 835, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.0546875 = fieldNorm(doc=835)
         0.018621752 = weight(abstract_txt:that in 835) [ClassicSimilarity], result of:
           0.018621752 = score(doc=835,freq=5.0), product of:
             0.06426808 = queryWeight, product of:
               2.037247 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.013313722 = queryNorm
             0.28975117 = fieldWeight in 835, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0546875 = fieldNorm(doc=835)
         0.22297283 = weight(abstract_txt:relevance in 835) [ClassicSimilarity], result of:
           0.22297283 = score(doc=835,freq=3.0), product of:
             0.47730234 = queryWeight, product of:
               7.2691627 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.013313722 = queryNorm
             0.46715218 = fieldWeight in 835, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0546875 = fieldNorm(doc=835)
         0.53786373 = weight(abstract_txt:trec in 835) [ClassicSimilarity], result of:
           0.53786373 = score(doc=835,freq=4.0), product of:
             0.7340074 = queryWeight, product of:
               8.229003 = boost
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.013313722 = queryNorm
             0.73277694 = fieldWeight in 835, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.0546875 = fieldNorm(doc=835)
       0.48 = coord(12/25)
   

3. Ravana, S.D.; Rajagopal, P.; Balakrishnan, V.: Ranking retrieval systems using pseudo relevance judgments (2015) 0.43

   0.4308114 = sum of:
     0.4308114 = product of:
       1.0770285 = sum of:
         0.014608985 = weight(abstract_txt:findings in 2591) [ClassicSimilarity], result of:
           0.014608985 = score(doc=2591,freq=1.0), product of:
             0.056324974 = queryWeight, product of:
               1.019442 = boost
               4.1499133 = idf(docFreq=1894, maxDocs=44218)
               0.013313722 = queryNorm
             0.25936958 = fieldWeight in 2591, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1499133 = idf(docFreq=1894, maxDocs=44218)
               0.0625 = fieldNorm(doc=2591)
         0.118692204 = weight(abstract_txt:assessors in 2591) [ClassicSimilarity], result of:
           0.118692204 = score(doc=2591,freq=3.0), product of:
             0.12527142 = queryWeight, product of:
               1.075036 = boost
               8.752448 = idf(docFreq=18, maxDocs=44218)
               0.013313722 = queryNorm
             0.94748026 = fieldWeight in 2591, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               8.752448 = idf(docFreq=18, maxDocs=44218)
               0.0625 = fieldNorm(doc=2591)
         0.018176476 = weight(abstract_txt:purpose in 2591) [ClassicSimilarity], result of:
           0.018176476 = score(doc=2591,freq=1.0), product of:
             0.06515695 = queryWeight, product of:
               1.0964589 = boost
               4.463432 = idf(docFreq=1384, maxDocs=44218)
               0.013313722 = queryNorm
             0.2789645 = fieldWeight in 2591, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.463432 = idf(docFreq=1384, maxDocs=44218)
               0.0625 = fieldNorm(doc=2591)
         0.021138918 = weight(abstract_txt:collections in 2591) [ClassicSimilarity], result of:
           0.021138918 = score(doc=2591,freq=1.0), product of:
             0.072056994 = queryWeight, product of:
               1.1530551 = boost
               4.693822 = idf(docFreq=1099, maxDocs=44218)
               0.013313722 = queryNorm
             0.29336387 = fieldWeight in 2591, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.693822 = idf(docFreq=1099, maxDocs=44218)
               0.0625 = fieldNorm(doc=2591)
         0.024959667 = weight(abstract_txt:factors in 2591) [ClassicSimilarity], result of:
           0.024959667 = score(doc=2591,freq=1.0), product of:
             0.080497086 = queryWeight, product of:
               1.2187147 = boost
               4.9611073 = idf(docFreq=841, maxDocs=44218)
               0.013313722 = queryNorm
             0.3100692 = fieldWeight in 2591, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9611073 = idf(docFreq=841, maxDocs=44218)
               0.0625 = fieldNorm(doc=2591)
         0.026272517 = weight(abstract_txt:test in 2591) [ClassicSimilarity], result of:
           0.026272517 = score(doc=2591,freq=1.0), product of:
             0.083295606 = queryWeight, product of:
               1.2397183 = boost
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.013313722 = queryNorm
             0.315413 = fieldWeight in 2591, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.0625 = fieldNorm(doc=2591)
         0.012781948 = weight(abstract_txt:paper in 2591) [ClassicSimilarity], result of:
           0.012781948 = score(doc=2591,freq=1.0), product of:
             0.058981538 = queryWeight, product of:
               1.2776611 = boost
               3.467376 = idf(docFreq=3749, maxDocs=44218)
               0.013313722 = queryNorm
             0.216711 = fieldWeight in 2591, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.467376 = idf(docFreq=3749, maxDocs=44218)
               0.0625 = fieldNorm(doc=2591)
         0.016484968 = weight(abstract_txt:that in 2591) [ClassicSimilarity], result of:
           0.016484968 = score(doc=2591,freq=3.0), product of:
             0.06426808 = queryWeight, product of:
               2.037247 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.013313722 = queryNorm
             0.2565032 = fieldWeight in 2591, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0625 = fieldNorm(doc=2591)
         0.38925326 = weight(abstract_txt:relevance in 2591) [ClassicSimilarity], result of:
           0.38925326 = score(doc=2591,freq=7.0), product of:
             0.47730234 = queryWeight, product of:
               7.2691627 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.013313722 = queryNorm
             0.8155277 = fieldWeight in 2591, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=2591)
         0.43465954 = weight(abstract_txt:trec in 2591) [ClassicSimilarity], result of:
           0.43465954 = score(doc=2591,freq=2.0), product of:
             0.7340074 = queryWeight, product of:
               8.229003 = boost
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.013313722 = queryNorm
             0.5921732 = fieldWeight in 2591, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.0625 = fieldNorm(doc=2591)
       0.4 = coord(10/25)
   

4. Sparck Jones, K.: Reflections on TREC (1997) 0.28

   0.27822348 = sum of:
     0.27822348 = product of:
       0.86944836 = sum of:
         0.021913476 = weight(abstract_txt:findings in 580) [ClassicSimilarity], result of:
           0.021913476 = score(doc=580,freq=1.0), product of:
             0.056324974 = queryWeight, product of:
               1.019442 = boost
               4.1499133 = idf(docFreq=1894, maxDocs=44218)
               0.013313722 = queryNorm
             0.38905436 = fieldWeight in 580, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1499133 = idf(docFreq=1894, maxDocs=44218)
               0.09375 = fieldNorm(doc=580)
         0.037439503 = weight(abstract_txt:factors in 580) [ClassicSimilarity], result of:
           0.037439503 = score(doc=580,freq=1.0), product of:
             0.080497086 = queryWeight, product of:
               1.2187147 = boost
               4.9611073 = idf(docFreq=841, maxDocs=44218)
               0.013313722 = queryNorm
             0.4651038 = fieldWeight in 580, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.9611073 = idf(docFreq=841, maxDocs=44218)
               0.09375 = fieldNorm(doc=580)
         0.055732425 = weight(abstract_txt:test in 580) [ClassicSimilarity], result of:
           0.055732425 = score(doc=580,freq=2.0), product of:
             0.083295606 = queryWeight, product of:
               1.2397183 = boost
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.013313722 = queryNorm
             0.669092 = fieldWeight in 580, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.09375 = fieldNorm(doc=580)
         0.019172922 = weight(abstract_txt:paper in 580) [ClassicSimilarity], result of:
           0.019172922 = score(doc=580,freq=1.0), product of:
             0.058981538 = queryWeight, product of:
               1.2776611 = boost
               3.467376 = idf(docFreq=3749, maxDocs=44218)
               0.013313722 = queryNorm
             0.3250665 = fieldWeight in 580, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.467376 = idf(docFreq=3749, maxDocs=44218)
               0.09375 = fieldNorm(doc=580)
         0.034543462 = weight(abstract_txt:research in 580) [ClassicSimilarity], result of:
           0.034543462 = score(doc=580,freq=2.0), product of:
             0.0821815 = queryWeight, product of:
               1.9470137 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.013313722 = queryNorm
             0.4203314 = fieldWeight in 580, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.09375 = fieldNorm(doc=580)
         0.020189881 = weight(abstract_txt:that in 580) [ClassicSimilarity], result of:
           0.020189881 = score(doc=580,freq=2.0), product of:
             0.06426808 = queryWeight, product of:
               2.037247 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.013313722 = queryNorm
             0.314151 = fieldWeight in 580, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.09375 = fieldNorm(doc=580)
         0.028467426 = weight(abstract_txt:data in 580) [ClassicSimilarity], result of:
           0.028467426 = score(doc=580,freq=1.0), product of:
             0.091013454 = queryWeight, product of:
               2.0489662 = boost
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.013313722 = queryNorm
             0.31278262 = fieldWeight in 580, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.09375 = fieldNorm(doc=580)
         0.6519893 = weight(abstract_txt:trec in 580) [ClassicSimilarity], result of:
           0.6519893 = score(doc=580,freq=2.0), product of:
             0.7340074 = queryWeight, product of:
               8.229003 = boost
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.013313722 = queryNorm
             0.8882598 = fieldWeight in 580, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.09375 = fieldNorm(doc=580)
       0.32 = coord(8/25)
   

5. Behnert, C.; Lewandowski, D.: ¬A framework for designing retrieval effectiveness studies of library information systems using human relevance assessments (2017) 0.25

   0.24782486 = sum of:
     0.24782486 = product of:
       0.5632383 = sum of:
         0.014608985 = weight(abstract_txt:findings in 3700) [ClassicSimilarity], result of:
           0.014608985 = score(doc=3700,freq=1.0), product of:
             0.056324974 = queryWeight, product of:
               1.019442 = boost
               4.1499133 = idf(docFreq=1894, maxDocs=44218)
               0.013313722 = queryNorm
             0.25936958 = fieldWeight in 3700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.1499133 = idf(docFreq=1894, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.068526976 = weight(abstract_txt:assessors in 3700) [ClassicSimilarity], result of:
           0.068526976 = score(doc=3700,freq=1.0), product of:
             0.12527142 = queryWeight, product of:
               1.075036 = boost
               8.752448 = idf(docFreq=18, maxDocs=44218)
               0.013313722 = queryNorm
             0.547028 = fieldWeight in 3700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.752448 = idf(docFreq=18, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.018176476 = weight(abstract_txt:purpose in 3700) [ClassicSimilarity], result of:
           0.018176476 = score(doc=3700,freq=1.0), product of:
             0.06515695 = queryWeight, product of:
               1.0964589 = boost
               4.463432 = idf(docFreq=1384, maxDocs=44218)
               0.013313722 = queryNorm
             0.2789645 = fieldWeight in 3700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.463432 = idf(docFreq=1384, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.025793059 = weight(abstract_txt:types in 3700) [ClassicSimilarity], result of:
           0.025793059 = score(doc=3700,freq=2.0), product of:
             0.065304965 = queryWeight, product of:
               1.0977036 = boost
               4.4684987 = idf(docFreq=1377, maxDocs=44218)
               0.013313722 = queryNorm
             0.3949632 = fieldWeight in 3700, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.4684987 = idf(docFreq=1377, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.026272517 = weight(abstract_txt:test in 3700) [ClassicSimilarity], result of:
           0.026272517 = score(doc=3700,freq=1.0), product of:
             0.083295606 = queryWeight, product of:
               1.2397183 = boost
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.013313722 = queryNorm
             0.315413 = fieldWeight in 3700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.046608 = idf(docFreq=772, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.012781948 = weight(abstract_txt:paper in 3700) [ClassicSimilarity], result of:
           0.012781948 = score(doc=3700,freq=1.0), product of:
             0.058981538 = queryWeight, product of:
               1.2776611 = boost
               3.467376 = idf(docFreq=3749, maxDocs=44218)
               0.013313722 = queryNorm
             0.216711 = fieldWeight in 3700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.467376 = idf(docFreq=3749, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.016283944 = weight(abstract_txt:research in 3700) [ClassicSimilarity], result of:
           0.016283944 = score(doc=3700,freq=1.0), product of:
             0.0821815 = queryWeight, product of:
               1.9470137 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.013313722 = queryNorm
             0.19814612 = fieldWeight in 3700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.009517602 = weight(abstract_txt:that in 3700) [ClassicSimilarity], result of:
           0.009517602 = score(doc=3700,freq=1.0), product of:
             0.06426808 = queryWeight, product of:
               2.037247 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.013313722 = queryNorm
             0.1480922 = fieldWeight in 3700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.018978283 = weight(abstract_txt:data in 3700) [ClassicSimilarity], result of:
           0.018978283 = score(doc=3700,freq=1.0), product of:
             0.091013454 = queryWeight, product of:
               2.0489662 = boost
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.013313722 = queryNorm
             0.20852174 = fieldWeight in 3700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.04494786 = weight(abstract_txt:studies in 3700) [ClassicSimilarity], result of:
           0.04494786 = score(doc=3700,freq=2.0), product of:
             0.119149886 = queryWeight, product of:
               2.0968812 = boost
               4.26796 = idf(docFreq=1683, maxDocs=44218)
               0.013313722 = queryNorm
             0.37723795 = fieldWeight in 3700, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.26796 = idf(docFreq=1683, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
         0.3073507 = weight(abstract_txt:trec in 3700) [ClassicSimilarity], result of:
           0.3073507 = score(doc=3700,freq=1.0), product of:
             0.7340074 = queryWeight, product of:
               8.229003 = boost
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.013313722 = queryNorm
             0.4187297 = fieldWeight in 3700, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.699675 = idf(docFreq=147, maxDocs=44218)
               0.0625 = fieldNorm(doc=3700)
       0.44 = coord(11/25)