Document (#34211)

Author

Otterbacher, J.
Radev, D.

Title

Exploring fact-focused relevance and novelty detection

Source

Journal of documentation. 64(2008) no.4, S.496-510

Year

2008

Abstract

Purpose - Automated sentence-level relevance and novelty detection would be of direct benefit to many information retrieval systems. However, the low level of agreement between human judges performing the task is an issue of concern. In previous approaches, annotators were asked to identify sentences in a document set that are relevant to a given topic, and then to eliminate sentences that do not provide novel information. This paper aims to explore a new approach in which relevance and novelty judgments are made within the context of specific, factual information needs, rather than with respect to a broad topic. Design/methodology/approach - An experiment is conducted in which annotators perform the novelty detection task in both the topic-focused and fact-focused settings. Findings - Higher levels of agreement between judges are found on the task of identifying relevant sentences in the fact-focused approach. However, the new approach does not improve agreement on novelty judgments. Originality/value - The analysis confirms the intuition that making sentence-level relevance judgments is likely to be the more difficult of the two tasks in the novelty detection framework.

Similar documents (author)

1. Finegan-Dollak, C.; Radev, D.R.: Sentence simplification, compression, and disaggregation for summarization of sophisticated documents (2016) 4.00

   3.9952228 = sum of:
     3.9952228 = weight(author_txt:radev in 3122) [ClassicSimilarity], result of:
       3.9952228 = fieldWeight in 3122, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.131938 = idf(docFreq=12, maxDocs=44218)
         0.4375 = fieldNorm(doc=3122)
   

2. Radev, D.R.; Libner, K.; Fan, W.: Getting answers to natural language questions on the Web (2002) 3.42

   3.4244766 = sum of:
     3.4244766 = weight(author_txt:radev in 5204) [ClassicSimilarity], result of:
       3.4244766 = fieldWeight in 5204, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.131938 = idf(docFreq=12, maxDocs=44218)
         0.375 = fieldNorm(doc=5204)
   

3. Otterbacher, J.; Radev, D.; Kareem, O.: Hierarchical summarization for delivering information to mobile devices (2008) 3.42

   3.4244766 = sum of:
     3.4244766 = weight(author_txt:radev in 2071) [ClassicSimilarity], result of:
       3.4244766 = fieldWeight in 2071, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.131938 = idf(docFreq=12, maxDocs=44218)
         0.375 = fieldNorm(doc=2071)
   

4. Otterbacher, J.; Erkan, G.; Radev, D.R.: Biased LexRank : passage retrieval using random walks with question-based priors (2009) 3.42

   3.4244766 = sum of:
     3.4244766 = weight(author_txt:radev in 2450) [ClassicSimilarity], result of:
       3.4244766 = fieldWeight in 2450, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.131938 = idf(docFreq=12, maxDocs=44218)
         0.375 = fieldNorm(doc=2450)
   

5. Lam, W.; Chan, K.; Radev, D.; Saggion, H.; Teufel, S.: Context-based generic cross-lingual retrieval of documents and automated summaries (2005) 2.85

   2.8537307 = sum of:
     2.8537307 = weight(author_txt:radev in 1965) [ClassicSimilarity], result of:
       2.8537307 = fieldWeight in 1965, product of:
         1.0 = tf(freq=1.0), with freq of:
           1.0 = termFreq=1.0
         9.131938 = idf(docFreq=12, maxDocs=44218)
         0.3125 = fieldNorm(doc=1965)
   

Similar documents (content)

1. Xiaoyan Li, X.; Croft, W.B.: ¬An information-pattern-based approach to novelty detection (2008) 0.44

   0.43788025 = sum of:
     0.43788025 = product of:
       1.563858 = sum of:
         0.0051875184 = weight(abstract_txt:that in 2080) [ClassicSimilarity], result of:
           0.0051875184 = score(doc=2080,freq=1.0), product of:
             0.028023183 = queryWeight, product of:
               1.0555955 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.011203863 = queryNorm
             0.18511525 = fieldWeight in 2080, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.078125 = fieldNorm(doc=2080)
         0.013552967 = weight(abstract_txt:information in 2080) [ClassicSimilarity], result of:
           0.013552967 = score(doc=2080,freq=6.0), product of:
             0.029253885 = queryWeight, product of:
               1.0785259 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.011203863 = queryNorm
             0.46328777 = fieldWeight in 2080, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.078125 = fieldNorm(doc=2080)
         0.061462387 = weight(abstract_txt:level in 2080) [ClassicSimilarity], result of:
           0.061462387 = score(doc=2080,freq=3.0), product of:
             0.100981906 = queryWeight, product of:
               2.0038288 = boost
               4.497956 = idf(docFreq=1337, maxDocs=44218)
               0.011203863 = queryNorm
             0.6086475 = fieldWeight in 2080, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.497956 = idf(docFreq=1337, maxDocs=44218)
               0.078125 = fieldNorm(doc=2080)
         0.16673818 = weight(abstract_txt:sentence in 2080) [ClassicSimilarity], result of:
           0.16673818 = score(doc=2080,freq=4.0), product of:
             0.15590163 = queryWeight, product of:
               2.0329115 = boost
               6.8448567 = idf(docFreq=127, maxDocs=44218)
               0.011203863 = queryNorm
             1.0695089 = fieldWeight in 2080, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.8448567 = idf(docFreq=127, maxDocs=44218)
               0.078125 = fieldNorm(doc=2080)
         0.047312085 = weight(abstract_txt:approach in 2080) [ClassicSimilarity], result of:
           0.047312085 = score(doc=2080,freq=3.0), product of:
             0.09335371 = queryWeight, product of:
               2.2247128 = boost
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.011203863 = queryNorm
             0.5068045 = fieldWeight in 2080, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.078125 = fieldNorm(doc=2080)
         0.32469383 = weight(abstract_txt:detection in 2080) [ClassicSimilarity], result of:
           0.32469383 = score(doc=2080,freq=4.0), product of:
             0.30630445 = queryWeight, product of:
               4.0298123 = boost
               6.784232 = idf(docFreq=135, maxDocs=44218)
               0.011203863 = queryNorm
             1.0600363 = fieldWeight in 2080, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.784232 = idf(docFreq=135, maxDocs=44218)
               0.078125 = fieldNorm(doc=2080)
         0.9449111 = weight(abstract_txt:novelty in 2080) [ClassicSimilarity], result of:
           0.9449111 = score(doc=2080,freq=7.0), product of:
             0.59308326 = queryWeight, product of:
               6.8677053 = boost
               7.7079034 = idf(docFreq=53, maxDocs=44218)
               0.011203863 = queryNorm
             1.5932183 = fieldWeight in 2080, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               7.7079034 = idf(docFreq=53, maxDocs=44218)
               0.078125 = fieldNorm(doc=2080)
       0.28 = coord(7/25)
   

2. Bando, L.L.; Scholer, F.; Turpin, A.: Query-biased summary generation assisted by query expansion : temporality (2015) 0.33

   0.3338513 = sum of:
     0.3338513 = product of:
       0.8346282 = sum of:
         0.01221853 = weight(abstract_txt:between in 1820) [ClassicSimilarity], result of:
           0.01221853 = score(doc=1820,freq=2.0), product of:
             0.03991382 = queryWeight, product of:
               1.0286196 = boost
               3.4633842 = idf(docFreq=3764, maxDocs=44218)
               0.011203863 = queryNorm
             0.3061228 = fieldWeight in 1820, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4633842 = idf(docFreq=3764, maxDocs=44218)
               0.0625 = fieldNorm(doc=1820)
         0.007188036 = weight(abstract_txt:that in 1820) [ClassicSimilarity], result of:
           0.007188036 = score(doc=1820,freq=3.0), product of:
             0.028023183 = queryWeight, product of:
               1.0555955 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.011203863 = queryNorm
             0.2565032 = fieldWeight in 1820, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0625 = fieldNorm(doc=1820)
         0.015589977 = weight(abstract_txt:however in 1820) [ClassicSimilarity], result of:
           0.015589977 = score(doc=1820,freq=1.0), product of:
             0.05915856 = queryWeight, product of:
               1.2522815 = boost
               4.216459 = idf(docFreq=1772, maxDocs=44218)
               0.011203863 = queryNorm
             0.26352867 = fieldWeight in 1820, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.216459 = idf(docFreq=1772, maxDocs=44218)
               0.0625 = fieldNorm(doc=1820)
         0.02071603 = weight(abstract_txt:relevant in 1820) [ClassicSimilarity], result of:
           0.02071603 = score(doc=1820,freq=1.0), product of:
             0.07150312 = queryWeight, product of:
               1.3767519 = boost
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.011203863 = queryNorm
             0.28972206 = fieldWeight in 1820, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.0625 = fieldNorm(doc=1820)
         0.04916991 = weight(abstract_txt:level in 1820) [ClassicSimilarity], result of:
           0.04916991 = score(doc=1820,freq=3.0), product of:
             0.100981906 = queryWeight, product of:
               2.0038288 = boost
               4.497956 = idf(docFreq=1337, maxDocs=44218)
               0.011203863 = queryNorm
             0.486918 = fieldWeight in 1820, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.497956 = idf(docFreq=1337, maxDocs=44218)
               0.0625 = fieldNorm(doc=1820)
         0.13339053 = weight(abstract_txt:sentence in 1820) [ClassicSimilarity], result of:
           0.13339053 = score(doc=1820,freq=4.0), product of:
             0.15590163 = queryWeight, product of:
               2.0329115 = boost
               6.8448567 = idf(docFreq=127, maxDocs=44218)
               0.011203863 = queryNorm
             0.8556071 = fieldWeight in 1820, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.8448567 = idf(docFreq=127, maxDocs=44218)
               0.0625 = fieldNorm(doc=1820)
         0.021852516 = weight(abstract_txt:approach in 1820) [ClassicSimilarity], result of:
           0.021852516 = score(doc=1820,freq=1.0), product of:
             0.09335371 = queryWeight, product of:
               2.2247128 = boost
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.011203863 = queryNorm
             0.234083 = fieldWeight in 1820, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.0625 = fieldNorm(doc=1820)
         0.04989545 = weight(abstract_txt:relevance in 1820) [ClassicSimilarity], result of:
           0.04989545 = score(doc=1820,freq=1.0), product of:
             0.16187182 = queryWeight, product of:
               2.929502 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.011203863 = queryNorm
             0.3082405 = fieldWeight in 1820, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=1820)
         0.23889299 = weight(abstract_txt:sentences in 1820) [ClassicSimilarity], result of:
           0.23889299 = score(doc=1820,freq=5.0), product of:
             0.24432242 = queryWeight, product of:
               3.1168828 = boost
               6.996407 = idf(docFreq=109, maxDocs=44218)
               0.011203863 = queryNorm
             0.9777776 = fieldWeight in 1820, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               6.996407 = idf(docFreq=109, maxDocs=44218)
               0.0625 = fieldNorm(doc=1820)
         0.28571427 = weight(abstract_txt:novelty in 1820) [ClassicSimilarity], result of:
           0.28571427 = score(doc=1820,freq=1.0), product of:
             0.59308326 = queryWeight, product of:
               6.8677053 = boost
               7.7079034 = idf(docFreq=53, maxDocs=44218)
               0.011203863 = queryNorm
             0.48174396 = fieldWeight in 1820, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.7079034 = idf(docFreq=53, maxDocs=44218)
               0.0625 = fieldNorm(doc=1820)
       0.4 = coord(10/25)
   

3. Sweeney, S.; Crestani, F.; Losada, D.E.: 'Show me more' : incremental length summarisation using novelty detection (2008) 0.24

   0.23532084 = sum of:
     0.23532084 = product of:
       0.8404316 = sum of:
         0.010979907 = weight(abstract_txt:that in 2054) [ClassicSimilarity], result of:
           0.010979907 = score(doc=2054,freq=7.0), product of:
             0.028023183 = queryWeight, product of:
               1.0555955 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.011203863 = queryNorm
             0.3918151 = fieldWeight in 2054, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0625 = fieldNorm(doc=2054)
         0.0098976875 = weight(abstract_txt:information in 2054) [ClassicSimilarity], result of:
           0.0098976875 = score(doc=2054,freq=5.0), product of:
             0.029253885 = queryWeight, product of:
               1.0785259 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.011203863 = queryNorm
             0.33833754 = fieldWeight in 2054, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0625 = fieldNorm(doc=2054)
         0.022047557 = weight(abstract_txt:however in 2054) [ClassicSimilarity], result of:
           0.022047557 = score(doc=2054,freq=2.0), product of:
             0.05915856 = queryWeight, product of:
               1.2522815 = boost
               4.216459 = idf(docFreq=1772, maxDocs=44218)
               0.011203863 = queryNorm
             0.37268582 = fieldWeight in 2054, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.216459 = idf(docFreq=1772, maxDocs=44218)
               0.0625 = fieldNorm(doc=2054)
         0.04989545 = weight(abstract_txt:relevance in 2054) [ClassicSimilarity], result of:
           0.04989545 = score(doc=2054,freq=1.0), product of:
             0.16187182 = queryWeight, product of:
               2.929502 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.011203863 = queryNorm
             0.3082405 = fieldWeight in 2054, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.0625 = fieldNorm(doc=2054)
         0.21367238 = weight(abstract_txt:sentences in 2054) [ClassicSimilarity], result of:
           0.21367238 = score(doc=2054,freq=4.0), product of:
             0.24432242 = queryWeight, product of:
               3.1168828 = boost
               6.996407 = idf(docFreq=109, maxDocs=44218)
               0.011203863 = queryNorm
             0.8745509 = fieldWeight in 2054, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.996407 = idf(docFreq=109, maxDocs=44218)
               0.0625 = fieldNorm(doc=2054)
         0.12987754 = weight(abstract_txt:detection in 2054) [ClassicSimilarity], result of:
           0.12987754 = score(doc=2054,freq=1.0), product of:
             0.30630445 = queryWeight, product of:
               4.0298123 = boost
               6.784232 = idf(docFreq=135, maxDocs=44218)
               0.011203863 = queryNorm
             0.4240145 = fieldWeight in 2054, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.784232 = idf(docFreq=135, maxDocs=44218)
               0.0625 = fieldNorm(doc=2054)
         0.40406102 = weight(abstract_txt:novelty in 2054) [ClassicSimilarity], result of:
           0.40406102 = score(doc=2054,freq=2.0), product of:
             0.59308326 = queryWeight, product of:
               6.8677053 = boost
               7.7079034 = idf(docFreq=53, maxDocs=44218)
               0.011203863 = queryNorm
             0.68128884 = fieldWeight in 2054, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.7079034 = idf(docFreq=53, maxDocs=44218)
               0.0625 = fieldNorm(doc=2054)
       0.28 = coord(7/25)
   

4. Aksoy, C.; Can, F.; Kocberber, S.: Novelty detection for topic tracking (2012) 0.23

   0.22769797 = sum of:
     0.22769797 = product of:
       0.81320703 = sum of:
         0.007188036 = weight(abstract_txt:that in 51) [ClassicSimilarity], result of:
           0.007188036 = score(doc=51,freq=3.0), product of:
             0.028023183 = queryWeight, product of:
               1.0555955 = boost
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.011203863 = queryNorm
             0.2565032 = fieldWeight in 51, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               2.3694751 = idf(docFreq=11241, maxDocs=44218)
               0.0625 = fieldNorm(doc=51)
         0.0044263806 = weight(abstract_txt:information in 51) [ClassicSimilarity], result of:
           0.0044263806 = score(doc=51,freq=1.0), product of:
             0.029253885 = queryWeight, product of:
               1.0785259 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.011203863 = queryNorm
             0.15130915 = fieldWeight in 51, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.0625 = fieldNorm(doc=51)
         0.022047557 = weight(abstract_txt:however in 51) [ClassicSimilarity], result of:
           0.022047557 = score(doc=51,freq=2.0), product of:
             0.05915856 = queryWeight, product of:
               1.2522815 = boost
               4.216459 = idf(docFreq=1772, maxDocs=44218)
               0.011203863 = queryNorm
             0.37268582 = fieldWeight in 51, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.216459 = idf(docFreq=1772, maxDocs=44218)
               0.0625 = fieldNorm(doc=51)
         0.030904124 = weight(abstract_txt:approach in 51) [ClassicSimilarity], result of:
           0.030904124 = score(doc=51,freq=2.0), product of:
             0.09335371 = queryWeight, product of:
               2.2247128 = boost
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.011203863 = queryNorm
             0.33104333 = fieldWeight in 51, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.0625 = fieldNorm(doc=51)
         0.070094764 = weight(abstract_txt:topic in 51) [ClassicSimilarity], result of:
           0.070094764 = score(doc=51,freq=3.0), product of:
             0.12790897 = queryWeight, product of:
               2.255222 = boost
               5.062254 = idf(docFreq=760, maxDocs=44218)
               0.011203863 = queryNorm
             0.54800504 = fieldWeight in 51, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.062254 = idf(docFreq=760, maxDocs=44218)
               0.0625 = fieldNorm(doc=51)
         0.18367456 = weight(abstract_txt:detection in 51) [ClassicSimilarity], result of:
           0.18367456 = score(doc=51,freq=2.0), product of:
             0.30630445 = queryWeight, product of:
               4.0298123 = boost
               6.784232 = idf(docFreq=135, maxDocs=44218)
               0.011203863 = queryNorm
             0.59964705 = fieldWeight in 51, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.784232 = idf(docFreq=135, maxDocs=44218)
               0.0625 = fieldNorm(doc=51)
         0.49487165 = weight(abstract_txt:novelty in 51) [ClassicSimilarity], result of:
           0.49487165 = score(doc=51,freq=3.0), product of:
             0.59308326 = queryWeight, product of:
               6.8677053 = boost
               7.7079034 = idf(docFreq=53, maxDocs=44218)
               0.011203863 = queryNorm
             0.834405 = fieldWeight in 51, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.7079034 = idf(docFreq=53, maxDocs=44218)
               0.0625 = fieldNorm(doc=51)
       0.28 = coord(7/25)
   

5. Xu, Y.C..; Chen, Z.: Relevance judgment : what do information users consider beyond topicality? (2006) 0.17

   0.16525406 = sum of:
     0.16525406 = product of:
       0.8262703 = sum of:
         0.006639571 = weight(abstract_txt:information in 5073) [ClassicSimilarity], result of:
           0.006639571 = score(doc=5073,freq=1.0), product of:
             0.029253885 = queryWeight, product of:
               1.0785259 = boost
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.011203863 = queryNorm
             0.22696373 = fieldWeight in 5073, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               2.4209464 = idf(docFreq=10677, maxDocs=44218)
               0.09375 = fieldNorm(doc=5073)
         0.031074043 = weight(abstract_txt:relevant in 5073) [ClassicSimilarity], result of:
           0.031074043 = score(doc=5073,freq=1.0), product of:
             0.07150312 = queryWeight, product of:
               1.3767519 = boost
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.011203863 = queryNorm
             0.43458307 = fieldWeight in 5073, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.635553 = idf(docFreq=1165, maxDocs=44218)
               0.09375 = fieldNorm(doc=5073)
         0.032778773 = weight(abstract_txt:approach in 5073) [ClassicSimilarity], result of:
           0.032778773 = score(doc=5073,freq=1.0), product of:
             0.09335371 = queryWeight, product of:
               2.2247128 = boost
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.011203863 = queryNorm
             0.3511245 = fieldWeight in 5073, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.745328 = idf(docFreq=2839, maxDocs=44218)
               0.09375 = fieldNorm(doc=5073)
         0.14968635 = weight(abstract_txt:relevance in 5073) [ClassicSimilarity], result of:
           0.14968635 = score(doc=5073,freq=4.0), product of:
             0.16187182 = queryWeight, product of:
               2.929502 = boost
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.011203863 = queryNorm
             0.9247215 = fieldWeight in 5073, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.931848 = idf(docFreq=866, maxDocs=44218)
               0.09375 = fieldNorm(doc=5073)
         0.60609156 = weight(abstract_txt:novelty in 5073) [ClassicSimilarity], result of:
           0.60609156 = score(doc=5073,freq=2.0), product of:
             0.59308326 = queryWeight, product of:
               6.8677053 = boost
               7.7079034 = idf(docFreq=53, maxDocs=44218)
               0.011203863 = queryNorm
             1.0219333 = fieldWeight in 5073, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.7079034 = idf(docFreq=53, maxDocs=44218)
               0.09375 = fieldNorm(doc=5073)
       0.2 = coord(5/25)