Document (#36542)

Author
Chu, H.
Title
Factors affecting relevance judgment : a report from TREC Legal track
Source
Journal of documentation. 67(2011) no.2, S.264-278
Year
2011
Abstract
Purpose - This study intends to identify factors that affect relevance judgment of retrieved information as part of the 2007 TREC Legal track interactive task. Design/methodology/approach - Data were gathered and analyzed from the participants of the 2007 TREC Legal track interactive task using a questionnaire which includes not only a list of 80 relevance factors identified in prior research, but also a space for expressing their thoughts on relevance judgment in the process. Findings - This study finds that topicality remains a primary criterion, out of various options, for determining relevance, while specificity of the search request, task, or retrieved results also helps greatly in relevance judgment. Research limitations/implications - Relevance research should focus on the topicality and specificity of what is being evaluated as well as conducted in real environments. Practical implications - If multiple relevance factors are presented to assessors, the total number in a list should be below ten to take account of the limited processing capacity of human beings' short-term memory. Otherwise, the assessors might either completely ignore or inadequately consider some of the relevance factors when making judgment decisions. Originality/value - This study presents a method for reducing the artificiality of relevance research design, an apparent limitation in many related studies. Specifically, relevance judgment was made in this research as part of the 2007 TREC Legal track interactive task rather than a study devised for the sake of it. The assessors also served as searchers so that their searching experience would facilitate their subsequent relevance judgments.
Theme
Retrievalstudien
Object
TREC

Similar documents (content)

  1. Ruthven, I.; Baillie, M.; Elsweiler, D.: ¬The relative effects of knowledge, interest and confidence in assessing relevance (2007) 0.52
    0.51671517 = sum of:
      0.51671517 = product of:
        0.9936831 = sum of:
          0.014351648 = weight(abstract_txt:should in 2836) [ClassicSimilarity], result of:
            0.014351648 = score(doc=2836,freq=1.0), product of:
              0.058794484 = queryWeight, product of:
                1.0682297 = boost
                4.463516 = idf(docFreq=1324, maxDocs=42306)
                0.012330901 = queryNorm
              0.24409854 = fieldWeight in 2836, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.463516 = idf(docFreq=1324, maxDocs=42306)
                0.0546875 = fieldNorm(doc=2836)
          0.02624864 = weight(abstract_txt:implications in 2836) [ClassicSimilarity], result of:
            0.02624864 = score(doc=2836,freq=3.0), product of:
              0.060967658 = queryWeight, product of:
                1.0877926 = boost
                4.5452585 = idf(docFreq=1220, maxDocs=42306)
                0.012330901 = queryNorm
              0.43053383 = fieldWeight in 2836, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.5452585 = idf(docFreq=1220, maxDocs=42306)
                0.0546875 = fieldNorm(doc=2836)
          0.015655475 = weight(abstract_txt:part in 2836) [ClassicSimilarity], result of:
            0.015655475 = score(doc=2836,freq=1.0), product of:
              0.062303565 = queryWeight, product of:
                1.0996457 = boost
                4.594786 = idf(docFreq=1161, maxDocs=42306)
                0.012330901 = queryNorm
              0.25127736 = fieldWeight in 2836, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.594786 = idf(docFreq=1161, maxDocs=42306)
                0.0546875 = fieldNorm(doc=2836)
          0.0137495445 = weight(abstract_txt:their in 2836) [ClassicSimilarity], result of:
            0.0137495445 = score(doc=2836,freq=3.0), product of:
              0.045350727 = queryWeight, product of:
                1.1490372 = boost
                3.2007766 = idf(docFreq=4683, maxDocs=42306)
                0.012330901 = queryNorm
              0.30318245 = fieldWeight in 2836, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.2007766 = idf(docFreq=4683, maxDocs=42306)
                0.0546875 = fieldNorm(doc=2836)
          0.008266197 = weight(abstract_txt:this in 2836) [ClassicSimilarity], result of:
            0.008266197 = score(doc=2836,freq=3.0), product of:
              0.035555664 = queryWeight, product of:
                1.1748049 = boost
                2.4544165 = idf(docFreq=9879, maxDocs=42306)
                0.012330901 = queryNorm
              0.23248607 = fieldWeight in 2836, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                2.4544165 = idf(docFreq=9879, maxDocs=42306)
                0.0546875 = fieldNorm(doc=2836)
          0.0098508885 = weight(abstract_txt:also in 2836) [ClassicSimilarity], result of:
            0.0098508885 = score(doc=2836,freq=1.0), product of:
              0.05237002 = queryWeight, product of:
                1.2347623 = boost
                3.4395735 = idf(docFreq=3688, maxDocs=42306)
                0.012330901 = queryNorm
              0.18810168 = fieldWeight in 2836, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4395735 = idf(docFreq=3688, maxDocs=42306)
                0.0546875 = fieldNorm(doc=2836)
          0.02733814 = weight(abstract_txt:study in 2836) [ClassicSimilarity], result of:
            0.02733814 = score(doc=2836,freq=4.0), product of:
              0.07170862 = queryWeight, product of:
                1.6683879 = boost
                3.485616 = idf(docFreq=3522, maxDocs=42306)
                0.012330901 = queryNorm
              0.38123924 = fieldWeight in 2836, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                3.485616 = idf(docFreq=3522, maxDocs=42306)
                0.0546875 = fieldNorm(doc=2836)
          0.023506597 = weight(abstract_txt:research in 2836) [ClassicSimilarity], result of:
            0.023506597 = score(doc=2836,freq=3.0), product of:
              0.07687789 = queryWeight, product of:
                1.931377 = boost
                3.228045 = idf(docFreq=4557, maxDocs=42306)
                0.012330901 = queryNorm
              0.30576536 = fieldWeight in 2836, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.228045 = idf(docFreq=4557, maxDocs=42306)
                0.0546875 = fieldNorm(doc=2836)
          0.071873486 = weight(abstract_txt:factors in 2836) [ClassicSimilarity], result of:
            0.071873486 = score(doc=2836,freq=2.0), product of:
              0.18538924 = queryWeight, product of:
                2.999222 = boost
                5.0128083 = idf(docFreq=764, maxDocs=42306)
                0.012330901 = queryNorm
              0.38768962 = fieldWeight in 2836, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.0128083 = idf(docFreq=764, maxDocs=42306)
                0.0546875 = fieldNorm(doc=2836)
          0.27689445 = weight(abstract_txt:assessors in 2836) [ClassicSimilarity], result of:
            0.27689445 = score(doc=2836,freq=3.0), product of:
              0.33568728 = queryWeight, product of:
                3.1261473 = boost
                8.708245 = idf(docFreq=18, maxDocs=42306)
                0.012330901 = queryNorm
              0.8248583 = fieldWeight in 2836, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                8.708245 = idf(docFreq=18, maxDocs=42306)
                0.0546875 = fieldNorm(doc=2836)
          0.19207451 = weight(abstract_txt:trec in 2836) [ClassicSimilarity], result of:
            0.19207451 = score(doc=2836,freq=4.0), product of:
              0.26305014 = queryWeight, product of:
                3.1954396 = boost
                6.6759505 = idf(docFreq=144, maxDocs=42306)
                0.012330901 = queryNorm
              0.7301821 = fieldWeight in 2836, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                6.6759505 = idf(docFreq=144, maxDocs=42306)
                0.0546875 = fieldNorm(doc=2836)
          0.111566074 = weight(abstract_txt:track in 2836) [ClassicSimilarity], result of:
            0.111566074 = score(doc=2836,freq=1.0), product of:
              0.29069227 = queryWeight, product of:
                3.35914 = boost
                7.0179553 = idf(docFreq=102, maxDocs=42306)
                0.012330901 = queryNorm
              0.38379443 = fieldWeight in 2836, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.0179553 = idf(docFreq=102, maxDocs=42306)
                0.0546875 = fieldNorm(doc=2836)
          0.20230749 = weight(abstract_txt:relevance in 2836) [ClassicSimilarity], result of:
            0.20230749 = score(doc=2836,freq=3.0), product of:
              0.4322683 = queryWeight, product of:
                7.0949388 = boost
                4.9409437 = idf(docFreq=821, maxDocs=42306)
                0.012330901 = queryNorm
              0.46801373 = fieldWeight in 2836, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.9409437 = idf(docFreq=821, maxDocs=42306)
                0.0546875 = fieldNorm(doc=2836)
        0.52 = coord(13/25)
    
  2. Xu, Y.C..; Chen, Z.: Relevance judgment : what do information users consider beyond topicality? (2006) 0.42
    0.42009178 = sum of:
      0.42009178 = product of:
        1.3127868 = sum of:
          0.025979416 = weight(abstract_txt:implications in 74) [ClassicSimilarity], result of:
            0.025979416 = score(doc=74,freq=1.0), product of:
              0.060967658 = queryWeight, product of:
                1.0877926 = boost
                4.5452585 = idf(docFreq=1220, maxDocs=42306)
                0.012330901 = queryNorm
              0.426118 = fieldWeight in 74, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.5452585 = idf(docFreq=1220, maxDocs=42306)
                0.09375 = fieldNorm(doc=74)
          0.0115702655 = weight(abstract_txt:this in 74) [ClassicSimilarity], result of:
            0.0115702655 = score(doc=74,freq=2.0), product of:
              0.035555664 = queryWeight, product of:
                1.1748049 = boost
                2.4544165 = idf(docFreq=9879, maxDocs=42306)
                0.012330901 = queryNorm
              0.32541272 = fieldWeight in 74, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                2.4544165 = idf(docFreq=9879, maxDocs=42306)
                0.09375 = fieldNorm(doc=74)
          0.016887238 = weight(abstract_txt:also in 74) [ClassicSimilarity], result of:
            0.016887238 = score(doc=74,freq=1.0), product of:
              0.05237002 = queryWeight, product of:
                1.2347623 = boost
                3.4395735 = idf(docFreq=3688, maxDocs=42306)
                0.012330901 = queryNorm
              0.32246003 = fieldWeight in 74, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4395735 = idf(docFreq=3688, maxDocs=42306)
                0.09375 = fieldNorm(doc=74)
          0.03313883 = weight(abstract_txt:study in 74) [ClassicSimilarity], result of:
            0.03313883 = score(doc=74,freq=2.0), product of:
              0.07170862 = queryWeight, product of:
                1.6683879 = boost
                3.485616 = idf(docFreq=3522, maxDocs=42306)
                0.012330901 = queryNorm
              0.46213174 = fieldWeight in 74, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.485616 = idf(docFreq=3522, maxDocs=42306)
                0.09375 = fieldNorm(doc=74)
          0.2692222 = weight(abstract_txt:topicality in 74) [ClassicSimilarity], result of:
            0.2692222 = score(doc=74,freq=3.0), product of:
              0.20093091 = queryWeight, product of:
                1.9747845 = boost
                8.251487 = idf(docFreq=29, maxDocs=42306)
                0.012330901 = queryNorm
              1.3398745 = fieldWeight in 74, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                8.251487 = idf(docFreq=29, maxDocs=42306)
                0.09375 = fieldNorm(doc=74)
          0.08712382 = weight(abstract_txt:factors in 74) [ClassicSimilarity], result of:
            0.08712382 = score(doc=74,freq=1.0), product of:
              0.18538924 = queryWeight, product of:
                2.999222 = boost
                5.0128083 = idf(docFreq=764, maxDocs=42306)
                0.012330901 = queryNorm
              0.4699508 = fieldWeight in 74, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.0128083 = idf(docFreq=764, maxDocs=42306)
                0.09375 = fieldNorm(doc=74)
          0.4684001 = weight(abstract_txt:judgment in 74) [ClassicSimilarity], result of:
            0.4684001 = score(doc=74,freq=2.0), product of:
              0.47986788 = queryWeight, product of:
                5.2858863 = boost
                7.3622246 = idf(docFreq=72, maxDocs=42306)
                0.012330901 = queryNorm
              0.97610223 = fieldWeight in 74, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                7.3622246 = idf(docFreq=72, maxDocs=42306)
                0.09375 = fieldNorm(doc=74)
          0.40046498 = weight(abstract_txt:relevance in 74) [ClassicSimilarity], result of:
            0.40046498 = score(doc=74,freq=4.0), product of:
              0.4322683 = queryWeight, product of:
                7.0949388 = boost
                4.9409437 = idf(docFreq=821, maxDocs=42306)
                0.012330901 = queryNorm
              0.92642695 = fieldWeight in 74, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.9409437 = idf(docFreq=821, maxDocs=42306)
                0.09375 = fieldNorm(doc=74)
        0.32 = coord(8/25)
    
  3. Ravana, S.D.; Rajagopal, P.; Balakrishnan, V.: Ranking retrieval systems using pseudo relevance judgments (2015) 0.40
    0.39568812 = sum of:
      0.39568812 = product of:
        1.4131719 = sum of:
          0.009447082 = weight(abstract_txt:this in 4592) [ClassicSimilarity], result of:
            0.009447082 = score(doc=4592,freq=3.0), product of:
              0.035555664 = queryWeight, product of:
                1.1748049 = boost
                2.4544165 = idf(docFreq=9879, maxDocs=42306)
                0.012330901 = queryNorm
              0.26569837 = fieldWeight in 4592, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                2.4544165 = idf(docFreq=9879, maxDocs=42306)
                0.0625 = fieldNorm(doc=4592)
          0.02705774 = weight(abstract_txt:study in 4592) [ClassicSimilarity], result of:
            0.02705774 = score(doc=4592,freq=3.0), product of:
              0.07170862 = queryWeight, product of:
                1.6683879 = boost
                3.485616 = idf(docFreq=3522, maxDocs=42306)
                0.012330901 = queryNorm
              0.377329 = fieldWeight in 4592, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.485616 = idf(docFreq=3522, maxDocs=42306)
                0.0625 = fieldNorm(doc=4592)
          0.058082543 = weight(abstract_txt:factors in 4592) [ClassicSimilarity], result of:
            0.058082543 = score(doc=4592,freq=1.0), product of:
              0.18538924 = queryWeight, product of:
                2.999222 = boost
                5.0128083 = idf(docFreq=764, maxDocs=42306)
                0.012330901 = queryNorm
              0.31330052 = fieldWeight in 4592, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.0128083 = idf(docFreq=764, maxDocs=42306)
                0.0625 = fieldNorm(doc=4592)
          0.31645077 = weight(abstract_txt:assessors in 4592) [ClassicSimilarity], result of:
            0.31645077 = score(doc=4592,freq=3.0), product of:
              0.33568728 = queryWeight, product of:
                3.1261473 = boost
                8.708245 = idf(docFreq=18, maxDocs=42306)
                0.012330901 = queryNorm
              0.9426952 = fieldWeight in 4592, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                8.708245 = idf(docFreq=18, maxDocs=42306)
                0.0625 = fieldNorm(doc=4592)
          0.15521963 = weight(abstract_txt:trec in 4592) [ClassicSimilarity], result of:
            0.15521963 = score(doc=4592,freq=2.0), product of:
              0.26305014 = queryWeight, product of:
                3.1954396 = boost
                6.6759505 = idf(docFreq=144, maxDocs=42306)
                0.012330901 = queryNorm
              0.5900762 = fieldWeight in 4592, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                6.6759505 = idf(docFreq=144, maxDocs=42306)
                0.0625 = fieldNorm(doc=4592)
          0.4937371 = weight(abstract_txt:judgment in 4592) [ClassicSimilarity], result of:
            0.4937371 = score(doc=4592,freq=5.0), product of:
              0.47986788 = queryWeight, product of:
                5.2858863 = boost
                7.3622246 = idf(docFreq=72, maxDocs=42306)
                0.012330901 = queryNorm
              1.0289022 = fieldWeight in 4592, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                7.3622246 = idf(docFreq=72, maxDocs=42306)
                0.0625 = fieldNorm(doc=4592)
          0.35317692 = weight(abstract_txt:relevance in 4592) [ClassicSimilarity], result of:
            0.35317692 = score(doc=4592,freq=7.0), product of:
              0.4322683 = queryWeight, product of:
                7.0949388 = boost
                4.9409437 = idf(docFreq=821, maxDocs=42306)
                0.012330901 = queryNorm
              0.81703174 = fieldWeight in 4592, product of:
                2.6457512 = tf(freq=7.0), with freq of:
                  7.0 = termFreq=7.0
                4.9409437 = idf(docFreq=821, maxDocs=42306)
                0.0625 = fieldNorm(doc=4592)
        0.28 = coord(7/25)
    
  4. Xu, Y.; Yin, H.: Novelty and topicality in interactive information retrieval (2008) 0.38
    0.37687957 = sum of:
      0.37687957 = product of:
        1.1777487 = sum of:
          0.009447082 = weight(abstract_txt:this in 3356) [ClassicSimilarity], result of:
            0.009447082 = score(doc=3356,freq=3.0), product of:
              0.035555664 = queryWeight, product of:
                1.1748049 = boost
                2.4544165 = idf(docFreq=9879, maxDocs=42306)
                0.012330901 = queryNorm
              0.26569837 = fieldWeight in 3356, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                2.4544165 = idf(docFreq=9879, maxDocs=42306)
                0.0625 = fieldNorm(doc=3356)
          0.011258158 = weight(abstract_txt:also in 3356) [ClassicSimilarity], result of:
            0.011258158 = score(doc=3356,freq=1.0), product of:
              0.05237002 = queryWeight, product of:
                1.2347623 = boost
                3.4395735 = idf(docFreq=3688, maxDocs=42306)
                0.012330901 = queryNorm
              0.21497335 = fieldWeight in 3356, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4395735 = idf(docFreq=3688, maxDocs=42306)
                0.0625 = fieldNorm(doc=3356)
          0.031243589 = weight(abstract_txt:study in 3356) [ClassicSimilarity], result of:
            0.031243589 = score(doc=3356,freq=4.0), product of:
              0.07170862 = queryWeight, product of:
                1.6683879 = boost
                3.485616 = idf(docFreq=3522, maxDocs=42306)
                0.012330901 = queryNorm
              0.435702 = fieldWeight in 3356, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                3.485616 = idf(docFreq=3522, maxDocs=42306)
                0.0625 = fieldNorm(doc=3356)
          0.015510331 = weight(abstract_txt:research in 3356) [ClassicSimilarity], result of:
            0.015510331 = score(doc=3356,freq=1.0), product of:
              0.07687789 = queryWeight, product of:
                1.931377 = boost
                3.228045 = idf(docFreq=4557, maxDocs=42306)
                0.012330901 = queryNorm
              0.20175281 = fieldWeight in 3356, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.228045 = idf(docFreq=4557, maxDocs=42306)
                0.0625 = fieldNorm(doc=3356)
          0.20724735 = weight(abstract_txt:topicality in 3356) [ClassicSimilarity], result of:
            0.20724735 = score(doc=3356,freq=4.0), product of:
              0.20093091 = queryWeight, product of:
                1.9747845 = boost
                8.251487 = idf(docFreq=29, maxDocs=42306)
                0.012330901 = queryNorm
              1.0314358 = fieldWeight in 3356, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                8.251487 = idf(docFreq=29, maxDocs=42306)
                0.0625 = fieldNorm(doc=3356)
          0.0473001 = weight(abstract_txt:interactive in 3356) [ClassicSimilarity], result of:
            0.0473001 = score(doc=3356,freq=1.0), product of:
              0.13635756 = queryWeight, product of:
                1.9924232 = boost
                5.5501256 = idf(docFreq=446, maxDocs=42306)
                0.012330901 = queryNorm
              0.34688285 = fieldWeight in 3356, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.5501256 = idf(docFreq=446, maxDocs=42306)
                0.0625 = fieldNorm(doc=3356)
          0.6245335 = weight(abstract_txt:judgment in 3356) [ClassicSimilarity], result of:
            0.6245335 = score(doc=3356,freq=8.0), product of:
              0.47986788 = queryWeight, product of:
                5.2858863 = boost
                7.3622246 = idf(docFreq=72, maxDocs=42306)
                0.012330901 = queryNorm
              1.3014697 = fieldWeight in 3356, product of:
                2.828427 = tf(freq=8.0), with freq of:
                  8.0 = termFreq=8.0
                7.3622246 = idf(docFreq=72, maxDocs=42306)
                0.0625 = fieldNorm(doc=3356)
          0.23120856 = weight(abstract_txt:relevance in 3356) [ClassicSimilarity], result of:
            0.23120856 = score(doc=3356,freq=3.0), product of:
              0.4322683 = queryWeight, product of:
                7.0949388 = boost
                4.9409437 = idf(docFreq=821, maxDocs=42306)
                0.012330901 = queryNorm
              0.53487283 = fieldWeight in 3356, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.9409437 = idf(docFreq=821, maxDocs=42306)
                0.0625 = fieldNorm(doc=3356)
        0.32 = coord(8/25)
    
  5. Spink, A.; Greisdorf, H.: Regions and levels : Measuring and mapping users' relevance judgements (2001) 0.38
    0.37553832 = sum of:
      0.37553832 = product of:
        0.93884575 = sum of:
          0.01731961 = weight(abstract_txt:implications in 587) [ClassicSimilarity], result of:
            0.01731961 = score(doc=587,freq=1.0), product of:
              0.060967658 = queryWeight, product of:
                1.0877926 = boost
                4.5452585 = idf(docFreq=1220, maxDocs=42306)
                0.012330901 = queryNorm
              0.28407866 = fieldWeight in 587, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.5452585 = idf(docFreq=1220, maxDocs=42306)
                0.0625 = fieldNorm(doc=587)
          0.009072347 = weight(abstract_txt:their in 587) [ClassicSimilarity], result of:
            0.009072347 = score(doc=587,freq=1.0), product of:
              0.045350727 = queryWeight, product of:
                1.1490372 = boost
                3.2007766 = idf(docFreq=4683, maxDocs=42306)
                0.012330901 = queryNorm
              0.20004854 = fieldWeight in 587, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.2007766 = idf(docFreq=4683, maxDocs=42306)
                0.0625 = fieldNorm(doc=587)
          0.0054542758 = weight(abstract_txt:this in 587) [ClassicSimilarity], result of:
            0.0054542758 = score(doc=587,freq=1.0), product of:
              0.035555664 = queryWeight, product of:
                1.1748049 = boost
                2.4544165 = idf(docFreq=9879, maxDocs=42306)
                0.012330901 = queryNorm
              0.15340103 = fieldWeight in 587, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                2.4544165 = idf(docFreq=9879, maxDocs=42306)
                0.0625 = fieldNorm(doc=587)
          0.011258158 = weight(abstract_txt:also in 587) [ClassicSimilarity], result of:
            0.011258158 = score(doc=587,freq=1.0), product of:
              0.05237002 = queryWeight, product of:
                1.2347623 = boost
                3.4395735 = idf(docFreq=3688, maxDocs=42306)
                0.012330901 = queryNorm
              0.21497335 = fieldWeight in 587, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.4395735 = idf(docFreq=3688, maxDocs=42306)
                0.0625 = fieldNorm(doc=587)
          0.03424121 = weight(abstract_txt:retrieved in 587) [ClassicSimilarity], result of:
            0.03424121 = score(doc=587,freq=1.0), product of:
              0.09603735 = queryWeight, product of:
                1.3652633 = boost
                5.704649 = idf(docFreq=382, maxDocs=42306)
                0.012330901 = queryNorm
              0.35654056 = fieldWeight in 587, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.704649 = idf(docFreq=382, maxDocs=42306)
                0.0625 = fieldNorm(doc=587)
          0.022092553 = weight(abstract_txt:study in 587) [ClassicSimilarity], result of:
            0.022092553 = score(doc=587,freq=2.0), product of:
              0.07170862 = queryWeight, product of:
                1.6683879 = boost
                3.485616 = idf(docFreq=3522, maxDocs=42306)
                0.012330901 = queryNorm
              0.30808783 = fieldWeight in 587, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.485616 = idf(docFreq=3522, maxDocs=42306)
                0.0625 = fieldNorm(doc=587)
          0.015510331 = weight(abstract_txt:research in 587) [ClassicSimilarity], result of:
            0.015510331 = score(doc=587,freq=1.0), product of:
              0.07687789 = queryWeight, product of:
                1.931377 = boost
                3.228045 = idf(docFreq=4557, maxDocs=42306)
                0.012330901 = queryNorm
              0.20175281 = fieldWeight in 587, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.228045 = idf(docFreq=4557, maxDocs=42306)
                0.0625 = fieldNorm(doc=587)
          0.10362367 = weight(abstract_txt:topicality in 587) [ClassicSimilarity], result of:
            0.10362367 = score(doc=587,freq=1.0), product of:
              0.20093091 = queryWeight, product of:
                1.9747845 = boost
                8.251487 = idf(docFreq=29, maxDocs=42306)
                0.012330901 = queryNorm
              0.5157179 = fieldWeight in 587, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                8.251487 = idf(docFreq=29, maxDocs=42306)
                0.0625 = fieldNorm(doc=587)
          0.22080594 = weight(abstract_txt:judgment in 587) [ClassicSimilarity], result of:
            0.22080594 = score(doc=587,freq=1.0), product of:
              0.47986788 = queryWeight, product of:
                5.2858863 = boost
                7.3622246 = idf(docFreq=72, maxDocs=42306)
                0.012330901 = queryNorm
              0.46013904 = fieldWeight in 587, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.3622246 = idf(docFreq=72, maxDocs=42306)
                0.0625 = fieldNorm(doc=587)
          0.49946764 = weight(abstract_txt:relevance in 587) [ClassicSimilarity], result of:
            0.49946764 = score(doc=587,freq=14.0), product of:
              0.4322683 = queryWeight, product of:
                7.0949388 = boost
                4.9409437 = idf(docFreq=821, maxDocs=42306)
                0.012330901 = queryNorm
              1.1554575 = fieldWeight in 587, product of:
                3.7416575 = tf(freq=14.0), with freq of:
                  14.0 = termFreq=14.0
                4.9409437 = idf(docFreq=821, maxDocs=42306)
                0.0625 = fieldNorm(doc=587)
        0.4 = coord(10/25)