Document (#7960)

Author
Su, L.T.
Title
Is relevance an adequate criterion for retrieval system evaluation : an empirical enquiry into the user's evaluation
Source
Integrating technologies - converging professions: proceedings of the 56th Annual Meeting of the American Society for Information Science, Columbus, OH, 24-28 October 1993. Ed.: S. Bonzi
Imprint
Medford, NJ : Learned Information
Year
1993
Pages
S.93-104
Abstract
Considers whether relevance is an adequate criterion for retrieval system evaluation. Addresses this question by providing a brief review of the information retrieval literature and by presenting some empirical evidence collected in an earlier study concerning user's assessment of retrieval system performance. Identifies a total of 26 success dimensions through content analysis of 203 users' reasons for system success. The user's judgement of system performance is a multi-dimensional assessment. Although relevance is an important criterion, there are many other considerations affecting assessments of the system success. Discusses dimensions or categories of success related to as well as those not related to relevance. Compares the results from content analysis of verbal data with those from factor analysis of quantitative data. Discusses implications and future research

Similar documents (content)

  1. Su, L.T.: ¬The relevance of recall and precision in user evaluation (1994) 0.48
    0.4830859 = sum of:
      0.4830859 = product of:
        1.006429 = sum of:
          0.023859333 = weight(abstract_txt:data in 6933) [ClassicSimilarity], result of:
            0.023859333 = score(doc=6933,freq=4.0), product of:
              0.064205594 = queryWeight, product of:
                1.0373017 = boost
                3.3975618 = idf(docFreq=3815, maxDocs=41962)
                0.018217988 = queryNorm
              0.37160832 = fieldWeight in 6933, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                3.3975618 = idf(docFreq=3815, maxDocs=41962)
                0.0546875 = fieldNorm(doc=6933)
          0.07377841 = weight(abstract_txt:verbal in 6933) [ClassicSimilarity], result of:
            0.07377841 = score(doc=6933,freq=2.0), product of:
              0.13627625 = queryWeight, product of:
                1.0685965 = boost
                7.0001287 = idf(docFreq=103, maxDocs=41962)
                0.018217988 = queryNorm
              0.54138863 = fieldWeight in 6933, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                7.0001287 = idf(docFreq=103, maxDocs=41962)
                0.0546875 = fieldNorm(doc=6933)
          0.02273974 = weight(abstract_txt:content in 6933) [ClassicSimilarity], result of:
            0.02273974 = score(doc=6933,freq=1.0), product of:
              0.09870617 = queryWeight, product of:
                1.2861475 = boost
                4.212628 = idf(docFreq=1688, maxDocs=41962)
                0.018217988 = queryNorm
              0.23037809 = fieldWeight in 6933, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.212628 = idf(docFreq=1688, maxDocs=41962)
                0.0546875 = fieldNorm(doc=6933)
          0.023514036 = weight(abstract_txt:related in 6933) [ClassicSimilarity], result of:
            0.023514036 = score(doc=6933,freq=1.0), product of:
              0.1009343 = queryWeight, product of:
                1.3005829 = boost
                4.259909 = idf(docFreq=1610, maxDocs=41962)
                0.018217988 = queryNorm
              0.23296379 = fieldWeight in 6933, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.259909 = idf(docFreq=1610, maxDocs=41962)
                0.0546875 = fieldNorm(doc=6933)
          0.030795552 = weight(abstract_txt:performance in 6933) [ClassicSimilarity], result of:
            0.030795552 = score(doc=6933,freq=1.0), product of:
              0.12082198 = queryWeight, product of:
                1.4229565 = boost
                4.66073 = idf(docFreq=1078, maxDocs=41962)
                0.018217988 = queryNorm
              0.25488368 = fieldWeight in 6933, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.66073 = idf(docFreq=1078, maxDocs=41962)
                0.0546875 = fieldNorm(doc=6933)
          0.040355425 = weight(abstract_txt:analysis in 6933) [ClassicSimilarity], result of:
            0.040355425 = score(doc=6933,freq=3.0), product of:
              0.11483615 = queryWeight, product of:
                1.6990398 = boost
                3.7100062 = idf(docFreq=2791, maxDocs=41962)
                0.018217988 = queryNorm
              0.35141745 = fieldWeight in 6933, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                3.7100062 = idf(docFreq=2791, maxDocs=41962)
                0.0546875 = fieldNorm(doc=6933)
          0.071981296 = weight(abstract_txt:evaluation in 6933) [ClassicSimilarity], result of:
            0.071981296 = score(doc=6933,freq=3.0), product of:
              0.16889772 = queryWeight, product of:
                2.0605168 = boost
                4.4993234 = idf(docFreq=1267, maxDocs=41962)
                0.018217988 = queryNorm
              0.42618278 = fieldWeight in 6933, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                4.4993234 = idf(docFreq=1267, maxDocs=41962)
                0.0546875 = fieldNorm(doc=6933)
          0.035680186 = weight(abstract_txt:retrieval in 6933) [ClassicSimilarity], result of:
            0.035680186 = score(doc=6933,freq=2.0), product of:
              0.13328217 = queryWeight, product of:
                2.1135848 = boost
                3.4614017 = idf(docFreq=3579, maxDocs=41962)
                0.018217988 = queryNorm
              0.26770413 = fieldWeight in 6933, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.4614017 = idf(docFreq=3579, maxDocs=41962)
                0.0546875 = fieldNorm(doc=6933)
          0.20220648 = weight(abstract_txt:user's in 6933) [ClassicSimilarity], result of:
            0.20220648 = score(doc=6933,freq=5.0), product of:
              0.2836119 = queryWeight, product of:
                2.6700935 = boost
                5.830389 = idf(docFreq=334, maxDocs=41962)
                0.018217988 = queryNorm
              0.71296895 = fieldWeight in 6933, product of:
                2.236068 = tf(freq=5.0), with freq of:
                  5.0 = termFreq=5.0
                5.830389 = idf(docFreq=334, maxDocs=41962)
                0.0546875 = fieldNorm(doc=6933)
          0.07389462 = weight(abstract_txt:relevance in 6933) [ClassicSimilarity], result of:
            0.07389462 = score(doc=6933,freq=1.0), product of:
              0.27283862 = queryWeight, product of:
                3.0240333 = boost
                4.952436 = idf(docFreq=805, maxDocs=41962)
                0.018217988 = queryNorm
              0.27083635 = fieldWeight in 6933, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.952436 = idf(docFreq=805, maxDocs=41962)
                0.0546875 = fieldNorm(doc=6933)
          0.19667523 = weight(abstract_txt:success in 6933) [ClassicSimilarity], result of:
            0.19667523 = score(doc=6933,freq=3.0), product of:
              0.3633206 = queryWeight, product of:
                3.489624 = boost
                5.7149305 = idf(docFreq=375, maxDocs=41962)
                0.018217988 = queryNorm
              0.54132694 = fieldWeight in 6933, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                5.7149305 = idf(docFreq=375, maxDocs=41962)
                0.0546875 = fieldNorm(doc=6933)
          0.2109486 = weight(abstract_txt:criterion in 6933) [ClassicSimilarity], result of:
            0.2109486 = score(doc=6933,freq=1.0), product of:
              0.4988487 = queryWeight, product of:
                3.5411856 = boost
                7.7324967 = idf(docFreq=49, maxDocs=41962)
                0.018217988 = queryNorm
              0.4228709 = fieldWeight in 6933, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.7324967 = idf(docFreq=49, maxDocs=41962)
                0.0546875 = fieldNorm(doc=6933)
        0.48 = coord(12/25)
    
  2. Vakkari, P.; Jones, S.; MacFarlane, A.; Sormunen, E.: Query exhaustivity, relevance feedback and search success in automatic and interactive query expansion (2004) 0.25
    0.2525 = sum of:
      0.2525 = product of:
        0.7890625 = sum of:
          0.026873183 = weight(abstract_txt:related in 436) [ClassicSimilarity], result of:
            0.026873183 = score(doc=436,freq=1.0), product of:
              0.1009343 = queryWeight, product of:
                1.3005829 = boost
                4.259909 = idf(docFreq=1610, maxDocs=41962)
                0.018217988 = queryNorm
              0.26624432 = fieldWeight in 436, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.259909 = idf(docFreq=1610, maxDocs=41962)
                0.0625 = fieldNorm(doc=436)
          0.028338643 = weight(abstract_txt:those in 436) [ClassicSimilarity], result of:
            0.028338643 = score(doc=436,freq=1.0), product of:
              0.10457119 = queryWeight, product of:
                1.323807 = boost
                4.335977 = idf(docFreq=1492, maxDocs=41962)
                0.018217988 = queryNorm
              0.27099857 = fieldWeight in 436, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.335977 = idf(docFreq=1492, maxDocs=41962)
                0.0625 = fieldNorm(doc=436)
          0.026627677 = weight(abstract_txt:analysis in 436) [ClassicSimilarity], result of:
            0.026627677 = score(doc=436,freq=1.0), product of:
              0.11483615 = queryWeight, product of:
                1.6990398 = boost
                3.7100062 = idf(docFreq=2791, maxDocs=41962)
                0.018217988 = queryNorm
              0.23187539 = fieldWeight in 436, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.7100062 = idf(docFreq=2791, maxDocs=41962)
                0.0625 = fieldNorm(doc=436)
          0.04749534 = weight(abstract_txt:evaluation in 436) [ClassicSimilarity], result of:
            0.04749534 = score(doc=436,freq=1.0), product of:
              0.16889772 = queryWeight, product of:
                2.0605168 = boost
                4.4993234 = idf(docFreq=1267, maxDocs=41962)
                0.018217988 = queryNorm
              0.2812077 = fieldWeight in 436, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.4993234 = idf(docFreq=1267, maxDocs=41962)
                0.0625 = fieldNorm(doc=436)
          0.11943173 = weight(abstract_txt:relevance in 436) [ClassicSimilarity], result of:
            0.11943173 = score(doc=436,freq=2.0), product of:
              0.27283862 = queryWeight, product of:
                3.0240333 = boost
                4.952436 = idf(docFreq=805, maxDocs=41962)
                0.018217988 = queryNorm
              0.4377376 = fieldWeight in 436, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.952436 = idf(docFreq=805, maxDocs=41962)
                0.0625 = fieldNorm(doc=436)
          0.039667867 = weight(abstract_txt:system in 436) [ClassicSimilarity], result of:
            0.039667867 = score(doc=436,freq=1.0), product of:
              0.18872337 = queryWeight, product of:
                3.0802937 = boost
                3.3630488 = idf(docFreq=3949, maxDocs=41962)
                0.018217988 = queryNorm
              0.21019055 = fieldWeight in 436, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.3630488 = idf(docFreq=3949, maxDocs=41962)
                0.0625 = fieldNorm(doc=436)
          0.259544 = weight(abstract_txt:success in 436) [ClassicSimilarity], result of:
            0.259544 = score(doc=436,freq=4.0), product of:
              0.3633206 = queryWeight, product of:
                3.489624 = boost
                5.7149305 = idf(docFreq=375, maxDocs=41962)
                0.018217988 = queryNorm
              0.7143663 = fieldWeight in 436, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                5.7149305 = idf(docFreq=375, maxDocs=41962)
                0.0625 = fieldNorm(doc=436)
          0.24108413 = weight(abstract_txt:criterion in 436) [ClassicSimilarity], result of:
            0.24108413 = score(doc=436,freq=1.0), product of:
              0.4988487 = queryWeight, product of:
                3.5411856 = boost
                7.7324967 = idf(docFreq=49, maxDocs=41962)
                0.018217988 = queryNorm
              0.48328105 = fieldWeight in 436, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.7324967 = idf(docFreq=49, maxDocs=41962)
                0.0625 = fieldNorm(doc=436)
        0.32 = coord(8/25)
    
  3. Brooks, T.A.: Relevance auras : macro patterns and micro scatter (2001) 0.23
    0.22617275 = sum of:
      0.22617275 = product of:
        0.70678985 = sum of:
          0.07677087 = weight(abstract_txt:dimensional in 2592) [ClassicSimilarity], result of:
            0.07677087 = score(doc=2592,freq=2.0), product of:
              0.1280178 = queryWeight, product of:
                1.0357115 = boost
                6.7847075 = idf(docFreq=128, maxDocs=41962)
                0.018217988 = queryNorm
              0.59968907 = fieldWeight in 2592, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                6.7847075 = idf(docFreq=128, maxDocs=41962)
                0.0625 = fieldNorm(doc=2592)
          0.013633905 = weight(abstract_txt:data in 2592) [ClassicSimilarity], result of:
            0.013633905 = score(doc=2592,freq=1.0), product of:
              0.064205594 = queryWeight, product of:
                1.0373017 = boost
                3.3975618 = idf(docFreq=3815, maxDocs=41962)
                0.018217988 = queryNorm
              0.21234761 = fieldWeight in 2592, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.3975618 = idf(docFreq=3815, maxDocs=41962)
                0.0625 = fieldNorm(doc=2592)
          0.10980006 = weight(abstract_txt:assessments in 2592) [ClassicSimilarity], result of:
            0.10980006 = score(doc=2592,freq=3.0), product of:
              0.1419637 = queryWeight, product of:
                1.0906674 = boost
                7.14471 = idf(docFreq=89, maxDocs=41962)
                0.018217988 = queryNorm
              0.77343756 = fieldWeight in 2592, product of:
                1.7320508 = tf(freq=3.0), with freq of:
                  3.0 = termFreq=3.0
                7.14471 = idf(docFreq=89, maxDocs=41962)
                0.0625 = fieldNorm(doc=2592)
          0.03800442 = weight(abstract_txt:related in 2592) [ClassicSimilarity], result of:
            0.03800442 = score(doc=2592,freq=2.0), product of:
              0.1009343 = queryWeight, product of:
                1.3005829 = boost
                4.259909 = idf(docFreq=1610, maxDocs=41962)
                0.018217988 = queryNorm
              0.37652633 = fieldWeight in 2592, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.259909 = idf(docFreq=1610, maxDocs=41962)
                0.0625 = fieldNorm(doc=2592)
          0.051517006 = weight(abstract_txt:empirical in 2592) [ClassicSimilarity], result of:
            0.051517006 = score(doc=2592,freq=1.0), product of:
              0.15576138 = queryWeight, product of:
                1.6156546 = boost
                5.29189 = idf(docFreq=573, maxDocs=41962)
                0.018217988 = queryNorm
              0.33074313 = fieldWeight in 2592, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                5.29189 = idf(docFreq=573, maxDocs=41962)
                0.0625 = fieldNorm(doc=2592)
          0.026627677 = weight(abstract_txt:analysis in 2592) [ClassicSimilarity], result of:
            0.026627677 = score(doc=2592,freq=1.0), product of:
              0.11483615 = queryWeight, product of:
                1.6990398 = boost
                3.7100062 = idf(docFreq=2791, maxDocs=41962)
                0.018217988 = queryNorm
              0.23187539 = fieldWeight in 2592, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.7100062 = idf(docFreq=2791, maxDocs=41962)
                0.0625 = fieldNorm(doc=2592)
          0.0978891 = weight(abstract_txt:assessment in 2592) [ClassicSimilarity], result of:
            0.0978891 = score(doc=2592,freq=2.0), product of:
              0.18965848 = queryWeight, product of:
                1.7828088 = boost
                5.8393846 = idf(docFreq=331, maxDocs=41962)
                0.018217988 = queryNorm
              0.51613355 = fieldWeight in 2592, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                5.8393846 = idf(docFreq=331, maxDocs=41962)
                0.0625 = fieldNorm(doc=2592)
          0.29254678 = weight(abstract_txt:relevance in 2592) [ClassicSimilarity], result of:
            0.29254678 = score(doc=2592,freq=12.0), product of:
              0.27283862 = queryWeight, product of:
                3.0240333 = boost
                4.952436 = idf(docFreq=805, maxDocs=41962)
                0.018217988 = queryNorm
              1.0722338 = fieldWeight in 2592, product of:
                3.4641016 = tf(freq=12.0), with freq of:
                  12.0 = termFreq=12.0
                4.952436 = idf(docFreq=805, maxDocs=41962)
                0.0625 = fieldNorm(doc=2592)
        0.32 = coord(8/25)
    
  4. Maglaughlin, K.L.; Sonnenwald, D.H.: User perspectives an relevance criteria : a comparison among relevant, partially relevant, and not-relevant judgements (2002) 0.22
    0.22203387 = sum of:
      0.22203387 = product of:
        0.92514116 = sum of:
          0.15188809 = weight(abstract_txt:judgement in 202) [ClassicSimilarity], result of:
            0.15188809 = score(doc=202,freq=2.0), product of:
              0.1738662 = queryWeight, product of:
                1.207011 = boost
                7.9068503 = idf(docFreq=41, maxDocs=41962)
                0.018217988 = queryNorm
              0.8735918 = fieldWeight in 202, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                7.9068503 = idf(docFreq=41, maxDocs=41962)
                0.078125 = fieldNorm(doc=202)
          0.03248534 = weight(abstract_txt:content in 202) [ClassicSimilarity], result of:
            0.03248534 = score(doc=202,freq=1.0), product of:
              0.09870617 = queryWeight, product of:
                1.2861475 = boost
                4.212628 = idf(docFreq=1688, maxDocs=41962)
                0.018217988 = queryNorm
              0.32911155 = fieldWeight in 202, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.212628 = idf(docFreq=1688, maxDocs=41962)
                0.078125 = fieldNorm(doc=202)
          0.03359148 = weight(abstract_txt:related in 202) [ClassicSimilarity], result of:
            0.03359148 = score(doc=202,freq=1.0), product of:
              0.1009343 = queryWeight, product of:
                1.3005829 = boost
                4.259909 = idf(docFreq=1610, maxDocs=41962)
                0.018217988 = queryNorm
              0.3328054 = fieldWeight in 202, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.259909 = idf(docFreq=1610, maxDocs=41962)
                0.078125 = fieldNorm(doc=202)
          0.13170607 = weight(abstract_txt:adequate in 202) [ClassicSimilarity], result of:
            0.13170607 = score(doc=202,freq=1.0), product of:
              0.2509708 = queryWeight, product of:
                2.0508327 = boost
                6.717266 = idf(docFreq=137, maxDocs=41962)
                0.018217988 = queryNorm
              0.5247864 = fieldWeight in 202, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                6.717266 = idf(docFreq=137, maxDocs=41962)
                0.078125 = fieldNorm(doc=202)
          0.14928965 = weight(abstract_txt:relevance in 202) [ClassicSimilarity], result of:
            0.14928965 = score(doc=202,freq=2.0), product of:
              0.27283862 = queryWeight, product of:
                3.0240333 = boost
                4.952436 = idf(docFreq=805, maxDocs=41962)
                0.018217988 = queryNorm
              0.547172 = fieldWeight in 202, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                4.952436 = idf(docFreq=805, maxDocs=41962)
                0.078125 = fieldNorm(doc=202)
          0.42618054 = weight(abstract_txt:criterion in 202) [ClassicSimilarity], result of:
            0.42618054 = score(doc=202,freq=2.0), product of:
              0.4988487 = queryWeight, product of:
                3.5411856 = boost
                7.7324967 = idf(docFreq=49, maxDocs=41962)
                0.018217988 = queryNorm
              0.8543283 = fieldWeight in 202, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                7.7324967 = idf(docFreq=49, maxDocs=41962)
                0.078125 = fieldNorm(doc=202)
        0.24 = coord(6/25)
    
  5. Quiroga, L.M.; Mostafa, J.: ¬An experiment in building profiles in information filtering : the role of context of user relevance feedback (2002) 0.19
    0.18941553 = sum of:
      0.18941553 = product of:
        0.59192353 = sum of:
          0.019281251 = weight(abstract_txt:data in 3580) [ClassicSimilarity], result of:
            0.019281251 = score(doc=3580,freq=2.0), product of:
              0.064205594 = queryWeight, product of:
                1.0373017 = boost
                3.3975618 = idf(docFreq=3815, maxDocs=41962)
                0.018217988 = queryNorm
              0.30030486 = fieldWeight in 3580, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.3975618 = idf(docFreq=3815, maxDocs=41962)
                0.0625 = fieldNorm(doc=3580)
          0.06339309 = weight(abstract_txt:assessments in 3580) [ClassicSimilarity], result of:
            0.06339309 = score(doc=3580,freq=1.0), product of:
              0.1419637 = queryWeight, product of:
                1.0906674 = boost
                7.14471 = idf(docFreq=89, maxDocs=41962)
                0.018217988 = queryNorm
              0.44654438 = fieldWeight in 3580, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                7.14471 = idf(docFreq=89, maxDocs=41962)
                0.0625 = fieldNorm(doc=3580)
          0.025988273 = weight(abstract_txt:content in 3580) [ClassicSimilarity], result of:
            0.025988273 = score(doc=3580,freq=1.0), product of:
              0.09870617 = queryWeight, product of:
                1.2861475 = boost
                4.212628 = idf(docFreq=1688, maxDocs=41962)
                0.018217988 = queryNorm
              0.26328924 = fieldWeight in 3580, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                4.212628 = idf(docFreq=1688, maxDocs=41962)
                0.0625 = fieldNorm(doc=3580)
          0.07038983 = weight(abstract_txt:performance in 3580) [ClassicSimilarity], result of:
            0.07038983 = score(doc=3580,freq=4.0), product of:
              0.12082198 = queryWeight, product of:
                1.4229565 = boost
                4.66073 = idf(docFreq=1078, maxDocs=41962)
                0.018217988 = queryNorm
              0.58259124 = fieldWeight in 3580, product of:
                2.0 = tf(freq=4.0), with freq of:
                  4.0 = termFreq=4.0
                4.66073 = idf(docFreq=1078, maxDocs=41962)
                0.0625 = fieldNorm(doc=3580)
          0.026627677 = weight(abstract_txt:analysis in 3580) [ClassicSimilarity], result of:
            0.026627677 = score(doc=3580,freq=1.0), product of:
              0.11483615 = queryWeight, product of:
                1.6990398 = boost
                3.7100062 = idf(docFreq=2791, maxDocs=41962)
                0.018217988 = queryNorm
              0.23187539 = fieldWeight in 3580, product of:
                1.0 = tf(freq=1.0), with freq of:
                  1.0 = termFreq=1.0
                3.7100062 = idf(docFreq=2791, maxDocs=41962)
                0.0625 = fieldNorm(doc=3580)
          0.106708266 = weight(abstract_txt:dimensions in 3580) [ClassicSimilarity], result of:
            0.106708266 = score(doc=3580,freq=2.0), product of:
              0.20088527 = queryWeight, product of:
                1.8348167 = boost
                6.0097303 = idf(docFreq=279, maxDocs=41962)
                0.018217988 = queryNorm
              0.5311901 = fieldWeight in 3580, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                6.0097303 = idf(docFreq=279, maxDocs=41962)
                0.0625 = fieldNorm(doc=3580)
          0.22343631 = weight(abstract_txt:relevance in 3580) [ClassicSimilarity], result of:
            0.22343631 = score(doc=3580,freq=7.0), product of:
              0.27283862 = queryWeight, product of:
                3.0240333 = boost
                4.952436 = idf(docFreq=805, maxDocs=41962)
                0.018217988 = queryNorm
              0.8189321 = fieldWeight in 3580, product of:
                2.6457512 = tf(freq=7.0), with freq of:
                  7.0 = termFreq=7.0
                4.952436 = idf(docFreq=805, maxDocs=41962)
                0.0625 = fieldNorm(doc=3580)
          0.056098837 = weight(abstract_txt:system in 3580) [ClassicSimilarity], result of:
            0.056098837 = score(doc=3580,freq=2.0), product of:
              0.18872337 = queryWeight, product of:
                3.0802937 = boost
                3.3630488 = idf(docFreq=3949, maxDocs=41962)
                0.018217988 = queryNorm
              0.29725432 = fieldWeight in 3580, product of:
                1.4142135 = tf(freq=2.0), with freq of:
                  2.0 = termFreq=2.0
                3.3630488 = idf(docFreq=3949, maxDocs=41962)
                0.0625 = fieldNorm(doc=3580)
        0.32 = coord(8/25)