Document (#28644)

Author
Cleverdon, C.W.
Mills, J.
Title
¬The testing of index language devices
Source
Theory of subject analysis: a sourcebook. Ed.: L.M. Chan, et al
Imprint
Littleton, CO : Libraries Unlimited
Year
1985
Pages
S.221-246
Abstract
A landmark event in the twentieth-century development of subject analysis theory was a retrieval experiment, begun in 1957, by Cyril Cleverdon, Librarian of the Cranfield Institute of Technology. For this work he received the Professional Award of the Special Libraries Association in 1962 and the Award of Merit of the American Society for Information Science in 1970. The objective of the experiment, called Cranfield I, was to test the ability of four indexing systems-UDC, Facet, Uniterm, and Alphabetic-Subject Headings-to retrieve material responsive to questions addressed to a collection of documents. The experiment was ambitious in scale, consisting of eighteen thousand documents and twelve hundred questions. Prior to Cranfield I, the question of what constitutes good indexing was approached subjectively and reference was made to assumptions in the form of principles that should be observed or user needs that should be met. Cranfield I was the first large-scale effort to use objective criteria for determining the parameters of good indexing. Its creative impetus was the definition of user satisfaction in terms of precision and recall. Out of the experiment emerged the definition of recall as the percentage of relevant documents retrieved and precision as the percentage of retrieved documents that were relevant. Operationalizing the concept of user satisfaction, that is, making it measurable, meant that it could be studied empirically and manipulated as a variable in mathematical equations. Much has been made of the fact that the experimental methodology of Cranfield I was seriously flawed. This is unfortunate as it tends to diminish Cleverdon's contribu tion, which was not methodological-such contributions can be left to benchmark researchers-but rather creative: the introduction of a new paradigm, one that proved to be eminently productive. The criticism leveled at the methodological shortcomings of Cranfield I underscored the need for more precise definitions of the variables involved in information retrieval. Particularly important was the need for a definition of the dependent variable index language. Like the definitions of precision and recall, that of index language provided a new way of looking at the indexing process. It was a re-visioning that stimulated research activity and led not only to a better understanding of indexing but also the design of better retrieval systems." Cranfield I was followed by Cranfield II. While Cranfield I was a wholesale comparison of four indexing "systems," Cranfield II aimed to single out various individual factors in index languages, called "indexing devices," and to measure how variations in these affected retrieval performance. The following selection represents the thinking at Cranfield midway between these two notable retrieval experiments.
Footnote
Nachdruck des Originalartikels mit Kommentierung durch die Herausgeber
Original in: Aslib proceedings 15(1963) no.4, S.106-130.
Theme
Retrievalstudien
Object
Cranfield

Similar documents (author)

  1. Cleverdon, C.W.; Mills, J.: ¬The testing of index language devices (1997) 6.29 
    6.2852325 = sum of:
  6.2852325 = sum of:
    2.7096782 = weight(author_txt:mills in 576) [ClassicSimilarity], result of:
      2.7096782 = score(doc=576,freq=1.0), product of:
        0.63922495 = queryWeight, product of:
          8.478011 = idf(docFreq=24, maxDocs=44218)
          0.07539798 = queryNorm
        4.2390056 = fieldWeight in 576, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.478011 = idf(docFreq=24, maxDocs=44218)
          0.5 = fieldNorm(doc=576)
    3.5755544 = weight(author_txt:cleverdon in 576) [ClassicSimilarity], result of:
      3.5755544 = score(doc=576,freq=1.0), product of:
        0.7690198 = queryWeight, product of:
          1.0968366 = boost
          9.298992 = idf(docFreq=10, maxDocs=44218)
          0.07539798 = queryNorm
        4.649496 = fieldWeight in 576, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          9.298992 = idf(docFreq=10, maxDocs=44218)
          0.5 = fieldNorm(doc=576)
  2. Cleverdon, C.W.; Mills, J.: ¬The testing of index language devices (1963) 6.29 
    6.2852325 = sum of:
  6.2852325 = sum of:
    2.7096782 = weight(author_txt:mills in 577) [ClassicSimilarity], result of:
      2.7096782 = score(doc=577,freq=1.0), product of:
        0.63922495 = queryWeight, product of:
          8.478011 = idf(docFreq=24, maxDocs=44218)
          0.07539798 = queryNorm
        4.2390056 = fieldWeight in 577, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.478011 = idf(docFreq=24, maxDocs=44218)
          0.5 = fieldNorm(doc=577)
    3.5755544 = weight(author_txt:cleverdon in 577) [ClassicSimilarity], result of:
      3.5755544 = score(doc=577,freq=1.0), product of:
        0.7690198 = queryWeight, product of:
          1.0968366 = boost
          9.298992 = idf(docFreq=10, maxDocs=44218)
          0.07539798 = queryNorm
        4.649496 = fieldWeight in 577, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          9.298992 = idf(docFreq=10, maxDocs=44218)
          0.5 = fieldNorm(doc=577)
  3. Cleverdon, C.W.; Mills, J.; Keen, M.: Factors determining the performance of indexing systems : ASLIB Cranfield research project (1966) 4.71 
    4.7139244 = sum of:
  4.7139244 = sum of:
    2.0322585 = weight(author_txt:mills in 5363) [ClassicSimilarity], result of:
      2.0322585 = score(doc=5363,freq=1.0), product of:
        0.63922495 = queryWeight, product of:
          8.478011 = idf(docFreq=24, maxDocs=44218)
          0.07539798 = queryNorm
        3.179254 = fieldWeight in 5363, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          8.478011 = idf(docFreq=24, maxDocs=44218)
          0.375 = fieldNorm(doc=5363)
    2.681666 = weight(author_txt:cleverdon in 5363) [ClassicSimilarity], result of:
      2.681666 = score(doc=5363,freq=1.0), product of:
        0.7690198 = queryWeight, product of:
          1.0968366 = boost
          9.298992 = idf(docFreq=10, maxDocs=44218)
          0.07539798 = queryNorm
        3.487122 = fieldWeight in 5363, product of:
          1.0 = tf(freq=1.0), with freq of:
            1.0 = termFreq=1.0
          9.298992 = idf(docFreq=10, maxDocs=44218)
          0.375 = fieldNorm(doc=5363)
  4. Cleverdon, C.W.: On the inverse relationship of recall and precision (1972) 2.23 
    2.2347214 = sum of:
  2.2347214 = product of:
    4.469443 = sum of:
      4.469443 = weight(author_txt:cleverdon in 1843) [ClassicSimilarity], result of:
        4.469443 = score(doc=1843,freq=1.0), product of:
          0.7690198 = queryWeight, product of:
            1.0968366 = boost
            9.298992 = idf(docFreq=10, maxDocs=44218)
            0.07539798 = queryNorm
          5.81187 = fieldWeight in 1843, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.298992 = idf(docFreq=10, maxDocs=44218)
            0.625 = fieldNorm(doc=1843)
    0.5 = coord(1/2)
  5. Cleverdon, C.W.: Evaluation tests of information retrieval systems (1970) 2.23 
    2.2347214 = sum of:
  2.2347214 = product of:
    4.469443 = sum of:
      4.469443 = weight(author_txt:cleverdon in 2272) [ClassicSimilarity], result of:
        4.469443 = score(doc=2272,freq=1.0), product of:
          0.7690198 = queryWeight, product of:
            1.0968366 = boost
            9.298992 = idf(docFreq=10, maxDocs=44218)
            0.07539798 = queryNorm
          5.81187 = fieldWeight in 2272, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            9.298992 = idf(docFreq=10, maxDocs=44218)
            0.625 = fieldNorm(doc=2272)
    0.5 = coord(1/2)

Similar documents (content)

  1. Fugmann, R.: ¬The complementarity of natural and indexing languages (1985) 0.45 
    0.44790304 = sum of:
  0.44790304 = product of:
    0.93313134 = sum of:
      0.02951254 = weight(abstract_txt:objective in 3641) [ClassicSimilarity], result of:
        0.02951254 = score(doc=3641,freq=2.0), product of:
          0.07722856 = queryWeight, product of:
            1.0873349 = boost
            5.7646422 = idf(docFreq=376, maxDocs=44218)
            0.012320896 = queryNorm
          0.3821454 = fieldWeight in 3641, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.7646422 = idf(docFreq=376, maxDocs=44218)
            0.046875 = fieldNorm(doc=3641)
      0.024441741 = weight(abstract_txt:definitions in 3641) [ClassicSimilarity], result of:
        0.024441741 = score(doc=3641,freq=1.0), product of:
          0.08581008 = queryWeight, product of:
            1.1461554 = boost
            6.0764866 = idf(docFreq=275, maxDocs=44218)
            0.012320896 = queryNorm
          0.2848353 = fieldWeight in 3641, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            6.0764866 = idf(docFreq=275, maxDocs=44218)
            0.046875 = fieldNorm(doc=3641)
      0.035856374 = weight(abstract_txt:language in 3641) [ClassicSimilarity], result of:
        0.035856374 = score(doc=3641,freq=9.0), product of:
          0.06096923 = queryWeight, product of:
            1.1832467 = boost
            4.1820874 = idf(docFreq=1834, maxDocs=44218)
            0.012320896 = queryNorm
          0.58810604 = fieldWeight in 3641, product of:
            3.0 = tf(freq=9.0), with freq of:
              9.0 = termFreq=9.0
            4.1820874 = idf(docFreq=1834, maxDocs=44218)
            0.046875 = fieldNorm(doc=3641)
      0.027375868 = weight(abstract_txt:definition in 3641) [ClassicSimilarity], result of:
        0.027375868 = score(doc=3641,freq=1.0), product of:
          0.10593981 = queryWeight, product of:
            1.5597305 = boost
            5.512738 = idf(docFreq=484, maxDocs=44218)
            0.012320896 = queryNorm
          0.25840962 = fieldWeight in 3641, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.512738 = idf(docFreq=484, maxDocs=44218)
            0.046875 = fieldNorm(doc=3641)
      0.02756174 = weight(abstract_txt:precision in 3641) [ClassicSimilarity], result of:
        0.02756174 = score(doc=3641,freq=1.0), product of:
          0.10641881 = queryWeight, product of:
            1.5632526 = boost
            5.5251865 = idf(docFreq=478, maxDocs=44218)
            0.012320896 = queryNorm
          0.25899312 = fieldWeight in 3641, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.5251865 = idf(docFreq=478, maxDocs=44218)
            0.046875 = fieldNorm(doc=3641)
      0.031046255 = weight(abstract_txt:recall in 3641) [ClassicSimilarity], result of:
        0.031046255 = score(doc=3641,freq=1.0), product of:
          0.115209095 = queryWeight, product of:
            1.6265348 = boost
            5.7488523 = idf(docFreq=382, maxDocs=44218)
            0.012320896 = queryNorm
          0.26947746 = fieldWeight in 3641, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.7488523 = idf(docFreq=382, maxDocs=44218)
            0.046875 = fieldNorm(doc=3641)
      0.022859208 = weight(abstract_txt:retrieval in 3641) [ClassicSimilarity], result of:
        0.022859208 = score(doc=3641,freq=4.0), product of:
          0.07016454 = queryWeight, product of:
            1.638714 = boost
            3.4751394 = idf(docFreq=3720, maxDocs=44218)
            0.012320896 = queryNorm
          0.3257943 = fieldWeight in 3641, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            3.4751394 = idf(docFreq=3720, maxDocs=44218)
            0.046875 = fieldNorm(doc=3641)
      0.046668872 = weight(abstract_txt:index in 3641) [ClassicSimilarity], result of:
        0.046668872 = score(doc=3641,freq=4.0), product of:
          0.10482345 = queryWeight, product of:
            1.7915071 = boost
            4.74895 = idf(docFreq=1040, maxDocs=44218)
            0.012320896 = queryNorm
          0.44521406 = fieldWeight in 3641, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            4.74895 = idf(docFreq=1040, maxDocs=44218)
            0.046875 = fieldNorm(doc=3641)
      0.018445417 = weight(abstract_txt:that in 3641) [ClassicSimilarity], result of:
        0.018445417 = score(doc=3641,freq=8.0), product of:
          0.058715135 = queryWeight, product of:
            2.0112016 = boost
            2.3694751 = idf(docFreq=11241, maxDocs=44218)
            0.012320896 = queryNorm
          0.314151 = fieldWeight in 3641, product of:
            2.828427 = tf(freq=8.0), with freq of:
              8.0 = termFreq=8.0
            2.3694751 = idf(docFreq=11241, maxDocs=44218)
            0.046875 = fieldNorm(doc=3641)
      0.039534595 = weight(abstract_txt:experiment in 3641) [ClassicSimilarity], result of:
        0.039534595 = score(doc=3641,freq=1.0), product of:
          0.14897443 = queryWeight, product of:
            2.1357243 = boost
            5.6614056 = idf(docFreq=417, maxDocs=44218)
            0.012320896 = queryNorm
          0.2653784 = fieldWeight in 3641, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.6614056 = idf(docFreq=417, maxDocs=44218)
            0.046875 = fieldNorm(doc=3641)
      0.04437126 = weight(abstract_txt:indexing in 3641) [ClassicSimilarity], result of:
        0.04437126 = score(doc=3641,freq=2.0), product of:
          0.1538854 = queryWeight, product of:
            2.8714883 = boost
            4.3495874 = idf(docFreq=1551, maxDocs=44218)
            0.012320896 = queryNorm
          0.28833964 = fieldWeight in 3641, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.3495874 = idf(docFreq=1551, maxDocs=44218)
            0.046875 = fieldNorm(doc=3641)
      0.58545744 = weight(abstract_txt:cranfield in 3641) [ClassicSimilarity], result of:
        0.58545744 = score(doc=3641,freq=3.0), product of:
          0.87269187 = queryWeight, product of:
            8.572079 = boost
            8.2629 = idf(docFreq=30, maxDocs=44218)
            0.012320896 = queryNorm
          0.67086387 = fieldWeight in 3641, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            8.2629 = idf(docFreq=30, maxDocs=44218)
            0.046875 = fieldNorm(doc=3641)
    0.48 = coord(12/25)
  2. Harter, S.P.; Hert, C.A.: Evaluation of information retrieval systems : approaches, issues, and methods (1997) 0.28 
    0.27806628 = sum of:
  0.27806628 = product of:
    1.3903314 = sum of:
      0.0254189 = weight(abstract_txt:documents in 2264) [ClassicSimilarity], result of:
        0.0254189 = score(doc=2264,freq=1.0), product of:
          0.078946374 = queryWeight, product of:
            1.5547316 = boost
            4.1213026 = idf(docFreq=1949, maxDocs=44218)
            0.012320896 = queryNorm
          0.32197678 = fieldWeight in 2264, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.1213026 = idf(docFreq=1949, maxDocs=44218)
            0.078125 = fieldNorm(doc=2264)
      0.051743753 = weight(abstract_txt:recall in 2264) [ClassicSimilarity], result of:
        0.051743753 = score(doc=2264,freq=1.0), product of:
          0.115209095 = queryWeight, product of:
            1.6265348 = boost
            5.7488523 = idf(docFreq=382, maxDocs=44218)
            0.012320896 = queryNorm
          0.44912907 = fieldWeight in 2264, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.7488523 = idf(docFreq=382, maxDocs=44218)
            0.078125 = fieldNorm(doc=2264)
      0.04259562 = weight(abstract_txt:retrieval in 2264) [ClassicSimilarity], result of:
        0.04259562 = score(doc=2264,freq=5.0), product of:
          0.07016454 = queryWeight, product of:
            1.638714 = boost
            3.4751394 = idf(docFreq=3720, maxDocs=44218)
            0.012320896 = queryNorm
          0.6070819 = fieldWeight in 2264, product of:
            2.236068 = tf(freq=5.0), with freq of:
              5.0 = termFreq=5.0
            3.4751394 = idf(docFreq=3720, maxDocs=44218)
            0.078125 = fieldNorm(doc=2264)
      0.010869067 = weight(abstract_txt:that in 2264) [ClassicSimilarity], result of:
        0.010869067 = score(doc=2264,freq=1.0), product of:
          0.058715135 = queryWeight, product of:
            2.0112016 = boost
            2.3694751 = idf(docFreq=11241, maxDocs=44218)
            0.012320896 = queryNorm
          0.18511525 = fieldWeight in 2264, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            2.3694751 = idf(docFreq=11241, maxDocs=44218)
            0.078125 = fieldNorm(doc=2264)
      1.259704 = weight(abstract_txt:cranfield in 2264) [ClassicSimilarity], result of:
        1.259704 = score(doc=2264,freq=5.0), product of:
          0.87269187 = queryWeight, product of:
            8.572079 = boost
            8.2629 = idf(docFreq=30, maxDocs=44218)
            0.012320896 = queryNorm
          1.4434694 = fieldWeight in 2264, product of:
            2.236068 = tf(freq=5.0), with freq of:
              5.0 = termFreq=5.0
            8.2629 = idf(docFreq=30, maxDocs=44218)
            0.078125 = fieldNorm(doc=2264)
    0.2 = coord(5/25)
  3. Lancaster, F.W.: Evaluating the performance of a large computerized information system (1985) 0.21 
    0.21096602 = sum of:
  0.21096602 = product of:
    0.4057039 = sum of:
      0.017891034 = weight(abstract_txt:scale in 3649) [ClassicSimilarity], result of:
        0.017891034 = score(doc=3649,freq=1.0), product of:
          0.0696959 = queryWeight, product of:
            1.0329467 = boost
            5.476297 = idf(docFreq=502, maxDocs=44218)
            0.012320896 = queryNorm
          0.2567014 = fieldWeight in 3649, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.476297 = idf(docFreq=502, maxDocs=44218)
            0.046875 = fieldNorm(doc=3649)
      0.008167016 = weight(abstract_txt:user in 3649) [ClassicSimilarity], result of:
        0.008167016 = score(doc=3649,freq=1.0), product of:
          0.047299467 = queryWeight, product of:
            1.0421928 = boost
            3.6835442 = idf(docFreq=3020, maxDocs=44218)
            0.012320896 = queryNorm
          0.17266613 = fieldWeight in 3649, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.6835442 = idf(docFreq=3020, maxDocs=44218)
            0.046875 = fieldNorm(doc=3649)
      0.026375609 = weight(abstract_txt:good in 3649) [ClassicSimilarity], result of:
        0.026375609 = score(doc=3649,freq=2.0), product of:
          0.07165424 = queryWeight, product of:
            1.0473583 = boost
            5.5527015 = idf(docFreq=465, maxDocs=44218)
            0.012320896 = queryNorm
          0.36809558 = fieldWeight in 3649, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.5527015 = idf(docFreq=465, maxDocs=44218)
            0.046875 = fieldNorm(doc=3649)
      0.028649988 = weight(abstract_txt:retrieved in 3649) [ClassicSimilarity], result of:
        0.028649988 = score(doc=3649,freq=2.0), product of:
          0.075716384 = queryWeight, product of:
            1.0766369 = boost
            5.707926 = idf(docFreq=398, maxDocs=44218)
            0.012320896 = queryNorm
          0.37838557 = fieldWeight in 3649, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.707926 = idf(docFreq=398, maxDocs=44218)
            0.046875 = fieldNorm(doc=3649)
      0.02390425 = weight(abstract_txt:language in 3649) [ClassicSimilarity], result of:
        0.02390425 = score(doc=3649,freq=4.0), product of:
          0.06096923 = queryWeight, product of:
            1.1832467 = boost
            4.1820874 = idf(docFreq=1834, maxDocs=44218)
            0.012320896 = queryNorm
          0.3920707 = fieldWeight in 3649, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            4.1820874 = idf(docFreq=1834, maxDocs=44218)
            0.046875 = fieldNorm(doc=3649)
      0.02156865 = weight(abstract_txt:documents in 3649) [ClassicSimilarity], result of:
        0.02156865 = score(doc=3649,freq=2.0), product of:
          0.078946374 = queryWeight, product of:
            1.5547316 = boost
            4.1213026 = idf(docFreq=1949, maxDocs=44218)
            0.012320896 = queryNorm
          0.27320635 = fieldWeight in 3649, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            4.1213026 = idf(docFreq=1949, maxDocs=44218)
            0.046875 = fieldNorm(doc=3649)
      0.038978186 = weight(abstract_txt:precision in 3649) [ClassicSimilarity], result of:
        0.038978186 = score(doc=3649,freq=2.0), product of:
          0.10641881 = queryWeight, product of:
            1.5632526 = boost
            5.5251865 = idf(docFreq=478, maxDocs=44218)
            0.012320896 = queryNorm
          0.3662716 = fieldWeight in 3649, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.5251865 = idf(docFreq=478, maxDocs=44218)
            0.046875 = fieldNorm(doc=3649)
      0.053773686 = weight(abstract_txt:recall in 3649) [ClassicSimilarity], result of:
        0.053773686 = score(doc=3649,freq=3.0), product of:
          0.115209095 = queryWeight, product of:
            1.6265348 = boost
            5.7488523 = idf(docFreq=382, maxDocs=44218)
            0.012320896 = queryNorm
          0.46674863 = fieldWeight in 3649, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            5.7488523 = idf(docFreq=382, maxDocs=44218)
            0.046875 = fieldNorm(doc=3649)
      0.022859208 = weight(abstract_txt:retrieval in 3649) [ClassicSimilarity], result of:
        0.022859208 = score(doc=3649,freq=4.0), product of:
          0.07016454 = queryWeight, product of:
            1.638714 = boost
            3.4751394 = idf(docFreq=3720, maxDocs=44218)
            0.012320896 = queryNorm
          0.3257943 = fieldWeight in 3649, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            3.4751394 = idf(docFreq=3720, maxDocs=44218)
            0.046875 = fieldNorm(doc=3649)
      0.046668872 = weight(abstract_txt:index in 3649) [ClassicSimilarity], result of:
        0.046668872 = score(doc=3649,freq=4.0), product of:
          0.10482345 = queryWeight, product of:
            1.7915071 = boost
            4.74895 = idf(docFreq=1040, maxDocs=44218)
            0.012320896 = queryNorm
          0.44521406 = fieldWeight in 3649, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            4.74895 = idf(docFreq=1040, maxDocs=44218)
            0.046875 = fieldNorm(doc=3649)
      0.0145823825 = weight(abstract_txt:that in 3649) [ClassicSimilarity], result of:
        0.0145823825 = score(doc=3649,freq=5.0), product of:
          0.058715135 = queryWeight, product of:
            2.0112016 = boost
            2.3694751 = idf(docFreq=11241, maxDocs=44218)
            0.012320896 = queryNorm
          0.24835816 = fieldWeight in 3649, product of:
            2.236068 = tf(freq=5.0), with freq of:
              5.0 = termFreq=5.0
            2.3694751 = idf(docFreq=11241, maxDocs=44218)
            0.046875 = fieldNorm(doc=3649)
      0.039534595 = weight(abstract_txt:experiment in 3649) [ClassicSimilarity], result of:
        0.039534595 = score(doc=3649,freq=1.0), product of:
          0.14897443 = queryWeight, product of:
            2.1357243 = boost
            5.6614056 = idf(docFreq=417, maxDocs=44218)
            0.012320896 = queryNorm
          0.2653784 = fieldWeight in 3649, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.6614056 = idf(docFreq=417, maxDocs=44218)
            0.046875 = fieldNorm(doc=3649)
      0.06275044 = weight(abstract_txt:indexing in 3649) [ClassicSimilarity], result of:
        0.06275044 = score(doc=3649,freq=4.0), product of:
          0.1538854 = queryWeight, product of:
            2.8714883 = boost
            4.3495874 = idf(docFreq=1551, maxDocs=44218)
            0.012320896 = queryNorm
          0.40777382 = fieldWeight in 3649, product of:
            2.0 = tf(freq=4.0), with freq of:
              4.0 = termFreq=4.0
            4.3495874 = idf(docFreq=1551, maxDocs=44218)
            0.046875 = fieldNorm(doc=3649)
    0.52 = coord(13/25)
  4. Strzalkowski, T.: Natural language information retrieval (1995) 0.21 
    0.20671064 = sum of:
  0.20671064 = product of:
    0.7382523 = sum of:
      0.013611693 = weight(abstract_txt:user in 1914) [ClassicSimilarity], result of:
        0.013611693 = score(doc=1914,freq=1.0), product of:
          0.047299467 = queryWeight, product of:
            1.0421928 = boost
            3.6835442 = idf(docFreq=3020, maxDocs=44218)
            0.012320896 = queryNorm
          0.2877769 = fieldWeight in 1914, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            3.6835442 = idf(docFreq=3020, maxDocs=44218)
            0.078125 = fieldNorm(doc=1914)
      0.03450281 = weight(abstract_txt:language in 1914) [ClassicSimilarity], result of:
        0.03450281 = score(doc=1914,freq=3.0), product of:
          0.06096923 = queryWeight, product of:
            1.1832467 = boost
            4.1820874 = idf(docFreq=1834, maxDocs=44218)
            0.012320896 = queryNorm
          0.56590533 = fieldWeight in 1914, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            4.1820874 = idf(docFreq=1834, maxDocs=44218)
            0.078125 = fieldNorm(doc=1914)
      0.044026818 = weight(abstract_txt:documents in 1914) [ClassicSimilarity], result of:
        0.044026818 = score(doc=1914,freq=3.0), product of:
          0.078946374 = queryWeight, product of:
            1.5547316 = boost
            4.1213026 = idf(docFreq=1949, maxDocs=44218)
            0.012320896 = queryNorm
          0.5576801 = fieldWeight in 1914, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            4.1213026 = idf(docFreq=1949, maxDocs=44218)
            0.078125 = fieldNorm(doc=1914)
      0.032994423 = weight(abstract_txt:retrieval in 1914) [ClassicSimilarity], result of:
        0.032994423 = score(doc=1914,freq=3.0), product of:
          0.07016454 = queryWeight, product of:
            1.638714 = boost
            3.4751394 = idf(docFreq=3720, maxDocs=44218)
            0.012320896 = queryNorm
          0.47024357 = fieldWeight in 1914, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            3.4751394 = idf(docFreq=3720, maxDocs=44218)
            0.078125 = fieldNorm(doc=1914)
      0.03889073 = weight(abstract_txt:index in 1914) [ClassicSimilarity], result of:
        0.03889073 = score(doc=1914,freq=1.0), product of:
          0.10482345 = queryWeight, product of:
            1.7915071 = boost
            4.74895 = idf(docFreq=1040, maxDocs=44218)
            0.012320896 = queryNorm
          0.37101173 = fieldWeight in 1914, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            4.74895 = idf(docFreq=1040, maxDocs=44218)
            0.078125 = fieldNorm(doc=1914)
      0.010869067 = weight(abstract_txt:that in 1914) [ClassicSimilarity], result of:
        0.010869067 = score(doc=1914,freq=1.0), product of:
          0.058715135 = queryWeight, product of:
            2.0112016 = boost
            2.3694751 = idf(docFreq=11241, maxDocs=44218)
            0.012320896 = queryNorm
          0.18511525 = fieldWeight in 1914, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            2.3694751 = idf(docFreq=11241, maxDocs=44218)
            0.078125 = fieldNorm(doc=1914)
      0.56335676 = weight(abstract_txt:cranfield in 1914) [ClassicSimilarity], result of:
        0.56335676 = score(doc=1914,freq=1.0), product of:
          0.87269187 = queryWeight, product of:
            8.572079 = boost
            8.2629 = idf(docFreq=30, maxDocs=44218)
            0.012320896 = queryNorm
          0.6455391 = fieldWeight in 1914, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            8.2629 = idf(docFreq=30, maxDocs=44218)
            0.078125 = fieldNorm(doc=1914)
    0.28 = coord(7/25)
  5. Kaiser, J.O.: Systematic indexing (1985) 0.19 
    0.18873866 = sum of:
  0.18873866 = product of:
    0.58980834 = sum of:
      0.022957081 = weight(abstract_txt:called in 571) [ClassicSimilarity], result of:
        0.022957081 = score(doc=571,freq=2.0), product of:
          0.065320775 = queryWeight, product of:
            5.3016257 = idf(docFreq=598, maxDocs=44218)
            0.012320896 = queryNorm
          0.35145146 = fieldWeight in 571, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            5.3016257 = idf(docFreq=598, maxDocs=44218)
            0.046875 = fieldNorm(doc=571)
      0.029276606 = weight(abstract_txt:language in 571) [ClassicSimilarity], result of:
        0.029276606 = score(doc=571,freq=6.0), product of:
          0.06096923 = queryWeight, product of:
            1.1832467 = boost
            4.1820874 = idf(docFreq=1834, maxDocs=44218)
            0.012320896 = queryNorm
          0.48018658 = fieldWeight in 571, product of:
            2.4494898 = tf(freq=6.0), with freq of:
              6.0 = termFreq=6.0
            4.1820874 = idf(docFreq=1834, maxDocs=44218)
            0.046875 = fieldNorm(doc=571)
      0.027375868 = weight(abstract_txt:definition in 571) [ClassicSimilarity], result of:
        0.027375868 = score(doc=571,freq=1.0), product of:
          0.10593981 = queryWeight, product of:
            1.5597305 = boost
            5.512738 = idf(docFreq=484, maxDocs=44218)
            0.012320896 = queryNorm
          0.25840962 = fieldWeight in 571, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.512738 = idf(docFreq=484, maxDocs=44218)
            0.046875 = fieldNorm(doc=571)
      0.04041643 = weight(abstract_txt:index in 571) [ClassicSimilarity], result of:
        0.04041643 = score(doc=571,freq=3.0), product of:
          0.10482345 = queryWeight, product of:
            1.7915071 = boost
            4.74895 = idf(docFreq=1040, maxDocs=44218)
            0.012320896 = queryNorm
          0.3855667 = fieldWeight in 571, product of:
            1.7320508 = tf(freq=3.0), with freq of:
              3.0 = termFreq=3.0
            4.74895 = idf(docFreq=1040, maxDocs=44218)
            0.046875 = fieldNorm(doc=571)
      0.009222709 = weight(abstract_txt:that in 571) [ClassicSimilarity], result of:
        0.009222709 = score(doc=571,freq=2.0), product of:
          0.058715135 = queryWeight, product of:
            2.0112016 = boost
            2.3694751 = idf(docFreq=11241, maxDocs=44218)
            0.012320896 = queryNorm
          0.1570755 = fieldWeight in 571, product of:
            1.4142135 = tf(freq=2.0), with freq of:
              2.0 = termFreq=2.0
            2.3694751 = idf(docFreq=11241, maxDocs=44218)
            0.046875 = fieldNorm(doc=571)
      0.039534595 = weight(abstract_txt:experiment in 571) [ClassicSimilarity], result of:
        0.039534595 = score(doc=571,freq=1.0), product of:
          0.14897443 = queryWeight, product of:
            2.1357243 = boost
            5.6614056 = idf(docFreq=417, maxDocs=44218)
            0.012320896 = queryNorm
          0.2653784 = fieldWeight in 571, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            5.6614056 = idf(docFreq=417, maxDocs=44218)
            0.046875 = fieldNorm(doc=571)
      0.083011016 = weight(abstract_txt:indexing in 571) [ClassicSimilarity], result of:
        0.083011016 = score(doc=571,freq=7.0), product of:
          0.1538854 = queryWeight, product of:
            2.8714883 = boost
            4.3495874 = idf(docFreq=1551, maxDocs=44218)
            0.012320896 = queryNorm
          0.539434 = fieldWeight in 571, product of:
            2.6457512 = tf(freq=7.0), with freq of:
              7.0 = termFreq=7.0
            4.3495874 = idf(docFreq=1551, maxDocs=44218)
            0.046875 = fieldNorm(doc=571)
      0.338014 = weight(abstract_txt:cranfield in 571) [ClassicSimilarity], result of:
        0.338014 = score(doc=571,freq=1.0), product of:
          0.87269187 = queryWeight, product of:
            8.572079 = boost
            8.2629 = idf(docFreq=30, maxDocs=44218)
            0.012320896 = queryNorm
          0.38732344 = fieldWeight in 571, product of:
            1.0 = tf(freq=1.0), with freq of:
              1.0 = termFreq=1.0
            8.2629 = idf(docFreq=30, maxDocs=44218)
            0.046875 = fieldNorm(doc=571)
    0.32 = coord(8/25)