Document (#13225)

Author

Robertson, S.E.

Title

¬The parametric description of retrieval tests : Part I: The basic parameters

Source

Journal of documentation. 25(1969) no.1, S.1-27

Year

1969

Abstract

Some parameters and techniques in use for describing the results of test on IR system are analysed. Several considerations outside the scope of the usual 2X2 table are relevant to the choice of parameters. In particular, a variable which produces a 'performance curve' of a system corresponds to an extension of the 2x2 table. Also, the statistical relationships between parameters are all-important. It is considered that precision is not such a useful measure of performance (in conjunction with recall)as fallout. A more powerful alternative to Cleverdon's 'invitable inverse relationship between recall and precision'is proposed and justified, namely that the recall-fallout graph is convex.

Theme

Retrievalstudien

Similar documents (author)

1. Robertson, M.A.: Windows 3.0 for the online searcher (1991) 4.57

   4.5717874 = sum of:
     4.5717874 = weight(author_txt:robertson in 592) [ClassicSimilarity], result of:
       4.5717874 = score(doc=592,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           7.314861 = idf(docFreq=79, maxDocs=44218)
           0.13670799 = queryNorm
         4.571788 = fieldWeight in 592, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           7.314861 = idf(docFreq=79, maxDocs=44218)
           0.625 = fieldNorm(doc=592)
   

2. Robertson, S.E.: Some recent theories and models in information retrieval (1980) 4.57

   4.5717874 = sum of:
     4.5717874 = weight(author_txt:robertson in 1326) [ClassicSimilarity], result of:
       4.5717874 = score(doc=1326,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           7.314861 = idf(docFreq=79, maxDocs=44218)
           0.13670799 = queryNorm
         4.571788 = fieldWeight in 1326, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           7.314861 = idf(docFreq=79, maxDocs=44218)
           0.625 = fieldNorm(doc=1326)
   

3. Robertson, S.E.: Theories and models in information retrieval (1977) 4.57

   4.5717874 = sum of:
     4.5717874 = weight(author_txt:robertson in 1844) [ClassicSimilarity], result of:
       4.5717874 = score(doc=1844,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           7.314861 = idf(docFreq=79, maxDocs=44218)
           0.13670799 = queryNorm
         4.571788 = fieldWeight in 1844, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           7.314861 = idf(docFreq=79, maxDocs=44218)
           0.625 = fieldNorm(doc=1844)
   

4. Robertson, S.E.: On term selection for query expansion (1990) 4.57

   4.5717874 = sum of:
     4.5717874 = weight(author_txt:robertson in 2650) [ClassicSimilarity], result of:
       4.5717874 = score(doc=2650,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           7.314861 = idf(docFreq=79, maxDocs=44218)
           0.13670799 = queryNorm
         4.571788 = fieldWeight in 2650, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           7.314861 = idf(docFreq=79, maxDocs=44218)
           0.625 = fieldNorm(doc=2650)
   

5. Robertson, S.E.: On relevance weight estimation and query expansion (1986) 4.57

   4.5717874 = sum of:
     4.5717874 = weight(author_txt:robertson in 3875) [ClassicSimilarity], result of:
       4.5717874 = score(doc=3875,freq=1.0), product of:
         0.99999994 = queryWeight, product of:
           7.314861 = idf(docFreq=79, maxDocs=44218)
           0.13670799 = queryNorm
         4.571788 = fieldWeight in 3875, product of:
           1.0 = tf(freq=1.0), with freq of:
             1.0 = termFreq=1.0
           7.314861 = idf(docFreq=79, maxDocs=44218)
           0.625 = fieldNorm(doc=3875)
   

Similar documents (content)

1. Robertson, S.E.: ¬The parametric description of retrieval tests : Part II: Overall measures (1969) 0.26

   0.25768125 = sum of:
     0.25768125 = product of:
       1.0736719 = sum of:
         0.051199585 = weight(abstract_txt:namely in 4156) [ClassicSimilarity], result of:
           0.051199585 = score(doc=4156,freq=1.0), product of:
             0.103744775 = queryWeight, product of:
               1.0395794 = boost
               6.31699 = idf(docFreq=216, maxDocs=44218)
               0.015797865 = queryNorm
             0.49351484 = fieldWeight in 4156, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.31699 = idf(docFreq=216, maxDocs=44218)
               0.078125 = fieldNorm(doc=4156)
         0.15839909 = weight(abstract_txt:curve in 4156) [ClassicSimilarity], result of:
           0.15839909 = score(doc=4156,freq=2.0), product of:
             0.1748291 = queryWeight, product of:
               1.3495264 = boost
               8.200379 = idf(docFreq=32, maxDocs=44218)
               0.015797865 = queryNorm
             0.9060225 = fieldWeight in 4156, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               8.200379 = idf(docFreq=32, maxDocs=44218)
               0.078125 = fieldNorm(doc=4156)
         0.040329892 = weight(abstract_txt:performance in 4156) [ClassicSimilarity], result of:
           0.040329892 = score(doc=4156,freq=1.0), product of:
             0.11148505 = queryWeight, product of:
               1.5240452 = boost
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.015797865 = queryNorm
             0.3617516 = fieldWeight in 4156, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.078125 = fieldNorm(doc=4156)
         0.13072272 = weight(abstract_txt:table in 4156) [ClassicSimilarity], result of:
           0.13072272 = score(doc=4156,freq=1.0), product of:
             0.24417393 = queryWeight, product of:
               2.255481 = boost
               6.8527 = idf(docFreq=126, maxDocs=44218)
               0.015797865 = queryNorm
             0.5353672 = fieldWeight in 4156, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8527 = idf(docFreq=126, maxDocs=44218)
               0.078125 = fieldNorm(doc=4156)
         0.20052163 = weight(abstract_txt:recall in 4156) [ClassicSimilarity], result of:
           0.20052163 = score(doc=4156,freq=3.0), product of:
             0.25776824 = queryWeight, product of:
               2.838245 = boost
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.015797865 = queryNorm
             0.7779144 = fieldWeight in 4156, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.078125 = fieldNorm(doc=4156)
         0.49249902 = weight(abstract_txt:fallout in 4156) [ClassicSimilarity], result of:
           0.49249902 = score(doc=4156,freq=2.0), product of:
             0.4692369 = queryWeight, product of:
               3.1266956 = boost
               9.499662 = idf(docFreq=8, maxDocs=44218)
               0.015797865 = queryNorm
             1.0495744 = fieldWeight in 4156, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               9.499662 = idf(docFreq=8, maxDocs=44218)
               0.078125 = fieldNorm(doc=4156)
       0.24 = coord(6/25)
   

2. Egghe, L.: ¬The measures precision, recall, fallout and miss as a function of the number of retrieved documents and their mutual interrelations (2008) 0.17

   0.17166874 = sum of:
     0.17166874 = product of:
       1.0729296 = sum of:
         0.019092942 = weight(abstract_txt:between in 2067) [ClassicSimilarity], result of:
           0.019092942 = score(doc=2067,freq=2.0), product of:
             0.062370203 = queryWeight, product of:
               1.1399298 = boost
               3.4633842 = idf(docFreq=3764, maxDocs=44218)
               0.015797865 = queryNorm
             0.3061228 = fieldWeight in 2067, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4633842 = idf(docFreq=3764, maxDocs=44218)
               0.0625 = fieldNorm(doc=2067)
         0.14454569 = weight(abstract_txt:convex in 2067) [ClassicSimilarity], result of:
           0.14454569 = score(doc=2067,freq=1.0), product of:
             0.24047247 = queryWeight, product of:
               1.5827314 = boost
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.015797865 = queryNorm
             0.6010904 = fieldWeight in 2067, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.617446 = idf(docFreq=7, maxDocs=44218)
               0.0625 = fieldNorm(doc=2067)
         0.22686432 = weight(abstract_txt:recall in 2067) [ClassicSimilarity], result of:
           0.22686432 = score(doc=2067,freq=6.0), product of:
             0.25776824 = queryWeight, product of:
               2.838245 = boost
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.015797865 = queryNorm
             0.88010967 = fieldWeight in 2067, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.0625 = fieldNorm(doc=2067)
         0.6824267 = weight(abstract_txt:fallout in 2067) [ClassicSimilarity], result of:
           0.6824267 = score(doc=2067,freq=6.0), product of:
             0.4692369 = queryWeight, product of:
               3.1266956 = boost
               9.499662 = idf(docFreq=8, maxDocs=44218)
               0.015797865 = queryNorm
             1.454333 = fieldWeight in 2067, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               9.499662 = idf(docFreq=8, maxDocs=44218)
               0.0625 = fieldNorm(doc=2067)
       0.16 = coord(4/25)
   

3. Bollmann, P.; Cherniavsky, V.S.: Probleme der Bewertung von Information-Retrieval-Systemen (1980) 0.15

   0.14872126 = sum of:
     0.14872126 = product of:
       1.2393439 = sum of:
         0.13051082 = weight(abstract_txt:graph in 5495) [ClassicSimilarity], result of:
           0.13051082 = score(doc=5495,freq=2.0), product of:
             0.11232152 = queryWeight, product of:
               1.081698 = boost
               6.572923 = idf(docFreq=167, maxDocs=44218)
               0.015797865 = queryNorm
             1.1619396 = fieldWeight in 5495, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.572923 = idf(docFreq=167, maxDocs=44218)
               0.125 = fieldNorm(doc=5495)
         0.3208346 = weight(abstract_txt:recall in 5495) [ClassicSimilarity], result of:
           0.3208346 = score(doc=5495,freq=3.0), product of:
             0.25776824 = queryWeight, product of:
               2.838245 = boost
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.015797865 = queryNorm
             1.244663 = fieldWeight in 5495, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.125 = fieldNorm(doc=5495)
         0.78799844 = weight(abstract_txt:fallout in 5495) [ClassicSimilarity], result of:
           0.78799844 = score(doc=5495,freq=2.0), product of:
             0.4692369 = queryWeight, product of:
               3.1266956 = boost
               9.499662 = idf(docFreq=8, maxDocs=44218)
               0.015797865 = queryNorm
             1.6793189 = fieldWeight in 5495, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               9.499662 = idf(docFreq=8, maxDocs=44218)
               0.125 = fieldNorm(doc=5495)
       0.12 = coord(3/25)
   

4. Egghe, L.: Existence theorem of the quadruple (P, R, F, M) : precision, recall, fallout and miss (2007) 0.11

   0.109022945 = sum of:
     0.109022945 = product of:
       0.68139344 = sum of:
         0.02492687 = weight(abstract_txt:system in 2011) [ClassicSimilarity], result of:
           0.02492687 = score(doc=2011,freq=4.0), product of:
             0.059133068 = queryWeight, product of:
               1.1099534 = boost
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.015797865 = queryNorm
             0.42153856 = fieldWeight in 2011, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.3723085 = idf(docFreq=4123, maxDocs=44218)
               0.0625 = fieldNorm(doc=2011)
         0.013500748 = weight(abstract_txt:between in 2011) [ClassicSimilarity], result of:
           0.013500748 = score(doc=2011,freq=1.0), product of:
             0.062370203 = queryWeight, product of:
               1.1399298 = boost
               3.4633842 = idf(docFreq=3764, maxDocs=44218)
               0.015797865 = queryNorm
             0.21646151 = fieldWeight in 2011, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4633842 = idf(docFreq=3764, maxDocs=44218)
               0.0625 = fieldNorm(doc=2011)
         0.1604173 = weight(abstract_txt:recall in 2011) [ClassicSimilarity], result of:
           0.1604173 = score(doc=2011,freq=3.0), product of:
             0.25776824 = queryWeight, product of:
               2.838245 = boost
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.015797865 = queryNorm
             0.6223315 = fieldWeight in 2011, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.0625 = fieldNorm(doc=2011)
         0.4825485 = weight(abstract_txt:fallout in 2011) [ClassicSimilarity], result of:
           0.4825485 = score(doc=2011,freq=3.0), product of:
             0.4692369 = queryWeight, product of:
               3.1266956 = boost
               9.499662 = idf(docFreq=8, maxDocs=44218)
               0.015797865 = queryNorm
             1.0283686 = fieldWeight in 2011, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               9.499662 = idf(docFreq=8, maxDocs=44218)
               0.0625 = fieldNorm(doc=2011)
       0.16 = coord(4/25)
   

5. Chen, H.; Zhang, Y.; Houston, A.L.: Semantic indexing and searching using a Hopfield net (1998) 0.10

   0.10322007 = sum of:
     0.10322007 = product of:
       0.51610035 = sum of:
         0.07893219 = weight(abstract_txt:tests in 5704) [ClassicSimilarity], result of:
           0.07893219 = score(doc=5704,freq=3.0), product of:
             0.095995516 = queryWeight, product of:
               6.0764866 = idf(docFreq=275, maxDocs=44218)
               0.015797865 = queryNorm
             0.8222487 = fieldWeight in 5704, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.0764866 = idf(docFreq=275, maxDocs=44218)
               0.078125 = fieldNorm(doc=5704)
         0.016875936 = weight(abstract_txt:between in 5704) [ClassicSimilarity], result of:
           0.016875936 = score(doc=5704,freq=1.0), product of:
             0.062370203 = queryWeight, product of:
               1.1399298 = boost
               3.4633842 = idf(docFreq=3764, maxDocs=44218)
               0.015797865 = queryNorm
             0.2705769 = fieldWeight in 5704, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4633842 = idf(docFreq=3764, maxDocs=44218)
               0.078125 = fieldNorm(doc=5704)
         0.040329892 = weight(abstract_txt:performance in 5704) [ClassicSimilarity], result of:
           0.040329892 = score(doc=5704,freq=1.0), product of:
             0.11148505 = queryWeight, product of:
               1.5240452 = boost
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.015797865 = queryNorm
             0.3617516 = fieldWeight in 5704, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.078125 = fieldNorm(doc=5704)
         0.11577121 = weight(abstract_txt:recall in 5704) [ClassicSimilarity], result of:
           0.11577121 = score(doc=5704,freq=1.0), product of:
             0.25776824 = queryWeight, product of:
               2.838245 = boost
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.015797865 = queryNorm
             0.44912907 = fieldWeight in 5704, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.078125 = fieldNorm(doc=5704)
         0.26419112 = weight(abstract_txt:parameters in 5704) [ClassicSimilarity], result of:
           0.26419112 = score(doc=5704,freq=1.0), product of:
             0.491761 = queryWeight, product of:
               4.5266986 = boost
               6.8766055 = idf(docFreq=123, maxDocs=44218)
               0.015797865 = queryNorm
             0.5372348 = fieldWeight in 5704, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.8766055 = idf(docFreq=123, maxDocs=44218)
               0.078125 = fieldNorm(doc=5704)
       0.2 = coord(5/25)