Document (#27264)

Author

Della Mea, V.
Mizzaro, S.

Title

Measuring retrieval effectiveness : a new proposal and a first experimental validation

Source

Journal of the American Society for Information Science and Technology. 55(2004) no.6, S.530-543

Year

2004

Abstract

Most common effectiveness measures for information retrieval systems are based an the assumptions of binary relevance (either a document is relevant to a given query or it is not) and binary retrieval (either a document is retrieved or it is not). In this article, these assumptions are questioned, and a new measure named ADM (average distance measure) is proposed, discussed from a conceptual point of view, and experimentally validated an Text Retrieval Conference (TREC) data. Both conceptual analysis and experimental evidence demonstrate ADM's adequacy in measuring the effectiveness of information retrieval systems. Some potential problems about precision and recall are also highlighted and discussed.

Theme

Retrievalstudien

Similar documents (author)

1. Della Mea, V.; Demartini, G.; Di Gaspero, L.; Mizzaro, S.: Measuring retrieval effectiveness with Average Distance Measure (ADM) (2006) 4.18

   4.179983 = sum of:
     4.179983 = sum of:
       1.9845178 = weight(author_txt:mizzaro in 774) [ClassicSimilarity], result of:
         1.9845178 = score(doc=774,freq=1.0), product of:
           0.68291885 = queryWeight, product of:
             9.298992 = idf(docFreq=10, maxDocs=44218)
             0.07344009 = queryNorm
           2.905935 = fieldWeight in 774, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.298992 = idf(docFreq=10, maxDocs=44218)
             0.3125 = fieldNorm(doc=774)
       2.1954656 = weight(author_txt:della in 774) [ClassicSimilarity], result of:
         2.1954656 = score(doc=774,freq=1.0), product of:
           0.7304943 = queryWeight, product of:
             1.0342461 = boost
             9.617446 = idf(docFreq=7, maxDocs=44218)
             0.07344009 = queryNorm
           3.005452 = fieldWeight in 774, product of:
             1.0 = tf(freq=1.0), with freq of:
               1.0 = termFreq=1.0
             9.617446 = idf(docFreq=7, maxDocs=44218)
             0.3125 = fieldNorm(doc=774)
   

2. Mizzaro, S.: Relevance: the whole history (1997) 1.98

   1.9845178 = sum of:
     1.9845178 = product of:
       3.9690356 = sum of:
         3.9690356 = weight(author_txt:mizzaro in 1003) [ClassicSimilarity], result of:
           3.9690356 = score(doc=1003,freq=1.0), product of:
             0.68291885 = queryWeight, product of:
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.07344009 = queryNorm
             5.81187 = fieldWeight in 1003, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.625 = fieldNorm(doc=1003)
       0.5 = coord(1/2)
   

3. Mizzaro, S.: How many relevances in information retrieval? (1998) 1.98

   1.9845178 = sum of:
     1.9845178 = product of:
       3.9690356 = sum of:
         3.9690356 = weight(author_txt:mizzaro in 3799) [ClassicSimilarity], result of:
           3.9690356 = score(doc=3799,freq=1.0), product of:
             0.68291885 = queryWeight, product of:
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.07344009 = queryNorm
             5.81187 = fieldWeight in 3799, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.625 = fieldNorm(doc=3799)
       0.5 = coord(1/2)
   

4. Mizzaro, S.: Quality control in scholarly publishing : a new proposal (2003) 1.98

   1.9845178 = sum of:
     1.9845178 = product of:
       3.9690356 = sum of:
         3.9690356 = weight(author_txt:mizzaro in 1810) [ClassicSimilarity], result of:
           3.9690356 = score(doc=1810,freq=1.0), product of:
             0.68291885 = queryWeight, product of:
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.07344009 = queryNorm
             5.81187 = fieldWeight in 1810, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.625 = fieldNorm(doc=1810)
       0.5 = coord(1/2)
   

5. Mizzaro, S.: Readersourcing - a manifesto (2012) 1.98

   1.9845178 = sum of:
     1.9845178 = product of:
       3.9690356 = sum of:
         3.9690356 = weight(author_txt:mizzaro in 356) [ClassicSimilarity], result of:
           3.9690356 = score(doc=356,freq=1.0), product of:
             0.68291885 = queryWeight, product of:
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.07344009 = queryNorm
             5.81187 = fieldWeight in 356, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.298992 = idf(docFreq=10, maxDocs=44218)
               0.625 = fieldNorm(doc=356)
       0.5 = coord(1/2)
   

Similar documents (content)

1. Della Mea, V.; Demartini, G.; Di Gaspero, L.; Mizzaro, S.: Measuring retrieval effectiveness with Average Distance Measure (ADM) (2006) 1.44

   1.4405415 = sum of:
     1.4405415 = product of:
       2.2508461 = sum of:
         0.05868712 = weight(abstract_txt:retrieved in 774) [ClassicSimilarity], result of:
           0.05868712 = score(doc=774,freq=1.0), product of:
             0.109671354 = queryWeight, product of:
               5.707926 = idf(docFreq=398, maxDocs=44218)
               0.019213872 = queryNorm
             0.53511804 = fieldWeight in 774, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.707926 = idf(docFreq=398, maxDocs=44218)
               0.09375 = fieldNorm(doc=774)
         0.06514305 = weight(abstract_txt:average in 774) [ClassicSimilarity], result of:
           0.06514305 = score(doc=774,freq=1.0), product of:
             0.11757367 = queryWeight, product of:
               1.0354006 = boost
               5.90999 = idf(docFreq=325, maxDocs=44218)
               0.019213872 = queryNorm
             0.55406153 = fieldWeight in 774, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.90999 = idf(docFreq=325, maxDocs=44218)
               0.09375 = fieldNorm(doc=774)
         0.08509327 = weight(abstract_txt:distance in 774) [ClassicSimilarity], result of:
           0.08509327 = score(doc=774,freq=1.0), product of:
             0.1404952 = queryWeight, product of:
               1.1318376 = boost
               6.4604454 = idf(docFreq=187, maxDocs=44218)
               0.019213872 = queryNorm
             0.60566676 = fieldWeight in 774, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.4604454 = idf(docFreq=187, maxDocs=44218)
               0.09375 = fieldNorm(doc=774)
         0.10018064 = weight(abstract_txt:named in 774) [ClassicSimilarity], result of:
           0.10018064 = score(doc=774,freq=1.0), product of:
             0.15664645 = queryWeight, product of:
               1.1951259 = boost
               6.82169 = idf(docFreq=130, maxDocs=44218)
               0.019213872 = queryNorm
             0.63953346 = fieldWeight in 774, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.82169 = idf(docFreq=130, maxDocs=44218)
               0.09375 = fieldNorm(doc=774)
         0.035451405 = weight(abstract_txt:systems in 774) [ClassicSimilarity], result of:
           0.035451405 = score(doc=774,freq=2.0), product of:
             0.07837068 = queryWeight, product of:
               1.195488 = boost
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.019213872 = queryNorm
             0.45235544 = fieldWeight in 774, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.09375 = fieldNorm(doc=774)
         0.16684149 = weight(abstract_txt:adequacy in 774) [ClassicSimilarity], result of:
           0.16684149 = score(doc=774,freq=1.0), product of:
             0.2200902 = queryWeight, product of:
               1.4166212 = boost
               8.085969 = idf(docFreq=36, maxDocs=44218)
               0.019213872 = queryNorm
             0.7580596 = fieldWeight in 774, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.085969 = idf(docFreq=36, maxDocs=44218)
               0.09375 = fieldNorm(doc=774)
         0.07060194 = weight(abstract_txt:document in 774) [ClassicSimilarity], result of:
           0.07060194 = score(doc=774,freq=2.0), product of:
             0.12405352 = queryWeight, product of:
               1.504087 = boost
               4.2926083 = idf(docFreq=1642, maxDocs=44218)
               0.019213872 = queryNorm
             0.5691248 = fieldWeight in 774, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.2926083 = idf(docFreq=1642, maxDocs=44218)
               0.09375 = fieldNorm(doc=774)
         0.104445495 = weight(abstract_txt:conceptual in 774) [ClassicSimilarity], result of:
           0.104445495 = score(doc=774,freq=2.0), product of:
             0.16106129 = queryWeight, product of:
               1.7138151 = boost
               4.891165 = idf(docFreq=902, maxDocs=44218)
               0.019213872 = queryNorm
             0.6484829 = fieldWeight in 774, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.891165 = idf(docFreq=902, maxDocs=44218)
               0.09375 = fieldNorm(doc=774)
         0.14039008 = weight(abstract_txt:experimental in 774) [ClassicSimilarity], result of:
           0.14039008 = score(doc=774,freq=2.0), product of:
             0.19616535 = queryWeight, product of:
               1.8913833 = boost
               5.397938 = idf(docFreq=543, maxDocs=44218)
               0.019213872 = queryNorm
             0.7156722 = fieldWeight in 774, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.397938 = idf(docFreq=543, maxDocs=44218)
               0.09375 = fieldNorm(doc=774)
         0.14348422 = weight(abstract_txt:measure in 774) [ClassicSimilarity], result of:
           0.14348422 = score(doc=774,freq=2.0), product of:
             0.19903713 = queryWeight, product of:
               1.9051775 = boost
               5.437306 = idf(docFreq=522, maxDocs=44218)
               0.019213872 = queryNorm
             0.7208917 = fieldWeight in 774, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.437306 = idf(docFreq=522, maxDocs=44218)
               0.09375 = fieldNorm(doc=774)
         0.15627758 = weight(abstract_txt:either in 774) [ClassicSimilarity], result of:
           0.15627758 = score(doc=774,freq=2.0), product of:
             0.210699 = queryWeight, product of:
               1.9601966 = boost
               5.5943284 = idf(docFreq=446, maxDocs=44218)
               0.019213872 = queryNorm
             0.7417101 = fieldWeight in 774, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.5943284 = idf(docFreq=446, maxDocs=44218)
               0.09375 = fieldNorm(doc=774)
         0.2462045 = weight(abstract_txt:assumptions in 774) [ClassicSimilarity], result of:
           0.2462045 = score(doc=774,freq=2.0), product of:
             0.28527388 = queryWeight, product of:
               2.280864 = boost
               6.5095015 = idf(docFreq=178, maxDocs=44218)
               0.019213872 = queryNorm
             0.86304605 = fieldWeight in 774, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               6.5095015 = idf(docFreq=178, maxDocs=44218)
               0.09375 = fieldNorm(doc=774)
         0.18070921 = weight(abstract_txt:measuring in 774) [ClassicSimilarity], result of:
           0.18070921 = score(doc=774,freq=1.0), product of:
             0.2924567 = queryWeight, product of:
               2.3094 = boost
               6.590942 = idf(docFreq=164, maxDocs=44218)
               0.019213872 = queryNorm
             0.6179008 = fieldWeight in 774, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.590942 = idf(docFreq=164, maxDocs=44218)
               0.09375 = fieldNorm(doc=774)
         0.3475814 = weight(abstract_txt:binary in 774) [ClassicSimilarity], result of:
           0.3475814 = score(doc=774,freq=2.0), product of:
             0.35900652 = queryWeight, product of:
               2.5587013 = boost
               7.3024383 = idf(docFreq=80, maxDocs=44218)
               0.019213872 = queryNorm
             0.96817565 = fieldWeight in 774, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.3024383 = idf(docFreq=80, maxDocs=44218)
               0.09375 = fieldNorm(doc=774)
         0.2173131 = weight(abstract_txt:effectiveness in 774) [ClassicSimilarity], result of:
           0.2173131 = score(doc=774,freq=3.0), product of:
             0.26249555 = queryWeight, product of:
               2.679631 = boost
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.019213872 = queryNorm
             0.82787347 = fieldWeight in 774, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.09375 = fieldNorm(doc=774)
         0.13244162 = weight(abstract_txt:retrieval in 774) [ClassicSimilarity], result of:
           0.13244162 = score(doc=774,freq=4.0), product of:
             0.20325957 = queryWeight, product of:
               3.0441349 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.019213872 = queryNorm
             0.6515886 = fieldWeight in 774, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.09375 = fieldNorm(doc=774)
       0.64 = coord(16/25)
   

2. Heine, M.H.: Distance between sets as an objective measure of retrieval effectiveness (1973) 0.24

   0.24317412 = sum of:
     0.24317412 = product of:
       0.75991917 = sum of:
         0.048905935 = weight(abstract_txt:retrieved in 5515) [ClassicSimilarity], result of:
           0.048905935 = score(doc=5515,freq=1.0), product of:
             0.109671354 = queryWeight, product of:
               5.707926 = idf(docFreq=398, maxDocs=44218)
               0.019213872 = queryNorm
             0.4459317 = fieldWeight in 5515, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.707926 = idf(docFreq=398, maxDocs=44218)
               0.078125 = fieldNorm(doc=5515)
         0.08654275 = weight(abstract_txt:recall in 5515) [ClassicSimilarity], result of:
           0.08654275 = score(doc=5515,freq=3.0), product of:
             0.1112497 = queryWeight, product of:
               1.0071701 = boost
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.019213872 = queryNorm
             0.7779144 = fieldWeight in 5515, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.7488523 = idf(docFreq=382, maxDocs=44218)
               0.078125 = fieldNorm(doc=5515)
         0.07091106 = weight(abstract_txt:distance in 5515) [ClassicSimilarity], result of:
           0.07091106 = score(doc=5515,freq=1.0), product of:
             0.1404952 = queryWeight, product of:
               1.1318376 = boost
               6.4604454 = idf(docFreq=187, maxDocs=44218)
               0.019213872 = queryNorm
             0.5047223 = fieldWeight in 5515, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.4604454 = idf(docFreq=187, maxDocs=44218)
               0.078125 = fieldNorm(doc=5515)
         0.041602593 = weight(abstract_txt:document in 5515) [ClassicSimilarity], result of:
           0.041602593 = score(doc=5515,freq=1.0), product of:
             0.12405352 = queryWeight, product of:
               1.504087 = boost
               4.2926083 = idf(docFreq=1642, maxDocs=44218)
               0.019213872 = queryNorm
             0.33536002 = fieldWeight in 5515, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.2926083 = idf(docFreq=1642, maxDocs=44218)
               0.078125 = fieldNorm(doc=5515)
         0.14644298 = weight(abstract_txt:measure in 5515) [ClassicSimilarity], result of:
           0.14644298 = score(doc=5515,freq=3.0), product of:
             0.19903713 = queryWeight, product of:
               1.9051775 = boost
               5.437306 = idf(docFreq=522, maxDocs=44218)
               0.019213872 = queryNorm
             0.73575705 = fieldWeight in 5515, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.437306 = idf(docFreq=522, maxDocs=44218)
               0.078125 = fieldNorm(doc=5515)
         0.15059102 = weight(abstract_txt:measuring in 5515) [ClassicSimilarity], result of:
           0.15059102 = score(doc=5515,freq=1.0), product of:
             0.2924567 = queryWeight, product of:
               2.3094 = boost
               6.590942 = idf(docFreq=164, maxDocs=44218)
               0.019213872 = queryNorm
             0.5149173 = fieldWeight in 5515, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.590942 = idf(docFreq=164, maxDocs=44218)
               0.078125 = fieldNorm(doc=5515)
         0.10455481 = weight(abstract_txt:effectiveness in 5515) [ClassicSimilarity], result of:
           0.10455481 = score(doc=5515,freq=1.0), product of:
             0.26249555 = queryWeight, product of:
               2.679631 = boost
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.019213872 = queryNorm
             0.39831078 = fieldWeight in 5515, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.078125 = fieldNorm(doc=5515)
         0.11036802 = weight(abstract_txt:retrieval in 5515) [ClassicSimilarity], result of:
           0.11036802 = score(doc=5515,freq=4.0), product of:
             0.20325957 = queryWeight, product of:
               3.0441349 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.019213872 = queryNorm
             0.5429905 = fieldWeight in 5515, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.078125 = fieldNorm(doc=5515)
       0.32 = coord(8/25)
   

3. Lam-Adesina, A.M.; Jones, G.J.F.: Examining and improving the effectiveness of relevance feedback for retrieval of scanned text documents (2006) 0.19

   0.19196399 = sum of:
     0.19196399 = product of:
       0.5998875 = sum of:
         0.056728847 = weight(abstract_txt:distance in 977) [ClassicSimilarity], result of:
           0.056728847 = score(doc=977,freq=1.0), product of:
             0.1404952 = queryWeight, product of:
               1.1318376 = boost
               6.4604454 = idf(docFreq=187, maxDocs=44218)
               0.019213872 = queryNorm
             0.40377784 = fieldWeight in 977, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.4604454 = idf(docFreq=187, maxDocs=44218)
               0.0625 = fieldNorm(doc=977)
         0.02363427 = weight(abstract_txt:systems in 977) [ClassicSimilarity], result of:
           0.02363427 = score(doc=977,freq=2.0), product of:
             0.07837068 = queryWeight, product of:
               1.195488 = boost
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.019213872 = queryNorm
             0.3015703 = fieldWeight in 977, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.0625 = fieldNorm(doc=977)
         0.057646245 = weight(abstract_txt:document in 977) [ClassicSimilarity], result of:
           0.057646245 = score(doc=977,freq=3.0), product of:
             0.12405352 = queryWeight, product of:
               1.504087 = boost
               4.2926083 = idf(docFreq=1642, maxDocs=44218)
               0.019213872 = queryNorm
             0.46468848 = fieldWeight in 977, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.2926083 = idf(docFreq=1642, maxDocs=44218)
               0.0625 = fieldNorm(doc=977)
         0.13627651 = weight(abstract_txt:experimentally in 977) [ClassicSimilarity], result of:
           0.13627651 = score(doc=977,freq=1.0), product of:
             0.25200328 = queryWeight, product of:
               1.5158509 = boost
               8.652365 = idf(docFreq=20, maxDocs=44218)
               0.019213872 = queryNorm
             0.5407728 = fieldWeight in 977, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.652365 = idf(docFreq=20, maxDocs=44218)
               0.0625 = fieldNorm(doc=977)
         0.06618052 = weight(abstract_txt:experimental in 977) [ClassicSimilarity], result of:
           0.06618052 = score(doc=977,freq=1.0), product of:
             0.19616535 = queryWeight, product of:
               1.8913833 = boost
               5.397938 = idf(docFreq=543, maxDocs=44218)
               0.019213872 = queryNorm
             0.3373711 = fieldWeight in 977, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.397938 = idf(docFreq=543, maxDocs=44218)
               0.0625 = fieldNorm(doc=977)
         0.06763911 = weight(abstract_txt:measure in 977) [ClassicSimilarity], result of:
           0.06763911 = score(doc=977,freq=1.0), product of:
             0.19903713 = queryWeight, product of:
               1.9051775 = boost
               5.437306 = idf(docFreq=522, maxDocs=44218)
               0.019213872 = queryNorm
             0.33983162 = fieldWeight in 977, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.437306 = idf(docFreq=522, maxDocs=44218)
               0.0625 = fieldNorm(doc=977)
         0.083643846 = weight(abstract_txt:effectiveness in 977) [ClassicSimilarity], result of:
           0.083643846 = score(doc=977,freq=1.0), product of:
             0.26249555 = queryWeight, product of:
               2.679631 = boost
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.019213872 = queryNorm
             0.31864864 = fieldWeight in 977, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.0625 = fieldNorm(doc=977)
         0.10813814 = weight(abstract_txt:retrieval in 977) [ClassicSimilarity], result of:
           0.10813814 = score(doc=977,freq=6.0), product of:
             0.20325957 = queryWeight, product of:
               3.0441349 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.019213872 = queryNorm
             0.5320199 = fieldWeight in 977, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=977)
       0.32 = coord(8/25)
   

4. Park, G.; Baek, Y.; Lee, H.-K.: Re-ranking algorithm using post-retrieval clustering for content-based image retrieval (2005) 0.17

   0.16903229 = sum of:
     0.16903229 = product of:
       0.5282259 = sum of:
         0.06776605 = weight(abstract_txt:retrieved in 1005) [ClassicSimilarity], result of:
           0.06776605 = score(doc=1005,freq=3.0), product of:
             0.109671354 = queryWeight, product of:
               5.707926 = idf(docFreq=398, maxDocs=44218)
               0.019213872 = queryNorm
             0.6179011 = fieldWeight in 1005, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               5.707926 = idf(docFreq=398, maxDocs=44218)
               0.0625 = fieldNorm(doc=1005)
         0.061417453 = weight(abstract_txt:average in 1005) [ClassicSimilarity], result of:
           0.061417453 = score(doc=1005,freq=2.0), product of:
             0.11757367 = queryWeight, product of:
               1.0354006 = boost
               5.90999 = idf(docFreq=325, maxDocs=44218)
               0.019213872 = queryNorm
             0.5223742 = fieldWeight in 1005, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.90999 = idf(docFreq=325, maxDocs=44218)
               0.0625 = fieldNorm(doc=1005)
         0.056728847 = weight(abstract_txt:distance in 1005) [ClassicSimilarity], result of:
           0.056728847 = score(doc=1005,freq=1.0), product of:
             0.1404952 = queryWeight, product of:
               1.1318376 = boost
               6.4604454 = idf(docFreq=187, maxDocs=44218)
               0.019213872 = queryNorm
             0.40377784 = fieldWeight in 1005, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.4604454 = idf(docFreq=187, maxDocs=44218)
               0.0625 = fieldNorm(doc=1005)
         0.016711952 = weight(abstract_txt:systems in 1005) [ClassicSimilarity], result of:
           0.016711952 = score(doc=1005,freq=1.0), product of:
             0.07837068 = queryWeight, product of:
               1.195488 = boost
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.019213872 = queryNorm
             0.2132424 = fieldWeight in 1005, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4118783 = idf(docFreq=3963, maxDocs=44218)
               0.0625 = fieldNorm(doc=1005)
         0.06618052 = weight(abstract_txt:experimental in 1005) [ClassicSimilarity], result of:
           0.06618052 = score(doc=1005,freq=1.0), product of:
             0.19616535 = queryWeight, product of:
               1.8913833 = boost
               5.397938 = idf(docFreq=543, maxDocs=44218)
               0.019213872 = queryNorm
             0.3373711 = fieldWeight in 1005, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.397938 = idf(docFreq=543, maxDocs=44218)
               0.0625 = fieldNorm(doc=1005)
         0.06763911 = weight(abstract_txt:measure in 1005) [ClassicSimilarity], result of:
           0.06763911 = score(doc=1005,freq=1.0), product of:
             0.19903713 = queryWeight, product of:
               1.9051775 = boost
               5.437306 = idf(docFreq=522, maxDocs=44218)
               0.019213872 = queryNorm
             0.33983162 = fieldWeight in 1005, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.437306 = idf(docFreq=522, maxDocs=44218)
               0.0625 = fieldNorm(doc=1005)
         0.083643846 = weight(abstract_txt:effectiveness in 1005) [ClassicSimilarity], result of:
           0.083643846 = score(doc=1005,freq=1.0), product of:
             0.26249555 = queryWeight, product of:
               2.679631 = boost
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.019213872 = queryNorm
             0.31864864 = fieldWeight in 1005, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.0625 = fieldNorm(doc=1005)
         0.10813814 = weight(abstract_txt:retrieval in 1005) [ClassicSimilarity], result of:
           0.10813814 = score(doc=1005,freq=6.0), product of:
             0.20325957 = queryWeight, product of:
               3.0441349 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.019213872 = queryNorm
             0.5320199 = fieldWeight in 1005, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.0625 = fieldNorm(doc=1005)
       0.32 = coord(8/25)
   

5. Ahlgren, P.; Grönqvist, L.: Evaluation of retrieval effectiveness with incomplete relevance data : theoretical and experimental comparison of three measures (2008) 0.16

   0.15887374 = sum of:
     0.15887374 = product of:
       0.6619739 = sum of:
         0.06514305 = weight(abstract_txt:average in 2032) [ClassicSimilarity], result of:
           0.06514305 = score(doc=2032,freq=1.0), product of:
             0.11757367 = queryWeight, product of:
               1.0354006 = boost
               5.90999 = idf(docFreq=325, maxDocs=44218)
               0.019213872 = queryNorm
             0.55406153 = fieldWeight in 2032, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.90999 = idf(docFreq=325, maxDocs=44218)
               0.09375 = fieldNorm(doc=2032)
         0.20441478 = weight(abstract_txt:experimentally in 2032) [ClassicSimilarity], result of:
           0.20441478 = score(doc=2032,freq=1.0), product of:
             0.25200328 = queryWeight, product of:
               1.5158509 = boost
               8.652365 = idf(docFreq=20, maxDocs=44218)
               0.019213872 = queryNorm
             0.8111592 = fieldWeight in 2032, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.652365 = idf(docFreq=20, maxDocs=44218)
               0.09375 = fieldNorm(doc=2032)
         0.09927078 = weight(abstract_txt:experimental in 2032) [ClassicSimilarity], result of:
           0.09927078 = score(doc=2032,freq=1.0), product of:
             0.19616535 = queryWeight, product of:
               1.8913833 = boost
               5.397938 = idf(docFreq=543, maxDocs=44218)
               0.019213872 = queryNorm
             0.50605667 = fieldWeight in 2032, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.397938 = idf(docFreq=543, maxDocs=44218)
               0.09375 = fieldNorm(doc=2032)
         0.10145867 = weight(abstract_txt:measure in 2032) [ClassicSimilarity], result of:
           0.10145867 = score(doc=2032,freq=1.0), product of:
             0.19903713 = queryWeight, product of:
               1.9051775 = boost
               5.437306 = idf(docFreq=522, maxDocs=44218)
               0.019213872 = queryNorm
             0.50974745 = fieldWeight in 2032, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.437306 = idf(docFreq=522, maxDocs=44218)
               0.09375 = fieldNorm(doc=2032)
         0.12546577 = weight(abstract_txt:effectiveness in 2032) [ClassicSimilarity], result of:
           0.12546577 = score(doc=2032,freq=1.0), product of:
             0.26249555 = queryWeight, product of:
               2.679631 = boost
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.019213872 = queryNorm
             0.47797295 = fieldWeight in 2032, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.098378 = idf(docFreq=733, maxDocs=44218)
               0.09375 = fieldNorm(doc=2032)
         0.06622081 = weight(abstract_txt:retrieval in 2032) [ClassicSimilarity], result of:
           0.06622081 = score(doc=2032,freq=1.0), product of:
             0.20325957 = queryWeight, product of:
               3.0441349 = boost
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.019213872 = queryNorm
             0.3257943 = fieldWeight in 2032, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.4751394 = idf(docFreq=3720, maxDocs=44218)
               0.09375 = fieldNorm(doc=2032)
       0.24 = coord(6/25)