Document (#13329)

Author

Pair, C.I.

Title

Formal evaluation methods : their utility and limitations

Source

International forum on information and documentation. 20(1995) no.4, S.16-24

Year

1995

Abstract

Discusses evaluation techniques as an integral part of science with the emphasis on evalution for policy purposes. Outlines early attempts to validate the use of biliometric indicators. Concludes that: best results are obtained by applying a variety of methods simultaneously; reliable results can be obtained from citation analysis for purely scientific subfields such as physics; and citation analysis tends to give unreliable results for technological subjects. Concludes that bibliometrics as a technique for determining policy should never be used on its own. Describes an evaluation method used for selecting research projects for financial support, as applied by STW, the technology branch of the Netherlands' research council, NWO

Theme

Citation indexing
Informetrie

Similar documents (content)

1. Hirao, T.; Okumura, M.; Yasuda, N.; Isozaki, H.: Supervised automatic evaluation for summarization with voted regression model (2007) 0.18

   0.18168943 = sum of:
     0.18168943 = product of:
       0.7570393 = sum of:
         0.02267859 = weight(abstract_txt:used in 942) [ClassicSimilarity], result of:
           0.02267859 = score(doc=942,freq=1.0), product of:
             0.08641265 = queryWeight, product of:
               1.0312343 = boost
               3.3592992 = idf(docFreq=4177, maxDocs=44218)
               0.0249443 = queryNorm
             0.26244524 = fieldWeight in 942, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3592992 = idf(docFreq=4177, maxDocs=44218)
               0.078125 = fieldNorm(doc=942)
         0.07388475 = weight(abstract_txt:methods in 942) [ClassicSimilarity], result of:
           0.07388475 = score(doc=942,freq=3.0), product of:
             0.1316728 = queryWeight, product of:
               1.2729657 = boost
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.0249443 = queryNorm
             0.56112385 = fieldWeight in 942, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.078125 = fieldNorm(doc=942)
         0.20429248 = weight(abstract_txt:unreliable in 942) [ClassicSimilarity], result of:
           0.20429248 = score(doc=942,freq=1.0), product of:
             0.29693285 = queryWeight, product of:
               1.3517077 = boost
               8.806516 = idf(docFreq=17, maxDocs=44218)
               0.0249443 = queryNorm
             0.688009 = fieldWeight in 942, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.806516 = idf(docFreq=17, maxDocs=44218)
               0.078125 = fieldNorm(doc=942)
         0.06563964 = weight(abstract_txt:results in 942) [ClassicSimilarity], result of:
           0.06563964 = score(doc=942,freq=3.0), product of:
             0.13929453 = queryWeight, product of:
               1.6035457 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.0249443 = queryNorm
             0.47122908 = fieldWeight in 942, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.078125 = fieldNorm(doc=942)
         0.16140218 = weight(abstract_txt:obtained in 942) [ClassicSimilarity], result of:
           0.16140218 = score(doc=942,freq=2.0), product of:
             0.25376374 = queryWeight, product of:
               1.7671908 = boost
               5.756716 = idf(docFreq=379, maxDocs=44218)
               0.0249443 = queryNorm
             0.6360333 = fieldWeight in 942, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               5.756716 = idf(docFreq=379, maxDocs=44218)
               0.078125 = fieldNorm(doc=942)
         0.22914167 = weight(abstract_txt:evaluation in 942) [ClassicSimilarity], result of:
           0.22914167 = score(doc=942,freq=8.0), product of:
             0.2311549 = queryWeight, product of:
               2.0656934 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0249443 = queryNorm
             0.9912905 = fieldWeight in 942, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.078125 = fieldNorm(doc=942)
       0.24 = coord(6/25)
   

2. Bar-Ilan, J.: Informetrics (2009) 0.13

   0.13028406 = sum of:
     0.13028406 = product of:
       0.65142024 = sum of:
         0.1477796 = weight(abstract_txt:bibliometrics in 3822) [ClassicSimilarity], result of:
           0.1477796 = score(doc=3822,freq=2.0), product of:
             0.1899137 = queryWeight, product of:
               1.0810152 = boost
               7.042927 = idf(docFreq=104, maxDocs=44218)
               0.0249443 = queryNorm
             0.7781408 = fieldWeight in 3822, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.042927 = idf(docFreq=104, maxDocs=44218)
               0.078125 = fieldNorm(doc=3822)
         0.05053288 = weight(abstract_txt:analysis in 3822) [ClassicSimilarity], result of:
           0.05053288 = score(doc=3822,freq=3.0), product of:
             0.102213666 = queryWeight, product of:
               1.1215616 = boost
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.0249443 = queryNorm
             0.4943848 = fieldWeight in 3822, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.078125 = fieldNorm(doc=3822)
         0.19805674 = weight(abstract_txt:subfields in 3822) [ClassicSimilarity], result of:
           0.19805674 = score(doc=3822,freq=2.0), product of:
             0.23085524 = queryWeight, product of:
               1.1918553 = boost
               7.7650614 = idf(docFreq=50, maxDocs=44218)
               0.0249443 = queryNorm
             0.85792613 = fieldWeight in 3822, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.7650614 = idf(docFreq=50, maxDocs=44218)
               0.078125 = fieldNorm(doc=3822)
         0.14048019 = weight(abstract_txt:citation in 3822) [ClassicSimilarity], result of:
           0.14048019 = score(doc=3822,freq=4.0), product of:
             0.18360734 = queryWeight, product of:
               1.5031893 = boost
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.0249443 = queryNorm
             0.76511204 = fieldWeight in 3822, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.078125 = fieldNorm(doc=3822)
         0.114570834 = weight(abstract_txt:evaluation in 3822) [ClassicSimilarity], result of:
           0.114570834 = score(doc=3822,freq=2.0), product of:
             0.2311549 = queryWeight, product of:
               2.0656934 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0249443 = queryNorm
             0.49564525 = fieldWeight in 3822, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.078125 = fieldNorm(doc=3822)
       0.2 = coord(5/25)
   

3. Osareh, F.: Bibliometrics, citation analysis and co-citation analysis : a review of literature II (1996) 0.13

   0.13027905 = sum of:
     0.13027905 = product of:
       0.6513952 = sum of:
         0.036285743 = weight(abstract_txt:used in 7105) [ClassicSimilarity], result of:
           0.036285743 = score(doc=7105,freq=1.0), product of:
             0.08641265 = queryWeight, product of:
               1.0312343 = boost
               3.3592992 = idf(docFreq=4177, maxDocs=44218)
               0.0249443 = queryNorm
             0.4199124 = fieldWeight in 7105, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3592992 = idf(docFreq=4177, maxDocs=44218)
               0.125 = fieldNorm(doc=7105)
         0.16719355 = weight(abstract_txt:bibliometrics in 7105) [ClassicSimilarity], result of:
           0.16719355 = score(doc=7105,freq=1.0), product of:
             0.1899137 = queryWeight, product of:
               1.0810152 = boost
               7.042927 = idf(docFreq=104, maxDocs=44218)
               0.0249443 = queryNorm
             0.88036585 = fieldWeight in 7105, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.042927 = idf(docFreq=104, maxDocs=44218)
               0.125 = fieldNorm(doc=7105)
         0.10438029 = weight(abstract_txt:analysis in 7105) [ClassicSimilarity], result of:
           0.10438029 = score(doc=7105,freq=5.0), product of:
             0.102213666 = queryWeight, product of:
               1.1215616 = boost
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.0249443 = queryNorm
             1.021197 = fieldWeight in 7105, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.125 = fieldNorm(doc=7105)
         0.0682518 = weight(abstract_txt:methods in 7105) [ClassicSimilarity], result of:
           0.0682518 = score(doc=7105,freq=1.0), product of:
             0.1316728 = queryWeight, product of:
               1.2729657 = boost
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.0249443 = queryNorm
             0.518344 = fieldWeight in 7105, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.125 = fieldNorm(doc=7105)
         0.27528384 = weight(abstract_txt:citation in 7105) [ClassicSimilarity], result of:
           0.27528384 = score(doc=7105,freq=6.0), product of:
             0.18360734 = queryWeight, product of:
               1.5031893 = boost
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.0249443 = queryNorm
             1.4993074 = fieldWeight in 7105, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.125 = fieldNorm(doc=7105)
       0.2 = coord(5/25)
   

4. Wan, X.; Liu, F.: Are all literature citations equally important? : automatic citation strength estimation and its applications (2014) 0.13

   0.13017994 = sum of:
     0.13017994 = product of:
       0.54241645 = sum of:
         0.104495965 = weight(abstract_txt:bibliometrics in 1350) [ClassicSimilarity], result of:
           0.104495965 = score(doc=1350,freq=1.0), product of:
             0.1899137 = queryWeight, product of:
               1.0810152 = boost
               7.042927 = idf(docFreq=104, maxDocs=44218)
               0.0249443 = queryNorm
             0.55022866 = fieldWeight in 1350, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.042927 = idf(docFreq=104, maxDocs=44218)
               0.078125 = fieldNorm(doc=1350)
         0.04125993 = weight(abstract_txt:analysis in 1350) [ClassicSimilarity], result of:
           0.04125993 = score(doc=1350,freq=2.0), product of:
             0.102213666 = queryWeight, product of:
               1.1215616 = boost
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.0249443 = queryNorm
             0.40366352 = fieldWeight in 1350, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.078125 = fieldNorm(doc=1350)
         0.042657375 = weight(abstract_txt:methods in 1350) [ClassicSimilarity], result of:
           0.042657375 = score(doc=1350,freq=1.0), product of:
             0.1316728 = queryWeight, product of:
               1.2729657 = boost
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.0249443 = queryNorm
             0.32396498 = fieldWeight in 1350, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.078125 = fieldNorm(doc=1350)
         0.1858378 = weight(abstract_txt:citation in 1350) [ClassicSimilarity], result of:
           0.1858378 = score(doc=1350,freq=7.0), product of:
             0.18360734 = queryWeight, product of:
               1.5031893 = boost
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.0249443 = queryNorm
             1.012148 = fieldWeight in 1350, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.078125 = fieldNorm(doc=1350)
         0.053594537 = weight(abstract_txt:results in 1350) [ClassicSimilarity], result of:
           0.053594537 = score(doc=1350,freq=2.0), product of:
             0.13929453 = queryWeight, product of:
               1.6035457 = boost
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.0249443 = queryNorm
             0.38475692 = fieldWeight in 1350, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.482422 = idf(docFreq=3693, maxDocs=44218)
               0.078125 = fieldNorm(doc=1350)
         0.114570834 = weight(abstract_txt:evaluation in 1350) [ClassicSimilarity], result of:
           0.114570834 = score(doc=1350,freq=2.0), product of:
             0.2311549 = queryWeight, product of:
               2.0656934 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0249443 = queryNorm
             0.49564525 = fieldWeight in 1350, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.078125 = fieldNorm(doc=1350)
       0.24 = coord(6/25)
   

5. Osareh, F.: Bibliometrics, citation analysis and co-citation analysis : a review of literature I (1996) 0.11

   0.113187194 = sum of:
     0.113187194 = product of:
       0.56593597 = sum of:
         0.036285743 = weight(abstract_txt:used in 7170) [ClassicSimilarity], result of:
           0.036285743 = score(doc=7170,freq=1.0), product of:
             0.08641265 = queryWeight, product of:
               1.0312343 = boost
               3.3592992 = idf(docFreq=4177, maxDocs=44218)
               0.0249443 = queryNorm
             0.4199124 = fieldWeight in 7170, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3592992 = idf(docFreq=4177, maxDocs=44218)
               0.125 = fieldNorm(doc=7170)
         0.23644736 = weight(abstract_txt:bibliometrics in 7170) [ClassicSimilarity], result of:
           0.23644736 = score(doc=7170,freq=2.0), product of:
             0.1899137 = queryWeight, product of:
               1.0810152 = boost
               7.042927 = idf(docFreq=104, maxDocs=44218)
               0.0249443 = queryNorm
             1.2450253 = fieldWeight in 7170, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.042927 = idf(docFreq=104, maxDocs=44218)
               0.125 = fieldNorm(doc=7170)
         0.066015884 = weight(abstract_txt:analysis in 7170) [ClassicSimilarity], result of:
           0.066015884 = score(doc=7170,freq=2.0), product of:
             0.102213666 = queryWeight, product of:
               1.1215616 = boost
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.0249443 = queryNorm
             0.6458616 = fieldWeight in 7170, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.6535451 = idf(docFreq=3112, maxDocs=44218)
               0.125 = fieldNorm(doc=7170)
         0.0682518 = weight(abstract_txt:methods in 7170) [ClassicSimilarity], result of:
           0.0682518 = score(doc=7170,freq=1.0), product of:
             0.1316728 = queryWeight, product of:
               1.2729657 = boost
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.0249443 = queryNorm
             0.518344 = fieldWeight in 7170, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.146752 = idf(docFreq=1900, maxDocs=44218)
               0.125 = fieldNorm(doc=7170)
         0.15893519 = weight(abstract_txt:citation in 7170) [ClassicSimilarity], result of:
           0.15893519 = score(doc=7170,freq=2.0), product of:
             0.18360734 = queryWeight, product of:
               1.5031893 = boost
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.0249443 = queryNorm
             0.86562544 = fieldWeight in 7170, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.896717 = idf(docFreq=897, maxDocs=44218)
               0.125 = fieldNorm(doc=7170)
       0.2 = coord(5/25)