-
Mutz, R.; Bornmann, L.; Daniel, H.-D.: Testing for the fairness and predictive validity of research funding decisions : a multilevel multiple imputation for missing data approach using ex-ante and ex-post peer evaluation data from the Austrian science fund (2015)
0.03
0.028730042 = product of:
0.057460085 = sum of:
0.057460085 = product of:
0.08619013 = sum of:
0.047037635 = weight(_text_:r in 2270) [ClassicSimilarity], result of:
0.047037635 = score(doc=2270,freq=6.0), product of:
0.14850734 = queryWeight, product of:
3.3102584 = idf(docFreq=4387, maxDocs=44218)
0.044862766 = queryNorm
0.3167361 = fieldWeight in 2270, product of:
2.4494898 = tf(freq=6.0), with freq of:
6.0 = termFreq=6.0
3.3102584 = idf(docFreq=4387, maxDocs=44218)
0.0390625 = fieldNorm(doc=2270)
0.03915249 = weight(_text_:l in 2270) [ClassicSimilarity], result of:
0.03915249 = score(doc=2270,freq=2.0), product of:
0.17831391 = queryWeight, product of:
3.9746525 = idf(docFreq=2257, maxDocs=44218)
0.044862766 = queryNorm
0.2195706 = fieldWeight in 2270, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.9746525 = idf(docFreq=2257, maxDocs=44218)
0.0390625 = fieldNorm(doc=2270)
0.6666667 = coord(2/3)
0.5 = coord(1/2)
- Abstract
- It is essential for research funding organizations to ensure both the validity and fairness of the grant approval procedure. The ex-ante peer evaluation (EXANTE) of N?=?8,496 grant applications submitted to the Austrian Science Fund from 1999 to 2009 was statistically analyzed. For 1,689 funded research projects an ex-post peer evaluation (EXPOST) was also available; for the rest of the grant applications a multilevel missing data imputation approach was used to consider verification bias for the first time in peer-review research. Without imputation, the predictive validity of EXANTE was low (r?=?.26) but underestimated due to verification bias, and with imputation it was r?=?.49. That is, the decision-making procedure is capable of selecting the best research proposals for funding. In the EXANTE there were several potential biases (e.g., gender). With respect to the EXPOST there was only one real bias (discipline-specific and year-specific differential prediction). The novelty of this contribution is, first, the combining of theoretical concepts of validity and fairness with a missing data imputation approach to correct for verification bias and, second, multilevel modeling to test peer review-based funding decisions for both validity and fairness in terms of potential and real biases.
-
Bornmann, L.; Mutz, R.; Daniel, H.-D.: Are there better indices for evaluation purposes than the h index? : a comparison of nine different variants of the h index using data from biomedicine (2008)
0.02
0.022103228 = product of:
0.044206455 = sum of:
0.044206455 = product of:
0.06630968 = sum of:
0.02715719 = weight(_text_:r in 1608) [ClassicSimilarity], result of:
0.02715719 = score(doc=1608,freq=2.0), product of:
0.14850734 = queryWeight, product of:
3.3102584 = idf(docFreq=4387, maxDocs=44218)
0.044862766 = queryNorm
0.18286766 = fieldWeight in 1608, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.3102584 = idf(docFreq=4387, maxDocs=44218)
0.0390625 = fieldNorm(doc=1608)
0.03915249 = weight(_text_:l in 1608) [ClassicSimilarity], result of:
0.03915249 = score(doc=1608,freq=2.0), product of:
0.17831391 = queryWeight, product of:
3.9746525 = idf(docFreq=2257, maxDocs=44218)
0.044862766 = queryNorm
0.2195706 = fieldWeight in 1608, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.9746525 = idf(docFreq=2257, maxDocs=44218)
0.0390625 = fieldNorm(doc=1608)
0.6666667 = coord(2/3)
0.5 = coord(1/2)
-
Bornmann, L.; Mutz, R.; Daniel, H.-D.: Multilevel-statistical reformulation of citation-based university rankings : the Leiden ranking 2011/2012 (2013)
0.02
0.022103228 = product of:
0.044206455 = sum of:
0.044206455 = product of:
0.06630968 = sum of:
0.02715719 = weight(_text_:r in 1007) [ClassicSimilarity], result of:
0.02715719 = score(doc=1007,freq=2.0), product of:
0.14850734 = queryWeight, product of:
3.3102584 = idf(docFreq=4387, maxDocs=44218)
0.044862766 = queryNorm
0.18286766 = fieldWeight in 1007, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.3102584 = idf(docFreq=4387, maxDocs=44218)
0.0390625 = fieldNorm(doc=1007)
0.03915249 = weight(_text_:l in 1007) [ClassicSimilarity], result of:
0.03915249 = score(doc=1007,freq=2.0), product of:
0.17831391 = queryWeight, product of:
3.9746525 = idf(docFreq=2257, maxDocs=44218)
0.044862766 = queryNorm
0.2195706 = fieldWeight in 1007, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.9746525 = idf(docFreq=2257, maxDocs=44218)
0.0390625 = fieldNorm(doc=1007)
0.6666667 = coord(2/3)
0.5 = coord(1/2)
-
Bornmann, L.; Daniel, H.-D.: What do we know about the h index? (2007)
0.01
0.0091355825 = product of:
0.018271165 = sum of:
0.018271165 = product of:
0.054813493 = sum of:
0.054813493 = weight(_text_:l in 477) [ClassicSimilarity], result of:
0.054813493 = score(doc=477,freq=2.0), product of:
0.17831391 = queryWeight, product of:
3.9746525 = idf(docFreq=2257, maxDocs=44218)
0.044862766 = queryNorm
0.30739886 = fieldWeight in 477, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.9746525 = idf(docFreq=2257, maxDocs=44218)
0.0546875 = fieldNorm(doc=477)
0.33333334 = coord(1/3)
0.5 = coord(1/2)
-
Bornmann, L.; Daniel, H.-D.: Multiple publication on a single research study: does it pay? : The influence of number of research articles on total citation counts in biomedicine (2007)
0.01
0.0065254155 = product of:
0.013050831 = sum of:
0.013050831 = product of:
0.03915249 = sum of:
0.03915249 = weight(_text_:l in 444) [ClassicSimilarity], result of:
0.03915249 = score(doc=444,freq=2.0), product of:
0.17831391 = queryWeight, product of:
3.9746525 = idf(docFreq=2257, maxDocs=44218)
0.044862766 = queryNorm
0.2195706 = fieldWeight in 444, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.9746525 = idf(docFreq=2257, maxDocs=44218)
0.0390625 = fieldNorm(doc=444)
0.33333334 = coord(1/3)
0.5 = coord(1/2)
-
Bornmann, L.; Daniel, H.-D.: Universality of citation distributions : a validation of Radicchi et al.'s relative indicator cf = c/c0 at the micro level using data from chemistry (2009)
0.01
0.0065254155 = product of:
0.013050831 = sum of:
0.013050831 = product of:
0.03915249 = sum of:
0.03915249 = weight(_text_:l in 2954) [ClassicSimilarity], result of:
0.03915249 = score(doc=2954,freq=2.0), product of:
0.17831391 = queryWeight, product of:
3.9746525 = idf(docFreq=2257, maxDocs=44218)
0.044862766 = queryNorm
0.2195706 = fieldWeight in 2954, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.9746525 = idf(docFreq=2257, maxDocs=44218)
0.0390625 = fieldNorm(doc=2954)
0.33333334 = coord(1/3)
0.5 = coord(1/2)
-
Bornmann, L.; Schier, H.; Marx, W.; Daniel, H.-D.: Is interactive open access publishing able to identify high-impact submissions? : a study on the predictive validity of Atmospheric Chemistry and Physics by using percentile rank classes (2011)
0.01
0.0065254155 = product of:
0.013050831 = sum of:
0.013050831 = product of:
0.03915249 = sum of:
0.03915249 = weight(_text_:l in 4132) [ClassicSimilarity], result of:
0.03915249 = score(doc=4132,freq=2.0), product of:
0.17831391 = queryWeight, product of:
3.9746525 = idf(docFreq=2257, maxDocs=44218)
0.044862766 = queryNorm
0.2195706 = fieldWeight in 4132, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.9746525 = idf(docFreq=2257, maxDocs=44218)
0.0390625 = fieldNorm(doc=4132)
0.33333334 = coord(1/3)
0.5 = coord(1/2)
-
Mutz, R.; Daniel, H.-D.: What is behind the curtain of the Leiden Ranking? (2015)
0.01
0.005431439 = product of:
0.010862878 = sum of:
0.010862878 = product of:
0.03258863 = sum of:
0.03258863 = weight(_text_:r in 2171) [ClassicSimilarity], result of:
0.03258863 = score(doc=2171,freq=2.0), product of:
0.14850734 = queryWeight, product of:
3.3102584 = idf(docFreq=4387, maxDocs=44218)
0.044862766 = queryNorm
0.2194412 = fieldWeight in 2171, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.3102584 = idf(docFreq=4387, maxDocs=44218)
0.046875 = fieldNorm(doc=2171)
0.33333334 = coord(1/3)
0.5 = coord(1/2)
-
Bornmann, L.; Daniel, H.-D.: Selecting manuscripts for a high-impact journal through peer review : a citation analysis of communications that were accepted by Angewandte Chemie International Edition, or rejected but published elsewhere (2008)
0.01
0.0052203326 = product of:
0.010440665 = sum of:
0.010440665 = product of:
0.031321995 = sum of:
0.031321995 = weight(_text_:l in 2381) [ClassicSimilarity], result of:
0.031321995 = score(doc=2381,freq=2.0), product of:
0.17831391 = queryWeight, product of:
3.9746525 = idf(docFreq=2257, maxDocs=44218)
0.044862766 = queryNorm
0.17565648 = fieldWeight in 2381, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.9746525 = idf(docFreq=2257, maxDocs=44218)
0.03125 = fieldNorm(doc=2381)
0.33333334 = coord(1/3)
0.5 = coord(1/2)
-
Mutz, R.; Wolbring, T.; Daniel, H.-D.: ¬The effect of the "very important paper" (VIP) designation in Angewandte Chemie International Edition on citation impact : a propensity score matching analysis (2017)
0.00
0.0045261984 = product of:
0.009052397 = sum of:
0.009052397 = product of:
0.02715719 = sum of:
0.02715719 = weight(_text_:r in 3792) [ClassicSimilarity], result of:
0.02715719 = score(doc=3792,freq=2.0), product of:
0.14850734 = queryWeight, product of:
3.3102584 = idf(docFreq=4387, maxDocs=44218)
0.044862766 = queryNorm
0.18286766 = fieldWeight in 3792, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
3.3102584 = idf(docFreq=4387, maxDocs=44218)
0.0390625 = fieldNorm(doc=3792)
0.33333334 = coord(1/3)
0.5 = coord(1/2)
