Abramo, G.; D'Angelo, C.A.: ¬The VQR, Italy's second national research assessment : methodological failures and ranking distortions (2015)
0.01
0.005796136 = product of:
0.028980678 = sum of:
0.028980678 = weight(_text_:it in 2256) [ClassicSimilarity], result of:
0.028980678 = score(doc=2256,freq=2.0), product of:
0.15115225 = queryWeight, product of:
2.892262 = idf(docFreq=6664, maxDocs=44218)
0.052260913 = queryNorm
0.19173169 = fieldWeight in 2256, product of:
1.4142135 = tf(freq=2.0), with freq of:
2.0 = termFreq=2.0
2.892262 = idf(docFreq=6664, maxDocs=44218)
0.046875 = fieldNorm(doc=2256)
0.2 = coord(1/5)
- Abstract
- The 2004-2010 VQR (Research Quality Evaluation), completed in July 2013, was Italy's second national research assessment exercise. The VQR performance evaluation followed a pattern also seen in other nations, as it was based on a selected subset of products. In this work, we identify the exercise's methodological weaknesses and measure the distortions that result from them in the university performance rankings. First, we create a scenario in which we assume the efficient selection of the products to be submitted by the universities and, from this, simulate a set of rankings applying the precise VQR rating criteria. Next, we compare these "VQR rankings" with those that would derive from the application of more-appropriate bibliometrics. Finally, we extend the comparison to university rankings based on the entire scientific production for the period, as indexed in the Web of Science.