Document (#40223)

Author

Bonaccorsi, A.
Cicero, T.

Title

Distributed or concentrated research excellence? : evidence from a large-scale research assessment exercise

Source

Journal of the Association for Information Science and Technology. 67(2016) no.12, S.2976-2992

Year

2016

Abstract

Almost all research evaluation exercises, by construction, deliver data at the level of departments and universities, not at the level of individuals. Yet, the aggregate performance is the average of the performance of individual researchers. This paper explores the issue of the relative magnitude of variability in performance within departments and between departments. It exploits anonymized data at the individual level from one of the largest research evaluation exercises, the Italian VQR 2004-2010 (Valutazione della Qualità della Ricerca). If the variability between departments were much larger than variability within departments, we would see evidence of a process of stratification, or vertical differentiation, arguably driven by competition and researcher mobility. The data show that the opposite pattern is at play.

Content

Vgl.: http://onlinelibrary.wiley.com/doi/10.1002/asi.23539/full.

Similar documents (content)

1. Walters, W.H.; Wilder, E.I.: Disciplinary, national, and departmental contributions to the literature of library and information science, 2007-2012 (2016) 0.18

   0.17605115 = sum of:
     0.17605115 = product of:
       0.7335465 = sum of:
         0.058734667 = weight(abstract_txt:competition in 2940) [ClassicSimilarity], result of:
           0.058734667 = score(doc=2940,freq=1.0), product of:
             0.12440898 = queryWeight, product of:
               1.0020893 = boost
               7.5537524 = idf(docFreq=62, maxDocs=44218)
               0.016435487 = queryNorm
             0.47210953 = fieldWeight in 2940, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.5537524 = idf(docFreq=62, maxDocs=44218)
               0.0625 = fieldNorm(doc=2940)
         0.020131778 = weight(abstract_txt:within in 2940) [ClassicSimilarity], result of:
           0.020131778 = score(doc=2940,freq=1.0), product of:
             0.076769166 = queryWeight, product of:
               1.1132404 = boost
               4.195805 = idf(docFreq=1809, maxDocs=44218)
               0.016435487 = queryNorm
             0.26223782 = fieldWeight in 2940, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.195805 = idf(docFreq=1809, maxDocs=44218)
               0.0625 = fieldNorm(doc=2940)
         0.0151824355 = weight(abstract_txt:data in 2940) [ClassicSimilarity], result of:
           0.0151824355 = score(doc=2940,freq=1.0), product of:
             0.072809845 = queryWeight, product of:
               1.3278109 = boost
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.016435487 = queryNorm
             0.20852174 = fieldWeight in 2940, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.0625 = fieldNorm(doc=2940)
         0.024563933 = weight(abstract_txt:research in 2940) [ClassicSimilarity], result of:
           0.024563933 = score(doc=2940,freq=2.0), product of:
             0.087659165 = queryWeight, product of:
               1.6823223 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.016435487 = queryNorm
             0.28022093 = fieldWeight in 2940, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.0625 = fieldNorm(doc=2940)
         0.040587164 = weight(abstract_txt:performance in 2940) [ClassicSimilarity], result of:
           0.040587164 = score(doc=2940,freq=1.0), product of:
             0.14024529 = queryWeight, product of:
               1.8428301 = boost
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.016435487 = queryNorm
             0.28940126 = fieldWeight in 2940, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.0625 = fieldNorm(doc=2940)
         0.57434654 = weight(abstract_txt:departments in 2940) [ClassicSimilarity], result of:
           0.57434654 = score(doc=2940,freq=8.0), product of:
             0.48640507 = queryWeight, product of:
               4.4306207 = boost
               6.6796074 = idf(docFreq=150, maxDocs=44218)
               0.016435487 = queryNorm
             1.1807989 = fieldWeight in 2940, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               6.6796074 = idf(docFreq=150, maxDocs=44218)
               0.0625 = fieldNorm(doc=2940)
       0.24 = coord(6/25)
   

2. Clarke, A.; Steele, R.: Smartphone-based public health information systems : anonymity, privacy and intervention (2015) 0.11

   0.11414574 = sum of:
     0.11414574 = product of:
       0.40766335 = sum of:
         0.08254491 = weight(abstract_txt:aggregate in 2342) [ClassicSimilarity], result of:
           0.08254491 = score(doc=2342,freq=2.0), product of:
             0.123890765 = queryWeight, product of:
               7.538004 = idf(docFreq=63, maxDocs=44218)
               0.016435487 = queryNorm
             0.6662717 = fieldWeight in 2342, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.538004 = idf(docFreq=63, maxDocs=44218)
               0.0625 = fieldNorm(doc=2342)
         0.0658376 = weight(abstract_txt:concentrated in 2342) [ClassicSimilarity], result of:
           0.0658376 = score(doc=2342,freq=1.0), product of:
             0.13424703 = queryWeight, product of:
               1.0409572 = boost
               7.84674 = idf(docFreq=46, maxDocs=44218)
               0.016435487 = queryNorm
             0.49042124 = fieldWeight in 2342, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.84674 = idf(docFreq=46, maxDocs=44218)
               0.0625 = fieldNorm(doc=2342)
         0.024605602 = weight(abstract_txt:evaluation in 2342) [ClassicSimilarity], result of:
           0.024605602 = score(doc=2342,freq=1.0), product of:
             0.08775827 = queryWeight, product of:
               1.1902537 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.016435487 = queryNorm
             0.2803793 = fieldWeight in 2342, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.0625 = fieldNorm(doc=2342)
         0.044706937 = weight(abstract_txt:individual in 2342) [ClassicSimilarity], result of:
           0.044706937 = score(doc=2342,freq=2.0), product of:
             0.10371431 = queryWeight, product of:
               1.2939422 = boost
               4.8768706 = idf(docFreq=915, maxDocs=44218)
               0.016435487 = queryNorm
             0.43105853 = fieldWeight in 2342, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.8768706 = idf(docFreq=915, maxDocs=44218)
               0.0625 = fieldNorm(doc=2342)
         0.13243002 = weight(abstract_txt:anonymized in 2342) [ClassicSimilarity], result of:
           0.13243002 = score(doc=2342,freq=1.0), product of:
             0.21391752 = queryWeight, product of:
               1.3140253 = boost
               9.905128 = idf(docFreq=5, maxDocs=44218)
               0.016435487 = queryNorm
             0.6190705 = fieldWeight in 2342, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               9.905128 = idf(docFreq=5, maxDocs=44218)
               0.0625 = fieldNorm(doc=2342)
         0.04016895 = weight(abstract_txt:data in 2342) [ClassicSimilarity], result of:
           0.04016895 = score(doc=2342,freq=7.0), product of:
             0.072809845 = queryWeight, product of:
               1.3278109 = boost
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.016435487 = queryNorm
             0.55169666 = fieldWeight in 2342, product of:
               2.6457512 = tf(freq=7.0), with freq of:
                 7.0 = termFreq=7.0
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.0625 = fieldNorm(doc=2342)
         0.017369324 = weight(abstract_txt:research in 2342) [ClassicSimilarity], result of:
           0.017369324 = score(doc=2342,freq=1.0), product of:
             0.087659165 = queryWeight, product of:
               1.6823223 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.016435487 = queryNorm
             0.19814612 = fieldWeight in 2342, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.0625 = fieldNorm(doc=2342)
       0.28 = coord(7/25)
   

3. Vibert, N.; Ros, C.; Bigot, L. le; Ramond, M.; Gatefin, J.; Rouet, J.-F.: Effects of domain knowledge on reference search with the PubMed database : an experimental study (2009) 0.09

   0.09365861 = sum of:
     0.09365861 = product of:
       0.39024422 = sum of:
         0.028470634 = weight(abstract_txt:within in 2940) [ClassicSimilarity], result of:
           0.028470634 = score(doc=2940,freq=2.0), product of:
             0.076769166 = queryWeight, product of:
               1.1132404 = boost
               4.195805 = idf(docFreq=1809, maxDocs=44218)
               0.016435487 = queryNorm
             0.37086028 = fieldWeight in 2940, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.195805 = idf(docFreq=1809, maxDocs=44218)
               0.0625 = fieldNorm(doc=2940)
         0.044706937 = weight(abstract_txt:individual in 2940) [ClassicSimilarity], result of:
           0.044706937 = score(doc=2940,freq=2.0), product of:
             0.10371431 = queryWeight, product of:
               1.2939422 = boost
               4.8768706 = idf(docFreq=915, maxDocs=44218)
               0.016435487 = queryNorm
             0.43105853 = fieldWeight in 2940, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.8768706 = idf(docFreq=915, maxDocs=44218)
               0.0625 = fieldNorm(doc=2940)
         0.0151824355 = weight(abstract_txt:data in 2940) [ClassicSimilarity], result of:
           0.0151824355 = score(doc=2940,freq=1.0), product of:
             0.072809845 = queryWeight, product of:
               1.3278109 = boost
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.016435487 = queryNorm
             0.20852174 = fieldWeight in 2940, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.0625 = fieldNorm(doc=2940)
         0.03720258 = weight(abstract_txt:level in 2940) [ClassicSimilarity], result of:
           0.03720258 = score(doc=2940,freq=1.0), product of:
             0.13233596 = queryWeight, product of:
               1.7901115 = boost
               4.497956 = idf(docFreq=1337, maxDocs=44218)
               0.016435487 = queryNorm
             0.28112224 = fieldWeight in 2940, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.497956 = idf(docFreq=1337, maxDocs=44218)
               0.0625 = fieldNorm(doc=2940)
         0.07029902 = weight(abstract_txt:performance in 2940) [ClassicSimilarity], result of:
           0.07029902 = score(doc=2940,freq=3.0), product of:
             0.14024529 = queryWeight, product of:
               1.8428301 = boost
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.016435487 = queryNorm
             0.50125766 = fieldWeight in 2940, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.0625 = fieldNorm(doc=2940)
         0.19438261 = weight(abstract_txt:variability in 2940) [ClassicSimilarity], result of:
           0.19438261 = score(doc=2940,freq=1.0), product of:
             0.3984747 = queryWeight, product of:
               3.1062868 = boost
               7.805067 = idf(docFreq=48, maxDocs=44218)
               0.016435487 = queryNorm
             0.4878167 = fieldWeight in 2940, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.805067 = idf(docFreq=48, maxDocs=44218)
               0.0625 = fieldNorm(doc=2940)
       0.24 = coord(6/25)
   

4. Williams, D.; Coles, L.: Evidence-based practice in teaching : an information perspective (2007) 0.09

   0.092573315 = sum of:
     0.092573315 = product of:
       0.38572216 = sum of:
         0.015098834 = weight(abstract_txt:within in 848) [ClassicSimilarity], result of:
           0.015098834 = score(doc=848,freq=1.0), product of:
             0.076769166 = queryWeight, product of:
               1.1132404 = boost
               4.195805 = idf(docFreq=1809, maxDocs=44218)
               0.016435487 = queryNorm
             0.19667837 = fieldWeight in 848, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.195805 = idf(docFreq=1809, maxDocs=44218)
               0.046875 = fieldNorm(doc=848)
         0.027891915 = weight(abstract_txt:data in 848) [ClassicSimilarity], result of:
           0.027891915 = score(doc=848,freq=6.0), product of:
             0.072809845 = queryWeight, product of:
               1.3278109 = boost
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.016435487 = queryNorm
             0.3830789 = fieldWeight in 848, product of:
               2.4494898 = tf(freq=6.0), with freq of:
                 6.0 = termFreq=6.0
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.046875 = fieldNorm(doc=848)
         0.031793647 = weight(abstract_txt:evidence in 848) [ClassicSimilarity], result of:
           0.031793647 = score(doc=848,freq=1.0), product of:
             0.12612024 = queryWeight, product of:
               1.4268816 = boost
               5.377919 = idf(docFreq=554, maxDocs=44218)
               0.016435487 = queryNorm
             0.25208998 = fieldWeight in 848, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               5.377919 = idf(docFreq=554, maxDocs=44218)
               0.046875 = fieldNorm(doc=848)
         0.041194968 = weight(abstract_txt:research in 848) [ClassicSimilarity], result of:
           0.041194968 = score(doc=848,freq=10.0), product of:
             0.087659165 = queryWeight, product of:
               1.6823223 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.016435487 = queryNorm
             0.46994478 = fieldWeight in 848, product of:
               3.1622777 = tf(freq=10.0), with freq of:
                 10.0 = termFreq=10.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.046875 = fieldNorm(doc=848)
         0.11744618 = weight(abstract_txt:exercises in 848) [ClassicSimilarity], result of:
           0.11744618 = score(doc=848,freq=2.0), product of:
             0.23920695 = queryWeight, product of:
               1.9650899 = boost
               7.406428 = idf(docFreq=72, maxDocs=44218)
               0.016435487 = queryNorm
             0.49098146 = fieldWeight in 848, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               7.406428 = idf(docFreq=72, maxDocs=44218)
               0.046875 = fieldNorm(doc=848)
         0.15229663 = weight(abstract_txt:departments in 848) [ClassicSimilarity], result of:
           0.15229663 = score(doc=848,freq=1.0), product of:
             0.48640507 = queryWeight, product of:
               4.4306207 = boost
               6.6796074 = idf(docFreq=150, maxDocs=44218)
               0.016435487 = queryNorm
             0.3131066 = fieldWeight in 848, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.6796074 = idf(docFreq=150, maxDocs=44218)
               0.046875 = fieldNorm(doc=848)
       0.24 = coord(6/25)
   

5. Kuan, C.-H.; Huang, M.-H.; Chen, D.-Z.: ¬A two-dimensional approach to performance evaluation for a large number of research institutions (2012) 0.09

   0.08714712 = sum of:
     0.08714712 = product of:
       0.43573558 = sum of:
         0.030757003 = weight(abstract_txt:evaluation in 58) [ClassicSimilarity], result of:
           0.030757003 = score(doc=58,freq=1.0), product of:
             0.08775827 = queryWeight, product of:
               1.1902537 = boost
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.016435487 = queryNorm
             0.35047412 = fieldWeight in 58, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               4.4860687 = idf(docFreq=1353, maxDocs=44218)
               0.078125 = fieldNorm(doc=58)
         0.018978044 = weight(abstract_txt:data in 58) [ClassicSimilarity], result of:
           0.018978044 = score(doc=58,freq=1.0), product of:
             0.072809845 = queryWeight, product of:
               1.3278109 = boost
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.016435487 = queryNorm
             0.26065218 = fieldWeight in 58, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.3363478 = idf(docFreq=4274, maxDocs=44218)
               0.078125 = fieldNorm(doc=58)
         0.030704917 = weight(abstract_txt:research in 58) [ClassicSimilarity], result of:
           0.030704917 = score(doc=58,freq=2.0), product of:
             0.087659165 = queryWeight, product of:
               1.6823223 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.016435487 = queryNorm
             0.35027617 = fieldWeight in 58, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.078125 = fieldNorm(doc=58)
         0.101467915 = weight(abstract_txt:performance in 58) [ClassicSimilarity], result of:
           0.101467915 = score(doc=58,freq=4.0), product of:
             0.14024529 = queryWeight, product of:
               1.8428301 = boost
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.016435487 = queryNorm
             0.7235032 = fieldWeight in 58, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.63042 = idf(docFreq=1171, maxDocs=44218)
               0.078125 = fieldNorm(doc=58)
         0.25382772 = weight(abstract_txt:departments in 58) [ClassicSimilarity], result of:
           0.25382772 = score(doc=58,freq=1.0), product of:
             0.48640507 = queryWeight, product of:
               4.4306207 = boost
               6.6796074 = idf(docFreq=150, maxDocs=44218)
               0.016435487 = queryNorm
             0.5218443 = fieldWeight in 58, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               6.6796074 = idf(docFreq=150, maxDocs=44218)
               0.078125 = fieldNorm(doc=58)
       0.2 = coord(5/25)