Document (#37526)

Author

Lee, C.J.
Sugimoto, C.R.
Zhang, G.
Cronin, B.

Title

Bias in peer review

Source

Journal of the American Society for Information Science and Technology. 64(2013) no.1, S.2-17

Year

2013

Series

Advances in information science

Abstract

Research on bias in peer review examines scholarly communication and funding processes to assess the epistemic and social legitimacy of the mechanisms by which knowledge communities vet and self-regulate their work. Despite vocal concerns, a closer look at the empirical and methodological limitations of research on bias raises questions about the existence and extent of many hypothesized forms of bias. In addition, the notion of bias is predicated on an implicit ideal that, once articulated, raises questions about the normative implications of research on bias in peer review. This review provides a brief description of the function, history, and scope of peer review; articulates and critiques the conception of bias unifying research on bias in peer review; characterizes and examines the empirical, methodological, and normative claims of bias in peer review research; and assesses possible alternatives to the status quo. We close by identifying ways to expand conceptions and studies of bias to contend with the complexity of social interactions among actors involved directly and indirectly in peer review.

Similar documents (author)

1. Sugimoto, C.R.; Cronin, B.: Biobibliometric profiling : an examination of multifaceted approaches to scholarship (2012) 3.41

   3.4149597 = sum of:
     3.4149597 = product of:
       5.1224394 = sum of:
         2.277104 = weight(author_txt:cronin in 4991) [ClassicSimilarity], result of:
           2.277104 = score(doc=4991,freq=1.0), product of:
             0.5936501 = queryWeight, product of:
               1.1942201 = boost
               7.6715355 = idf(docFreq=55, maxDocs=44218)
               0.06479834 = queryNorm
             3.8357677 = fieldWeight in 4991, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.6715355 = idf(docFreq=55, maxDocs=44218)
               0.5 = fieldNorm(doc=4991)
         2.8453355 = weight(author_txt:sugimoto in 4991) [ClassicSimilarity], result of:
           2.8453355 = score(doc=4991,freq=1.0), product of:
             0.6887014 = queryWeight, product of:
               1.2862772 = boost
               8.2629 = idf(docFreq=30, maxDocs=44218)
               0.06479834 = queryNorm
             4.13145 = fieldWeight in 4991, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.2629 = idf(docFreq=30, maxDocs=44218)
               0.5 = fieldNorm(doc=4991)
       0.6666667 = coord(2/3)
   

2. Larivière, V.; Sugimoto, C.R.; Cronin, B.: ¬A bibliometric chronicling of library and information science's first hundred years (2012) 2.56

   2.5612197 = sum of:
     2.5612197 = product of:
       3.8418293 = sum of:
         1.7078279 = weight(author_txt:cronin in 244) [ClassicSimilarity], result of:
           1.7078279 = score(doc=244,freq=1.0), product of:
             0.5936501 = queryWeight, product of:
               1.1942201 = boost
               7.6715355 = idf(docFreq=55, maxDocs=44218)
               0.06479834 = queryNorm
             2.8768258 = fieldWeight in 244, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.6715355 = idf(docFreq=55, maxDocs=44218)
               0.375 = fieldNorm(doc=244)
         2.1340015 = weight(author_txt:sugimoto in 244) [ClassicSimilarity], result of:
           2.1340015 = score(doc=244,freq=1.0), product of:
             0.6887014 = queryWeight, product of:
               1.2862772 = boost
               8.2629 = idf(docFreq=30, maxDocs=44218)
               0.06479834 = queryNorm
             3.0985875 = fieldWeight in 244, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.2629 = idf(docFreq=30, maxDocs=44218)
               0.375 = fieldNorm(doc=244)
       0.6666667 = coord(2/3)
   

3. Larivière, V.; Sugimoto, C.R.; Macaluso, B.; Milojevi´c, S.; Cronin, B.; Thelwall, M.: arXiv E-prints and the journal of record : an analysis of roles and relationships (2014) 1.71

   1.7074798 = sum of:
     1.7074798 = product of:
       2.5612197 = sum of:
         1.138552 = weight(author_txt:cronin in 1285) [ClassicSimilarity], result of:
           1.138552 = score(doc=1285,freq=1.0), product of:
             0.5936501 = queryWeight, product of:
               1.1942201 = boost
               7.6715355 = idf(docFreq=55, maxDocs=44218)
               0.06479834 = queryNorm
             1.9178839 = fieldWeight in 1285, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.6715355 = idf(docFreq=55, maxDocs=44218)
               0.25 = fieldNorm(doc=1285)
         1.4226677 = weight(author_txt:sugimoto in 1285) [ClassicSimilarity], result of:
           1.4226677 = score(doc=1285,freq=1.0), product of:
             0.6887014 = queryWeight, product of:
               1.2862772 = boost
               8.2629 = idf(docFreq=30, maxDocs=44218)
               0.06479834 = queryNorm
             2.065725 = fieldWeight in 1285, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.2629 = idf(docFreq=30, maxDocs=44218)
               0.25 = fieldNorm(doc=1285)
       0.6666667 = coord(2/3)
   

4. Sugimoto, M.: ¬A document retrieval system for assisting creative research (1995) 1.19

   1.1855565 = sum of:
     1.1855565 = product of:
       3.5566695 = sum of:
         3.5566695 = weight(author_txt:sugimoto in 3143) [ClassicSimilarity], result of:
           3.5566695 = score(doc=3143,freq=1.0), product of:
             0.6887014 = queryWeight, product of:
               1.2862772 = boost
               8.2629 = idf(docFreq=30, maxDocs=44218)
               0.06479834 = queryNorm
             5.164313 = fieldWeight in 3143, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               8.2629 = idf(docFreq=30, maxDocs=44218)
               0.625 = fieldNorm(doc=3143)
       0.33333334 = coord(1/3)
   

5. Cronin, B.: Standing on ceremony (2013) 0.95

   0.94879335 = sum of:
     0.94879335 = product of:
       2.84638 = sum of:
         2.84638 = weight(author_txt:cronin in 1106) [ClassicSimilarity], result of:
           2.84638 = score(doc=1106,freq=1.0), product of:
             0.5936501 = queryWeight, product of:
               1.1942201 = boost
               7.6715355 = idf(docFreq=55, maxDocs=44218)
               0.06479834 = queryNorm
             4.7947097 = fieldWeight in 1106, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               7.6715355 = idf(docFreq=55, maxDocs=44218)
               0.625 = fieldNorm(doc=1106)
       0.33333334 = coord(1/3)
   

Similar documents (content)

1. García, J.A.; Rodriguez-Sánchez, R.; Fdez-Valdivia, J.: Bias and effort in peer review (2015) 0.20

   0.19929335 = sum of:
     0.19929335 = product of:
       1.2455834 = sum of:
         0.013664181 = weight(abstract_txt:about in 2121) [ClassicSimilarity], result of:
           0.013664181 = score(doc=2121,freq=1.0), product of:
             0.04460418 = queryWeight, product of:
               1.054905 = boost
               3.9211915 = idf(docFreq=2381, maxDocs=44218)
               0.010783113 = queryNorm
             0.30634308 = fieldWeight in 2121, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9211915 = idf(docFreq=2381, maxDocs=44218)
               0.078125 = fieldNorm(doc=2121)
         0.18007436 = weight(abstract_txt:review in 2121) [ClassicSimilarity], result of:
           0.18007436 = score(doc=2121,freq=3.0), product of:
             0.27390543 = queryWeight, product of:
               5.228245 = boost
               4.858482 = idf(docFreq=932, maxDocs=44218)
               0.010783113 = queryNorm
             0.6574326 = fieldWeight in 2121, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               4.858482 = idf(docFreq=932, maxDocs=44218)
               0.078125 = fieldNorm(doc=2121)
         0.37702966 = weight(abstract_txt:peer in 2121) [ClassicSimilarity], result of:
           0.37702966 = score(doc=2121,freq=3.0), product of:
             0.42876476 = queryWeight, product of:
               6.1188407 = boost
               6.49839 = idf(docFreq=180, maxDocs=44218)
               0.010783113 = queryNorm
             0.8793392 = fieldWeight in 2121, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.49839 = idf(docFreq=180, maxDocs=44218)
               0.078125 = fieldNorm(doc=2121)
         0.6748152 = weight(abstract_txt:bias in 2121) [ClassicSimilarity], result of:
           0.6748152 = score(doc=2121,freq=3.0), product of:
             0.7118568 = queryWeight, product of:
               9.423385 = boost
               7.0055394 = idf(docFreq=108, maxDocs=44218)
               0.010783113 = queryNorm
             0.94796485 = fieldWeight in 2121, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.0055394 = idf(docFreq=108, maxDocs=44218)
               0.078125 = fieldNorm(doc=2121)
       0.16 = coord(4/25)
   

2. Zhao, Y.W.; Chi. C.-H.; Heuvel, W.J. van den: Imperfect referees : reducing the impact of multiple biases in peer review (2015) 0.19

   0.18869744 = sum of:
     0.18869744 = product of:
       1.1793591 = sum of:
         0.014443622 = weight(abstract_txt:research in 2271) [ClassicSimilarity], result of:
           0.014443622 = score(doc=2271,freq=1.0), product of:
             0.07289379 = queryWeight, product of:
               2.1322634 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.010783113 = queryNorm
             0.19814612 = fieldWeight in 2271, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.0625 = fieldNorm(doc=2271)
         0.16634557 = weight(abstract_txt:review in 2271) [ClassicSimilarity], result of:
           0.16634557 = score(doc=2271,freq=4.0), product of:
             0.27390543 = queryWeight, product of:
               5.228245 = boost
               4.858482 = idf(docFreq=932, maxDocs=44218)
               0.010783113 = queryNorm
             0.60731024 = fieldWeight in 2271, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               4.858482 = idf(docFreq=932, maxDocs=44218)
               0.0625 = fieldNorm(doc=2271)
         0.30162373 = weight(abstract_txt:peer in 2271) [ClassicSimilarity], result of:
           0.30162373 = score(doc=2271,freq=3.0), product of:
             0.42876476 = queryWeight, product of:
               6.1188407 = boost
               6.49839 = idf(docFreq=180, maxDocs=44218)
               0.010783113 = queryNorm
             0.70347136 = fieldWeight in 2271, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               6.49839 = idf(docFreq=180, maxDocs=44218)
               0.0625 = fieldNorm(doc=2271)
         0.69694614 = weight(abstract_txt:bias in 2271) [ClassicSimilarity], result of:
           0.69694614 = score(doc=2271,freq=5.0), product of:
             0.7118568 = queryWeight, product of:
               9.423385 = boost
               7.0055394 = idf(docFreq=108, maxDocs=44218)
               0.010783113 = queryNorm
             0.9790539 = fieldWeight in 2271, product of:
               2.236068 = tf(freq=5.0), with freq of:
                 5.0 = termFreq=5.0
               7.0055394 = idf(docFreq=108, maxDocs=44218)
               0.0625 = fieldNorm(doc=2271)
       0.16 = coord(4/25)
   

3. Sun, M.; Danfa, J.B.; Teplitskiy, M.: Does double-blind peer review reduce bias? : evidence from a top computer science conference (2022) 0.18

   0.18300986 = sum of:
     0.18300986 = product of:
       1.1438117 = sum of:
         0.020426366 = weight(abstract_txt:research in 562) [ClassicSimilarity], result of:
           0.020426366 = score(doc=562,freq=2.0), product of:
             0.07289379 = queryWeight, product of:
               2.1322634 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.010783113 = queryNorm
             0.28022093 = fieldWeight in 562, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.0625 = fieldNorm(doc=562)
         0.23524815 = weight(abstract_txt:review in 562) [ClassicSimilarity], result of:
           0.23524815 = score(doc=562,freq=8.0), product of:
             0.27390543 = queryWeight, product of:
               5.228245 = boost
               4.858482 = idf(docFreq=932, maxDocs=44218)
               0.010783113 = queryNorm
             0.85886633 = fieldWeight in 562, product of:
               2.828427 = tf(freq=8.0), with freq of:
                 8.0 = termFreq=8.0
               4.858482 = idf(docFreq=932, maxDocs=44218)
               0.0625 = fieldNorm(doc=562)
         0.34828508 = weight(abstract_txt:peer in 562) [ClassicSimilarity], result of:
           0.34828508 = score(doc=562,freq=4.0), product of:
             0.42876476 = queryWeight, product of:
               6.1188407 = boost
               6.49839 = idf(docFreq=180, maxDocs=44218)
               0.010783113 = queryNorm
             0.8122988 = fieldWeight in 562, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.49839 = idf(docFreq=180, maxDocs=44218)
               0.0625 = fieldNorm(doc=562)
         0.5398522 = weight(abstract_txt:bias in 562) [ClassicSimilarity], result of:
           0.5398522 = score(doc=562,freq=3.0), product of:
             0.7118568 = queryWeight, product of:
               9.423385 = boost
               7.0055394 = idf(docFreq=108, maxDocs=44218)
               0.010783113 = queryNorm
             0.7583719 = fieldWeight in 562, product of:
               1.7320508 = tf(freq=3.0), with freq of:
                 3.0 = termFreq=3.0
               7.0055394 = idf(docFreq=108, maxDocs=44218)
               0.0625 = fieldNorm(doc=562)
       0.16 = coord(4/25)
   

4. Mutz, R.; Bornmann, L.; Daniel, H.-D.: Testing for the fairness and predictive validity of research funding decisions : a multilevel multiple imputation for missing data approach using ex-ante and ex-post peer evaluation data from the Austrian science fund (2015) 0.18

   0.17890625 = sum of:
     0.17890625 = product of:
       1.1181641 = sum of:
         0.028887244 = weight(abstract_txt:research in 2270) [ClassicSimilarity], result of:
           0.028887244 = score(doc=2270,freq=4.0), product of:
             0.07289379 = queryWeight, product of:
               2.1322634 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.010783113 = queryNorm
             0.39629224 = fieldWeight in 2270, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.0625 = fieldNorm(doc=2270)
         0.117624074 = weight(abstract_txt:review in 2270) [ClassicSimilarity], result of:
           0.117624074 = score(doc=2270,freq=2.0), product of:
             0.27390543 = queryWeight, product of:
               5.228245 = boost
               4.858482 = idf(docFreq=932, maxDocs=44218)
               0.010783113 = queryNorm
             0.42943317 = fieldWeight in 2270, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               4.858482 = idf(docFreq=932, maxDocs=44218)
               0.0625 = fieldNorm(doc=2270)
         0.34828508 = weight(abstract_txt:peer in 2270) [ClassicSimilarity], result of:
           0.34828508 = score(doc=2270,freq=4.0), product of:
             0.42876476 = queryWeight, product of:
               6.1188407 = boost
               6.49839 = idf(docFreq=180, maxDocs=44218)
               0.010783113 = queryNorm
             0.8122988 = fieldWeight in 2270, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               6.49839 = idf(docFreq=180, maxDocs=44218)
               0.0625 = fieldNorm(doc=2270)
         0.6233676 = weight(abstract_txt:bias in 2270) [ClassicSimilarity], result of:
           0.6233676 = score(doc=2270,freq=4.0), product of:
             0.7118568 = queryWeight, product of:
               9.423385 = boost
               7.0055394 = idf(docFreq=108, maxDocs=44218)
               0.010783113 = queryNorm
             0.8756924 = fieldWeight in 2270, product of:
               2.0 = tf(freq=4.0), with freq of:
                 4.0 = termFreq=4.0
               7.0055394 = idf(docFreq=108, maxDocs=44218)
               0.0625 = fieldNorm(doc=2270)
       0.16 = coord(4/25)
   

5. Mulligan, A.; Hall, L.; Raphael, E.: Peer review in a changing world : an international study measuring the attitudes of researchers (2013) 0.15

   0.14567329 = sum of:
     0.14567329 = product of:
       0.9104581 = sum of:
         0.010931346 = weight(abstract_txt:about in 528) [ClassicSimilarity], result of:
           0.010931346 = score(doc=528,freq=1.0), product of:
             0.04460418 = queryWeight, product of:
               1.054905 = boost
               3.9211915 = idf(docFreq=2381, maxDocs=44218)
               0.010783113 = queryNorm
             0.24507447 = fieldWeight in 528, product of:
               1.0 = tf(freq=1.0), with freq of:
                 1.0 = termFreq=1.0
               3.9211915 = idf(docFreq=2381, maxDocs=44218)
               0.0625 = fieldNorm(doc=528)
         0.020426366 = weight(abstract_txt:research in 528) [ClassicSimilarity], result of:
           0.020426366 = score(doc=528,freq=2.0), product of:
             0.07289379 = queryWeight, product of:
               2.1322634 = boost
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.010783113 = queryNorm
             0.28022093 = fieldWeight in 528, product of:
               1.4142135 = tf(freq=2.0), with freq of:
                 2.0 = termFreq=2.0
               3.170338 = idf(docFreq=5046, maxDocs=44218)
               0.0625 = fieldNorm(doc=528)
         0.27585292 = weight(abstract_txt:review in 528) [ClassicSimilarity], result of:
           0.27585292 = score(doc=528,freq=11.0), product of:
             0.27390543 = queryWeight, product of:
               5.228245 = boost
               4.858482 = idf(docFreq=932, maxDocs=44218)
               0.010783113 = queryNorm
             1.0071101 = fieldWeight in 528, product of:
               3.3166249 = tf(freq=11.0), with freq of:
                 11.0 = termFreq=11.0
               4.858482 = idf(docFreq=932, maxDocs=44218)
               0.0625 = fieldNorm(doc=528)
         0.60324746 = weight(abstract_txt:peer in 528) [ClassicSimilarity], result of:
           0.60324746 = score(doc=528,freq=12.0), product of:
             0.42876476 = queryWeight, product of:
               6.1188407 = boost
               6.49839 = idf(docFreq=180, maxDocs=44218)
               0.010783113 = queryNorm
             1.4069427 = fieldWeight in 528, product of:
               3.4641016 = tf(freq=12.0), with freq of:
                 12.0 = termFreq=12.0
               6.49839 = idf(docFreq=180, maxDocs=44218)
               0.0625 = fieldNorm(doc=528)
       0.16 = coord(4/25)