Diese Datenbank enthält über 40.000 Dokumente zu Themen aus den Bereichen Formalerschließung – Inhaltserschließung – Information Retrieval.
© 2015 W. Gödert, TH Köln, Institut für Informationswissenschaft / Powered by litecat, BIS Oldenburg (Stand: 04. Juni 2021)
1Mutz, R. ; Wolbring, T. ; Daniel, H.-D.: ¬The effect of the "very important paper" (VIP) designation in Angewandte Chemie International Edition on citation impact : a propensity score matching analysis.
In: Journal of the Association for Information Science and Technology. 68(2017) no.9, S.2139-2153.
Abstract: Scientific journals publish an increasing number of articles every year. To steer readers' attention to the most important papers, journals use several techniques (e.g., lead paper). Angewandte Chemie International Edition (AC), a leading international journal in chemistry, signals high-quality papers through designating them as a "very important paper" (VIP). This study aims to investigate the citation impact of Communications in AC receiving the special feature VIP, both cumulated and over time. Using propensity score matching, treatment group (VIP) and control group (non-VIP) were balanced for 14 covariates to estimate the unconfounded "average treatment effect on the treated" for the VIP designation. Out of N = 3,011 Communications published in 2007 and 2008, N = 207 received the special feature VIP. For each Communication, data were collected from AC (e.g., referees' ratings) and from the databases Chemical Abstracts (e.g., sections) and the Web of Science (e.g., citations). The estimated unconfounded average treatment effect on the treated (that is, Communications designated as a VIP) was statistically significant and amounted to 19.83 citations. In addition, the special feature VIP fostered the cumulated annual citation growth. For instance, the time until a Communication reached its maximum annual number of citations, was reduced.
Inhalt: Vgl.: http://onlinelibrary.wiley.com/doi/10.1002/asi.23825/full.
2Mutz, R. ; Daniel, H.-D.: What is behind the curtain of the Leiden Ranking?.
In: Journal of the Association for Information Science and Technology. 66(2015) no.9, S.1950-1953.
Abstract: Even with very well-documented rankings of universities, it is difficult for an individual university to reconstruct its position in the ranking. What is the reason behind whether a university places higher or lower in the ranking? Taking the example of ETH Zurich, the aim of this communication is to reconstruct how the high position of ETHZ (in Europe rank no. 1 in PP[top 10%]) in the Centre for Science and Technology Studies (CWTS) Leiden Ranking 2013 in the field "social sciences, arts and humanities" came about. According to our analyses, the bibliometric indicator values of a university depend very strongly on weights that result in differing estimates of both the total number of a university's publications and the number of publications with a citation impact in the 90th percentile, or PP(top 10%). In addition, we examine the effect of weights at the level of individual publications. Based on the results, we offer recommendations for improving the Leiden Ranking (for example, publication of sample calculations to increase transparency).
Inhalt: Vgl.: http://onlinelibrary.wiley.com/doi/10.1002/asi.23360/abstract.
3Mutz, R. ; Bornmann, L. ; Daniel, H.-D.: Testing for the fairness and predictive validity of research funding decisions : a multilevel multiple imputation for missing data approach using ex-ante and ex-post peer evaluation data from the Austrian science fund.
In: Journal of the Association for Information Science and Technology. 66(2015) no.11, S.2321-2339.
Abstract: It is essential for research funding organizations to ensure both the validity and fairness of the grant approval procedure. The ex-ante peer evaluation (EXANTE) of N?=?8,496 grant applications submitted to the Austrian Science Fund from 1999 to 2009 was statistically analyzed. For 1,689 funded research projects an ex-post peer evaluation (EXPOST) was also available; for the rest of the grant applications a multilevel missing data imputation approach was used to consider verification bias for the first time in peer-review research. Without imputation, the predictive validity of EXANTE was low (r?=?.26) but underestimated due to verification bias, and with imputation it was r?=?.49. That is, the decision-making procedure is capable of selecting the best research proposals for funding. In the EXANTE there were several potential biases (e.g., gender). With respect to the EXPOST there was only one real bias (discipline-specific and year-specific differential prediction). The novelty of this contribution is, first, the combining of theoretical concepts of validity and fairness with a missing data imputation approach to correct for verification bias and, second, multilevel modeling to test peer review-based funding decisions for both validity and fairness in terms of potential and real biases.
Inhalt: Vgl.: http://onlinelibrary.wiley.com/doi/10.1002/asi.23315/abstract.
4Bornmann, L. ; Mutz, R. ; Daniel, H.-D.: Multilevel-statistical reformulation of citation-based university rankings : the Leiden ranking 2011/2012.
In: Journal of the American Society for Information Science and Technology. 64(2013) no.8, S.1649-1658.
Abstract: Since the 1990s, with the heightened competition and the strong growth of the international higher education market, an increasing number of rankings have been created that measure the scientific performance of an institution based on data. The Leiden Ranking 2011/2012 (LR) was published early in 2012. Starting from Goldstein and Spiegelhalter's (1996) recommendations for conducting quantitative comparisons among institutions, in this study we undertook a reformulation of the LR by means of multilevel regression models. First, with our models we replicated the ranking results; second, the reanalysis of the LR data showed that only 5% of the PPtop10% total variation is attributable to differences between universities. Beyond that, about 80% of the variation between universities can be explained by differences among countries. If covariates are included in the model the differences among most of the universities become meaningless. Our findings have implications for conducting university rankings in general and for the LR in particular. For example, with Goldstein-adjusted confidence intervals, it is possible to interpret the significance of differences among universities meaningfully: Rank differences among universities should be interpreted as meaningful only if their confidence intervals do not overlap.
5Bornmann, L. ; Schier, H. ; Marx, W. ; Daniel, H.-D.: Is interactive open access publishing able to identify high-impact submissions? : a study on the predictive validity of Atmospheric Chemistry and Physics by using percentile rank classes.
In: Journal of the American Society for Information Science and Technology. 62(2011) no.1, S.61-71.
Abstract: In a comprehensive research project, we investigated the predictive validity of selection decisions and reviewers' ratings at the open access journal Atmospheric Chemistry and Physics (ACP). ACP is a high-impact journal publishing papers on the Earth's atmosphere and the underlying chemical and physical processes. Scientific journals have to deal with the following question concerning the predictive validity: Are in fact the "best" scientific works selected from the manuscripts submitted? In this study we examined whether selecting the "best" manuscripts means selecting papers that after publication show top citation performance as compared to other papers in this research area. First, we appraised the citation impact of later published manuscripts based on the percentile citedness rank classes of the population distribution (scaling in a specific subfield). Second, we analyzed the association between the decisions (n = 677 accepted or rejected, but published elsewhere manuscripts) or ratings (reviewers' ratings for n = 315 manuscripts), respectively, and the citation impact classes of the manuscripts. The results confirm the predictive validity of the ACP peer review system.
6Bornmann, L. ; Daniel, H.-D.: Universality of citation distributions : a validation of Radicchi et al.'s relative indicator cf = c/c0 at the micro level using data from chemistry.
In: Journal of the American Society for Information Science and Technology. 60(2009) no.8, S.1664-1670.
Abstract: In a recently published PNAS paper, Radicchi, Fortunato, and Castellano (2008) propose the relative indicator cf as an unbiased indicator for citation performance across disciplines (fields, subject areas). To calculate cf, the citation rate for a single paper is divided by the average number of citations for all papers in the discipline in which the single paper has been categorized. cf values are said to lead to a universality of discipline-specific citation distributions. Using a comprehensive dataset of an evaluation study on Angewandte Chemie International Edition (AC-IE), we tested the advantage of using this indicator in practical application at the micro level, as compared with (1) simple citation rates, and (2) z-scores, which have been used in psychological testing for many years for normalization of test scores. To calculate z-scores, the mean number of citations of the papers within a discipline is subtracted from the citation rate of a single paper, and the difference is then divided by the citations' standard deviation for a discipline. Our results indicate that z-scores are better suited than cf values to produce universality of discipline-specific citation distributions.
7Bornmann, L. ; Mutz, R. ; Daniel, H.-D.: Are there better indices for evaluation purposes than the h index? : a comparison of nine different variants of the h index using data from biomedicine.
In: Journal of the American Society for Information Science and Technology. 59(2008) no.5, S.830-837.
Abstract: In this study, we examined empirical results on the h index and its most important variants in order to determine whether the variants developed are associated with an incremental contribution for evaluation purposes. The results of a factor analysis using bibliographic data on postdoctoral researchers in biomedicine indicate that regarding the h index and its variants, we are dealing with two types of indices that load on one factor each. One type describes the most productive core of a scientist's output and gives the number of papers in that core. The other type of indices describes the impact of the papers in the core. Because an index for evaluative purposes is a useful yardstick for comparison among scientists if the index corresponds strongly with peer assessments, we calculated a logistic regression analysis with the two factors resulting from the factor analysis as independent variables and peer assessment of the postdoctoral researchers as the dependent variable. The results of the regression analysis show that peer assessments can be predicted better using the factor impact of the productive core than using the factor quantity of the productive core.
8Neuhaus, C. ; Daniel, H.-D.: Data sources for performing citation analysis : an overview.
In: Journal of documentation. 64(2008) no.2, S.193-210.
Abstract: Purpose - The purpose of this paper is to provide an overview of new citation-enhanced databases and to identify issues to be considered when they are used as a data source for performing citation analysis. Design/methodology/approach - The paper reports the limitations of Thomson Scientific's citation indexes and reviews the characteristics of the citation-enhanced databases Chemical Abstracts, Google Scholar and Scopus. Findings - The study suggests that citation-enhanced databases need to be examined carefully, with regard to both their potentialities and their limitations for citation analysis. Originality/value - The paper presents a valuable overview of new citation-enhanced databases in the context of research evaluation.
Themenfeld: Informetrie ; Citation indexing
Objekt: Science citation index ; Social sciences citation index ; Arts and humanities citation index ; Chemical Abstracts ; Google Scholar ; Scopus
9Bornmann, L. ; Daniel, H.-D.: Selecting manuscripts for a high-impact journal through peer review : a citation analysis of communications that were accepted by Angewandte Chemie International Edition, or rejected but published elsewhere.
In: Journal of the American Society for Information Science and Technology. 59(2008) no.11, S.1841-1852.
Abstract: All journals that use peer review have to deal with the following question: Does the peer review system fulfill its declared objective to select the best scientific work? We investigated the journal peer-review process at Angewandte Chemie International Edition (AC-IE), one of the prime chemistry journals worldwide, and conducted a citation analysis for Communications that were accepted by the journal (n = 878) or rejected but published elsewhere (n = 959). The results of negative binomial-regression models show that holding all other model variables constant, being accepted by AC-IE increases the expected number of citations by up to 50%. A comparison of average citation counts (with 95% confidence intervals) of accepted and rejected (but published elsewhere) Communications with international scientific reference standards was undertaken. As reference standards, (a) mean citation counts for the journal set provided by Thomson Reuters corresponding to the field chemistry and (b) specific reference standards that refer to the subject areas of Chemical Abstracts were used. When compared to reference standards, the mean impact on chemical research is for the most part far above average not only for accepted Communications but also for rejected (but published elsewhere) Communications. However, average and below-average scientific impact is to be expected significantly less frequently for accepted Communications than for rejected Communications. All in all, the results of this study confirm that peer review at AC-IE is able to select the best scientific work with the highest impact on chemical research.
Inhalt: Vgl. auch: Erratum Re: Selecting manuscripts for a high-impact journal through peer review: A citation analysis of communications that were accepted by Agewandte Chemie International Edition, or rejected but published elsewhere. In: Journal of the American Society for Information Science and Technology 59(2008) no.12, S.2037-2038.
Themenfeld: Informetrie ; Citation indexing
10Bornmann, L. ; Daniel, H.-D.: Multiple publication on a single research study: does it pay? : The influence of number of research articles on total citation counts in biomedicine.
In: Journal of the American Society for Information Science and Technology. 58(2007) no.8, S.1100-1107.
Abstract: Scientists may seek to report a single definable body of research in more than one publication, that is, in repeated reports of the same work or in fractional reports, in order to disseminate their research as widely as possible in the scientific community. Up to now, however, it has not been examined whether this strategy of "multiple publication" in fact leads to greater reception of the research. In the present study, we investigate the influence of number of articles reporting the results of a single study on reception in the scientific community (total citation counts of an article on a single study). Our data set consists of 96 applicants for a research fellowship from the Boehringer Ingelheim Fonds (BIF), an international foundation for the promotion of basic research in biomedicine. The applicants reported to us all articles that they had published within the framework of their doctoral research projects. On this single project, the applicants had published from 1 to 16 articles (M = 4; Mdn = 3). The results of a regression model with an interaction term show that the practice of multiple publication of research study results does in fact lead to greater reception of the research (higher total citation counts) in the scientific community. However, reception is dependent upon length of article: the longer the article, the more total citation counts increase with the number of articles. Thus, it pays for scientists to practice multiple publication of study results in the form of sizable reports.
Themenfeld: Citation indexing ; Informetrie
11Bornmann, L. ; Daniel, H.-D.: What do we know about the h index?.
In: Journal of the American Society for Information Science and Technology. 58(2007) no.9, S.1381-1385.
Abstract: Jorge Hirsch recently proposed the h index to quantify the research output of individual scientists. The new index has attracted a lot of attention in the scientific community. The claim that the h index in a single number provides a good representation of the scientific lifetime achievement of a scientist as well as the (supposed) simple calculation of the h index using common literature databases lead to the danger of improper use of the index. We describe the advantages and disadvantages of the h index and summarize the studies on the convergent validity of this index. We also introduce corrections and complements as well as single-number alternatives to the h index.
12Daniel, H.-D.: Peer-review als Qualitätsfilter im wissenschaftlichen Publikationswesen.
In: Informations- und Wissensverarbeitung in den Sozialwissenschaften: Beiträge zur Umsetzung neuer Informationstechnologien. Hrsg.: H. Best u.a. Opladen : Westdeutscher Verlag, 1994. S. -.
13Daniel, H.-D.: Guardians of science : fairness and reliabiblity of peer review.Translated by William E. Russey.
Weinheim : VCH Verlagsgesellschaft, 1993. xiv, 118 S.
Abstract: The book evaluates the peer reviews presented to the Editorial Office of the journal Angewandte Chemie for all contributions submitted for publication in 1984. The peer review system, since its inception in the 17th century, helps to improve the quality of published papers. The book has 10 chapters, dealing with the peer review as an instrument for the self-regulation of science, as a target for criticism, it deals with the journal Angewandte Chemie, the communications received in 1984, the internal and external evaluations and editorial decisions, the reviewers and the reviews, the reliability of manuscript refereeing, the fairness in manuscript evaluation, the validity of manuscript review and makes suggestions for a reform of the peer-review process
Anmerkung: Rez. in: Knowledge organization 21(1994) no.2, S.108 (H. Borko)
LCSH: Research / Evaluation / Analysis ; Peer review / Analysis ; Technical writing / Evaluation / Analysis
RSWK: Angewandte Chemie
/ Zeitschriftenaufsatz / Qualität / Gutachten; Wissenschaftliches Manuskript / Bewertung (BVB) ; Chemie / Zeitschriftenaufsatz / Bewertung (BVB)
BK: 81.20 / Bildungssoziologie: Allgemeines ; 02.20 / Wissenschaftsinformation ; 30.04 / Ausbildung, Beruf, Organisationen
; 30.03 / Methoden und Techniken in den Naturwissenschaften
DDC: 507/.2 / dc20 ; 502.3
GHBS: ANC (GE)
LCC: Q180.55.E9D36 1993
RVK: VB 4400 Chemie und Pharmazie / Bibliographien und Nachschlagewerke, Geschichte und Didaktik der Chemie und Pharmazie, Betriebssicherheit / Richtlinien für die Abfassung und Drucklegung chemischer Literatur Wissenschaftliches Arbeiten; Kongreßplanung Englisch für Chemiker u.ä. / Allgemeines ; CM 2200 Psychologie / Allgemeines. Geschichte und Methodik / Methodik und Wissenschaftstheorie der Psychologie