Pasar al contenido principal

Resultados relacionados

Resultados totales (Incluyendo duplicados): 10
Encontrada(s) 1 página(s)

Biblos-e Archivo. Repositorio Institucional de la UAM
Publicación Artículo científico (JournalArticle)

The citation merit of scientific publications

  • Crespo Fernández, Juan Alfonso
  • Ortuño Ortín, Juan Ignacio
  • Ruiz Castillo, Javier
We propose a new method to assess the merit of any set of scientific papers in a given field based on the citations they receive. Given a field and a citation impact indicator, such as the mean citation or the h-index, the merit of a given set of n articles is identified with the probability that a randomly drawn set of n articles from a given pool of articles in that field has a lower citation impact according to the indicator in question. The method allows for comparisons between sets of articles of different sizes and fields. Using a dataset acquired from Thomson Scientific that contains the articles published in the periodical literature in the period 1998–2007, we show that the novel approach yields rankings of research units different from those obtained by a direct application of the mean citation or the h-index., The authors acknowledge financial support from the Santander Universities Global Division of Banco Santander. JR-C also acknowledges financial help from the Spanish MEC (Ministerio de Educación) through grant SEJ2007-67436. JAC and IO-O also acknowledge financial help from the Spanish MEC through grant ECO2010-19596. This paper is produced as part of the project Science, Innovation, Firms and markets in a Globalised World (SCIFI-GLOW), a Collaborative Project funded by the European Commission’s Seventh Research Framework Programme, Contract number SSH7-CT-2008-217436.
e-Archivo. Repositorio Institucional de la Universidad Carlos III de Madrid
Publicación Artículo científico (JournalArticle)

The end of the "European Paradox"

  • Herranz, Neus
  • Ruiz-Castillo, Javier
This paper evaluates the European Paradox according to which Europe plays a leading world role in terms of scientific excellence, measured in terms of the number of publications, but lacks the entrepreneurial capacity of the US to transform this excellent performance into innovation, growth, and jobs. Citation distributions for the US, the European Union (EU), and the Rest of the World are evaluated using a pair of high and low impact indicators, as well as the mean citation rate (MCR). The dataset consists of 3.6 million articles published in 1998 2002 with a common 5 year citation window. The analysis is carried at a low aggregation level, namely, the 219 sub fields identified with the Web of Science categories distinguished by Thomson Scientific. The problems posed by international coauthorship and the multiple assignments of articles to sub fields are solved following a multiplicative strategy. We find that, although the EU has more publications than the US in 113 out of 219 sub fields, the US is ahead of the EU in 189 sub fields in terms of the high impact indicator, and in 163 sub fields in terms of the low impact indicator. Finally, we verify that using the high impact indicator the US/EU gap is usually greater than when using the MCR., The authors acknowledge financial support from the Santander Universities Global Division of Banco Santander. Ruiz-Castillo also acknowledges financial help from the Spanish MEC through grant SEJ2007-67436. This paper is part of the SCIFI-GLOW Collaborative Project supported by the European Commission’s Seventh Research Framework Programme, Contract number SSH7-CT-2008-217436., Publicado
e-Archivo. Repositorio Institucional de la Universidad Carlos III de Madrid
Publicación Artículo científico (JournalArticle)

The evolution of the scientific productivity of highly productive economists

  • Carrasco, Raquel
  • Ruiz-Castillo, Javier
This paper studies the evolution of research productivity of a sample of economists working in the best 81 departments in the world in 2007. The main novelty is that, in so far as a productivity distribution can be identified with an income distribution, we measure productivity mobility in a dynamic context using an indicator inspired in an income mobility index suggested by Fields (2010) for a two-period world. Productivity is measured in terms of publications, weighted by the citation impact of the journals where each article is published in the periodical literature. We study the evolution of average productivity, productivity inequality, the extent of rank reversals, and productivity mobility for seven cohorts, as well as the population as a whole. We offer new evidence confirming previous results about the heterogeneity of the evolution of productivity for top and other researchers. However, the major result is that-contrary to what was expected-for our sample of very highly productive scholars the effect of rank reversals between the two periods on overall productivity mobility offsets the effect of an increase in productivity inequality from the first to the second period in the youngest five out of seven cohorts., This paper is produced as part of the project Science, Innovation, Firms and markets in a Globalized World (SCIFI-GLOW), a Collaborative Project funded by the European Commission's Seventh Research Framework Programme, Contract number SSH7-CT-2008-217436. Carrasco and Ruiz- Castillo acknowledge additional financial support from the Spanish MEC through grant No. ECO2009-11165, and SEJ2007-67436, respectively
e-Archivo. Repositorio Institucional de la Universidad Carlos III de Madrid
Publicación Artículo científico (JournalArticle)

High- and low-impact citation measures : empirical applications

  • Albarrán, Pedro
  • Ortuño, Ignacio
  • Ruiz-Castillo, Javier
This paper contains the first empirical applications of a novel methodology for comparing the citation distributions of research units working in the same homogeneous field. The paper considers a situation in which the world citation distribution in 22 scientific fields is partitioned into three geographical areas: the U.S., the European Union (EU), and the rest of the world (RW). Given a critical citation level (CCL), we suggest using two real valued indicators to describe the shape of each area’s distribution: a high- and a low-impact measure defined over the set of articles with citations below or above the CCL. It is found¡ that, when the CCL is fixed at the 80th percentile of the world citation distribution, the U.S. performs dramatically better than the EU and the RW according to both indicators in all scientific fields. This superiority generally increases as we move from the incidence to the intensity and the citation inequality aspects of the phenomena in question. Surprisingly, changes observed when the CCL is increased from the 80th to the 95th percentile are of a relatively small order of magnitude. Finally, it is found that international co-authorship increases the high-impact and reduces the low-impact level in the three geographical areas. This is especially the case for the EU and the RW when they cooperate with the U.S., The authors acknowledge financial support by Santander Universities Global Division of Banco Santander. Albarrán and Ruiz-Castillo also acknowledge financial help from the Spanish MEC, the first through grants SEJ2007-63098 and SEJ2006-05710, and the second through grant SEJ2007-67436. Finally, this paper is part of the SCIFI-GLOW Collaborative Project supported by the European Commission’s Seventh Research Framework Programme, Contract number SSH7-CT-2008-217436., Publicado
e-Archivo. Repositorio Institucional de la Universidad Carlos III de Madrid
Publicación Artículo científico (JournalArticle)

The evaluation of citation distributions

  • Ruiz-Castillo, Javier
The original publication is available at www.springerlink.com, This paper reviews a number of recent contributions that demonstrate that a blend of welfare economics and statistical analysis is useful in the evaluation of the citations received by scientifi papers in the periodical literature. The paper begins by clarifying the role of citation analysis in the evaluation of research. Next, a summary of results about the citation distributions’ basic features at different aggregation levels is offered. These results indicate that citation distributions share the same broad shape, are highly skewed, and are often crowned by a power law. In light of this evidence, a novel methodology for the evaluation of research units is illustrated by comparing the high- and low-citation impact achieved by the US, the European Union, and the rest of the world in 22 scientifi fields However, contrary to recent claims, it is shown that mean normalization at the sub-fiel level does not lead to a universal distribution. Nevertheless, among other topics subject to ongoing research, it appears that this lack of universality does not preclude sensible normalization procedures to compare the citation impact of articles in different scientifi fields, European Community's Seventh Framework Program, The author acknowledges financia support from Santander Universities Global Division of Banco Santander, as well as from the Spanish MEC through grant SEJ2007-67436 This paper is part of the SCIFI-GLOW Collaborative Project supported by the European Commission’s Seventh Research Framework Programme, Contract no SSH7-CT-2008-217436, Publicado
e-Archivo. Repositorio Institucional de la Universidad Carlos III de Madrid
Publicación Artículo científico (JournalArticle)

Multiplicative and fractional strategies when journals are assigned to several subfields

  • Herranz, Neus
  • Ruiz-Castillo, Javier
In many data sets, articles are classified into subfields through the journals in which they have been published. The problem is that while many journals are assigned to a single subfield, many others are assigned to several. This article discusses a multiplicative and a fractional strategy to deal with this situation. The empirical part studies different aspects of citation distributions under the two strategies, namely: the number of articles, the mean citation rate, the broad shape of the distribution, their characterization in terms of size- and scale-invariant indicators of high and low impact, and the presence of extreme distributions, that is, distributions that behave very differently from the rest. We found that, despite large differences in the number of articles according to both strategies, the similarity of the citation characteristics of articles published in journals assigned to one or several subfields guarantees that choosing one of the two strategies may not lead to a radically different picture in practical applications. Nevertheless, the characterization of citation excellence through a high-impact indicator may considerably differ depending on that choice, We acknowledge financial support by Santander Univer-sities Global Division of Banco Santander. Ruiz-Castilloacknowledges financial support from the Spanish MECthrough grant SEJ2007-67436. This article is produced aspart of the CEPR project “SCience, Innovation, FIrms andmarkets in a GLObalized World (SCI-FI GLOW)” fundedby the European Commission under its Seventh Frame-work Programme for Research (Collaborative Project)Contract no. 217436., Publicado
e-Archivo. Repositorio Institucional de la Universidad Carlos III de Madrid
Publicación Artículo científico (JournalArticle)

A comparison of the scientific performance of the U.S. and the European Union at the turn of the 21st century

  • Albarrán, Pedro
  • Crespo, Juan A.
  • Ortuño, Ignacio
  • Ruiz-Castillo, Javier
In this paper, scientific performance is identified with the impact that journal articles have through the citations they receive. In 15 disciplines, as well as in all sciences as a whole, the EU share of total publications is greater than that of the U.S. However, as soon as the citations received by these publications are taken into account the picture is completely reversed. Firstly, the EU share of total citations is still greater than the U.S. in only seven fields. Secondly, the mean citation rate in the U.S. is greater than in the EU in every one of the 22 fields studied. Thirdly, since standard indicators—such as normalized mean citation ratios—are silent about what takes place in different parts of the citation distribution, this paper compares the publication shares of the U.S. and the EU at every percentile of the world citation distribution in each field. It is found that in seven fields the initial gap between the U.S. and the EU widens as we advance towards the more cited articles, while in the remaining 15 fields—except for Agricultural Sciences—the U.S. always surpasses the EU when it counts, namely, at the upper tail of citation distributions. Finally, for all sciences as a whole the U.S. publication share becomes greater than that of the EU for the top 50% of the most highly cited articles. The data used refers to 3.6 million articles published in 1998–2002, and the more than 47 million citations they received in 1998–2007, The authors acknowledge financial support from the Spanish MEC through grants SEJ2007-63098, SEJ2006-05710, SEJ2007-67135, and SEJ2007-67436. The database of Thomson Scientific (formerly Thomson-ISI; Institute for Scientific Information) has been acquired with funds from Santander Universities Global Division of Banco Santander. This paper is part of the SCIFI-GLOW Collaborative Project supported by the European Commission’s Seventh Research Framework Programme, Contract number SSH7-CT-2008-217436., Publicado
e-Archivo. Repositorio Institucional de la Universidad Carlos III de Madrid
Publicación Artículo científico (JournalArticle)

The measurement of low- and high-impact in citation distributions : technical results

  • Albarrán, Pedro
  • Ortuño, Ignacio
  • Ruiz-Castillo, Javier
This paper introduces a novel methodology for comparing the citation distributions of research units of a certain size working in the same homogeneous field. Given a critical citation level (CCL), we suggest using two real valued indicators to describe the shape of any distribution: a high-impact and a low-impact measure defined over the set of articles with citations above or below the CCL. The key to this methodology is the identification of a citation distribution with an income distribution. Once this step is taken, it is easy to realize that the measurement of low-impact coincides with the measurement of economic poverty. In turn, it is equally natural to identify the measurement of high-impact with the measurement of a certain notion of economic affluence. On the other hand, it is seen that the ranking of citation distributions according to a family of low-impact measures is essentially characterized by a number of desirable axioms. Appropriately redefined, these same axioms lead to the selection of an equally convenient class of decomposable high-impact measures. These two families are shown to satisfy other interesting properties that make them potentially useful in empirical applications, including the comparison of research units working in different fields, European Community's Seventh Framework Program, Albarrán and Ruiz-Castillo acknowledge financial support from the Spanish MEC, the former through grants SEJ2007-63098 and SEJ2006-05710, and the latter through grant SEJ2007-67436. This paper is part of the SCIFI-GLOW Collaborative Project supported by the European Commission’s Seventh Research Framework Programme, Contract number SSH7-CT-2008-217436., Publicado
e-Archivo. Repositorio Institucional de la Universidad Carlos III de Madrid
Publicación Artículo científico (JournalArticle)

References made and citations received by scientific articles

  • Albarrán, Pedro
  • Ruiz-Castillo, Javier
This article studies massive evidence about references made and citations received after a 5-year citation window by 3.7 million articles published in 1998 to 2002 in 22 scientific fields. We find that the distributions of references made and citations received share a number of basic features across sciences. Reference distributions are rather skewed to the right while citation distributions are even more highly skewed:The mean is about 20 percentage points to the right of the median, and articles with a remarkable or an outstanding number of citations represent about 9% of the total. Moreover, the existence of a power law representing the upper tail of citation distributions cannot be rejected in 17 fields whose articles represent 74.7% of the total. Contrary to the evidence in other contexts, the value of the scale parameter is above 3.5 in 13 of the 17 cases. Finally, power laws are typically small, but capture a considerable proportion of the total citations received, The authors acknowledge financial support from Span-ish MEC Grants SEJ2007–67436, SEJ2007–63098, and SEJ2006–05710. The database of Thomson Scientific (for-merly Thomson-ISI; Institute for Scientific Information)was acquired with funds from Santander Universities Global Division of Banco Santander. This article is partof the SCIFI-GLOW Collaborative Project supported bythe European Commission’s 7th Research Framework Pro-gramme, Contract No. SSH7-CT-2008–217436, Publicado
e-Archivo. Repositorio Institucional de la Universidad Carlos III de Madrid
Publicación Artículo científico (JournalArticle)

The skewness of science in 219 sub-fields and a number of aggregates

  • Albarrán, Pedro
  • Crespo, Juan A.
  • Ortuño, Ignacio
  • Ruiz-Castillo, Javier
This paper studies evidence from Thomson Scientific (TS) about the citation process of 3.7 million articles published in the period 1998 2002 in 219 Web of Science (WoS) categories, or sub fields. Reference and citation distributions have very different characteristics across sub fields. However, when analyzed with the Characteristic Scores and Scales (CSS) technique, which is replication and scale invariant, the shape of these distributions over three broad categories of articles appears strikingly similar. Reference distributions are mildly skewed, but citation distributions with a 5 year citation window are highly skewed: the mean is 20 points above the median, while 9 10% of all articles in the upper tail account for about 44% of all citations. The aggregation of sub fields into disciplines and fields according to several aggregation schemes preserve this feature of citation distributions. It should be noted that when we look into subsets of articles within the lower and upper tails of citation distributions the universality partially breaks down. On the other hand, for 140 of the 219 sub fields the existence of a power law cannot be rejected. However, contrary to what is generally believed, at the sub field level the scaling parameter is above 3.5 most of the time, and power laws are relatively small: on average, they represent 2% of all articles and account for 13.5% of all citations. The results of the aggregation into disciplines and fields reveal that power law algebra is a subtle phenomenon, The authors acknowledge financial support from the Spanish MEC through grants SEJ2007 63098, SEJ2007 67436, ECO2009 11165, and ECO2010 19596. This paper is part of the SCIFI-GLOW Collaborative Project supported by the European Commission’s Seventh Research Framework Programme, Co SSH7-CT-2008-217436, Publicado