Skip to main content

Resultados relacionados

Resultados totales (Incluyendo duplicados): 28
Encontrada(s) 1 página(s)

Biblos-e Archivo. Repositorio Institucional de la UAM
Publication Artículo científico (JournalArticle)

The citation merit of scientific publications

  • Crespo Fernández, Juan Alfonso
  • Ortuño Ortín, Juan Ignacio
  • Ruiz Castillo, Javier
We propose a new method to assess the merit of any set of scientific papers in a given field based on the citations they receive. Given a field and a citation impact indicator, such as the mean citation or the h-index, the merit of a given set of n articles is identified with the probability that a randomly drawn set of n articles from a given pool of articles in that field has a lower citation impact according to the indicator in question. The method allows for comparisons between sets of articles of different sizes and fields. Using a dataset acquired from Thomson Scientific that contains the articles published in the periodical literature in the period 1998–2007, we show that the novel approach yields rankings of research units different from those obtained by a direct application of the mean citation or the h-index., The authors acknowledge financial support from the Santander Universities Global Division of Banco Santander. JR-C also acknowledges financial help from the Spanish MEC (Ministerio de Educación) through grant SEJ2007-67436. JAC and IO-O also acknowledge financial help from the Spanish MEC through grant ECO2010-19596. This paper is produced as part of the project Science, Innovation, Firms and markets in a Globalised World (SCIFI-GLOW), a Collaborative Project funded by the European Commission’s Seventh Research Framework Programme, Contract number SSH7-CT-2008-217436.
e-Archivo. Repositorio Institucional de la Universidad Carlos III de Madrid
Publication Artículo preliminar (WorkingPaper)

The citation merit of scientific publications

  • Crespo, Juan A.
  • Ortuño, Ignacio
  • Ruiz-Castillo, Javier
We propose a new method to assess the merit of any set of scientific papers in a given field based on the citations they receive. Given a citation indicator, such as the mean citation or the h-index, we identify the merit of a given set of n articles with the probability that a randomly drawn sample of an articles from a reference set of articles in that field presents a lower citation index. The method allows for comparisons between research units of different sizes and fields. Using a dataset acquired from Thomson Scientific that contains the articles published in the periodical literature in the period 1998-2007, we show that the novel approach yields rankings of research units different from those obtained by a direct application of the mean citation or the h-index., Ruiz-Castillo acknowledges financial help from the Spanish MEC through grant SEJ2007-67436. Crespo and Ortuño-Ortín also acknowledge financial help from the Spanish MEC through grant ECO2010-19596. This paper is produced as part of the project Science, Innovation, Firms and markets in a Globalised World (SCIFI-GLOW), a Collaborative Project funded by the European Commission's Seventh Research Framework Programme, Contract number SSH7-CT-2008-217436.
e-Archivo. Repositorio Institucional de la Universidad Carlos III de Madrid
Publication Artículo preliminar (WorkingPaper)

The skewness of science in 219 sub-fields and a number of aggregates

  • Albarrán, Pedro
  • Crespo, Juan A.
  • Ortuño, Ignacio
  • Ruiz-Castillo, Javier
This paper studies evidence from Thomson Scientific about the citation process of 3.7 million articles published in the period 1998-2002 in 219 Web of Science categories, or sub-fields. Reference and citation distributions have very different characteristics across sub-fields. However, when analyzed with the Characteristic Scores and Scales technique, which is replication and scale invariant, the shape of these distributions over three broad categories of articles appears strikingly similar. Reference distributions are mildly skewed, but citation distributions with a five-year citation window are highly skewed: the mean is twenty points above the median, while 9-10% of all articles in the upper tail account for about 44% of all citations. The aggregation of sub-fields into disciplines and fields according to several aggregation schemes preserve this feature of citation distributions. It should be noted that when we look into subsets of articles within the lower and upper tails of citation distributions the universality partially breaks down. On the other hand, for 140 of the 219 sub-fields the existence of a power law cannot be rejected. However, contrary to what is generally believed, at the sub-field level the scaling parameter is above 3.5 most of the time, and power laws are relatively small: on average, they represent 2% of all articles and account for 13.5% of all citations. The results of the aggregation into disciplines and fields reveal that power law algebra is a subtle phenomenon., European Community's Seventh Framework Program, The authors acknowledge financial support from the Spanish MEC through grants SEJ2007-63098, SEJ2007- 67436, ECO2009-11165, and ECO2010-19596. The database of Thomson Scientific (formerly Thomson- ISI; Institute for Scientific Information) has been acquired with funds from Santander Universities Global Division of Banco Santander. This paper is part of the SCIFI-GLOW Collaborative Project supported by the European Commission’s Seventh Research Framework Programme, Contract no. SSH7-CT-2008- 217436.
e-Archivo. Repositorio Institucional de la Universidad Carlos III de Madrid
Publication Artículo científico (JournalArticle)

The end of the "European Paradox"

  • Herranz, Neus
  • Ruiz-Castillo, Javier
This paper evaluates the European Paradox according to which Europe plays a leading world role in terms of scientific excellence, measured in terms of the number of publications, but lacks the entrepreneurial capacity of the US to transform this excellent performance into innovation, growth, and jobs. Citation distributions for the US, the European Union (EU), and the Rest of the World are evaluated using a pair of high and low impact indicators, as well as the mean citation rate (MCR). The dataset consists of 3.6 million articles published in 1998 2002 with a common 5 year citation window. The analysis is carried at a low aggregation level, namely, the 219 sub fields identified with the Web of Science categories distinguished by Thomson Scientific. The problems posed by international coauthorship and the multiple assignments of articles to sub fields are solved following a multiplicative strategy. We find that, although the EU has more publications than the US in 113 out of 219 sub fields, the US is ahead of the EU in 189 sub fields in terms of the high impact indicator, and in 163 sub fields in terms of the low impact indicator. Finally, we verify that using the high impact indicator the US/EU gap is usually greater than when using the MCR., The authors acknowledge financial support from the Santander Universities Global Division of Banco Santander. Ruiz-Castillo also acknowledges financial help from the Spanish MEC through grant SEJ2007-67436. This paper is part of the SCIFI-GLOW Collaborative Project supported by the European Commission’s Seventh Research Framework Programme, Contract number SSH7-CT-2008-217436., Publicado
e-Archivo. Repositorio Institucional de la Universidad Carlos III de Madrid
Publication Artículo preliminar (WorkingPaper)

From the “European Paradox” to a European Drama in citation impact

  • Ruiz-Castillo, Javier
Conversations with Pedro Albarrán, Juan A. Crespo, and Ignacio Ortuño are gratefully acknowledged, This paper has two main aims: (i) to criticize the diagnosis about the research performance of the EU contained in the so-called “European Paradox”, according to which Europe plays a leading world role in terms of scientific excellence, but lacks the entrepreneurial capacity of the U.S. to transform this excellence into innovation, growth, and jobs; and (ii) to study the heterogeneity among the 15 member countries of the EU prior to the 2004 accession. For the first aim, we use a Thomson Scientific dataset with 3.6 million articles published in 1998-2002 with a five-year citation window, and a partition of the world into three large geographical areas including the U.S., the EU, and the rest of the world. For the second aim, we use a dataset with 800,000 articles more published in 2003, and a partition of the world into 38 countries and eight geographical areas. The main results are the following two. Firstly, the European Paradox hides a truly European Drama: judging from citation impact in the periodical literature, the dominance of the U.S. over the EU is almost universal at all aggregation levels. Secondly, since the UK and six small European countries (Austria, Belgium, Denmark, Finland, Netherlands, and Sweden) perform relatively well, the explanation of this European Drama must be found in the relative poor performance of Germany and France and, above all, Italy and Spain among the four larger continental countries, The author acknowledges financial support from the Santander Universities Global Division of Banco Santander, as well as from the Spanish MEC through grant SEJ2007-67436
e-Archivo. Repositorio Institucional de la Universidad Carlos III de Madrid
Publication Artículo científico (JournalArticle)

The evolution of the scientific productivity of highly productive economists

  • Carrasco, Raquel
  • Ruiz-Castillo, Javier
This paper studies the evolution of research productivity of a sample of economists working in the best 81 departments in the world in 2007. The main novelty is that, in so far as a productivity distribution can be identified with an income distribution, we measure productivity mobility in a dynamic context using an indicator inspired in an income mobility index suggested by Fields (2010) for a two-period world. Productivity is measured in terms of publications, weighted by the citation impact of the journals where each article is published in the periodical literature. We study the evolution of average productivity, productivity inequality, the extent of rank reversals, and productivity mobility for seven cohorts, as well as the population as a whole. We offer new evidence confirming previous results about the heterogeneity of the evolution of productivity for top and other researchers. However, the major result is that-contrary to what was expected-for our sample of very highly productive scholars the effect of rank reversals between the two periods on overall productivity mobility offsets the effect of an increase in productivity inequality from the first to the second period in the youngest five out of seven cohorts., This paper is produced as part of the project Science, Innovation, Firms and markets in a Globalized World (SCIFI-GLOW), a Collaborative Project funded by the European Commission's Seventh Research Framework Programme, Contract number SSH7-CT-2008-217436. Carrasco and Ruiz- Castillo acknowledge additional financial support from the Spanish MEC through grant No. ECO2009-11165, and SEJ2007-67436, respectively
e-Archivo. Repositorio Institucional de la Universidad Carlos III de Madrid
Publication Artículo preliminar (WorkingPaper)

Multiplicative and fractional strategies when journals are assigned to several sub-fields

  • Herranz, Neus
  • Ruiz-Castillo, Javier
In many datasets, articles are classified into sub-fields through the journals in which they have been published. The problem is that many journals are assigned to a single sub-field, but many others are assigned to several sub-fields. This paper discusses a multiplicative and a fractional strategy to deal with this situation, and introduces a normalization procedure in the multiplicative case that takes into account differences in mean citation rates across sub-fields. The empirical part studies different aspects of citation distributions under the two strategies, namely: (i) the number of articles, (ii) the mean citation rate, (iii) the broad shape of the distribution, (iv) the characterization in terms of size- and scale-invariant indicators of high- and low-impact, and (v) the presence of extreme distributions, or distributions that behave very differently from the rest. It is found that, in spite of large differences in the number of articles according to both strategies, the similarity of the citation characteristics of articles published in journals assigned to one or several sub-fields guarantees that choosing one of the two strategies may not lead to a radically different picture in practical applications. Nevertheless, the evaluation of citation excellence through a high-impact indicator may considerably differ depending on that choice., The authors acknowledge financial support by Santander Universities Global Division of Banco Santander. Ruiz-Castillo acknowledges financial support from the Spanish MEC through grant SEJ2007-67436, European Community's Seventh Framework Program
e-Archivo. Repositorio Institucional de la Universidad Carlos III de Madrid
Publication Artículo preliminar (WorkingPaper)

Sub-field normalization in the multiplicative case : high- and low- impact citation indicators

  • Herranz, Neus
  • Ruiz-Castillo, Javier
This paper uses high- and low-impact citation indicators for the evaluation of the citation performance of research units at different aggregate levels. To solve the problem of the assignment of individual articles to multiple sub-fields, it follows a multiplicative strategy according to which each paper is wholly counted as many times as necessary in the several categories to which it is assigned at each aggregation level. To control for wide differences in citation practices at the lowest level of aggregation, we apply a novel subfield normalization procedure in the multiplicative case. The methodology is applied to a partition of the world into three geographical areas: the U.S., the European Union (EU), and the Rest of the World. The main findings are the following two. (i) Although normalization does not systematically bias the results against any area, it reduces the U.S./EU highimpact gap in the all-sciences case by a non-negligible 14.4%. (ii) The dominance of the U.S. over the EU in the basic and applied research published in the periodical literature is almost universal at all aggregation levels. From the high-impact perspective, for example, the U.S. is ahead of the EU in 77 out of 80 disciplines, and all of 20 fields. For all sciences as a whole, the U.S. high-impact indicator is 61% greater than that of the EU., The authors acknowledge financial support from the Santander Universities Global Division of Banco Santander. Ruiz-Castillo also acknowledges financial help from the Spanish MEC through grant SEJ2007- 67436. This paper is part of the SCIFI-GLOW Collaborative Project supported by the European Commission’s Seventh Research Framework Programme, Contract number SSH7-CT-2008-217436, European Community's Seventh Framework Program
e-Archivo. Repositorio Institucional de la Universidad Carlos III de Madrid
Publication Artículo preliminar (WorkingPaper)

The measurement of scientific excellence around the world

  • Albarrán, Pedro
  • Ruiz-Castillo, Javier
This paper reviews scientific excellence in 38 countries and eight geographical areas using two sets of novel indicators of citation impact: a family of high-impact indicators imported from the poverty literature in Economics, and a set of indicators within the percentile rank approach. Among the main findings with a dataset of about 4.4 million from Thomson Scientific we emphasize the following three. (i) The proportion of articles of a research unit in the set formed by the 10% of the most cited papers in the world, and two important percentile rank indicators bring no novelty relative to a traditional average-based indicator. (ii) A high-impact indicator very sensitive to citation inequality is seen to be useful to detect success at a local level, but not for a global ranking that includes small research units. (iii) A monotonic high-impact indicator sensitive to any increase in citations is used to rank the partition of the world into 46 units in the 22 broad fields distinguished by Thomson Scientific, as well as the all-sciences case., The authors acknowledge financial support by Santander Universities Global Division of Banco Santander. Albarrán acknowledges additional financial support from the Spanish MEC through grants ECO2009-11165 y ECO2011-29751, and Ruiz-Castillo through grant SEJ2007-67436. This paper is produced as part of the project Science, Innovation, Firms and markets in a Globalised World (SCIFIGLOW), a Collaborative Project funded by the European Commission's Seventh Research Framework Programme, Contract number SSH7-CT-2008-217436.
e-Archivo. Repositorio Institucional de la Universidad Carlos III de Madrid
Publication Artículo preliminar (WorkingPaper)

Sub-field normalization in the multiplicative case : average-based citation indicators

  • Herranz, Neus
  • Ruiz-Castillo, Javier
This paper investigates the citation impact of three large geographical areas –the U.S., the European Union (EU), and the rest of the world (RW)– at different aggregation levels. The difficulty is that 42% of the 3.6 million articles in our Thomson Scientific dataset are assigned to several sub-fields among a set of 219 Web of Science categories. We follow a multiplicative approach in which every article is wholly counted as many times as it appears at each aggregation level. We compute the crown indicator and the Mean Normalized Citation Score (MNCS) using for the first time sub-field normalization procedures for the multiplicative case. We also compute a third indicator that does not correct for differences in citation practices across sub-fields. It is found that: (1) No geographical area is systematically favored (or penalized) by any of the two normalized indicators. (2) According to the MNCS, only in six out of 80 disciplines –but in none of 20 fields– is the EU ahead of the U.S. In contrast, the normalized U.S./EU gap is greater than 20% in 44 disciplines, 13 fields, and for all sciences as a whole. The dominance of the EU over the RW is even greater. (3) The U.S. appears to devote relatively more –and the RW less– publication effort to subfields with a high mean citation rate, which explains why the U.S./EU and EU/RW gaps for all sciences as a whole increase by 4.5 and 5.6 percentage points in the un-normalized case. The results with a fractional approach are very similar indeed, Financial support from the Santander Universities Global Division of Banco Santander. Ruiz-Castillo also acknowledges financial help from the Spanish MEC through grant SEJ2007-67436, European Community's Seventh Framework Program
e-Archivo. Repositorio Institucional de la Universidad Carlos III de Madrid
Publication Artículo científico (JournalArticle)

High- and low-impact citation measures : empirical applications

  • Albarrán, Pedro
  • Ortuño, Ignacio
  • Ruiz-Castillo, Javier
This paper contains the first empirical applications of a novel methodology for comparing the citation distributions of research units working in the same homogeneous field. The paper considers a situation in which the world citation distribution in 22 scientific fields is partitioned into three geographical areas: the U.S., the European Union (EU), and the rest of the world (RW). Given a critical citation level (CCL), we suggest using two real valued indicators to describe the shape of each area’s distribution: a high- and a low-impact measure defined over the set of articles with citations below or above the CCL. It is found¡ that, when the CCL is fixed at the 80th percentile of the world citation distribution, the U.S. performs dramatically better than the EU and the RW according to both indicators in all scientific fields. This superiority generally increases as we move from the incidence to the intensity and the citation inequality aspects of the phenomena in question. Surprisingly, changes observed when the CCL is increased from the 80th to the 95th percentile are of a relatively small order of magnitude. Finally, it is found that international co-authorship increases the high-impact and reduces the low-impact level in the three geographical areas. This is especially the case for the EU and the RW when they cooperate with the U.S., The authors acknowledge financial support by Santander Universities Global Division of Banco Santander. Albarrán and Ruiz-Castillo also acknowledge financial help from the Spanish MEC, the first through grants SEJ2007-63098 and SEJ2006-05710, and the second through grant SEJ2007-67436. Finally, this paper is part of the SCIFI-GLOW Collaborative Project supported by the European Commission’s Seventh Research Framework Programme, Contract number SSH7-CT-2008-217436., Publicado
e-Archivo. Repositorio Institucional de la Universidad Carlos III de Madrid
Publication Artículo preliminar (WorkingPaper)

High - and low-impact citation measures: empirical applications

  • Albarrán, Pedro
  • Ortuño, Ignacio
  • Ruiz-Castillo, Javier
This paper contains the first empirical applications of a novel methodology for comparing the citation distributions of research units working in the same homogeneous field. The paper considers a situation in which the world citation distribution in 22 scientific fields is partitioned into three geographical areas: the U.S., the European Union (EU), and the rest of the world (RW). Given a critical citation level (CCL), we suggest using two real valued indicators to describe the shape of each area’s distribution: a high- and a low-impact measure defined over the set of articles with citations below or above the CCL. It is found that, when the CCL is fixed at the 80th percentile of the world citation distribution, the U.S. performs dramatically better than the EU and the RW according to both indicators in all scientific fields. This superiority generally increases as we move from the incidence to the intensity and the citation inequality aspects of the phenomena in question. Surprisingly, changes observed when the CCL is increased from the 80th to the 95th percentile are of a relatively small order of magnitude. Finally, it is found that international co-authorship increases the high-impact and reduces the low-impact level in the three geographical areas. This is especially the case for the EU and the RW when they cooperate with the U.S., Albarrán and Ruiz-Castillo acknowledge financial help from the Spanish MEC, the first through grants SEJ2007-63098 and SEJ2006-05710, and the second through grant SEJ2007-67436. Finally, this paper is part of the SCIFI-GLOW Collaborative Project supported by the European Commission's Seventh Research Framework Programme, Contract number SSH7-CT-2008-217436.
e-Archivo. Repositorio Institucional de la Universidad Carlos III de Madrid
Publication Artículo científico (JournalArticle)

The evaluation of citation distributions

  • Ruiz-Castillo, Javier
The original publication is available at www.springerlink.com, This paper reviews a number of recent contributions that demonstrate that a blend of welfare economics and statistical analysis is useful in the evaluation of the citations received by scientifi papers in the periodical literature. The paper begins by clarifying the role of citation analysis in the evaluation of research. Next, a summary of results about the citation distributions’ basic features at different aggregation levels is offered. These results indicate that citation distributions share the same broad shape, are highly skewed, and are often crowned by a power law. In light of this evidence, a novel methodology for the evaluation of research units is illustrated by comparing the high- and low-citation impact achieved by the US, the European Union, and the rest of the world in 22 scientifi fields However, contrary to recent claims, it is shown that mean normalization at the sub-fiel level does not lead to a universal distribution. Nevertheless, among other topics subject to ongoing research, it appears that this lack of universality does not preclude sensible normalization procedures to compare the citation impact of articles in different scientifi fields, European Community's Seventh Framework Program, The author acknowledges financia support from Santander Universities Global Division of Banco Santander, as well as from the Spanish MEC through grant SEJ2007-67436 This paper is part of the SCIFI-GLOW Collaborative Project supported by the European Commission’s Seventh Research Framework Programme, Contract no SSH7-CT-2008-217436, Publicado
e-Archivo. Repositorio Institucional de la Universidad Carlos III de Madrid
Publication Artículo preliminar (WorkingPaper)

European cooperative R&D and firm performance

  • Aguiar, Luis
  • Gagnepain, Philippe
The goal of this paper is to assess the impact on the performance of firms that participate in Research Joint Ventures (RJVs) funded by the Fifth European Framework Programme for Research and Technological Development (EU-FP5). A special emphasis is made on the User-friendly Information Society (IST) programme, one of the most important thematic programmes of the EU-FP5. We use the funding available to the firms as an instrumental variable to account for self-selection and estimate the Local Average Treatment Effect (LATE) of participation by considering labor productivity and profit margin as performance measures. Our results show a large and positive impact of participation on the labor productivity of the firms, whereas the effect on profit margin is weaker. When taking into account the size of the RJV, we find that the positive impact on labor productivity comes mainly from participation in large projects and that participation in smaller RJVs has a negative effect on the profit margin, This paper is produced as part of the CEPR project “SCience, Innovation, FIrms and markets in a GLObalized World (SCI-FI GLOW)” funded by the European Commission under its Seventh Framework Programme for Research (Collaborative Project) Contract no. 217436.
e-Archivo. Repositorio Institucional de la Universidad Carlos III de Madrid
Publication Artículo preliminar (WorkingPaper)

The end of the European Paradox

  • Herranz, Neus
  • Ruiz-Castillo, Javier
This paper evaluates the European Paradox according to which Europe plays a leading world role in terms of scientific excellence, measured in terms of the number of publications, but lacks the entrepreneurial capacity of the U.S. to transform this excellent performance into innovation, growth, and jobs. Citation distributions for the U.S., the European Union (EU), and the rest of the world are evaluated using a pair of high- and low-impact indicators, as well as the mean citation rate. The dataset consists of 3.6 million articles published in 1998-2002 with a common five-year citation window. The analysis is carried at a low aggregation level: the 219 sub-fields identified with the Web of Science categories distinguished by Thomson Scientific. The problems posed by international co-authorship and the multiple assignments of articles to sub-fields are solved following a multiplicative strategy. In the first place, we find that, although the EU has more publications than the U.S. in 113 out of 219 sub-fields, the U.S. is ahead of the EU in 189 and 163 sub-fields in terms of the high- and low-impact indicators. In the second place, we verify that using the high-impact indicator the U.S./EU gap is usually greater than when using the mean citation rate., The authors acknowledge financial support from the Santander Universities Global Division of Banco Santander. Ruiz-Castillo also acknowledges financial help from the Spanish MEC through grant SEJ2007-67436. This paper is part of the SCIFI-GLOW Collaborative Project supported by the European Commission’s Seventh Research Framework Programme, Contract number SSH7-CT-2008-217436.
e-Archivo. Repositorio Institucional de la Universidad Carlos III de Madrid
Publication Artículo preliminar (WorkingPaper)

The evolution of the scientific productivity of highly productive economist

  • Carrasco, Raquel
  • Ruiz-Castillo, Javier
This is the third version of a paper with the same title published in this series in June 2012, This paper studies the evolution of research productivity of a sample of economists working in the best 81 departments in the world in 2007. The main novelty is that, in so far as a productivity distribution can be identified with an income distribution, we measure productivity mobility in a dynamic context using an indicator inspired in an income mobility index suggested by Fields (2010) for a two-period world. Productivity is measured in terms of the number of publications in each of four classes, weighted according to a rather elitist scheme. We study the evolution of average productivity, productivity inequality, the extent of rank reversals, and productivity mobility for seven cohorts, as well as the population as a whole. We offer new evidence confirming previous results about the heterogeneity of the evolution of productivity for top and other researchers. However, the major result is that –contrary to what was expected– for our sample of very highly productive scholars the effect of rank reversals between the two periods on overall productivity mobility offsets the effect of an increase in productivity inequality from the first to the second period in the youngest five out of seven cohorts, Carrasco and Ruiz-Castillo acknowledge additional financial support from the Spanish MEC through grant No. ECO2009-11165, and SEJ2007-67436, respectively
e-Archivo. Repositorio Institucional de la Universidad Carlos III de Madrid
Publication Artículo científico (JournalArticle)

Multiplicative and fractional strategies when journals are assigned to several subfields

  • Herranz, Neus
  • Ruiz-Castillo, Javier
In many data sets, articles are classified into subfields through the journals in which they have been published. The problem is that while many journals are assigned to a single subfield, many others are assigned to several. This article discusses a multiplicative and a fractional strategy to deal with this situation. The empirical part studies different aspects of citation distributions under the two strategies, namely: the number of articles, the mean citation rate, the broad shape of the distribution, their characterization in terms of size- and scale-invariant indicators of high and low impact, and the presence of extreme distributions, that is, distributions that behave very differently from the rest. We found that, despite large differences in the number of articles according to both strategies, the similarity of the citation characteristics of articles published in journals assigned to one or several subfields guarantees that choosing one of the two strategies may not lead to a radically different picture in practical applications. Nevertheless, the characterization of citation excellence through a high-impact indicator may considerably differ depending on that choice, We acknowledge financial support by Santander Univer-sities Global Division of Banco Santander. Ruiz-Castilloacknowledges financial support from the Spanish MECthrough grant SEJ2007-67436. This article is produced aspart of the CEPR project “SCience, Innovation, FIrms andmarkets in a GLObalized World (SCI-FI GLOW)” fundedby the European Commission under its Seventh Frame-work Programme for Research (Collaborative Project)Contract no. 217436., Publicado
e-Archivo. Repositorio Institucional de la Universidad Carlos III de Madrid
Publication Artículo científico (JournalArticle)

A comparison of the scientific performance of the U.S. and the European Union at the turn of the 21st century

  • Albarrán, Pedro
  • Crespo, Juan A.
  • Ortuño, Ignacio
  • Ruiz-Castillo, Javier
In this paper, scientific performance is identified with the impact that journal articles have through the citations they receive. In 15 disciplines, as well as in all sciences as a whole, the EU share of total publications is greater than that of the U.S. However, as soon as the citations received by these publications are taken into account the picture is completely reversed. Firstly, the EU share of total citations is still greater than the U.S. in only seven fields. Secondly, the mean citation rate in the U.S. is greater than in the EU in every one of the 22 fields studied. Thirdly, since standard indicators—such as normalized mean citation ratios—are silent about what takes place in different parts of the citation distribution, this paper compares the publication shares of the U.S. and the EU at every percentile of the world citation distribution in each field. It is found that in seven fields the initial gap between the U.S. and the EU widens as we advance towards the more cited articles, while in the remaining 15 fields—except for Agricultural Sciences—the U.S. always surpasses the EU when it counts, namely, at the upper tail of citation distributions. Finally, for all sciences as a whole the U.S. publication share becomes greater than that of the EU for the top 50% of the most highly cited articles. The data used refers to 3.6 million articles published in 1998–2002, and the more than 47 million citations they received in 1998–2007, The authors acknowledge financial support from the Spanish MEC through grants SEJ2007-63098, SEJ2006-05710, SEJ2007-67135, and SEJ2007-67436. The database of Thomson Scientific (formerly Thomson-ISI; Institute for Scientific Information) has been acquired with funds from Santander Universities Global Division of Banco Santander. This paper is part of the SCIFI-GLOW Collaborative Project supported by the European Commission’s Seventh Research Framework Programme, Contract number SSH7-CT-2008-217436., Publicado
e-Archivo. Repositorio Institucional de la Universidad Carlos III de Madrid
Publication Artículo científico (JournalArticle)

The measurement of low- and high-impact in citation distributions : technical results

  • Albarrán, Pedro
  • Ortuño, Ignacio
  • Ruiz-Castillo, Javier
This paper introduces a novel methodology for comparing the citation distributions of research units of a certain size working in the same homogeneous field. Given a critical citation level (CCL), we suggest using two real valued indicators to describe the shape of any distribution: a high-impact and a low-impact measure defined over the set of articles with citations above or below the CCL. The key to this methodology is the identification of a citation distribution with an income distribution. Once this step is taken, it is easy to realize that the measurement of low-impact coincides with the measurement of economic poverty. In turn, it is equally natural to identify the measurement of high-impact with the measurement of a certain notion of economic affluence. On the other hand, it is seen that the ranking of citation distributions according to a family of low-impact measures is essentially characterized by a number of desirable axioms. Appropriately redefined, these same axioms lead to the selection of an equally convenient class of decomposable high-impact measures. These two families are shown to satisfy other interesting properties that make them potentially useful in empirical applications, including the comparison of research units working in different fields, European Community's Seventh Framework Program, Albarrán and Ruiz-Castillo acknowledge financial support from the Spanish MEC, the former through grants SEJ2007-63098 and SEJ2006-05710, and the latter through grant SEJ2007-67436. This paper is part of the SCIFI-GLOW Collaborative Project supported by the European Commission’s Seventh Research Framework Programme, Contract number SSH7-CT-2008-217436., Publicado
e-Archivo. Repositorio Institucional de la Universidad Carlos III de Madrid
Publication Artículo preliminar (WorkingPaper)

The evaluation of citation distributions

  • Ruiz-Castillo, Javier
This paper reviews a number of recent contributions that demonstrate that a blend of welfare economics and statistical analysis is useful in the evaluation of the citations received by scientific papers in the periodical literature. The paper begins by clarifying the role of citation analysis in the evaluation of research. Next, a summary of results about the citation distributions’ basic features at different aggregation levels is offered. These results indicate that citation distributions share the same broad shape, are highly skewed, and are often crowned by a power law. In light of this evidence, a novel methodology for the evaluation of research units is illustrated by comparing the high- and low-citation impact achieved by the U.S., the European Union, and the rest of the world in 22 scientific fields. However, contrary to recent claims, it is shown that mean normalization at the sub-field level does not lead to a universal distribution. Nevertheless, among other topics subject to ongoing research, it appears that this lack of universality does not preclude sensible normalization procedures to compare the citation impact of articles in different scientific fields., The author acknowledges financial support from Santander Universities Global Division of Banco Santander, as well as from the Spanish MEC through grant SEJ2007-67436. This paper is part of the SCIFI-GLOW Collaborative Project supported by the European Commission’s Seventh Research Framework Programme, Contract no. SSH7-CT-2008-217436.
e-Archivo. Repositorio Institucional de la Universidad Carlos III de Madrid
Publication Artículo científico (JournalArticle)

References made and citations received by scientific articles

  • Albarrán, Pedro
  • Ruiz-Castillo, Javier
This article studies massive evidence about references made and citations received after a 5-year citation window by 3.7 million articles published in 1998 to 2002 in 22 scientific fields. We find that the distributions of references made and citations received share a number of basic features across sciences. Reference distributions are rather skewed to the right while citation distributions are even more highly skewed:The mean is about 20 percentage points to the right of the median, and articles with a remarkable or an outstanding number of citations represent about 9% of the total. Moreover, the existence of a power law representing the upper tail of citation distributions cannot be rejected in 17 fields whose articles represent 74.7% of the total. Contrary to the evidence in other contexts, the value of the scale parameter is above 3.5 in 13 of the 17 cases. Finally, power laws are typically small, but capture a considerable proportion of the total citations received, The authors acknowledge financial support from Span-ish MEC Grants SEJ2007–67436, SEJ2007–63098, and SEJ2006–05710. The database of Thomson Scientific (for-merly Thomson-ISI; Institute for Scientific Information)was acquired with funds from Santander Universities Global Division of Banco Santander. This article is partof the SCIFI-GLOW Collaborative Project supported bythe European Commission’s 7th Research Framework Pro-gramme, Contract No. SSH7-CT-2008–217436, Publicado
e-Archivo. Repositorio Institucional de la Universidad Carlos III de Madrid
Publication Artículo preliminar (WorkingPaper)

Average-based versus high-and low-impact indicators for the evaluation of scientific distributions

  • Albarrán, Pedro
  • Ortuño, Ignacio
  • Ruiz-Castillo, Javier
Albarran et al. (2011a) introduced a novel methodology for the evaluation of citation distributions consisting of a pair of high- and a low-impact measures defined over the set of articles with citations below or above a critical citation level CCL. Albarran et al. (2011b) presented the first empirical applications to a situation in which the world citation distribution in 22 scientific fields is partitioned into three geographical areas: the U.S., the European Union, and the rest of the world. In this paper, we compare our results with those obtained with average-based indicators. For reasonable CCLs, such as the 80th percentile of the world citation distribution in each field, the cardinal differences between the results obtained with our high-impact index and the mean citation rate are of a large order of magnitude. When, in addition, the percentage in the top 5% of most cited articles or the percentage of uncited articles are used, there are still important quantitative differences with respect to the high- and low-impact indicators advocated in our approach when the CCL is fixed at the 80th or the 95th percentile., Albarrán y Ruiz-Castillo acknowledge financial help from the Spanish MEC, the first though grants SEJ2007-63098 and SEJ2006-05710, and the second through grant SEJ2007-67436. This paper is part of the SCIFI-GLOW Collaborative Project supported by the European Commission's Seventh Research Framework Programme, Contract number SSH7-CT-2008-217436.
e-Archivo. Repositorio Institucional de la Universidad Carlos III de Madrid
Publication Artículo preliminar (WorkingPaper)

The measurement of low- and high-impact in citation distributions : technical results

  • Albarrán, Pedro
  • Ortuño, Ignacio
  • Ruiz-Castillo, Javier
This paper introduces a novel methodology for comparing the citation distributions of research units working in the same homogeneous field. Given a critical citation level (CCL), we suggest using two real valued indicators to describe the shape of any distribution: a high-impact and a low-impact measure defined over the set of articles with citations above or below the CCL. The key to this methodology is the identification of a citation distribution with an income distribution. Once this step is taken, it is easy to realize that the measurement of low-impact coincides with the measurement of economic poverty. In turn, it is equally natural to identify the measurement of high-impact with the measurement of a certain notion of economic affluence. On the other hand, it is seen that the ranking of citation distributions according to a family of low-impact measures is essentially characterized by a number of desirable axioms. Appropriately redefined, these same axioms lead to the selection of an equally convenient class of decomposable high-impact measures. These two families are shown to satisfy other interesting properties that make them potentially useful in empirical applications, including the comparison of research units working in different fields., Albarrán and Ruiz-Castillo acknowledge financial support from the Spanish MEC, the former through grants SEJ2007-63098 and SEJ2006-05710, and the latter through grant SEJ2007-67436. This paper is part of the SCIFI-GLOW Collaborative Project supported by the European Commission's Seventh Research Framework Programme, Contract number SSH7-CT-2008-217436.
e-Archivo. Repositorio Institucional de la Universidad Carlos III de Madrid
Publication Artículo preliminar (WorkingPaper)

References made and citations received by scientific articles

  • Albarrán, Pedro
  • Ruiz-Castillo, Javier
This paper studies massive evidence about references made and citations received after a five-year citation window by 3.7 million articles published in 1998-2002 in 22 scientific fields. We find that the distributions of references made and citations received share a number of basic features across sciences. Reference distributions are rather skewed to the right, while citation distributions are even more highly skewed: the mean is about 20 percentage points to the right of the median, and articles with a remarkable or outstanding number of citations represent about 9% of the total. Moreover, the existence of a power law representing the upper tail of citation distributions cannot be rejected in 17 fields whose articles represent 74.7% of the total. Contrary to the evidence in other contexts, the value of the scale parameter is above 3.5 in 13 of the 17 cases. Finally, power laws are typically small but capture a considerable proportion of the total citations received, The authors acknowledge financial support from the Spanish MEC, Grants SEJ2007-67436, SEJ2007-63098 and SEJ2006-05710. The database of Thomson Scientific (formerly Thomson-ISI; Institute for Scientific Information) has been acquired with funds from Santander Universities Global Division of Banco Santander. This paper is part of the SCIFI-GLOW Collaborative Project supported by the European Commission’s Seventh Research Framework Programme, Contract no. SSH7-CT-2008-217436.
e-Archivo. Repositorio Institucional de la Universidad Carlos III de Madrid
Publication Artículo preliminar (WorkingPaper)

The skewness of science in 219 sub-fields and a number of aggregates

  • Albarrán, Pedro
  • Crespo, Juan A.
  • Ortuño, Ignacio
  • Ruiz-Castillo, Javier
This paper studies evidence from Thomson Scientific about the citation process of 3.7 million articles published in the period 1998-2002 in 219 Web of Science categories, or sub-fields. Reference and citation distributions have very different characteristics across sub-fields. However, when analyzed with the Characteristic Scores and Scales technique, which is size and scale independent, the shape of these distributions appear extraordinarily similar. Reference distributions are mildly skewed, but citation distributions with a five-year citation window are highly skewed: the mean is twenty points above the median, while 9-10% of all articles in the upper tail account for about 44% of all citations. The aggregation of sub-fields into disciplines and fields according to several aggregation schemes preserve this feature of citation distributions. On the other hand, for 140 of the 219 sub-fields the existence of a power law cannot be rejected. However, contrary to what is generally believed, at the sub-field level the scaling parameter is above 3.5 most of the time, and power laws are relatively small: on average, they represent 2% of all articles and account for 13.5% of all citations. The results of the aggregation into disciplines and fields reveal that power law algebra is a subtle phenomenon., European Community's Seventh Framework Program, The authors acknowledge financial support from the Spanish MEC through grants SEJ2007-63098, SEJ2006-05710, SEJ2007-67135, and SEJ2007-67436. This paper is part of the SCIFI-GLOW Collaborative Project supported by the European Commission’s Seventh Research Framework Programme, Contract no. SSH7-CT-2008-217436.
e-Archivo. Repositorio Institucional de la Universidad Carlos III de Madrid
Publication Artículo científico (JournalArticle)

The skewness of science in 219 sub-fields and a number of aggregates

  • Albarrán, Pedro
  • Crespo, Juan A.
  • Ortuño, Ignacio
  • Ruiz-Castillo, Javier
This paper studies evidence from Thomson Scientific (TS) about the citation process of 3.7 million articles published in the period 1998 2002 in 219 Web of Science (WoS) categories, or sub fields. Reference and citation distributions have very different characteristics across sub fields. However, when analyzed with the Characteristic Scores and Scales (CSS) technique, which is replication and scale invariant, the shape of these distributions over three broad categories of articles appears strikingly similar. Reference distributions are mildly skewed, but citation distributions with a 5 year citation window are highly skewed: the mean is 20 points above the median, while 9 10% of all articles in the upper tail account for about 44% of all citations. The aggregation of sub fields into disciplines and fields according to several aggregation schemes preserve this feature of citation distributions. It should be noted that when we look into subsets of articles within the lower and upper tails of citation distributions the universality partially breaks down. On the other hand, for 140 of the 219 sub fields the existence of a power law cannot be rejected. However, contrary to what is generally believed, at the sub field level the scaling parameter is above 3.5 most of the time, and power laws are relatively small: on average, they represent 2% of all articles and account for 13.5% of all citations. The results of the aggregation into disciplines and fields reveal that power law algebra is a subtle phenomenon, The authors acknowledge financial support from the Spanish MEC through grants SEJ2007 63098, SEJ2007 67436, ECO2009 11165, and ECO2010 19596. This paper is part of the SCIFI-GLOW Collaborative Project supported by the European Commission’s Seventh Research Framework Programme, Co SSH7-CT-2008-217436, Publicado
Dipòsit Digital de la UB
Publication Artículo preliminar (WorkingPaper)

What does it take for and R&D tax incentive policy to be effective?

  • Mohnen, Pierre
  • Lokshin, Boris
We take a critical look at how to assess the effectiveness of R&D tax incentives. The net welfare gain is shown to be sensitive to a certain number of parameters. In particular, the deadweight loss associated with level-based tax incentives depends on the ex-ante R&D level. We report on the success of a past policy changes and simulate the effect of various parameter changes in the existing Dutch R&D tax incentive scheme. We show that this policy is more effective for small firms than for large firms. We end with a discussion of the pros and cons of volume-based versus incremental R&D tax incentives.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo preliminar (WorkingPaper)

What does it take for and R&D tax incentive policy to be effective?

  • Mohnen, Pierre
  • Lokshin, Boris
We take a critical look at how to assess the effectiveness of R&D tax incentives. The net welfare gain is shown to be sensitive to a certain number of parameters. In particular, the deadweight loss associated with level-based tax incentives depends on the ex-ante R&D level. We report on the success of a past policy changes and simulate the effect of various parameter changes in the existing Dutch R&D tax incentive scheme. We show that this policy is more effective for small firms than for large firms. We end with a discussion of the pros and cons of volume-based versus incremental R&D tax incentives.