Skip to main content

Rethinking randomised controlled trials: Causal claims, the reproducibility crisis, and combining methods

RYC2020-029424-I

•
Funding agency name Agencia Estatal de Investigación
Funding agency acronym AEI
Program Programa Estatal de Promoción del Talento y su Empleabilidad en I+D+i
Subprogram Subprograma Estatal de Incorporación
Call Ramón y Cajal
Call year 2020
State Plan 2017-2020 Plan Estatal de Investigación Científica y Técnica y de Innovación
Beneficiary centre AGENCIA ESTATAL CONSEJO SUPERIOR DE INVESTIGACIONES CIENTIFICAS (CSIC)

Resultados relacionados

Resultados totales (Incluyendo duplicados): 1
Encontrada(s) 1 página(s)

DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Otros (Other)

Multi-Studies: A Novel Approach to Addressing Irreplicability in RCTs

  • Krauss, Alexander
© The Author(s), under exclusive license to Springer Nature, This chapter proposes a novel approach to addressing irreplicability encountered in randomised controlled trials (RCTs). Irreplicability affects, to different degrees, all fields of science. Some of the most common explanations for non-replicability are low sample size, low statistical power, p-hacking, publication bias and HARKing. Such issues face some studies but not others. Focusing on RCTs, this chapter highlights that, while it is well-recognised that many types of bias and other types of constraint generally face studies across the biomedical, behavioural and social sciences, they are not commonly discussed collectively. In response to this gap in the literature on RCTs, we shall consider a novel approach to addressing non-replicability. The chapter helps explain how a degree of inevitable variation between the outcomes of different studies is driven by a combined set of biases and constraints underlying the scientific process that relate to methods, people, contexts, and time points at which data are collected in studies. It outlines how causal evidence in such studies is inferred from estimated statistical results that are the outcome of multiple complex processes: sampling, randomising, blinding, controlling, delivering treatments, and so on. These processes involve many actors making many decisions at different steps when designing, implementing and analysing studies within a particular context and time period. Correspondingly, the chapter considers the influence of the combined set of constraints on the quality and replicability of RCTs, and how to better tackle this issue. This entails integrating comparability of groups, treatments, contexts, etc. within a single study—called here a multi-study. Implications are then drawn for practitioners., I am thankful for comments from Nancy Cartwright, John Worrall, Federica Russo, Carl Hoefer, Stephan Guettinger, Corinna Peters, Camille Lassale, Federica Malfatti and Saana Jukola. I received funding from the Marie Curie programme of the European Commission and the Ministry of Science and Innovation of the Government of Spain (grant RYC2020-029424-I)., Peer reviewed