The proportion of randomized controlled trials that inform clinical practice

  1. Nora Hutchinson
  2. Hannah Moyer
  3. Deborah A Zarin
  4. Jonathan Kimmelman  Is a corresponding author
  1. McGill University, Canada
  2. Brigham and Women's Hospital, United States

Abstract

Prior studies suggest that clinical trials are often hampered by problems in design, conduct and reporting that limit their uptake in clinical practice. We have described 'informativeness' as the ability of a trial to guide clinical, policy or research decisions. Little is known about the proportion of initiated trials that inform clinical practice. We created a cohort of randomized interventional clinical trials in three disease areas (ischemic heart disease, diabetes mellitus and lung cancer), that were initiated between 1 January 2009 and 31 December 2010 using ClinicalTrials.gov. We restricted inclusion to trials aimed at answering a clinical question related to the treatment or prevention of disease. Our primary outcome was the proportion of clinical trials fulfilling four conditions of informativeness: importance of the clinical question, trial design, feasibility, and reporting of results. Our study included 125 clinical trials. The proportion meeting four conditions for informativeness was 26.4% (95% CI 18.9 - 35.0). Sixty-seven percent of participants were enrolled in informative trials. The proportion of informative trials did not differ significantly between our three disease areas. Our results suggest that the majority of clinical trials designed to guide clinical practice possess features that may compromise their ability to do so. This highlights opportunities to improve the scientific vetting of clinical research.

Data availability

The data set is available online on Open Science Framework (DOI 10.17605/OSF.IO/3EGKU) (reference 18 in the manuscript).

Article and author information

Author details

  1. Nora Hutchinson

    Studies of Translation, Ethics and Medicine, McGill University, Montreal, Canada
    Competing interests
    No competing interests declared.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0003-1349-8592
  2. Hannah Moyer

    Studies of Translation, Ethics and Medicine, McGill University, Montreal, Canada
    Competing interests
    No competing interests declared.
  3. Deborah A Zarin

    Multi-Regional Clinical Trials Center, Brigham and Women's Hospital, Boston, United States
    Competing interests
    Deborah A Zarin, received payment as consultant for National Library of Medicine, NIH, for scientific advice to ClinicalTrials.gov and received grants from the Greenwall Foundation..
  4. Jonathan Kimmelman

    Studies of Translation, Ethics and Medicine Research Group, Biomedical Ethics Unit, McGill University, Montreal, Canada
    For correspondence
    jonathan.kimmelman@mcgill.ca
    Competing interests
    Jonathan Kimmelman, received consulting fees from Amylyx Inc and payments from Biomarin. JK participated on Data Safety Monitoring Boards for NIAID and Ultragenyx.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0003-1614-6779

Funding

Fonds de Recherche du Québec - Santé

  • Nora Hutchinson

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Copyright

© 2022, Hutchinson et al.

This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 1,854
    views
  • 350
    downloads
  • 19
    citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Nora Hutchinson
  2. Hannah Moyer
  3. Deborah A Zarin
  4. Jonathan Kimmelman
(2022)
The proportion of randomized controlled trials that inform clinical practice
eLife 11:e79491.
https://doi.org/10.7554/eLife.79491

Share this article

https://doi.org/10.7554/eLife.79491

Further reading

    1. Medicine
    2. Neuroscience
    Tomohiro Umeda, Ayumi Sakai ... Takami Tomiyama
    Research Article

    Neurodegenerative diseases are age-related disorders characterized by the cerebral accumulation of amyloidogenic proteins, and cellular senescence underlies their pathogenesis. Thus, it is necessary for preventing these diseases to remove toxic proteins, repair damaged neurons, and suppress cellular senescence. As a source for such prophylactic agents, we selected zizyphi spinosi semen (ZSS), a medicinal herb used in traditional Chinese medicine. Oral administration of ZSS hot water extract ameliorated Aβ and tau pathology and cognitive impairment in mouse models of Alzheimer’s disease and frontotemporal dementia. Non-extracted ZSS simple crush powder showed stronger effects than the extract and improved α-synuclein pathology and cognitive/motor function in Parkinson’s disease model mice. Furthermore, when administered to normal aged mice, the ZSS powder suppressed cellular senescence, reduced DNA oxidation, promoted brain-derived neurotrophic factor expression and neurogenesis, and enhanced cognition to levels similar to those in young mice. The quantity of known active ingredients of ZSS, jujuboside A, jujuboside B, and spinosin was not proportional to the nootropic activity of ZSS. These results suggest that ZSS simple crush powder is a promising dietary material for the prevention of neurodegenerative diseases and brain aging.

    1. Medicine
    Hyun Beom Song, Laura Campello ... Anand Swaroop
    Research Advance

    Inherited retinal degenerations (IRDs) constitute a group of clinically and genetically diverse vision-impairing disorders. Retinitis pigmentosa (RP), the most common form of IRD, is characterized by gradual dysfunction and degeneration of rod photoreceptors, followed by the loss of cone photoreceptors. Recently, we identified reserpine as a lead molecule for maintaining rod survival in mouse and human retinal organoids as well as in the rd16 mouse, which phenocopy Leber congenital amaurosis caused by mutations in the cilia-centrosomal gene CEP290 (Chen et al., 2023). Here, we show the therapeutic potential of reserpine in a rhodopsin P23H rat model of autosomal dominant RP. At postnatal day (P) 68, when males and females are analyzed together, the reserpine-treated rats exhibit higher rod-derived scotopic b-wave amplitudes compared to the controls with little or no change in scotopic a-wave or cone-derived photopic b-wave. Interestingly, the reserpine-treated female rats display enhanced scotopic a- and b-waves and photopic b-wave responses at P68, along with a better contrast threshold and increased outer nuclear layer thickness. The female rats demonstrate better preservation of both rod and cone photoreceptors following reserpine treatment. Retinal transcriptome analysis reveals sex-specific responses to reserpine, with significant upregulation of phototransduction genes and proteostasis-related pathways, and notably, genes associated with stress response. This study builds upon our previously reported results reaffirming the potential of reserpine for gene-agnostic treatment of IRDs and emphasizes the importance of biological sex in retinal disease research and therapy development.