Consensus-based guidance for conducting and reporting multi-analyst studies
- Eötvös Loránd University, Hungary
- Karolinska Institutet, Sweden
- Tilburg University, Netherlands
- University of Groningen, Netherlands
- University of Southern California, United States
- University of Amsterdam, Netherlands
- Dartmouth Collge, United States
- University of Muenster, Germany
- University of Rennes, France
- McLean Hospital, United States
- University of Missouri, United States
- National University of Singapore, Singapore
- University of New South Wales, Australia
- Stockholm School of Economics, Sweden
- University Hospital Basel, Switzerland
- Monash University, Australia
- University of Wisconsin-Madison, United States
- Ludwig-Maximilians-University, Germany
- University of Innsbruck, Austria
- Maastricht University, Netherlands
- Princeton University, United States
- University of Victoria, Canada
- Université Paris-Saclay, France
- University of Bristol, United Kingdom
- Center for Open Science and University of Virginia, United States
- Stanford University, United States
- University of Basel, Switzerland
- Tel Aviv University, Israel
- ESMT Berlin, Germany
- University College London, United Kingdom
- University of Sussex, United Kingdom
- University of Illinois, United States
- University of Virginia, United States
- University of Alberta, Canada
- University of Massachusetts Amherst, United States
- INSEAD, Singapore
Abstract
Any large dataset can be analyzed in a number of ways, and it is possible that the use of different analysis strategies will lead to different results and conclusions. One way to assess whether the results obtained depend on the analysis strategy chosen is to employ multiple analysts and leave each of them free to follow their own approach. Here, we present consensus-based guidance for conducting and reporting such multi-analyst studies, and we discuss how broader adoption of the multi-analyst approach has the potential to strengthen the robustness of results and conclusions obtained from analyses of datasets in basic and applied research.
Data availability
All anonymized data as well as the survey materials are publicly shared on the Open Science Framework page of the project: https://osf.io/4zvst/. Our methodology and data-analysis plan were preregistered. The preregistration document can be accessed at: https://osf.io/dgrua.
Article and author information
Author details
Jojanneke A Bastiaansen
Rotem Botvinik-Nezer
Noah N N van Dongen
Johnny B van Doorn
Morton Ann Gernsbacher
Magnus Johannesson
Jean-Francois Mangin
Russell A Poldrack
Don van Ravenzwaaij
Martin Schweinsberg
Funding
Netherlands Organisations for Scientific Research (406-17-568)
- Alexandra Sarafoglou
Natural Sciences and Engineering Research Council of Canada (BP-546283-2020)
- Samuel St-Jean
Fonds de recherche du Québec – Nature et technologies (290978)
- Samuel St-Jean
European Research Council (726361)
- Jelte Wicherts
European Research Council (726361)
- Olmo R van den Akker
European Research Council (681466)
- Yoram K Kunkels
VIDI fellowship organisation (016.Vidi.188.001)
- Don van Ravenzwaaij
VENI fellowship grant (Veni 191G.037)
- Laura F Bringmann
National Science Foundation (1760052)
- Matthew J Salganik
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Copyright
© 2021, Aczel et al.
This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.
Metrics
-
- 2,671
- views
-
- 325
- downloads
-
- 30
- citations
Views, downloads and citations are aggregated across all versions of this paper published by eLife.
Download links
A two-part list of links to download the article, or parts of the article, in various formats.
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Consensus-based guidance for conducting and reporting multi-analyst studies
eLife 10:e72185.
https://doi.org/10.7554/eLife.72185
Further reading
-
- Immunology and Inflammation
- Medicine
Metabolic abnormalities associated with liver disease have a significant impact on the risk and prognosis of cholecystitis. However, the underlying mechanism remains to be elucidated. Here, we investigated this issue using Wilson’s disease (WD) as a model, which is a genetic disorder characterized by impaired mitochondrial function and copper metabolism. Our retrospective clinical study found that WD patients have a significantly higher incidence of cholecystitis and a poorer prognosis. The hepatic immune cell landscape using single-cell RNA sequencing showed that the tissue immune microenvironment is altered in WD, mainly a major change in the constitution and function of the innate immune system. Exhaustion of natural killer (NK) cells is the fundamental factor, supported by the upregulated expression of inhibitory receptors and the downregulated expression of cytotoxic molecules, which was verified in clinical samples. Further bioinformatic analysis confirmed a positive correlation between NK cell exhaustion and poor prognosis in cholecystitis and other inflammatory diseases. The study demonstrated dysfunction of liver immune cells triggered by specific metabolic abnormalities in WD, with a focus on the correlation between NK cell exhaustion and poor healing of cholecystitis, providing new insights into the improvement of inflammatory diseases by assessing immune cell function.
-
- Computational and Systems Biology
- Medicine
Sudden death after myocardial infarction (MI) is associated with electrophysiological heterogeneities and ionic current remodelling. Low ejection fraction (EF) is used in risk stratification, but its mechanistic links with pro-arrhythmic heterogeneities are unknown. We aim to provide mechanistic explanations of clinical phenotypes in acute and chronic MI, from ionic current remodelling to ECG and EF, using human electromechanical modelling and simulation to augment experimental and clinical investigations. A human ventricular electromechanical modelling and simulation framework is constructed and validated with rich experimental and clinical datasets, incorporating varying degrees of ionic current remodelling as reported in literature. In acute MI, T-wave inversion and Brugada phenocopy were explained by conduction abnormality and local action potential prolongation in the border zone. In chronic MI, upright tall T-waves highlight large repolarisation dispersion between the border and remote zones, which promoted ectopic propagation at fast pacing. Post-MI EF at resting heart rate was not sensitive to the extent of repolarisation heterogeneity and the risk of repolarisation abnormalities at fast pacing. T-wave and QT abnormalities are better indicators of repolarisation heterogeneities than EF in post-MI.
