TY - JOUR TI - Investigating disagreement in the scientific literature AU - Lamers, Wout S AU - Boyack, Kevin AU - Larivière, Vincent AU - Sugimoto, Cassidy R AU - van Eck, Nees Jan AU - Waltman, Ludo AU - Murray, Dakota A2 - Rodgers, Peter VL - 10 PY - 2021 DA - 2021/12/24 SP - e72737 C1 - eLife 2021;10:e72737 DO - 10.7554/eLife.72737 UR - https://doi.org/10.7554/eLife.72737 AB - Disagreement is essential to scientific progress but the extent of disagreement in science, its evolution over time, and the fields in which it happens remain poorly understood. Here we report the development of an approach based on cue phrases that can identify instances of disagreement in scientific articles. These instances are sentences in an article that cite other articles. Applying this approach to a collection of more than four million English-language articles published between 2000 and 2015 period, we determine the level of disagreement in five broad fields within the scientific literature (biomedical and health sciences; life and earth sciences; mathematics and computer science; physical sciences and engineering; and social sciences and humanities) and 817 meso-level fields. Overall, the level of disagreement is highest in the social sciences and humanities, and lowest in mathematics and computer science. However, there is considerable heterogeneity across the meso-level fields, revealing the importance of local disciplinary cultures and the epistemic characteristics of disagreement. Analysis at the level of individual articles reveals notable episodes of disagreement in science, and illustrates how methodological artifacts can confound analyses of scientific texts. KW - meta-research KW - disagreement KW - citation analysis KW - natural language processing KW - metascience JF - eLife SN - 2050-084X PB - eLife Sciences Publications, Ltd ER -