Research: Titles and abstracts of scientific reports ignore variation among species

  1. Barbara R Migeon  Is a corresponding author
  1. Johns Hopkins University, United States

Abstract

An analysis of more than 1000 research articles in biology reveals that the name of the species being studied is not mentioned in the title or abstract of many articles. Consequently, such data are not easily accessible in the PubMed database. These omissions can mislead readers about the true nature of developmental processes and delay the acceptance of valid species differences. To improve the accuracy of the scientific record, I suggest that journals should require that authors include the name of the species being studied in the title or abstract of submitted papers.

https://doi.org/10.7554/eLife.05075.001

Main text

One undeniable truth that should be apparent to all scientists is that evolution is a tinkerer (Jacob, 1977, 2001). Such tinkering is responsible for the huge variations in the ways that organisms carry out their essential functions. We have become aware of species differences in DNA content (Atkin et al., 1965), DNA methylation (Bird, 2002), sex determination (Sander van Doorn, 2014), staging of embryonic stem cells (Ginis et al., 2004; Silva et al., 2008), length of gestation (Migeon, 2014), dosage compensation (Migeon, 2011), telomere length (Tackney et al., 2014), the repair of chromosome breakage (Doseth et al., 2011), ease of transformation (Rangarajan and Weinberg, 2003) and expression of inborn errors (Elsea and Lucas, 2002) among many other variations. This is true not only for different evolutionary kingdoms, classes, phyla, orders, but also for genera, and even among species. Such variations are attributable not only to random mutations, but also to the striking disparity in the staging of embryonic development between species. Species differences should not be ignored because they tell us so much about the determinants of these developmental events. Therefore, a mouse is a mouse and not a human surrogate.

For many years I have been surprised to see that the titles of many papers in my own field, X inactivation, do not indicate the mammalian species used for their research, implying that their evidence applies to all mammals. Many readers cannot help but assume that it does, even when other published evidence indicates that such an assumption is erroneous. Not even Xist, the mammalian non-coding RNA that recruits chromatin modifiers to inactivate X chromosomes, is present in all mammals (Duret et al., 2006). During mammalian evolution, invasions of repetitive DNA sequences have destroyed some genes in the X inactivation center, and other genetic elements have arrived on the scene (Migeon et al., 2001).

I wondered if species variation were being ignored in studies of other biological phenomena—that is, if this were a common feature of the science being reported at this time. Therefore, I examined the tables of contents of various journals to find articles and reports concerning biological subjects, scoring each with respect to inclusion of the species studied in the title and in the abstract of the paper. If the species was not mentioned in the title I looked for it in the abstract. If not mentioned there, I then looked at the experimental methods or supplementary material to find the true subjects of the study. Note, my analysis did not require a specific species, only the kind of organism studied; the words Bacteria or Yeast were as acceptable as E. coli or S. cerevisiae. When I repeated this exercise 2 years later I also asked if the experimental models were mentioned in other summary material provided by the journal. My observations are summarized in Table 1 and in the text below.

Table 1

Frequency of inclusion of species in titles and abstracts of published papers

https://doi.org/10.7554/eLife.05075.002
JournalIssues# of articles*Is the species included in the title?If not included in the title, is the species included in the abstract?Species not included in title or abstract%
YesNo% NoYesNo% No
Nature GeneticsJan–Apr 2012521933652492717
June–Sept 2014602040673282013
CellFeb–May 20129613839046374539
July–Sept 20148218647829355543
ScienceMar–May 20125422325921113420
July–Sept 20145929305120103317
PNASMar–May 20122521111415672694927
July 201411949705936344929
PLOS GeneticsApr–May 2012107565148465105
Aug–Sept 201482443846317189
Hum Mol GeneticsApr–June 201267264161356159
eLifeMar–June 201410523827834445442
July–Sept 20149327667132345237
  1. *

    Only biological articles are included.

Table 1—source data 1

Is the species name mentioned in the title, impact statement, abstract and digest of eLife papers (July–Sept 2014)?

https://doi.org/10.7554/eLife.05075.003

These data clearly show that at least half the time, the species being studied does not appear in the title; and it does not appear in the abstract either in a significant fraction of papers (Table 1). At times I had to look at the supplementary material to discover the organism studied. The ‘In Brief’ statements published in Cell and the ‘Impact Statements’ published in eLife were even less likely to reveal the species studied: 72% of In Brief statements and 86% of Impact Statements did not mention the species examined (data not shown). Moreover, 45% of ‘Digests’ published by eLife did not mention the species being studied (see Table 1—Source data 1). I also noted that Drosophila, Caenorhabditis elegans and Arabidopsis were most frequently mentioned in the title of reports about them, whereas rats and mice appeared infrequently.

Two of the journals surveyed (PNAS and eLife) include keywords that are accessible in PubMed and other databases (such as EMBASE): these keywords can include the names of the species under study, but this is not always the case. Although information about species can be captured by searching databases, readers should not have to. Species variation is key to the interpretation of findings, so the species used for the investigation should be a fundamental part of the resulting research paper and not something that can be discovered by searching an outside database.

I wondered why one has to go to the methods section (not included in the PubMed database) to find the subject of a study. Although in some cases, the function studied may be highly conserved and non-variant, often, species variations should be expected, even in conserved developmental processes. In some cases authors may be trying to make it difficult for those who abhor animal experimentation to know the subject of their study. This is most evident when non-human primates are used for the studies. But, my data suggest that often, the investigators, even if aware of species variation, do not consider it relevant enough to include in title or abstract. We need to be mindful that not including the subject of the study in the title or abstract implies that the results of the study are generally applicable to all species.

Ignoring species variation would be understandable and perhaps tolerable if it didn't lead to misinterpretation of experimental observations. I know best the upshot in my own field: It took more than 30 years for the scientific community to accept valid evidence that humans are not like mice with respect to the details of X inactivation. Because of expectations that this developmental process would be similar among mammals, it has taken too many years and costly repetitive experiments for the community to accept the evidence that humans, unlike mice do not have paternal imprinting of X-linked genes in their placental tissues (Migeon and Do, 1979; Moreira de Mello et al., 2010). Papers that do not mention mice, the species being studied, in their title or abstract (Chelmicki et al., 2014; Payer and Lee, 2014) continue to report mechanisms that have no consequence for humans or other mammals as the targeted non-coding RNA being reported in rodents is not functional in other mammalian species.

Ignoring species variation leads to over-interpretation of data, which may actually stifle novel discoveries in other organisms. Ignoring species variations is a common oversight that needs to be remedied. To improve the accuracy of the scientific record, I suggest that all journals should require that authors include the name(s) of the species being studied in the title or abstract of submitted papers.

References

    1. Jacob F
    (2001) Complexity and tinkering
    Annals of the New York Academy of Sciences 929:71–73.
    https://doi.org/10.1111/j.1749-6632.2001.tb05708.x
    1. Migeon BR
    2. Do TT
    (1979)
    In search of non-random X inactivation: studies of fetal membranes heterozygous for glucose-6-phosphate dehydrogenase
    American Journal of Human Genetics 31:581–585.
    1. Migeon BR
    (2014)
    Females are mosaics: X inactivation and sex differences in disease
    73, Females are mosaics: X inactivation and sex differences in disease, New York, Oxford University Press, Table 6–1.

Decision letter

  1. Peter Rodgers
    Reviewing Editor

eLife posts the editorial decision letter and author response on a selection of the published articles (subject to the approval of the authors). An edited version of the letter sent to the authors after peer review is shown, indicating the substantive concerns or comments; minor concerns are not usually shown. Reviewers have the opportunity to discuss the decision before the letter is sent (see review process). Similarly, the author response typically shows only responses to the major concerns raised by the reviewers.

Thank you for sending your work entitled “Titles and Abstracts of Scientific Reports Ignore Species Variation” for consideration at eLife. Your article has been favorably evaluated by the Features Editor (Peter Rodgers) and two reviewers, one of whom, Ferric Fang, has agreed to reveal his identity.

The Features Editor and the reviewers discussed their comments before we reached this decision, and the Features Editor has assembled the following comments to help you prepare a revised submission.

The author of this Comment notes that, in the field of X inactivation, the importance of species variation has often been ignored by researchers. To test whether this might be true of other fields, she then asks whether the species examined in experimental studies is specifically mentioned in the titles and abstracts of recent publications in several prominent journals. She reports that species are not mentioned in the titles of the majority (63%) of articles and are often (25%) not mentioned in either the title or abstract. She suggests that this has had 'detrimental consequences for the scientific community'.

We wholeheartedly agree with the author that distinctions between species can be important. For instance, the question of whether mouse models of inflammation are relevant to humans has been hotly debated (Seok et al., PNAS, 2013; Takao and Miyakawa, PNAS, 2014). However we are not convinced that the failure to mention a species name in the title and abstract necessarily indicates that the importance of species differences has been neglected (see points 1 and 2 below). And while the article is brief, it could be shortened even further to focus on its core message (see points 3-5 below).

1) Please mention that two of the journals surveyed (PNAS and eLife) include keywords, which are easily accessed in PubMed and often include the names of the species under study. Please also mention that information about species can be captured by search strategies, as databases such as EMBASE index articles by species, and even include sub-classification by experimental animal model, cell or tissue (for articles published since 1978).

2) The article should be reworded to make clear that the fact that species are not mentioned in titles does not mean that species differences are being neglected by authors. (To make the case that species differences have been neglected to the detriment of science, the author would have to go beyond the mere failure to mention species and provide specific examples in which this is the case. Otherwise one cannot exclude the possibility that authors sometimes fail to mention individual species when they wish to emphasize a highly conserved phenomenon that is generalizable across many species. For instance, rRNA, tRNA and nucleotide binding domains of ABC transport proteins are highly conserved in all kingdoms of life, and it might not necessarily be essential or relevant to designate an individual species in the abstract of an article that is attempting to make a general point. For example, the article 'Molecular Architecture of a Eukaryotic Translational Initiation Complex' (Fernandez et al. Science, 2013) might be criticised by the author as neglecting to mention that the study was performed in S. cerevesiae, but in fact the authors note throughout the paper that this mechanism is conserved from bacteria to humans.)

3) Passages that make various assumptions about why species are not mentioned in titles/abstracts should be removed. These include the sentence “This practice is based [. . .] is erroneous”, and the passage “I suppose that in some cases […] in prestigious journals.”

4) The column containing impact factors should be removed from Table 1; impact factors are not mentioned in the article and don't seem relevant to the points being made. And in any case, our official eLife policy is to eschew the use of impact factor in any discussion of scholarly assessment.

5) Table 2 should be deleted, and the relevant section of the text should be modified accordingly. Much of the data in Table 2 already appears in Table 1; regarding the new data, it is not clear that one would expect, say, the graphical abstracts published by Cell or the Digests published by eLife to contain species information. (Note from Peter: the Digests in eLife are aimed at the general public, so they will often refer to, say, bacteria or yeast, rather than to specific species.)

https://doi.org/10.7554/eLife.05075.004

Author response

1) Please mention that two of the journals surveyed (PNAS and eLife) include keywords, which are easily accessed in PubMed and often include the names of the species under study. Please also mention that information about species can be captured by search strategies, as databases such as EMBASE index articles by species, and even include sub-classification by experimental animal model, cell or tissue (for articles published since 1978).

I have included the following in my comment: “Two of the journals surveyed (PNAS and eLife) include keywords that are accessible in PubMed and may, but do not always include the names of the species under study. Although information about species can be captured by search strategies, such as EMBASE, readers should not have to, and do not often consult these databases for the purpose of determining the species under study. Because species variation is key to the interpretation of findings, the species used for the investigation should be a fundamental part of reportage and not something that can be discovered by searching an outside database.”

2) The article should be reworded to make clear that the fact that species are not mentioned in titles does not mean that species differences are being neglected by authors.

My data suggest that often investigators, even if aware of species variation, do not consider it relevant enough to include species name in Title or Abstract.

(To make the case that species differences have been neglected to the detriment of science, the author would have to go beyond the mere failure to mention species and provide specific examples in which this is the case […]

I did mention the 30-year delay in convincing the scientific community of the validity of species differences in placental imprinting of X inactivation. And that key players in one species may not be present in others, making the observations less important than advertised, as they do not explain what is going on in most mammals.

[…] Otherwise one cannot exclude the possibility that authors sometimes fail to mention individual species when they wish to emphasize a highly conserved phenomenon that is generalizable across many species. For instance, rRNA, tRNA and nucleotide binding domains of ABC transport proteins are highly conserved in all kingdoms of life, and it might not necessarily be essential or relevant to designate an individual species in the abstract of an article that is attempting to make a general point. For example, the article 'Molecular Architecture of a Eukaryotic Translational Initiation Complex' (Fernandez et al. Science, 2013) might be criticised by the author as neglecting to mention that the study was performed in S. cerevesiae, but in fact the authors note throughout the paper that this mechanism is conserved from bacteria to humans.)

I agree that such variation is a moot point when there is no variation. But some assumptions of conservation need to be documented.

3) Passages that make various assumptions about why species are not mentioned in titles/abstracts should be removed. These include the sentence “This practice is based […] is erroneous”, and the passage “I suppose that in some cases […] in prestigious journals.

I have revised the offending passages.

4) The column containing impact factors should be removed from Table 1; impact factors are not mentioned in the article and don't seem relevant to the points being made. And in any case, our official eLife policy is to eschew the use of impact factor in any discussion of scholarly assessment.

I have removed the impact factors from Table 1.

5) Table 2 should be deleted, and the relevant section of the text should be modified accordingly. Much of the data in Table 2 already appears in Table 1; regarding the new data, it is not clear that one would expect, say, the graphical abstracts published by Cell or the Digests published by eLife to contain species information.

I did not know what to expect and so I asked the question. As you see these extra summaries do not often provide such information: 72% of In Brief and 88 % of Graphical Abstracts published by Cell and 86 % of Impact Statements and 45% of Digests published by eLife did not mention species. Table 2 has been removed.

(Note from Peter: the Digests in eLife are aimed at the general public, so they will often refer to, say, bacteria or yeast, rather than to specific species).

My analysis did not require authors to state a specific species, only the kind of organism they were studying. Bacteria or Yeast were as acceptable as E. coli and S. cerevisiae. I added this statement in my comment.

https://doi.org/10.7554/eLife.05075.005

Article and author information

Author details

  1. Barbara R Migeon

    McKusick Nathans Institute of Genetic Medicine, Johns Hopkins University, Baltimore, United States
    Contribution
    BRM, Conception and design, Acquisition of data, Analysis and interpretation of data, Drafting or revising the article, Contributed unpublished essential data or reagents
    For correspondence
    bmigeon@jhmi.edu
    Competing interests
    The author declares that no competing interests exist.

Funding

The author declares there was no grant funding for this research. The Institute of Genetic Medicine, which provides my salary had no role in this research.

Publication history

  1. Received: October 7, 2014
  2. Version of Record published: December 24, 2014 (version 1)

Copyright

© 2014, Migeon

This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 3,624
    Page views
  • 82
    Downloads
  • 1
    Citations

Article citation count generated by polling the highest count across the following sources: Crossref, PubMed Central, Scopus.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Barbara R Migeon
(2014)
Research: Titles and abstracts of scientific reports ignore variation among species
eLife 3:e05075.
https://doi.org/10.7554/eLife.05075
  1. Further reading

Further reading

    1. Developmental Biology
    2. Genetics and Genomics
    Zian Liao, Suni Tang ... Martin Matzuk
    Research Article

    Endometrial decidualization, a prerequisite for successful pregnancies, relies on transcriptional reprogramming driven by progesterone receptor (PR) and bone morphogenetic protein (BMP)-SMAD1/SMAD5 signaling pathways. Despite their critical roles in early pregnancy, how these pathways intersect in reprogramming the endometrium into a receptive state remains unclear. To define how SMAD1 and/or SMAD5 integrate BMP signaling in the uterus during early pregnancy, we generated two novel transgenic mouse lines with affinity tags inserted into the endogenous SMAD1 and SMAD5 loci (Smad1HA/HA and Smad5PA/PA). By profiling the genome-wide distribution of SMAD1, SMAD5, and PR in the mouse uterus, we demonstrated the unique and shared roles of SMAD1 and SMAD5 during the window of implantation. We also showed the presence of a conserved SMAD1, SMAD5, and PR genomic binding signature in the uterus during early pregnancy. To functionally characterize the translational aspects of our findings, we demonstrated that SMAD1/5 knockdown in human endometrial stromal cells suppressed expressions of canonical decidual markers (IGFBP1, PRL, FOXO1) and PR-responsive genes (RORB, KLF15). Here, our studies provide novel tools to study BMP signaling pathways and highlight the fundamental roles of SMAD1/5 in mediating both BMP signaling pathways and the transcriptional response to progesterone (P4) during early pregnancy.

    1. Developmental Biology
    2. Neuroscience
    Tariq Zaman, Daniel Vogt ... Michael R Williams
    Research Article

    The cell-type-specific expression of ligand/receptor and cell-adhesion molecules is a fundamental mechanism through which neurons regulate connectivity. Here, we determine a functional relevance of the long-established mutually exclusive expression of the receptor tyrosine kinase Kit and the trans-membrane protein Kit Ligand by discrete populations of neurons in the mammalian brain. Kit is enriched in molecular layer interneurons (MLIs) of the cerebellar cortex (i.e., stellate and basket cells), while cerebellar Kit Ligand is selectively expressed by a target of their inhibition, Purkinje cells (PCs). By in vivo genetic manipulation spanning embryonic development through adulthood, we demonstrate that PC Kit Ligand and MLI Kit are required for, and capable of driving changes in, the inhibition of PCs. Collectively, these works in mice demonstrate that the Kit Ligand/Kit receptor dyad sustains mammalian central synapse function and suggest a rationale for the affiliation of Kit mutation with neurodevelopmental disorders.