Mice and primates use distinct strategies for visual segmentation

  1. Francisco J Luongo
  2. Lu Liu
  3. Chun Lum Andy Ho
  4. Janis K Hesse
  5. Joseph B Wekselblatt
  6. Francesco Lanfranchi
  7. Daniel Huber
  8. Doris Y Tsao  Is a corresponding author
  1. California Institute of Technology, United States
  2. University of Geneva, Switzerland
  3. University of California, Berkeley, United States

Abstract

The rodent visual system has attracted great interest in recent years due to its experimental tractability, but the fundamental mechanisms used by the mouse to represent the visual world remain unclear. In the primate, researchers have argued from both behavioral and neural evidence that a key step in visual representation is 'figure-ground segmentation', the delineation of figures as distinct from backgrounds (Nakayama, He, and Shimojo 1995; Lamme 1995; Poort et al. 2012; Qiu and Heydt 2005). To determine if mice also show behavioral and neural signatures of figure-ground segmentation, we trained mice on a figure-ground segmentation task where figures were defined by gratings and naturalistic textures moving counterphase to the background. Unlike primates, mice were severely limited in their ability to segment figure from ground using the opponent motion cue, with segmentation behavior strongly dependent on the specific carrier pattern. Remarkably, when mice were forced to localize naturalistic patterns defined by opponent motion, they adopted a strategy of brute force memorization of texture patterns. In contrast, primates, including humans, macaques, and mouse lemurs, could readily segment figures independent of carrier pattern using the opponent motion cue. Consistent with mouse behavior, neural responses to the same stimuli recorded in mouse visual areas V1, RL, and LM also did not support texture-invariant segmentation of figures using opponent motion. Modeling revealed tha­t the texture dependence of both the mouse's behavior and neural responses could be explained by a feedforward neural network lacking explicit segmentation capabilities. These findings reveal a fundamental limitation in the ability of mice to segment visual objects compared to primates.

Data availability

Source data has been provided to replicate all neural and behavioral figures (2,3,4,5,6,7). These data have been uploaded to dryad: https://doi.org/10.5061/dryad.ngf1vhhvp.Sufficient modeling details have been provided in methods section to replicate relevant parts of figure 8.

The following data sets were generated

Article and author information

Author details

  1. Francisco J Luongo

    Division of Biology and Biological Engineering, California Institute of Technology, Pasadena, United States
    Competing interests
    The authors declare that no competing interests exist.
  2. Lu Liu

    Division of Biology and Biological Engineering, California Institute of Technology, Pasadena, United States
    Competing interests
    The authors declare that no competing interests exist.
  3. Chun Lum Andy Ho

    Department of Basic Neurosciences, University of Geneva, Geneva, Switzerland
    Competing interests
    The authors declare that no competing interests exist.
  4. Janis K Hesse

    Division of Biology and Biological Engineering, California Institute of Technology, Pasadena, United States
    Competing interests
    The authors declare that no competing interests exist.
  5. Joseph B Wekselblatt

    Division of Biology and Biological Engineering, California Institute of Technology, Pasadena, United States
    Competing interests
    The authors declare that no competing interests exist.
  6. Francesco Lanfranchi

    Division of Biology and Biological Engineering, California Institute of Technology, Pasadena, United States
    Competing interests
    The authors declare that no competing interests exist.
  7. Daniel Huber

    Department of Basic Neurosciences, University of Geneva, Geneva, Switzerland
    Competing interests
    The authors declare that no competing interests exist.
  8. Doris Y Tsao

    University of California, Berkeley, Berkeley, United States
    For correspondence
    dortsao@berkeley.edu
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0003-1083-1919

Funding

NIH , Howard Hughes Medical Institute

  • Doris Y Tsao

Arnold O. Beckman postdoctoral fellowship, Burroughs Wellcome PDEP Award

  • Francisco J Luongo

Swiss National Science Foundation

  • Daniel Huber

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Ethics

Animal experimentation: The following animals were used in this study: adult mice 2-12 months old, both male and female; adult treeshrews 7-18 months old, both male and female; adult mouse lemurs 2-3.5 yrs, both male and female; and adult macaques 3 and 7 yrs old, male. All procedures on mice, macaques, and tree shrews were conducted in accordance with the ethical guidelines of the National Institutes of Health and were approved by the Institutional Animal Care and Use Committee at the California Institute of Technology.Mouse lemur experiments were in accordance with European animal welfare regulations and were reviewed by the local ethics committee ('Comite d'éthique en expérimentation animale No. 68') in Brunoy, France, by the ethics committee of the University of Geneva, Switzerland and authorized by the French 'Ministère de l'education nationale de l'enseignement supérieur et de la recherche."

Copyright

© 2023, Luongo et al.

This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 3,026
    views
  • 355
    downloads
  • 10
    citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Francisco J Luongo
  2. Lu Liu
  3. Chun Lum Andy Ho
  4. Janis K Hesse
  5. Joseph B Wekselblatt
  6. Francesco Lanfranchi
  7. Daniel Huber
  8. Doris Y Tsao
(2023)
Mice and primates use distinct strategies for visual segmentation
eLife 12:e74394.
https://doi.org/10.7554/eLife.74394

Share this article

https://doi.org/10.7554/eLife.74394

Further reading

    1. Evolutionary Biology
    2. Microbiology and Infectious Disease
    Zach Hensel
    Short Report

    Accurate estimation of the effects of mutations on SARS-CoV-2 viral fitness can inform public-health responses such as vaccine development and predicting the impact of a new variant; it can also illuminate biological mechanisms including those underlying the emergence of variants of concern. Recently, Lan et al. reported a model of SARS-CoV-2 secondary structure and its underlying dimethyl sulfate reactivity data (Lan et al., 2022). I investigated whether base reactivities and secondary structure models derived from them can explain some variability in the frequency of observing different nucleotide substitutions across millions of patient sequences in the SARS-CoV-2 phylogenetic tree. Nucleotide basepairing was compared to the estimated ‘mutational fitness’ of substitutions, a measurement of the difference between a substitution’s observed and expected frequency that is correlated with other estimates of viral fitness (Bloom and Neher, 2023). This comparison revealed that secondary structure is often predictive of substitution frequency, with significant decreases in substitution frequencies at basepaired positions. Focusing on the mutational fitness of C→U, the most common type of substitution, I describe C→U substitutions at basepaired positions that characterize major SARS-CoV-2 variants; such mutations may have a greater impact on fitness than appreciated when considering substitution frequency alone.

    1. Evolutionary Biology
    Yiheng Zhang, Xing Wang ... Xiaoguang Yang
    Research Article

    Although fossil evidence suggests the existence of an early muscular system in the ancient cnidarian jellyfish from the early Cambrian Kuanchuanpu biota (ca. 535 Ma), south China, the mechanisms underlying the feeding and respiration of the early jellyfish are conjectural. Recently, the polyp inside the periderm of olivooids was demonstrated to be a calyx-like structure, most likely bearing short tentacles and bundles of coronal muscles at the edge of the calyx, thus presumably contributing to feeding and respiration. Here, we simulate the contraction and expansion of the microscopic periderm-bearing olivooid Quadrapyrgites via the fluid-structure interaction computational fluid dynamics (CFD) method to investigate their feeding and respiratory activities. The simulations show that the rate of water inhalation by the polyp subumbrella is positively correlated with the rate of contraction and expansion of the coronal muscles, consistent with the previous feeding and respiration hypothesis. The dynamic simulations also show that the frequent inhalation/exhalation of water through the periderm polyp expansion/contraction conducted by the muscular system of Quadrapyrgites most likely represents the ancestral feeding and respiration patterns of Cambrian sedentary medusozoans that predated the rhythmic jet-propelled swimming of the modern jellyfish. Most importantly for these Cambrian microscopic sedentary medusozoans, the increase of body size and stronger capacity of muscle contraction may have been indispensable in the stepwise evolution of active feeding and subsequent swimming in a higher flow (or higher Reynolds number) environment.