Efficient coding of natural scene statistics predicts discrimination thresholds for grayscale textures

  1. Tiberiu Tesileanu  Is a corresponding author
  2. Mary M Conte
  3. John J Briguglio
  4. Ann M Hermundstad
  5. Jonathan D Victor
  6. Vijay Balasubramanian
  1. Flatiron Institute, United States
  2. Weill Cornell Medical College, United States
  3. Howard Hughes Medical Institute, United States
  4. University of Pennsylvania, United States

Abstract

Previously, in (Hermundstad et al., 2014), we showed that when sampling is limiting, the efficient coding principle leads to a 'variance is salience' hypothesis, and that this hypothesis accounts for visual sensitivity to binary image statistics. Here, using extensive new psychophysical data and image analysis, we show that this hypothesis accounts for visual sensitivity to a large set of grayscale image statistics at a striking level of detail, and also identify the limits of the prediction. We define a 66-dimensional space of local grayscale light-intensity correlations, and measure the relevance of each direction to natural scenes. The 'variance is salience' hypothesis predicts that two-point correlations are most salient, and predicts their relative salience. We tested these predictions in a texture-segregation task using un-natural, synthetic textures. As predicted, correlations beyond second order are not salient, and predicted thresholds for over 300 second-order correlations match psychophysical thresholds closely (median fractional error < 0:13).

Data availability

All the code and data necessary to reproduce the results from the manuscript are available at https://github.com/ttesileanu/TextureAnalysis.

The following previously published data sets were used

Article and author information

Author details

  1. Tiberiu Tesileanu

    Center for Computational Biology, Flatiron Institute, New York, United States
    For correspondence
    ttesileanu@gmail.com
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0003-3107-3088
  2. Mary M Conte

    Brain and Mind Institute, Weill Cornell Medical College, New York, United States
    Competing interests
    The authors declare that no competing interests exist.
  3. John J Briguglio

    Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, United States
    Competing interests
    The authors declare that no competing interests exist.
  4. Ann M Hermundstad

    Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, United States
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-0377-0516
  5. Jonathan D Victor

    Brain and Mind Research Institute and Department of Neurology, Weill Cornell Medical College, New-York, United States
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-9293-0111
  6. Vijay Balasubramanian

    Department of Physics, University of Pennsylvania, Philadelphia, United States
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-6497-3819

Funding

US-Israel Binational Science Foundation (2011058)

  • Vijay Balasubramanian

National Eye Institute (EY07977)

  • Mary M Conte
  • Jonathan D Victor
  • Vijay Balasubramanian

Swartz Foundation

  • Tiberiu Tesileanu

Howard Hughes Medical Institute

  • John J Briguglio
  • Ann M Hermundstad

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Ethics

Human subjects: This work was carried out with the subjects' informed consent, and in accordance with the Code of Ethics of the World Medical Association (Declaration of Helsinki) and the approval of the Institutional Review Board of Weill Cornell. The IRB protocol number is 0904010359.

Copyright

© 2020, Tesileanu et al.

This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 1,498
    views
  • 176
    downloads
  • 20
    citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Tiberiu Tesileanu
  2. Mary M Conte
  3. John J Briguglio
  4. Ann M Hermundstad
  5. Jonathan D Victor
  6. Vijay Balasubramanian
(2020)
Efficient coding of natural scene statistics predicts discrimination thresholds for grayscale textures
eLife 9:e54347.
https://doi.org/10.7554/eLife.54347

Share this article

https://doi.org/10.7554/eLife.54347

Further reading

    1. Neuroscience
    Sharon Inberg, Yael Iosilevskii ... Benjamin Podbilewicz
    Research Article Updated

    Dendrites are crucial for receiving information into neurons. Sensory experience affects the structure of these tree-like neurites, which, it is assumed, modifies neuronal function, yet the evidence is scarce, and the mechanisms are unknown. To study whether sensory experience affects dendritic morphology, we use the Caenorhabditis elegans’ arborized nociceptor PVD neurons, under natural mechanical stimulation induced by physical contacts between individuals. We found that mechanosensory signals induced by conspecifics and by glass beads affect the dendritic structure of the PVD. Moreover, developmentally isolated animals show a decrease in their ability to respond to harsh touch. The structural and behavioral plasticity following sensory deprivation are functionally independent of each other and are mediated by an array of evolutionarily conserved mechanosensory amiloride-sensitive epithelial sodium channels (degenerins). Calcium imaging of the PVD neurons in a micromechanical device revealed that controlled mechanical stimulation of the body wall produces similar calcium dynamics in both isolated and crowded animals. Our genetic results, supported by optogenetic, behavioral, and pharmacological evidence, suggest an activity-dependent homeostatic mechanism for dendritic structural plasticity, that in parallel controls escape response to noxious mechanosensory stimuli.

    1. Neuroscience
    Magdalena Ziółkowska, Narges Sotoudeh ... Kasia Radwanska
    Research Article

    The ability to extinguish contextual fear in a changing environment is crucial for animal survival. Recent data support the role of the thalamic nucleus reuniens (RE) and its projections to the dorsal hippocampal CA1 area (RE→dCA1) in this process. However, it remains poorly understood how RE impacts dCA1 neurons during contextual fear extinction (CFE). Here, we reveal that the RE→dCA1 pathway contributes to the extinction of contextual fear by affecting CFE-induced molecular remodeling of excitatory synapses. Anatomical tracing and chemogenetic manipulation in mice demonstrate that RE neurons form synapses and regulate synaptic transmission in the stratum oriens (SO) and lacunosum-moleculare (SLM) of the dCA1 area, but not in the stratum radiatum (SR). We also observe CFE-specific structural changes of excitatory synapses and expression of the synaptic scaffold protein, PSD-95, in both strata innervated by RE, but not in SR. Interestingly, only the changes in SLM are specific for the dendrites innervated by RE. To further support the role of the RE→dCA1 projection in CFE, we demonstrate that brief chemogenetic inhibition of the RE→dCA1 pathway during a CFE session persistently impairs the formation of CFE memory and CFE-induced changes of PSD-95 levels in SLM. Thus, our data indicate that RE participates in CFE by regulating CFE-induced molecular remodeling of dCA1 synapses.