A neural mechanism for contextualizing fragmented inputs during naturalistic vision

  1. Daniel Kaiser  Is a corresponding author
  2. Jacopo Turini
  3. Radoslaw M Cichy
  1. University of York, United Kingdom
  2. Freie Universität Berlin, Germany

Abstract

With every glimpse of our eyes, we sample only a small and incomplete fragment of the visual world, which needs to be contextualized and integrated into a coherent scene representation. Here we show that the visual system achieves this contextualization by exploiting spatial schemata, that is our knowledge about the composition of natural scenes. We measured fMRI and EEG responses to incomplete scene fragments and used representational similarity analysis to reconstruct their cortical representations in space and time. We observed a sorting of representations according to the fragments' place within the scene schema, which occurred during perceptual analysis in the occipital place area and within the first 200ms of vision. This schema-based coding operates flexibly across visual features (as measured by a deep neural network model) and different types of environments (indoor and outdoor scenes). This flexibility highlights the mechanism's ability to efficiently organize incoming information under dynamic real-world conditions.

Data availability

Data are publicly available on OSF (http://doi.org/10.17605/OSF.IO/H3G6V), as indicated in the Materials and Methods section of the manuscript.

The following data sets were generated

Article and author information

Author details

  1. Daniel Kaiser

    Department of Psychology, University of York, York, United Kingdom
    For correspondence
    danielkaiser.net@gmail.com
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-9007-3160
  2. Jacopo Turini

    Department of Education and Psychology, Freie Universität Berlin, Berlin, Germany
    Competing interests
    The authors declare that no competing interests exist.
  3. Radoslaw M Cichy

    Department of Education and Psychology, Freie Universität Berlin, Berlin, Germany
    Competing interests
    The authors declare that no competing interests exist.

Funding

Deutsche Forschungsgemeinschaft (KA4683/2-1)

  • Daniel Kaiser

Deutsche Forschungsgemeinschaft (CI241/1-1)

  • Radoslaw M Cichy

Deutsche Forschungsgemeinschaft (CI241/3-1)

  • Radoslaw M Cichy

H2020 European Research Council (ERC-2018-StG 803370)

  • Radoslaw M Cichy

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Ethics

Human subjects: All participants provided informed written consent. All procedures were approved by the ethical committee of the Department of Education and Psychology at Freie Universität Berlin (reference 140/2017) and were in accordance with the Declaration of Helsinki.

Reviewing Editor

  1. Huan Luo, Peking University, China

Publication history

  1. Received: May 3, 2019
  2. Accepted: October 8, 2019
  3. Accepted Manuscript published: October 9, 2019 (version 1)
  4. Version of Record published: October 21, 2019 (version 2)

Copyright

© 2019, Kaiser et al.

This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 1,660
    Page views
  • 250
    Downloads
  • 10
    Citations

Article citation count generated by polling the highest count across the following sources: Crossref, PubMed Central, Scopus.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Daniel Kaiser
  2. Jacopo Turini
  3. Radoslaw M Cichy
(2019)
A neural mechanism for contextualizing fragmented inputs during naturalistic vision
eLife 8:e48182.
https://doi.org/10.7554/eLife.48182

Further reading

    1. Neuroscience
    Brian D Mueller, Sean A Merrill ... Erik M Jorgensen
    Research Article Updated

    Activation of voltage-gated calcium channels at presynaptic terminals leads to local increases in calcium and the fusion of synaptic vesicles containing neurotransmitter. Presynaptic output is a function of the density of calcium channels, the dynamic properties of the channel, the distance to docked vesicles, and the release probability at the docking site. We demonstrate that at Caenorhabditis elegans neuromuscular junctions two different classes of voltage-gated calcium channels, CaV2 and CaV1, mediate the release of distinct pools of synaptic vesicles. CaV2 channels are concentrated in densely packed clusters ~250 nm in diameter with the active zone proteins Neurexin, α-Liprin, SYDE, ELKS/CAST, RIM-BP, α-Catulin, and MAGI1. CaV2 channels are colocalized with the priming protein UNC-13L and mediate the fusion of vesicles docked within 33 nm of the dense projection. CaV2 activity is amplified by ryanodine receptor release of calcium from internal stores, triggering fusion up to 165 nm from the dense projection. By contrast, CaV1 channels are dispersed in the synaptic varicosity, and are colocalized with UNC-13S. CaV1 and ryanodine receptors are separated by just 40 nm, and vesicle fusion mediated by CaV1 is completely dependent on the ryanodine receptor. Distinct synaptic vesicle pools, released by different calcium channels, could be used to tune the speed, voltage-dependence, and quantal content of neurotransmitter release.

    1. Cell Biology
    2. Neuroscience
    Yu Wang, Meghan Lee Arnold ... Barth D Grant
    Research Article Updated

    Caenorhabditis elegans neurons under stress can produce giant vesicles, several microns in diameter, called exophers. Current models suggest that exophers are neuroprotective, providing a mechanism for stressed neurons to eject toxic protein aggregates and organelles. However, little is known of the fate of the exopher once it leaves the neuron. We found that exophers produced by mechanosensory neurons in C. elegans are engulfed by surrounding hypodermal skin cells and are then broken up into numerous smaller vesicles that acquire hypodermal phagosome maturation markers, with vesicular contents gradually degraded by hypodermal lysosomes. Consistent with the hypodermis acting as an exopher phagocyte, we found that exopher removal requires hypodermal actin and Arp2/3, and the hypodermal plasma membrane adjacent to newly formed exophers accumulates dynamic F-actin during budding. Efficient fission of engulfed exopher-phagosomes to produce smaller vesicles and degrade their contents requires phagosome maturation factors SAND-1/Mon1, GTPase RAB-35, the CNT-1 ARF-GAP, and microtubule motor-associated GTPase ARL-8, suggesting a close coupling of phagosome fission and phagosome maturation. Lysosome activity was required to degrade exopher contents in the hypodermis but not for exopher-phagosome resolution into smaller vesicles. Importantly, we found that GTPase ARF-6 and effector SEC-10/exocyst activity in the hypodermis, along with the CED-1 phagocytic receptor, is required for efficient production of exophers by the neuron. Our results indicate that the neuron requires specific interaction with the phagocyte for an efficient exopher response, a mechanistic feature potentially conserved with mammalian exophergenesis, and similar to neuronal pruning by phagocytic glia that influences neurodegenerative disease.