A compositional neural code in high-level visual cortex can explain jumbled word reading

  1. Aakash Agrawal
  2. KVS Hari
  3. SP Arun  Is a corresponding author
  1. Indian Institute of Science, Bangalore, India

Abstract

We read jubmled wrods effortlessly, but the neural correlates of this remarkable ability remain poorly understood. We hypothesized that viewing a jumbled word activates a visual representation that is compared to known words. To test this hypothesis, we devised a purely visual model in which neurons tuned to letter shape respond to longer strings in a compositional manner by linearly summing letter responses. We found that dissimilarities between letter strings in this model can explain human performance on visual search, and responses to jumbled words in word reading tasks. Brain imaging revealed that viewing a string activates this letter-based code in the lateral occipital (LO) region and that subsequent comparisons to stored words are consistent with activations of the visual word form area (VWFA). Thus, a compositional neural code potentially contributes to efficient reading.

Data availability

Data and code necessary to reproduce the results are available in an Open Science Framework repository at https://osf.io/384zw/

The following data sets were generated
    1. VisionLabIISc
    (2020) jumbledwordsfMRI
    Open Science Framework, 384zw.

Article and author information

Author details

  1. Aakash Agrawal

    Centre for BioSystems Science and Engineering, Indian Institute of Science, Bangalore, Bangalore, India
    Competing interests
    The authors declare that no competing interests exist.
  2. KVS Hari

    Department of Electrical Communication Engineering, Indian Institute of Science, Bangalore, Bangalore, India
    Competing interests
    The authors declare that no competing interests exist.
  3. SP Arun

    Centre for Neuroscience, Indian Institute of Science, Bangalore, Bangalore, India
    For correspondence
    sparun@iisc.ac.in
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0001-9602-5066

Funding

Wellcome Trust/DBT India Alliance (IA/S/17/1/503081)

  • SP Arun

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Ethics

Human subjects: All subjects gave informed consent to an experimental protocol approved by the Institutional Human Ethics Committee of the Indian Institute of Science (IHEC # 6-15092017).

Copyright

© 2020, Agrawal et al.

This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 4,122
    views
  • 463
    downloads
  • 28
    citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Aakash Agrawal
  2. KVS Hari
  3. SP Arun
(2020)
A compositional neural code in high-level visual cortex can explain jumbled word reading
eLife 9:e54846.
https://doi.org/10.7554/eLife.54846

Share this article

https://doi.org/10.7554/eLife.54846

Further reading

    1. Neuroscience
    Lisa Reisinger, Gianpaolo Demarchi ... Nathan Weisz
    Research Article

    Phantom perceptions like tinnitus occur without any identifiable environmental or bodily source. The mechanisms and key drivers behind tinnitus are poorly understood. The dominant framework, suggesting that tinnitus results from neural hyperactivity in the auditory pathway following hearing damage, has been difficult to investigate in humans and has reached explanatory limits. As a result, researchers have tried to explain perceptual and potential neural aberrations in tinnitus within a more parsimonious predictive-coding framework. In two independent magnetoencephalography studies, participants passively listened to sequences of pure tones with varying levels of regularity (i.e. predictability) ranging from random to ordered. Aside from being a replication of the first study, the pre-registered second study, including 80 participants, ensured rigorous matching of hearing status, as well as age, sex, and hearing loss, between individuals with and without tinnitus. Despite some changes in the details of the paradigm, both studies equivalently reveal a group difference in neural representation, based on multivariate pattern analysis, of upcoming stimuli before their onset. These data strongly suggest that individuals with tinnitus engage anticipatory auditory predictions differently to controls. While the observation of different predictive processes is robust and replicable, the precise neurocognitive mechanism underlying it calls for further, ideally longitudinal, studies to establish its role as a potential contributor to, and/or consequence of, tinnitus.

    1. Neuroscience
    Sam E Benezra, Kripa B Patel ... Randy M Bruno
    Research Article

    Learning alters cortical representations and improves perception. Apical tuft dendrites in cortical layer 1, which are unique in their connectivity and biophysical properties, may be a key site of learning-induced plasticity. We used both two-photon and SCAPE microscopy to longitudinally track tuft-wide calcium spikes in apical dendrites of layer 5 pyramidal neurons in barrel cortex as mice learned a tactile behavior. Mice were trained to discriminate two orthogonal directions of whisker stimulation. Reinforcement learning, but not repeated stimulus exposure, enhanced tuft selectivity for both directions equally, even though only one was associated with reward. Selective tufts emerged from initially unresponsive or low-selectivity populations. Animal movement and choice did not account for changes in stimulus selectivity. Enhanced selectivity persisted even after rewards were removed and animals ceased performing the task. We conclude that learning produces long-lasting realignment of apical dendrite tuft responses to behaviorally relevant dimensions of a task.