Magnetic Resonance: Mapping the visual world to the human brain

The visual maps measured non-invasively in the brain of human and non-human primates reliably reflect the underlying neuronal responses recorded with invasive electrodes.
  1. Betina Ip
  2. Holly Bridge  Is a corresponding author
  1. Wellcome Centre for Integrative Neuroimaging, Nuffield Department of Clinical Neurosciences, University of Oxford, United Kingdom

Vision enables many animals to identify objects and, critically, to locate them in space. To achieve this, a reliable internal map of the world is required. In primates, light enters the eye in an ordered way, creating a map interpreted by the receptors in the retina. The information travels through the optic pathway to the visual brain, where it activates neurons depending on the specific location in the visual field. This ‘receptive field’ is the discrete area of space in the external world that a visual neuron responds to (Figure 1A). Receptive fields can vary in size and include a preference for specific properties, such as orientation or colour (Hubel and Wiesel, 1962). They are essential building blocks of our perception, connecting our internal representation to the external world.

Mapping visual space using invasive and non-invasive methods.

(A) In experiments studying how neurons respond to visual stimuli, visual space is mapped using a flickering stimulus (black and white bar) that moves repeatedly across a screen in different directions, while the observer looks at the dot in the centre of the screen (blue). As the bar moves through the red circle, some neurons in the visual brain will become active. The red circle represents the ‘receptive field’ of those neurons. The entire visual space is covered with the receptive fields of different neurons. (B) In the human brain (top), non-invasive brain imaging is used to study the responses of millions of neurons to visual space by measuring changes in blood flow using fMRI (brain image with colours). In the macaque monkey (bottom), it is possible to directly record neuronal activity during visual stimulation using electrodes (measuring action potentials and local field potentials; right). Since non-invasive imaging and direct neural recordings differ both in spatial scale (scale bar at the bottom) and in the origin of the signal (fMRI measures blood flow and oxygen level as a proxy for increased or decreased activity, while electrodes directly measure the electrical activity of neurons), it is challenging to make comparisons between species and determine the validity of the non-invasive human data.

In animal models, receptive fields can be mapped using microelectrodes to record signals from neurons (Figure 1B). Since this type of invasive approach cannot be used in the human brain, it is necessary to use functional magnetic resonance imaging (fMRI), a technique that indirectly measures the activity of millions of neurons across the brain. The fMRI signal reflects the sum of the activity of all the neurons within a cubic volume called a ‘voxel’; an 8 mm3 voxel contains around a million neurons (and fMRI records from thousands of voxels). A human ‘population receptive field’ (pRF) determines the specific region of visual space to which each voxel responds (Dumoulin and Wandell, 2008) and provides a measure comparable to the receptive field of neurons (Figure 1B). However, the fMRI response is an indirect measure of neuronal activity: it records changes in blood flow rather than the electrical activity of neurons. Comparing fMRI data directly to invasive methods is therefore critical to establish whether the fMRI data collected in humans truly reflects the underlying neuronal activity.

Now, in eLife, Christiaan Klink, Xing Chen, Wim Vanduffel and Pieter Roelfsema report that fMRI measurements correspond broadly to direct neuronal recordings (Klink et al., 2021). The team – who are based at the Netherlands Institute for Neuroscience, Amsterdam UMC, KU Leuven Medical School, VU University Amsterdam and Harvard Medical School – first used fMRI to map pRFs across the entire brain in two macaque monkeys. This resulted in clear visual maps of the cortical and subcortical brain regions, comparable to those built out of human data. Using mathematical modelling, Klink et al. determined that responses of neurons were summed non-linearly within each pRF, meaning that different parts of the pRF contributed different amounts to the fMRI output signal. In particular, increasing the stimulus overlap with the pRF did not cause the expected increase in neural response.

Next, Klink et al. analysed multi-unit activity (MUA) data acquired from large, invasive electrode arrays in the visual areas V1 and V4 of two other macaques. These arrays directly measure action potentials from a population of neurons close to each electrode simultaneously. Two analyses were performed: a classical receptive field mapping analysis, using a narrow bar to find the edges of the receptive field (Figure 1A); and a pRF analysis using comparable approaches to the fMRI-based pRF. These yielded similar results, suggesting that the newer pRF technique can be compared to the classical RF technique. Across the two visual areas, receptive fields in V4 were larger than those in V1, reflecting the later stage of processing in V4. The critical result, however, was that the MUA pRFs from both visual areas accurately reflected those derived from the fMRI data.

Klink et al. then analysed pRFs based on local field potentials – the electric potentials in the extracellular space around neurons – recorded simultaneously through all electrodes in the array. While MUA provides information about action potentials in neurons, local field potentials reflect a sum of all electrical activity, both excitatory and inhibitory, including sub-threshold changes not visible in the action potential spike rate (Victor et al., 1994). In many ways, this is more comparable to the fMRI signal, which reflects the oxygen demands of all local activity. Indeed, pRFs derived from local field potentials at specific frequencies that dominate during visual stimulation, also correlated with the fMRI-based pRF, backing previous research suggesting that the change in blood flow correlates best with local field potentials (Logothetis et al., 2001; Berens et al., 2008).

The results of Klink et al. results show that three key features are directly comparable across the three types of pRF measured with invasive and non-invasive approaches. First, all the methods show non-linear summation across the pRF. Second, the size of the pRFs was broadly similar across experiments. Finally, the size of the pRF increases with the distance from where someone is looking. This reflects the high-resolution vision available in the area where someone points their eyes, and the reduction in resolution away from that point. The findings also show that action potentials measured with MUA reflect the fMRI-based pRFs more accurately than the local field potentials, which contrasts with previous studies suggesting that local field potentials better reflect the fMRI signal.

Klink et al. thus show that fMRI and direct neural recordings broadly correspond, indicating that non-invasive brain imaging can reliably reflect receptive fields in the primate brain. Klink et al. exploited the fact that fMRI can measure multiple pRFs across the brain simultaneously to investigate the presence of pRFs outside the visual cortex. It would be valuable to also work in the opposite direction, identifying regions of the brain with interesting or unusual pRF properties for further investigation at a neuronal level. Finally, these spatial maps of the world are present throughout the mammalian visual system, while much of the object identification system is performed in specialised regions. A future challenge will be to apply similar techniques to uncover the mechanisms underlying processing of visual properties such as colour, faces and objects.

References

Article and author information

Author details

  1. Betina Ip

    Betina Ip is in the Wellcome Centre for Integrative Neuroimaging, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, United Kingdom

    Competing interests
    No competing interests declared
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0003-3544-0711
  2. Holly Bridge

    Holly Bridge is in the Wellcome Centre for Integrative Neuroimaging, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, United Kingdom

    For correspondence
    holly.bridge@ndcn.ox.ac.uk
    Competing interests
    No competing interests declared
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-8089-6198

Publication history

  1. Version of Record published: December 3, 2021 (version 1)

Copyright

© 2021, Ip and Bridge

This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 779
    Page views
  • 86
    Downloads
  • 1
    Citations

Article citation count generated by polling the highest count across the following sources: PubMed Central, Crossref, Scopus.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Betina Ip
  2. Holly Bridge
(2021)
Magnetic Resonance: Mapping the visual world to the human brain
eLife 10:e75171.
https://doi.org/10.7554/eLife.75171

Further reading

    1. Neuroscience
    Harry Clark, Matthew F Nolan
    Research Article

    Grid firing fields have been proposed as a neural substrate for spatial localisation in general or for path integration in particular. To distinguish these possibilities, we investigate firing of grid and non-grid cells in the mouse medial entorhinal cortex during a location memory task. We find that grid firing can either be anchored to the task environment, or can encode distance travelled independently of the task reference frame. Anchoring varied between and within sessions, while spatial firing of non-grid cells was either coherent with the grid population, or was stably anchored to the task environment. We took advantage of the variability in task-anchoring to evaluate whether and when encoding of location by grid cells might contribute to behaviour. We find that when reward location is indicated by a visual cue, performance is similar regardless of whether grid cells are task-anchored or not, arguing against a role for grid representations when location cues are available. By contrast, in the absence of the visual cue, performance was enhanced when grid cells were anchored to the task environment. Our results suggest that anchoring of grid cells to task reference frames selectively enhances performance when path integration is required.

    1. Cell Biology
    2. Neuroscience
    Zhenyong Wu, Grant F Kusick ... Shigeki Watanabe
    Research Article

    Despite decades of intense study, the molecular basis of asynchronous neurotransmitter release remains enigmatic. Synaptotagmin (syt) 7 and Doc2 have both been proposed as Ca2+ sensors that trigger this mode of exocytosis, but conflicting findings have led to controversy. Here, we demonstrate that at excitatory mouse hippocampal synapses, Doc2α is the major Ca2+ sensor for asynchronous release, while syt7 supports this process through activity-dependent docking of synaptic vesicles. In synapses lacking Doc2α, asynchronous release after single action potentials is strongly reduced, while deleting syt7 has no effect. However, in the absence of syt7, docked vesicles cannot be replenished on millisecond timescales. Consequently, both synchronous and asynchronous release depress from the second pulse onward during repetitive activity. By contrast, synapses lacking Doc2α have normal activity-dependent docking, but continue to exhibit decreased asynchronous release after multiple stimuli. Moreover, disruption of both Ca2+ sensors is non-additive. These findings result in a new model whereby syt7 drives activity-dependent docking, thus providing synaptic vesicles for synchronous (syt1) and asynchronous (Doc2 and other unidentified sensors) release during ongoing transmission.