Magnetic Resonance: Mapping the visual world to the human brain

The visual maps measured non-invasively in the brain of human and non-human primates reliably reflect the underlying neuronal responses recorded with invasive electrodes.
  1. Betina Ip
  2. Holly Bridge  Is a corresponding author
  1. Wellcome Centre for Integrative Neuroimaging, Nuffield Department of Clinical Neurosciences, University of Oxford, United Kingdom

Vision enables many animals to identify objects and, critically, to locate them in space. To achieve this, a reliable internal map of the world is required. In primates, light enters the eye in an ordered way, creating a map interpreted by the receptors in the retina. The information travels through the optic pathway to the visual brain, where it activates neurons depending on the specific location in the visual field. This ‘receptive field’ is the discrete area of space in the external world that a visual neuron responds to (Figure 1A). Receptive fields can vary in size and include a preference for specific properties, such as orientation or colour (Hubel and Wiesel, 1962). They are essential building blocks of our perception, connecting our internal representation to the external world.

Mapping visual space using invasive and non-invasive methods.

(A) In experiments studying how neurons respond to visual stimuli, visual space is mapped using a flickering stimulus (black and white bar) that moves repeatedly across a screen in different directions, while the observer looks at the dot in the centre of the screen (blue). As the bar moves through the red circle, some neurons in the visual brain will become active. The red circle represents the ‘receptive field’ of those neurons. The entire visual space is covered with the receptive fields of different neurons. (B) In the human brain (top), non-invasive brain imaging is used to study the responses of millions of neurons to visual space by measuring changes in blood flow using fMRI (brain image with colours). In the macaque monkey (bottom), it is possible to directly record neuronal activity during visual stimulation using electrodes (measuring action potentials and local field potentials; right). Since non-invasive imaging and direct neural recordings differ both in spatial scale (scale bar at the bottom) and in the origin of the signal (fMRI measures blood flow and oxygen level as a proxy for increased or decreased activity, while electrodes directly measure the electrical activity of neurons), it is challenging to make comparisons between species and determine the validity of the non-invasive human data.

In animal models, receptive fields can be mapped using microelectrodes to record signals from neurons (Figure 1B). Since this type of invasive approach cannot be used in the human brain, it is necessary to use functional magnetic resonance imaging (fMRI), a technique that indirectly measures the activity of millions of neurons across the brain. The fMRI signal reflects the sum of the activity of all the neurons within a cubic volume called a ‘voxel’; an 8 mm3 voxel contains around a million neurons (and fMRI records from thousands of voxels). A human ‘population receptive field’ (pRF) determines the specific region of visual space to which each voxel responds (Dumoulin and Wandell, 2008) and provides a measure comparable to the receptive field of neurons (Figure 1B). However, the fMRI response is an indirect measure of neuronal activity: it records changes in blood flow rather than the electrical activity of neurons. Comparing fMRI data directly to invasive methods is therefore critical to establish whether the fMRI data collected in humans truly reflects the underlying neuronal activity.

Now, in eLife, Christiaan Klink, Xing Chen, Wim Vanduffel and Pieter Roelfsema report that fMRI measurements correspond broadly to direct neuronal recordings (Klink et al., 2021). The team – who are based at the Netherlands Institute for Neuroscience, Amsterdam UMC, KU Leuven Medical School, VU University Amsterdam and Harvard Medical School – first used fMRI to map pRFs across the entire brain in two macaque monkeys. This resulted in clear visual maps of the cortical and subcortical brain regions, comparable to those built out of human data. Using mathematical modelling, Klink et al. determined that responses of neurons were summed non-linearly within each pRF, meaning that different parts of the pRF contributed different amounts to the fMRI output signal. In particular, increasing the stimulus overlap with the pRF did not cause the expected increase in neural response.

Next, Klink et al. analysed multi-unit activity (MUA) data acquired from large, invasive electrode arrays in the visual areas V1 and V4 of two other macaques. These arrays directly measure action potentials from a population of neurons close to each electrode simultaneously. Two analyses were performed: a classical receptive field mapping analysis, using a narrow bar to find the edges of the receptive field (Figure 1A); and a pRF analysis using comparable approaches to the fMRI-based pRF. These yielded similar results, suggesting that the newer pRF technique can be compared to the classical RF technique. Across the two visual areas, receptive fields in V4 were larger than those in V1, reflecting the later stage of processing in V4. The critical result, however, was that the MUA pRFs from both visual areas accurately reflected those derived from the fMRI data.

Klink et al. then analysed pRFs based on local field potentials – the electric potentials in the extracellular space around neurons – recorded simultaneously through all electrodes in the array. While MUA provides information about action potentials in neurons, local field potentials reflect a sum of all electrical activity, both excitatory and inhibitory, including sub-threshold changes not visible in the action potential spike rate (Victor et al., 1994). In many ways, this is more comparable to the fMRI signal, which reflects the oxygen demands of all local activity. Indeed, pRFs derived from local field potentials at specific frequencies that dominate during visual stimulation, also correlated with the fMRI-based pRF, backing previous research suggesting that the change in blood flow correlates best with local field potentials (Logothetis et al., 2001; Berens et al., 2008).

The results of Klink et al. results show that three key features are directly comparable across the three types of pRF measured with invasive and non-invasive approaches. First, all the methods show non-linear summation across the pRF. Second, the size of the pRFs was broadly similar across experiments. Finally, the size of the pRF increases with the distance from where someone is looking. This reflects the high-resolution vision available in the area where someone points their eyes, and the reduction in resolution away from that point. The findings also show that action potentials measured with MUA reflect the fMRI-based pRFs more accurately than the local field potentials, which contrasts with previous studies suggesting that local field potentials better reflect the fMRI signal.

Klink et al. thus show that fMRI and direct neural recordings broadly correspond, indicating that non-invasive brain imaging can reliably reflect receptive fields in the primate brain. Klink et al. exploited the fact that fMRI can measure multiple pRFs across the brain simultaneously to investigate the presence of pRFs outside the visual cortex. It would be valuable to also work in the opposite direction, identifying regions of the brain with interesting or unusual pRF properties for further investigation at a neuronal level. Finally, these spatial maps of the world are present throughout the mammalian visual system, while much of the object identification system is performed in specialised regions. A future challenge will be to apply similar techniques to uncover the mechanisms underlying processing of visual properties such as colour, faces and objects.


Article and author information

Author details

  1. Betina Ip

    Betina Ip is in the Wellcome Centre for Integrative Neuroimaging, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, United Kingdom

    Competing interests
    No competing interests declared
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0003-3544-0711
  2. Holly Bridge

    Holly Bridge is in the Wellcome Centre for Integrative Neuroimaging, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, United Kingdom

    For correspondence
    Competing interests
    No competing interests declared
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-8089-6198

Publication history

  1. Version of Record published: December 3, 2021 (version 1)


© 2021, Ip and Bridge

This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.


  • 743
    Page views
  • 85
  • 0

Article citation count generated by polling the highest count across the following sources: Crossref, PubMed Central, Scopus.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Betina Ip
  2. Holly Bridge
Magnetic Resonance: Mapping the visual world to the human brain
eLife 10:e75171.

Further reading

    1. Genetics and Genomics
    2. Neuroscience
    Yoshifumi Sonobe, Soojin Lee ... Paschalis Kratsios
    Research Article Updated

    A hexanucleotide repeat expansion in C9ORF72 is the most common genetic cause of amyotrophic lateral sclerosis (ALS) and frontotemporal dementia (FTD). A hallmark of ALS/FTD pathology is the presence of dipeptide repeat (DPR) proteins, produced from both sense GGGGCC (poly-GA, poly-GP, poly-GR) and antisense CCCCGG (poly-PR, poly-PG, poly-PA) transcripts. Translation of sense DPRs, such as poly-GA and poly-GR, depends on non-canonical (non-AUG) initiation codons. Here, we provide evidence for canonical AUG-dependent translation of two antisense DPRs, poly-PR and poly-PG. A single AUG is required for synthesis of poly-PR, one of the most toxic DPRs. Unexpectedly, we found redundancy between three AUG codons necessary for poly-PG translation. Further, the eukaryotic translation initiation factor 2D (EIF2D), which was previously implicated in sense DPR synthesis, is not required for AUG-dependent poly-PR or poly-PG translation, suggesting that distinct translation initiation factors control DPR synthesis from sense and antisense transcripts. Our findings on DPR synthesis from the C9ORF72 locus may be broadly applicable to many other nucleotide repeat expansion disorders.

    1. Cell Biology
    2. Neuroscience
    Elisabeth Jongsma, Anita Goyala ... Collin Yvès Ewald
    Research Article Updated

    The amyloid beta (Aβ) plaques found in Alzheimer’s disease (AD) patients’ brains contain collagens and are embedded extracellularly. Several collagens have been proposed to influence Aβ aggregate formation, yet their role in clearance is unknown. To investigate the potential role of collagens in forming and clearance of extracellular aggregates in vivo, we created a transgenic Caenorhabditis elegans strain that expresses and secretes human Aβ1-42. This secreted Aβ forms aggregates in two distinct places within the extracellular matrix. In a screen for extracellular human Aβ aggregation regulators, we identified different collagens to ameliorate or potentiate Aβ aggregation. We show that a disintegrin and metalloprotease a disintegrin and metalloprotease 2 (ADM-2), an ortholog of ADAM9, reduces the load of extracellular Aβ aggregates. ADM-2 is required and sufficient to remove the extracellular Aβ aggregates. Thus, we provide in vivo evidence of collagens essential for aggregate formation and metalloprotease participating in extracellular Aβ aggregate removal.