Reconstructing someone else’s attentional state is of central importance in theory of mind (Baron-Cohen, 1997; Calder et al., 2002; Graziano, 2013). By identifying the object of someone else’s attention, and having some intuitive understanding of the complex dynamics and consequences of attention, one can reconstruct at least some of the other person’s likely thoughts, intentions, and emotions, and make predictions about that person’s behavior. Almost all work on how people reconstruct the attention of others has focused on gaze direction. For example, the human eye has a high contrast between pupil and sclera, possibly an adaptation for better gaze tracking (Kobayashi and Kohshima, 1997). The superior temporal sulcus in monkeys and humans may contain specialized neural circuitry for processing gaze direction (Hoffman and Haxby, 2000; Marquardt et al., 2017; Perrett et al., 1985; Puce et al., 1998; Wicker et al., 1998). Seeing a face gaze at an object automatically draws one’s own attention to the object (Friesen and Kingstone, 1998; Frischen et al., 2007). These and other findings show the importance of reconstructing gaze direction in social cognition.

To be adaptive in aiding theory of mind, however, a model of attention should be far more than a vector indicating gaze direction. We previously suggested that the human brain constructs a rich, dynamic, and predictive model of other people’s attention (Graziano, 2019; Graziano, 2013; Graziano and Kastner, 2011). The model should contain information about different types of attention, about the rapidity or sluggishness with which attention tends to move from item to item, about how external factors such as salience and clutter are likely to affect a person’s attention, and about how attention profoundly affects thought, memory, and behavior. In the proposal, that deeper model is constrained by incoming information, including gaze direction. However, other cues can also constrain the model. People rely on the other person’s body posture, on cues in the surrounding environment, on speech, and on social context. For example, blind people must be able to build models of other people’s attention without seeing the other person’s eyes. Likewise, during a phone conversation, we cannot see the other person and yet we intuitively understand whether that person is attending to what we have said or is distracted by her own words or by a salient event on her end of the line.

Several recent experiments provide evidence for an automatically constructed model of the attention of others that may go beyond merely registering gaze direction (Guterstam et al., 2019; Guterstam and Graziano, 2020a; Kelly et al., 2014; Pesquita et al., 2016; Randall and Guterstam, 2020; Vernet et al., 2019). For example, Pesquita et al., 2016 found that when participants watch an actor in a video attending to an object, the participants implicitly distinguish between whether the actor’s attention was drawn to the object exogenously (bottom-up or stimulus-driven attention), or whether the actor endogenously shifted attention to the object (top-down or internally driven attention). Exogenous and endogenous attention are the two principal ways in which selective attention moves between objects. They are emphasized in distinct cortical networks (the ventral and dorsal attention networks), and they influence the behavior of agents in profoundly different manners (Corbetta et al., 2008; Corbetta and Shulman, 2002; Posner, 1980; Shulman et al., 2010). The ability to distinguish between someone else’s exogenous and endogenous attention is therefore one example of how people may construct a rich, dynamic, and useful model of other people’s attention beyond merely encoding gaze direction or identifying the object of attention.

Inspired by the vignette-style tasks widely used in studies on theory of mind (Fletcher et al., 1995; Gallagher et al., 2000; Happé, 1994; Saxe and Kanwisher, 2003; Vogeley et al., 2001), in the present study, we used functional magnetic resonance imaging (fMRI) and multi-voxel pattern analysis (MVPA) to study brain activity in participants while they read brief stories about people’s attention (Figure 1). Some of the stories implied that attention was being attracted exogenously (‘Kevin walks into his closet and notices the bright red tie…') and some stories implied that attention was being directed endogenously (‘Kevin walks into his closet and looks for the bright red tie…'). We also included analogous stories written in the first person, casting the subject of the experiment as the agent (‘You walk into your closet and notice the bright red tie…'). The study therefore used a 2 × 2 design (exogenous versus endogenous attention X self agent versus other agent). Finally, we included a fifth, control condition, consisting of nonsocial stories in which the agent was replaced by an inanimate object, that, like attention, has a source and a target, such as a camera or a light source (‘In a closet, a light shines on a red tie…').

Figure 1

Download asset Open asset

We made four predictions. Our first, central prediction was inspired by the Pesquita et al., 2016 study described above. We hypothesized that participants would encode the type of attention in the story (exogenous versus endogenous), and that this encoding would be evident in some subset of the areas classically involved in theory of mind. Previous experiments on theory of mind typically recruited a network of cortical areas including the temporoparietal junction (TPJ), the superior temporal sulcus (STS), the medial prefrontal cortex (MPFC), and the precuneus (Gallagher et al., 2000; Saxe and Kanwisher, 2003; van Veluw and Chance, 2014; Vogeley et al., 2001). This first prediction, that the social cognition network will encode the exogenous-versus-endogenous distinction, represents the main, novel contribution of this study. Previous studies have used MVPA to decode various aspects of other people’s mental states from activity in social brain areas, such as their beliefs (Koster-Hale et al., 2017), intentions (Koster-Hale et al., 2013), and perceptual source (Koster-Hale et al., 2014). To the best of our knowledge, this investigation is the first to test whether activity in social brain areas can decode other people’s attentional states.

Our second prediction was that participants would encode information about the agent in the story (self versus other), and that this encoding would again be evident in some subset of the areas classically involved in theory of mind. Self-versus-other encoding has been examined in previous studies, and found to be reflected in the theory-of-mind network (e.g. Northoff et al., 2006; Ochsner et al., 2004; Passingham et al., 2010; Qin and Northoff, 2011; van Veluw and Chance, 2014). This second prediction represents a test of whether our present paradigm, using subtle wording differences between similar sentences, can produce results consistent with previous findings.

Third, we predicted that participants would encode information associated with the interaction between the two factors. We predicted that at least some subset of the areas in the theory-of-mind network may encode the type of attention (exogenous versus endogenous) to a different extent in self-related stories as compared to other-related stories.

Fourth and finally, we tested for brain regions that encoded the distinction between social stories (with human agents) and nonsocial stories (with only non-agent objects). We predicted that this social-versus-nonsocial encoding would again be evident in the same network of brain regions noted above, that are known to be involved in theory of mind. This final analysis served as a control to check on the validity of the story stimuli and confirm that they engaged social cognition as expected.

This study analyzed brain activity while people read stories about agents attending to objects in the environment. We examined whether specific brain areas could decode information about the type of attention referenced in the story (exogenous versus endogenous), and about the type of agent in the story (whether the agent was the subject reading the story or a different person). We hypothesized that if the brain constructs a model of attentional state that is used in social cognition, then areas of the brain known to be involved in social cognition should be able to distinguish between the two types of attention, exogenous and endogenous, represented in the stories. Our main analysis confirmed the hypothesis: the left TPJ showed significant decoding of information about endogenous versus exogenous attention. The finding is, arguably, remarkable, given that the semantic and wording difference between the two story types is extremely subtle.

These results support a new and growing body of evidence that the human brain constructs a model of attention to aid in theory of mind (Guterstam et al., 2019; Guterstam and Graziano, 2020b; Kelly et al., 2014; Pesquita et al., 2016; Vernet et al., 2019). The model includes information about attention that is deeper and more complex than just gaze direction or an identification of the attended object. At least one aspect of attention incorporated into the model appears to be the manner in which attention moves to an object: endogenously (internally directed) or exogenously (externally induced). The processing of the model appears to engage the theory-of-mind cortical network. The left TPJ showed the strongest decoding result.

Why should the TPJ in particular have shown involvement in decoding someone else’s attention state, rather than areas in the STS that are known for responding to the gaze direction of others (Marquardt et al., 2017)? As noted in the Introduction, we suggest that modeling someone else’s attention, and processing someone else’s gaze direction, are not the same. Gaze is only one of many cues that can be integrated to constrain a model of someone else’s attention. In Kelly et al., 2014, in a task in which participants judged the attention state of a cartoon, the TPJ was not active in association with gaze direction, and also not active in association with facial expression; but both left and right TPJ were active in association with the integration of the two cues, gaze and expression, in order to judge the cartoon’s attentional state. The current finding of significant decoding in the left TPJ is consistent with that prior finding.

It is not clear why the left hemisphere showed stronger activity than the right in the present task. Social cognition tasks often activate the TPJ bilaterally, but typically engage the right TPJ more (Saxe and Wexler, 2005). One speculation is that some aspect of the present task, perhaps explicitly instructing people that the task was a test of reading comprehension, caused an emphasis on linguistic processing, biasing the activity toward the left hemisphere. Other explanations for the left-hemisphere bias may also be possible.

One alternative interpretation of the present finding in the TPJ is that people simulated attention orienting when reading the stories, and activated the corresponding dorsal (endogenous) and ventral (exogenous) attention networks in a ‘mirror-neuron-like’ fashion. Under this hypothesis, the TPJ, as part of the ventral attention network, was activated when reading the exogenous stories, and the dorsal attention network (consisting of the frontal eye fields, intraparietal sulcus, and middle temporal complex) should be active in association with reading the endogenous stories (Corbetta et al., 2008; Corbetta and Shulman, 2002; Fox et al., 2006). However, a control analysis showed that none of these dorsal attention network regions significantly decoded information concerning the attention type in the stories (Figure 3—figure supplement 6), which is incompatible with the attention-orienting simulation account of the TPJ result. Our findings are thus more consistent with the notion that the TPJ is involved in constructing a rich, perhaps implicit model of attention that may assist in social cognition (Graziano and Kastner, 2011; Guterstam et al., 2020; Guterstam and Graziano, 2020a; Kelly et al., 2014). We are not suggesting, however, that the possible involvement of the TPJ in modeling one’s own and others’ attention, and the involvement of the TPJ in the control of attention, is a coincidence. We suggested in previous work (Graziano and Webb, 2015) that a rich model of attention may be of benefit in the control of attention.

A second, alternative interpretation of the present results is that the exogenous sentences might make the reader focus more on the object in the story (thus engaging less mentalizing), whereas the endogenous sentences might make the reader focus more on the character’s mental act of attending (thus engaging more mentalizing). In that interpretation, the TPJ shows a significant decoding result because it becomes more active in the endogenous story type, due to more mentalizing cognition. Although this possible explanation of the TPJ decoding results is difficult to exclude, we believe it is unlikely. First, if endogenous stories simply engaged more mentalizing than exogenous stories, and thus caused more activity in the TPJ, our univariate analysis should have found more activity in the TPJ to endogenous stories. It did not (see Supplementary file 5). We found no evidence that a simple difference in the amount of mentalizing between exogenous and endogenous stories affected the overall amount of activity in the TPJ or anywhere else in the brain. Although the pattern of activity in the left TPJ clearly contains information about the exogenous-endogenous distinction, that information is not in the form of a simple increase in activity during the endogenous stories. Second, it is not clear that subjects should mentalize more in the endogenous story type than in the exogenous story type. When reading that ‘Alice looks for the red ball,’ subjects might wonder why, and think about Alice’s mental state. When reading that ‘Alice notices the red ball,’ subjects might again wonder why the ball was of enough significance to be capturing her notice, or what mental reaction she experiences when noticing that apparently unanticipated object. Both story types invite mentalizing, alhough one focuses on an endogenous process of attention and the other on exogenous attention. Third, the probe task was designed to limit readers from speculating too much about the deeper meaning of the stories by asking only about literal details and never about the internal states of the characters. Thus, the subjects had an incentive to focus on the same physical aspects of the story in both the exogenous and endogenous conditions. Fourth, and finally, prior studies suggest that if an experimental and a control story both include human agents with potential thoughts, then subjects automatically mentalize in both story types, and the contrast between the story types will tend not to show a differential degree of activity in theory-of-mind cortical areas, especially in the TPJ (Saxe and Kanwisher, 2003). It is likely that, in our case, subjects cannot help mentalizing about the characters in both story types. We acknowledge that any story stimuli are always so complex that a variety of unintended, subtle differences may affect the results, but for the reasons listed here, we argue that a difference in the overall amount of mentalizing during endogenous versus exogenous stories is unlikely to explain the present results in the TPJ. The results point to the left TPJ processing different information in the exogenous and endogenous story types, but not a difference in overall amount of activity.

In addition to the endogenous-versus-exogenous comparisons, we also analyzed brain areas involved in self-versus-other encoding. We found evidence of self-versus-other encoding in the left TPJ, left STS, MPFC, and precuneus. The MPFC and precuneus have been previously implicated in self processing (Northoff et al., 2006; Ochsner et al., 2004; Passingham et al., 2010; Qin and Northoff, 2011; van Veluw and Chance, 2014), and the TPJ is consistently activated in fMRI studies involving self-recognition (van Veluw and Chance, 2014) and first-person perspective taking (Ionta et al., 2011). These results lend confidence to the present paradigm, showing that even the very subtle differences between our story stimuli were able to reveal cortical results consistent with previous studies.

Contrary to our prediction 3, we found no evidence for an interaction between attention type and agent type decoding in the theory-of-mind ROIs. (As noted in the Supplementary Information, during an exploratory searchlight analysis, we also found no evidence of an interaction effect in any other brain area.) Although it is possible that our paradigm was simply not sensitive enough to detect subtle interaction effects, these results suggest that the brain encodes information about attention type in a similar manner in the self and in others. In light of previous results showing that the attribution of sensory awareness to others and to oneself have a shared representation in the TPJ (Kelly et al., 2014), we directly tested this notion in a post hoc cross-classification analysis focusing on the left TPJ, which was the only region showing significant decoding of attention type. We found that endogenous-versus-exogenous decoding significantly generalized across self-stories and other-stories (Figure 3—figure supplement 7), suggesting that there is an overlap in brain mechanisms that participate in the encoding of attention in others and in encoding of attention in the self.

Finally, significant decoding of the social-versus-nonsocial distinction was obtained across most of the theory-of-mind ROIs. This finding confirmed the validity of the paradigm, and was expected based on previous experiments of the theory-of-mind network (Gallagher et al., 2000; Saxe and Kanwisher, 2003; van Veluw and Chance, 2014; Vogeley et al., 2001).

The use of a story-reading paradigm allowed us to systematically manipulate the kind of attention represented in the stimulus while keeping other experimental factors close to identical. The endogenous and exogenous story versions differed only with respect to a few key words specifying the type of attention, while the rest of the stories were semantically the same. The absence of any univariate effect within the ROIs or anywhere else in the brain, even at a liberal uncorrected threshold, confirm that the stimuli were well matched (Supplementary file 5). To avoid cognitive bias or expectation effects, the probe task performed by the subjects concerned details about the spatial context or the objects in the stories, effectively distracting subjects from the description of attention. We also speculate that this design of the probe task minimized the theoretical risk of the reader focusing on slightly different aspects of the story in the endogenous and exogenous conditions (e.g. focusing more on the mental act of attending in endogenous stories, and more on the attention-grabbing object in the exogenous stories), because the task ‘forced’ the reader to focus on processing the spatial context and the object descriptions equally in both conditions. A post-scan questionnaire confirmed that none of the subjects came close to figuring out the purpose of the experiment (which they had been told was a ‘Reading Comprehension Experiment’). The finding of brain areas that significantly decoded the type of attention, despite the distinction between endogenous and exogenous attention being subtle and task-irrelevant, suggests that the human brain automatically, and possibly also implicitly (Pesquita et al., 2016), constructs a model of an agents’ attention that specifies at least some dynamic aspects of how that attention is moving around the scene.

The data that support the findings of this study are available at https://figshare.com/s/c3463d15bc78106a1b5c (https://doi.org/10.6084/m9.figshare.12273128).

1. 1. Guterstam A

   (2021) figshare

   Temporo-Parietal Cortex Involved in Modeling One's Own and Others' Attention.

   https://doi.org/10.6084/m9.figshare.12273128.v1

1. 1. Abraham A
   2. Pedregosa F
   3. Eickenberg M
   4. Gervais P
   5. Mueller A
   6. Kossaifi J
   7. Gramfort A
   8. Thirion B
   9. Varoquaux G

   (2014) Machine learning for neuroimaging with scikit-learn

   Frontiers in Neuroinformatics 8:14.

   https://doi.org/10.3389/fninf.2014.00014

   • PubMed
   • Google Scholar
2. 1. Avants BB
   2. Epstein CL
   3. Grossman M
   4. Gee JC

   (2008) Symmetric diffeomorphic image registration with cross-correlation: evaluating automated labeling of elderly and neurodegenerative brain

   Medical Image Analysis 12:26–41.

   https://doi.org/10.1016/j.media.2007.06.004

   • PubMed
   • Google Scholar
3. Book

   1. Baron-Cohen S

   (1997) Mindblindness: An Essay on Autism and Theory of Mind

   MIT Press.

   https://doi.org/10.1016/S0166-2236(96)60013-7

   • Google Scholar
4. 1. Benjamini Y
   2. Hochberg Y

   (1995) Controlling the false discovery rate: a practical and powerful approach to multiple testing

   Journal of the Royal Statistical Society: Series B 57:289–300.

   https://doi.org/10.1111/j.2517-6161.1995.tb02031.x

   • Google Scholar
5. 1. Brainard DH

   (1997) The psychophysics toolbox

   Spatial Vision 10:433–436.

   https://doi.org/10.1163/156856897X00357

   • PubMed
   • Google Scholar
6. 1. Bzdok D
   2. Langner R
   3. Schilbach L
   4. Jakobs O
   5. Roski C
   6. Caspers S
   7. Laird AR
   8. Fox PT
   9. Zilles K
   10. Eickhoff SB

   (2013) Characterization of the temporo-parietal junction by combining data-driven parcellation, complementary connectivity analyses, and functional decoding

   NeuroImage 81:381–392.

   https://doi.org/10.1016/j.neuroimage.2013.05.046

   • PubMed
   • Google Scholar
7. 1. Calder AJ
   2. Lawrence AD
   3. Keane J
   4. Scott SK
   5. Owen AM
   6. Christoffels I
   7. Young AW

   (2002) Reading the mind from eye gaze

   Neuropsychologia 40:1129–1138.

   https://doi.org/10.1016/S0028-3932(02)00008-8

   • PubMed
   • Google Scholar
8. 1. Corbetta M
   2. Patel G
   3. Shulman GL

   (2008) The reorienting system of the human brain: from environment to theory of mind

   Neuron 58:306–324.

   https://doi.org/10.1016/j.neuron.2008.04.017

   • PubMed
   • Google Scholar
9. 1. Corbetta M
   2. Shulman GL

   (2002) Control of goal-directed and stimulus-driven attention in the brain

   Nature Reviews Neuroscience 3:201–215.

   https://doi.org/10.1038/nrn755

   • PubMed
   • Google Scholar
10. 1. Cox RW

    (1996) AFNI: software for analysis and visualization of functional magnetic resonance neuroimages

    Computers and Biomedical Research 29:162–173.

    https://doi.org/10.1006/cbmr.1996.0014

    • PubMed
    • Google Scholar
11. 1. Esteban O
    2. Markiewicz CJ
    3. Blair RW
    4. Moodie CA
    5. Isik AI
    6. Erramuzpe A
    7. Kent JD
    8. Goncalves M
    9. DuPre E
    10. Snyder M
    11. Oya H
    12. Ghosh SS
    13. Wright J
    14. Durnez J
    15. Poldrack RA
    16. Gorgolewski KJ

    (2019) fMRIPrep: a robust preprocessing pipeline for functional MRI

    Nature Methods 16:111–116.

    https://doi.org/10.1038/s41592-018-0235-4

    • PubMed
    • Google Scholar
12. 1. Fletcher PC
    2. Happé F
    3. Frith U
    4. Baker SC
    5. Dolan RJ
    6. Frackowiak RS
    7. Frith CD

    (1995) Other minds in the brain: a functional imaging study of "theory of mind" in story comprehension

    Cognition 57:109–128.

    https://doi.org/10.1016/0010-0277(95)00692-R

    • PubMed
    • Google Scholar
13. 1. Fonov VS
    2. Evans AC
    3. McKinstry RC
    4. Almli CR
    5. Collins DL

    (2009) Unbiased nonlinear average age-appropriate brain templates from birth to adulthood

    NeuroImage 47:S102.

    https://doi.org/10.1016/S1053-8119(09)70884-5

    • Google Scholar
14. 1. Fox MD
    2. Corbetta M
    3. Snyder AZ
    4. Vincent JL
    5. Raichle ME

    (2006) Spontaneous neuronal activity distinguishes human dorsal and ventral attention systems

    PNAS 103:10046–10051.

    https://doi.org/10.1073/pnas.0604187103

    • PubMed
    • Google Scholar
15. 1. Friesen CK
    2. Kingstone A

    (1998) The eyes have it! reflexive orienting is triggered by nonpredictive gaze

    Psychonomic Bulletin & Review 5:490–495.

    https://doi.org/10.3758/BF03208827

    • Google Scholar
16. 1. Frischen A
    2. Bayliss AP
    3. Tipper SP

    (2007) Gaze cueing of attention

    Psychological Bulletin 133:694–724.

    https://doi.org/10.1037/0033-2909.133.4.694

    • Google Scholar
17. 1. Friston KJ
    2. Holmes AP
    3. Worsley KJ
    4. Poline J-P
    5. Frith CD
    6. Frackowiak RSJ

    (1994) Statistical parametric maps in functional imaging: a general linear approach

    Human Brain Mapping 2:189–210.

    https://doi.org/10.1002/hbm.460020402

    • Google Scholar
18. 1. Gallagher HL
    2. Happé F
    3. Brunswick N
    4. Fletcher PC
    5. Frith U
    6. Frith CD

    (2000) Reading the mind in cartoons and stories: an fMRI study of 'theory of mind' in verbal and nonverbal tasks

    Neuropsychologia 38:11–21.

    https://doi.org/10.1016/S0028-3932(99)00053-6

    • PubMed
    • Google Scholar
19. 1. Gorgolewski K
    2. Burns CD
    3. Madison C
    4. Clark D
    5. Halchenko YO
    6. Waskom ML
    7. Ghosh SS

    (2011) Nipype: a flexible, lightweight and extensible neuroimaging data processing framework in Python

    Frontiers in Neuroinformatics 5:13.

    https://doi.org/10.3389/fninf.2011.00013

    • PubMed
    • Google Scholar
20. Book

    1. Graziano MS

    (2013)

    Consciousness and the Social Brain

    Oxford University Press.

    • Google Scholar
21. 1. Graziano MS

    (2019)

    Attributing awareness to others: the attention schema theory and its relationship to behavioural prediction

    Journal of Consciousness Studies : Controversies in Science & the Humanities 26:17–37.

    • Google Scholar
22. 1. Graziano MS
    2. Kastner S

    (2011) Human consciousness and its relationship to social neuroscience: a novel hypothesis

    Cognitive Neuroscience 2:98–113.

    https://doi.org/10.1080/17588928.2011.565121

    • PubMed
    • Google Scholar
23. 1. Graziano MS
    2. Webb TW

    (2015) The attention schema theory: a mechanistic account of subjective awareness

    Frontiers in Psychology 6:500.

    https://doi.org/10.3389/fpsyg.2015.00500

    • PubMed
    • Google Scholar
24. 1. Greve DN
    2. Fischl B

    (2009) Accurate and robust brain image alignment using boundary-based registration

    NeuroImage 48:63–72.

    https://doi.org/10.1016/j.neuroimage.2009.06.060

    • PubMed
    • Google Scholar
25. 1. Guterstam A
    2. Kean HH
    3. Webb TW
    4. Kean FS
    5. Graziano MSA

    (2019) Implicit model of other people's visual attention as an invisible, force-carrying beam projecting from the eyes

    PNAS 116:328–333.

    https://doi.org/10.1073/pnas.1816581115

    • PubMed
    • Google Scholar
26. 1. Guterstam A
    2. Wilterson AI
    3. Wachtell D
    4. Graziano MSA

    (2020) Other people's gaze encoded as implied motion in the human brain

    PNAS 117:13162–13167.

    https://doi.org/10.1073/pnas.2003110117

    • PubMed
    • Google Scholar
27. 1. Guterstam A
    2. Graziano MSA

    (2020a) Visual motion assists in social cognition

    PNAS 117:32165–32168.

    https://doi.org/10.1073/pnas.2021325117

    • PubMed
    • Google Scholar
28. 1. Guterstam A
    2. Graziano MSA

    (2020b) Implied motion as a possible mechanism for encoding other people's attention

    Progress in Neurobiology 190:101797.

    https://doi.org/10.1016/j.pneurobio.2020.101797

    • PubMed
    • Google Scholar
29. 1. Happé FG

    (1994) An advanced test of theory of mind: understanding of story characters' thoughts and feelings by able autistic, mentally handicapped, and normal children and adults

    Journal of Autism and Developmental Disorders 24:129–154.

    https://doi.org/10.1007/BF02172093

    • PubMed
    • Google Scholar
30. 1. Hassabis D
    2. Chu C
    3. Rees G
    4. Weiskopf N
    5. Molyneux PD
    6. Maguire EA

    (2009) Decoding neuronal ensembles in the human Hippocampus

    Current Biology 19:546–554.

    https://doi.org/10.1016/j.cub.2009.02.033

    • PubMed
    • Google Scholar
31. 1. Haxby JV
    2. Gobbini MI
    3. Furey ML
    4. Ishai A
    5. Schouten JL
    6. Pietrini P

    (2001) Distributed and overlapping representations of faces and objects in ventral temporal cortex

    Science 293:2425–2430.

    https://doi.org/10.1126/science.1063736

    • PubMed
    • Google Scholar
32. 1. Hebart MN
    2. Görgen K
    3. Haynes JD

    (2014) The decoding toolbox (TDT): a versatile software package for multivariate analyses of functional imaging data

    Frontiers in Neuroinformatics 8:88.

    https://doi.org/10.3389/fninf.2014.00088

    • PubMed
    • Google Scholar
33. 1. Hoffman EA
    2. Haxby JV

    (2000) Distinct representations of eye gaze and identity in the distributed human neural system for face perception

    Nature Neuroscience 3:80–84.

    https://doi.org/10.1038/71152

    • PubMed
    • Google Scholar
34. 1. Ionta S
    2. Heydrich L
    3. Lenggenhager B
    4. Mouthon M
    5. Fornari E
    6. Chapuis D
    7. Gassert R
    8. Blanke O

    (2011) Multisensory mechanisms in temporo-parietal cortex support self-location and first-person perspective

    Neuron 70:363–374.

    https://doi.org/10.1016/j.neuron.2011.03.009

    • PubMed
    • Google Scholar
35. 1. Jenkinson M
    2. Bannister P
    3. Brady M
    4. Smith S

    (2002) Improved optimization for the robust and accurate linear registration and motion correction of brain images

    NeuroImage 17:825–841.

    https://doi.org/10.1006/nimg.2002.1132

    • PubMed
    • Google Scholar
36. 1. Kelly YT
    2. Webb TW
    3. Meier JD
    4. Arcaro MJ
    5. Graziano MS

    (2014) Attributing awareness to oneself and to others

    PNAS 111:5012–5017.

    https://doi.org/10.1073/pnas.1401201111

    • PubMed
    • Google Scholar
37. 1. Kobayashi H
    2. Kohshima S

    (1997) Unique morphology of the human eye

    Nature 387:767–768.

    https://doi.org/10.1038/42842

    • PubMed
    • Google Scholar
38. 1. Koster-Hale J
    2. Saxe R
    3. Dungan J
    4. Young LL

    (2013) Decoding moral judgments from neural representations of intentions

    PNAS 110:5648–5653.

    https://doi.org/10.1073/pnas.1207992110

    • PubMed
    • Google Scholar
39. 1. Koster-Hale J
    2. Bedny M
    3. Saxe R

    (2014) Thinking about seeing: perceptual sources of knowledge are encoded in the theory of mind brain regions of sighted and blind adults

    Cognition 133:65–78.

    https://doi.org/10.1016/j.cognition.2014.04.006

    • PubMed
    • Google Scholar
40. 1. Koster-Hale J
    2. Richardson H
    3. Velez N
    4. Asaba M
    5. Young L
    6. Saxe R

    (2017) Mentalizing regions represent distributed, continuous, and abstract dimensions of others' beliefs

    NeuroImage 161:9–18.

    https://doi.org/10.1016/j.neuroimage.2017.08.026

    • PubMed
    • Google Scholar
41. 1. Kriegeskorte N
    2. Goebel R
    3. Bandettini P

    (2006) Information-based functional brain mapping

    PNAS 103:3863–3868.

    https://doi.org/10.1073/pnas.0600244103

    • PubMed
    • Google Scholar
42. 1. Logothetis NK
    2. Pauls J
    3. Augath M
    4. Trinath T
    5. Oeltermann A

    (2001) Neurophysiological investigation of the basis of the fMRI signal

    Nature 412:150–157.

    https://doi.org/10.1038/35084005

    • PubMed
    • Google Scholar
43. 1. Mar RA

    (2011) The neural bases of social cognition and story comprehension

    Annual Review of Psychology 62:103–134.

    https://doi.org/10.1146/annurev-psych-120709-145406

    • PubMed
    • Google Scholar
44. 1. Marquardt K
    2. Ramezanpour H
    3. Dicke PW
    4. Thier P

    (2017) Following eye gaze activates a patch in the posterior temporal cortex that is not part of the human "Face Patch" System

    Eneuro 4:ENEURO.0317-16.2017.

    https://doi.org/10.1523/ENEURO.0317-16.2017

    • PubMed
    • Google Scholar
45. 1. Mars RB
    2. Sallet J
    3. Schüffelgen U
    4. Jbabdi S
    5. Toni I
    6. Rushworth MF

    (2012) Connectivity-based subdivisions of the human right "temporoparietal junction area": evidence for different areas participating in different cortical networks

    Cerebral Cortex 22:1894–1903.

    https://doi.org/10.1093/cercor/bhr268

    • PubMed
    • Google Scholar
46. 1. Misaki M
    2. Kim Y
    3. Bandettini PA
    4. Kriegeskorte N

    (2010) Comparison of multivariate classifiers and response normalizations for pattern-information fMRI

    NeuroImage 53:103–118.

    https://doi.org/10.1016/j.neuroimage.2010.05.051

    • PubMed
    • Google Scholar
47. 1. Molenberghs P
    2. Johnson H
    3. Henry JD
    4. Mattingley JB

    (2016) Understanding the minds of others: a neuroimaging meta-analysis

    Neuroscience & Biobehavioral Reviews 65:276–291.

    https://doi.org/10.1016/j.neubiorev.2016.03.020

    • PubMed
    • Google Scholar
48. 1. Nakagawa S
    2. Cuthill IC

    (2007) Effect size, confidence interval and statistical significance: a practical guide for biologists

    Biological Reviews 82:591–605.

    https://doi.org/10.1111/j.1469-185X.2007.00027.x

    • PubMed
    • Google Scholar
49. 1. Northoff G
    2. Heinzel A
    3. de Greck M
    4. Bermpohl F
    5. Dobrowolny H
    6. Panksepp J

    (2006) Self-referential processing in our brain--a meta-analysis of imaging studies on the self

    NeuroImage 31:440–457.

    https://doi.org/10.1016/j.neuroimage.2005.12.002

    • PubMed
    • Google Scholar
50. 1. Ochsner KN
    2. Knierim K
    3. Ludlow DH
    4. Hanelin J
    5. Ramachandran T
    6. Glover G
    7. Mackey SC

    (2004) Reflecting upon feelings: an fMRI study of neural systems supporting the attribution of emotion to self and other

    Journal of Cognitive Neuroscience 16:1746–1772.

    https://doi.org/10.1162/0898929042947829

    • PubMed
    • Google Scholar
51. 1. Passingham RE
    2. Bengtsson SL
    3. Lau HC

    (2010) Medial frontal cortex: from self-generated action to reflection on one's own performance

    Trends in Cognitive Sciences 14:16–21.

    https://doi.org/10.1016/j.tics.2009.11.001

    • PubMed
    • Google Scholar
52. 1. Perrett DI
    2. Smith PA
    3. Potter DD
    4. Mistlin AJ
    5. Head AS
    6. Milner AD
    7. Jeeves MA

    (1985) Visual cells in the temporal cortex sensitive to face view and gaze direction

    Proceedings of the Royal Society of London. Series B, Biological Sciences 223:293–317.

    https://doi.org/10.1098/rspb.1985.0003

    • PubMed
    • Google Scholar
53. 1. Pesquita A
    2. Chapman CS
    3. Enns JT

    (2016) Humans are sensitive to attention control when predicting others' actions

    PNAS 113:8669–8674.

    https://doi.org/10.1073/pnas.1601872113

    • PubMed
    • Google Scholar
54. 1. Poldrack RA

    (2007) Region of interest analysis for fMRI

    Social Cognitive and Affective Neuroscience 2:67–70.

    https://doi.org/10.1093/scan/nsm006

    • PubMed
    • Google Scholar
55. 1. Posner MI

    (1980) Orienting of attention

    Quarterly Journal of Experimental Psychology 32:3–25.

    https://doi.org/10.1080/00335558008248231

    • Google Scholar
56. 1. Puce A
    2. Allison T
    3. Bentin S
    4. Gore JC
    5. McCarthy G

    (1998) Temporal cortex activation in humans viewing eye and mouth movements

    The Journal of Neuroscience 18:2188–2199.

    https://doi.org/10.1523/JNEUROSCI.18-06-02188.1998

    • PubMed
    • Google Scholar
57. 1. Qin P
    2. Northoff G

    (2011) How is our self related to midline regions and the default-mode network?

    NeuroImage 57:1221–1233.

    https://doi.org/10.1016/j.neuroimage.2011.05.028

    • PubMed
    • Google Scholar
58. Preprint

    1. Randall W
    2. Guterstam A

    (2020) A motion aftereffect from viewing other people’s gaze

    bioRxiv.

    https://doi.org/10.1101/2020.11.08.373308

    • Google Scholar
59. 1. Saxe R
    2. Kanwisher N

    (2003) People thinking about thinking people the role of the temporo-parietal junction in "theory of mind"

    NeuroImage 19:1835–1842.

    https://doi.org/10.1016/S1053-8119(03)00230-1

    • PubMed
    • Google Scholar
60. 1. Saxe R
    2. Wexler A

    (2005) Making sense of another mind: the role of the right temporo-parietal junction

    Neuropsychologia 43:1391–1399.

    https://doi.org/10.1016/j.neuropsychologia.2005.02.013

    • PubMed
    • Google Scholar
61. Conference

    1. Schneider B
    2. Pao Y
    3. Pea RD

    (2013)

    Predicting students’ Learning Outcomes Using Eye-Tracking Data

    Learn Anal Knowl Conference.

    • Google Scholar
62. 1. Schurz M
    2. Radua J
    3. Aichhorn M
    4. Richlan F
    5. Perner J

    (2014) Fractionating theory of mind: a meta-analysis of functional brain imaging studies

    Neuroscience & Biobehavioral Reviews 42:9–34.

    https://doi.org/10.1016/j.neubiorev.2014.01.009

    • PubMed
    • Google Scholar
63. 1. Shulman GL
    2. Pope DL
    3. Astafiev SV
    4. McAvoy MP
    5. Snyder AZ
    6. Corbetta M

    (2010) Right hemisphere dominance during spatial selective attention and target detection occurs outside the dorsal frontoparietal network

    Journal of Neuroscience 30:3640–3651.

    https://doi.org/10.1523/JNEUROSCI.4085-09.2010

    • PubMed
    • Google Scholar
64. 1. Tustison NJ
    2. Avants BB
    3. Cook PA
    4. Zheng Y
    5. Egan A
    6. Yushkevich PA
    7. Gee JC

    (2010) N4ITK: improved N3 Bias correction

    IEEE Transactions on Medical Imaging 29:1310–1320.

    https://doi.org/10.1109/TMI.2010.2046908

    • PubMed
    • Google Scholar
65. 1. van Veluw SJ
    2. Chance SA

    (2014) Differentiating between self and others: an ALE meta-analysis of fMRI studies of self-recognition and theory of mind

    Brain Imaging and Behavior 8:24–38.

    https://doi.org/10.1007/s11682-013-9266-8

    • PubMed
    • Google Scholar
66. 1. Vernet M
    2. Japee S
    3. Lokey S
    4. Ahmed S
    5. Zachariou V
    6. Ungerleider LG

    (2019) Endogenous visuospatial attention increases visual awareness independent of visual discrimination sensitivity

    Neuropsychologia 128:297–304.

    https://doi.org/10.1016/j.neuropsychologia.2017.08.015

    • PubMed
    • Google Scholar
67. 1. Vogeley K
    2. Bussfeld P
    3. Newen A
    4. Herrmann S
    5. Happé F
    6. Falkai P
    7. Maier W
    8. Shah NJ
    9. Fink GR
    10. Zilles K

    (2001) Mind reading: neural mechanisms of theory of mind and self-perspective

    NeuroImage 14:170–181.

    https://doi.org/10.1006/nimg.2001.0789

    • PubMed
    • Google Scholar
68. 1. Wicker B
    2. Michel F
    3. Henaff MA
    4. Decety J

    (1998) Brain regions involved in the perception of gaze: a PET study

    NeuroImage 8:221–227.

    https://doi.org/10.1006/nimg.1998.0357

    • PubMed
    • Google Scholar
69. 1. Zhang Y
    2. Brady M
    3. Smith S

    (2001) Segmentation of brain MR images through a hidden markov random field model and the expectation-maximization algorithm

    IEEE Transactions on Medical Imaging 20:45–57.

    https://doi.org/10.1109/42.906424

    • PubMed
    • Google Scholar

Acceptance summary:

This paper reports the novel finding that fMRI activity patterns in the left TPJ distinguish between stories in which an agent endogenously versus exogenously attends to an object. The experimental design is straightforward and elegant, using tightly-controlled comparisons. The findings suggest that brain regions implicated in theory-of-mind represent a model of another person's attentional state.

Decision letter after peer review:

Thank you for submitting your article "Temporo-Parietal Cortex Involved in Modeling One's Own and Others' Attention" for consideration by eLife. Your article has been reviewed by three peer reviewers, one of whom is a member of our Board of Reviewing Editors, and the evaluation has been overseen by Michael Frank as the Senior Editor. The following individual involved in review of your submission has agreed to reveal their identity: Anthony Atkinson (Reviewer #3).

The reviewers have discussed the reviews with one another and the Reviewing Editor has drafted this decision to help you prepare a revised submission.

We would like to draw your attention to changes in our revision policy that we have made in response to COVID-19 (https://elifesciences.org/articles/57162). Specifically, when editors judge that a submitted work as a whole belongs in eLife but that some conclusions require a modest amount of additional new data, we are asking that the manuscript be revised to either limit claims to those supported by data in hand, or to explicitly state that the relevant conclusions require additional supporting data.

Summary:

This fMRI study tested whether theory-of-mind (ToM) regions differentially represent information about endogenous and exogenous attention of the self and of another person. Participants read short passages that described themselves or another person deliberately attending to or having their attention drawn to an object. The main finding was that activity patterns in left TPJ allowed for decoding endogenous vs. exogenous attention (collapsed across self and other). This finding indicates a role for the left TPJ in modelling attentional states.

Revisions for this paper:

Motivation and interpretation:

1) Considering that the study decodes mental states (here: attentional states) in ToM areas, as described in stories, please review work similarly decoding mental states in these regions (e.g., work by Koster-Hale, Saxe). How is your study similar or different from previous work decoding mental states? Do results follow from these previous studies? I also missed a review of (and integration with) the literature on endogenous vs exogenous attention itself (e.g., ventral vs dorsal attention network).

2) It was not clear from the Introduction why you hypothesized that exo vs endo attention should be decodable in TPJ. Is this where eye gaze direction – which appeared to have motivated the study – can be decoded from? The study cited for this hypothesis (Kelly et al., 2014; reanalysed in Igelstrom et al., 2016) showed that univariate activity in TPJ reflected the difficulty of social attribution, which does not obviously lead to the current hypothesis.

3) Does the main finding reflect a model of others' attention or differences in mental state attribution: sentences describing endogenous attention focus the reader more on the mental act of attending and might also induce further mentalizing (e.g., the reader may wonder: "why would he decide to look for that object?"). In exogenous sentences, the focus of the sentence is instead more strongly on the attention-grabbing object (e.g., "the bright red tie"). Can this alternative interpretation be excluded?

4) Searchlight analysis for exogenous v. endogenous attention: Is the cluster centred at -59, -47, 5, labelled left posterior STS (TPJ), really TPJ? It is, after all, squarely in the temporal lobe and some distance (22mm) from the centre of the left TPJ ROI, the latter being in left angular gyrus (areas PGa and PFm). Do you have some independent justification for the labelling of the location of this cluster as TPJ? For example, perhaps it lies within the anterior TPJ (TPJa) subregion identified by Mars et al. (Cerebral Cortex 2012)? The posterior STS area from the searchlight analysis seems to fall into the "gaze-following patch" in the posterior STS as reported by Marquardt et al., 2017. Since this cortical area is not generally considered to be a part of the theory of mind network, the seeming involvement of this area potentially changes the interpretation of the results.

Additional analyses:

5) Please report and compare accuracy and RTs for the response to the probe statement. If either differs between conditions, then that becomes a potential confound for the between condition contrasts in the MVPA analyses, considering that the BOLD response to the story and probe events could not be separated.

6) The TPJ is introduced in the context of theory of mind and social cognition, but it has also been implicated in attentional orienting. Could it be the case that participants simulate such orienting when reading the stories, leading to the above-chance decoding in TPJ? If this is the case, one may similarly expect above-chance decoding in areas that have been implicated in endogenous attention. This should be tested by including dorsal attention network ROIs. Above-chance decoding in such attention regions may inform the interpretation of the TPJ results.

7) Please provide univariate activity estimates, both in the ROIs and in whole-brain contrasts. This may help to interpret the multivariate results.

Further support for main finding:

8) The reported decoding accuracy values are really quite small and close to 50% (chance), especially for the endogenous vs. exogenous and self vs. other contrasts, even those values that are statistically significant. Please report appropriate effect sizes and the confidence intervals around those effect sizes (for all your reported t-tests, not just those that are statistically significant). It would also be informative if you were to include in your graphs the individual subject data (e.g., mean decoding accuracy per subject for each ROI) and/or plots of the effect sizes and their distributions. For more on effect sizes, their CIs and associated plots, I point you to the following sources and the references therein:

https://thenewstatistics.com/itns

https://thenewstatistics.com/itns/2019/05/20/reply-to-lakens-the-correctly-used-p-value-needs-an-effect-size-and-ci/

https://www.estimationstats.com/

9) The authors computed the attentional state decoding separately for "self" and "other". These decoding accuracies did not differ. Please also provide and test the accuracies of self and other separately; this would shed light on the reliability of the main result (which was collapsed across the two conditions) and might also indicate whether the decoding was more reliable (less variable) in self or other.

10) Replicate results in one or multiple additional ToM TPJ ROIs. Reviewers raised two suggestions: 1) Surface-based ROI: the TPJ is a highly anatomically variable cortical region that isn't well approximated by a single volume ROI (see Croxson et al., 2017). There are many surface-based ROIs now available that mitigate the effect of this variability, including ones from the authors' own lab. 2) Use a different meta-analysis: The used meta-analysis defines “theory of mind” solely in terms of false-belief tasks (van Veluw and Chance, 2014), which may not be appropriate for delineating the ROIs and their exact locations in your study. Different types of ToM task reliably activate different brain areas, as well as common ones (mPFC and bilateral TPJ: Molenberghs et al., Neuroscience and Biobehavioral Review 2016). Consider using the results of a different meta-analysis, e.g., one that identifies regions based on the conjunction of multiple types of theory-of-mind tasks (e.g., Mar, Annual Review of Psychology 2011; Molenberghs et al., 2016; Schurz et al., Neuroscience and Biobehavioral Reviews 2014).

11) In previous work (Kelly et al., 2014), the authors were interested in an overlap between attention in self and other. Here, this could be addressed in a cross-decoding analysis, training a classifier on exo vs endo in the "self" stories and testing this on the "other" stories. Above-chance classification in this analysis would strengthen the evidence for lTPJ involvement and would provide additional information that would help interpreting the TPJ findings.

[Editors' note: further revisions were suggested prior to acceptance, as described below.]

Thank you for submitting your article "Temporo-Parietal Cortex Involved in Modeling One's Own and Others' Attention" for consideration by eLife. Your article has been reviewed by two peer reviewers, one of whom is a member of our Board of Reviewing Editor, and the evaluation has been overseen by Michael Frank as the Senior Editor. The reviewers have opted to remain anonymous.

The reviewers have discussed their reviews with one another, and the Reviewing Editor has drafted this to help you prepare a revised submission.

Summary:

Both reviewers noted that many of their concerns were addressed. However, they each had one remaining concern that would need to be addressed.

Essential Revisions:

1) Please report and analyze the univariate activity in the ROIs

2) More fully report (in main Results section) and discuss the searchlight results.

Reviewer #1:

The authors have addressed many of my concerns. In particular, the additional TPJ ROIs and the demonstration of self-other cross-decoding increased my confidence in the main finding of attention state decoding in lTPJ.

One comment has not been sufficiently addressed, however: it would be highly relevant and informative to see the average univariate activity for each of the conditions in the 6 original ROIs, plotted in a graph. The endo>exo contrast should be tested, correcting for the 6 ROIs, similar to how the decoding accuracies are tested (i.e., with the same p<0.05 cut-off). This ROI-based univariate analysis is also interesting for other comparisons, e.g. to test whether the social conditions gave higher activity than the non-social condition, as would be expected based on previous work. Thus, please provide a full univariate analysis on average ROI activity.

There is a lot of interesting information in the Supplementary figures (e.g., searchlight, additional ROIs), which will not be visible when viewing or printing pdfs. You could consider moving some of this to the main text, or add panels to existing figures where you include some of this information.

Reviewer #2:

In this revised manuscript, the authors have greatly clarified some key points, most important of which was how well matched the behavior was across all of the conditions. While there is still a potential confound in the social vs. non-social contrast given the difference in reaction time, (a) the confound effects are likely negligible in size, (b) the end result matches the previous literature, and (c) the contrast was only a control analysis and doesn't greatly affect the main point of the paper. However, the handling of the left posterior STS result in the searchlight analysis remains problematic, both in the manuscript and in the author's response.

pSTS response and discussion: The main point of the manuscript is to examine whether known theory of mind areas contain information that differentiates between the endogenous vs. exogenous story conditions. The revised manuscript makes quite clear that the answer is yes, activity in the L TPJ differentiates between the two conditions, albeit with a relatively low decoding accuracy. The fact that multiple versions of the L TPJ ROI produces the same result is particularly reassuring. The spotlight analysis, however, finds that there is potentially more discriminatory information to be found in the posterior STS/middle temporal gyrus, and this is where the manuscript runs into problems.

In the revised manuscript, this result is simply not mentioned, though it clearly has implications for the interpretations of the result as mentioned in the previous round of reviews. In addition, in the response to the reviewers' comments, the authors give a very convoluted and confusing argument based on MNI coordinates that somehow this focus is somehow (a) part of the TPJ and (b) may be a part of the attention-related TPJa as opposed to their TPJp ROI. In the process of saying that the surface projections are misleading, they state that the focus as falling on the STG on the surface projection, when it is really on the MTG. In addition, they base their arguments on MNI coordinates, but MNI coordinates are notoriously inaccurate in comparing results from different studies, so the author's attempts to justify their conclusions using these coordinates falls flat. The authors own volume images very clearly show the focus as being in the STS and not on either the angular gyrus or supramarginal gyrus that Mars, Corbetta, and others have generally shown the TPJp and TPJa to fall on. And even if this focus was in the TPJa, as the authors seem to hint at, they do not discuss the implications of this result.

The authors' defensiveness around this point is frankly puzzling. The searchlight results do not seem to invalidate their main point, only potentially augment it. The fact that the posterior STS (and what seem to be the right FEF and iPCS areas) exhibit higher discriminability between the endo and exo conditions may not be shocking given that the theory of mind areas are likely involved in many operations in this task, whereas the pSTS and right hemisphere areas likely may only be involved in just the imagined attention/sensory processing aspects of the task. It is possible that these areas are "reading out" the differing attentional conditions from the L TPJ. Whatever the explanation may be, the authors seem to be trying to bury this result to shoehorn the results into fitting their a priori model, which is a disservice and misleading to the readers, and needs to be rectified before the manuscript can be published. My recommendation is to at least mention the searchlight results in the main Results section, then add a paragraph to the Discussion discussing the implications of these results. Better yet would be to quantify the discrimination accuracy within each of the foci uncovered in the spotlight analyses.

Revisions for this paper:

Motivation and interpretation:

1) Considering that the study decodes mental states (here: attentional states) in ToM areas, as described in stories, please review work similarly decoding mental states in these regions (e.g., work by Koster-Hale, Saxe). How is your study similar or different from previous work decoding mental states? Do results follow from these previous studies? I also missed a review of (and integration with) the literature on endogenous vs exogenous attention itself (e.g., ventral vs dorsal attention network).

We thank the reviewers for these relevant suggestions. The work in our lab has focused on how people construct models of their own and others’ attention, an area of modeling mental states that is relatively less well studied. We now cite and briefly review previous relevant work using MVPA to decode various aspects of other people’s mental state, such as their beliefs (Koster-Hale et al., 2017), intentions (Koster-Hale et al., 2013), and perceptual source (Koster-Hale et al., 2014), from activity patterns in the theory of mind network. We also clarify what we believe distinguishes the current study from earlier ones. From the fifth paragraph of the Introduction:

“This first prediction, that the social cognition network will encode the exogenous-versus-endogenous distinction, represents the main, novel contribution of this study. Previous studies have used MVPA to decode various aspects of other people’s mental states from activity in social brain areas, such as their beliefs (Koster-Hale et al., 2017), intentions (Koster-Hale et al., 2013), and perceptual source (Koster-Hale et al., 2014). To the best of our knowledge, this investigation is the first to test whether activity in social brain areas can decode other people’s attentional states.”

We also added a brief review of endogenous versus exogenous attention in the revised Introduction (paragraph three):

“For example, Pesquita et al. (2016) found that when participants watch an actor in a video attending to an object, the participants implicitly distinguish between whether the actor’s attention was drawn to the object exogenously (bottom-up, or stimulus-driven attention), or whether the actor endogenously shifted attention to the object (top-down, or internally driven attention). Exogenous and endogenous attention are the two principal ways in which selective attention moves between objects. They may be relatively emphasized in distinct cortical networks (the ventral and dorsal attention networks), and they influence the behavior of agents in profoundly different manners (Corbetta et al., 2008; Corbetta and Shulman, 2002; Posner, 1980; Shulman et al., 2010). The ability to distinguish between someone else’s exogenous and endogenous attention is therefore one example of how people may construct a rich, dynamic, and useful model of other people’s attention beyond merely encoding gaze direction or identifying the object of attention.”

2) It was not clear from the Introduction why you hypothesized that exo vs endo attention should be decodable in TPJ. Is this where eye gaze direction – which appeared to have motivated the study – can be decoded from? The study cited for this hypothesis (Kelly et al., 2014; reanalysed in Igelstrom et al., 2016) showed that univariate activity in TPJ reflected the difficulty of social attribution, which does not obviously lead to the current hypothesis.

We thank the reviewers for allowing us to clarify the rationale behind our central Prediction 1. First, we would like to stress that the wording of Prediction 1 emphasized that we expected above-chance decoding in “some subset” of theory-of-mind areas, not only in the TPJ:

“We hypothesized that participants would encode the type of attention in the story (exogenous versus endogenous), and that this encoding would be evident in some subset of the areas classically involved in theory of mind. […] We therefore predicted that the exogenous-versus-endogenous distinction would be significantly encoded in some subset of these areas.”

In accordance with this prediction, we tested exogenous-versus-endogenous decoding in each of the six ROIs and corrected for multiple comparisons across all ROIs.

We also anticipated that, among the theory-of-mind areas, the TPJ might show the clearest evidence of attention type decoding, based on the results of Kelly et al. (2014). Kelly et al. (2014) is particularly relevant to our study because it identified areas showing greater activity when the social attribution of an attentional state to a cartoon face is more difficult, while controlling for factors such as the direction of gaze, emotional valence, and low-level visual features. An important underlying concept in our current work is that modeling someone else’s attention, and processing someone else’s gaze direction, are not the same. Gaze is only one cue to someone else’s attention. In Kelly et al. (2014), we found that the TPJ was not active in association with gaze, and also not active in association with facial expression; but was active in association with a task in which subjects integrated both gaze and expression in order to judge the attentional state of someone else. Considering that the task in Kelly et al. (2014) engaged the TPJ bilaterally, but none of the other theory-of-mind regions investigated here (i.e., STS, precuneus, and MPFC), we anticipated the TPJ might be more likely than the other theory-of-mind ROIs to be involved in encoding attention type. As discussed more in detail in our response to point #4 below, the TPJ region investigated here, which was defined based on studies of theory of mind reasoning, is spatially separated (by 2 cm) from the location of the gaze-following patch within the STS.

To address the reviewers’ concern, we removed the statement in the Introduction that predicts an effect specifically in the TPJ. Instead, in the Introduction, we confine Prediction 1 to a more cautious statement, predicting that the exogenous-versus-endogenous distinction should be significantly encoded in at least some subset of the ROIs representing the ToM cortical network.

In the revised Discussion section, we added a paragraph (third paragraph) discussing the reasons why the TPJ may have been a special focus of activity here. In that paragraph, we describe more fully why Kelly et al. (2014) is consistent with this finding.

3) Does the main finding reflect a model of others' attention or differences in mental state attribution: sentences describing endogenous attention focus the reader more on the mental act of attending and might also induce further mentalizing (e.g., the reader may wonder: "why would he decide to look for that object?"). In exogenous sentences, the focus of the sentence is instead more strongly on the attention-grabbing object (e.g., "the bright red tie"). Can this alternative interpretation be excluded?

This is an important point that we thought deeply about when constructing the story stimuli. The short answer is that the alternative interpretation can’t be entirely excluded, but we believe it is unlikely. We now address it explicitly in the sixth paragraph of the Discussion section:

“A second, alternative interpretation of the present results is that the exogenous sentences might make the reader focus more on the object in the story (thus engaging less mentalizing), whereas the endogenous sentences might make the reader focus more on the character’s mental act of attending (thus engaging more mentalizing). […] The results point to the left TPJ processing different information in the exogenous and endogenous story types, but not a difference in overall amount of activity.”

4) Searchlight analysis for exogenous v. endogenous attention: Is the cluster centred at -59, -47, 5, labelled left posterior STS (TPJ), really TPJ? It is, after all, squarely in the temporal lobe and some distance (22mm) from the centre of the left TPJ ROI, the latter being in left angular gyrus (areas PGa and PFm). Do you have some independent justification for the labelling of the location of this cluster as TPJ? For example, perhaps it lies within the anterior TPJ (TPJa) subregion identified by Mars et al. (Cerebral Cortex 2012)? The posterior STS area from the searchlight analysis seems to fall into the "gaze-following patch" in the posterior STS as reported by Marquardt et al. 2017. Since this cortical area is not generally considered to be a part of the theory of mind network, the seeming involvement of this area potentially changes the interpretation of the results.

We very much appreciate the reviewers bringing this issue of neuroanatomy to our attention, and for directing us to the Mars et al. (2012) paper. First, we would like to emphasize that the anatomical localization of the Searchlight decoding clusters was based on the projection of the clusters onto sections of the average structural scan generated from the 32 subjects. The projection of volumetric results onto a 3D canonical brain surface is an approximate and imperfect process, and was here used for visualization purposes only. To better clarify the three-dimensional location of the left posterior STS cluster in the endogenous-vs-exogenous Searchlight analysis, we have now included all three sections in the bottom part of Figure 3—figure supplement 3

As can be seen in Figure 3—figure supplement 3, the cluster lies entirely in the posterior section of the STS (and not on the STG, which one might guess from looking at the brain surface projection). As the reviewers point out, the peak of the Searchlight cluster (MNI: -59, -47, 5) is anterior-inferior with respect to the center of our left TPJ ROI (MNI: -52, -56, 24). However, do they belong to the same or different TPJ subregions? According to the connectivity-based TPJ subdivision proposed by Mars et al. (2012), the border between the anterior (TPJa) and posterior TPJ (TPJp) within the posterior STS is somewhere between the MNI y-coordinates -40 and -48 (see Figure 3a in Mars et al.; unfortunately, a more precise definition in terms of MNI coordinates are not reported). Our TPJ ROI is clearly located in TPJp. The Searchlight cluster is likely located in TPJp but very close to the border of TPJa, given that the Searchlight cluster peak is 3 mm closer to the center of gravity for TPJp compared to TPJa (23 mm vs 26 mm). This anatomical labelling is in accordance with another functional TPJ parcellation (Bzdok et al. 2013), in which the TPJp within STS starts at the MNI y-coordinate -47 (see Figure 2 in Bzdok et al. 2013).

It should be noted that both the Mars et al. (2012) and Bzdok et al. (2013) TPJ characterizations are based on the right TPJ. However, the TPJ has a known hemispheric asymmetry regarding functional specialization (Seghier, 2013), neurological lesion effects (Corbetta et al., 2000), functional (Uddin et al., 2010) and anatomical (Caspers et al., 2011) connectivity, as well as cytoarchitectonic borders and gyral pattern (Caspers et al., 2006, 2008). The proposed TPJa and TPJp subdivisions may therefore not directly apply to the left TPJ, and should be interpreted with caution.

Finally, the endogenous-vs-exogenous decoding cluster does not overlap with the gaze-following patch (GFP) reported in Marquardt et al. 2017 (MNI: -55, -67, 6). The GFP is located 20 mm directly posterior to the decoding cluster (and inferior to our TPJ ROI).

We have updated the Supplementary file 7, Figure 3—figure supplement 3, and Supplementary file 1, which now briefly discuss the spatial discrepancy of the left TPJ ROI and the Searchlight decoding cluster. We have also added references to Mars et al. (2012) and Bzdok et al. (2013).

Additional analyses:

5) Please report and compare accuracy and RTs for the response to the probe statement. If either differs between conditions, then that becomes a potential confound for the between condition contrasts in the MVPA analyses, considering that the BOLD response to the story and probe events could not be separated.

We thank the reviewers for suggesting this relevant analysis. Among the four social conditions, self-endo, self-exo, other-endo, and other-exo, we did not expect any systematic differences in performance on the probe statement task, given the extremely subtle semantic differences across conditions. As predicted, neither the mean accuracies (94.2% vs 93.4% vs 93.1% vs 93.4%; F_3,93=0.15, p=0.930, repeated-measures ANOVA) nor the mean RTs (1.61s vs 1.60s vs 1.67s vs 1.65s; F_3,93=1.66, p=0.181, repeated-measures ANOVA) for the response to the probe statement differed significantly across the four conditions.

These behavioral results relating to the response to the probe statement are now included in the revised manuscript, in a new first section of the Results (Behavioral results). Note also that since the story period was 10 sec, and the subsequent probe event was 4 sec, it was possible to focus the analysis on the MRI activity evoked by the story, fairly well uncontaminated by the probe event.

6) The TPJ is introduced in the context of theory of mind and social cognition, but it has also been implicated in attentional orienting. Could it be the case that participants simulate such orienting when reading the stories, leading to the above-chance decoding in TPJ? If this is the case, one may similarly expect above-chance decoding in areas that have been implicated in endogenous attention. This should be tested by including dorsal attention network ROIs. Above-chance decoding in such attention regions may inform the interpretation of the TPJ results.

We thank the reviewers for this intriguing suggestion. We have performed the requested analysis and included it in the new submission. If we understand the reviewers’ suggestion correctly, they hypothesize that our subjects, when reading stories, may have simulated exogenous and endogenous attention reorienting by activating the corresponding ventral and dorsal attention networks in a “mirror-neuron-like” fashion. This proposal would explain our TPJ result, because this area is a key node in the ventral attention network and might thus be involved in simulating exogenous attention orienting. If this mechanism is the underlying cause of the TPJ result, one would also predict the involvement of the dorsal attention network when subjects read (and simulated) the endogenous stories.

To test this prediction, as requested, we repeated the endogenous-versus-exogenous decoding analysis in four areas typically considered to constitute the dorsal attention network: the frontal eye fields (FEF), the anterior and posterior intraparietal sulcus (aIPS and pIPS), and the middle temporal complex (MT+). The ROIs were defined as 10-mm-radius spheres around the peak coordinates reported in Fox et al. (2006). The results are shown in Figure 3—figure supplement 6. None of the dorsal attention network ROIs decoded the attention type better than chance (all ps > 0.05, based on permutation testing with 10,000 iterations, uncorrected for multiple comparisons). These findings are thus incompatible with the proposed attention simulation account of the TPJ result.

This issue and these new results are now discussed in the fifth paragraph of the revised Discussion section, and the analysis results are also included in the supplementary material and shown in Figure 3—figure supplement 6.

7) Please provide univariate activity estimates, both in the ROIs and in whole-brain contrasts. This may help to interpret the multivariate results.

The results for the seven univariate contrasts corresponding to the main multivariate analyses are now included in the supplementary material (Supplementary file 5). We report univariate activity corrected for multiple comparisons both at the whole-brain level and within the search volume of each ROI. Notably, there were no significant clusters in any of the ROIs, or anywhere else in the brain, for the ENDOGENOUS > EXOGENOUS and EXOGENOUS > ENDGENOUS contrasts, not even at the uncorrected threshold p<0.001. These findings are compatible with previous studies (e.g., Hassabis et al. 2009 Current Biology) that have demonstrated the superiority of pattern-sensitive multivariate analyses compared with conventional univariate approaches for detecting differences in activity between conditions with highly similar macroscopic characteristics. In the revised manuscript, we added a sentence in the tenth Discussion paragraph referring to the univariate results.

The SELF > OTHER contrast also did not reveal any significant activity (even at the p<0.001 uncorrected level). The OTHER > SELF contrast revealed one single significant cluster, which was located in the left calcarine sulcus and survived whole-brain correction for multiple comparisons. We speculate that this activation reflects a main effect of the visual input of a name (e.g. “Emma”) in the OTHER condition versus the word “You” in the SELF. We observed no other activations at the p<0.001 uncorrected level in the rest of the brain, and the left calcarine activation was located at a distance from the locations of our ROIs (the STS, TPJ, MPFC, and precuneus) and did not overlap with the decoding results.

The attention type X agent type interactions did not reveal any activity at the whole-brain or ROI levels that survived multiple comparisons.

The Social > Non-Social contrast revealed more significant and widespread activity than the above contrasts, which was expected given the much greater semantic difference between the conditions. We found no significant activity within the ROIs, but four clusters survived correction at the whole-brain level: the left middle orbital gyrus, right SMG, left SFG, and the left insula.

Further support for main finding:

8) The reported decoding accuracy values are really quite small and close to 50% (chance), especially for the endogenous vs. exogenous and self vs. other contrasts, even those values that are statistically significant. Please report appropriate effect sizes and the confidence intervals around those effect sizes (for all your reported t-tests, not just those that are statistically significant). It would also be informative if you were to include in your graphs the individual subject data (e.g., mean decoding accuracy per subject for each ROI) and/or plots of the effect sizes and their distributions. For more on effect sizes, their CIs and associated plots, I point you to the following sources and the references therein:

https://thenewstatistics.com/itns

https://thenewstatistics.com/itns/2019/05/20/reply-to-lakens-the-correctly-used-p-value-needs-an-effect-size-and-ci/

https://www.estimationstats.com/

We thank the reviewers for this suggestion. We believe the decoding accuracy effects are not so small compared to other findings in the literature. This is especially so when considering that the effects noted by the reviewers are for the most subtle stimulus distinctions in our experiments. The effects are, of course, larger for the social-vs-nonsocial comparisons, because the distinction between the stimuli is much larger. In addition (as suggested by the reviewers in point 10 below), we have now replicated the crucial left TPJ decoding effect using three other anatomical definitions of that theory-of-mind ROI (see new Figure 3—figure supplement 2). All three anatomical definitions of the ROI show a highly significant effect (actually larger than the effect reported in our main analysis in the ROI based on van Veluw and Chance, 2014). Those replications of the finding may help convince the reviewers of the robustness of the result.

We also thank the reviewers for the suggestion to show more information about effect size. In Tables 1 and 2, we had already reported, for all analyses regardless of their significance, the effect size in terms of mean decoding accuracy (relative to chance), the 95% confidence interval around the mean (based on a bootstrap distribution), and the p value (based on permutation testing). To visualize the data more clearly, we have now included two additional supplementary figures featuring violin plots for all other ROI analyses (see Figure 3—figure supplement 1 and Figure 4—figure supplement 2). The violin plots show mean and median decoding accuracy, 95% confidence interval, a kernel density estimation, and individual data points for each decoding analysis and each ROI. (To avoid confusion and visual clutter, we left the figures in the main body of the paper as they were, and presented the new violin plots in the supplementary material.)

9) The authors computed the attentional state decoding separately for "self" and "other". These decoding accuracies did not differ. Please also provide and test the accuracies of self and other separately; this would shed light on the reliability of the main result (which was collapsed across the two conditions) and might also indicate whether the decoding was more reliable (less variable) in self or other.

Thank you for this suggestion. These results are now presented in Figure 3—figure supplement 1 in the revised submission. These results revealed no significant activity in the left TPJ (or in any of the other ROIs), which is likely due to a lack of statistical power (since only half of the data set is used for these analyses). There is, however, an alternative analysis that gets at the same question but does not suffer from a reduction in statistical power, and which does show significant activity in the left TPJ. We included that new analysis in the revision. Please see our response to the related point #11 for a description of that new analysis.

10) Replicate results in one or multiple additional ToM TPJ ROIs. Reviewers raised two suggestions: 1) Surface-based ROI: the TPJ is a highly anatomically variable cortical region that isn't well approximated by a single volume ROI (see Croxson et al. 2017). There are many surface-based ROIs now available that mitigate the effect of this variability, including ones from the authors' own lab. 2) Use a different meta-analysis: The used meta-analysis defines “theory of mind” solely in terms of false-belief tasks (van Veluw and Chance, 2014), which may not be appropriate for delineating the ROIs and their exact locations in your study. Different types of ToM task reliably activate different brain areas, as well as common ones (mPFC and bilateral TPJ: Molenberghs et al., Neuroscience and Biobehavioral Review 2016). Consider using the results of a different meta-analysis, e.g., one that identifies regions based on the conjunction of multiple types of theory-of-mind tasks (e.g., Mar, Annual Review of Psychology 2011; Molenberghs et al., 2016; Schurz et al., Neuroscience and Biobehavioral Reviews 2014).

We welcome the reviewers’ suggestion of replicating the endogenous-versus-exogenous decoding results in different ToM TPJ ROIs. In line with their recommendation, we defined three new left TPJ ROIs based on the peak coordinates reported in Mar (2011), Schurz et al. (2014), and Molenberghs et al. (2016). The results showed significant decoding in the Mar ROI (mean decoding accuracy 53.4%, 95% CI 51.0 to 55.1, p=0.0023), the Schurz ROI (mean decoding accuracy 52.7%, 95% CI 50.8 to 54.4, p=0.0092), and in the Molenberghs ROI (mean decoding accuracy 53.4%, 95% CI 51.3 to 55.2, p=0.0020), suggesting that the attention type decoding in the left TPJ is robust. In the revised paper, these results are included in the supplementary material (see Figure 3—figure supplement 2, also pasted above in relation to major point 8).

The suggestion of re-analyzing the data set using surface-based techniques is interesting and definitely something we aim to pursue in future studies. However, we feel that mixing surface- and volume-based analysis methods, and defining ROIs using fundamentally different approaches, might risk over-complicating the paper. Furthermore, the surface-based TPJ subdivision described by Igelstrom et al. (2016) suffers the same draw-back as the van Veluw and Chance (2014) meta-analysis in that it only involves one type of theory-of-mind task (a false belief task). We therefore decided to use volume-based methods throughout.

11) In previous work (Kelly et al., 2014), the authors were interested in an overlap between attention in self and other. Here, this could be addressed in a cross-decoding analysis, training a classifier on exo vs endo in the "self" stories and testing this on the "other" stories. Above-chance classification in this analysis would strengthen the evidence for lTPJ involvement and would provide additional information that would help interpreting the TPJ findings.

We thank the reviewer for this excellent suggestion. Indeed, one of the goals of the study was to test for differences in the encoding of attention type in self versus others (Prediction 3). Attention type could be significantly decoded in the left TPJ when taking all data (“self” and “other” stories) into account (Figure 3A). However, we did not find significant decoding in the left TPJ when analyzing the “self” stories and “other” stories separately (see our response to point #9), which is likely due to a lack of statistical power because the data set was split in two. The absence of a self-vs-other difference in attention decoding could thus be due to either a lack of statistical power, or a true overlap between attention type encoding in self and other.

A direct way of testing for overlap in attention encoding in self and others in the left TPJ, while maintaining statistical power by using the entire data set, is to employ a two-way cross-classification analysis. In line with the reviewers’ suggestion, we have now included this analysis in the paper (Figure 3—figure supplement 7). In each subject, one classifier was trained to discriminate endogenous versus exogenous self-stories and tested on other-stories (using a leave-one-run out approach), and another classifier was trained to discriminate endogenous versus exogenous other-stories and tested on self-stories, from which an average cross-classification decoding accuracy for the left TPJ was obtained. The group-level result shows significant above-chance decoding (mean decoding accuracy 51.9%, 95% CI 49.9 to 54.1, p=0.0393, permutation testing with 10,000 iterations). This finding suggests that there is an overlap in brain mechanisms that participate in the encoding of attention in others and in encoding of attention in the self in the left TPJ.

The new results are now included in the Results section (under Prediction 3) and Figure 3—figure supplement 7 in the revised paper. We have also expanded the eighth Discussion paragraph, relating to the interaction between attention type and agent type, to address this point.

[Editors' note: further revisions were suggested prior to acceptance, as described below.]

Essential Revisions:

1) Please report and analyze the univariate activity in the ROIs

2) More fully report (in main Results section) and discuss the searchlight results.

We thank the editor and two reviewers for their detailed and constructive comments. In the revised submission, we report the univariate activity averaged across all voxels within each ROI, and report and discuss the Searchlight results in the main text. In our view the paper has been greatly improved as a result of these revisions. Below we answer all comments in a point-by-point manner.

Reviewer #1:

The authors have addressed many of my concerns. In particular, the additional TPJ ROIs and the demonstration of self-other cross-decoding increased my confidence in the main finding of attention state decoding in lTPJ.

One comment has not been sufficiently addressed, however: it would be highly relevant and informative to see the average univariate activity for each of the conditions in the 6 original ROIs, plotted in a graph. The endo>exo contrast should be tested, correcting for the 6 ROIs, similar to how the decoding accuracies are tested (i.e., with the same p<0.05 cut-off). This ROI-based univariate analysis is also interesting for other comparisons, e.g. to test whether the social conditions gave higher activity than the non-social condition, as would be expected based on previous work. Thus, please provide a full univariate analysis on average ROI activity.

We thank the reviewer for this suggestion. In the revised submission, we now include a supplementary figure showing the difference in average univariate activity across all voxels within each ROI, for the endo-vs-exo, self-vs-other, and social-vs-nonsocial contrasts. In line with the voxelwise univariate results reported in Supplementary file 5, none of these contrasts were statistically significant (all FDR-corrected ps > 0.21).

There is a lot of interesting information in the Supplementary figures (e.g., searchlight, additional ROIs), which will not be visible when viewing or printing pdfs. You could consider moving some of this to the main text, or add panels to existing figures where you include some of this information.

We agree with the reviewer, and have incorporated some of the supplementary results into the main text in the revised submission. Specifically, we have added three panels to Figure 3, which now features the additional left TPJ ROI results, the endo-versus-exo Searchlight results, and the cross-classification results.

Reviewer #2:

In this revised manuscript, the authors have greatly clarified some key points, most important of which was how well matched the behavior was across all of the conditions. While there is still a potential confound in the social vs. non-social contrast given the difference in reaction time, (a) the confound effects are likely negligible in size, (b) the end result matches the previous literature, and (c) the contrast was only a control analysis and doesn't greatly affect the main point of the paper. However, the handling of the left posterior STS result in the searchlight analysis remains problematic, both in the manuscript and in the author's response.

pSTS response and discussion: The main point of the manuscript is to examine whether known theory of mind areas contain information that differentiates between the endogenous vs. exogenous story conditions. The revised manuscript makes quite clear that the answer is yes, activity in the L TPJ differentiates between the two conditions, albeit with a relatively low decoding accuracy. The fact that multiple versions of the L TPJ ROI produces the same result is particularly reassuring. The spotlight analysis, however, finds that there is potentially more discriminatory information to be found in the posterior STS/middle temporal gyrus, and this is where the manuscript runs into problems.

In the revised manuscript, this result is simply not mentioned, though it clearly has implications for the interpretations of the result as mentioned in the previous round of reviews. In addition, in the response to the reviewers' comments, the authors give a very convoluted and confusing argument based on MNI coordinates that somehow this focus is somehow (a) part of the TPJ and (b) may be a part of the attention-related TPJa as opposed to their TPJp ROI. In the process of saying that the surface projections are misleading, they state that the focus as falling on the STG on the surface projection, when it is really on the MTG. In addition, they base their arguments on MNI coordinates, but MNI coordinates are notoriously inaccurate in comparing results from different studies, so the author's attempts to justify their conclusions using these coordinates falls flat. The authors own volume images very clearly show the focus as being in the STS and not on either the angular gyrus or supramarginal gyrus that Mars, Corbetta, and others have generally shown the TPJp and TPJa to fall on. And even if this focus was in the TPJa, as the authors seem to hint at, they do not discuss the implications of this result.

The authors' defensiveness around this point is frankly puzzling. The searchlight results do not seem to invalidate their main point, only potentially augment it. The fact that the posterior STS (and what seem to be the right FEF and iPCS areas) exhibit higher discriminability between the endo and exo conditions may not be shocking given that the theory of mind areas are likely involved in many operations in this task, whereas the pSTS and right hemisphere areas likely may only be involved in just the imagined attention/sensory processing aspects of the task. It is possible that these areas are "reading out" the differing attentional conditions from the L TPJ. Whatever the explanation may be, the authors seem to be trying to bury this result to shoehorn the results into fitting their a priori model, which is a disservice and misleading to the readers, and needs to be rectified before the manuscript can be published. My recommendation is to at least mention the searchlight results in the main Results section, then add a paragraph to the Discussion discussing the implications of these results. Better yet would be to quantify the discrimination accuracy within each of the foci uncovered in the spotlight analyses.

We are sorry to hear that the reviewer interpreted our previous response as defensive, it was not our intention. And we apologize for erroneously referring to STG in our response (“they state that the focus as falling on the STG on the surface projection”), it should have said MTG, which is obvious from the surface projection in Figure 3—figure supplement 3. In the revised submission, we now include the searchlight results in the main Results section and in the main results Figure 3 (panel C).

First, we would like to take the opportunity put the searchlight result into a broader context. The searchlight analysis is fundamentally different from the ROI analysis. It is not targeted to specific brain areas on the basis of strong predictions. Instead, it is a whole-brain analysis that is much more statistically conservative because of the brain-wide correction for multiple comparisons. In general, one would not necessarily expect the searchlight analysis to align perfectly with the ROI analysis. Its usefulness is that it may reveal any cluster of very strong decoding that was missed by the more sensitive analysis restricted to the ROIs. However, the results of our searchlight analysis revealed no brain-wide significant clusters of decoding for the endogenous versus exogenous distinction. Thus, we cannot make any inferences about attention-type decoding based on the searchlight results. However, in a purely descriptive manner, we report the (four) decoding clusters that survived the conventional uncorrected statistical threshold p<0.001. It is interesting to note that the brain-wide searchlight decoding peak happened to fall in the posterior STS just 20 mm from the center of our predefined left TPJ ROI, and that they belong to the same anatomical subregion of the TPJ (TPJp). In our view, this approximate, descriptive overlap lends at least some additional confidence to our significant left TPJ ROI decoding result. Nevertheless, since the searchlight result consists of an uncorrected decoding map, we have been very careful to not over-interpret the data. We suspect that the reviewer may have taken this caution on our part as defensiveness. Because the searchlight results for the endo-versus-exo distinction were inconclusive, interpretations such as the one offered by the reviewer (“The fact that the posterior STS [and what seem to be the right FEF and iPCS areas] exhibit higher discriminability between the endo and exo conditions may not be shocking given that the theory of mind areas are likely involved in many operations in this task, whereas the pSTS and right hemisphere areas likely may only be involved in just the imagined attention/sensory processing aspects of the task. It is possible that these areas are "reading out" the differing attentional conditions from the L TPJ.”) are in our view therefore highly speculative.

The goal with our previous response was to make an honest attempt at pinpointing the functional location the left pSTS searchlight cluster, which was prompted by the reviewer’s previous comment that questioned whether the cluster belong to the TPJ at all and speculated that it perhaps belongs to TPJa or coincides with the gaze-following patch reported in Marquardt et al. 2017. In contrast to the reviewer’s assertion that the TPJa and TPJp encompass only the angular gyrus and the SMG, the connectivity-based subdivision of TPJa and TPJp described by Bzdok et al. (2013) and Mars et al. (2012) both define the pSTS as part of the TPJ. According to this definition, our pSTS searchlight cluster clearly belongs to the TPJ and specifically to the posterior subregion TPJp. The reviewer appears to have the impression that we are arguing the cluster belongs to the TPJa (“the authors [argue that] this focus is somehow (a) part of the TPJ and (b) may be a part of the attention-related TPJa as opposed to their TPJp ROI.” and “And even if this focus was in the TPJa, as the authors seem to hint at […]”); however, we are not. Furthermore, the pSTS searchlight cluster does not coincide with the gaze-following patch reported in Marquardt et al. 2017.

To help clarify the relationship between the left TPJ ROI, in which we obtained significant decoding, and the left STS, in which we found a non-significant peak in the searchlight analysis, we performed a further analysis for the reviewer. In this new analysis, we used a more lax statistical threshold, to better examine whether there is any halo of activity hidden under the statistical threshold. Instead of using the arbitrary uncorrected threshold of p<0.001, we used the uncorrected threshold of p<0.01, in the searchlight analysis. Author response image 1 shows the result. Using this threshold, the left posterior STS cluster merged with clusters encompassing both the angular gyrus, the SMG and the MTG. The general area of activity is now more clearly in the TPJ, including the TPJ ROI and extending into the STS. It is important to keep in mind, however, that all of these methods – the method that shows a small peak in the STS, and the method that shows a large cluster encompassing the TPJ – should not be taken as definite, statistically strong findings. They are the result of exploratory searchlight analysis and, though interesting, should be taken cautiously.

Author response image 1

Download asset Open asset

We certainly want to avoid the impression of “burying” the searchlight results. Although descriptive, they are interesting and compatible with our ROI results, and constitute valuable information not least for future studies. Therefore, we now include the endo-versus-exo searchlight results in the updated main results figure (Figure 3C) and report the results, including the decoding accuracy for the pSTS peak voxel (53.7%), in the main Results section under “Prediction 1”.

Author details

1. Arvid Guterstam

   1. Department of Psychology, Princeton University, Department of Psychology, Princeton, United States
   2. Department of Clinical Neuroscience, Karolinska Institutet, Stockholm, Sweden

   Contribution

   Conceptualization, Formal analysis, Funding acquisition, Investigation, Visualization, Methodology, Writing - original draft

   For correspondence

   arvidg@princeton.edu

   Competing interests

   No competing interests declared

   "This ORCID iD identifies the author of this article:" 0000-0002-3694-1318

2. Branden J Bio

   Department of Psychology, Princeton University, Department of Psychology, Princeton, United States

   Contribution

   Investigation, Writing - review and editing

   Competing interests

   No competing interests declared

3. Andrew I Wilterson

   Department of Psychology, Princeton University, Department of Psychology, Princeton, United States

   Contribution

   Investigation, Writing - review and editing

   Competing interests

   No competing interests declared

4. Michael Graziano

   Department of Psychology, Princeton University, Department of Psychology, Princeton, United States

   Contribution

   Conceptualization, Writing - review and editing

   Competing interests

   No competing interests declared

• 1,421

  Page views

• 152

  Downloads

• 7

  Citations

Article citation count generated by polling the highest count across the following sources: Crossref, PubMed Central, Scopus.