Anticipation of temporally structured events in the brain

  1. Caroline S Lee
  2. Mariam Aly
  3. Christopher Baldassano  Is a corresponding author
  1. Columbia University, Department of Psychology, United States
  2. Dartmouth College, Department of Psychological and Brain Sciences, United States
5 figures and 1 additional file

Figures

Computing varying timescales of anticipatory signals by examining temporal shifts in events across multiple viewings of a movie.

(a) Given the voxel by time pattern of responses evoked by the movie clip on each viewing (darker colors indicate higher levels of activity), our goal is to model all viewings as a series of …

Figure 2 with 4 supplements
Timescales of anticipation vary across the cortical hierarchy.

(a) Multiple regions exhibited shifts in event timing between initial and repeated viewings, with event transitions shifting earlier in time with subsequent viewings. Across the brain, anticipation …

Figure 2—figure supplement 1
Unthresholded statistical map of anticipation timescales.

This figure shows the same analysis as in Figure 2a, but without statistical thresholding. The posterior-to-anterior hierarchy of anticipation persists in this unthresholded map (Spearman’s rho = 0.4…

Figure 2—figure supplement 2
Timescales of anticipation when the first viewing is compared to the last viewing.

This figure shows the same analysis as that in Figure 2, except that the first viewing is compared to the last (6th) viewing only.

Figure 2—figure supplement 3
Timescales of anticipation as a function of the optimal number of events.

(a) This map depicts the optimal number of events in each brain region that shows statistically significant anticipation (i.e., masked by regions shown in Figure 2a). The optimal number of events …

Figure 2—figure supplement 4
Cross-correlation analysis of anticipation.

Cross-correlations were conducted between the activity timecourse of a given region for the first movie viewing and the average of the subsequent movie viewings. The regions depicted showed …

An example of event annotations from The Grand Budapest Hotel.

Dotted lines demarcate events and phrases between the lines are brief titles given by one participant to describe each event. (Frames in this figure have been blurred to comply with copyright …

Construction of behavioral boundary timecourse from human annotations.

The number of boundary annotations at each second of the movie clip (in gray) was convolved with a hemodynamic response function (HRF) to produce a continuous measure of boundary strength (black …

Correlations between the brain’s event transitions and human-annotated event boundaries.

Cross-correlation plots show the correlation between the brain’s hidden Markov model (HMM) event boundaries and annotated event boundaries as the timecourses are shifted with respect to one another. …

Additional files

Download links