Schema-based predictive eye movements support sequential memory encoding

  1. Jiawen Huang  Is a corresponding author
  2. Isabel Velarde
  3. Wei Ji Ma
  4. Christopher Baldassano
  1. Department of Psychology, Columbia University, United States
  2. Center for Neural Science and Department of Psychology, New York University, United States
8 figures and 1 additional file

Figures

A schematic of the experimental method.

(a) Task structure across six (non-consecutive) days. (b) Memory task. In each of the 30 trials, participants saw an initial board for 5 s, and then a move was added to the board every 5 s. After …

Participants’ performance in memory and gameplay.

(a) On average, Participants become better at remembering sequences over the course of the training (red line, N = 35). In each session, memory accuracy is much higher than the performance that …

The effect of schema consistency on memory and its development across training sessions.

(a) An example of the model’s evaluation of a board where the next player is black. Based on features that would be generated by each possible next move (e.g. creating three-in-a-row), the model …

Using eye movements to reveal encoding strategies.

Left: A participant’s fixation heatmaps over a 5 s encoding period. right: the 6 regressors that we consider as potential encoding strategies. 1: Participants could look at the last (most recent) …

The relationship between prediction, playing strengths, and recall accuracy.

(a) The extent to which eye movements on empty squares align with the gameplay model (prediction coefficient; see Figure 4) increases over training sessions. (b) Correlation between Elo (playing …

Model-free measure of prediction and their relationship with memory.

(a) Example fixation heatmaps (in red) of high and low prediction confidence and surprise. Confidence measures the extent to which fixations were focused on a small number of unoccupied squares, …

Author response image 1
Author response image 2

Additional files

Download links