Dynamic fMRI networks of human emotion

  1. Niels Janssen  Is a corresponding author
  2. Uriel KA Elvira
  3. Joost Janssen
  4. Theo GM van Erp
  1. Department of Psychology, Universidad de la Laguna, Spain
  2. Institute of Biomedical Technologies, Universidad de La Laguna, Spain
  3. Institute of Neurosciences, Universidad de la Laguna, Spain
  4. Department of Child and Adolescent Psychiatry, Institute of Psychiatry and Mental Health, Hospital General Universitario Gregorio Marañón, Spain
  5. Ciber del Área de Salud Mental, Instituto de Investigación Sanitaria Gregorio Marañón, Spain
  6. Department of Psychiatry, UMCU Brain Center, University Medical Center Utrecht, Netherlands
  7. Clinical Translational Neuroscience Laboratory, Department of Psychiatry and Human Behavior, University of California, Irvine, United States
  8. Center for the Neurobiology of Learning and Memory, University of California, Irvine, United States
8 figures, 3 tables and 1 additional file

Figures

Overview of quality control of structural data with Euler number (A), functional MRI (fMRI) head motion scores (B), analysis of name agreement using binomial GLM (logit link) with condition as a fixed effect and Bonferroni-adjusted pairwise contrasts.

Error bars reflect standard deviations for the scores of 22 participants per condition, (C) and reaction times using mixed effect model with condition as a fixed effect and a subject random intercept and Bonferroni-corrected pairwise contrasts Error bars reflect the standard errors of the model coefficients (D), and overview of the task (E).

© 1994, Paramount Pictures. Screenshots in panel E are taken from 'Forrest Gump' (1994). These are not covered by the CC-BY 4.0 license.

Slice-based functional MRI (fMRI) explanation (A, B), results (C), and subsequent processing steps (D).

In a hypothetical fMRI data acquisition protocol (A), three slices are acquired with TR = 2 s resulting in Slice-Acquisition Times (SAT) of 0, 0.7, 1.3 s, etc. The key point is that stimulus presentations are combined to extract the fMRI signal at high temporal resolution (Janssen et al., 2018). Three stimulus trials (T1.RT, T2.RT, T3.RT and red, yellow, green bars) whose onset coincides with each slice results in slices sampling the brain at all time points during a 6 s epoch relative to the onset of the stimulus. Thus, for a specific voxel on slice 2 (B), after these three stimulus trials, signal intensities at a temporal resolution equal to the ΔSAT (0.7 s) are acquired. Statistical models can extract the fMRI signal (B, gray dashed line) at this or at a higher powered binned, but lower temporal resolution. Results from group-level Slice-Based analysis of movie clips at 2 s resolution for the separate happy, fear, and sad trials (not all time points shown). Note that results reveal complex increases (hot colors) and decreases (cool colors) of signals across the whole brain during the 26 s epoch (C). The slice-based datasets for the happy, fear, and sad trials for each subject were then concatenated and entered into group spatial independent component analysis (ICA) for the detection of component maps and time courses (D).

Results from group spatial independent component analysis (ICA) with six dimensions.

Plotted are both the spatial maps and the component time courses averaged across subjects and conditions associated with each IC. Consideration of both spatial and temporal properties of these six ICs led to the identification of four ICs as signal (IC0, IC1, IC2, IC4) and two as noise (IC3, IC5). Note the noise components had spatial distributions associated with non-gray-matter regions (CSF, draining veins). Note also the networks are labeled and ordered as explained in the text. Bottom bar denotes the different stages of the behavioral task. The amplitude of the component time courses reflects the strength of engagement of each independent component over time, in z-scored units. Modulation of these time courses by emotions is investigated further below.

Basic regional functional connectivity in the four large-scale networks.

Note the scale differences between networks. Black bars denote the top 10 regions with the highest functional connectivity within each network. All results are Bonferroni-corrected.

Differences in functional connectivity between IC0 vs IC1 (A), IC1 vs IC0 (B), IC0 vs IC2 (C), IC2 vs IC0 (D), IC2 vs IC4 (E) and IC4 vs IC2 (F).

Note that here we focus on three main contrasts to highlight differences between IC0 and IC1, IC0 and IC2, and between IC2 and IC4.

Functional connectivity modulation of emotion conditions across networks IC1 “input” (A), IC0 “meaning” (B), IC2 “response (C), and IC4 “dmn” (D).

Note all large-scale networks involved in the task are modulated by emotions in all major lobes of the brain. H=happy, F=fear, S=sadness. All results are Bonferroni-corrected.

Explanation of curve-fitting procedure (A), goodness of fit results from Gaussian curve fitting (B), and graphical overview of how peak value (C), time to peak (D), and duration (E) differ between the four IC networks.

Note that goodness of fit values were relatively equal across IC networks, and that there were earlier time-to-peak values for IC1 compared to IC0. Error bars reflect standard error of mode coefficients, Different letters above bars indicate a significant difference in mixed effect models with component as a fixed effect and subject as a random intercept (p<0.05, Bonferroni-corrected) from 22 participants.

Results of the pairwise contrasts of the happy (H), sadness (S), and fear (F) conditions for the peak value (pv), time to peak (ttp), and duration (dur) across all four IC networks.

Only significant (p<0.05, Bonferroni-corrected) values are plotted.

Tables

Table 1
Order of the movie clips in the experiment.
Clip#EmotionDescription
1HappyYoung Forrest meets Jenny
2FearForrest runs from bullies
3SadForrest says goodbye to Jenny
4FearForrest gets shouted at
5SadForrest is alone in bed
6FearForrest gets attacked
7HappyForrest sees Jenny
8FearForrest sees a dangerous situation
9SadForrest sees a sad person
10SadForrest sees sick Jenny
11FearForrest sees Jenny's ghost
12HappyForrest sees Jenny
13SadForrest knows what love is
14HappyForrest is with Jenny
15HappyForrest stays with Jenny
Table 2
Overview of the ANOVA table from the statistical modeling of the regional functional connectivity data.
Sum sq.Mean sq.NumDFDenDFF valuePr(>F)
Hemisphere0.170.171.0021155.066.150.0131
Head motion0.030.031.0019.030.980.3346
Euler0.070.071.0018.972.530.1279
IC_network26.378.793.0021155.54309.64<0.0001
Emotion_condition0.090.042.0021155.531.580.2060
Region66.831.6341.0021155.1357.43<0.0001
IC:cond0.500.086.0021155.462.950.0070
IC:region226.841.84123.0021155.0864.98<0.0001
cond:region1.810.0282.0021155.070.780.9313
IC:cond:region12.000.05246.0021155.051.72<0.0001
Table 3
Overview of the ANOVA table from the statistical modeling of the curve-fitting data.
VariableSum sq.Mean sq.NumDFDenDFF valuePr(>F)
Peak valueRSE2583.062583.061.00206.1677.37<0.0001
IC740.74246.913.00190.487.400.0001
cond1123.70561.852.00187.3716.83<0.0001
IC:cond1058.63176.446.00186.055.28<0.0001
Time to peakRSE1.721.721.00205.181.670.1981
IC3403.491134.503.00189.381096.81<0.0001
cond26.4513.222.00187.3512.78<0.0001
IC:cond14.832.476.00186.552.390.0301
DurationRSE9.439.431.00160.083.250.0734
IC1443.68481.233.00195.80165.69<0.0001
cond24.8212.412.00191.794.270.0153
IC:cond46.737.796.00189.422.680.0160

Additional files

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Niels Janssen
  2. Uriel KA Elvira
  3. Joost Janssen
  4. Theo GM van Erp
(2026)
Dynamic fMRI networks of human emotion
eLife 14:RP106070.
https://doi.org/10.7554/eLife.106070.3