Introduction

Innate fear of predation has been a powerful driver of the evolution of defensive strategies (Cooper and Blumstein, 2015; Lima and Dill, 1990; Mobbs et al., 2024). In group-living species, these responses are further shaped by social context (Evans et al., 2019; Krause and Ruxton, 2002). Collective behaviors—such as the circle defense of muskoxen against wolves, the coordinated retreat of meerkats to burrows, mobbing of raptors by smaller birds, and predator-specific alarm calls in primates—demonstrate how social context enhances survival by coordinating individual responses. In humans and other social animals, individuals adjust their fear perception and defensive behaviors based on conspecific cues through mechanisms such as social buffering (Kikusui et al., 2006; Qi et al., 2021), emotional contagion (de Gelder et al., 2004), social learning (Olsson and Phelps, 2007), and social appraisal (Mumenthaler and Sander, 2012). Disruptions in these processes increase vulnerability to fear-related disorders, leading to maladaptive fear responses and impaired social functioning (Grammer and Zelikowsky, 2022; Ozbay et al., 2007; Top et al., 2016). Understanding the neural mechanisms underlying the social regulation of fear is therefore crucial for treating these neurological disorders.

Most studies on the social regulation of fear have focused on learned fear paradigms (Kikusui et al., 2006; Morozov and Ito, 2019). In these paradigms, conspecific presence typically reduces fear (Davitz and Mason, 1955), yet the effect depends on partner identity and emotional state: familiar partners provide stronger buffering (Kiyokawa et al., 2014), while frightened partners can diminish or even reverse this effect (Kiyokawa et al., 2004; Morozov and Ito, 2019). While these studies have advanced our understanding of how social cues modulate fear responses, they rely on conditioning and therefore do not capture ethologically relevant threat scenarios (Cisek and Green, 2024; Dennis et al., 2021).

In contrast, innate fear paradigms provide complementary insights into naturalistic defensive responses (Adolphs, 2013; Gross and Canteras, 2012; Rosen, 2004). Because innate fear responses are evolutionarily conserved, their underlying neural mechanisms are likely to generalize across individuals and species (Hein et al., 2018; Peek and Card, 2016). Recent work using such paradigms has begun to uncover how social cues regulate defensive behaviors across taxa—including flies, fish, rodents, primates, and humans—with modulation depending on the properties of threats and social cues (Blanchard and Blanchard, 1989; Coan et al., 2006; Faustino et al., 2017; Ferreira et al., 2022; Gutzeit et al., 2020; Testard et al., 2024; Vogt et al., 1981). Despite these advances, how dominance hierarchy—a fundamental organizing principle of many animal societies—regulates defensive behavior, and whether such regulation depends on the nature of the threats, remains poorly understood.

To address these questions, we developed a behavioral paradigm in which pair-housed mice with established dominance hierarchies encountered two distinct naturalistic threats, a transient visual looming stimulus (Yilmaz and Meister, 2013) and a sustained live rat (Kennedy et al., 2020; Kunwar et al., 2015), both alone and with their partners. Social presence alleviates threat-induced stress and modulates defensive strategies in a rank- and threat-dependent manner, attenuating looming-evoked defense while promoting active coping during rat exposure, with the effects more pronounced in dominants. Furthermore, shared threat experience reinforces social roles and strengthens group cohesion. Together, these findings reveal reciprocal interactions between defensive and social behaviors across distinct threat contexts, providing a behavioral framework for future investigations into the neural mechanisms underlying social modulation of innate fear.

Results

A behavioral paradigm to probe dominance-hierarchy modulation of innate defense across distinct threat contexts

To investigate how dominance hierarchy modulates innate defensive responses, we developed a behavioral paradigm that incorporates two ethologically relevant predatory stimuli (Figure 1A). Adult male sibling mice were pair-housed for two weeks to establish stable dominance hierarchies, assessed using the tube test (Fan et al., 2019). Subsequently, they were divided into two cohorts: one exposed to a transient visual looming stimulus that mimics the sudden approach of an aerial predator (Yilmaz and Meister, 2013), and the other to a live rat that serves as a sustained threat (Kennedy et al., 2020). Before threat exposure, all mice were habituated to the arena. Each mouse was tested both alone and in the presence of their cage mate. Rank stability was reassessed after threat exposure; only one pair showed a rank reversal and was excluded from further analysis.

A behavioral paradigm to probe dominance-hierarchy modulation of innate defense across distinct threat contexts.

(A) Schematic of behavioral paradigms. (B) Representative raster plots of behaviors during single and paired exposures. Top: looming exposure; bottom: live rat exposure. D: dominant; S: subordinate. (C) Bar graph of average time allocation for each annotated behavior. Pie charts show the proportion of behavioral categories. Paired t-test; N = 40 mice for looming exposure, N = 22 mice for rat exposure. (D) Behavior transition maps. Node size indicates the average duration of each behavior. Line thickness scales with the transition probability. (E) Matrices of behavior transition differences between single and paired conditions (paired-single). Paired t-test. (F) Transition maps of behavioral categories. *p < 0.05; ** p < 0.01; *** p < 0.001.

During habituation, mice primarily engaged in neutral solitary behaviors, with occasional spontaneous freezing (Figures S1A and S1B). When exposed to threats alone, both looming and rat stimuli elicited robust defensive responses (Figure 1B). Some behaviors, such as freezing and tail rattling, were common across paradigms, whereas others were threat-specific: escape occurred exclusively during looming exposure, while stretch-attend, approach, investigation, and withdrawal were unique to rat exposure. The presence of a social partner reduced defensive behaviors more than neutral ones (Figures 1B and 1C), suggesting an attenuation of fear under social conditions.

To probe the structure underlying these behaviors, we generated their transition maps (Figures 1D). Three patterns emerged. First, threat-specific defensive structures were evident. During looming exposure, freezing typically followed escape, and about one-third of bouts transitioned into rearing, reflecting heightened vigilance after a transient threat. In contrast, during rat exposure, freezing occurred more frequently after withdrawal, and about one-third entered another freezing bout, consistent with sustained, elevated stress levels. Rat exposure also revealed an approach–investigation–withdrawal sequence, indicating an active threat-evaluation strategy. Second, social context modulated transition dynamics, particularly those leading to freezing (Figures 1E, S1C, S1D). During looming exposure, post-escape freezing was partially replaced by neutral behavior in paired conditions; during rat exposure, post-withdrawal freezing was partially replaced by social behaviors. These behavioral shifts are consistent with reduced fear levels. Third, the nature of the threat shaped social modulation of behavior: during transient looming threats, huddling and approaching the partner were often followed by grooming the partner, indicative of stress-buffering interactions, whereas during persistent rat exposure, huddling was more often followed by freezing, reflecting heightened and sustained fear. Such threat-specific social modulation was also evident in transitions among defensive, social, and neutral behaviors. Compared to looming exposure, social behaviors were more often followed by defensive behavior during rat exposure (Figure 1F). Together, these findings reveal that social context modulates defensive strategies in a threat-specific manner.

Social context attenuates looming-evoked defensive behavior in a rank-dependent manner

Although looming stimuli trigger immediate defensive responses, their impact on behavior and emotional state can persist beyond the initial reaction. To examine how social context modulates the expression and progression of defensive responses, we analyzed behavior in two time windows: an early phase (0–5 s after looming onset) and a late phase (20–60 s after onset), each compared to the pre-looming baseline.

During baseline, mice showed a strong preference for the nest and stayed close to the arena walls when exploring outside, consistent with thigmotaxis in the open-field test (Figures 2A, 2B, S2A, S2B). Looming exposure altered both spatial occupancy and locomotion speed, with distinct effects across the transient and sustained phases (Figures 2A-2D, S2B). In the transient phase, it shifted the distribution of nest occupancy (p < 0.001, Kolmogorov–Smirnov (KS) test) and center-zone speed (p < 0.001, KS test), reflecting a rapid behavioral change immediately after threat onset. In the sustained phase, looming exposure increased nest occupancy and reduced locomotion speed within the nest (Figures 2A-2D, S2B), indicative of heightened anxiety. The presence of a social partner increased the locomotion speed in the nest (Figures S2F-G), suggesting that social interaction attenuates anxiety-related suppression of movement. Notably, nest occupancy remained unchanged (Figures S2C-E), which may reflect opposing social influences: reduced anxiety could promote exploration outside the nest, whereas social opportunities may motivate them to remain inside (Figure S2H).

Social context attenuates looming-evoked defensive behavior in a rank-dependent manner.

(A) Heatmaps of average time allocation in nest, edge, and center zones during baseline, early, and late phases under single exposure. (B) Time spent in each zone per minute, normalized by zone area. Paired t-test; N = 40 mice. (C) Heatmaps of average locomotion speed across zones, with arrows indicating average velocity vectors. (D) Locomotion speed in each zone. (E) Representative moving trajectories of example mice exhibiting different behavior decisions within 5 s after looming onset. (F) Distribution of behavioral decisions following looming exposure. Chi-square test; N = 89, 84, 88, 95 trials for sD (single dominant), pD (pair dominant), sS (single subordinate), and pS (pair subordinate) groups, respectively. (G) Peak escape speed. Paired t-test; N = 12, 12, 10, 10 mice. (H) Duration of the first looming-evoked freezing bout. Paired t-test; N = 12, 12, 13, 13 mice. (I) Time spent on self-grooming across time windows. Two-way ANOVA with post hoc Tukey’s range test; N = 20 mice for all groups. (J) Time spent on rearing and up-stretch across time windows. Two-way ANOVA with post hoc Tukey’s range test; N = 20 mice for all groups. *p < 0.05; ** p < 0.01; *** p < 0.001.

To directly assess how social context influences defense, we quantified manually annotated behaviors. During the early phase, looming-evoked behaviors were classified into four decision types: escape (E), escape after assessment (F+E), freezing (F), and no response (N) (Figures 2E-F). Social context significantly altered decision patterns in both dominant and subordinate mice (Figure 2F), with rank-specific modulation of escape speed and freezing duration. Escape speed was reduced in both groups, with a great reduction in subordinates (Figure 2G), whereas freezing duration was significantly shortened only in dominants (Figure 2H). This reduction in freezing was unlikely due to direct social interruption, as only a small fraction of freezing episodes transitioned to or overlapped with social behaviors (Figures S2I-K).

Rank-specific effects persisted into the late phase. Under social conditions, stress-induced self-grooming was alleviated only in dominants (Figures 2I and S2L). A similar rank-dependent reduction was observed for anxiety-associated rearing and up-stretch behaviors, evident both after looming exposure and during baseline (Figure 2J).

Together, these results demonstrate that social context shapes both early and late defensive responses to transient visual threats in a rank-dependent manner, modulating not only the occurrence but also the expression of specific defensive and anxiety-related behaviors.

Social context alleviates sustained predatory stress and fine-tunes defensive strategies across ranks

In natural environments, prey must cope not only with sudden, unpredictable predatory strikes but also with the sustained presence of predators, which imposes prolonged stress and elicits a broader repertoire of defensive behaviors. To investigate how social context modulates such defenses, we developed a rat-exposure paradigm (Figure 1A). Following a 5-minute habituation, a live rat was placed in an adjacent perforated, transparent chamber, allowing multisensory cues to reach the mouse for 5 minutes.

Mice allocated their time differently across near, middle, and far zones relative to the predator (Figures 3A, 3B, S3A-C), and their locomotion speed peaked in the middle zone when moving toward the far zone (Figures 3C and 3D). These patterns suggest a gradient of perceived risk: highest near the predator, moderate in the middle zone, and lowest in the far zone. Social context increased the locomotion speed in the far zone without altering time allocation (Figures S3D and S3E), echoing findings from the looming paradigm and indicating reduced anxiety.

Social context alleviates sustained predatory stress and fine-tunes defensive strategies across ranks.

(A) Heatmaps of average time allocation in near, center, and far zones during rat exposure. (B) Time spent in each zone per minute, normalized by zone area. Paired t-test; N = 22 mice. (C) Heatmaps of average locomotion speed, with arrows indicating average velocity vectors. (D) Speed in each zone. Paired t-test; N = 22 mice. (E) Representative trajectories of example mice displaying passive and active defense during rat exposure. (F) Distribution of behavioral categories during rat exposure. Chi-square test; N = 11 mice for each group. (G) Time spent on passive defense across time windows. Two-way ANOVA with post hoc Tukey’s range test; N = 11 mice for each group. (H) Longest freezing duration. Paired t-test; N = 11 mice for each group. (I) Time spent on active defense across time windows. Two-way ANOVA with post hoc Tukey’s range test; N = 11 mice for each group. (J) Approach frequency toward the rat. Paired t-test; N = 11 mice for each group. (K) Average investigation time toward the rat. Paired t-test; N = 11 mice for each group. *p < 0.05; *** p < 0.001.

To examine social modulation of specific behaviors, we grouped them into passive defense, active defense, social, and neutral categories (Figures 3E-F). Social context reshaped the distribution across these categories in both ranks and amplified rank differences (Figure 3F). This amplification was driven by a greater shift from passive to active defense in dominants under paired conditions(Figures 3G and 3I). Specifically, freezing decreased in both ranks, with a more pronounced reduction in dominants (Figures 3H and S3F-H). Approach frequency increased in both ranks (Figure 3J), while average investigation time—longer in dominants—remained unaffected by social context (Figure 3K). Together, these results indicate that social context alleviates sustained predator-induced stress while fine-tuning defensive strategies in a rank-dependent manner, paralleling effects observed in the looming assay.

Threat exposure reinforces social roles and promotes cohesive behavior

Having established how social context shapes defensive behaviors toward distinct threats, we next asked the reciprocal effect: how does threat exposure influence social behavior? We quantified both the total time spent on social behaviors and the average duration of social bouts (Figures 4A-D). Looming exposure increased both measures only in subordinates, whereas rat exposure affected both ranks, indicating a threat-specific modulation of social behaviors. In particular, during rat exposure, huddling emerged as the predominant social behavior across ranks (Figure 4E), likely serving to reduce individual risk and enhance collective security under sustained threat.

Threat exposure reinforces social roles and promotes cohesive behavior.

(A) Time spent on social behaviors within a 1-minute window before and after looming exposure. Paired t-test; N = 19, 20 mice for Dom and Sub group. (B) Average bout duration of social behaviors before and after looming exposure. Paired t-test; N = 19, 20 mice for Dom and Sub group. (C) Time spent on social behaviors during a 5-minute window before and during rat exposure. Paired t-test; N = 11 mice for both groups. (D) Average bout duration of social behaviors before and during rat exposure. Paired t-test; N = 11 mice for both groups. (E) Percentage of social time spent on huddling before and during rat exposure. Paired t-test; N = 11 mice for both groups. (F) Schematic illustrating social interactions. * denotes proactive social behaviors. (G-J) Social interactions in the looming paradigm: (G) Percentage of proactive social bouts across ranks. (H) Average duration of proactive bouts. (I) Response rate to proactive bouts. (J) Average duration of reactive bouts. Paired t-test; N = 17, 13 mice. (K-N) Same plots for the rat paradigm. N = 9, 9 mice. *p < 0.05; ** p < 0.01; *** p < 0.001.

To further examine how threat exposure alters the dynamics of social interaction, we analyzed proactive and reactive behaviors across ranks (Figure 4F). Looming exposure increased the proportion of proactive bouts in dominants but decreased it in subordinates (Figure 4G), with a similar trend during rat exposure (Figure 4K). Threats also lengthened proactive bouts in subordinates after looming exposure and in both ranks during rat exposure (Figures 4H and 4L). Moreover, only during rat exposure, proactive initiations by dominants elicited higher response rates from subordinates (Figures 4I and 4M), who in turn exhibited longer reactive social durations (Figure 4J and 4N).

These findings indicate that naturalistic threats, particularly sustained predator presence, enhance social engagement in a rank-dependent manner, potentially promoting cohesion and collective coping under threat.

Discussion

Our study introduces a behavioral paradigm to investigate how dominance hierarchy shapes innate defensive behaviors under distinct naturalistic threats (Figure 1). Using both transient looming stimulus and sustained rat exposure, we found that the presence of a social partner alleviates threat-induced stress in both dominant and subordinate mice, while fine-tuning their defensive strategies in a rank- and threat-dependent manner. Under looming threats, dominants showed stronger social modulation, with reduced freezing and faster recovery (Figure 2). During sustained rat exposure, social context promoted a shift from passive to active defense, again more prominently in dominants (Figure 3). Threat exposure also shaped social behaviors in a rank-dependent manner: dominants engaged more proactively, while subordinates became more responsive to dominant initiations, potentially reinforcing their social roles (Figure 4).

These findings broaden our understanding of how social context regulates fear responses, which has been largely studied in learned fear paradigms (Kikusui et al., 2006; Morozov and Ito, 2019). Our finding that conspecific presence reduces fear aligns with previous evidence across species, including zebrafish (Faustino et al., 2017), flies (Ferreira et al., 2022), rats (Bowen et al., 2013), monkeys (Testard et al., 2024), and humans (Coan et al., 2006). However, the role of social hierarchy in modulating innate fear has remained largely unexplored. Prior work has shown that dominant and subordinate rats behave differently when exposed to a predator (Blanchard and Blanchard, 1989), possibly reflecting the additional stress imposed on subordinates by their hierarchical status (Blanchard and Blanchard, 1990; Blanchard et al., 1993). Consistent with this, we found that dominants investigated predators longer than subordinates when tested alone. Yet the earlier study lacked paired versus single comparisons, leaving the role of social context unresolved. Our work addresses this gap, showing that defensive responses are jointly shaped by threat type and social rank, with an emphasis on survival-critical behaviors rather than fear or stress alone.

This rank-specific regulation likely has adaptive value for group survival. For transient threats, stronger fear reduction in dominants may allow leaders to recover rapidly and guide group decision-making. For sustained threats, the shift of dominants toward active defense mirrors natural patterns in which leaders take on greater risk-assessment responsibilities (Blanchard and Blanchard, 1989; Davis et al., 2009). Such role differentiation could enhance group survival by distributing vigilance and risk-taking across the hierarchy. Furthermore, the increase in social interactions following threat exposure likely reflects an evolutionarily conserved coping mechanism that strengthens group cohesion and collective security—a phenomenon observed across multiple species, including humans (Morris et al., 1976; Preston et al., 2011; Taylor, 1981; von Dawans et al., 2012).

What neural circuits mediate the social modulation of innate defensive behavior? We propose that the medial prefrontal cortex (mPFC) serves as a central hub in this process. Evidence from learned fear paradigms supports a modulatory role of the mPFC: it is densely interconnected with the amygdala and is essential for both the expression and extinction of conditioned fear (Marek et al., 2013; Sotres-Bayon and Quirk, 2010). Moreover, the mPFC is involved in social behavior and dominance hierarchy (Kingsbury et al., 2019; Wang et al., 2011). These findings indicate that the mPFC plays a key role in the social regulation of fear. Indeed, inhibition of the mPFC abolishes social buffering of fear responses (Lungwitz et al., 2014), whereas its activation can reproduce this buffering effect (Gutzeit et al., 2020).

By contrast, innate defensive behaviors are mediated by threat-specific subcortical circuits. Defensive responses to visual threats rely on the superior colliculus (SC) (Evans et al., 2018; Shang et al., 2015; Wei et al., 2015), whereas responses to predator odors or multimodal cues depend on the dorsomedial part of the ventromedial hypothalamus (VMHdm) (Silva et al., 2016). Importantly, the SC and VMHdm are not isolated but interconnected (Benavidez et al., 2021; Oh et al., 2014): the SC projects to VMHdm via distributed relay nodes, including the anterior hypothalamic nuclei (AHN), thalamus, and periaqueductal gray, and VMHdm sends direct projections back to the SC. This bidirectional connectivity positions VMHdm as a key integrator of internal fear state triggered by naturalistic threats. Crucially, VMHdm receives top-down modulation from the mPFC, relayed by the amygdala and AHN (Canteras, 2002; Hintiryan et al., 2025; Silva et al., 2016; Swanson, 2000). These findings raise the possibility that the mPFC regulates innate defensive behaviors by modulating neural activity in VMHdm and related subcortical circuits. Alternatively, the mPFC may function through parallel, modality-specific pathways. For instance, its direct projections to the SC (Benavidez et al., 2021) could selectively influence visually evoked defensive responses. Disentangling these models—convergent modulation of a unified fear state versus parallel control over distinct threat circuits—remains an important goal for future research.

One limitation of our study is the exclusive use of male mice, as the estrous cycles of female mice introduce additional variability that is difficult to control experimentally. Because female rodents show distinct defensive and social patterns under threat compared to males (Blanchard et al., 1991; Pentkowski et al., 2018), extending this paradigm to female mice—with careful control for estrous cycles—will provide a more comprehensive understanding of how hierarchy and social context shape defensive strategies.

In conclusion, our findings reveal that social context does not simply suppress fear but selectively tunes defensive and social behaviors according to both rank and threat type. This adaptive flexibility allows groups to manage risk while maintaining cohesion, paralleling collective coping strategies observed in humans and other animals. By providing a behavioral framework for probing the neural basis of social modulation of innate fear, our work opens new avenues for dissecting the interplay between social and defensive circuits. Given that maladaptive fear and social dysfunction often co-occur in neuropsychiatric disorders, these insights may inform mechanistic models of social-affective dysfunction and inspire new translational approaches.

Methods

All experimental procedures complied with animal welfare guidelines and were approved by the Institutional Animal Care and Use Committee at the Chinese Institute for Brain Research, Beijing.

Animal

Male C57BL/6J mice (8-12 weeks old) were pair-housed under a 12-h light/12-h dark cycle. Male Long-Evans rats (6 months old) were housed under the same light-dark cycle. All experiments were performed during the light phase. A total of 64 mice were used.

Arena design

The looming-exposure arena (48 (L)×48 (W) × 25 (H) cm) was constructed from infrared-transparent acrylic, with an overhead monitor (53 ×30 cm) to present visual stimuli. A prism-shaped shelter (20× 15 ×12 cm) was placed in one corner with its opening facing the monitor. Illumination was provided by two diagonally positioned infrared lamps. For real-time tracking, an OpenMV camera was placed 80 cm below the arena. A second infrared camera (LBAS-U350-74M, LUSTER LightTech) was placed 75 cm below the arena to record animal behavior at 30 Hz.

The rat-exposure arena (38.5 ×21× 40 cm) had three opaque acrylic walls and one infrared-transparent wall for video recording. The rat holding cage (18 ×14 ×35 cm) was made from transparent acrylic, with the wall facing the mouse perforated to allow visual, olfactory, and auditory cues. Behavior was recorded using two cameras: one overhead (75 cm above the arena floor) and one lateral (50 cm away from the infrared-transparent wall).

Tube Test

Social rank within each mouse pair was determined using the tube test. To minimize stress, each pair was co-housed for at least two weeks with a 15-cm tube placed in their home cage. Before testing, mice were trained to traverse a 30-cm tube over two consecutive days (10 trials per day), alternating entry from either end. On the test day, each mouse pair competed in up to seven trials using the same 30-cm tube, and the first mouse to win four trials was designated as the dominant. Social rank stability was reassessed one day after threat exposure, and only pairs with consistent ranks were included in subsequent analyses.

Threat Exposure

Looming exposure was conducted over two consecutive days using a counterbalanced design of single and paired trials. Half of the mice were exposed under single conditions on day 1 and paired conditions on day 2, with the order reversed for the other half. Each mouse underwent one 30-minute session per day, beginning with 10 minutes of free exploration. Looming stimuli were presented on a monitor suspended 25 cm above the arena. Each stimulus consisted of a dark disk (98% contrast on a grey background) that expanded from 1° to 20° of visual angle at 40°/s and remained at 20° for 0.25 s. Stimuli were triggered when a mouse entered a 13×13 cm zone beneath the monitor center. Each mouse could trigger up to 10 stimuli per session, with a minimum inter-stimulus interval of two minutes to prevent habituation to the looming. A total of 40 mice were used.

Rat exposure followed the same two-day, counterbalanced design. Each session began with 5 minutes of habituation in the arena, followed by 5 minutes of exposure to a live rat. A total of 24 mice were used.

Animal tracking

In the looming paradigm, seven key points on each mouse were tracked using Deeplabcut (Mathis et al., 2018): nose, left ear, right ear, neck, spine, tail base, and tail middle. The model was trained on a dataset of 1000 labeled frames. Only data points with a likelihood greater than 0.9 and instantaneous speed below 200 cm/s were used for analysis, and missing values were linearly interpolated. In the rat paradigm, mouse coordinates were extracted from recorded videos using EthoVisionXT (Noldus).

Heatmap of time allocation and speed distribution

The arenas were divided into 2× 2 cm grid cells. For each cell, the animal’s velocity vectors, speed, and occupancy time were calculated and then averaged across all animals. For visualization, grid cells with a total occupancy time of less than 0.17 s or fewer than five visits per mouse were excluded.

Behavioral zones were identified using a data-driven approach. In the looming arena, the edge zone width was defined at the elbow point of the “time in edge zone” curve (Figure S2A). In the rat arena, the far zone boundary was set at the elbow point of the “time in far zone” curve (Figure S3A), while the near zone boundary was determined at the stable point of the “near-middle zone transition” curve (Figure S3B). Time allocation and speed were subsequently calculated for each zone.

Behavioral annotation

Behavioral annotation was performed using BENTO (Segalin et al., 2021). Four behaviors were annotated for both paradigms: freezing (complete stillness for0.5 s), sniffing (nose twitching while investigating the environment), grooming (using mouth or paws to clean the fur or skin), and tail rattling (vigorous tail shaking in a crouched or alert posture). Paradigm-specific behaviors were also annotated. For the looming exposure paradigm, we annotated up-stretch (extending the body toward the screen with stationary hind limbs), rearing (lifting forelimbs off the ground while facing the screen), and escape (fleeing away from the looming stimulus). For the rat exposure paradigm, we annotated approach (moving toward the rat), investigation (nose contact with the rat cage or remaining within 5 cm), withdrawal (retreating from the rat), and stretch-attend (extending the body toward the rat while stationary). Additionally, in paired conditions, five social behaviors were annotated: approaching partner, sniffing partner (nose-directed investigation of the partner’s face, body, or tail), grooming partner, following partner, and huddling (remaining close to the partner without engaging in other social behaviors). The remaining unannotated behaviors were grouped as other neutral solitary behaviors.

Behavior transitions

The sequences of annotated behaviors were extracted for each animal. A transition was defined when two consecutive behaviors occurred within < 1 s; intervals1 s were classified as transitions to other neutral solitary behaviors. Individual transition matrices were computed for each animal and then averaged to generate the overall transition matrices (Figures 1D, S1C, and S1D). Transition difference matrices (Figure 1E) were obtained by subtracting transition probabilities in the single condition from those in the paired condition and averaging across animals.

In Figures 1D and 1F, node size increased with average bout duration (T) of each behavior according to the equation r = 0.01 + 0.05 ln(1 + T) (with T > 0), and edge thickness indicated the transition probability.

Behavioral analysis

Freezing subtypes in rat exposure

To examine the relationship between freezing stability and social interaction, freezing behavior was classified into three mutually exclusive subtypes (Figure S2I). Type 1 freezing was characterized by the absence of any overlap between mouse A’s freezing and mouse B’s social behavior, and without initiation of social behavior by mouse A within 1 s after freezing termination. Type 2 freezing was characterized by an overlap between mouse A’s freezing and mouse B’s social behavior. Type 3 freezing denoted cases in which mouse A engaged in social behavior within 1 s after its freezing ended.

Quantification of social interactions

To quantify the social interactions, we first merged individual social behaviors occurring within 1 s into social episodes. A social interaction was then defined as a pair of social episodes—one from each mouse—that either overlapped or were separated by a gap of 1 s. Based on the temporal sequence of behavior initiation, interactions were classified into six types reflecting asynchronous initiation, with the initiating mouse designated as the proactive individual (Figure 4F). The proactive bout response rate was calculated as the proportion of proactive bouts that received a response.

Quantification and statistical analysis

No statistical methods were used to predetermine the sample size. Data normality was assessed using the Shapiro-Wilk test. For normally distributed data, paired t-tests were applied; otherwise, Wilcoxon signed-rank tests were used. ANOVA with post-hoc tests was applied to assess the effects of time and social variables. Details of the statistical tests are provided in the figure legends and the Results section.

Resource availability

Materials availability

This study did not generate new unique reagents.

Supplemental information

Additional details related to the Results and Methods sections are provided below.

Behavior during habituation and additional information related to transition maps.

(A-B) Representative raster plots of behaviors during the habituation phase in single and paired exposures. (C-D) Transition probabilities between behavior pairs. Looming, N = 40 mice; rat, N = 22 mice.

Characterization of looming-evoked defensive behaviors.

(A) Time in the edge zone (green) and transitions between edge and center zones (gray) plotted against edge width. The green circle marks the elbow point, which was selected as the edge width for analysis in Figure 2. N = 39 mice. (B) Percentage of time spent in each zone across different time windows. (C-E) Difference (pair - single) of time spent in each zone during baseline (C), early (D), and late (E) phases. N = 20 mice for both dominant and subordinate groups. (F, G) Difference (pair - single) of speed in each zone during baseline and late phases. F: N = 20 mice; G: N = 17, 16, 13 mice. (H) Distribution of social time inside and outside the nest zones. N = 40, 39 for baseline and post-looming, respectively. (I) Illustration of three freezing types. Type 1 illustrates isolated freezing; type 2 illustrates freezing that overlapped with the partner’s social behavior; type 3 illustrates freezing that was followed by the animal’s own social behavior. (J, K) Percentage and duration of the three freezing types during the first freezing episode in dominant and subordinate mice. N = 14, 3, 4 mice in J and N = 16, 3, 3 mice in K. (L) Time allocation for three types of grooming. N = 20 mice for all groups. *p < 0.05; ** p < 0.01; *** p < 0.001.

Characterization of rat evoked defensive behaviors.

(A) Time in the far zone (blue) and transitions between the far and the non-far zones (gray) plotted against far zone width. The blue circle marks the elbow point, which was selected as the far zone width for analysis in Figure 3. N = 22 mice. (B) Time in the near (orange) and middle (green) zones and transitions between near and middle zones (gray) plotted against near zone width. The gray circle marks the stable point, which was selected as the near zone width for analysis in Figure 3. N = 22 mice. (C) Percentage of time spent in each zone during rat exposure. N = 22 mice. (D, E) Difference (pair - single) in time spent and speed across zones during rat exposure. N = 11 mice for each group. (F) Total freezing time. N = 11 mice for each group. (G-H) Percentage and duration of the three freezing types during the maximum freezing in dominant and subordinate mice. N = 7, 3, 1 mice in G and N = 11 mice in H. *p < 0.05; ** p < 0.01; *** p < 0.001.

Data availability

Data and code will be available in a public repository upon acceptance of the manuscript.

Acknowledgements

Ling-yun Li is supported by the Natural Science Foundation of Beijing Municipality (5244028), the National Natural Science Foundation of China (32471071), and the R&D Program of Beijing Municipal Education Commission (1240030201). Ya-tang Li is supported by the National Natural Science Foundation of China (32271060), the Natural Science Foundation of Beijing Municipality (IS23073), and the start-up fund from CIBR.

Additional information

Author contributions

Ling-yun Li and Ya-tang Li supervised the project; Ling-yun Li, Xinjian Gao, and Ya-tang Li designed the experiments; Xinjian Gao collected the data; Xinjian Gao and Ling-yun Li analyzed the data; Ling-yun Li and Ya-tang Li wrote the manuscript.

Funding

北京市科学技术委员会 | Natural Science Foundation of Beijing Municipality (北京市自然科学基金) (5244028)

  • Ling-yun Li

MOST | National Natural Science Foundation of China (NSFC) ((32471071)

  • Ling-yun Li

MOST | National Natural Science Foundation of China (NSFC) (32271060)

  • Ya-tang Li