Introduction

The CeA is comprised of multiple genetically distinct cell types that contribute to both appetitive and aversive processes (Cai et al., 2014; Douglass et al., 2017; Fadok et al., 2018; Hardaway et al., 2019; Haubensak et al., 2010; Isosaka et al., 2015; Kim et al., 2017; Li et al., 2013; McCullough et al., 2018; Warlow et al., 2020; Yu et al., 2017).

Subsets of cells in the CeA encode conditioned and/or unconditioned fear stimulus information (Ciocchi et al., 2010; Duvarci et al., 2011; Fadok et al., 2017; Li et al., 2013; Sanford et al., 2017; Yang et al., 2023; Yu et al., 2017), as well as appetitive information (Douglass et al., 2017; Hardaway et al., 2019; Yang et al., 2023). Plasticity within neurons of the CeA (Fu & Shinnick-Gallagher, 2005) contributes to both fear-related learning (Li et al., 2013; Penzo et al., 2014; Sanford et al., 2017) and reward-associated learning (Yang et al., 2023). Cells implicated in fear processing have also been shown to regulate consummatory behaviors (Cai et al., 2014; Douglass et al., 2017; Yang et al., 2023; Yu et al., 2017), suggesting that subsets of CeA neurons encode either incentive salience (the significance of the stimulus regardless of valence) or valence (whether it is a positive or negative outcome).

Specific subsets of neurons within the CeA have been shown to contribute to multiple aspects of appetitive and aversive behaviors (Balleine & Killcross, 2006; Kong & Zweifel, 2021; Pignatelli & Beyeler, 2019) and it was recently shown that subpopulations of CeA neurons provide scalar signals to oppositely valenced stimuli to promote learning (Yang et al., 2023). However, the full extent to which the CeA encodes the salience or valence of positive and negative affective information remains unresolved.

To address the extent of valence and salience encoding within the CeA, we used single cell calcium imaging to longitudinally track neurons during Pavlovian reward and Pavlovian fear conditioning. We found that the majority of CeA neurons are responsive to either the reward or the fear US. Although a subset of cells displays salience-like encoding of the US, most CeA neurons were selectively responsive to the valence of the US. We observed six distinct types of valence encoding that was either selective for one or the other USs or oppositely encoded US information. Salience and valence encoding was also observed in response to a reward- or fear-associated CS, but the magnitude of these responses and the number of cells responding to the CSs were considerably smaller than the responses observed to the USs. These data indicate that the CeA encodes multiple aspects of positive and negative reinforcing stimuli, but the prevailing responses relate to the encoding of the valence of the US.

Results

To monitor calcium dynamics in CeA neurons during positive and negative reinforcement, we selectively expressed GCaMP6m in GABAergic neurons of Vgat-Cre mice (4 males and 6 females) and implanted a gradient-index (GRIN) lens in the CeA (Figure 1A and Figure 1—figure supplement 1). Mice were conditioned in both Pavlovian appetitive and Pavlovian fear paradigms, with the conditioning order counterbalanced (Figure 1B). During appetitive learning, mice demonstrated a significant increase in time spent near the food hopper during the food-predicting CS (CSFood), reduced latency to retrieve the food pellet, and an increased success rate in procuring the reward (Figure 1C). During fear conditioning, the animals learned that the shock-predicting CS (CSShock) was followed by an impending foot shock and displayed increased freezing behavior to the CSShock as trials progressed (Figure 1D).

Acquisition of calcium signals during Pavlovian appetitive and fear conditioning.

A, CeA-GABAergic neurons were labelled with GCaMP6m, and their activity was recorded using a miniature microscope (Inscopix) via an implanted GRIN lens (left). A representative image of GCaMP6m expression and lens placement is shown on the right. Scale bar, 0.5 mm. B, Behavioral paradigm of the baseline, appetitive, and fear conditioning. To counterbalance the order of the two valence conditioning paradigms, there were two groups: appetitive → fear (5 mice) and fear → appetitive (5 mice) after the baseline session. C, Time spent near the food hopper during CSFood (left, day: F = 7.422, P = 0.0005), latency to procure a pellet (middle, day: F = 20.41, P < 0.0001), and success rate (right, day: F = 14.69, P = 0. 0017) over 10 days of appetitive learning (mean ± s.e.m., grey lines represent individual data, n = 10). D, Freezing behavior during CSShock (trial: F = 13.49, P < 0.0001) throughout 10 trials of fear conditioning (mean ± s.e.m., grey lines represent individual data, n = 10). Detailed information about statistical results is provided in Supplementary Table 1.

During conditioning, we observed responsive and non-responsive cells to both the appetitive and aversive US (Figure 2A). To resolve event-related calcium signals, we developed a variation of the ‘circular shift’ method27 to stringently define cells with statistically significant responses (see Methods for detailed description). In short, we used circular shifting to generate artificial “null” calcium traces resembling a sample from a hypothetical population of neuron traces unrelated to the exact time of behavior events (Step 1, Figure 2B). Wilcoxon rank sum tests (comparing pre-stimulus vs. post-stimulus activity) were performed on recorded traces and “null” traces and summed across trials (Step 2 and Step 3, Figure 2C,D) to create a single test statistic for each neuron. P-values were obtained by comparing the summed Wilcoxon rank sum test statistics from actual data against the summed Wilcoxon rank sum test statistics from the artificially generated null distribution (Step 4, Figure 2E).

Determination of CeA responses to appetitive and fearful stimuli.

A. Left: Example traces of CeA neurons that were responsive (upper three traces) and not responsive to food reward (bottom three traces). Right: Example traces of CeA neurons that were responsive (upper three traces) and not responsive to foot shock (bottom three traces). B, Step 1: Defining the “circular shift” operation. A neuron is randomly selected from the recorded neuron pool in our current study (denoted as Y). The calcium trace of the selected neuron is subjected to a circular shift operation, wherein it is moved from a randomly chosen time point (red bar). This operation results in a new calcium trace, as shown by the movement of the blue bar in Figure 2B; the traces that initially start with blue bars become red bar starting traces. C, Step 2: Creating a repository of test statistics for null data. A neuron is selected at random; then, the activity in each of its trials (20 trials for appetitive or 10 trials for fear conditioning, X = the number of trials) undergoes ‘circular shifting’, where a random point (red bar) is chosen within the circular shifting range. Then, on each trial, the Wilcoxon rank sum test between pre-stimulus vs. post-stimulus periods is computed. The final test statistic Wb representing a summary of all trials is obtained by summing the individual Wilcoxon rank sum test statistics over the trials with . Step 2 is repeated B times (we used B = 500), generating a null distribution of summed statistics . D, Step 3: calculating observed test statistics. Each observed neuron receives a summary test statistic obtained by summing the Wilcoxon rank sum test statistics from the individual trials. E, Step 4: Computing p-values. A p-value for the ith neuron comes from a comparison of For the ith neuron, p+i (the number of ) and pi (the number of divided by B+1) are calculated. The final p-value for the ith neuron (denoted as pi) is 2 times the lesser of p+i and pi. A detailed description of this statistical analysis is provided in Methods.

During Pavlovian appetitive conditioning, alignment to the cue presentation revealed no responsive cells to the CSFood or food delivery on day 1 (Figure 3A, top). However, on day 10, numerous cells were identified that were responsive to food delivery with either increases or decreases in calcium signals (Figure 3A, bottom).

Responses of CeA neurons during Pavlovian appetitive conditioning.

A, Top: Heat maps of CeA neurons aligned to CSFood onset (top left, 1078 neurons) and head entry (top right) from day 1 of Pavlovian appetitive conditioning. Bottom: Heat maps of CeA neurons aligned to CSFood onset (bottom left, 872 neurons) and head entry (bottom right) from day 10 of Pavlovian appetitive conditioning. Solid mint lines indicate CSFood, and a dotted darker mint line represents food delivery. Black dotted line represents the first head entry after food delivery. B, Proportion of head entry responsive neurons between day 1 (top) and day 10 (bottom). C, Left: The average Z- scored activity of head entry-excited neurons on day 1 (147 neurons) and day 10 (307 neurons) of appetitive conditioning during -10 s to 10 s after the first head entry of each reward delivery. The dark lines and shaded areas indicate the mean and standard error of the mean (s.e.m.). Right: Average area under the curve (AUC) for the Z-scored activity after head entry on day 1 compared to day 10 of appetitive conditioning (0-5 s after head entry, mean ± s.e.m.). D, Left: The average Z-scored activity of head entry- inhibited neurons on day 1 (104 neurons) and day 10 (229 neurons) of appetitive conditioning during -10 s to 10 s after the first head entry of each reward delivery. Right: Average AUC for the Z-scored activity after head entry on day 1 compared to day 10 of appetitive conditioning (0-5 s after head entry). E, Left: Proportion of CSFood -excited (orange), CSFood -inhibited (blue), and not significant neurons (grey) on day 10 of appetitive learning (total 872 neurons). Right: Heat maps of CSFood-excited neurons (top, n = 62) and CSFood-inhibited neurons (bottom, n = 50) from all trials (20 trials). Solid mint lines indicate CSFood onset and offset. F, The average Z-scored activity of each response type (orange, CSFood-excited; blue, CSFood-inhibited; grey, not significant). The dark lines and shaded areas represent the mean and s.e.m. The mint area represents 10 s of CSFood. G, Left: Proportion of food-excited (orange), food- inhibited (blue), and not significant neurons (grey) on day 10 of appetitive learning (total 872 neurons). Right: Heat maps of food-excited neurons (top, n = 345) and food- inhibited neurons (bottom, n = 241) from all trials (20 trials). The dotted line indicates a food delivery H, The average Z-scored activity of each response type (orange, food- excited; blue, food-inhibited; grey, not significant). The dark lines and shaded areas represent the mean and s.e.m. ***P < 0.001, ****P < 0.0001. Detailed information about statistical results is provided in Supplementary Table 1.

Analysis of responses aligned to food retrieval (head entry) revealed responsive cells on both day 1 and day 10 (Figure 3B). The number of cells showing increased calcium to head entry and the magnitude of the increase was larger on day 10 compared to day 1 (Figure 3B-D). Of the 872 cells recorded on day 10 of conditioning, a small proportion of cells were responsive to CSFood presentation, showing similar proportions of cells with increased or decreased calcium signals (Figure 3E,F). Of these CSFood responsive cells, the majority were responsive to both the CS and the food delivery (Supplementary Data Figure 2A,B). In contrast to the CSFood responsive cells, a large number (64%) of CeA neurons were responsive to food delivery, with the largest proportion of cells showing excitatory responses (40%) compared to inhibited responses (24%) (Figure 3G,H).

Additional analysis of CeA neuron responses on day 10 of Pavlovian appetitive conditioning revealed that there was a trend toward decreased responsiveness to the CSFood late in conditioning compared to early in the excited neurons and a significant increase in the inhibitory response in late conditioning compared to early (Figure 3— figure supplement 1C,D). In response to food delivery, no differences were observed in food-excited neurons; however, a small but significant difference was observed in food- inhibited cells with an increase in the magnitude of the inhibited response late in conditioning compared to early (Figure 3—figure supplement 1E,F).

During Pavlovian fear conditioning, alignment of calcium signals to the CSShock revealed that the greatest responses were to the US presentation (Figure 4A). Of the 519 cells recorded, a small percentage were either excited or inhibited by the CSShock (Figure 4B,C). A large number of cells (42%) were responsive to the shock US with the largest proportion showing excitations (30%) compared to inhibitions (12%) (Figure 4D,E). Of the CSShock responsive cells, an approximately equal number were responsive to the CSShock only or the CSShock and USShock (Figure 4—figure supplement 1A,B). In contrast to the CSFood responsive cells during day 10 of Pavlovian appetitive conditioning, we did not observe any changes in the CSShock responsive cells during early compared to late conditioning (Figure 4—figure supplement 1C,D). However, shock-excited CeA neurons showed a significant attenuation of the excited response in late conditioning compared to early conditioning (Figure 4—figure supplement 1E). No changes were observed in shock-inhibited cells (Figure 4—figure supplement 1F).

Responses of CeA neurons during Pavlovian fear conditioning.

A, Heat maps of CeA neurons aligned to CSShock onset (519 neurons) from day 1 of Pavlovian fear conditioning. Solid orange lines indicate CSShock, and a dotted red line represents shock delivery. B, Left: Proportion of CSShock-excited (orange), CSShock-inhibited (blue), and not significant neurons (grey) on day 1 of fear conditioning (total 519 neurons). Right: Heat maps of CSShock-excited neurons (top, n = 19) and CSShock-inhibited neurons (bottom, n = 24) from all trials (10 trials). Solid orange lines indicate CSShock onset and offset. C, The average Z-scored activity of each response type (orange, CSShock-excited; blue, CSShock-inhibited; grey, not significant). The dark lines and shaded areas represent the mean and s.e.m. The orange area represents 10 s of CSShock. D, Left: Proportion of shock-excited (orange), shock-inhibited (blue), and not significant neurons (grey) on day 1 of fear conditioning (total 519 neurons). Right: Averaged heat maps of shock-excited neurons (top, n = 157) and shock-inhibited neurons (bottom, n = 62) from all trials (10 trials). A dotted red line represents shock delivery. E, The average Z-scored activity of each response type (orange, shock-excited; blue, shock-inhibited; grey, not significant). The dark lines and shaded areas represent the mean and s.e.m.

Qualitatively, food-excited and shock-excited neurons exhibited distinctive properties. Food-excited neurons showed more sustained activity in response to food, and their time to peak activity occurred significantly later than that of shock-excited neurons, likely reflecting the longer time needed to consume food compared to the passive delivery of the shock (Figure 5—figure supplement 1A). Additionally, the maximum Z-score of food-excited neurons was larger than that of shock-excited neurons, indicating that food was more salient for the CeA (Figure 5—figure supplement 1B).

Salience and valence encoding in the CeA.

A, Among 872 neurons from appetitive conditioning and 519 neurons from fear conditioning, 303 neurons were registered during both learning. Heat maps of these 303 neurons during -10 s to 25 s after CSFood onset from appetitive (left) and during -10 s to 25 s after CSShock onset from fear conditioning (right). All neurons are aligned to their activity to food. The same neuron is represented in the same row. Solid mint lines indicate CSFood, and a dotted darker mint line represents food delivery, solid orange lines indicate CSShock, and a dotted red line represents shock delivery. B, Top: the proportion of significant neurons to food and shock (both; white), food-only (blue), shock-only (red), and not significant to both (grey). Bottom: detailed response types of all possible categories (excited, inhibited, not significant) for food vs. shock. White represents salience-encoding neurons showing the same response types to food and shock (n = 46, 15%), and black represents valence-encoding neurons showing different response types to food and shock (n = 198, 65%). Grey represents not significant neurons (n = 59, 20%). C, Salience-encoding neurons: the average Z-scored activity of neurons that were excited to both food and shock (n = 36, left) and inhibited to both food and shock (n = 10, right). Inserted bar graphs indicate average AUC of the Z-scored activity after food and shock delivery (0-10 s, mean ± s.e.m.). D, Valence-encoding neurons: the average Z-scored activity of neurons that were excited to food but inhibited to shock (n = 16, left) and inhibited to food but excited to shock (n = 25, right). Average AUC of the Z-scored activity after food and shock delivery are shown in inserted bar graphs (0-10 s, mean ± s.e.m.). E, The average Z-scored activity of neurons that were excited to food but not responsive to shock (n = 60, first), neurons that were inhibited to food but not responsive to shock (n = 50, second), neurons that were not responsive to food but excited to shock (n = 34, third), and neurons that were not responsive to food but inhibited to shock (n = 13, fourth). Inserted bar graphs indicate average AUC of the Z- scored activity after food and shock delivery (0-10 s, mean ± s.e.m.). The dark lines and shaded areas represent the mean and s.e.m. F, Proportion of significant neurons to CSFood and CSShock (both; white), CSFood-only (mint), CSShock-only (orange), and not significant to both (grey). G, Detailed response type of all possible categories (excited, inhibited, not significant) for CSFood vs. CSShock. White represents salience-encoding neurons showing the same response types to CSFood and CSShock (n = 7, 2%), and black represents valence-encoding neurons showing different response types to CSFood and CSShock (n = 57, 19%). Grey represents not significant neurons (n = 239, 79%). *P < 0.05, ****P < 0.0001. Detailed information about statistical results is provided in Supplementary Table 1.

To categorize cells as salience or valence encoding, we identified 303 neurons that appeared during both appetitive and fear conditioning (Figure 5A). Salience- encoding neurons (see Methods for detailed definition) were defined as those showing both excited or inhibited responses to food and shock, and comprised 15% of the total neurons (Figure 5B,C). In contrast, valence-encoding neurons were defined as those displaying differential activity to food and shock and represented 65% of the neurons (Figure 5B-E). Of these, 13.5% showed opposite responses to food or shock while the remaining 51% showed selective responses to one or the other USs (Figure 5D,E). The remaining 20% were categorized as non-responsive. These findings demonstrate that CeA neurons encode either the valence or the salience of the US, with the valence encoding being more prevalent.

To categorize salience- and valence-encoding neurons based on their responses to CSFood and CSShock, we analyzed the 303 registered neurons recorded during both reward and fear conditioning sessions (Figure 5F,G and Figure 5—figure supplement 1C,D). Only 2% of neurons were classified as salience-encoding, while 19% were identified as valence-encoding neurons. Although representing a significantly smaller proportion of CS encoding neurons compared to the US encoding neurons (CS encoding neurons: salience = 7, valence = 57, not significant = 239; US encoding neurons: salience = 46, valence = 198, not significant = 59; Χ2= 215.4, P < 0.0001, df = 2), these findings demonstrate that encoding of the valence of the CS is also the predominant response type of the CeA neurons.

It is possible that the low number of cells responsive to the CSShock during conditioning reflects the identification of these cells during acquisition as opposed to fear memory retrieval. To address this, we analyzed CeA neuron responses to the CSFood and CSShock twenty-four hours following fear conditioning (post-test) and compared these responses to a baseline pre-conditioning session. The number of responsive cells during the post-test was less than those observed during conditioning and did not differ from the proportion observed prior to conditioning (Figure 5—figure supplement 1E-J). Another possible reason for the fewer than expected CSFood and CSShock responsive cells is the analysis we used to classify these neurons. To address this, we used a more conventional Wilcoxon sign rank test on each trial relative to the pre-CS period combined with distribution cutoff (Figure 5—figure supplement 2A-C).

The number of CeA neurons excited or inhibited by the food US or shock US was similar to what was identified using the modified wrapping method (Figure 5—figure supplement 2D-G). Likewise, the number of cells responsive to the CSFood was similar (Figure 5—figure supplement 2J,K). CeA neurons excited or inhibited by the CSShock were more prevalent using the sign rank method compared to the wrapping method (10% excited and 13% inhibited vs. 4% excited and 5% inhibited) (Figure 5—figure supplement 2L,M). These marginal differences indicate that the classification method is not a major contributing factor to the observed results and confirm that CeA neurons as a whole are more responsive to the US than to the CS.

We next asked whether the order of valence conditioning (appetitive → fear or fear → appetitive) had any effect on the encoding of subsequent valence conditioning. Among the 303 registered neurons, 165 neurons belonged to the appetitive → fear group (Figure 5—figure supplement 3A), and 138 neurons were from the fear → appetitive group (Figure 5—figure supplement 3E). Our analysis revealed the following key findings: i) CeA neurons were more responsive to food compared to shock regardless of the conditioning order (Figure 5—figure supplement 3B,F), ii) the ratios of salience-, valence-encoding, and not significant neurons between the two groups were not significantly different (appetitive → fear group US: salience = 22, valence = 115, not significant = 28 vs. fear → appetitive group US: salience = 24, valence = 83, not significant = 31, Χ2= 3.029, P = 0.2199, df = 2, Figure 5—figure supplement 3B,F; appetitive → fear group CS: salience = 2, valence = 33, not significant = 109 vs. fear → appetitive group CS: salience = 4, valence = 35, not significant = 120, Χ2= 0.5126, P = 0.7739, df = 2, Figure 5—figure supplement 3C,G), and iii) the conditioning order did not preferentially recruit CeA neurons based on their topographical locations (Figure 5— figure supplement 3D,H), indicating that neurons encoding salience or valence were intermingled.

Finally, we investigated whether the responses to the USs or CSs were qualitatively biased by the initial valence conditioning experience. We found that the response to food before shock (appetitive → fear) was not significantly different from the response to food after the shock experience (fear → appetitive, Figure 5—figure supplement 3I). Similar results were observed for shock, CSFood, and CSShock responses (Figure 5—figure supplement 3J-L), suggesting that the encoding of positive or negative stimuli in CeA neurons is not influenced by the previous experience with opposing stimuli.

Discussion

The CeA is a principally GABAergic structure, allowing us to image the bulk of CeA neurons through conditional expression of GCaMP in Vgat-Cre mice. By imaging a total of 10 mice, we were able to achieve lens placements that largely covered the extent of the dorsal-ventral axis of the CeA. Interestingly, although the CeA is demarcated by functionally distinct subdivisions and genetically distinct cell types, we found that cells responsive to reward and/or fear were intermingled throughout the structure.

The CeA has been proposed to encode both salience and valence (Fadok et al., 2018; Kong & Zweifel, 2021; Pignatelli & Beyeler, 2019), which is supported by studies performing bulk or single cell imaging or recording in the CeA during appetitive or aversive behaviors (Ciocchi et al., 2010; Douglass et al., 2017; Duvarci et al., 2011; Fadok et al., 2017; Hardaway et al., 2019; Li et al., 2013; Sanford et al., 2017; Yang et al., 2023; Yu et al., 2017). The definition of salience or valence encoding is often poorly defined, and the terms are frequently used interchangeably. Moreover, with the exception of a recent study (Yang et al., 2023), analysis of specific cell types has not included both an appetitive and aversive stimulus to effectively resolve at the single cell level salience versus valence encoding. For salience encoding, we defined these cells as responding in the same direction to both the appetitive or aversive stimulus as described previously (Gao et al., 2020; Lin & Nicolelis, 2008; Steinberg et al., 2020; Zhu et al., 2018). Valence encoding cells were defined as cells responding in either the opposite direction to positive or negative stimuli, or selectively responding to one or the other (Douglass et al., 2017; Isosaka et al., 2015; Yu et al., 2017). Although we observed numerous examples of distinct types of salience and valence encoding cells, the majority of neurons within the CeA were similar to what we previously defined as Type 1 valence neurons (Kong & Zweifel, 2021), i.e., they respond selectively to either the positive or the negative valence of the US.

Consistent with observations reported for learning-dependent changes in somatostatin expressing neurons of the CeA (Yang et al., 2023), we observed increased responsiveness in excited neurons and the number of excited neurons of the CeA to the food US on day 10 compared to day 1 of conditioning. Within the last session of Pavlovian appetitive conditioning, we observed enhanced responses in cells inhibited by the food US and CSFood and diminished excitatory response to the CSFood. These results may reflect satiety within the session. Indeed, neurons within the CeA have been shown to play important roles in the regulation of feeding cessation (Cai et al., 2014). We did not record calcium dynamics in CeA neurons across multiple days of fear conditioning; however, we did observe a within session decrease in the amplitude of fear US excited cells consistent with a desensitization of these neurons (Yu et al., 2017).

Numerous studies have identified CeA neurons that respond to the CS following conditioning (Ciocchi et al., 2010; Duvarci et al., 2011; Fadok et al., 2017; Li et al., 2013; Sanford et al., 2017; Yu et al., 2017). We also observed cells that responded to the CS; however, it was evident that these responses occurred in a much smaller number of cells compared to the US responding and with a smaller amplitude. This is consistent with what has been reported previously for specific cell types within the CeA (Yang et al., 2023; Yu et al., 2017) and does not discount the previously defined importance of plasticity within these cells for fear-related learning (Li et al., 2013; Penzo et al., 2014; Sanford et al., 2017). Our findings do suggest however that the CeA as a whole is largely tuned to the valence of the US with approximately equal encoding of both positive and negative valences.

Methods

Animals

Male and female VgatIRES-Cre (Slc32a1tm2(cre)Lowl/J; JAX strain #: 016962) mice were group-housed on a 12h-light/12h-dark cycle (lights on 7 AM) with ad libitum access to food and water until surgery and behavioral experiment. All experiments were conducted during the light cycle and strictly followed the guidelines set by the University of Washington Animal Care and Use Committee, ensuring ethical treatment of the animals.

Surgery and Virus

Under isoflurane-induced anesthesia, 12-16 week old VgatIRES-Cre mice at the time of surgery were placed in a stereotaxic instrument (Kopf) and injected with 0.5 ul of AAV1-FLEX-GCaMP6m (produced in-house with a titer of ∼ 3 Χ 1012 particles/ml (Gore et al., 2013)). The injection was made in the right CeA (AP: -1.2 mm, ML: 2.9 mm, DV: -4.6 mm) at a rate of 0.25 ul/min. Following virus injection, mice were implanted with a gradient-index lens (GRIN lens with baseplates attached, 0.6mm diameter, 7.3 length; Inscopix) at the virus injection site. The GRIN lens was fixed with black dental cement (Lang Dental) with anchoring screws (Antrin Miniature Specialties). Four weeks after the surgery, animals were placed on a standard food restriction schedule with free access to water until they reached ∼ 85% of pre-operation weights. Behavioral experiments began 5 weeks after surgery.

Behavioral paradigms

Throughout the experimental sessions (baseline, appetitive Pavlovian conditioning, Pavlovian fear conditioning, post-learning test; Figure 1B), the mice maintained their body weights at ∼ 85% of their pre-operation weights. All sessions were conducted in the same operant chamber (21.6 Χ 17.8 Χ 12.7 cm) equipped with a house light, a speaker, a metal bar for fear Pavlovian conditioning, and a food dispenser for appetitive Pavlovian conditioning (MedAssociates). The operant chamber was placed in a sound-attenuating box, and each session had distinct contextual cues based on its type. Random assignment of mice was done to either the appetitive → fear or fear → appetitive group, indicating the order of valence conditioning.

Baseline: Prior to any conditioning, we assessed the basal freezing behavior and calcium activity in response to CSFood and CSShock were measured. Two CSs with different frequencies of CSs (either 4 kHz or 12 kHz, 10 s each; counter-balanced) were delivered 10 times, alternating with a 90 s inter-trial interval (ITI). The contextual cues for the baseline session consisted of white walls and floor.

Pavlovian appetitive Conditioning: During this session, CSFood was paired with a pellet (20 mg sucrose pellet, Bioserv) for 20 trials per day, conducted over a period of 10 days. A 3-s delay was introduced between CSFood and the presentation of the food pellet to distinguish the offset of CSFood from the onset of food delivery. The ITI was set to 90 s. The floor of the chamber was covered with a white plastic panel, while the walls were kept transparent. The chamber was cleaned with a chlorine dioxide-based sterilant (Clidox-S) between each animal.

Pavlovian fear conditioning: In this session, CSShock was paired with a foot shock (0.5 mA) for 10 trials, conducted for 1 day. Similar to the appetitive conditioning, a 3-s delay was introduced between CSShock and the delivery of the foot shock to distinguish the offset of CSShock from the onset of shock. The contextual cues during this session included white walls, a grid floor for shock delivery, and a 1% acetic acid odor cue. The chamber was cleaned with 70% ethanol between each animal.

Pre-processing calcium imaging data

One week prior to the start of the experiment, imaging parameters such as focal planes and LED power were calibrated by screening calcium activity from GCaMP6m-expressing CeA GABAergic neurons. The screening session involved checking calcium signals using nVoke miniscope (Inscopix) at two focal planes (multiplane imaging) with LED power set at 40−70% depending on the GCaMP6m expression level. Calcium activity was acquired at 10 Hz per plane (20 Hz for alternating acquisition), and this final temporal resolution was used for the imaging data without further down-sampling. The fixed pre-set focal planes and LED power were maintained throughout the entire experiment to ensure consistency.

To prevent prolonged exposure to the LED light, the Med Associates chamber sent a TTL pulse to turn on the LED 30 s before the CS onset and turn it off 30 s after the CS onset. Trial-structured multiplane imaging data were pre-processed through sequential concatenation and spatial down-sampled (spatial factor 4) using Inscopix Data Processing Software (IDPS). The IDPS was then utilized for the subsequent data processing steps, including motion correction, cell identification, and cell registration between planes or days. The following steps were followed: 1. Motion correction was performed multiple times as necessary until the image stabilized. 2. The motion- corrected TIFF (tag image file format) file was reloaded for easier processing of multiplane registration. 3. Multiplane registration was conducted to eliminate imaging the same cells from multiple planes (minimum spatial correlation = 0.5, temporal correlation = 0.99). 4. Cells were identified with a constrained non-negative matrix factorization algorithm for microendoscopic data (CNMF-E) (Zhou et al., 2018). 5. Longitudinal registration was used for day 10 of appetitive and day 1 of aversive learning to compare how the same cell responded to appetitive vs. aversive stimuli.

Identifying significantly responsive neurons

We wish to identify neurons that are responsive to appetitive or fear stimuli (i.e. that display a difference in activity pre- versus post-stimulus). However, the usual p-values derived from statistical analyses such as t-tests or Wilcoxon rank sum tests assume independence of data points, which is violated for neuronal calcium transients due to an inherent dependency between adjacent transient values. Consequently, a p-value computed assuming independence will lead to highly inflated measures of significance in the case of dependent data, and thus inaccurate interpretation of the data. A related issue is discussed in the Harris’ study along with suggested remedies (Harris, 2021).

Therefore, to quantify the responsiveness of CeA neurons to appetitive vs. aversive stimuli, we rely on an alternative method for generating p-values based upon a variant of ‘circular shifting’ (Harris, 2021). The null hypothesis for this statistical test is that the calcium transients are non-responsive to the stimuli (formally, pre-stimulus and post- stimulus data are drawn from the same distribution). To simulate hypothetical neuron data under the null hypothesis, we generated “null” calcium activity by circularly shifting the calcium trace of trials from randomly selected neurons (Step 1 in Figure 2B, red bar). Thus, the “null” calcium traces mimic the hypothetical situation where transients in calcium traces are unrelated to the experimental variables, while preserving calcium dependency dynamics.

After generating “null” calcium activity as described above, we compared the test statistics based upon the observed data to the collection of test statistics obtained under the “null” calcium activity distribution; test statistics were obtained by summing Wilcoxon rank sum test (WRST) statistics across trials.

We note two substantial differences between our approach and the circular shifting approach of the Harris’ study (Harris, 2021): (i) We generate a null distribution by pooling from the entire population of recorded neurons to fully capture the heterogeneity of possible calcium transients under the null distribution. (ii) Our analysis relies on WRST statistics, which operate on ranks (rather than directly on the calcium transient values).

Details are provided in Algorithm 1. Step 1 formally defines the circular shift operation. Step 2 involves repeatedly applying the circular shift operation to a randomly selected neuron, and then computing the resulting WRST; these results in a distribution of WRSTs generated under the null hypothesis. In Step 3, the WRST test statistics observed in the current study are computed, and in Step 4, they are compared with the null distribution generated in Step 2 to assess their statistical significance.

We now discuss Algorithm 1 in greater detail. In Algorithm 1, N is the number of timepoints for each neuron’s transient (note that each neuron has been recorded for the same number of timepoints).

Figure 5—figure supplement 2 displays the results obtained using the traditional WRST that relies on the theoretical null distribution, i.e., that assumes independence between time points, and then sets a threshold for the number of trials with a p-value below 0.05 in order to declare that a neuron is “responsive”. We see little difference between the two sets of results.

Classification of salience-encoding and valence-encoding neurons

With the neurons that appeared during both appetitive and fear conditioning, we conducted a direct comparison of how individual neurons respond to appetitive vs. aversive stimuli. After the new analysis confirmed ’responsive neurons’ (either excited or inhibited) among the registered neurons, we further classified them into salience-encoding and valence- encoding neurons based on their response patterns. Salience-encoding neurons demonstrate significant responses to both appetitive and aversive stimuli in the same direction (both excited or both inhibited), reflecting the stimulus strength, which is the definition of salience (Figure 5B white, Figure 5G white, Figure 5—figure supplement 2I,O white) (Kong & Zweifel, 2021). On the other hand, valence-encoding neurons exhibit a more diverse range of response types. For instance, some neurons exclusively encode one of the stimuli by showing a significant response to only one type.

Alternatively, some neurons respond significantly to both stimuli but in opposite directions (e.g., excited to food and inhibited to shock, Figure 5B black, Figure 5G black, Figure 5—figure supplement 2I,O black). These response patterns correspond to the definition of valence, representing either positive (good) or negative (bad) valence (Kong & Zweifel, 2021). Neurons that showed no significant activity in response to both appetitive and aversive stimuli were categorized as not-significant neurons (Figure 5B grey, Figure 5G grey, Figure 5—figure supplement 2I,O grey).

Histology

At the conclusion of the experiment, the mice were administered an overdose of Beuthanasia and then perfused transcranially with phosphate-buffered saline (PBS) and 4% paraformaldehyde (PFA). Following this, each mouse head with a GRIN lens was immersed in PFA at 4°C overnight for a week to preserve the lens track. The brains were subsequently extracted from the post-fixed heads, including the lens track, and cryoprotected in PBS containing 30% sucrose for 72 hours. Immunohistochemistry was performed on transverse sections (50 μm) using a primary antibody (anti-GFP Chicken polyclonal, Abcam, ab13970) followed by a secondary antibody (Alexa Fluor 488, JacksonImmuno, 703-545-155). The treated sections were then mounted on slides and coverslipped with DAPI Fluoromount-G (Southern Biotech). The expression of GCaMP6m and the location of the lens were examined using a Keyence Fluorescence Microscope (Keyence).

Statistical analysis

The responsiveness of CeA neurons to both appetitive and aversive stimuli was quantified using the previously outlined Algorithm 1, implemented in the R programming language. For the determination of statistical significance in behavioral results and area under curve data, we employed One-way repeated measured ANOVA, One-way ANOVA (with Tukey post hoc), paired t-test, and unpaired t-test using Prism software. A comprehensive presentation of the statistical results is available in Supplementary Table 1. A significance level of P < 0.05 was set for all tests. Graphs were generated using GraphPad Prism (version 10) and customized MATLAB codes.

Acknowledgements

We thank Dr. Selena Schattauer and Dr. James Allen for assistance with viral production. We thank colleagues for thoughtful discussion and insights for the manuscript. This work was supported by funding from the U.S. National Institutes of Health, F32MH127801 (M-S.K.), R01MH104450 (L.S.Z.), and the University of Washington Center for Excellence in Opioid Addiction research: P30DA048736.

Additiona information

Author contributions

M-S.K and L.S.Z. conceptualized the study and designed experiments. M-S.K. performed experiments and analyzed data with assistance from E.A. and D.M.W. M- S.K., E.A., and D.M.W. wrote analysis code. E.A. and D.M.W. designed analysis and wrote code for cell activation designations. M-S.K., L.S.Z., E.A., and D.M.W. wrote manuscript.

Conflict of Interest

The authors declare no conflicts of interest.

Data and code availability

The data supporting the findings of this study are available at https://doi.org/10.5061/dryad.zgmsbccng. The circular shifting tools are accessible on GitHub at https://github.com/zweifellab?tab=repositories.

Supplementary Information

GRN lens placements A, Histological reconstructions of GRIN lens locations.

CSFood and food response in the CeA neurons.

A, Proportion of CSFood-only, Food-only, CSFood+Food, and not significant neurons during appetitive learning. Blue and orange in the outer pie chart indicate the number of excited and inhibited responses from CSFood-only and Food-only responsive neurons. B, The average Z-scored activity of CSFood excited + Food excited (first), CSFood excited + Food inhibited (second), CSFood inhibited + Food excited (third) and CSFood inhibited + Food inhibited (fourth) neurons. C, Left: Average Z-scored activity of CSFood-excited neurons during the first five trials (early; grey) vs. the last five trials (late; black) of appetitive learning. Right: Average AUC for the Z-scored activity during CSFood (0-10 s, mean ± s.e.m.). D, Left: Average Z-scored activity of CSFood-inhibited neurons during the first five trials (early; grey) vs. the last five trials (late; black) of appetitive learning. Right: Average AUC for the Z-scored activity during CSFood (0-10 s). E, Left: Average Z-scored activity of food-inhibited neurons during the first five trials vs. the last five trials. A dotted darker mint line indicates food delivery. Right: Average AUC for the Z-scored activity after food delivery (t = 3.787, P = 0.0002). F, Left: Average Z-scored activity of shock- excited neurons during the first five trials vs. the last five trials. Right: Average AUC for the Z-scored activity after shock delivery (0-10 s; t = 5.246, P < 0.0001). The dark lines and shaded areas represent the mean and s.e.m. **P < 0.01, ***P < 0.001. Detailed information about statistical results is provided in Supplementary Table 1.

CSShock and shock response in the CeA neurons.

A, Proportion of CSShock-only, Shock-only, CSShock+Shock, and not significant neurons during fear conditioning. Blue and orange in the outer pie chart indicate the number of excited and inhibited responses from CSShock-only and Shock-only responsive neurons. B, The average Z-scored activity of CSShock excited + Shock excited (first), CSShock excited + Shock inhibited (second), CSShock inhibited + Shock excited (third) and CSShock inhibited + Shock inhibited (fourth) neurons. C, Left: Average Z-scored activity of CSShock-excited neurons during the first vs. last five trials of fear conditioning. Right: Average AUC for the Z-scored activity during CSShock (0-10 s, mean ± s.e.m.). D, Left: Average Z-scored activity of CSShock-inhibited neurons during the first vs. last five trials. Right: Average AUC for the Z-scored activity during CSShock. The orange area represents 10 s of CSShock. E, Left: Average Z-scored activity of shock-excited neurons during the first five trials vs. the last five trials. Right: Average AUC for the Z-scored activity after shock delivery (0-10 s; t = 5.246, P < 0.0001). F, Left: Average Z-scored activity of shock-inhibited neurons during the first five trials vs. the last five trials. A dotted darker red line indicates shock delivery. Right: Average AUC for the Z-scored activity after food delivery. The dark lines and shaded areas represent the mean and s.e.m. ****P < 0.0001. Detailed information about statistical results is provided in Supplementary Table 1.

Characteristics of CS and US responses in the CeA.

A, Peak time comparisons of food-excited (blue) vs. shock-excited (red) neurons from food/shock delivery (t = 21.76, P < 0.0001). B, Maximum Z-score comparisons of food-excited vs. shock-excited neurons (t = 3.210, P = 0.0014). Black bars represent the median. Circles indicate individual data. C, Salience-encoding neurons: the average Z- scored activity of neurons that were excited to both CSFood (mint) and CSShock (orange, n = 5, left) and inhibited to both CSFood and CSShock (n = 2, right). D, Valence-encoding neurons: the average Z-scored activity of neurons that were excited to CSFood but not significant to shock (n = 21, first), inhibited to CSFood but not significant to shock (n = 12, second), not significant to CSFood but excited to shock (n = 7, third), and not significant to CSFood but inhibited to shock (n = 716, fourth). Black bars indicate 10 s of CS. The dark lines and shaded areas represent the mean and s.e.m. E, The averaged Z-scored activity of CeA neurons (n = 925) during -10 s to 20 s after CSFood (left) and CSShock onset (right) from the baseline. Solid mint lines indicate CSFood and solid orange lines indicate CSShock. F, Proportion of CSFood-responsive (left) and CSShock-responsive neurons (right). G, The averaged freezing behavior during CSFood (mint) and CSShock (orange) during the baseline (mean ± s.e.m., n = 10). H-J, The same analyses as in A-C but with neurons from the post-test (n = 788). **P < 0.01, ****P < 0.0001. Detailed information about statistical results is provided in Supplementary Table 1.

Determining responsive neurons using the “theoretical” distribution of the Wilcoxon rank sum test, which assumes independence between timepoints. A, Each trial’s pre vs. post-stimulus activity was compared using Wilcoxon rank sum test. Neurons showing significant activity to the stimulus in more than 7 trials (appetitive; food or CSFood) or 3 trials (fear; shock or CSShock) were considered responsive neurons. B, Histograms of the number of significant cells by their number of significant trials to food (left) and shock (right). C, Histograms of the number of significant cells by their number of significant trials to CSFood (left) and CSShock (right). D, The proportion of food-excited (orange), food- inhibited (blue), and not significant neurons (grey) from day 10 of appetitive learning (total 872 neurons) tested by Wilcoxon rank sum test. E, Left: all trials (20 trials) averaged heat maps of food-excited neurons (top, n = 273) and food-inhibited neurons (bottom, n = 207). The dotted line indicates a food delivery. Middle: the average Z- scored activity of each response type (orange, food-excited; blue, food-inhibited; grey, not significant). The dark lines and shaded areas represent the mean and s.e.m. Right: average AUC for the Z-scored activity after food delivery (10 s, mean ± s.e.m.). F-G, The same analyses as in D,E but with shock-responsive neurons from day 1 of aversive learning (total 519 neurons, shock-excited = 165, shock-inhibited = 105). H, The proportion of significant neurons to food and shock (both; white), food-only (blue), shock-only (red), and not significant to both (grey) tested with Wilcoxon rank sum test. I, Detailed response type of all possible categories (excited, inhibited, not significant) for food vs. shock. White represents salience-encoding neurons showing the same response types for food and shock (16%), and black represents valence-encoding neurons showing different response types for food and shock (62%). J-K, The same analyses as in D,E with CSFood-responsive neurons from day 10 of appetitive learning (total 872 neurons, CSFood-excited = 63, CSFood-inhibited = 56). L-M, The same analyses as in D,E with CSShock-responsive neurons from day 1 of aversive learning (total 519 neurons, CSShock-excited = 53, CSShock-inhibited = 65). N-O, The same analyses as in H,I with CS-responsive neurons registered from day 10 of appetitive and day 1 of aversive learning (total 303 neurons). *P < 0.05, ****P < 0.0001. Detailed information about statistical results is provided in Supplementary Table 1.

The order of valence conditioning did not affect the encoding of food, shock, and CSs in the CeA.

A-D, Data of 165 neurons from appetitive → fear learning order. A, The averaged Z-scored activity during -10 s to 25 s after CSFood onset from appetitive learning (left) and during -10 s to 25 s after CSShock onset from aversive learning (right). All neurons are aligned to their activity to food. The same neuron is represented in the same row. Solid mint lines indicate CSFood, a dotted darker mint line represents food delivery, solid orange lines indicate CSShock, and a dotted red line represents shock delivery. B, Left: Proportion of salience-encoding, valence-encoding, and not significant neurons for food vs. shock. Right: Proportion of Food + Shock, Food-only, and Shock-only responsive neurons. C, Left: Proportion of salience-encoding, valence-encoding, and not significant neurons for CSFood and CSShock. Right: Proportion of CSFood + CSShock, CSFood-only, and CSShock-only responsive neurons. D, Top: Location of each neuron that was Food + Shock, Food-only, Shock- only, or not significantly responsive (Mouse1-5). Bottom: Location of each neuron that was CSFood + CSShock, CSFood-only, CSShock-only, or not significantly responsive. E-H, The same analyses as in A-D but with 138 neurons from fear → appetitive learning order (Mouse6-10). E, The averaged Z-scored activity during -10 s to 25 s after CSShock onset from fear learning (left) and during -10 s to 25 s after CSFood onset from appetitive (right). All neurons are aligned to their activity to shock. I, Left: Average Z-scored activity of food-excited neurons from appetitive → fear vs. fear → appetitive. Right: Average AUC for the Z-scored activity after food delivery (0-10 s, mean ± s.e.m.). The number in the bar graph represents the number of neurons for each group. J-L, The same analyses as in L with shock-excited/inhibited neurons (J), CSFood-excited/inhibited neurons (K), and CSShock-excited/inhibited neurons (L). A dotted darker mint line represents food delivery, a dotted red line represents shock delivery, a mint bar indicates CSFood, and an orange bar indicates CSShock. The dark lines and shaded areas represent the mean and s.e.m. Detailed information about statistical results is provided in Supplementary Table 1.

Results of statistical analyses.