Neural activity ramps in frontal cortex signal extended motivation during learning

Reviewer #1 (Public Review):

Summary:

This is an interesting report examining activity patterns in mouse ACC and in the OFC neurons projecting to ACC. In addition, the effects of inactivation are examined. In aggregate, the results provide new and interesting information about these two brain areas and they translate motivation into action - a function that it seems intuitively plausible that ACC might perform but, despite this intuition, there have been comparatively few direct tests of the idea and little is known of the specific mechanisms. The study is performed carefully and is written up clearly. There were just a few points where I wondered if a little more clarification might be helpful.

Strengths:

The combination of recording and inactivation/inhibition experiments and the combination of investigation of ACC neurons and of OFC regions projecting to ACC are very impressive.

Weaknesses:

These are all minor points of clarification.

(1) An important conclusion (Figure 4) is that when mice are trained to run through no reward (N) cues in order to reach reward (R) cues, the OFC neurons projecting to ACC each respond to different specific events in a manner that ensures that collectively they tile the extended behavioural sequence. What I was less sure of was whether the ACC neurons do the same or not. Figure 3 suggests that on average ACC neurons maintain activity across N cues in order to get to R cues but I was not sure whether this was because all individual neurons did this or whether some had activity patterns like the OFC neurons projecting to ACC.

(2) Figure 1 versus Figure 2: There does not seem to be a particular motivation for whether chemogenetic inactivation or optogenetic inhibition were used in different experiments. I think that this is not problematic but, if I am wrong and there were specific reasons for performing each experiment in a certain way, then further clarification as to why these decisions were made would be useful. If there is no particular reason, then simply explaining that this is the case might stop readers from seeking explanations.

(3) P5, paragraph 2. The authors argue that OFC and anteriomedial (AM) thalamic inputs into ACC are especially important for mediating motivation through N cues in order to reach R cues. Is this based on a statistical comparison between the activity in OFC or AM inputs as opposed to the other inputs?

(4) P3, paragraph 2. Some papers by Khalighinejad and colleagues (eg Neuron 2020, Current Biology, 2022) might be helpful here in as much as they assess ACC roles in determining action frequency, initiation, and speed and mediating the relationship between reward availability and action frequency and speed.

(5) Paragraph 1 "This learning is of a more deliberate, informed nature than habitual learning, as they are sensitive to the current value of outcomes and can lead to a novel sequence of actions for a desired outcome1-3." Should "they" be "it"?

Reviewer #2 (Public Review):

Summary:

Regalado et al. studied how an extended motivational state, necessary for maintaining behavioural drive despite unrewarding experiences, could be encoded in the ACC and its potential causal implications for learning discriminatory behaviour and avoiding unrewarding stimuli. They designed a self-initiated learning task and identified bulk neural responses tuned specifically to reward delivery as well as trial initiation. Interestingly, in both cases, neural activity precedes behavioural onset, indicating the encoding of a motivational signal. To investigate the neural encoding of motivational signals during unrewarded, distracting stimuli presentation, they created a discrimination task by introducing 'no reward' cues, during which animals need to learn not to reduce running speed and not engage in licking. Interestingly, with mice learning to increase running speed and reduce licking rates after 'no reward' cues, the preceding ACC activity also gradually increased. Importantly, only the increase in running speed after 'no reward' cues was impaired upon optogenetic inhibition of ACC activity during early training, linking the extended motivational signal in ACC and learning to maximise rewards by actively avoiding distracting and unrewarded stimuli. Such motivational signals could also be observed in OFC-ACC projecting neurons. Especially the continuous ramping of activity upon repeated 'non-reward' cues, which could be exclusively observed in the 'fast learner' subgroup, provides an interesting concept of how an extended motivational signal necessary for learning avoidance of unrewarded stimuli could be implemented in ACC. The shift in the temporal activity of initially reward-responsive neurons towards the preceding 'no reward' cue, provides a potential mechanism linking extended motivation to reward maximisation. This mechanism seems to be particularly important in periods of persistent 'non-reward' cues, as demonstrated in the impairment of running speed increase after two consecutive 'non-reward' cues.

Appraisal:

The authors provide convincing experimental evidence to support their claims of an extended motivational signal encoded in the ACC that is implemented by OFC-ACC signalling and critically involved in learning avoidance of unrewarded stimuli. The newly designed task seems appropriate to identify correlates of relevant cognitive and behavioural variables (e.g. sustained motivation). The combination of recording Ca2+ transients (bulk as well as longitudinal single neuron recordings) to identify potential neural responses and subsequent evaluation of their causal role in establishing and maintaining this persistent motivational state using opto- and pharmacogenetic manipulations is generally accepted.

Impact:

The findings will be valuable for further research on the impact of motivational states on behaviour and cognition. The authors provided a promising concept of how persistent motivational states could be maintained, as well as established a novel, reproducible task assay. While experimental methods used are currently state-of-the-art, theoretical analysis seems to be incomplete/not extensive.