The basal ganglia (BG) are an evolutionarily conserved and phylogenetically old set of sub-cortical nuclei that guide action selection, evaluation, and reinforcement. The entopeduncular nucleus (EP) is a major BG output nucleus that contains a population of GABA/glutamate cotransmitting neurons (EP^Sst+) that specifically target the lateral habenula (LHb) and whose function in behavior remains mysterious. Here, we use a probabilistic switching task that requires an animal to maintain flexible relationships between action selection and evaluation to examine when and how GABA/glutamate cotransmitting neurons contribute to behavior. We find that EP^Sst+ neurons are strongly engaged during this task and show bidirectional changes in activity during the choice and outcome periods of a trial. We then tested the effects of either permanently blocking cotransmission or modifying the GABA/glutamate ratio on behavior in well-trained animals. Neither manipulation produced detectable changes in behavior despite significant changes in synaptic transmission in the LHb, demonstrating that the outputs of these neurons are not required for ongoing action-outcome updating in a probabilistic switching task.

The claustrum complex is viewed as fundamental for higher-order cognition; however, the circuit organization and function of its neuroanatomical subregions are not well understood. We demonstrated that some of the key roles of the CLA complex can be attributed to the connectivity and function of a small group of neurons in its ventral subregion, the endopiriform (EN). We identified a subpopulation of EN neurons by their projection to the ventral CA1 (EN^vCA1-proj. neurons), embedded in recurrent circuits with other EN neurons and the piriform cortex. Although the EN^vCA1-proj. neuron activity was biased toward novelty across stimulus categories, their chemogenetic inhibition selectively disrupted the memory-guided but not innate responses of mice to novelty. Based on our functional connectivity analysis, we suggest that EN^vCA1-proj. neurons serve as an essential node for recognition memory through recurrent circuits mediating sustained attention to novelty, and through feed-forward inhibition of distal vCA1 neurons shifting memory-guided behavior from familiarity to novelty.