Learning: The devil is in the task structure
How should you pick your next read? You may rely on the recommendations from a renowned critic, or base your selection on specific literary genres. If you enjoy the book you chose, you will then update how you evaluate these sources of information: maybe historical fiction really is to your taste, and maybe you will keep on following that particularly perceptive critic. In many cases these two ways to acquire and assess information – one social and relying on the critic, the other individual and based on the characteristic of the item – occur at the same time (Figure 1A).
In social learning, knowledge about the world is acquired by observing or interacting with another agent (Olsson et al., 2020). However, during individual learning – when decisions are based solely on the features of an object – the learner obtains knowledge directly, through trial-and-error. But do social and individual learning rely on two different neural mechanisms, or are they just two different sources of information?
So far, existing research presents mixed evidence. Some studies find that in dual learning tasks – when a participant gathers information through both social and individual learning – the two types of knowledge acquisition elicit distinct brain activity (Behrens et al., 2008; Diaconescu et al., 2020; Zhang and Gläscher, 2020). Other experiments, however, suggest that there is no neural mechanism specific to social learning. For example, previous work has revealed that individual and social learning compute information similarly, calculating the mismatch between predicted and experienced outcomes; and that being forced to primarily use social information for a decision triggers activity in dopamine-rich brain regions previously linked to individual learning (Diaconescu et al., 2017; Olsson et al., 2020; Iglesias et al., 2013). Now in eLife, Alicia Ribicki, Sophie Sowden, Bianca Schuster and Jennifer Cook from the University of Birmingham report that the structure of the experimental task, rather than the type of learning, is responsible for these mixed results (Rybicki et al., 2022).
In the most popular version of the dual learning task, participants are asked to decide between two options (for instance, whether a reward is hidden in a blue or a green box) while also receiving a hint from a social agent - ‘an adviser’ (Behrens et al., 2008). When the outcome of the choice is revealed (was the reward in the chosen box?), participants can update their evaluation of the boxes’ values, and infer the accuracy of the adviser. However, Rybicki et al. note that this version of the task forces participants to mostly rely on information relevant for individual learning; they therefore label this condition ‘Individual-Primary’, where ‘primary’ refers to information that appears first, is highly salient and is directly related to both making and assessing a decision. The team hypothesized that differences in how the brain processes social and individual learning during this task may be related to the fact that the design confounds the type of learning (social vs. individual) and the primacy of the information source (primary vs. secondary).
To test this, Rybicki et al. developed a new task which included both the classic Individual-Primary condition and a new, ‘Social-Primary’ condition during which participants use the adviser’s recommendation as the primary source of information, along with secondary information about the recommended boxes. When the outcome of the choice is revealed, volunteers can update their evaluation of the adviser’s accuracy (did the recommendation lead to finding the reward?) and infer the value of the boxes. Participants in both the Individual-Primary and the Social-Primary conditions also performed the task twice: under a placebo, or under a drug – haloperidol – that perturbs dopamine-based signaling in the brain (Schultz, 2007). This allowed the team to dissect the role of dopamine in the learning process.
The results showed that dopaminergic manipulation affected the type of learning (social vs. individual) when that specific type was the primary but not the secondary source of information (Figure 1B). Previous findings demonstrating dopamine-dependent learning for individual but not social learning may therefore be related to the fact that individual learning, in these experiments, was the primary way to obtain information. This also explains why dopaminergic-dependent learning was observed in both a social and individual context in tasks with only one source of information. This finding may have a profound impact on the ongoing debate about how the brain processes social and individual information, shifting the attention to the task structure and away from the type of learning. Concrete health implications may emerge as task structure, and not content, may be the basis of psychiatric conditions and symptoms such as paranoia (Reed et al., 2020).
When creating the new version of the task, Rybicki et al. manipulated primacy by simultaneously adjusting several variables, such as the saliency of the signal, when it appeared, and the type of choice and reward feedback. What exactly makes a source of information ‘the’ primary signal therefore remains an open question. It is possible, for instance, that information which allows learning by directly linking the choice with the outcome (whether the right call was made) is used primarily. Secondary information would require an extra step where the participant, for example, must infer that the recommendation was accurate because the outcome was good. However, Diaconescu et al., 2017 showed that when there is only one source of information, even inference-based learning can be dopaminergic related. More work is needed to determine how task properties relate to neural learning mechanisms.
The study by Rybicki et al. has important implications for the way that social learning is studied and understood. If social and individual learning rely on the same neural processes, then what is already known about learning in a non-social context – the neural and computational mechanisms involved in processing that information, for example – could then be deployed in the social domain (Lockwood et al., 2020). On the other hand, knowing what the two types of learning share could also help to dissect the unique contribution of the social world to learning (Heyes, 2012). For example, the fact that various social traits such as prosociality and selfishness may be processed differently could be attributed to the unique characteristics of these social inputs, rather than to the learning process itself (Siegel et al., 2018). Delineating what makes social learning special while acknowledging that it may be based on a domain-general learning mechanism may lead to a richer understanding of the way the social environment shapes cognition.
References
-
Hierarchical prediction errors in midbrain and septum during social learningSocial Cognitive and Affective Neuroscience 12:618–634.https://doi.org/10.1093/scan/nsw171
-
What’s social about social learning?Journal of Comparative Psychology 126:193–202.https://doi.org/10.1037/a0025180
-
Is there a “social” brain? Implementations and algorithmsTrends in Cognitive Sciences 24:802–813.https://doi.org/10.1016/j.tics.2020.06.011
-
The neural and computational systems of social learningNature Reviews Neuroscience 21:197–212.https://doi.org/10.1038/s41583-020-0276-4
-
Behavioral dopamine signalsTrends in Neurosciences 30:203–210.https://doi.org/10.1016/j.tins.2007.03.007
-
Beliefs about bad people are volatileNature Human Behaviour 2:750–756.https://doi.org/10.1038/s41562-018-0425-1
-
A brain network supporting social influences in human decision-makingScience Advances 6:eabb4159.https://doi.org/10.1126/sciadv.abb4159
Article and author information
Author details
Publication history
Copyright
© 2022, Nafcha and Hertz
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.
Metrics
-
- 907
- views
-
- 74
- downloads
-
- 3
- citations
Views, downloads and citations are aggregated across all versions of this paper published by eLife.
Download links
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Further reading
-
- Neuroscience
The specific role that prolactin plays in lactational infertility, as distinct from other suckling or metabolic cues, remains unresolved. Here, deletion of the prolactin receptor (Prlr) from forebrain neurons or arcuate kisspeptin neurons resulted in failure to maintain normal lactation-induced suppression of estrous cycles. Kisspeptin immunoreactivity and pulsatile LH secretion were increased in these mice, even in the presence of ongoing suckling stimulation and lactation. GCaMP fibre photometry of arcuate kisspeptin neurons revealed that the normal episodic activity of these neurons is rapidly suppressed in pregnancy and this was maintained throughout early lactation. Deletion of Prlr from arcuate kisspeptin neurons resulted in early reactivation of episodic activity of kisspeptin neurons prior to a premature return of reproductive cycles in early lactation. These observations show dynamic variation in arcuate kisspeptin neuronal activity associated with the hormonal changes of pregnancy and lactation, and provide direct evidence that prolactin action on arcuate kisspeptin neurons is necessary for suppressing fertility during lactation in mice.
-
- Neuroscience
Unipolar brush cells (UBCs) are excitatory interneurons in the cerebellar cortex that receive mossy fiber (MF) inputs and excite granule cells. The UBC population responds to brief burst activation of MFs with a continuum of temporal transformations, but it is not known how UBCs transform the diverse range of MF input patterns that occur in vivo. Here, we use cell-attached recordings from UBCs in acute cerebellar slices to examine responses to MF firing patterns that are based on in vivo recordings. We find that MFs evoke a continuum of responses in the UBC population, mediated by three different types of glutamate receptors that each convey a specialized component. AMPARs transmit timing information for single stimuli at up to 5 spikes/s, and for very brief bursts. A combination of mGluR2/3s (inhibitory) and mGluR1s (excitatory) mediates a continuum of delayed, and broadened responses to longer bursts, and to sustained high frequency activation. Variability in the mGluR2/3 component controls the time course of the onset of firing, and variability in the mGluR1 component controls the duration of prolonged firing. We conclude that the combination of glutamate receptor types allows each UBC to simultaneously convey different aspects of MF firing. These findings establish that UBCs are highly flexible circuit elements that provide diverse temporal transformations that are well suited to contribute to specialized processing in different regions of the cerebellar cortex.