Neural arbitration between social and individual learning systems

  1. Andreea Oliviana Diaconescu  Is a corresponding author
  2. Madeline Stecy
  3. Lars Kasper
  4. Christopher J Burke
  5. Zoltan Nagy
  6. Christoph Mathys
  7. Philippe N Tobler
  1. Centre for Addiction and Mental Health, University of Toronto, Canada
  2. Rutgers Robert Wood Johnson Medical School, United States
  3. Institute for Biomedical Engineering, Switzerland
  4. University of Zurich, Switzerland
  5. Scuola Internazionale Superiore di Studi Avanzati (SISSA), Italy

Abstract

Decision making requires integrating self-gathered information with advice from others. However, the arbitration process by which one source of information is selected over the other has not been fully elucidated. In this study, we formalised arbitration as the relative precision of predictions, afforded by each learning system, using hierarchical Bayesian modelling. In a probabilistic learning task, participants predicted the outcome of a lottery using recommendations from a more informed advisor and/or self-sampled outcomes. Decision confidence, as measured by the number of points participants wagered on their predictions, varied with our relative precision definition of arbitration. Functional neuroimaging demonstrated arbitration signals that were independent of decision confidence and involved modality-specific brain regions. Arbitrating in favour of self-gathered information activated the dorsolateral prefrontal cortex and the midbrain, whereas arbitrating in favour of social information engaged the ventromedial prefrontal cortex and the amygdala. These findings indicate that relative precision captures arbitration between social and individual learning systems at both behavioural and neural levels.

Data availability

Data generated during this study are available in Dryad under the doi:10.5061/dryad.wwpzgmsgs. Source data files have been provided for the main tables and figures. The routines for all analyses are available as Matlab code: https://github.com/andreeadiaconescu/arbitration. The instructions for running the code in order to reproduce the results can be found in the ReadMe file.

The following data sets were generated

Article and author information

Author details

  1. Andreea Oliviana Diaconescu

    Department of Psychiatry, Centre for Addiction and Mental Health, University of Toronto, Toronto, Canada
    For correspondence
    andreea.diaconescu@utoronto.ca
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-3633-9757
  2. Madeline Stecy

    Medicine, Rutgers Robert Wood Johnson Medical School, New Jersey, United States
    Competing interests
    The authors declare that no competing interests exist.
  3. Lars Kasper

    MR Technology Group & Translational Neuromodeling Unit, Institute for Biomedical Engineering, Zurich, Switzerland
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0001-7667-603X
  4. Christopher J Burke

    Laboratory for Social and Neural Systems Research, University of Zurich, Zurich, Switzerland
    Competing interests
    The authors declare that no competing interests exist.
  5. Zoltan Nagy

    Laboratory for Social and Neural Systems Research, University of Zurich, Zurich, Switzerland
    Competing interests
    The authors declare that no competing interests exist.
  6. Christoph Mathys

    Neuroscience, Scuola Internazionale Superiore di Studi Avanzati (SISSA), Trieste, Italy
    Competing interests
    The authors declare that no competing interests exist.
  7. Philippe N Tobler

    Department of Economics, Laboratory for Social and Neural Systems Research, University of Zurich, Zürich, Switzerland
    Competing interests
    The authors declare that no competing interests exist.

Funding

Swiss National Foundation (PZ00P3_167952)

  • Andreea Oliviana Diaconescu

Swiss National Foundation (PP00P1_150739)

  • Philippe N Tobler

Swiss National Foundation (100014_165884)

  • Philippe N Tobler

Swiss National Foundation (100019_176016)

  • Philippe N Tobler

Krembil Foundation

  • Andreea Oliviana Diaconescu

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Ethics

Human subjects: Informed consent, and consent to publish, was obtained from all participants. The study was approved by the Ethics Committee of the Canton of Zürich (KEK-ZH 2010-0327). All participants gave written informed consent before taking part in the study.

Reviewing Editor

  1. Woo-Young Ahn, Seoul National University, Korea (South), Republic of

Version history

  1. Received: November 28, 2019
  2. Accepted: August 10, 2020
  3. Accepted Manuscript published: August 11, 2020 (version 1)
  4. Version of Record published: September 7, 2020 (version 2)

Copyright

© 2020, Diaconescu et al.

This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 1,879
    Page views
  • 267
    Downloads
  • 4
    Citations

Article citation count generated by polling the highest count across the following sources: Crossref, PubMed Central, Scopus.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Andreea Oliviana Diaconescu
  2. Madeline Stecy
  3. Lars Kasper
  4. Christopher J Burke
  5. Zoltan Nagy
  6. Christoph Mathys
  7. Philippe N Tobler
(2020)
Neural arbitration between social and individual learning systems
eLife 9:e54051.
https://doi.org/10.7554/eLife.54051

Further reading

    1. Computational and Systems Biology
    2. Neuroscience
    Huu Hoang, Shinichiro Tsutsumi ... Keisuke Toyama
    Research Article

    Cerebellar climbing fibers convey diverse signals, but how they are organized in the compartmental structure of the cerebellar cortex during learning remains largely unclear. We analyzed a large amount of coordinate-localized two-photon imaging data from cerebellar Crus II in mice undergoing 'Go/No-go' reinforcement learning. Tensor component analysis revealed that a majority of climbing fiber inputs to Purkinje cells were reduced to only four functional components, corresponding to accurate timing control of motor initiation related to a Go cue, cognitive error-based learning, reward processing, and inhibition of erroneous behaviors after a No-go cue. Changes in neural activities during learning of the first two components were correlated with corresponding changes in timing control and error learning across animals, indirectly suggesting causal relationships. Spatial distribution of these components coincided well with boundaries of Aldolase-C/zebrin II expression in Purkinje cells, whereas several components are mixed in single neurons. Synchronization within individual components was bidirectionally regulated according to specific task contexts and learning stages. These findings suggest that, in close collaborations with other brain regions including the inferior olive nucleus, the cerebellum, based on anatomical compartments, reduces dimensions of the learning space by dynamically organizing multiple functional components, a feature that may inspire new-generation AI designs.

    1. Computational and Systems Biology
    2. Genetics and Genomics
    John F Ouyang, Kunal Mishra ... Jacques Behmoaras
    Research Article

    Tissue fibrosis affects multiple organs and involves a master-regulatory role of macrophages which respond to an initial inflammatory insult common in all forms of fibrosis. The recently unravelled multi-organ heterogeneity of macrophages in healthy and fibrotic human disease suggests that macrophages expressing osteopontin (SPP1), associate with lung and liver fibrosis. However, the conservation of this SPP1+ macrophage population across different tissues, and its specificity to fibrotic diseases with different etiologies remain unclear. Integrating 15 single cell RNA-sequencing datasets to profile 235,930 tissue macrophages from healthy and fibrotic heart, lung, liver, kidney, skin and endometrium, we extended the association of SPP1+ macrophages with fibrosis to all these tissues. We also identified a subpopulation expressing matrisome-associated genes (e.g., matrix metalloproteinases and their tissue inhibitors), functionally enriched for ECM remodelling and cell metabolism, representative of a matrisome-associated macrophage (MAM) polarization state within SPP1+ macrophages. Importantly, the MAM polarization state follows a differentiation trajectory from SPP1+ macrophages and is associated with a core set of regulon activity. SPP1+ macrophages without the MAM polarization state (SPP1+MAM-) show a positive association with ageing lung in mice and humans. These results suggest an advanced and conserved polarization state of SPP1+ macrophages in fibrotic tissues resulting from prolonged inflammatory cues within each tissue microenvironment.