Temporal chunking as a mechanism for unsupervised learning of task-sets

  1. Flora Bouchacourt
  2. Stefano Palminteri
  3. Etienne Koechlin
  4. Srdjan Ostojic  Is a corresponding author
  1. Ecole Normale Superieure Paris, France

Abstract

Depending on environmental demands, humans can learn and exploit multiple concurrent sets of stimulus-response associations. Mechanisms underlying the learning of such task-sets remain unknown. Here we investigate the hypothesis that task-set learning relies on unsupervised chunking of stimulus-response associations that occur in temporal proximity. We examine behavioral and neural data from a task-set learning experiment using a network model. We first show that task-set learning can be achieved provided the timescale of chunking is slower than the timescale of stimulus-response learning. Fitting the model to behavioral data on a subject-by-subject basis confirmed this expectation and led to specific predictions linking chunking and task-set retrieval that were borne out by behavioral performance and reaction times. Comparing the model activity with BOLD signal allowed us to identify neural correlates of task-set retrieval in a functional network involving ventral and dorsal prefrontal cortex, with the dorsal system preferentially engaged when retrievals are used to improve performance.

Data availability

Code has been uploaded to https://github.com/florapython/TemporalChunkingTaskSets. Statistical maps corresponding to human subjects data have been uploadeed to Neurovault (https://neurovault.org/collections/6754/).

The following previously published data sets were used
    1. A Collins
    2. E Koechlin
    (2012) Human behaviour data
    https://journals.plos.org/plosbiology/article?id=10.1371/journal.pbio.1001293.

Article and author information

Author details

  1. Flora Bouchacourt

    Laboratoire de Neurosciences Cognitives et Computationelles, Ecole Normale Superieure Paris, Paris, France
    Competing interests
    The authors declare that no competing interests exist.
  2. Stefano Palminteri

    Laboratoire de Neurosciences Cognitives et Computationelles, Ecole Normale Superieure Paris, Paris, France
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0001-5768-6646
  3. Etienne Koechlin

    Laboratoire de Neurosciences Cognitives et Computationelles, Ecole Normale Superieure Paris, Paris, France
    Competing interests
    The authors declare that no competing interests exist.
  4. Srdjan Ostojic

    Laboratoire de Neurosciences Cognitives et Computationelles, Ecole Normale Superieure Paris, Paris, France
    For correspondence
    srdjan.ostojic@ens.fr
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-7473-1223

Funding

Ecole de Neuroscience de Paris (Doctoral Fellowship)

  • Flora Bouchacourt

Agence Nationale de la Recherche (ANR-16-CE37- 0016-01)

  • Srdjan Ostojic

Agence Nationale de la Recherche (ANR-17-ERC2-0005-01)

  • Srdjan Ostojic

Inserm (R16069JS)

  • Stefano Palminteri

Agence Nationale de la Recherche (ANR-16-NEUC-0004)

  • Stefano Palminteri

Fondation Fyssen

  • Stefano Palminteri

Fondation Schlumberger

  • Stefano Palminteri

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Ethics

Human subjects: Participants provided written informed consent approved by the French National Ethics Committee.

Copyright

© 2020, Bouchacourt et al.

This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 2,595
    views
  • 405
    downloads
  • 16
    citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Flora Bouchacourt
  2. Stefano Palminteri
  3. Etienne Koechlin
  4. Srdjan Ostojic
(2020)
Temporal chunking as a mechanism for unsupervised learning of task-sets
eLife 9:e50469.
https://doi.org/10.7554/eLife.50469

Share this article

https://doi.org/10.7554/eLife.50469

Further reading

    1. Neuroscience
    Claire Meissner-Bernard, Friedemann Zenke, Rainer W Friedrich
    Research Article

    Biological memory networks are thought to store information by experience-dependent changes in the synaptic connectivity between assemblies of neurons. Recent models suggest that these assemblies contain both excitatory and inhibitory neurons (E/I assemblies), resulting in co-tuning and precise balance of excitation and inhibition. To understand computational consequences of E/I assemblies under biologically realistic constraints we built a spiking network model based on experimental data from telencephalic area Dp of adult zebrafish, a precisely balanced recurrent network homologous to piriform cortex. We found that E/I assemblies stabilized firing rate distributions compared to networks with excitatory assemblies and global inhibition. Unlike classical memory models, networks with E/I assemblies did not show discrete attractor dynamics. Rather, responses to learned inputs were locally constrained onto manifolds that ‘focused’ activity into neuronal subspaces. The covariance structure of these manifolds supported pattern classification when information was retrieved from selected neuronal subsets. Networks with E/I assemblies therefore transformed the geometry of neuronal coding space, resulting in continuous representations that reflected both relatedness of inputs and an individual’s experience. Such continuous representations enable fast pattern classification, can support continual learning, and may provide a basis for higher-order learning and cognitive computations.

    1. Neuroscience
    Mi-Seon Kong, Ethan Ancell ... Larry S Zweifel
    Research Article

    The central amygdala (CeA) has emerged as an important brain region for regulating both negative (fear and anxiety) and positive (reward) affective behaviors. The CeA has been proposed to encode affective information in the form of valence (whether the stimulus is good or bad) or salience (how significant is the stimulus), but the extent to which these two types of stimulus representation occur in the CeA is not known. Here, we used single cell calcium imaging in mice during appetitive and aversive conditioning and found that majority of CeA neurons (~65%) encode the valence of the unconditioned stimulus (US) with a smaller subset of cells (~15%) encoding the salience of the US. Valence and salience encoding of the conditioned stimulus (CS) was also observed, albeit to a lesser extent. These findings show that the CeA is a site of convergence for encoding oppositely valenced US information.