Dynamic organization of cerebellar climbing fiber response and synchrony in multiple functional components reduces dimensions for reinforcement learning

  1. Huu Hoang
  2. Shinichiro Tsutsumi
  3. Masanori Matsuzaki
  4. Masanobu Kano
  5. Mitsuo Kawato
  6. Kazuo Kitamura  Is a corresponding author
  7. Keisuke Toyama  Is a corresponding author
  1. Advanced Telecommunications Research Institute International, Japan
  2. RIKEN Center for Brain Science, Japan
  3. The University of Tokyo, Japan
  4. University of Yamanashi, Japan
  5. ATR Neural Information Analysis Laboratories, Japan

Abstract

Cerebellar climbing fibers convey diverse signals, but how they are organized in the compartmental structure of the cerebellar cortex during learning remains largely unclear. We analyzed a large amount of coordinate-localized two-photon imaging data from cerebellar Crus II in mice undergoing 'Go/No-go' reinforcement learning. Tensor component analysis revealed that a majority of climbing fiber inputs to Purkinje cells were reduced to only four functional components, corresponding to accurate timing control of motor initiation related to a Go cue, cognitive error-based learning, reward processing, and inhibition of erroneous behaviors after a No-go cue. Changes in neural activities during learning of the first two components were correlated with corresponding changes in timing control and error learning across animals, indirectly suggesting causal relationships. Spatial distribution of these components coincided well with boundaries of Aldolase-C/zebrin II expression in Purkinje cells, whereas several components are mixed in single neurons. Synchronization within individual components was bidirectionally regulated according to specific task contexts and learning stages. These findings suggest that, in close collaborations with other brain regions including the inferior olive nucleus, the cerebellum, based on anatomical compartments, reduces dimensions of the learning space by dynamically organizing multiple functional components, a feature that may inspire new-generation AI designs.

Data availability

Data analysed for all the figures are included in the manuscript and source data files. The Aldoc-tdTomato mouse line is available at RIKEN Bio Resource Center (RBRC10927).

The following previously published data sets were used

Article and author information

Author details

  1. Huu Hoang

    Computational Brain Imaging, Advanced Telecommunications Research Institute International, Kyoto, Japan
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0003-1463-8323
  2. Shinichiro Tsutsumi

    RIKEN Center for Brain Science, Saitama, Japan
    Competing interests
    The authors declare that no competing interests exist.
  3. Masanori Matsuzaki

    Department of Physiology, The University of Tokyo, Tokyo, Japan
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0003-3872-4322
  4. Masanobu Kano

    Department of Neurophysiology, The University of Tokyo, Tokyo, Japan
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-0725-3292
  5. Mitsuo Kawato

    Computational Brain Imaging, Advanced Telecommunications Research Institute International, Kyoto, Japan
    Competing interests
    The authors declare that no competing interests exist.
  6. Kazuo Kitamura

    Department of Neurophysiology, University of Yamanashi, Yamanashi, Japan
    For correspondence
    kitamurak@yamanashi.ac.jp
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-8956-4122
  7. Keisuke Toyama

    Neural Information Analysis Laboratories, ATR Neural Information Analysis Laboratories, Kyoto, Japan
    For correspondence
    toyama@atr.jp
    Competing interests
    The authors declare that no competing interests exist.

Funding

Japan Society for the Promotion of Science

  • Huu Hoang
  • Masanori Matsuzaki
  • Masanobu Kano
  • Mitsuo Kawato
  • Kazuo Kitamura
  • Keisuke Toyama

Japan Science and Technology Agency

  • Huu Hoang
  • Keisuke Toyama

Japan Agency for Medical Research and Development

  • Huu Hoang
  • Mitsuo Kawato
  • Kazuo Kitamura

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Reviewing Editor

  1. Jennifer L Raymond, Stanford University, United States

Ethics

Animal experimentation: All experiments were approved by the Animal Experiment Committees of the University of Tokyo (#P08-015) and the University of Yamanashi (#A27-1), and carried out in accordance with national regulations and institutional guidelines.

Version history

  1. Preprint posted: December 5, 2022 (view preprint)
  2. Received: January 20, 2023
  3. Accepted: September 13, 2023
  4. Accepted Manuscript published: September 15, 2023 (version 1)
  5. Version of Record published: September 27, 2023 (version 2)

Copyright

© 2023, Hoang et al.

This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 995
    views
  • 190
    downloads
  • 4
    citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Huu Hoang
  2. Shinichiro Tsutsumi
  3. Masanori Matsuzaki
  4. Masanobu Kano
  5. Mitsuo Kawato
  6. Kazuo Kitamura
  7. Keisuke Toyama
(2023)
Dynamic organization of cerebellar climbing fiber response and synchrony in multiple functional components reduces dimensions for reinforcement learning
eLife 12:e86340.
https://doi.org/10.7554/eLife.86340

Share this article

https://doi.org/10.7554/eLife.86340

Further reading

    1. Computational and Systems Biology
    2. Neuroscience
    Andrea I Luppi, Pedro AM Mediano ... Emmanuel A Stamatakis
    Research Article

    How is the information-processing architecture of the human brain organised, and how does its organisation support consciousness? Here, we combine network science and a rigorous information-theoretic notion of synergy to delineate a ‘synergistic global workspace’, comprising gateway regions that gather synergistic information from specialised modules across the human brain. This information is then integrated within the workspace and widely distributed via broadcaster regions. Through functional MRI analysis, we show that gateway regions of the synergistic workspace correspond to the human brain’s default mode network, whereas broadcasters coincide with the executive control network. We find that loss of consciousness due to general anaesthesia or disorders of consciousness corresponds to diminished ability of the synergistic workspace to integrate information, which is restored upon recovery. Thus, loss of consciousness coincides with a breakdown of information integration within the synergistic workspace of the human brain. This work contributes to conceptual and empirical reconciliation between two prominent scientific theories of consciousness, the Global Neuronal Workspace and Integrated Information Theory, while also advancing our understanding of how the human brain supports consciousness through the synergistic integration of information.

    1. Computational and Systems Biology
    2. Genetics and Genomics
    Ardalan Naseri, Degui Zhi, Shaojie Zhang
    Research Article Updated

    Runs-of-homozygosity (ROH) segments, contiguous homozygous regions in a genome were traditionally linked to families and inbred populations. However, a growing literature suggests that ROHs are ubiquitous in outbred populations. Still, most existing genetic studies of ROH in populations are limited to aggregated ROH content across the genome, which does not offer the resolution for mapping causal loci. This limitation is mainly due to a lack of methods for the efficient identification of shared ROH diplotypes. Here, we present a new method, ROH-DICE (runs-of-homozygous diplotype cluster enumerator), to find large ROH diplotype clusters, sufficiently long ROHs shared by a sufficient number of individuals, in large cohorts. ROH-DICE identified over 1 million ROH diplotypes that span over 100 single nucleotide polymorphisms (SNPs) and are shared by more than 100 UK Biobank participants. Moreover, we found significant associations of clustered ROH diplotypes across the genome with various self-reported diseases, with the strongest associations found between the extended human leukocyte antigen (HLA) region and autoimmune disorders. We found an association between a diplotype covering the homeostatic iron regulator (HFE) gene and hemochromatosis, even though the well-known causal SNP was not directly genotyped or imputed. Using a genome-wide scan, we identified a putative association between carriers of an ROH diplotype in chromosome 4 and an increase in mortality among COVID-19 patients (p-value = 1.82 × 10−11). In summary, our ROH-DICE method, by calling out large ROH diplotypes in a large outbred population, enables further population genetics into the demographic history of large populations. More importantly, our method enables a new genome-wide mapping approach for finding disease-causing loci with multi-marker recessive effects at a population scale.