Dynamic organization of cerebellar climbing fiber response and synchrony in multiple functional components reduces dimensions for reinforcement learning

  1. Huu Hoang
  2. Shinichiro Tsutsumi
  3. Masanori Matsuzaki
  4. Masanobu Kano
  5. Mitsuo Kawato
  6. Kazuo Kitamura  Is a corresponding author
  7. Keisuke Toyama  Is a corresponding author
  1. Advanced Telecommunications Research Institute International, Japan
  2. RIKEN Center for Brain Science, Japan
  3. The University of Tokyo, Japan
  4. University of Yamanashi, Japan
  5. ATR Neural Information Analysis Laboratories, Japan

Abstract

Cerebellar climbing fibers convey diverse signals, but how they are organized in the compartmental structure of the cerebellar cortex during learning remains largely unclear. We analyzed a large amount of coordinate-localized two-photon imaging data from cerebellar Crus II in mice undergoing 'Go/No-go' reinforcement learning. Tensor component analysis revealed that a majority of climbing fiber inputs to Purkinje cells were reduced to only four functional components, corresponding to accurate timing control of motor initiation related to a Go cue, cognitive error-based learning, reward processing, and inhibition of erroneous behaviors after a No-go cue. Changes in neural activities during learning of the first two components were correlated with corresponding changes in timing control and error learning across animals, indirectly suggesting causal relationships. Spatial distribution of these components coincided well with boundaries of Aldolase-C/zebrin II expression in Purkinje cells, whereas several components are mixed in single neurons. Synchronization within individual components was bidirectionally regulated according to specific task contexts and learning stages. These findings suggest that, in close collaborations with other brain regions including the inferior olive nucleus, the cerebellum, based on anatomical compartments, reduces dimensions of the learning space by dynamically organizing multiple functional components, a feature that may inspire new-generation AI designs.

Data availability

Data analysed for all the figures are included in the manuscript and source data files. The Aldoc-tdTomato mouse line is available at RIKEN Bio Resource Center (RBRC10927).

The following previously published data sets were used

Article and author information

Author details

  1. Huu Hoang

    Computational Brain Imaging, Advanced Telecommunications Research Institute International, Kyoto, Japan
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0003-1463-8323
  2. Shinichiro Tsutsumi

    RIKEN Center for Brain Science, Saitama, Japan
    Competing interests
    The authors declare that no competing interests exist.
  3. Masanori Matsuzaki

    Department of Physiology, The University of Tokyo, Tokyo, Japan
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0003-3872-4322
  4. Masanobu Kano

    Department of Neurophysiology, The University of Tokyo, Tokyo, Japan
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-0725-3292
  5. Mitsuo Kawato

    Computational Brain Imaging, Advanced Telecommunications Research Institute International, Kyoto, Japan
    Competing interests
    The authors declare that no competing interests exist.
  6. Kazuo Kitamura

    Department of Neurophysiology, University of Yamanashi, Yamanashi, Japan
    For correspondence
    kitamurak@yamanashi.ac.jp
    Competing interests
    The authors declare that no competing interests exist.
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-8956-4122
  7. Keisuke Toyama

    Neural Information Analysis Laboratories, ATR Neural Information Analysis Laboratories, Kyoto, Japan
    For correspondence
    toyama@atr.jp
    Competing interests
    The authors declare that no competing interests exist.

Funding

Japan Society for the Promotion of Science

  • Huu Hoang
  • Masanori Matsuzaki
  • Masanobu Kano
  • Mitsuo Kawato
  • Kazuo Kitamura
  • Keisuke Toyama

Japan Science and Technology Agency

  • Huu Hoang
  • Keisuke Toyama

Japan Agency for Medical Research and Development

  • Huu Hoang
  • Mitsuo Kawato
  • Kazuo Kitamura

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Ethics

Animal experimentation: All experiments were approved by the Animal Experiment Committees of the University of Tokyo (#P08-015) and the University of Yamanashi (#A27-1), and carried out in accordance with national regulations and institutional guidelines.

Copyright

© 2023, Hoang et al.

This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 1,289
    views
  • 225
    downloads
  • 7
    citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Huu Hoang
  2. Shinichiro Tsutsumi
  3. Masanori Matsuzaki
  4. Masanobu Kano
  5. Mitsuo Kawato
  6. Kazuo Kitamura
  7. Keisuke Toyama
(2023)
Dynamic organization of cerebellar climbing fiber response and synchrony in multiple functional components reduces dimensions for reinforcement learning
eLife 12:e86340.
https://doi.org/10.7554/eLife.86340

Share this article

https://doi.org/10.7554/eLife.86340

Further reading

    1. Computational and Systems Biology
    2. Microbiology and Infectious Disease
    Saugat Poudel, Jason Hyun ... Bernhard O Palsson
    Research Article

    The Staphylococcus aureus clonal complex 8 (CC8) is made up of several subtypes with varying levels of clinical burden; from community-associated methicillin-resistant S. aureus USA300 strains to hospital-associated (HA-MRSA) USA500 strains and ancestral methicillin-susceptible (MSSA) strains. This phenotypic distribution within a single clonal complex makes CC8 an ideal clade to study the emergence of mutations important for antibiotic resistance and community spread. Gene-level analysis comparing USA300 against MSSA and HA-MRSA strains have revealed key horizontally acquired genes important for its rapid spread in the community. However, efforts to define the contributions of point mutations and indels have been confounded by strong linkage disequilibrium resulting from clonal propagation. To break down this confounding effect, we combined genetic association testing with a model of the transcriptional regulatory network (TRN) to find candidate mutations that may have led to changes in gene regulation. First, we used a De Bruijn graph genome-wide association study to enrich mutations unique to the USA300 lineages within CC8. Next, we reconstructed the TRN by using independent component analysis on 670 RNA-sequencing samples from USA300 and non-USA300 CC8 strains which predicted several genes with strain-specific altered expression patterns. Examination of the regulatory region of one of the genes enriched by both approaches, isdH, revealed a 38-bp deletion containing a Fur-binding site and a conserved single-nucleotide polymorphism which likely led to the altered expression levels in USA300 strains. Taken together, our results demonstrate the utility of reconstructed TRNs to address the limits of genetic approaches when studying emerging pathogenic strains.

    1. Computational and Systems Biology
    Masaaki Uematsu, Jeremy M Baskin
    Tools and Resources

    Plasmid construction is central to life science research, and sequence verification is arguably its costliest step. Long-read sequencing has emerged as a competitor to Sanger sequencing, with the principal benefit that whole plasmids can be sequenced in a single run. Nevertheless, the current cost of nanopore sequencing is still prohibitive for routine sequencing during plasmid construction. We develop a computational approach termed Simple Algorithm for Very Efficient Multiplexing of Oxford Nanopore Experiments for You (SAVEMONEY) that guides researchers to mix multiple plasmids and subsequently computationally de-mixes the resultant sequences. SAVEMONEY defines optimal mixtures in a pre-survey step, and following sequencing, executes a post-analysis workflow involving sequence classification, alignment, and consensus determination. By using Bayesian analysis with prior probability of expected plasmid construction error rate, high-confidence sequences can be obtained for each plasmid in the mixture. Plasmids differing by as little as two bases can be mixed as a single sample for nanopore sequencing, and routine multiplexing of even six plasmids per 180 reads can still maintain high accuracy of consensus sequencing. SAVEMONEY should further democratize whole-plasmid sequencing by nanopore and related technologies, driving down the effective cost of whole-plasmid sequencing to lower than that of a single Sanger sequencing run.