Learning: How the cerebellum learns to build a sequence

Rabbits can learn the biological analogue of a simple recursive function by relying only on the neurons of the cerebellum.
  1. Reza Shadmehr  Is a corresponding author
  1. Johns Hopkins School of Medicine, United States

Sequential patterns like the Fibonacci numbers, as well as the movements that produce a tied shoelace, are examples of recursion: the process begins with a seed that a system uses to generate an output. That output is then fed back to the system as a self-generated input, which in turn becomes a new output. The result is a recursive function that uses a seed (external input) at time t to generate outputs at times t, t + D, t + 2D and so on (where D is a constant interval of time). Now, in eLife, Andrei Khilkevich, Juan Zambrano, Molly-Marie Richards and Michael Mauk of the University of Texas at Austin report the results of experiments on rabbits which shed light on how the brain learns the biological analogue of a recursive function (Khilkevich et al., 2018).

To present the seed that started a sequence of motor outputs, Khilkevich et al. electrically stimulated the mossy fibers that provided inputs to the cerebellum. Near the end of the period of mossy fiber stimulation, they electrically stimulated the skin near the eyelid, which caused the rabbits to blink. The blink was the motor output. With repeated exposure to the mossy fiber input and the eyelid stimulation, the cerebellum learned to predict that the mossy fiber stimulation would be followed by the eyelid stimulation (Krupa et al., 1993), which then led to an anticipatory blink at time t. That is, given an input to the cerebellum at time t, the animals learned to produce an output at the same time. The technical term for this kind of learning is classical conditioning.

However, the goal for the rabbits was to learn to blink not just at time t, but also at times t + D, t + 2D and so on. That is, the challenge for the animal was to learn to use its own motor output at time t (the eye blink) as the cue needed to produce a second blink at t + D. To do this, Khilkevich et al. measured the eyelid response at time t. If the eye was less than 50% closed, they stimulated the eyelid as usual. However, if the eye was more than 50% closed, they stimulated it 600 milliseconds later (that is, at t + D). The critical point is that there was no input to the mossy fibers at t + D. Although earlier experiments had shown that the cerebellum was not able to associate a mossy fiber input with stimulation of the eyelid when the delay between them was longer than 400 milliseconds (Kalmbach et al., 2010), Khilkevich et al. found that the animals learned to blink not only at time t, but also at time t + D.

Their hypothesis was that the sequence was learned through recursion: a copy of the commands for the blink at t was sent as input to the cerebellum, allowing it to associate these commands with the eyelid stimulation at t + D, and thereby learning to blink at t + D. An elegant experiment confirmed this hypothesis: Khilkevich et al. found that after training was completed and the rabbits blinked at times t and t + D, omitting the eyelid stimulation at time t resulted in the extinction of the blinks at times t and t + D. Moreover, and rather remarkably, even if the eyelid was subsequently stimulated at time t + D, there was still no blink. This established the fundamental feature of the recursive function: without the blink at time t, which was generated because of the mossy fiber input at t, the animal could not produce a blink at time t + D.

Under normal conditions, the principal cells of the cerebellum, Purkinje cells, produce a steady stream of simple spikes. As the animal learns to associate the mossy fiber input with the eyelid stimulation, the Purkinje cells reduce their simple spike discharge just before the blink at time t, and again before the second blink at t + D (Jirenhed et al., 2017). Khilkevich et al. found that the modulation of the spikes before t + D appeared to be causal, because there was no blink response at t + D if there was no modulation around time t + D. The timing of the modulation at t and t + D also appeared consistent with a role for the cerebellum in generating the recursive function.

The results of Khilkevich and co-workers expand the range of learning behaviors that have been ascribed to the cerebellum. Earlier work had shown that Purkinje cells learn to associate motor commands with their sensory consequences (Herzfeld et al., 2015), forming 'forward models' that enable animals to control their movements with precision and accuracy (Heiney et al., 2014; Herzfeld et al., 2018). The new results demonstrate that Purkinje cells can also learn recursive functions, using a seed plus feedback from the animal’s own actions to construct a sequence of movements.

References

Article and author information

Author details

  1. Reza Shadmehr

    Reza Shadmehr is at the Laboratory for Computational Motor Control, Department of Biomedical Engineering, Johns Hopkins School of Medicine, Baltimore, United States

    For correspondence
    shadmehr@jhu.edu
    Competing interests
    No competing interests declared
    ORCID icon "This ORCID iD identifies the author of this article:" 0000-0002-7686-2569

Publication history

  1. Version of Record published: August 23, 2018 (version 1)

Copyright

© 2018, Shadmehr

This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.

Metrics

  • 1,521
    views
  • 173
    downloads
  • 0
    citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

  1. Reza Shadmehr
(2018)
Learning: How the cerebellum learns to build a sequence
eLife 7:e40660.
https://doi.org/10.7554/eLife.40660
  1. Further reading

Further reading

    1. Neuroscience
    Alyssa D Huff, Marlusa Karlen-Amarante ... Jan-Marino Ramirez
    Research Advance

    Obstructive sleep apnea (OSA) is a prevalent sleep-related breathing disorder that results in multiple bouts of intermittent hypoxia. OSA has many neurological and systemic comorbidities, including dysphagia, or disordered swallow, and discoordination with breathing. However, the mechanism in which chronic intermittent hypoxia (CIH) causes dysphagia is unknown. Recently, we showed the postinspiratory complex (PiCo) acts as an interface between the swallow pattern generator (SPG) and the inspiratory rhythm generator, the preBötzinger complex, to regulate proper swallow-breathing coordination (Huff et al., 2023). PiCo is characterized by interneurons co-expressing transporters for glutamate (Vglut2) and acetylcholine (ChAT). Here we show that optogenetic stimulation of ChATcre:Ai32, Vglut2cre:Ai32, and ChATcre:Vglut2FlpO:ChR2 mice exposed to CIH does not alter swallow-breathing coordination, but unexpectedly disrupts swallow behavior via triggering variable swallow motor patterns. This suggests that glutamatergic–cholinergic neurons in PiCo are not only critical for the regulation of swallow-breathing coordination, but also play an important role in the modulation of swallow motor patterning. Our study also suggests that swallow disruption, as seen in OSA, involves central nervous mechanisms interfering with swallow motor patterning and laryngeal activation. These findings are crucial for understanding the mechanisms underlying dysphagia, both in OSA and other breathing and neurological disorders.

    1. Neuroscience
    Vezha Boboeva, Alberto Pezzotta ... Athena Akrami
    Research Article

    The central tendency bias, or contraction bias, is a phenomenon where the judgment of the magnitude of items held in working memory appears to be biased toward the average of past observations. It is assumed to be an optimal strategy by the brain and commonly thought of as an expression of the brain’s ability to learn the statistical structure of sensory input. On the other hand, recency biases such as serial dependence are also commonly observed and are thought to reflect the content of working memory. Recent results from an auditory delayed comparison task in rats suggest that both biases may be more related than previously thought: when the posterior parietal cortex (PPC) was silenced, both short-term and contraction biases were reduced. By proposing a model of the circuit that may be involved in generating the behavior, we show that a volatile working memory content susceptible to shifting to the past sensory experience – producing short-term sensory history biases – naturally leads to contraction bias. The errors, occurring at the level of individual trials, are sampled from the full distribution of the stimuli and are not due to a gradual shift of the memory toward the sensory distribution’s mean. Our results are consistent with a broad set of behavioral findings and provide predictions of performance across different stimulus distributions and timings, delay intervals, as well as neuronal dynamics in putative working memory areas. Finally, we validate our model by performing a set of human psychophysics experiments of an auditory parametric working memory task.