To sense our environment our nervous system must be able to distinguish between signals generated by our bodies and signals from our surroundings. Did my head or eyes move, or did my surroundings move? Was my arm moved by myself or by an external agent? To distinguish between these types of signals our nervous system combines a motor control circuit (which tells the body to do something) and one or more sensory circuits (which relay information from various inputs) to create an internal model of the world that allows us to separate the new information in these inputs from information that is not useful.
Understanding how this happens, and solving other amusing puzzles (such as why we can't tickle ourselves), means laying bare the circuitry that the brain uses to learn. In particular, we want to know if these circuits always have to learn to adapt to individual contexts, or can the changes learnt in one context be applied in other contexts that have not been experienced yet? Now, in eLife, Conor Dempsey, Larry Abbott and Nathaniel Sawtell of Columbia University report that weakly electric fish are able to generalize what they learn in one context and apply it in other contexts (Dempsey et al., 2019).
Animals can experience their environment through active or passive sensing. In passive sensing, an animal simply senses stimuli from the environment, including stimuli from other animals. In active sensing, the animal emits signals to sample its environment (e.g., sonar in bats), or modifies its body position to generate responses in primary sensory receptors (e.g., whiskers in rodents). In addition to locating and identifying objects, the signal emitted during active sensing has the potential to interfere with the passive signaling system, which could put the animal's life in danger. However, if the relevant passive sensory circuits are 'warned' about the active sensing pulses in advance, the problem of interference can be countered.
In the 1950s, Erich Von Holst and Roger Sperry independently investigated the 'corollary discharge': this is a copy of a motor command that is sent to a sensory region of the brain every time a motor command is sent to some region of the body. Von Holst and Sperry suggested that a key role of this discharge is to compensate for the effects of unwanted inputs to sensory circuits caused by the motor command. This compensation could be achieved by creating a 'negative image' that cancels out the unwanted inputs, thus leaving behind new signals of interest from the environment.
Weakly electric fish perform both active and passive sensing (Figure 1). They generate a few active pulses per second when they are at rest, and up to 60 pulses per second when they are hunting, with each active pulse inducing an electric field in the water and surrounding objects. Active electroreceptors in the skin detect pulses that have been shaped by nearby objects. In contrast, the passive electrosensing system senses the weak electric signals produced by other animals. However, these signals can become contaminated by the active pulses: indeed, each time an active pulse arrives at a passive electroreceptor, the receptor 'rings' for hundreds of milliseconds during which time any signals from potential prey are masked.
Motor commands sent from the pacemaker nucleus in the brain of an electric fish (green region in inset) cause the electric organ in the tail (red region) to emit electric pulses (blue arrows) that …
Pulses emanate from an electric organ in the tail, which receives motor commands from a pacemaker in the brain. Simultaneously, a corollary discharge is sent by that pacemaker to electrosensory cells in the hindbrain (see Figure 1). These cells then subtract the negative image produced by the corollary discharge from the total sensory input received from the electroreceptors (Bell, 1989; Bell et al., 1993; Roberts and Bell, 2000). In an environment that is devoid of features, the signal will be completely nulled by the subtraction. But, if features are present, a signal will remain after subtraction and this signal will be sent to the relevant higher brain regions so that the fish can react as necessary.
To date the cancellation of active sense pulses by electrosensory cells has only been analyzed at low pulse rates, and it was not clear if or how cancellation worked during hunting when pulse rates are higher. Dempsey, Abbott and Sawtell have now recorded the activity of the different cell populations in the corollary discharge pathway for a range of pulse rates. The signals they recorded were then integrated into an expanded version of a computational model they have built (Kennedy et al., 2014). This showed that the generalization of this particular response from low pulse rates to high pulse rates depended on at least two factors: i) the regularization of synaptic plasticity (this well-known machine learning technique avoids reproducing the finer fluctuations in the data, as doing so is detrimental to generalization); ii) nonlinear effects that make the dependence of the activity of the corollary discharge on pulse rate match the dependence of the activity of the electroreceptors on pulse rate.
Similar changes to those observed by Dempsey et al. in the corollary discharge pathway may be involved in how we predict the sensory effects of our own movements and distinguish these from environmental induced effects (Mejias et al., 2013; Straka et al., 2018). The search for synaptic regularization, the effect of natural learning conditions, and the integration of multiple sensory inputs by individual cerebellum cells (Ishikawa et al., 2015) are exciting avenues that will further impact how we think about human motor learning.
© 2019, Longtin
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.
Views, downloads and citations are aggregated across all versions of this paper published by eLife.
Active inference integrates perception, decision-making, and learning into a united theoretical framework, providing an efficient way to trade off exploration and exploitation by minimizing (expected) free energy. In this study, we asked how the brain represents values and uncertainties (novelty and variability), and resolves these uncertainties under the active inference framework in the exploration-exploitation trade-off. Twenty-five participants performed a contextual two-armed bandit task, with electroencephalogram (EEG) recordings. By comparing the model evidence for active inference and reinforcement learning models of choice behavior, we show that active inference better explains human decision-making under novelty and variability, which entails exploration or information seeking. The EEG sensor-level results show that the activity in the frontal, central, and parietal regions is associated with novelty, while the activity in the frontal and central brain regions is associated with variability. The EEG source-level results indicate that the expected free energy is encoded in the frontal pole and middle frontal gyrus and uncertainties are encoded in different brain regions but with overlap. Our study dissociates the expected free energy and uncertainties in active inference theory and their neural correlates, speaking to the construct validity of active inference in characterizing cognitive processes of human decisions. It provides behavioral and neural evidence of active inference in decision processes and insights into the neural mechanism of human decisions under uncertainties.
The mammalian suprachiasmatic nucleus (SCN), situated in the ventral hypothalamus, directs daily cellular and physiological rhythms across the body. The SCN clockwork is a self-sustaining transcriptional-translational feedback loop (TTFL) that in turn coordinates the expression of clock-controlled genes (CCGs) directing circadian programmes of SCN cellular activity. In the mouse, the transcription factor, ZFHX3 (zinc finger homeobox-3), is necessary for the development of the SCN and influences circadian behaviour in the adult. The molecular mechanisms by which ZFHX3 affects the SCN at transcriptomic and genomic levels are, however, poorly defined. Here, we used chromatin immunoprecipitation sequencing to map the genomic localization of ZFHX3-binding sites in SCN chromatin. To test for function, we then conducted comprehensive RNA sequencing at six distinct times-of-day to compare the SCN transcriptional profiles of control and ZFHX3-conditional null mutants. We show that the genome-wide occupancy of ZFHX3 occurs predominantly around gene transcription start sites, co-localizing with known histone modifications, and preferentially partnering with clock transcription factors (CLOCK, BMAL1) to regulate clock gene(s) transcription. Correspondingly, we show that the conditional loss of ZFHX3 in the adult has a dramatic effect on the SCN transcriptome, including changes in the levels of transcripts encoding elements of numerous neuropeptide neurotransmitter systems while attenuating the daily oscillation of the clock TF Bmal1. Furthermore, various TTFL genes and CCGs exhibited altered circadian expression profiles, consistent with an advanced in daily behavioural rhythms under 12 h light–12 h dark conditions. Together, these findings reveal the extensive genome-wide regulation mediated by ZFHX3 in the central clock that orchestrates daily timekeeping in mammals.