Normative evidence accumulation in unpredictable environments
Abstract
In our dynamic world, decisions about noisy stimuli can require temporal accumulation of evidence to identify steady signals; differentiation to detect unpredictable changes in those signals; or both. Normative models can account for learning in these environments but have not yet been applied to faster decision processes. We present a novel, normative formulation of adaptive learning models that forms decisions by acting as a leaky accumulator with non-absorbing bounds. These dynamics, derived for both discrete and continuous cases, depend on the expected rate of change of the statistics of the evidence and balance signal identification and change detection. We found that, for two different tasks, human subjects learned these expectations, albeit imperfectly, then used them to make decisions in accordance with the normative model. The results represent a unified, empirically supported account of decision-making in unpredictable environments that provides new insights into the expectation-driven dynamics of the underlying neural signals.
Article and author information
Author details
Ethics
Human subjects: Informed consent, and consent to publish, was obtained from each subject prior to each experiment. Human subject protocols were approved by the University of Pennsylvania Internal Review Board.
Reviewing Editor
- Timothy Behrens, Oxford University, United Kingdom
Publication history
- Received: May 19, 2015
- Accepted: August 30, 2015
- Accepted Manuscript published: August 31, 2015 (version 1)
- Version of Record published: September 28, 2015 (version 2)
Copyright
© 2015, Glaze et al.
This article is distributed under the terms of the Creative Commons Attribution License permitting unrestricted use and redistribution provided that the original author and source are credited.
Metrics
-
- 4,018
- Page views
-
- 803
- Downloads
-
- 78
- Citations
Article citation count generated by polling the highest count across the following sources: Scopus, Crossref, PubMed Central.
Download links
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Further reading
-
- Genetics and Genomics
- Neuroscience
For at least two centuries, scientists have been enthralled by the “zombie” behaviors induced by mind-controlling parasites. Despite this interest, the mechanistic bases of these uncanny processes have remained mostly a mystery. Here, we leverage the Entomophthora muscae-Drosophila melanogaster “zombie fly” system to reveal the mechanistic underpinnings of summit disease, a manipulated behavior evoked by many fungal parasites. Using a high-throughput approach to measure summiting, we discovered that summiting behavior is characterized by a burst of locomotion and requires the host circadian and neurosecretory systems, specifically DN1p circadian neurons, pars intercerebralis to corpora allata projecting (PI-CA) neurons and corpora allata (CA), the latter being solely responsible for juvenile hormone (JH) synthesis and release. Using a machine learning classifier to identify summiting animals in real time, we observed that PI-CA neurons and CA appeared intact in summiting animals, despite invasion of adjacent regions of the “zombie fly” brain by E. muscae cells and extensive host tissue damage in the body cavity. The blood-brain barrier of flies late in their infection was significantly permeabilized, suggesting that factors in the hemolymph may have greater access to the central nervous system during summiting. Metabolomic analysis of hemolymph from summiting flies revealed differential abundance of several compounds compared to non-summiting flies. Transfusing the hemolymph of summiting flies into non-summiting recipients induced a burst of locomotion, demonstrating that factor(s) in the hemolymph likely cause summiting behavior. Altogether, our work reveals a neuro-mechanistic model for summiting wherein fungal cells perturb the fly’s hemolymph, activating a neurohormonal pathway linking clock neurons to juvenile hormone production in the CA, ultimately inducing locomotor activity in their host.
-
- Neuroscience
Deep brain stimulation targeting the posterior hypothalamus (pHyp-DBS) is being investigated as a treatment for refractory aggressive behavior, but its mechanisms of action remain elusive. We conducted an integrated imaging analysis of a large multi-centre dataset, incorporating volume of activated tissue modeling, probabilistic mapping, normative connectomics, and atlas-derived transcriptomics. Ninety-one percent of the patients responded positively to treatment, with a more striking improvement recorded in the pediatric population. Probabilistic mapping revealed an optimized surgical target within the posterior-inferior-lateral region of the posterior hypothalamic area. Normative connectomic analyses identified fiber tracts and functionally connected with brain areas associated with sensorimotor function, emotional regulation, and monoamine production. Functional connectivity between the target, periaqueductal gray and key limbic areas – together with patient age – were highly predictive of treatment outcome. Transcriptomic analysis showed that genes involved in mechanisms of aggressive behavior, neuronal communication, plasticity and neuroinflammation might underlie this functional network.