Mechanisms underlying sharpening of visual response dynamics with familiarity

Version of Record

Accepted for publication after peer review and revision.

Download
Cite
Share
CommentOpen annotations (there are currently 0 annotations on this page).

Version of Record published: August 27, 2019 (This version)
Accepted Manuscript published: August 8, 2019 (Go to version)
Accepted: August 7, 2019
Received: December 3, 2018

1. Of interest
Early-life experience reorganizes neuromodulatory regulation of stage-specific behavioral responses and individuality dimensions during development

Reemy Ali Nasser, Yuval Harel, Shay Stern

Research Article Updated Jun 1, 2023
Further reading

Article
Figures and data
Abstract
Introduction
Results
Discussion
Materials and methods
Data availability
References
Decision letter
Author response
Article and author information
Metrics

Abstract

Experience-dependent modifications of synaptic connections are thought to change patterns of network activities and stimulus tuning with learning. However, only a few studies explored how synaptic plasticity shapes the response dynamics of cortical circuits. Here, we investigated the mechanism underlying sharpening of both stimulus selectivity and response dynamics with familiarity observed in monkey inferotemporal cortex. Broadening the distribution of activities and stronger oscillations in the response dynamics after learning provide evidence for synaptic plasticity in recurrent connections modifying the strength of positive feedback. Its interplay with slow negative feedback via firing rate adaptation is critical in sharpening response dynamics. Analysis of changes in temporal patterns also enables us to disentangle recurrent and feedforward synaptic plasticity and provides a measure for the strengths of recurrent synaptic plasticity. Overall, this work highlights the importance of analyzing changes in dynamics as well as network patterns to further reveal the mechanisms of visual learning.

https://doi.org/10.7554/eLife.44098.001

Introduction

Experience-dependent changes in neural responses have been suggested to underlie the more efficient and rapid processing of stimuli with learning. Human and monkeys have been reported to process familiar stimuli with shorter response times and with less effort (Greene and Rayner, 2001; Logothetis et al., 1995; Mruczek and Sheinberg, 2007). The possible neural correlate for such behavior enhancement is the sharpening of stimulus selectivity that is achieved by broadening the distribution of activities as the stimulus becomes familiar (Freedman et al., 2006; Kobatake et al., 1998; Lim et al., 2015; McKee et al., 2013; Woloszyn and Sheinberg, 2012). Also, temporal sharpening of neural responses with experience has been observed, which can increase the resolution of discriminating stimuli in time with learning (Meyer et al., 2014; Recanzone et al., 1992).

Modifications of synaptic connections have been thought to be one of the basic mechanisms for learning. A repeated encounter of a stimulus would elicit a particular activity pattern in the network, which in turn modifies synaptic connections depending on pre- and post-synaptic activities. Such modifications of synaptic connections lead to changes in neural responses that can be a substrate to differentiate learned and unlearned stimuli. The previous modeling works investigated the relationship between synaptic plasticity and changes in network activity to find a synaptic plasticity rule that can account for sharpening of stimulus selectivity observed with learning (Dayan and Abbott, 2005; Gerstner and Kistler, 2002). However, whether such rules can also explain temporal changes in neural responses is in question.

In this work, we investigate the mechanism underlying changes of response dynamics with learning. To this end, we consider neural activities recorded in inferior temporal cortex (ITC) known to be important for visual object recognition (Miyashita, 1993; Tanaka, 1996). In ITC, changes in the response properties with learning have been reported in several experiments (Freedman et al., 2006; Li et al., 1993; Lim et al., 2015; Logothetis et al., 1995; McKee et al., 2013; Woloszyn and Sheinberg, 2012; Xiang and Brown, 1998). The average over different visual stimuli of time-averaged responses decreases with familiarity, while the distribution of responses across visual stimuli broadens with learning. The dynamics of visual responses were also found to change with familiarity – in particular, rapid successive presentation of familiar images, but not novel images, elicits strong periodic responses (Meyer et al., 2014).

Previously, we investigated synaptic plasticity in recurrently connected circuits that reproduces changes in the distribution of time-averaged visual responses observed experimentally (Lim et al., 2015). As the distribution of time-averaged visual responses of a single cell to multiple stimuli can be a surrogate for a spatial pattern of the network to one stimulus in a homogeneous network, the previous work mainly focused on how recurrent synaptic plasticity shapes the network pattern and stimulus tuning. Here, we extend our previous framework to understand mechanisms underlying changes of temporal patterns with learning. First, we demonstrate that the synaptic plasticity rule inferred from the time-averaged responses is not sufficient to reproduce changes in response dynamics. Next, we show that the interaction between synaptic plasticity and negative feedback mechanisms is critical for generating stronger oscillation after learning. Using a mean-field analysis, we identify the conditions on synaptic plasticity and negative feedback to reproduce changes in response dynamics consistently observed in different experimental settings. Finally, we validate these conditions through network simulations and infer the post-synaptic dependence of synaptic plasticity from the experimental data.

Results

Effects of visual learning on response dynamics

In this section, we summarize the effects of visual experience on response dynamics obtained from three different laboratories comparing the visual response to novel (unlearned) and familiar (learned) stimuli in the monkey ITC (Lim et al., 2015; McKee et al., 2013; Meyer et al., 2014; Woloszyn and Sheinberg, 2012). Two experiments measured visual responses to the presentation of one stimulus, one in a passive viewing task (Lim et al., 2015; Woloszyn and Sheinberg, 2012) and the other in a dimming-detection task (Freedman et al., 2006; Lim et al., 2015; McKee et al., 2013). The duration of the stimulus presentation and number of stimuli were different in the two tasks: shorter duration of stimulus presentation and a larger set of stimuli in the passive viewing task in comparison to the dimming-detection task (Materials and methods). In both cases, the average response to familiar stimuli was lower than that to novel stimuli with a rapid decrease of the response around 150 ms after the stimulus onset in putative excitatory neurons (Figure 1A; Figure 5A,B for the dimming-detection task). On the other hand, the response to the most preferred stimulus was found to increase for familiar stimuli with broadening of the distribution of time-averaged activities (Figure 1B,C).

Figure 1 with 1 supplement see all

Download asset Open asset

Changes in response dynamics of putative excitatory neurons with learning in a passive viewing task (Lim et al., 2015; Woloszyn and Sheinberg, 2012).

(**A, B**) Average and maximal response to familiar (blue) and novel (red) stimuli. For each excitatory neuron, we normalized firing rates by the mean and standard deviation of time-averaged activities over novel stimuli during stimulus presentation (80 ms-200 ms after the stimulus onset) and took the average over stimuli (A) and the response with the highest time-averaged activity (B). Solid curves are activities averaged over neurons, and shaded regions represent mean ± s.e.m of activities averaged over individual neurons. The gray horizontal bar represents the visual stimulation period starting at 0 ms. (C) Distribution of time-averaged activities during stimulus presentation. For each neuron, according to time-averaged activities, a stimulus was rank-ordered among familiar and novel stimuli, respectively. At each rank of the stimuli, we averaged the normalized response over neurons, and obtained the distributions of activities over different ranks of stimuli. To avoid negative values in the x-axis on a logarithmic scale, we added two to normalized rates. (D) Rebound strength of damped oscillation. At each rank of stimuli, the rebound strength was quantified by the slope of changes of activities between 230 ms and 320 ms after the stimulus onset.

https://doi.org/10.7554/eLife.44098.002

Figure 1—source code 1 Data for Figure 1D.: https://doi.org/10.7554/eLife.44098.019
Download elife-44098-fig1-code1-v2.m

In both the mean and maximal responses to familiar stimuli, a rebound of activity was observed around 230 ms after the stimulus onset (Figure 1A,B). This is distinctive from responses to novel stimuli showing slow decay after the transient rise. We further quantified the magnitude of the rebound before and after learning by measuring the slope of changes in the activities at each rank of stimuli (Figure 1D). It showed that the higher-rank familiar stimuli exhibit the stronger rebound in putative excitatory neurons. In contrast, there is only a weak dependence between the rank of stimuli and the magnitude of rebound activity in inhibitory neurons (Figure 1—figure supplement 1).

The emergence of oscillatory responses after learning was also observed in different experimental settings. In the dimming detection task with longer stimulus presentation, the average response showed damped oscillation for familiar stimuli (Figure 5B; Freedman et al., 2006; McKee et al., 2013). In another experiment where either two novel stimuli or two familiar stimuli were presented rapidly in sequence, the peak response for the second familiar stimulus is as strong as the one for the first stimulus, while the response to the novel stimulus is suppressed at the second peak (Meyer et al., 2014). Thus, rapid successive presentation of familiar images, but not novel images, elicits strong periodic responses. Note that although all three experiments suggest stronger oscillation after learning, its strength may vary depending on a sampling of neurons and stimuli as only excitatory neurons with their most preferred stimuli exhibit strong oscillation after learning (Figure 1D).

In sum, the prominent effects of visual learning on responses of excitatory neurons are (i) reduction in average response, (ii) increase in maximum response, and (iii) stronger oscillations after learning. In the following, we show how such changes guide us to reveal a mechanism underlying visual learning that sharpens stimulus selectivity and temporal resolution of stimuli. Note that we focus on excitatory neurons only assuming that the dynamics of inhibitory neurons follow that of mean excitatory neurons, and do not contribute qualitative changes of response dynamics after learning. Such a simplification is based on the experimental observation that input changes and the magnitude of rebound activity depend weakly on the post-synaptic firing rates in inhibitory neurons (See Discussion for further justification).

Recurrent synaptic plasticity alone cannot reproduce the response dynamics

Activity-dependent modifications of synaptic connections can be one of the key elements to explain changes in network patterns and response dynamics with learning. Previously, we introduced a procedure to infer synaptic plasticity rules from experimental data so that networks implementing the derived learning rules can quantitatively reproduce changes in the distribution of time-averaged visual responses observed experimentally (Lim et al., 2015). We now extend this framework and explore whether synaptic plasticity alone would be sufficient to explain stronger oscillatory responses after learning.

To investigate the effect of learning on response dynamics, we considered a firing rate model with a plasticity rule that modifies the strength of recurrent synapses as a function of the firing rates of pre- and postsynaptic neurons. Activities of neurons are described by their firing rates r_i for i = 1,…, N, where N denotes the number of neurons in the network. Their dynamics are described by the following equations

τ_{r} \frac{d r_{i}}{d t} = - r_{i} + Φ (\sum W_{i j}^{R} r_{j} + \sum W_{i j}^{F} I_{j}^{X})

where Φ is a static transfer function (f-I curve), and the total input current is the sum of the recurrent input $\sum W_{i j}^{R} r_{j}$ and the feedforward input $\sum W_{i j}^{F} I_{j}^{X}$ . $W_{i j}^{k}$ denotes the strength of synaptic connection from neuron j to neuron i with k = R or F representing recurrent and feedforward connections, respectively. The superscript X denotes an external input, and $I_{i}^{X}$ is the external input to neuron i before learning with $W_{i j}^{F} = δ_{i j}$ .

We assumed that the recurrent synapses are plastic, changing their strengths according to $W_{i j}^{R} \to W_{i j}^{R} + Δ W_{i j}^{R}$ , which depends on the activities of both pre- and postsynaptic neurons during the stimulus presentation. We further assumed that the learning rule is a separable function of pre- and postsynaptic activity as

Δ W_{i j}^{R} = \frac{1}{N} f_{R} (ξ_{i}) g_{R} (ξ_{j})

where f and g are post- and pre-synaptic dependence of the learning rules, respectively, and ξ_i is the activity of neuron i averaged during the stimulus presentation before learning.

Previously, we found that synaptic plasticity in recurrent excitatory connections is sufficient to reproduce changes in the distribution of time-averaged visual responses observed experimentally (Lim et al., 2015). Hebbian-type synaptic plasticity with a potentiation in high firing rates leads to an increase of the maximal response of excitatory neurons, while overall depression leads to a decrease of the average network response of both excitatory and inhibitory neurons (Figure 2A). With such synaptic plasticity derived from the time-averaged activities, response dynamics in Equation (1) shows similar changes to the time-averaged responses (Figure 2B,C). However, the temporal profile is similar before and after learning and does not show oscillations after learning. Thus, synaptic plasticity alone is not sufficient for reproducing changes in response dynamics observed experimentally, which will be shown analytically in the next section.

Figure 2

Download asset Open asset

Networks with synaptic plasticity in recurrent connections without slow negative feedback.

(A) Example post-synaptic dependence of recurrent synaptic plasticity inferred from changes of time-averaged responses. Dependence of synaptic plasticity on the post-synaptic rate, f in Equation (2), shows depression for low rates and potentiation at high rates. (**B, C**) Average (B) and maximal (C) response before (red) and after (blue) learning for the network with synaptic plasticity only in recurrent connections.

https://doi.org/10.7554/eLife.44098.004

Interactions between recurrent synaptic plasticity and slow negative feedback

Another key ingredient to explain changes in response dynamics with learning can be slow negative feedback. In a dynamical system, resonance-like behavior emerges from the interaction between strong positive feedback and relatively slow negative feedback. Thus, enhanced resonance behavior after learning observed experimentally may suggest that changes in synaptic connections strengthen positive feedback in the circuit and affect the response dynamics by interacting with a slow negative feedback mechanism. Also, the reduced response to successive stimulus presentation of novel stimuli (Meyer et al., 2014) can be caused by the slow recovery from negative feedback.

For generating a damped oscillatory response after learning, we found that specific negative feedback such as firing rate adaptation is required (Figure 3). Similar to previous works investigating the effect of adaptation on the network activity in a mean-field approach (Fuhrmann et al., 2002; Laing and Chow, 2002; Tabak et al., 2006; Treves, 1993; van Vreeswijk and Hansel, 2001), we considered a linear mechanism for adaptation where the adaptation current is a low-pass filtered firing rate represented by the variable a_i with time constant τ_a and strength k. Then the dynamics of network activity is described by the following equations:

\begin{matrix} τ_{r} \frac{d r_{i}}{d t} = - r_{i} + Φ (\sum W_{i j}^{R} r_{j} - k a_{i} + \sum W_{i j}^{F} I_{j}^{X}) \\ τ_{a} \frac{d a_{i}}{d t} = - a_{i} + r_{i} \end{matrix}

Figure 3 with 2 supplements see all

Download asset Open asset

Mechanism of generating damped oscillations after learning.

(A) Schematics of the dynamics after learning. The overlap variable m is similar to activities of high rate neurons represented as r₁, and n represents adaptation in m. These high rate neurons drive a damped oscillation in the remaining population whose strength is proportional to the post-synaptic dependence of recurrent synaptic plasticity $f_{R} (ξ_{i})$ . (B) Interactions between potentiation of recurrent inputs and a slow adaptation mechanism. The strength of potentiation is proportional to ${\bar{f g}}_{R}$ (Equation 4) which is 0 before learning. The separatrix dividing overshoot and damped oscillations is shown as a parabola defined by ${\bar{f g}}_{R}$ , the strength of adaptation k and time constants τ_R and τ_A.

https://doi.org/10.7554/eLife.44098.005

Intuitively, interactions between recurrent synaptic plasticity and adaptation-like negative feedback in Equations (2) and (3) can reproduce two effects of visual learning, increase in maximal response and stronger oscillatory response after learning. Hebbian-type synaptic plasticity in recurrent connections provides strong potentiation in the connections among high firing rate neurons, and thus, generates a cell assembly with stronger positive feedback after learning (Figure 3A). This leads to not only an increase in the response of this cell assembly but also the emergence of oscillation under the interplay with slow adaptation currents. The strength of oscillation in the rest of the population may depend on the synaptic strengths from these high firing rate neurons.

To show this analytically, we investigated mean-field dynamics that summarize network activity with fewer variables (Materials and methods). To facilitate the analysis, we made two assumptions, linear dynamics with transfer function Φ(x) = x, and homogeneous connectivity before learning that reflects no correlation between novel stimuli and network structure. Under these assumptions, the dynamics before learning is described by average activity and adaptation, $\bar{r} = \frac{1}{N} \sum_{i} r_{i}$ and $\bar{a} = \frac{1}{N} \sum_{i} a_{i}$ . After learning, with synaptic plasticity in recurrent connections following Equation (2), recurrent connections become correlated with activity pattern they learned. Increased correlation between the learned pattern and network structure can be captured by additional variables m and n, defined as $m = \frac{1}{N} \sum_{i} g_{R} (ξ_{i}) r_{i}$ and $n = \frac{1}{N} \sum_{i} g_{R} (ξ_{i}) a_{i}$ , which is a variation of the pattern overlap $\frac{1}{N} \sum_{i} ξ_{i} r_{i}$ utilized previously to describe changes in dynamics with learning (Tsodyks and Feigel'man, 1988).

The variables m and n can approximately represent the activities and adaptation of high firing rate neurons as the activities and adaptation of high firing rate neurons contribute more to m and n variables with monotonically increasing pre-synaptic dependence $g_{R} (ξ_{i})$ (Figure 3A). Thus, potentiation of recurrent inputs in high firing rate neurons provides strong positive feedback in m, while slow adaptation mechanisms represented by n variables provide negative feedback. As the variables m and n are only present in the dynamics after learning, qualitative changes of the response dynamics in the network should be mainly led by their dynamics with strong potentiation in high rate neurons (Figure 3B). Such strong potentiation and generation of damped oscillation in high rate neurons are consistent with the observation that the rebound is strongest in those neurons (Figure 1D).

The recurrent input from high rate neurons can lead to a damped oscillatory response in the rest of the population (Figure 3A). The mean-field analysis shows that the strength of the damped oscillatory response is proportional to the strength of postsynaptic synaptic plasticity $f_{R} (ξ_{i})$ in the case of linear dynamics. If f_R for neuron i is positive (negative) corresponding to potentiation (depression) in recurrent inputs, an oscillation in neuron i would be in phase (out of phase) with that of high rate neurons. Previously, we proposed Hebbian-type but overall depression-dominant synaptic plasticity in recurrent connections to minimally account for the decrease in time-averaged responses (Lim et al., 2015). However, this would lead to out of phase oscillation in the mean and maximum response, inconsistent with the data (Figure 1A,B). Instead, overall potentiation in recurrent inputs with ${\bar{f}}_{R}$ >0 is required to generate in-phase oscillation in the mean and maximum response in linear dynamics (Figure 3—figure supplement 1).

Additional synaptic plasticity for reduction in average response

We showed that recurrent synaptic plasticity could account for the emergence of damped oscillation and sharpening neural activities by increasing the maximal response after learning. Furthermore, synchronous oscillations in the mean and maximum response observed experimentally suggest overall potentiation in recurrent inputs. However, potentiation-dominant synaptic plasticity in recurrent connections would increase overall synaptic input and cannot reproduce a decrease in average activities with learning (Figure 3—figure supplement 1A,B). The same holds for recurrent synaptic plasticity with or without the assumption of the constant sum normalization which imposes a constraint on the pre-synaptic dependence (Figure 3—figure supplement 2).

Instead, reduction in average response requires changes in external inputs or other recurrent inputs such as suppression in other excitatory inputs or enhanced inhibition. Enhanced recurrent inhibition can result from an increase in inhibitory activities after learning or potentiated inhibitory connections onto excitatory neurons. The former is inconsistent with the experimental observations showing a reduction in inhibitory firing rates across different stimuli (Figure 1—figure supplement 1). Also, potentiated inhibition with learning is less likely to account for a decrease of average excitatory activities - a temporal profile of inhibitory activities after learning shows a decrease of activity almost to the baseline in the late phase of the stimulus presentation (200–250 ms after the stimulus onset). This suggests that the effect of potentiated inhibition in the late phase is weaker than in the early phase while reduction of excitatory activities was observed in the late phase (Figure 1A,B).

Another possibility is a depression in recurrent excitation through different types of synapses such as potentiation in fast AMPA-like currents and depression in slow NMDA-like currents. Depression in slow excitatory currents can lead to a decrease in excitatory activities in the late phase. However, different regulation of AMPA and NMDA currents is inconsistent with the experimental observations showing maintenance of a constant NMDA-to-AMPA ratio under the changes of AMPA receptors induced chemically or by an STDP protocol (Watt et al., 2000; Watt et al., 2004).

Instead of additional changes of the recurrent synaptic inputs, we considered changes in external inputs with feedforward synaptic plasticity $Δ W_{i j}^{F} = f_{F} (ξ_{i}) g_{F} (ξ_{j})$ . Together with overall potentiation in the recurrent connections, dominant depression in the feedforward connections with ${\bar{f}}_{F}$ < 0 can reproduce the reduction of average responses over the stimuli with learning. In Figure 4, an example network with Hebbian learning rule in recurrent connections, uniform depression in the feedforward connection, and spike adaptation mechanisms was shown to reproduce the effects of visual learning qualitatively. With learning, the average response decreases in particular in the late phase (Figure 4A), but maximal firing rates increased and oscillation becomes prominent especially in high rates (Figure 4B,C). Also, in the successive presentation of two stimuli, the average response shows stronger oscillation after learning (Figure 4D), while the rank of individual neuronal activities changes when a new stimulus arrives (Figure 4E,F).

Figure 4

Download asset Open asset

Example network reproducing the effects of visual learning in one stimulus presentation (**A–C**) and successive presentation of two stimuli (**D–F**).

The network implements potentiation in the recurrent connections through Hebbian synaptic plasticity, depression in the feedforward connections through uniform scaling down of the external inputs, and spike-adaptation mechanisms. Mean responses reproduce the effects of visual learning predicted in the mean-field dynamics, showing average reduction and stronger oscillations (**A, D**). Representative individual activities before (**B,E**) and after (**C,F**) learning show that activities in neurons with high firing rates increase with strong oscillation after learning (**E,F**), but the rank of stimuli is shuffled with the arrival of a new stimulus.

https://doi.org/10.7554/eLife.44098.008

Figure 4—source code 1 MATLAB code for Figure 4.: https://doi.org/10.7554/eLife.44098.020
Download elife-44098-fig4-code1-v2.m

Note that the mean field dynamics was derived under the assumption of linear dynamics. With synaptic or neuronal nonlinearity, some conditions identified through our mean field dynamics can be mitigated such as less dominant potentiation in recurrent inputs with learning (Figure 6—figure supplement 1). However, a network simulation with example nonlinearity still shows that the core principles on the synaptic plasticity rule remain the same as strong potentiation in recurrent connections in high rate neurons, and average depression in feedforward inputs.

Network simulation and comparison with data

In this section, we validate that network models implementing the conditions identified through mean-field equations indeed reproduce the experimental observation and allow us to infer the post-synaptic dependence of synaptic plasticity. To illustrate this, we considered electrophysiological data obtained in a passive viewing task and dimming-detection task (Lim et al., 2015; McKee et al., 2013; Woloszyn and Sheinberg, 2012). In the dimming detection task, responses to fewer stimuli were measured, and we considered the response averaged over neurons and stimuli, which was fitted using mean-field dynamics (Figure 5). The external inputs and parameters of the $\bar{r}$ and $\bar{a}$ dynamics before learning were chosen to generate no oscillations (Figure 5A; Figure 5—figure supplement 1). Potentiation in high firing rate neurons, average potentiation of recurrent inputs and depression in feedforward inputs were found to mimic response to familiar stimuli (Figure 5B).

Figure 5 with 3 supplements see all

Download asset Open asset

Comparison between network simulation and data obtained in a dimming-detection task.

(**A, B**) Fitting response dynamics (red in A and blue in B) using mean-field equations (gray in A and black in B) for novel (A) and familiar (B) stimuli. (**C,D**) Simulation for one stimulus presentation (C) and successive presentation of stimuli (D). The gray horizontal bar represents the visual stimulation period starting at 500 ms and x-axis is truncated to show activities from their onsets. In A-C, the stimulus was presented for a duration that was a sum of a fixed duration (650 ms shown in the dark gray) and a random duration (shown in the light gray). In D, different gray bars represent different stimuli shown alternatively for a duration of 150 ms.

https://doi.org/10.7554/eLife.44098.009

Figure 5—source code 1 Data for Figure 5.: https://doi.org/10.7554/eLife.44098.021
Download elife-44098-fig5-code1-v2.mat
Figure 5—source code 2 MATLAB code for Figure 5.: https://doi.org/10.7554/eLife.44098.022
Download elife-44098-fig5-code2-v2.m

This mean-field dynamics reproduces prominent features of response dynamics before and after learning, showing damped oscillation and a decrease in average response to familiar stimuli after its peak (Figure 5C). Furthermore, we simulated the mean response to novel and familiar stimuli for a successive presentation of stimuli (Figure 5D). When novel stimuli are repeatedly shown, the peak response to the second stimuli is smaller than the response to the first, due to a slow recovery from the adaptation current. In contrast, for the serial presentation of familiar stimuli, the response to the first stimulus decays quickly and the response to the second stimulus is less affected by the adaptation current. Thus, the overall response becomes more oscillatory compared to the one for novel stimuli.

In the experimental data obtained during the passive viewing task, the duration of stimulus presentation was shorter, but the distribution of response dynamics before and after learning could be obtained (Figure 1C; Materials and methods). As in the dimming detection task, the external inputs were obtained from the responses to novel stimuli. By comparing the response dynamics at each rank of the novel and familiar stimuli, we derived the post-synaptic dependence of synaptic plasticity in recurrent and feedforward connections. Note that the synaptic plasticity was inferred from normalized firing rates averaged over neurons under the assumption that the dependence of synaptic plasticity rules on normalized firing rates is the same across different neurons (See Discussion for justification).

Consistent with the fitting of the mean-field dynamics to the data obtained in a dimming detection task, the average post-synaptic dependence of synaptic plasticity leads to potentiation in recurrent inputs and depression in feedforward inputs (Figure 6A). Furthermore, the post-synaptic dependence in recurrent connections is an increasing function of the rank of stimuli, or equivalently, the post-synaptic activities. It is notable that such a tendency is similar to the dependence of the rebound magnitude to familiar stimuli on the rank of stimuli observed experimentally (Figure 1D). Network models implementing the derived synaptic plasticity reproduce the reduction of average activities (Figure 6B) and rebound in the late phase of stimulus presentation in both average and maximal responses, although the maximal response after the initial rise is less well fitted (Figure 6C).

Figure 6 with 3 supplements see all

Download asset Open asset

Post-synaptic dependence of synaptic plasticity in recurrent (left) and feedforward (right) connections derived from a passive viewing task (A) and comparison between the data and network simulations for average (B) and maximal (C) responses.

The external inputs were chosen so that the response to novel stimuli is the same in the experiment and simulation (red in B,C). With the derived post-synaptic dependence in the recurrent and feedforward connections (A), the response to familiar stimuli was simulated (black in B,C).

https://doi.org/10.7554/eLife.44098.013

Figure 6—source code 1 MATLAB code for Figure 6.: https://doi.org/10.7554/eLife.44098.023
Download elife-44098-fig6-code1-v2.m

We also checked whether the key conditions for synaptic plasticity change with example nonlinear input-output transfer function derived from the time-averaged response to novel stimuli (Figure 6—figure supplement 1A). The derived post-synaptic dependence in both recurrent and feedforward connections is similar to that obtained under linear dynamics with more balance between depression and potentiation in recurrent synaptic plasticity (Figure 6—figure supplement 1B). Although the rebound in the average activities is less well fitted compared to that with linear dynamics, the network simulations agree with the data qualitatively (Figure 6—figure supplement 1C,D).

Alternative negative feedback mechanisms

Our mean field analysis and model fit to the data suggest firing rate adaptation mechanisms as a good candidate for slow negative feedback to explain the familiarity effect on the dynamics. Here, we explored whether two alternative negative feedback mechanisms such as delayed global inhibition or short-term depression can replace adaptation. Delayed global inhibition may arise due to local inhibition with slow NMDA- or GABA_B-like currents in inhibitory feedback pathways, or inhibitory feedback from other areas. For instance, prefrontal cortex shows a familiarity effect with a long latency around 100 ms but with opposite sign (Rainer and Miller, 2000; Xiang and Brown, 2004), and thus, the top-down signals from this area can serve as slow negative feedback.

We considered a model of global inhibition so that all excitatory neurons receive the same slow inhibition whose strength is proportional to the average activity of excitatory neurons (Materials and methods). Under the assumption of linearity, we could derive the mean field equations similar to that with adaptation mechanisms with variables r, a and m but without variable n that mainly represents the negative feedback in high firing rate neurons (Equation (6)). Without negative feedback, m cannot generate damped oscillations after learning in both high rate neurons and the overall population. This suggests that slow negative feedback private to individual neurons or sub-populations is required to generate qualitative changes in dynamics as interacting with synaptic plasticity.

Short-term depression in synaptic connections has also been suggested as a mechanism for negative feedback and generating oscillations in cortical circuits (Laing and Chow, 2002; Loebel and Tsodyks, 2002; Tabak et al., 2006; Wang, 2010). To see whether short-term depression can reproduce the damped oscillatory response after learning, we considered a phenomenological model mimicking the effect of depletion of a neurotransmitter such that when the pre-synaptic firing is high, the synaptic input from such neuron becomes weak due to the lack of resources (Materials and methods; Tsodyks and Markram, 1997). Under the assumption that the recurrent connection is weak before learning, and the damped oscillation in the network is led by that in the high rate neurons, we searched for a parameter set of the strength and timescale of short-term plasticity that provides the best fit to the experimental data. However, the network simulation with the best-fitted parameters cannot generate a strong rebound, unlike the adaptation mechanisms (Figure 6—figure supplement 2). Thus, a simple phenomenological model of short-term plasticity cannot explain the qualitative changes in response dynamics observed experimentally.

Discussion

In this work, we provided a mechanistic understanding of how interactions between synaptic plasticity and a negative feedback mechanism implementing firing rate adaptation shape response dynamics with learning. The emergence of damped oscillations after learning requires strong positive feedback through potentiation in recurrent connections particularly among neurons with high firing rates. Such recurrent synaptic plasticity broadens the distribution of activities, while depression in feedforward inputs decreases average firing rates. Synaptic plasticity, therefore, enables the sparse and efficient representation of the learned stimuli. Furthermore, the strength of rebound of damped oscillation observed after learning can be a novel, graded measure for recurrent synaptic plasticity. On the other hand, adaptation-like mechanisms are critical for enhanced oscillatory responses after learning, and strongly suppresses the neural activities for the learned stimuli in particular in the late phase of the stimulus presentation. As such temporal sharpening prepares neurons to respond to the subsequent stimulus, our work suggests that the adaptation mechanisms together with synaptic plasticity may play an important role in the rapid processing of the learned stimuli.

Here, we extended our previous work inferring recurrent synaptic plasticity rules from time-averaged data in a static model of a cortical network to time-course data and a dynamic model with additional spike adaptation mechanisms and feedforward synaptic plasticity (Lim et al., 2015). Analyzing time-course data allows disentangling contributions of synaptic plasticity in different connections. However, similar to the previous work, only post-synaptic dependence of the synaptic plasticity rules can be inferred from single cell recordings under the assumption that the learning rules are a separable function of pre- and postsynaptic rates. Also, fitting the time course poses a limitation such that synaptic plasticity rules needed to be inferred from the data averaged over neurons due to noise. On the other hand, time-averaged data allows to infer recurrent synaptic plasticity in different neurons, which reveals a strong correlation between neural activity and the threshold separating depression and potentiation, but no correlation when the post-synaptic activity is normalized (Lim et al., 2015). Inspired by this observation, we inferred synaptic plasticity rules from normalized firing rates under the assumption that synaptic plasticity rules are the same across different neurons when inputs and rates are normalized (Figures 1 and 6). Although a direct test of this assumption is not feasible, the relatively small variance of rebound strengths over neurons may support this assumption on the recurrent synaptic plasticity as the dependence of rebound strengths on the rank of stimuli alternatively represents learning rules in recurrent connections (Figure 6C). Furthermore, if the learning rule inferred from the time-averaged response is the combination of recurrent and feedforward synaptic plasticity, the same learning rules of this mixture and recurrent connections across different neurons would justify the assumption on the feedforward plasticity (Figure 6—figure supplement 3).

Our work provides a reconciling perspective between two prominent classes of synaptic plasticity models suggested for familiarity detection and associative memory in ITC. Depression in the feedforward connections required to lower average response after learning reasserts the role of feedforward synaptic plasticity suggested for familiarity detection (Bogacz and Brown, 2003; Norman and O'Reilly, 2003; Sohal and Hasselmo, 2000). On the other hand, most theoretical works implementing synaptic plasticity in recurrent connections have focused on associative memory and the emergence of attractors with learning (Amit and Brunel, 1997; Pereira and Brunel, 2018; Sohal and Hasselmo, 2000). Unlike most of the previous works focusing on one-type of synaptic plasticity, our analysis proposed that both recurrent and feedforward synaptic plasticity are required to reproduce changes in spatial and temporal patterns underlying familiarity detection. A recent study investigated the memory capacity for associative memory under recurrent synaptic plasticity whose form was derived from neural activities related to familiarity detection (Pereira and Brunel, 2018). Similarly, it can be further investigated how the feedforward and recurrent synaptic plasticity rules derived from the data for familiarity detection contribute to other types of memory, and how a memory capacity changes dynamically during the stimulus presentation with slow spike adaptation mechanisms.

As a substrate for slow negative feedback, firing rate adaptation mechanisms have been suggested to be critical in generating network oscillations and synchrony (Ermentrout et al., 2001; Fuhrmann et al., 2002; La Camera et al., 2004; Laing and Chow, 2002; Tabak et al., 2006; van Vreeswijk and Hansel, 2001; Wang, 2010), and in optimal information transmission under a particular form of synaptic plasticity (Hennequin et al., 2010). The effect of synaptic plasticity on enhancing synchrony in the recurrent synaptic circuits also has been explored theoretically (Gilson et al., 2010; Karbowski and Ermentrout, 2002; Morrison et al., 2007). Consistent with these previous works, our work suggests that the interplay between synaptic plasticity and adaptation with the time constant consistent with that of cellular adaptation mechanisms (Benda and Herz, 2003) generate synchronous damped oscillations after learning. Note that our analysis based on the data obtained from single cell physiology is limited to firing rate synchrony, and how spike-time correlation between neurons changes with visual learning needs to be further explored. Also, our work emphasizes the role of adaptation in different types of recognition memory. Previously, the adaptation mechanisms in the temporal cortex have been suggested to encode the recency of stimuli, which is typically measured by suppression of the response to the repetition of a stimulus (Meyer and Rust, 2018; Miller et al., 1991; Vogels, 2016; Xiang and Brown, 1998). As the time scale of repetition suppression lasts up to seconds, it may require the adaptation mechanisms on the much longer time scale (Sanchez-Vives et al., 2000). Thus, adaptation on various time scales (La Camera et al., 2006; Pozzorini et al., 2013) may be required for different types of recognition memory.

In our work, we assumed that inhibition minimally contributes to shaping response dynamics with learning for the following reasons. First, no dependence of input changes on post-synaptic firing rates in inhibitory neurons observed experimentally suggests that changes in inhibitory activities with learning can reflect the reduction of average excitatory activities and thereafter, excitatory inputs to inhibitory neurons without synaptic plasticity in the excitatory (E)-to-inhibitory (I) connections (Lim et al., 2015). On the other hand, anti-Hebbian synaptic plasticity in the I-to-E connections can have similar effects as Hebbian-synaptic plasticity in the E-to-E connections. Alternatively, overall potentiation in the I-to-E connections can provide stronger negative feedback or can replace the role of feedforward synaptic plasticity. However, as the dynamics of inhibitory neurons show strong suppression almost to the baseline in the late phase of the stimulus presentation after learning (Figure 1—figure supplement 1), neither anti-Hebbian synaptic plasticity nor potentiation can account for an increase of maximal response of excitatory neurons in the early phase and overall reduction in activities in the late phase (Figure 1). Thus, we assumed that changes in the inhibitory pathway are less likely to induce oscillation or suppression in the excitatory neurons. It is notable that the interaction between synaptic plasticity in both recurrent excitatory and inhibitory connections was suggested to reproduce increased transient response with learning (Moldakarimov et al., 2006). Although the homeostatic inhibitory plasticity proposed in this work cannot reproduce damped oscillatory response observed in ITC, we cannot rule out the role of inhibitory synaptic plasticity that can be complementary to the mechanisms proposed in our work.

The enhanced oscillation for familiar stimuli investigated here was around 5 Hz, which is in the range of theta oscillations. Such a low-frequency oscillation has been discussed in visual search to characterize overt exploration or sampling behaviors such as saccadic or microsaccadic eye movements (Otero-Millan et al., 2008; Buzsaki, 2011) and to underlie covert shift of attention that samples different stimuli rhythmically (Dugué et al., 2015; Fiebelkorn et al., 2013; Landau and Fries, 2012). In line with these studies, Rollenhagen and Olson (2005) observed that low-frequency oscillation became stronger when another stimulus was present together. Competitive interactions between populations representing different stimuli were suggested to generate oscillation with fatigue mechanism (Moldakarimov et al., 2005; Rollenhagen and Olson, 2005). Based on the adaptation mechanisms proposed in the current work, competition between two different familiar stimuli can generate stronger oscillation at a similar frequency. In the mean-field dynamics with two mutually inhibitory populations each of which mimics the maximum response to a single familiar stimulus, stronger oscillation but with the similar frequency with that for the single stimulus presentation was reproduced in the presentation of two stimuli (Figure 7). This may indicate low-frequency damped oscillators for a single familiar stimulus can be a building block for a rhythmic sampling of multiple stimuli and covert attentional shift through competitive interactions.

Figure 7

Download asset Open asset

Enhanced oscillation through competitive interactions between different stimuli.

(A) Two mutually inhibitory populations selectively responding to stimuli 1 and 2, respectively. The dynamics of each population follows the dynamics of m in the mean-field description for a single familiar stimulus in Figures 3A,5. (B) Time course of visual responses of two populations with different stimulus onsets (black and gray bars below). Stimulus 2 was present 500 ms after the onset of stimulus 1, and the population two was assumed to be silent before the arrival of stimulus 2. After the onset of stimulus 2, visual response selective to stimulus one was transiently suppressed and showed stronger oscillation compared to that under the single stimulus presentation.

https://doi.org/10.7554/eLife.44098.017

Overall, our work resonates with perspectives emphasizing the importance of dynamics in understanding cognitive functions (Bargmann and Marder, 2013; Kopell et al., 2014). As an extension of our previous work that inferred the synaptic plasticity rules from changes in spatial patterns, additional analysis of response dynamics revealed the role of slow adaptation currents in shaping response dynamics. Different contributions to activity changes of recurrent and feedforward synaptic plasticity suggested in our work can be further utilized to examine how each synaptic plasticity engages during the progress of learning. Also, although we suggested a local circuit model for visual learning, interactions with other areas might also be important – for instance, the interactions between ITC and perirhinal cortex may form positive feedback given the adjacency of these two areas and similar familiarity effects observed experimentally (Xiang and Brown, 1998). On the other hand, prefrontal cortex showing opposite effects of familiarity with a long latency may provide slow negative feedback (Xiang and Brown, 2004). To dissect the interaction between multiple regions, one can analyze time course data investigating latencies and qualitative changes in dynamics in these areas such as the emergence of oscillatory response after learning.

Materials and methods

Mean-field dynamics

Request a detailed protocol

To derive the mean field dynamics from Equation (3), we assumed linear dynamics with Φ(x) = x and uniform recurrent connectivity before learning $W_{i j}^{R} = w_{R} / N$ . Note that uniform connection can be replaced by random connection, which is analogous to the state where the network connectivity is stabilized after learning of a large number of uncorrelated activity patterns, but not correlated with the stimulus of interest (Lim et al., 2015). We also assumed $\sum g_{k} (ξ_{j}) = 0$ so that the sum of synaptic weights over the presynaptic neurons is preserved with learning. The external input to neuron i before learning is defined as $I_{i}^{X}$ with $W_{i j}^{F} = δ_{i j}$ .

Before learning, the mean-field dynamics can be obtained by taking an average over neurons, which yields a two-dimensional system of differential equations in terms of $\bar{r} = \frac{1}{N} \sum_{i} r_{i}$ and $\bar{a} = \frac{1}{N} \sum_{i} a_{i}$ . After learning, with $W_{i j}^{k} \to W_{i j}^{k} + \frac{1}{N} f_{k} (ξ_{i}) g_{k} (ξ_{j})$ , Equation (3) becomes

\begin{matrix} τ_{r} \frac{d r_{i}}{d t} = - r_{i} + w_{r} \frac{1}{N} \sum_{j} r_{j} + f_{R} (ξ_{i}) \frac{1}{N} \sum_{j} g_{R} (ξ_{j}) r_{j} - k a_{i} + I_{i}^{X} + f_{F} (ξ_{i}) \frac{1}{N} \sum g_{F} (ξ_{j}) I_{j}^{X} \\ τ_{a} \frac{d a_{i}}{d t} = - a_{i} + r_{i} \end{matrix}

The mean-field dynamics is four-dimensional with additional variables $m = \frac{1}{N} \sum_{i} g_{R} (ξ_{i}) r_{i}$ and $n = \frac{1}{N} \sum_{i} g_{R} (ξ_{i}) a_{i}$ . The dynamics of m and n can be obtained by multiplying $g_{R} (ξ_{j})$ to Equation (3) and taking the average over neurons as

\begin{array}{ll} τ_{r} \frac{d \frac{1}{N} \sum_{j} {g_{R} (ξ_{j}) r_{j}}_{i}}{d t} = - \frac{1}{N} \sum_{j} g_{R} (ξ_{j}) r_{j} + w_{r} \frac{1}{N} \sum_{j} g_{R} (ξ_{j}) \frac{1}{N} \sum_{j} r_{j} + \frac{1}{N} \sum_{j} f_{R} (ξ_{j}) g_{R} (ξ_{j}) m \\ - k \frac{1}{N} \sum_{j} g_{R} (ξ_{j}) a_{j} + k \frac{1}{N} \sum_{j} g_{R} (ξ_{j}) I_{j}^{X} + \frac{1}{N} \sum_{j} f_{F} (ξ_{j}) g_{R} (ξ_{j}) I_{F X} \end{array}

τ_{a} \frac{d \frac{1}{N} \sum_{j} g_{R} (ξ_{j}) a_{j}}{d t} = - \frac{1}{N} \sum_{j} g_{R} (ξ_{j}) a_{j} + \sum_{j} g_{R} (ξ_{j}) r_{j}

With $\sum g_{k} (ξ_{j}) = 0$ , the second term in the first equation disappears (note that without $\sum g_{k} (ξ_{j}) = 0$ , this term remains and provides feedback from $\bar{r}$ to the m dynamics as in Figure 3—figure supplement 2). Then, the mean-field dynamics after learning is given as

\begin{matrix} τ_{R} \frac{d \bar{r}}{d t} = - \bar{r} + w_{R} \bar{r} + {\bar{f}}_{R} m - k \bar{a} + {\bar{I}}_{X} + {\bar{f}}_{F} I_{F X} \\ τ_{A} \frac{d \bar{a}}{d t} = - \bar{a} + \bar{r} \\ τ_{R} \frac{d m}{d t} = - m + {\bar{f g}}_{R} m - k n + I_{M X} + {\bar{f g}}_{F} I_{F X} \\ τ_{A} \frac{d n}{d t} = - n + m \end{matrix}

with

\begin{matrix} \bar{r} = \frac{1}{N} \sum_{i} r_{i}, & \bar{a} = \frac{1}{N} \sum_{i} a_{i} \\ m = \frac{1}{N} \sum_{i} g_{R} (ξ_{i}) r_{i}, & n = \frac{1}{N} \sum_{i} g_{R} (ξ_{i}) a_{i} . \end{matrix}

In Equation (4), ${\bar{f}}_{R, F} = \frac{1}{N} \sum_{i} f_{R, F} (ξ_{i})$ is the average post-synaptic dependence of recurrent and feedforward synaptic plasticity, ${\bar{f g}}_{k} = \frac{1}{N} \sum_{i} f_{k} (ξ_{i}) g_{R} (ξ_{i})$ is the average of the product of post- and pre-synaptic dependence f and g. I represent the external inputs where ${\bar{I}}_{X} = \frac{1}{N} \sum_{} I_{i}^{X}, I_{F X} = \frac{1}{N} \sum_{} g_{F} (ξ_{i}) I_{i}^{X}, I_{M X} = \frac{1}{N} \sum_{} g_{R} (ξ_{i}) I_{i}^{X}$ .

To describe visual responses under the successive presentation of stimuli (Meyer et al., 2014), we consider learning of two stimuli. Changes of synaptic connections after two stimuli become $W_{i j}^{k} \to W_{i j}^{k} + Δ W_{i j}^{k, 1} + Δ W_{i j}^{k, 2}$ where superscripts 1 and 2 represent the indices of the stimuli. With the same synaptic plasticity rule as in Equation (2), ${\bar{f}}_{R, F}$ and ${\bar{f g}}_{R, F}$ for different stimuli are the same, and the external input is the sum of the inputs $I_{^{i}}^{X} = I_{i}^{X, 1} + I_{i}^{X, 2}$ . For simplicity, we assume that the interaction of learning two stimuli is minimal such that two stimuli are uncorrelated as $\sum_{} f_{k} (ξ_{j}^{l_{1}}) g_{k} (ξ_{j}^{l_{2}}) = 0$ and $\sum_{} I_{j}^{X, l_{1}} g_{k} (ξ_{j}^{l_{2}}) = 0$ for l₁, l₂ = 1,2 but l₁ ≠ l₂. Then, by defining the overlap variables as $m = \frac{1}{N} \sum_{} (g_{R} (ξ_{j}^{1}) + g_{R} (ξ_{j}^{2})) r_{j}$ , $n = \frac{1}{N} \sum_{} (g_{R} (ξ_{j}^{1}) + g_{R} (ξ_{j}^{2})) a_{j}$ , and inputs as $I_{F X} = \frac{1}{N} \sum_{} (g_{F} (ξ_{i}^{1}) + g_{F} (ξ_{i}^{2})) I_{i}^{X}$ and $I_{M X} = \frac{1}{N} \sum_{} (g_{R} (ξ_{i}^{1}) + g_{R} (ξ_{i}^{2})) I_{i}^{X}$ , the dynamics after learning two stimuli is the same as for that stimulus given in Equation (4).

Constraints on parameters in the mean-field dynamics

Request a detailed protocol

In this section, we describe the conditions on parameters in the mean-field dynamics Equation (4) to reproduce changes of response dynamics with learning qualitatively. Changes in response dynamics showing stronger oscillation after learning imposes a condition on the m and n dynamics in Equation (4), and thus the constraints on the strength of potentiation, ${\bar{f g}}_{R}$ , parameters for adaptation, k and τ_A, and time constant τ_R (Figure 3B). Also, response dynamics to novel stimuli such as no damped oscillation before learning and reduced response in the successive presentation of novel stimuli leads to constraints on the dynamics of $\bar{r}$ and $\bar{a}$ before learning, thus, k, τ_A, τ_R, and connectivity strength before learning w_R (Figure 5—figure supplement 1).

Under the linear assumption, the dynamics is characterized by the eigenvalues of the system, and the eigenvalues of the m and n dynamics are given as $(- 1 + {\bar{f g}}_{R}) / τ_{R} - 1 / τ_{A} \pm \sqrt{{(- 1 + {\bar{f g}}_{R}) / τ_{R} + 1 / τ_{A}}^{2} - 4 k / (τ_{R} τ_{A})}$ . The transition to overdamped oscillation occurs when the eigenvalue becomes a complex number, that is, ${(- 1 + {\bar{f g}}_{R}) / τ_{R} + 1 / τ_{A}}^{2} - 4 k / (τ_{R} τ_{A})$ changes its sign. This provides a separatrix (red to blue region in Figure 3B). Also, the stability requiring a negative real part of eigenvalues imposes two other conditions, ${\bar{f g}}_{R} < 1 + τ_{R} / τ_{A}$ , and $(- 1 + {\bar{f g}}_{R}) / τ_{R} - 1 / τ_{A} + \sqrt{{(- 1 + {\bar{f g}}_{R}) / τ_{R} + 1 / τ_{A}}^{2} - 4 k / (τ_{R} τ_{A})} < 0$ , that is, ${\bar{f g}}_{R} - k - 1 < 0$ (two lines on the right side in Figure 3B).

Similarly, the eigenvalues of linear dynamics of $\bar{r}$ and $\bar{a}$ before learning are given as $(- 1 + w_{R}) / τ_{R} - 1 / τ_{A} \pm \sqrt{{(- 1 + w_{R}) / τ_{R} + 1 / τ_{A}}^{2} - 4 k / (τ_{R} τ_{A})}$ , and no oscillation before learning requires no complex eigenvalues, that is, ${(- 1 + w_{R}) / τ_{R} + 1 / τ_{A}}^{2} - 4 k / (τ_{R} τ_{A}) \geq 0$ (solid curve in Figure 5—figure supplement 1). Another condition is that the second peak is lower than the first peak in the successive presentation of two novel stimuli. To derive analytical expression, we made the following assumptions − i) neural activity changes linearly during the rising and decaying phases, and ii) during the rising phase, the adaptation variable $\bar{a}$ and external input are constant. We denote t₀ and t₁ as the duration of the rising and decaying phases, r₀ and r₁ are activities at the end of the rising and decaying phases with $\bar{r}$ = 0 and $\bar{a}$ = 0 as the baseline before the stimulus presentation. Also, if we denote I₀ as the constant input during the rising phase, then approximately, $r_{0} = I_{0} t_{0} / τ_{e f f}$ where $τ_{e f f} = τ_{R} / (1 - w_{R})$ . During the decaying phase of the first stimulus presentation, $\bar{r}$ decreases linearly from r₀ to r₁, and then at the end of the presentation of the first stimulus, $\bar{a} = r_{0} (1 - \exp (- t_{1} / τ_{A})) + (r_{1} - r_{0}) {1 - τ_{A} / t_{1} (1 - \exp (- t_{1} / τ_{A}))} \equiv a_{1}$ .

Now based on the second assumption during the rising phase of the second stimulus presentation, the input becomes $I_{0} - a_{1} k$ and the expression for the second peak becomes $(I_{0} - a_{1} k) \frac{t_{0}}{τ_{R} / (1 - w_{R})} + r_{1}$ . Then the condition that the second peak is lower than the first peak gives $(I_{0} - a_{1} k) \frac{t_{0}}{τ_{R} / (1 - w_{R})} + r_{1} < r_{0}$ . Replacing I₀ using $r_{0} = I_{0} t_{0} / τ_{e f f}$ leads to the condition $\frac{r_{1} / r_{0} \cdot τ_{R} / t_{0}}{1 - \exp (- t_{1} / τ_{A}) - (1 - r_{1} / r_{0}) (τ_{A} / t_{0} (\exp (- t_{1} / τ_{A}) - 1) + 1)} < (1 - w_{R}) k$ (dotted curve in Figure 5—figure supplement 1).

Network simulation in Figure 4

Request a detailed protocol

In Figure 4, we illustrated the dynamics of an example network with synaptic plasticity in feedforward and recurrent connections, and spike adaptation mechanisms. The network dynamics follows Equation (3) and as in the mean-field dynamics, we assumed linear dynamics with Φ(x) = x and uniform recurrent connectivity before learning $W_{i j}^{R} = w_{R} / N$ . The input was modeled as a sum of a constant input $I_{c o n s t}$ and time-varying one which is the sum of two exponential functions $I_{d y n} = \exp (- t / t_{1}) - \exp (- t / t_{2})$ with its strength $ξ_{i}$ varying across neurons as $I_{i}^{X} = I_{c o n s t} + ξ_{i} I_{d y n}$ . For recurrent synaptic plasticity, Hebbian learning rule such as $Δ W_{i j}^{R} = \frac{α}{N var (ξ)} ξ_{i} (ξ_{j} - \bar{ξ})$ was considered where α is the strength of the plasticity. For feedforward synaptic plasticity, uniform scaling down of the time-varying input was considered such that $I_{i}^{X}$ changes to $I_{i}^{X} = I_{c o n s t} + γ ξ_{i} I_{d y n}$ after learning.

For the successive presentation of two stimuli, the changes in the recurrent connection become $W_{i j}^{R} \to W_{i j}^{R} + Δ W_{i j}^{R, 1} + Δ W_{i j}^{R, 2}$ with uncorrelated patterns $ξ_{i}^{1}$ and $ξ_{i}^{2}$ . The duration of each stimulus presentation is denoted as P₁ and the external input correlated with one stimulus decays linearly during P₂ when another stimulus is on. The parameters used in Figure 4 are N = 2000, w_R = 0, k = 1.8, τ_R = 5 ms, τ_A = 200 ms, t₁ = 150 ms, t₂ = 50 ms, P₁ = 150 ms and P₂ = 100 ms. ξ_i is assumed to follow a gamma distribution with shape parameter three and α = 0.9. I_const is adjusted so that the baseline firing rate is 5 Hz, and γ = 0.4.

Fitting experimental data in Figures 5,6

Request a detailed protocol

In Figure 5, activities in ITC neurons for the dimming detection task were fitted using the mean field dynamics given in Equation (4). Under the assumption of a homogeneous network, activities to different stimuli can serve as a surrogate for activities of different neurons to one stimulus. Thus, we took an average of firing rates over stimuli (eight novel stimuli and 10 familiar stimuli for each neuron) and over 41 neurons classified as putative excitatory neurons (see more details in Lim et al., 2015). Note that as the time-course data without taking an average over neurons is noisy and the number of stimuli is small, only the parameters for the mean-field dynamics could be inferred from the data from the dimming-detection task.

Before learning, the response dynamics is only determined by average variables $\bar{r}$ and $\bar{a}$ , and by the parameters w_R, k, τ_R, and τ_A, which need to reproduce the data showing no damped oscillations before learning and suppressed response to the presentation of the second novel stimuli (Figure 5—figure supplement 1). Given w_R, k, τ_R, and τ_A, the external input was modeled as the sum of two exponential functions $a \exp (- t / t_{1}) - b \exp (- t / t_{2}) + b - a$ and their parameters are chosen such that the simulation fits the activities before learning (Figure 5A). Note that since we assume that the inhibitory activities follow the excitatory activities instantaneously, w_R represents $W^{E E} - W^{E I} W^{I E}$ , and can be negative. In the dynamics of m and n after learning, the strength of positive feedback is ${\bar{f g}}_{R}$ in Equation (4), analogous to potentiation in high firing rate neurons. Together with parameters for slow adaptation currents, ${\bar{f g}}_{R}$ should be chosen to generate the oscillation with the period around 150 ms (Figure 5—figure supplement 2A,B). The external input for m is also modeled as the sum of two exponential functions, and given m and n dynamics and the external input from the novel response, ${\bar{f}}_{R, F}$ were chosen to fit the magnitude of oscillation and reduction in firing rates in the mean response for familiar stimuli given the dynamics of m (Figure 5B; Figure 5—figure supplement 2C).

In the simulation of the successive stimulus presentation in Figure 5C D, all the parameters are the same as in Figure 5A B and the external inputs for the first and second stimuli have the same temporal profile except for different onsets. During the presentation of the second stimuli, the external input for the first stimulus decays exponentially with a time constant of 50 ms. The parameters used in Figure 5 are w_R = 0, k = 1.8, τ_R = 5 ms, τ_A= 200 ms, ${\bar{f g}}_{R}$ = 0.9, ${\bar{f}}_{R}$ = 0.3, ${\bar{f}}_{F}$ = −0.7, a = 6, b = 5, t₀ = 700 ms, t₁ = 40 ms for the mean external input and a = b = 5, t₀ = 400 ms, t₁ = 20 ms for the external input of the m dynamics. Note that for a wide range of w_R with the same parameters except a, b, t₀, and t₁ adjusted to reproduce response to novel stimuli, the simulation fit the data well (Figure 5—figure supplement 3).

In the passive viewing task in Figure 6, responses to 125 novel and 125 familiar stimuli were measured, and 14 putative excitatory neurons were classified to show both potentiation and depression when the distributions of time-averaged activities before and after learning were compared (see more details in Lim et al., 2015). Time-course data at each rank of the stimuli in each neuron was noisy, and averaging over neurons was required to reduce noise. For this, we normalized activities in each neuron and took the average of these normalized activities over neurons at each rank (Figure 1).

To infer post-synaptic dependence of synaptic plasticity rules on normalized activities, we considered a network consisting of 125 neurons whose dynamics are described by Equation (3) and fit time-course data before and after learning. We set the parameters to be the same as in Figure 5, and fitted external inputs $I_{}^{X} (t)$ and post-synaptic dependence of the feedforward and recurrent connections, $f_{R, F}$ . The external input to each neuron was obtained to reproduce the response for novel stimuli at each rank as follows - Discretization of the dynamic equations in Equation (3) yields $\frac{τ_{r}}{d t} (r_{i}^{n o v} (t + d t) - r_{i}^{n o v} (t)) = - r_{i}^{n o v} (t) + Φ (w_{r} {\bar{r}}_{i}^{n o v} (t) - k a_{i}^{n o v} (t) + I_{i}^{X} (t))$ where $r_{i}^{n o v} (t)$ is the firing rate for the novel stimulus at rank i, and $a_{i}^{n o v} (t)$ is a low-pass filtered $r_{i}^{n o v} (t)$ . Given w_R = 0, τ_R = 5 ms with the time step 5 ms to be the same as that in the data, the external input can be expressed as $I_{i}^{X} (t) = Φ^{- 1} (r_{i}^{n o v} (t + d t)) + k a_{i}^{n o v} (t)$ , and thus, it is determined by activities for novel stimuli.

The post-synaptic dependence of the synaptic plasticity was obtained to fit the activities for familiar stimuli. As the single cell recordings do not allow inference on the pre-synaptic dependence, we assumed its form which is $g_{R, F}$ = 1 for the highest rank and 0 otherwise such that m in Equation (4) is the response to the familiar stimulus at the highest rank. In this case, discretization of the dynamic equation for familiar stimuli becomes $\frac{τ_{r}}{d t} (r_{i}^{f a m} (t + d t) - r_{i}^{f a m} (t)) = - r_{i}^{f a m} (t) + Φ (w_{r} {\bar{r}}_{i}^{f a m} (t) + f_{R, i} r_{\max}^{f a m} (t) - k a_{i}^{f a m} (t) + I_{i}^{X} (t) + f_{F, i} I_{\max}^{X} (t))$ . $f_{R, F}$ were fitted to mimic the response to familiar stimuli at each rank - the number of unknowns is 125 times 2 (125 $f_{R}$ and 125 $f_{F}$ ) and the number of data points to fit is 125 times 44 where 44 is the number of time steps so it is analogous to underdetermined system. We used the least square method with larger weights in the late phase to capture the rebound better (weight 5 from 230 ms after the stimulus onset, and otherwise 1; different weights do not affect the performance qualitatively, not shown here). Note that in fitting and simulating the response to familiar stimuli, we used $r_{\max}^{f a m} (t)$ from the data to prevent the fitting error in $r_{\max}^{f a m} (t)$ from spreading over the network.

For nonlinear dynamics in Figure 6—figure supplement 1, the transfer function $Φ (x)$ was obtained from the time-averaged response for novel stimuli – for each rank of novel stimuli, we took the time-averaged response in the time window between 75 ms and 200 ms after stimulus onset. Under the assumption that the transfer function $Φ (x)$ is monotonically increasing and the distribution of synaptic inputs to novel stimuli follow Gaussian statistics, the transfer function is obtained by matching the input current and time-averaged response at the same rank (Lim et al., 2015).

Models for alternative negative feedback mechanisms

Request a detailed protocol

Replacing adaptation a_i in Equation (3) as a^I which is an exponential filtered $\bar{r}$ with strength k^I and time constant τ_A, we can derive the mean-field dynamics of the model for the global inhibition as

\begin{matrix} τ_{R} \frac{d \bar{r}}{d t} = - \bar{r} + w_{R} \bar{r} + {\bar{f}}_{R} m - k^{I} {\bar{a}}^{I} + {\bar{I}}_{X} + {\bar{f}}_{F} I_{F X} \\ τ_{A} \frac{d {\bar{a}}^{I}}{d t} = - {\bar{a}}^{I} + \bar{r} \\ τ_{R} \frac{d m}{d t} = - m + {\bar{f g}}_{R} m + I_{M X} + {\bar{f g}}_{F} I_{F X} \end{matrix}

which is similar to Equation (4), but without n dynamics.

The short-term depression is modeled by a variable x which represents the fraction of resources available after the depletion of neurotransmitters and therefore adjusts the strength of the synaptic connections (Tsodyks and Markram, 1997). The network activity is thus described by the following equations

\begin{matrix} τ_{r} \frac{d r_{i}}{d t} = - r_{i} + \sum W_{i j}^{R} x_{j} r_{j} + I_{j}^{X} \\ \frac{d x_{j}}{d t} = \frac{1 - x_{j}}{τ_{x}} - γ x_{j} r_{j} \end{matrix} .

where τ_X and γ represent the time constant and strength of short-term depression. Before the stimulus presentation, x is initialized to its steady states given the parameters and baseline activity, and W^R before and after learning is the same as in Equation (3). To see whether short-term depression can reproduce the oscillatory response after learning, we considered the case that the recurrent connection is weak before learning, and the oscillation in the network is led by that in the high rate neurons. With larger pre-synaptic dependence g_R for the high rate neurons, their dynamics can be approximated as

\begin{matrix} τ_{r} \frac{d r_{m}}{d t} = - r_{m} + f_{m}^{R} g_{m}^{R} x_{m} r_{m} + I_{m}^{X} \\ \frac{d x_{m}}{d t} = \frac{1 - x_{m}}{τ_{x}} - γ x_{m} r_{m} \end{matrix} .

We fitted the parameters $f_{m}^{R} g_{m}^{R}$ and γ analogous to the strengths of long-term synaptic plasticity and short-term plasticity, respectively (Figure 6—figure supplement 2). When we set $τ_{R}$ = 5 ms, $τ_{x}$ = 200 ms, $I_{m}^{X}$ was obtained from the maximal response to the novel stimuli. The best fitting parameters to the maximal response to the familiar stimuli are $f_{m}^{R} g_{m}^{R}$ = 2.56 and γ = 0.125, and the time course with the best-fitted parameters cannot generate oscillation (Figure 6—figure supplement 2).

Models for competitive interactions between two stimuli

Request a detailed protocol

Experimentally, stronger oscillation at around 5 Hz was observed in the presence of another stimulus in the visual field, which was accounted for by competitive interactions between the populations selective to each stimulus (Moldakarimov et al., 2005; Rollenhagen and Olson, 2005). Following these previous works, we considered two mutually inhibitory populations where each population is selective to one of two stimuli and its dynamics follow the dynamics of m in the mean-field description under the presence of a single stimulus. Then the dynamics of two populations are given as follows:

\begin{matrix} τ_{R} \frac{d m_{i}}{d t} = - m_{i} + Φ ({\bar{f g}}_{R} m_{i} - k n_{i} - w_{c} m_{j} + I_{m, i}) \\ τ_{A} \frac{d n_{i}}{d t} = - n_{i} + m_{i} \end{matrix}

where population indices i,j = 1 or two where i ≠ j, and w_c denotes the strength of the mutual inhibition, set to be 0.1. Φ is the input current-output rate transfer function which was assumed to be piece-wise linear as Φ(x) = x for $x \geq - 3$ and 0 otherwise. The remaining parameters and variables are the same as in Figure 5 as ${\bar{f g}}_{R}$ = 0.9, k = 1.8, τ_R= 5 ms, τ_A= 200 ms, $I_{m, i} = \exp (- t / t_{1}) - \exp (- t / t_{2})$ where t₁ = 400 ms and t₂ = 20 ms.

Data availability

All data and codes used in the manuscript have been provided as source code files. Please note that the original data were generated in Sheinberg's and Freedman's labs, and the uploaded data are processed data used for network simulations and fitting.

References

1. Amit DJ
2. Brunel N
(1997) Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex
Cerebral Cortex 7:237–252.
https://doi.org/10.1093/cercor/7.3.237
- PubMed
- Google Scholar
1. Bargmann CI
2. Marder E
(2013) From the connectome to brain function
Nature Methods 10:483–490.
https://doi.org/10.1038/nmeth.2451
- PubMed
- Google Scholar
1. Benda J
2. Herz AV
(2003) A universal model for spike-frequency adaptation
Neural Computation 15:2523–2564.
https://doi.org/10.1162/089976603322385063
- PubMed
- Google Scholar
1. Bogacz R
2. Brown MW
(2003) Comparison of computational models of familiarity discrimination in the perirhinal cortex
Hippocampus 13:494–524.
https://doi.org/10.1002/hipo.10093
- PubMed
- Google Scholar
Book
1. Buzsaki G
(2011) Rhythms of the Brain
Oxford University Press.
https://doi.org/10.1093/acprof:oso/9780195301069.001.0001
- Google Scholar
Book
1. Dayan P
2. Abbott LF
(2005)
Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems

The MIT Press.
- Google Scholar
(2015) Theta oscillations modulate attentional search performance periodically
Journal of Cognitive Neuroscience 27:945–958.
https://doi.org/10.1162/jocn_a_00755
- PubMed
- Google Scholar
(2001) The effects of spike frequency adaptation and negative feedback on the synchronization of neural oscillators
Neural Computation 13:1285–1310.
https://doi.org/10.1162/08997660152002861
- PubMed
- Google Scholar
(2013) Rhythmic sampling within and between objects despite sustained attention at a cued location
Current Biology 23:2553–2558.
https://doi.org/10.1016/j.cub.2013.10.063
- PubMed
- Google Scholar
(2006) Experience-dependent sharpening of visual shape selectivity in inferior temporal cortex
Cerebral Cortex 16:1631–1644.
https://doi.org/10.1093/cercor/bhj100
- PubMed
- Google Scholar
(2002) Spike frequency adaptation and neocortical rhythms
Journal of Neurophysiology 88:761–770.
https://doi.org/10.1152/jn.2002.88.2.761
- PubMed
- Google Scholar
Book
1. Gerstner W
2. Kistler WM
(2002) Spiking Neuron Models: Single Neurons, Populations, Plasticity
Cambridge University Press.
https://doi.org/10.1017/CBO9780511815706
- Google Scholar
(2010) STDP in recurrent neuronal networks
Frontiers in Computational Neuroscience 4:23.
https://doi.org/10.3389/fncom.2010.00023
- PubMed
- Google Scholar
1. Greene HH
2. Rayner K
(2001) Eye movements and familiarity effects in visual search
Vision Research 41:3763–3773.
https://doi.org/10.1016/S0042-6989(01)00154-7
- PubMed
- Google Scholar
(2010) STDP in adaptive neurons gives Close-To-Optimal information transmission
Frontiers in Computational Neuroscience 4:143.
https://doi.org/10.3389/fncom.2010.00143
- PubMed
- Google Scholar
1. Karbowski J
2. Ermentrout GB
(2002) Synchrony arising from a balanced synaptic plasticity in a network of heterogeneous neural oscillators
Physical Review E 65:031902.
https://doi.org/10.1103/PhysRevE.65.031902
- Google Scholar
(1998) Effects of shape-discrimination training on the selectivity of inferotemporal cells in adult monkeys
Journal of Neurophysiology 80:324–330.
https://doi.org/10.1152/jn.1998.80.1.324
- PubMed
- Google Scholar
(2014) Beyond the connectome: the dynome
Neuron 83:1319–1328.
https://doi.org/10.1016/j.neuron.2014.08.016
- PubMed
- Google Scholar
1. La Camera G
2. Rauch A
3. Lüscher HR
4. Senn W
5. Fusi S
(2004) Minimal models of adapted neuronal response to in vivo-like input currents
Neural Computation 16:2101–2124.
https://doi.org/10.1162/0899766041732468
- PubMed
- Google Scholar
1. La Camera G
2. Rauch A
3. Thurbon D
4. Lüscher HR
5. Senn W
6. Fusi S
(2006) Multiple time scales of temporal response in pyramidal and fast spiking cortical neurons
Journal of Neurophysiology 96:3448–3464.
https://doi.org/10.1152/jn.00453.2006
- PubMed
- Google Scholar
1. Laing CR
2. Chow CC
(2002)
A spiking neuron model for binocular rivalry

Journal of Computational Neuroscience 12:39–53.
- PubMed
- Google Scholar
1. Landau AN
2. Fries P
(2012) Attention samples stimuli rhythmically
Current Biology 22:1000–1004.
https://doi.org/10.1016/j.cub.2012.03.054
- PubMed
- Google Scholar
(1993) The representation of stimulus familiarity in anterior inferior temporal cortex
Journal of Neurophysiology 69:1918–1929.
https://doi.org/10.1152/jn.1993.69.6.1918
- PubMed
- Google Scholar
1. Lim S
2. McKee JL
3. Woloszyn L
4. Amit Y
5. Freedman DJ
6. Sheinberg DL
7. Brunel N
(2015) Inferring learning rules from distributions of firing rates in cortical neurons
Nature Neuroscience 18:1804–1810.
https://doi.org/10.1038/nn.4158
- PubMed
- Google Scholar
1. Loebel A
2. Tsodyks M
(2002)
Computation by ensemble synchronization in recurrent networks with synaptic depression

Journal of Computational Neuroscience 13:111–124.
- PubMed
- Google Scholar
(1995) Shape representation in the inferior temporal cortex of monkeys
Current Biology 5:552–563.
https://doi.org/10.1016/S0960-9822(95)00108-4
- PubMed
- Google Scholar
Conference
(2013)
Neuronal representations of novel and familiar visual stimuli in macaque inferior temporal, perirhinal and prefrontal cortices

Neuroscience.
- Google Scholar
1. Meyer T
2. Walker C
3. Cho RY
4. Olson CR
(2014) Image familiarization sharpens response dynamics of neurons in inferotemporal cortex
Nature Neuroscience 17:1388–1394.
https://doi.org/10.1038/nn.3794
- PubMed
- Google Scholar
1. Meyer T
2. Rust NC
(2018) Single-exposure visual memory judgments are reflected in inferotemporal cortex
eLife 7:e32259.
https://doi.org/10.7554/eLife.32259
- PubMed
- Google Scholar
(1991) A neural mechanism for working and recognition memory in inferior temporal cortex
Science 254:1377–1379.
https://doi.org/10.1126/science.1962197
- PubMed
- Google Scholar
1. Miyashita Y
(1993) Inferior temporal cortex: where visual perception meets memory
Annual Review of Neuroscience 16:245–263.
https://doi.org/10.1146/annurev.ne.16.030193.001333
- PubMed
- Google Scholar
(2005) Competitive dynamics in cortical responses to visual stimuli
Journal of Neurophysiology 94:3388–3396.
https://doi.org/10.1152/jn.00159.2005
- PubMed
- Google Scholar
(2006) A homeostatic rule for inhibitory synapses promotes temporal sharpening and cortical reorganization
PNAS 103:16526–16531.
https://doi.org/10.1073/pnas.0607589103
- PubMed
- Google Scholar
(2007) Spike-timing-dependent plasticity in balanced random networks
Neural Computation 19:1437–1467.
https://doi.org/10.1162/neco.2007.19.6.1437
- PubMed
- Google Scholar
1. Mruczek RE
2. Sheinberg DL
(2007) Context familiarity enhances target processing by inferior temporal cortex neurons
Journal of Neuroscience 27:8533–8545.
https://doi.org/10.1523/JNEUROSCI.2106-07.2007
- PubMed
- Google Scholar
1. Norman KA
2. O'Reilly RC
(2003) Modeling hippocampal and neocortical contributions to recognition memory: a complementary-learning-systems approach
Psychological Review 110:611–646.
https://doi.org/10.1037/0033-295X.110.4.611
- PubMed
- Google Scholar
(2008) Saccades and microsaccades during visual fixation, exploration, and search: foundations for a common saccadic generator
Journal of Vision 8:21.
https://doi.org/10.1167/8.14.21
- PubMed
- Google Scholar
1. Pereira U
2. Brunel N
(2018) Attractor dynamics in networks with learning rules inferred from in Vivo Data
Neuron 99:227–238.
https://doi.org/10.1016/j.neuron.2018.05.038
- PubMed
- Google Scholar
1. Pozzorini C
2. Naud R
3. Mensi S
4. Gerstner W
(2013) Temporal whitening by power-law adaptation in neocortical neurons
Nature Neuroscience 16:942–948.
https://doi.org/10.1038/nn.3431
- PubMed
- Google Scholar
1. Rainer G
2. Miller EK
(2000) Effects of visual experience on the representation of objects in the prefrontal cortex
Neuron 27:179–189.
https://doi.org/10.1016/S0896-6273(00)00019-2
- PubMed
- Google Scholar
(1992) Progressive improvement in discriminative abilities in adult owl monkeys performing a tactile frequency discrimination task
Journal of Neurophysiology 67:1015–1030.
https://doi.org/10.1152/jn.1992.67.5.1015
- PubMed
- Google Scholar
1. Rollenhagen JE
2. Olson CR
(2005) Low-frequency oscillations arising from competitive interactions between visual stimuli in macaque inferotemporal cortex
Journal of Neurophysiology 94:3368–3387.
https://doi.org/10.1152/jn.00158.2005
- PubMed
- Google Scholar
(2000) Membrane mechanisms underlying contrast adaptation in cat area 17 in vivo
The Journal of Neuroscience 20:4267–4285.
https://doi.org/10.1523/JNEUROSCI.20-11-04267.2000
- PubMed
- Google Scholar
1. Sohal VS
2. Hasselmo ME
(2000) A model for experience-dependent changes in the responses of inferotemporal neurons
Network: Computation in Neural Systems 11:169–190.
https://doi.org/10.1088/0954-898X_11_3_301
- PubMed
- Google Scholar
(2006) Differential control of active and silent phases in relaxation models of neuronal rhythms
Journal of Computational Neuroscience 21:307–328.
https://doi.org/10.1007/s10827-006-8862-7
- PubMed
- Google Scholar
1. Tanaka K
(1996) Inferotemporal cortex and object vision
Annual Review of Neuroscience 19:109–139.
https://doi.org/10.1146/annurev.ne.19.030196.000545
- PubMed
- Google Scholar
1. Treves A
(1993) Mean-field analysis of neuronal spike dynamics
Network: Computation in Neural Systems 4:259–284.
https://doi.org/10.1088/0954-898X_4_3_002
- Google Scholar
1. Tsodyks MV
2. Feigel'man MV
(1988) The enhanced storage capacity in neural networks with low activity level
Europhysics Letters 6:101–105.
https://doi.org/10.1209/0295-5075/6/2/002
- Google Scholar
1. Tsodyks MV
2. Markram H
(1997) The neural code between neocortical pyramidal neurons depends on neurotransmitter release probability
PNAS 94:719–723.
https://doi.org/10.1073/pnas.94.2.719
- PubMed
- Google Scholar
1. van Vreeswijk C
2. Hansel D
(2001) Patterns of synchrony in neural networks with spike adaptation
Neural Computation 13:959–992.
https://doi.org/10.1162/08997660151134280
- PubMed
- Google Scholar
1. Vogels R
(2016) Sources of adaptation of inferior temporal cortical responses
Cortex 80:185–195.
https://doi.org/10.1016/j.cortex.2015.08.024
- PubMed
- Google Scholar
1. Wang XJ
(2010) Neurophysiological and computational principles of cortical rhythms in cognition
Physiological Reviews 90:1195–1268.
https://doi.org/10.1152/physrev.00035.2008
- PubMed
- Google Scholar
(2000) Activity coregulates quantal AMPA and NMDA currents at neocortical synapses
Neuron 26:659–670.
https://doi.org/10.1016/S0896-6273(00)81202-7
- PubMed
- Google Scholar
(2004) A proportional but slower NMDA potentiation follows AMPA potentiation in LTP
Nature Neuroscience 7:518–524.
https://doi.org/10.1038/nn1220
- PubMed
- Google Scholar
1. Woloszyn L
2. Sheinberg DL
(2012) Effects of long-term visual experience on responses of distinct classes of single units in inferior temporal cortex
Neuron 74:193–205.
https://doi.org/10.1016/j.neuron.2012.01.032
- PubMed
- Google Scholar
1. Xiang JZ
2. Brown MW
(1998) Differential neuronal encoding of novelty, familiarity and recency in regions of the anterior temporal lobe
Neuropharmacology 37:657–676.
https://doi.org/10.1016/S0028-3908(98)00030-6
- PubMed
- Google Scholar
1. Xiang JZ
2. Brown MW
(2004) Neuronal responses related to long-term recognition memory processes in prefrontal cortex
Neuron 42:817–829.
https://doi.org/10.1016/j.neuron.2004.05.013
- PubMed
- Google Scholar

Decision letter

Nicole Rust

Reviewing Editor; University of Pennsylvania, United States
Michael J Frank

Senior Editor; Brown University, United States

In the interests of transparency, eLife includes the editorial decision letter and accompanying author responses. A lightly edited version of the letter sent to the authors after peer review is shown, indicating the most substantive concerns; minor comments are not usually included.

Thank you for submitting your article "Mechanisms underlying sharpening of visual response dynamics with familiarity" for consideration by eLife. Your article has been reviewed by two peer reviewers, one of whom is a member of our Board of Reviewing Editors, and the evaluation has been overseen by Michael Frank as the Senior Editor. The reviewers have opted to remain anonymous.

The reviewers have discussed the reviews with one another and the Reviewing Editor has drafted this decision to help you prepare a revised submission.

Summary:

In this paper, Lim addresses questions related to the cortical mechanisms that support learning through an innovative modeling-based approach. The specific focus of this paper is a model of how the stimulus-evoked response dynamics of IT neurons along timescales of a few hundred ms differ for novel as compared to highly familiar images. Previous experimental work found that familiarity leads to a sharp reduction in firing rate following the initial peak (phasic) response, then a rebound of firing that when taken together resemble a damped oscillation. Modeling this response could provide important insights into learning mechanisms of the brain.

The author builds on her earlier model of IT familiarity acquisition, which uses changes in tuning functions to argue that familiarity plasticity resides in synaptic plasticity of recurrent connections within IT. Here she proposes 1) synaptic plasticity in the recurrent connections, 2) rate adaptation and 3) plasticity in the feedforward inputs, are sufficient to account for experimentally observed changes in visual response between novel and familiar images. In particular, this work extends the work Lim et al., 2015. It focuses on reproducing a damped oscillatory component of the visual response after learning, which was not present before learning in experimental data.

The reviewers find the work interesting and exciting, but have also identified a number of issues that must be addressed for the manuscript to be suitable for publication. They also have provided a number of suggestions for improvement.

Essential revisions:

1) The BCM type rule was derived assuming there is only plasticity in the recurrent network (Lim et al., 2015). Then it is used here with plasticity in the feedforward network. That seems inconsistent. If I understand correctly, the rule should be re-inferred with plasticity both in feedforward and recurrent connections in the first place.

2) Describing this rebound/oscillatory component mechanistically is interesting, in terms of fitting the data. However, the functional implications are less clear. The work could be extended to show the functional implications of a network with the 3 ingredients: plasticity in the feedforward, in the recurrent and the rate adaptation, leading to this transition between overshoot and damped oscillations.

3) Is this model fully consistent with the experimental results that motivate it? Specifically, wouldn't turning off the image still induce an oscillatory response due to the positive/negative recurrent feedback? This seems counter to work the author cites (Meyer et al., 2014 Figure 5C, D – notice how when a familiar image is presented then left with a blank screen 'F-' there is no oscillation).

4) The paper focuses exclusively on excitatory neurons – is there a good reason for this? Can the model account for both excitatory and inhibitory response dynamics?

5) The author needs to include all the information to reproduce the paper.

6) The writing should be improved for both technical expects as well as a general audience, particularly in the subsection “Interactions between synaptic plasticity and slow negative feedback”.

7) The author must provide code for the reviewers (both for the network with fitted parameters and the code for the fitting procedure) and post the code publicly after publication.

[Editors' note: further revisions were requested prior to acceptance, as described below.]

The reviewers have discussed the reviews with one another and the Reviewing Editor has drafted this decision to help you prepare a revised submission.

Summary:

The reviewers would like to thank the authors for all the work they did. The paper has improved as a result of these clarifications. A few remaining items should be addressed before the manuscript is accepted for publication.

Essential revisions:

1) In the first round of reviews, the reviewers pointed out that the BCM type rule was derived in 2015 assuming that plasticity was only in the recurrent network but in the current manuscript it was applied to a network with feedforward plasticity; the reviewers asked whether the rule should be re-derived. The author reply focused on a normalization procedure applied to the neural data. It is not clear to the reviewers how this normalization procedure relates to the issues raised about recurrent versus feedforward processing. Please justify the use of the BCM type rule in the model with multiple types of plasticity.

2) In the first round of reviews, the reviewers requested that the work be extended to show the functional implications of the proposed network. The authors responded by incorporating a paragraph into the Discussion highlighting the bridge between two classes of models, and these are nice points to make. However, the reviewers would like to clarify their request to complement the current presentation, which focuses on the network architectures required to recapitulate an experimentally-observed phenomenology, with more insight into the functional implications of this work. For example, beyond constraining mechanistic models, why do we care about the damped oscillatory response?

What are its functional implications for representation in IT and/or behavior? What types of functions is a network with the 3 proposed ingredients capable of?

https://doi.org/10.7554/eLife.44098.026

Author response

Essential revisions:

1) The BCM type rule was derived assuming there is only plasticity in the recurrent network (Lim et al., 2015). Then it is used here with plasticity in the feedforward network. That seems inconsistent. If I understand correctly, the rule should be re-inferred with plasticity both in feedforward and recurrent connections in the first place.

Thank you for pointing out the lack of clarity concerning connection to the previous work (Lim et al., 2015). As noted by the reviewers, one of the main findings in my previous work (Lim et al., 2015) was that when the synaptic plasticity was inferred from changes of time averaged response with learning, the post-synaptic firing rate separating depression and potentiation, denoted as a threshold θ, was strongly correlated with mean and standard deviation of post-synaptic firing rates. This is reminiscent of the BCM rule claiming the dynamic evolution of θ depending on the post-synaptic activities, although our work compared snapshots of statistics before and after learning, and examined θ across different neurons, that is, the spatial version of the BCM rule. Such a correlation between θ and post-synaptic activities may arise from similar synaptic plasticity rule across different neurons when input currents and firing rates are normalized. Author response image 1, adapted from the previous paper (Figure 4 in Lim et al., 2015) shows that when firing rates and inputs were normalized by the mean and standard deviation of them before learning, such a correlation disappeared (g and h compared to e and f). This may suggest the same synaptic plasticity rule across different neurons when post-synaptic rates were normalized (c), and as overall firing rates changes across different neurons, the threshold changes proportionally as θ = σθ’+μ where θ’ is the threshold for normalized firing rate, and μ and σ are the mean and standard deviation of activities.

Author response image 1

Download asset Open asset

Inspired by this previous observation, we inferred synaptic plasticity from normalized activities when it was allowed – in the passive viewing task in Figures 1 and 6, we normalized activities in each neuron using the mean and standard deviation of activities before learning, and averaged such normalized activities over different neurons. Note that averaging over neurons was required to reduce noise in the time-course data, in contrast to the previous work comparing the time-averaged responses and deriving recurrent synaptic plasticity rule in individual neurons. Under the assumption that synaptic plasticity rule is the same across different neurons when inputs and rates are normalized, the correlation between the threshold and post-synaptic activities naturally arises even if depression occurs mainly in the feedforward connections and potentiation occurs in the recurrent connections.

We now add a sentence in Results and the paragraph in Discussion to clarify this as follows:

Results: “… Note that the synaptic plasticity was inferred from normalized firing rates averaged over neurons under the assumption that the dependence of synaptic plasticity rules on normalized firing rates is the same across different neurons (See Discussion for justification).”

Discussion: “Here, we extended our previous work inferring recurrent synaptic plasticity rules from time-averaged data in a static model of a cortical network to time-course data and a dynamic model with additional spike adaptation mechanisms and feedforward synaptic plasticity (Lim et al., 2015). […] In this case, the dependence of synaptic plasticity rules on post-synaptic rates scales proportionally to changes of a range of firing rates, resulting in a correlation between the threshold and neural activity even with synaptic plasticity in different connections, consistent with the previous observation from time-averaged responses (Lim et al., 2015).”

2) Describing this rebound/oscillatory component mechanistically is interesting, in terms of fitting the data. However, the functional implications are less clear. The work could be extended to show the functional implications of a network with the 3 ingredients: plasticity in the feedforward, in the recurrent and the rate adaptation, leading to this transition between overshoot and damped oscillations.

We thank the reviewers for pointing out the lack of clarity. The current work proposed the conditions on synaptic plasticity in recurrent and feedforward connections, and spike-adaptation mechanisms for reproducing the time course activities. Recurrent synaptic plasticity broadens the distribution of activities as typical Hebbian synaptic plasticity, while depression in feedforward inputs decreases average firing activities. Thus, synaptic plasticity enables the sparse and efficient representation of the learned stimuli. On the other hand, adaptation-like mechanisms are critical for shaping the dynamics as the network cannot generate oscillatory response without slow negative feedback (Figure 2). It has been suggested that stronger oscillatory response after learning might be important for putting neurons to be ready for the following stimuli as suppressing activity strongly in particular in the late phase of the stimulus presentation. Thus, the slow adaptation mechanisms together with synaptic plasticity may play an important role in the rapid processing of the learned stimuli.

The functional role of these three main ingredients have been investigated previously in relation to different types of recognition memory. For familiarity detection, different forms of feedforward synaptic plasticity have been explored to reproduce a lower response for familiar stimuli, but without considering response dynamics (Bogacz and Brown, 2003; Norman and O'Reilly, 2003; Sohal and Hasselmo, 2000). On the other hand, most theoretical works implementing synaptic plasticity in recurrent connections have focused on associative memory and the emergence of attractors with learning (Amit and Brunel, 1997; Pereira and Brunel, 2018; Sohal and Hasselmo, 2000). Finally, the adaptation mechanisms in the temporal cortex have been suggested to encode the recency of stimuli, which is typically measured by suppression of the response to the repetition of a stimulus (Meyer and Rust, 2018; Miller, Li and Desimone, 1991; Vogels, 2016; Xiang and Brown, 1998). As the time scale of repetition suppression lasts up to seconds, the spike adaptation mechanism considered in the current study may only encode the recency signal on a shorter time scale.

Most of these works focused on one of the three ingredients, except Sohal and Hasselmo, 2000, whose model contained feedforward and recurrent synaptic plasticity as well as spike adaptation mechanisms on a longer time scale. Still, as other works, Sohal and Hasselmo proposed each ingredient for a different type of memory, and did not investigate their interactions. On the other hand, we focused on familiarity detection and investigated how the three ingredients shape response dynamics together. Recently, Pereira and Brunel, 2018, have investigated the capacity of associative memory with recurrent synaptic plasticity whose form was derived from neural activities related to familiarity detection. Similarly, it can be further investigated how the three ingredients derived in the current study contribute to other types of memory like associative memory and recency effect, and how a memory capacity for familiarity detection changes dynamically during the stimulus presentation with the spike adaptation mechanisms. However, this is beyond the scope of the current paper.

The functional implications of each mechanism are summarized in the first paragraph in Discussion and to discuss them related to the previous works, we modified the paragraph in Discussion as follows:

“Our work provides a reconciling perspective between two prominent classes of synaptic plasticity models suggested for familiarity detection and associative memory in ITC. […] Similarly, it can be further investigated how the feedforward and recurrent synaptic plasticity rules derived from the data for familiarity detection contribute to other types of memory, and how a memory capacity changes dynamically during the stimulus presentation with slow spike adaptation mechanisms.”

3) Is this model fully consistent with the experimental results that motivate it? Specifically, wouldn't turning off the image still induce an oscillatory response due to the positive/negative recurrent feedback? This seems counter to work the author cites (Meyer et al., 2014 Figure 5C, D – notice how when a familiar image is presented then left with a blank screen 'F-' there is no oscillation).

To reveal the mechanisms underlying changes in response dynamics with learning, we mainly considered the experimental results obtained from three different laboratories. We note that different experimental settings may lead to quantitatively different results even if the underlying principle is the same.

The data obtained from a passive viewing task with a larger number of stimuli suggests that oscillation is originated from the response dynamics of excitatory neurons to their most preferred stimuli about the top 5% of the stimuli (Figure 1C). As different data sets from the dimming-detection task or with the successive presentation of two stimuli (Meyer et al., 2014) employed the smaller number of stimuli (10 familiar stimuli for each neuron in the dimming detection task, and on average 6.5 times 2 familiar stimuli for Meyer et al., 2014) in comparison to 125 stimuli in the passive viewing task, it requires sampling at least ten times more neurons to see the oscillation. Furthermore, as addressed in the reply to point 4 below, damped oscillation is not prominent in inhibitory neurons. Thus, averaging response dynamics over excitatory neurons and inhibitory neurons can mask oscillation.

The response to a short presentation of familiar stimuli shown as blue curves in Figure 5C, E, and G (adapted from Meyer et al., 2014) is less consistent as panels C and E do not show oscillation while panel G shows oscillation. Such inconsistency may arise from sparse sampling from highly oscillatory excitatory neurons and averaging the response over both excitatory and inhibitory neurons. Similarly, in Figure 5D compared to Meyer et al., 2014, the network with the parameters inferred from one experimental setting might be difficult to reproduce the data from another experiment quantitatively. Instead, we focused on inferring the mechanisms underlying visual learning from the common qualitative features across the different experiments showing stronger oscillation after learning although their magnitude may depend on different sampling of neurons and stimuli.

To clarify this, we added the following sentence in “Effects of visual learning on response dynamics” section in Results:

“… Note that although all three experiments suggest stronger oscillation after learning, its strength may vary depending on a sampling of neurons and stimuli as only excitatory neurons with their most preferred stimuli exhibit strong oscillation after learning (Figure 1D).”

4) The paper focuses exclusively on excitatory neurons – is there a good reason for this? Can the model account for both excitatory and inhibitory response dynamics?

We thank the reviewers for bringing up the lack of clarity in simplification on the inhibitory dynamics in the model and the possible role of inhibitory dynamics and synaptic plasticity in shaping response dynamics. As the reviewers noted, the dynamics of inhibitory neurons follow that of mean excitatory neurons in the model, and the recurrent inputs to excitatory neurons reflect the feedback through inhibitory neurons as the connectivity strength w_R represents W^EE ₋ W^EI W^IE,and can be negative. Such a simplification is permitted under the assumption that inhibitory dynamics do not provide a major contribution to the emergence of oscillation after learning, which can be justified for the following reasons. First, no dependence of input changes on post-synaptic firing rates in inhibitory neurons observed experimentally (Author response image 1D) suggests that changes in inhibitory activities with learning can reflect the reduction of average excitatory activities and thereafter, excitatory inputs to inhibitory neurons without synaptic plasticity in the excitatory (E)-to-inhibitory (I) connections (Lim et al., 2015). On the other hand, anti-Hebbian synaptic plasticity in the I-to-E connections can have similar effects as Hebbian-synaptic plasticity in the E-to-E connections. Alternatively, overall potentiation in the I-to-E connections can provide stronger negative feedback or can replace the role of feedforward synaptic plasticity. However, as the dynamics of inhibitory neurons show strong suppression almost to the baseline in the late phase of the stimulus presentation after learning (150-200 ms after the stimulus onset in Figure 1—figure supplement 1), neither anti Hebbian synaptic plasticity nor potentiation can account for an increase of maximal response of excitatory neurons in the early phase or overall reduction in activities in the late phase (Figure 1). Thus, although inhibitory dynamics or synaptic plasticity can be complementary to the mechanisms addressed in the paper, we think that it cannot be a major factor to lead to oscillation with stronger positive or negative feedback, or reduction in activities with learning.

Another reason why we did not model the inhibitory dynamics explicitly is difficulty in fitting the data quantitatively – in the passive viewing task, as many stimuli were presented with a short inter-stimulus interval (200 ms for the stimulus presentation and 50 ms for the interval between the stimuli). Thus, the baseline activities before the stimulus presentation may reflect the residual activities in response to the previous stimulus. Indeed, inhibitory neurons show a more prominent effect having the baseline around 30 Hz which is too high compared to 10 Hz in Meyer et al. or other experiments. Such distortion in the temporal profiles hinders fitting the time course of inhibitory neurons quantitatively.

In summary, we made a simplification of the dynamics of inhibitory neurons based on the assumption that changes in inhibitory activities with learning can be explained by that of excitatory neurons, and inhibitory dynamics or synaptic plasticity does not provide a major contribution to the emergence of the oscillation. Also, the limitation of the current experimental settings poses difficulty in fitting the inhibitory dynamics quantitatively. To clarify this, we modified the text in Results about modeling excitatory dynamics only, the candidate mechanisms for reduction of average activities with learning and a paragraph in Discussion for the role of inhibitory dynamics or synaptic plasticity as follows:

Results: “In sum, the prominent effects of visual learning on responses of excitatory neurons are i) reduction in average response, ii) increase in maximum response, and iii) stronger oscillations after learning. […] Such a simplification is based on the experimental observation that input changes and the magnitude of rebound activity depend weakly on the postsynaptic firing rates in inhibitory neurons (see Discussion for further justification).”

Results: “Instead, reduction in average response requires changes in external inputs or other recurrent inputs such as suppression in other excitatory inputs or enhanced inhibition. […] This suggests that the effect of potentiated inhibition in the late phase is weaker than in the early phase while reduction of excitatory activities was observed in the late phase (Figure 1A, B).”

Discussion: “In our work, we assumed that inhibition minimally contributes to shaping response dynamics with learning for the following reasons. […] Thus, we assumed that changes in the inhibitory pathway are less likely to induce oscillation or suppression in the excitatory neurons…”

5) The author needs to include all the information to reproduce the paper.

We modified the Materials and methods section significantly and published the codes and data (see the reply to point 7).

6) The writing should be improved for both technical expects as well as a general audience, particularly in the subsection “Interactions between synaptic plasticity and slow negative feedback”.

We highly appreciate the reviewers’ constructive suggestions to improve the clarity in the paper. Following the first three suggestions, we modified the relevant texts in “Interactions between recurrent synaptic plasticity and slow negative feedback” section and created a new section, “Additional synaptic plasticity for a reduction in average response” in Results.

With regard to the last suggestion, we added a new paragraph in Discussion as addressing the relation to the BCM-rule (see the relevant paragraph in point 1).

7) The author must provide code for the reviewers (both for the network with fitted parameters and the code for the fitting procedure) and post the code publicly after publication.

In the original submission, I uploaded the code and data on Github and provided this information in Data availability. However, I did not include this information in the manuscript due to my carelessness, and now I added this information in Materials and methods as follows: “Code availability. The data analysis and network simulations were performed in MATLAB. The data, codes for fitting the data and network simulations are available at https://github.com/slim-compneuro/Dynamics_NovelvsFamiliar.”

[Editors' note: further revisions were requested prior to acceptance, as described below.]

Essential revisions:

1) In the first round of reviews, the reviewers pointed out that the BCM type rule was derived in 2015 assuming that plasticity was only in the recurrent network but in the current manuscript it was applied to a network with feedforward plasticity; the reviewers asked whether the rule should be re-derived. The author reply focused on a normalization procedure applied to the neural data. It is not clear to the reviewers how this normalization procedure relates to the issues raised about recurrent versus feedforward processing. Please justify the use of the BCM type rule in the model with multiple types of plasticity.

Thank you for pointing out the lack of clarity. In the previous response, I addressed that under the assumption of the same learning rule across different neurons for normalized firing rates and input currents, a correlation between activity and the threshold separating the depression and potentiation emerges as observed in the previous work based on time-averaged response. However, the contribution of different synaptic plasticity such as feedforward or recurrent connections cannot be dissected using time-averaged response, and changes in temporal dynamics such as synchronous oscillations emerging after learning were further required.

In the time course data, as the response at each rank of stimuli in individual neuron was noisy, inferring both feedforward and recurrent synaptic plasticity in each neuron was not feasible. Instead, we assumed the BCM-type rules in each synaptic plasticity, that is, the same learning rule across different neurons as a function of the normalized firing rate. To validate this assumption, it may require more trials for the same stimulus or a larger set of stimuli so that averaging over a larger number of trials or stimuli at a similar rank can reduce noise and inference of synaptic plasticity in individual neurons would be allowed. Such a direct re-inference is not feasible in the current data set, given that oscillation is prominent in the top 5% of preferred stimuli, that is, 5-6 stimuli out of 125 stimuli, and averaging over stimuli would diminish the dependence of the learning rule on the post-synaptic activity.

On the other hand, as pointed in Figure 6A and its surrounding text, the rebound strength of damped oscillation for learned stimuli was similar to the post-synaptic dependence of recurrent synaptic plasticity. Although such rebound strengths at each rank of stimuli vary over neurons, its standard error of the mean was relatively small compared to the mean (shaded area compared to the solid line in Figure 1D). This may suggest a similar recurrent synaptic plasticity rule across different neurons as a function of the rank of stimuli, or equivalently normalized firing rates (Figure 6—figure supplement 3). If the learning rule inferred from time-averaged activities is the combination of recurrent and feedforward synaptic plasticity, the same synaptic plasticity of this mixture and recurrent connections across different neurons (Figure 6—figure supplement 3A and B) would lead to the same synaptic plasticity of feedforward connections as well (Figure 6—figure supplement 3C). Thus, a BCM-type of synaptic plasticity rules observed in time-averaged response and relatively small noise in rebound strengths across different neurons might provide indirect support for similar synaptic plasticity over neurons for both feedforward and recurrent synaptic plasticity.

To clarify this point, I modified the text in the Discussion (second paragraph) and added a supplementary figure (Figure 6—figure supplement 3).

2) In the first round of reviews, the reviewers requested that the work be extended to show the functional implications of the proposed network. The authors responded by incorporating a paragraph into the Discussion highlighting the bridge between two classes of models, and these are nice points to make. However, the reviewers would like to clarify their request to complement the current presentation, which focuses on the network architectures required to recapitulate an experimentally-observed phenomenology, with more insight into the functional implications of this work. For example, beyond constraining mechanistic models, why do we care about the damped oscillatory response?

What are its functional implications for representation in IT and/or behavior? What types of functions is a network with the 3 proposed ingredients capable of?

I appreciate the reviewers for raising this issue again – in this revision, I found that I missed literature discussing the prevalence of low-frequency oscillation in the brain and their functional roles (Buzsaki, 2011). The frequency of damped oscillation analyzed in this work is around 5Hz, which is in the range of theta oscillations. Closely related to the visual response in ITC investigated in this work, such a low-frequency oscillation has been discussed in visual search to characterize overt exploration or sampling behaviors such as saccadic or microsaccadic eye movements (Otero-Millan, Troncoso et al., 2008; Buzsaki, 2011). Similarly, it was suggested that covert shift of attention samples different stimuli rhythmically at a similar frequency range (Landau and Fries, 2012; Fiebelkorn, Saalmann et al., 2013; Dugue, Marque et al., 2015).

In line with these studies, a low-frequency oscillation at the theta range has been observed in several electrophysiological studies in ITC while monkeys passively viewed the images or performed attention tasks (Nakamura, Mikami et al., 1991; Nakamura, Mikami et al., 1992; Sheinberg and Logothetis, 1997; Freedman, Riesenhuber et al., 2006; Woloszyn and Sheinberg, 2012). In particular, Rollenhagen and Olson observed that low-frequency oscillation became stronger when an object eliciting an excitatory response was present together with a flanker stimulus that alone elicits little or no activity (Rollenhagen and Olson, 2005). The authors and Moldakarimov et al. in the following theoretical study suggested competitive interactions between populations representing each stimulus can generate such oscillation together with fatigue mechanisms (Moldakarimov, Rollenhagen et al., 2005; Rollenhagen and Olson, 2005). The frequency of enhanced oscillation was around 5 Hz, consistent with other electrophysiology and behavior studies, and thus, the oscillatory response may suggest perceptual alternation between different stimuli and covert shift of attention.

Interestingly, the frequency of damped oscillation in the presentation of a single familiar stimulus is similar to that observed during the visual search. Based on the adaptation mechanisms proposed in the current work which determines the frequency of oscillation, competition between two different familiar stimuli can generate stronger oscillation at a similar frequency. To show this, I utilized the mean-field dynamics considered in Figure 5, which generated damped oscillation in the presentation of a single familiar stimulus. Considering two mutually inhibitory populations each of which mimics the maximum response to a single familiar stimulus (Figure 7A), the experimental observation was reproduced qualitatively – the onset of the second stimulus transiently suppressed the response to the first stimulus and the oscillation during the presentation of both stimuli becomes stronger (Figure 7B). Furthermore, the oscillation frequency for the single stimulus presentation and presentation of two stimuli is similar around 5 Hz. This may indicate that low-frequency damped oscillators for a single familiar stimulus can be a building block for a rhythmic sampling of multiple stimuli and attentional shift through competitive interactions.

To discuss this possible functional role, I added a new paragraph in the Discussion (sixth paragraph), Figure 7, and a section describing the competition model in Materials and methods (subsection “Models for competitive interactions between two stimuli”).

https://doi.org/10.7554/eLife.44098.027

Article and author information

Author details

Sukbin Lim
1. Neural Science, NYU Shanghai, Shanghai, China
2. NYU-ECNU Institute of Brain and Cognitive Science, NYU Shanghai, Shanghai, China
Contribution
Conceptualization, Data curation, Software, Formal analysis, Funding acquisition, Validation, Investigation, Visualization, Methodology, Writing—original draft, Writing—review and editing

For correspondence
sukbin.lim@nyu.edu

Competing interests
No competing interests declared

"This ORCID iD identifies the author of this article:" 0000-0001-9936-5293

Funding

National Natural Science Foundation of China (Fund for International Young Scientists – 31650110468)

Sukbin Lim

The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.

Acknowledgements

The author is grateful to Nicolas Brunel for valuable feedback on the manuscript and discussions with the initial suggestion of the project, David Sheinberg and David Freedman for sharing their data, Loreen Hertäg and Panagiota Theodoni for valuable feedback on the manuscript, John Rinzel for valuable discussion, and anonymous reviewers whose comments helped to improve the manuscript significantly. This research was supported by Research Fund for International Young Scientists at National Natural Science Foundation of China, 31650110468, and the author acknowledges the support of the NYU-ECNU Institute of Brain and Cognitive Science at NYU Shanghai.

Senior Editor

Michael J Frank, Brown University, United States

Reviewing Editor

Nicole Rust, University of Pennsylvania, United States

Publication history

Received: December 3, 2018
Accepted: August 7, 2019
Accepted Manuscript published: August 8, 2019 (version 1)
Version of Record published: August 27, 2019 (version 2)

Copyright

This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.

Metrics

1,471

Page views
222

Downloads
6

Citations

Article citation count generated by polling the highest count across the following sources: Crossref, PubMed Central, Scopus.

Download links

A two-part list of links to download the article, or parts of the article, in various formats.

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Mendeley

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

Sukbin Lim

(2019)

Mechanisms underlying sharpening of visual response dynamics with familiarity

eLife 8:e44098.

https://doi.org/10.7554/eLife.44098

Categories and tags

Research organism

Rhesus macaque

Share this article

Cite this article

Changes in response dynamics of putative excitatory neurons with learning in a passive viewing task (Lim et al., 2015; Woloszyn and Sheinberg, 2012).

Figure 1—source code 1

Networks with synaptic plasticity in recurrent connections without slow negative feedback.

Mechanism of generating damped oscillations after learning.

Example network reproducing the effects of visual learning in one stimulus presentation (A–C) and successive presentation of two stimuli (D–F).

Figure 4—source code 1

Comparison between network simulation and data obtained in a dimming-detection task.

Figure 5—source code 1

Figure 5—source code 2

Post-synaptic dependence of synaptic plasticity in recurrent (left) and feedforward (right) connections derived from a passive viewing task (A) and comparison between the data and network simulations for average (B) and maximal (C) responses.

Figure 6—source code 1

Enhanced oscillation through competitive interactions between different stimuli.

Author details

Sukbin Lim

Contribution

For correspondence

Competing interests

Downloads (link to download the article as PDF)

Open citations (links to open the citations from this article in various online reference manager services)

Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)

Categories and tags

Research organism

Further reading