Figures and data
![](https://prod--epp.elifesciences.org/iiif/2/95160%2Fv2%2Fcontent%2F566396v3_fig1.tif/full/max/0/default.jpg)
Error patterns of orientation stimuli in delayed-estimation tasks and low-dimensional attractor models. (A-C) Characteristic patterns of natural statistics of orientation stimuli θθ (A), bias (B), and standard deviation (SD; C) during the delay period observed experimentally. Cardinal orientations are predominant in natural images (A). Bias and SD increase during the delay period, keeping patterns of repulsive bias (B) and minimum variance (C) around cardinal orientations. These characteristic patterns are visualized using trigonometric functions, and the range is normalized by their maximum values. Red vertical lines correspond to representative cardinal and oblique orientations, and with a periodicity of the error patterns, we only show the grey-shaded range in the remaining panels. (D-L) Comparison of different attractor models. (D-F) Continuous attractors with constant noise. Energy potential is flat (D), resulting in no bias (E) and uniform SD with uniform noise (F). (G-L) Discrete attractors with constant (G-I) and nonuniform noise (J-L). The discrete attractor models have potential hills and wells at cardinal and oblique orientations, respectively (G,J). While the bias patterns depend only on the energy landscape (H,K), SD representing variability also depends on noise (I,L). For the correct SD pattern (L), uneven noise with its maxima at the obliques (J) is required. Bias and SD patterns in the attractor models were obtained by running one-dimensional drift-diffusion models (see Methods).
![](https://prod--epp.elifesciences.org/iiif/2/95160%2Fv2%2Fcontent%2F566396v3_fig2.tif/full/max/0/default.jpg)
Extension of Bayesian sensory models. (A) Schematics of extension to memory processing. We adapted the previous Bayesian models (Wei and Stocker 2015) for sensory encoding where θ and
![](https://prod--epp.elifesciences.org/iiif/2/95160%2Fv2%2Fcontent%2F566396v3_fig3.tif/full/max/0/default.jpg)
Network models of sensory and memory circuits in isolation, implementing efficient coding and ring-attractor dynamics, respectively. (A) Schematics of columnar architecture for orientation selectivity. Neurons in the same column have similar preferred orientations, and recurrent connections are a combination of local excitation and global inhibition, represented as triangles and circles, respectively. (B-F) Connectivity and tuning properties of the sensory network (left column) and memory network (right column). (B) Example connectivity strengths. We indexed neurons by ψ ranging uniformly from 0° to 180°. The connectivity strengths depend only on ψ’s of the presynaptic and postsynaptic neurons. Each curve shows the connectivity strengths from presynaptic neuron ψ to an example postsynaptic neuron. Unlike the homogeneous connectivity in the memory network (right), the sensory connectivity is heterogeneous, and its degree is denoted by α. (C) Heterogeneous tuning curves for different stimulus θ in the sensory network in the stimulus period (left) and homogeneous ones in the memory network in the delay period (right). The memory network can sustain persistent activity in isolation, while the sensory network cannot. (D) Histograms of the preferred orientations. We measured the maximum of the tuning curve of each neuron, denoted as
![](https://prod--epp.elifesciences.org/iiif/2/95160%2Fv2%2Fcontent%2F566396v3_fig4.tif/full/max/0/default.jpg)
Network model with interacting sensory and memory modules generates correct error patterns in delayed estimation tasks. (A) Schematic of two-module architecture. The sensory and memory modules are connected via feedforward and feedback connectivity to form a closed loop. The sensory module receives external input with orientation θ while internal representation is decoded from the memory module, denoted as
![](https://prod--epp.elifesciences.org/iiif/2/95160%2Fv2%2Fcontent%2F566396v3_fig5.tif/full/max/0/default.jpg)
Low-dimensional dynamics along memory manifold and their dependence on heterogeneity degrees in the sensory module. (A) Low-dimensional projection along the memory states. Left panel: The memory manifold projected to the first two PCs associated with the vector fields. Right panel: Example drift-diffusion trajectories along the memory manifold starting at θ =112.5°. (B,C) Velocity (B) and noise coefficients (C) corresponding to drift and diffusion processes. Different grey scales represent different heterogeneity degrees in the sensory module, α in Figure 3B. The velocity with which the remembered orientation drifts to the obliques in a noise-free network (B). A larger noise coefficient around the obliques overcomes the underlying drift dynamics and causes the standard deviation pattern to reach its maxima at the obliques (C). (D) Equivalent one-dimensional energy potential derived from the velocity in (B). (E,F) Example bias (E) and standard deviation (F) patterns at 4s into the delay. The shaded areas mark the ±s.e.m. of 1000 realizations.
![](https://prod--epp.elifesciences.org/iiif/2/95160%2Fv2%2Fcontent%2F566396v3_fig6.tif/full/max/0/default.jpg)
Error patterns and low-dimensional dynamics for different intermodal connectivity strengths. (A-J) Low-dimensional dynamics and error patterns with varying feedforward and feedback connection strengths, denoted by Jf and Jb. (K,L) Potential differences and noise coefficient indices comparing low-dimensional dynamics at cardinal and oblique orientations for changing Jb and heterogeneity degree, α. Increasing both feedforward (A-D) and feedback (E-H) connection strengths deepens the potential difference (A,E,K) and increases the bias (B,F), similar to the effects of α increases in Figure 5D,E. In contrast, the profile of noise coefficients is less affected (C,G,L) and the SD pattern gets flattened with stronger drift (D,H). Bias and SD patterns depend on the product of feedforward and feedback connection strengths (I,J). Bias and SD are estimated at 4s (B,D,F,H) or 1s (I,J) into the delay and shaded areas mark the ±s.e.m. of 1000 realizations.
![](https://prod--epp.elifesciences.org/iiif/2/95160%2Fv2%2Fcontent%2F566396v3_fig7.tif/full/max/0/default.jpg)
Stronger inhibitory synaptic modulation is required for correct error patterns. (A) Segregation of excitatory (blue) and inhibitory (red) synaptic pathways. (B) Example excitatory (left) and inhibitory (right) connectivity strengths of the sensory module. The heterogeneity degrees of excitatory and inhibitory connections are denoted by α and β, respectively. Unlike combined excitation and inhibition in Figure 3B, the connectivity strengths are maximal around cardinal orientations. (C,D) Bias with stimulus at 22.5° (C) and standard deviation (SD) index (D) estimated at 1s into the delay for different values of α and β. SD index compares the SD at the cardinal and oblique orientations (Methods). (E,F) Example bias (left) and SD (right) patterns when excitatory modulation overwhelms inhibitory modulation (α = 0.068, β = 0.04; E) and when inhibitory modulation is stronger (α = 0.03, β = 0.08; F). In (C) and (D), green (yellow) pentagrams mark the parameters used in (E) and (F). Stronger inhibitory modulation is required for correct bias and variance patterns (F and green regions in C and D). In (E) and (F), shaded areas mark the ±s.e.m. of 1000 realizations.
![](https://prod--epp.elifesciences.org/iiif/2/95160%2Fv2%2Fcontent%2F566396v3_fig8.tif/full/max/0/default.jpg)
Network model with memory module only cannot reproduce correct error patterns. (A) Schematics of one-module network with heterogeneous and strong recurrent connections that enable both efficient coding and memory maintenance. (B) Example tuning curves at the end of the stimulus epoch (left) and at 4s into the delay epoch (right). (C,D) Bias with stimulus at 22.5° (C) and standard deviation (SD) index (D) estimated at 1s into the delay for different heterogeneity degrees of excitatory and inhibitory connections, denoted by α and β. For the parameters that generate reasonable bias patterns, the SD index is always negative, which indicates that the SD pattern is inconsistent with experimental findings. (E) Bias (left), and SD (right) patterns in the delay. While the bias pattern is correct, the SD reaches maxima around cardinal orientations, unlike the experiments. In (C) and (D), the yellow pentagram marks the parameters used in (E).
![](https://prod--epp.elifesciences.org/iiif/2/95160%2Fv2%2Fcontent%2F566396v3_fig9.tif/full/max/0/default.jpg)
Comparison of low-dimensional dynamics between two-module and one-module network models. (A,B) Bias and standard deviation (SD) patterns of two-module (A) and one-module (B) networks, adapted from Figure 7F and Figure 8E, respectively. The averages of bias and SD over different θ at 4s into the delay are similar in the two networks. (C-F) Low-dimensional dynamics of two-module (black) and one-module (red) networks. In both networks, the energy potential (C), the distance between stimulus representation,
![](https://prod--epp.elifesciences.org/iiif/2/95160%2Fv2%2Fcontent%2F566396v3_fig10.tif/full/max/0/default.jpg)
Effect of perturbations in sensory-memory interaction on error patterns. (A,B) Example bias (A) and standard deviation (B) patterns when we assumed that TMS is applied to interrupt the feedforward signal from 2.5s into the delay. Shaded areas mark the ±s.e.m. of 1000 realizations. (C,D) Evolution of bias with example cue orientation at θ = 18° (C) and the tuning width indices in the memory network (WI; C) representing the asymmetry of tuning widths at cardinal and oblique orientations (Methods). Two vertical dashed lines mark the end of the stimulus epoch and the beginning of TMS disruption, respectively. Solid and dashed curves correspond to with and without perturbations, respectively. Both bias (C) and WI (D) stop increasing when TMS is on (C,D).
![](https://prod--epp.elifesciences.org/iiif/2/95160%2Fv2%2Fcontent%2F566396v3_fig4_1.tif/full/max/0/default.jpg)
Bias (A) and SD (B) patterns decoded from activities of sensory module. All parameters are the same as in Figure 4.
![](https://prod--epp.elifesciences.org/iiif/2/95160%2Fv2%2Fcontent%2F566396v3_fig4_2.tif/full/max/0/default.jpg)
Dynamics of bias and tuning properties of sensory-memory interacting network models. (A) Maximum firing rate of ψ = 22.2° for all stimulus orientations. The vertical grey line represents the end of the stimulus presentation. Both sensory and memory modules show lower but sustained activities during the delay period. (B) Bias evolution to input orientation θ = 18°. The bias increases both in the stimulus and delay periods, while its increasing speed is reduced during the delay period. (C) Tuning width indices (WI) measuring the asymmetry of tuning widths at cardinal and oblique orientations (Methods). WI also increases in the whole process, indicating the tuning curves of the neural population become more heterogeneous. All parameters are the same as in Figure 4.
![](https://prod--epp.elifesciences.org/iiif/2/95160%2Fv2%2Fcontent%2F566396v3_fig5_1.tif/full/max/0/default.jpg)
Comparison between bias and standard deviation (SD) patterns of the full network model (orangish) and low-dimensional projection (bluish curves). From top to bottom, each row corresponds to sensory-memory interacting networks in Figure 5 with α = 0.03 (A,D), 0.04 (B,E), and 0.05 (C,F), respectively. We projected the dynamics onto the left (A-C) and right (D-F) eigenvectors of the Jacobian matrix obtained from local dynamics along the memory states (Methods). The initial orientations of the low-dimensional model were set to be the orientations decoded from the full model at 1s into the delay. We compared the increase of bias from then on, i.e., at 1.2s, 1.5s, and 2s into the delay for the full model, but 0.2s, 0.5s, and 1s for the low-dimensional model. Low-dimensional projection captures characteristic patterns well despite relatively larger deviation in the SD compared to bias, and we found that projecting to the right eigenvector (D-F) generally yields better predictions than projecting to the left eigenvector (A-C). All parameters are the same as in Figure 5 except for α. Shaded areas (too narrow to be seen) mark the ±s.e.m. of 3000 realizations.
![](https://prod--epp.elifesciences.org/iiif/2/95160%2Fv2%2Fcontent%2F566396v3_fig5_2.tif/full/max/0/default.jpg)
SD pattern remains consistent under different noise types. When Poisson noise is replaced by uniform Gaussian noise with ξ∼N(0, σξ2) in Eq. (3), the diffusion term and variability of errors are affected (A-C), but the drift and bias patterns remain unchanged (not shown). The distance between stimulus representation
![](https://prod--epp.elifesciences.org/iiif/2/95160%2Fv2%2Fcontent%2F566396v3_fig7_1.tif/full/max/0/default.jpg)
Relationship between drift speed and memory loss in two-module (A-C) and one-module (D-F) networks. (A,D) Drift speed for different heterogeneity degrees, α and β. (B,E) Minimum Fisher information (FI). The upper panels were obtained with a coarse parameter grid, and lower panels were obtained with a fine grid but only along parameters for the smallest bias increase (red circle) and the orthogonal direction (red triangle). When bias speed is large with unbalanced excitation and inhibition strengths (triangle), the minimum FI decreases quickly in both two-module and one-module networks, suggesting memory loss. On the other hand, along the direction with the smallest bias increase (circle), the minimum FI is relatively high. The FI was estimated at 4s into the delay epoch using 1000 realizations. (C,F) Negative correlation between minimum FI and drift speed.
![](https://prod--epp.elifesciences.org/iiif/2/95160%2Fv2%2Fcontent%2F566396v3_fig7_2.tif/full/max/0/default.jpg)
Error patterns in sensory networks with long intrinsic time constants. In the sensory module alone, with an intrinsic time constant τ=1s in Eq. (3), the bias (A) and SD (B) remain nearly unchanged during a 5-second delay period. Preferred orientations are estimated 10s after stimulus onset, and all other parameters are the same with those in Fig. 7F.
![](https://prod--epp.elifesciences.org/iiif/2/95160%2Fv2%2Fcontent%2F566396v3_fig9_1.tif/full/max/0/default.jpg)
Error patterns remain unchanged under different levels of noise. Bias (left) and SD (right) in two-module (A,B) and one-module (C,D) networks with uniform Gaussian noise