Deciphering anomalous heterogeneous intracellular transport with neural networks
Abstract
Intracellular transport is predominantly heterogeneous in both time and space, exhibiting varying non-Brownian behavior. Characterization of this movement through averaging methods over an ensemble of trajectories or over the course of a single trajectory often fails to capture this heterogeneity. Here, we developed a deep learning feedforward neural network trained on fractional Brownian motion, providing a novel, accurate and efficient method for resolving heterogeneous behavior of intracellular transport in space and time. The neural network requires significantly fewer data points compared to established methods. This enables robust estimation of Hurst exponents for very short time series data, making possible direct, dynamic segmentation and analysis of experimental tracks of rapidly moving cellular structures such as endosomes and lysosomes. By using this analysis, fractional Brownian motion with a stochastic Hurst exponent was used to interpret, for the first time, anomalous intracellular dynamics, revealing unexpected differences in behavior between closely related endocytic organelles.
Introduction
The majority of transport inside cells on the mesoscale (nm-100μm) is now known to exhibit non-Brownian anomalous behavior (Metzler and Klafter, 2004; Barkai et al., 2012; Waigh, 2014). This has wide ranging implications for most of the biochemical reactions inside cells and thus cellular physiology. It is vitally important to be able to quantitatively characterize the dynamics of organelles and cellular responses to different biological conditions (van Bergeijk et al., 2015; Patwardhan et al., 2017; Moutaux et al., 2018). Classification of different non-Brownian dynamic behaviors at various time scales has been crucial to the analysis of intracellular dynamics (Fedotov et al., 2018; Bressloff and Newby, 2013), protein crowding in the cell (Banks and Fradin, 2005; Weiss et al., 2004), microrheology (Waigh, 2005; Waigh, 2016), entangled actin networks (Amblard et al., 1996), and the movement of lysosomes (Ba et al., 2018) and endosomes (Flores-Rodriguez et al., 2011). Anomalous transport is currently analyzed by statistical averaging methods and this has been a barrier to understanding the nature of its heterogeneity.
Spatiotemporal analysis of intracellular dynamics is often performed by acquiring and tracking microscopy movies of fluorescing membrane-bound organelles in a cell (Rogers et al., 2007; Flores-Rodriguez et al., 2011; Chenouard et al., 2014; Zajac et al., 2013). These tracks are then commonly interpreted using statistical tools such as the mean square displacement (MSD) averaged over the ensemble of tracks, . The MSD is a measure that is widely used in physics, chemistry and biology. In particular, MSDs serve to distinguish between anomalous and normal diffusion at different temporal scales by determining the anomalous exponent through (Metzler and Klafter, 2000). Diffusion is defined as , sub-diffusion and super-diffusion (Klafter and Sokolov, 2011). To improve the statistics of MSDs, they are often averaged over different temporal scales, forming the time-averaged MSD (TAMSD), , where is the lag time (Sokolov, 2012).
For stochastic processes with long-range time dependence such as fractional Brownian motion (fBm), other statistical averaging methods exist. For fBm, the MSD is with the Hurst exponent, varying between 0 and 1. One can use rescaled and sequential range analysis (Samorodnitsky, 2016; Peters, 1994) to estimate . The advantage of modeling intracellular transport with fBm is that both sub-diffusion () and super-diffusion () can be explained in a unified manner using only the Hurst exponent. The essence of fBm is that long-range correlations result in random trajectories that are anti-persistent () or persistent (). How can we understand persistence in the context of intracellular transport? The term persistence can be understood as the processive motor-protein transport of cargo in one direction, whether it be retrograde or anterograde. From a probabilistic viewpoint, persistence can be interpreted as the cargo being more likely to keep the same direction given it had been moving in this fashion before. Conversely, anti-persistence is interpreted as cargo being more likely to change its direction given it had been moving in that direction before. Anti-persistence can arise if cargo is confined to a local volume in the cytoplasm simply due to crowding or tethering biochemical interactions (Harrison et al., 2013), which in effect leads to sub-diffusion (Weiss et al., 2004; Ernst et al., 2012). By interpreting intracellular cargo transport as fBm, there are two main advantages: we can describe movement with the intuitive biological concepts of persistence and anti-persistence; and we can provide an immediate link to anomalous diffusion since α = 2H for constant H.
Cargo movement in vivo often exhibits random switching between persistent and anti-persistent movement, even in a single trajectory (Chen et al., 2015). Therefore, we can model this by a stochastic local Hurst exponent, , which jumps between persistent () and anti-persistent () states. Still, a major challenge exists: how can we estimate a local stochastic Hurst exponent from a trajectory?
Whilst exponent estimation using neural networks is an emerging field (Bondarenko et al., 2016), segmentation of single trajectories into persistent and anti-persistent sections based on instantaneous dynamic behavior has not been studied. Instead, hidden Markov models (Monnier et al., 2015; Persson et al., 2013) and windowed analyses (Getz and Saltz, 2008) are commonly used to segment local behavior along single trajectories (see Appendix A for comparisons). Even so, most methods neglect the microscopic processes which are often a feature of intracellular transport (e.g. alternation between ‘runs’ and ‘rests’) (Weiss et al., 2004; Chen et al., 2015; Fedotov et al., 2018) and the non-Markovian nature of their motion (Fuliński, 2017). fBm was chosen due to its self-similar properties that allow direct analysis at short time scales given by experimental systems; and the experimental evidence for fBm in the crowded cytoplasm (Weiss et al., 2004; Szymanski and Weiss, 2009; Krapf et al., 2019). Moreover, other anomalous diffusion models, such as scaled Brownian motion (Lim and Muniandy, 2002), subdiffusive continuous time random walks (Sokolov, 2012) and superdiffusive Lévy walks (Fedotov et al., 2018) are not suitable to interpret anomalous trajectories on the microscopic level.
Here, we present a new method for characterizing anomalous transport inside cells based on a Deep Learning Feedforward Neural Network (DLFNN) that is trained on fBm. Neural networks are becoming a general tool in a wide range of fields, such as single-cell transcriptomics (Deng et al., 2019) and protein folding (Evans et al., 2018). We find the neural network is a much more sensitive method to characterise fBm than previous statistical tools, since it is an intrinsically non-linear regression method that accounts for correlated time series. In addition, it can estimate the Hurst exponent using as few as seven consecutive time points with good accuracy.
To test the ability of the DLFNN to segment real-world biological motility, we focused on organelles in the endocytic pathway. This pathway is essential for cell homeostasis, allowing nutrient uptake, the turnover of plasma membrane components, and uptake of growth factor receptors bound to their ligands. Early endosomes then sort components destined for degradation from material that needs to be recycled back to the cell surface or to the Trans-Golgi Network (TGN) (Naslavsky and Caplan, 2018). Many aspects of endosome function are regulated by Rab5, a small GTPase that is localized to the cytosolic face of early endosomes (Stenmark and Olkkonen, 2001). Sorting nexin 1 (SNX1) also localises to early endosomes, where it works with the retromer complex to retrieve and recycle cargoes from early endosomes to the TGN (Simonetti and Cullen, 2019). SNX1 achieves this through regulating tubular membrane elements on early endosomes by associating with regions of high membrane curvature (Carlton et al., 2004). Early endosomes mature into late endosomes, which then fuse with lysosomes, delivering their contents for degradation (Huotari and Helenius, 2011). Endocytic pathway components are highly dynamic, with microtubule motors driving long-distance movement while short-range dynamics involve actin-based motility (Granger et al., 2014; Cabukusta and Neefjes, 2018), making them ideal test cases for DLFNN analysis. The new method enables the interpretation of experimental trajectories of lysosomes and endosomes as fBm with stochastic local Hurst exponent, H (t). This in turn allows us to unambiguously and directly classify endosomes and lysosomes to be in anti-persistent or persistent states of motion at different times. From experiments, we observe that the time spent within these two states both exhibit truncated heavy-tailed distributions.
To our knowledge, this is the first method which is capable of resolving heterogeneous behavior of anomalous transport in both time and space. We anticipate that this method will be useful in characterizing a wide range of systems that exhibit anomalous heterogeneous transport. We have therefore created a GUI computer application in which the DLFNN is implemented, so that the wider community can conveniently access this analysis method.
Results and discussion
The DLFNN is more accurate than established methods
We tested a DLFNN trained on fBm with three hidden layers of densely connected nodes on N = 104 computer-generated fBm trajectories each with n = 102 evenly spaced time points and constant Hurst exponent , randomly chosen between 0 and 1. The DLFNN estimated the Hurst exponents based on the trajectories, and these were compared with those estimated from TAMSD, rescaled range, and sequential range methods (Figure 1a). The difference between the simulated and estimated values was much smaller for the DLFNN than for the other methods (Figure 1a), and the DLFNN was times more accurate at estimating Hurst exponents with a mean absolute error () . Also, the errors in estimation of the DLFNN are more stable across values of .
Tracking of intracellular motion usually generates trajectories with a variable number of data points. We therefore compared the performance of the different exponent estimation methods when the number of evenly spaced, consecutive fBm time points in a trajectory varied over points. The DLFNN maintained an accuracy of across , whereas of other methods increase as decreases (Figure 1b), and was always substantially worse than that of the DLFNN estimation. Different DLFNN structures (see Figure 1c,d and e) performed similarly, and introducing more hidden layers did not affect the accuracy of estimation (Figure 1f and g). Given that the structure of DLFNN does not significantly affect the accuracy of exponent estimation, a triangular densely connected DLFNN was used for all subsequent analyses.
The structure of a triangular DLFNN means that the input layer consists of nodes, which are densely connected to nodes in the first hidden layer, such that at the th hidden layer, there would be densely connected nodes. Then to estimate the Hurst exponent these nodes are connected to a single node using a Rectified Linear Unit (ReLU) activation function, which returns the exponent estimate. A triangular DLFNN therefore uses only nodes for hidden layers and input points, whereas the rectangular structure uses nodes and the anti-triangular structure uses . The triangular structure results in a significant decrease in training parameters, and hence computational requirements, while maintaining good levels of accuracy. This demonstrates that a computationally inexpensive neural network can accurately estimate exponents.
The DLFNN’s estimation capabilities were tested further by inputting randomly sampled time points from the original fBm trajectories. Surprisingly, is regained even with just 40 out of 100 data points randomly sampled from the time series for any triangular DLFNN with more than one hidden layer (Figure 1g). For this method to work with experimental systems, it must estimate Hurst exponents even when the trajectories are noisy. Figure 1h shows how the exponent estimation error increases when Gaussian noise with varying strength compared to the original signal is added to the fBm trajectories. Importantly, the DLFNN accuracy at 20% NSR is as good as the accuracy of other methods with no noise (compare 1a and h).
To characterize the accuracy of estimation by the DLFNN, we calculated the bias, ; variance, ; and mean square error, (Figure 1i). To quantify the efficiency of the estimator the Fisher information of the neural network’s estimation needs to be found and the Cramer-Rao lower bound calculated. The values of bias, variance and MSE were very low (Figure 1i), which taken together with the simplicity of calculation and the accuracy of estimation even with small number of data points, demonstrates the strength of the DLFNN method. Furthermore, once trained, the model can be saved and reloaded at any time. Saved DLFNN models, code and the DLFNN Exponent Estimator GUI are available to download (see Software and Code).
DLFNN allows analysis of simulated trajectories with local stochastic Hurst exponents
Estimating local Hurst exponents is fundamentally important because much research has focused on inferring active and passive states of transport within living cells using position-derived quantities such as windowed MSDs, directionality and velocity (Arcizet et al., 2008; Monnier et al., 2015). The trajectories are then segmented and Hurst exponents measured in an effort to characterize the behavior of different cargo when they are actively transported by motor proteins (Chen et al., 2015; Fedotov et al., 2018) or sub-diffusing in the cytoplasm (Jeon et al., 2011). However, conventional methods such as the MSD and TAMSD need trajectories with many time points () to calculate a single Hurst exponent value with high fidelity. In contrast, the DLFNN enables the Hurst exponent to be estimated, directly from positional data, for a small number of points. Furthermore, the DLFNN measures local Hurst exponents without averaging over time points and is able to characterize particle trajectories that may exhibit multi-fractional, heterogeneous dynamics.
To provide a synthetic data set that mimics particle motion in cells, we simulated fBm trajectories with Hurst exponents that varied in time, and applied a symmetric moving window to estimate the Hurst exponent using a small number of data points before and after each time point (Figure 2). The DLFNN was able to identify segments with different exponents, and provided a good running estimation of the Hurst exponent values. The DLFNN could also handle trajectories with different diffusion coefficients, and generally performed better than MSD analysis when a sliding window was used (see Appendix B).
DLFNN analysis reveals differences in motile behavior of organelles in the endocytic pathway
Early endosomes labeled with green fluorescent protein (GFP)-Rab5 undergo bursts of rapid cytoplasmic dynein-driven motility interspersed with periods of rest (Flores-Rodriguez et al., 2011; Zajac et al., 2013). We therefore applied the DLFNN method to experimental trajectories obtained from automated tracking (Newby et al., 2018) data of GFP-Rab5-labeled endosomes in an MRC-5 cell line that stably expressed GFP-Rab5 at low levels (Figure 3). A moving window of 15 points identified persistent (green) and anti-persistent (magenta) segments, which corresponded well to the moving window velocity plots (Figure 3, lower panel), confirming that the neural network is indeed distinguishing passive states from active transport states with non-zero average velocity. We then used it to analyze the motility of two other endocytic compartments: SNX1-positive endosomes (Allison et al., 2017; Hunt et al., 2013) and lysosomes (Cabukusta and Neefjes, 2018; Hendricks et al., 2010). It successfully segmented tracks of GFP-SNX1 endosomes (Figure 3—figure supplement 1) in a stable MRC-5 cell line (Allison et al., 2017) and lysosomes visualized using lysobrite dye (Figure 3—figure supplement 2). A total of 63–71 MRC-5 cells were analyzed, giving 40,800 (GFP-Rab5 endosome), 11,273 (GFP-SNX1 endosome) and 38,039 (lysosome) tracks that were segmented into 277,926 (GFP-Rab5), 215,087 (GFP-SNX1) and 474,473 (lysosome) persistent or anti-persistent sections, each yielding a displacement, duration and average .
These data revealed intriguing similarities and differences in behavior between the three endocytic components. Analysis of the duration and displacement of segments (Appendix C) revealed that all organelles spent longer in anti-persistent than persistent states (Figure 4) but moved much further when persistent (Appendix 3—figure 1), as expected. However, GFP-SNX1 endosomes spent much less time than GFP-Rab5 endosomes or lysosomes in an anti-persistent state (Figure 4). This difference in behavior was also seen when histograms of the Hurst exponents were plotted (Figure 5), as SNX1 endosomes were much less likely to exhibit anti-persistent behavior, particularly with , than Rab5 endosomes or lysosomes. This was confirmed by fitting the histograms of the Hurst exponent with a six component Gaussian mixture model (Figure 5b–d; Appendix D). In contrast, all three organelle classes exhibited a similar range of Hurst exponents when they underwent directionally persistent motion.
To understand organelle motility in the context of cell behavior, an additional layer of complexity needs to be considered - the location of the moving structure within the cell itself. Such information would reveal zones that favor anti-persistent or persistent movement (Bálint et al., 2013). Using the neural network, trajectories of GFP-Rab5, GFP-SNX1 endosomes and lysosomes from MRC-5 cells were plotted with colors depicting the changing Hurst exponent at different points in each trajectory (Figure 6). For Rab5- and SNX1-positive endosomes, anti-persistent organelles were enriched in the cell periphery, but occasionally underwent long-range persistent movement towards the nucleus (Figure 6—video 1; Figure 6—video 2), as expected (Flores-Rodriguez et al., 2011; Zajac et al., 2013; Hunt et al., 2013; Allison et al., 2017). Lysosomes displayed completely different behavior, with most trajectories being anti-persistent, while the persistent trajectories were not obviously organized spatially (Figure 6; Figure 6—video 3). The location information together with classification of anti-persistent and persistent trajectories qualitatively shows the regions of high motor-driven activity within the cell for different endocytic organelles.
Many cargos that move along microtubules can switch their direction of motility, between dynein-driven inward (retrograde) motion toward the microtubule minus ends at the cell centre and plus-end-directed outward (anterograde) movement driven by kinesin family members (Hancock, 2014). To investigate the characteristics of anterograde and retrograde motility of endocytic organelles, we adapted our method to subdivide persistent segments according to whether the movement occurred towards or away from the user-defined centrosomal region (see Materials and methods). Only tracks with displacement of >0.5µm from their start point were selected, which yielded 2369 Rab5, 2099 SNX1 and 7645 lysosome persistent segments that were then analyzed to give the duration, displacement and velocity of anterograde and retrograde excursions (Figure 7; Table 1). The anti-persistent segments contained within these tracks were also analyzed.
These statistics revealed that each endocytic organelle moved with different characteristics. GFP-Rab5 endosomes moved much faster than GFP-SNX1 endosomes or lysosomes, particularly in the retrograde direction (Figure 7, upper panel). Strikingly, although the GFP-SNX1 endosomes were slowest in both directions, they moved furthest and for longest in each segment, in keeping with the longer duration of persistent segments seen in the global analysis of tracks (Figure 4) and higher H values (Figure 5). The differences in behavior between Rab5 and SNX1 endosomes is intriguing, since both are recruited to the early endosome by the lipid phosphoinositol-3-phosphate (Christoforidis et al., 1999; Carlton et al., 2004; Behnia and Munro, 2005; Huotari and Helenius, 2011). However, SNX1 also senses membrane curvature (Carlton et al., 2004), and immunofluorescence labeling of MRC-5 cells with antibodies to Rab5 and SNX1 demonstrated that they reside on distinct domains of larger early endosomes (Figure 6—figure supplement 1), as expected van Weering et al. (2012). In addition, while SNX1 endosomes were usually Rab5-positive, there was a significant population of Rab5 endosomes that lacked SNX1, especially smaller early endosomes that were often located in the cell periphery. It is likely that this population of Rab5-positive, SNX1-negative endosomes is particularly motile. The high retrograde velocity of these endosomes might be explained by the recruitment of dynein to Rab5 endosomes via Hook family members (Bielska et al., 2014; Zhang et al., 2014; Schroeder and Vale, 2016; Guo et al., 2016). These dynein adaptors have the intriguing property of recruiting two dyneins per dynactin (Urnavicius et al., 2018; Grotjahn et al., 2018), leading to faster rates of movement in motility assays using purified protein than adaptors that only recruit one dynein per dynactin. Perhaps, SNX1 endosomes move more slowly than Rab5 endosomes because they use a ‘single-dynein’ adaptor. An alternative explanation could be that SNX1 endosomes are slowed down by interactions with the actin cytoskeleton, since SNX1 domains are enriched in the WASH complex, which in turn controls localized actin assembly (Gomez and Billadeau, 2009; Simonetti and Cullen, 2019). Actin might also contribute to the slow, steady motion of SNX1 endosomes via myosin motors or the formation of actin comets (Simonetti and Cullen, 2019). These interesting possibilities remain to be tested experimentally.
The analysis of anterograde and retrograde segments revealed that lysosomes moved at moderate speed, and were equally fast in both directions, but each burst of movement was short (Figure 7, upper panels). In addition, pauses were times longer for lysosomes than either early endosome type (Figure 7, lower panels). Lysosomes also often changed direction of movement (e.g. Figure 3—figure supplement 2), as previously reported (Hendricks et al., 2010). So far, no activating dynein adaptor has been identified on lysosomes (Reck-Peterson et al., 2018), although several potential dynein interactors have been identified, such as RILP (Rab7 interacting lysosomal protein (Cabukusta and Neefjes, 2018). Whether this underlies the difference in motile behavior between lysosomes and early endosomes remains to be tested: however, a less active dynein could well contribute to frequent reversals in direction (Hancock, 2014).
fBm with a stochastic Hurst exponent is a new possible intracellular transport model
fBm is a Gaussian process with zero mean and covariance , where the Hurst exponent, is a constant between 0 and 1. With the DLFNN providing local estimates of the Hurst exponent, the motion of endosomes and lysosomes can be described as fBm with a stochastic Hurst exponent, . This is different to multifractional Brownian motion (Peltier and Lévy Véhel, 1995) where is a function of time. In our case, is itself a stochastic process and such a process has been considered theoretically (Ayache and Taqqu, 2005). This is the first application of such a theory to intracellular transport and opens a new method for characterizing vesicular movement. Furthermore, Figure 3 shows that the motion of a vesicle, , exhibits regime switching behavior between persistent and anti-persistent states.
We found that the times that lysosomes and endosomes spend in a persistent and anti-persistent state are heavy-tailed (Figure 4). These times are characterized by the probability densities , where anti-persistent states have 0 < µ < 1 and persistent states have 1 < µ < 2. Extensive plots and fittings are shown in Figure 4 and Appendix C. In fact, the residence time probability density has an infinite mean to remain in an anti-persistent state () but in persistent states () the mean of the residence time probability density is finite and the second moment is infinite. This implies that the vesicles may have a biological mechanism to prioritize certain interactions within the complex cytoplasm, similar to ecological searching patterns (Reynolds and Rhodes, 2009), mRNPs (Song et al., 2018), swarming bacteria (Ariel et al., 2015) and how human dynamics are often heavy tailed and bursty (Barabási, 2005).
Conclusions
We developed a Deep Learning Feedforward Neural Network trained on fBm that estimates accurately the Hurst exponent for heterogeneous trajectories. Estimating the Hurst exponent using a DLFNN is not only more accurate than conventional methods but also enables direct trajectory segmentation without a drastic increase in computational cost. We package this DLFNN analysis code into a user-friendly application, which can predict the Hurst exponent with consistent accuracy for as few as seven consecutive data points. This is useful to biologists since major limitations to trajectory analysis are: the brevity of tracks due to the fact that particles may rapidly switch between motile states or move out of the plane of focus; the rapid nature of some biochemical reactions; and the bleaching of fluorescent probes (with non-bleaching probes often being bulky or cytotoxic). This method can be used to detect persistent and anti-persistent states of motion purely from the positional data of trajectories and removes the prerequisite of time or ensemble averaging for effective heterogeneous transport characterization.
The DLFNN enabled us to discover regime switching in lysosome and endosome movement that can be modeled by fBm with a stochastic Hurst exponent. This interpretation is a unified approach to describe motion with anti-persistence and persistence varying over time. Furthermore, the residence time of vesicles in a persistent or anti-persistent state is found to be heavy tailed, which implies that endosomes and lysosomes possess biological mechanisms to prioritize varying biological processes similar to ecological searching patterns (Reynolds and Rhodes, 2009), mRNPs (Song et al., 2018), swarming bacteria (Ariel et al., 2015) and even human dynamics (Barabási, 2005). Importantly, applying this method to identify and analyze the anterograde and retrograde motility reveals unexpected differences in behavior between closely-related organelles. Finally, in addition to providing a new segmentation method of active and passive transport, this new technique distinguishes the difference in motility between lysosomes, Rab5-positive endosomes and SNX1 positive endosomes. The results suggest that the manner in which these vesicles move is dependent on their identity within the endocytic pathway, especially when the motion is anti-persistent. This implies that directionality and the correlation between consecutive steps is important to measure in addition to the displacement, velocity and duration of movement. There is considerable scope for using these methods to identify changes in motility of different organelles caused by disease. We hope that this type of analysis will allow discoveries in particle motility of a more refined nature and make applying anomalous transport theory more accessible to researchers in a wide variety of disciplines.
Materials and methods
Hurst exponent estimation methods
Request a detailed protocolTime averaged MSDs were calculated using
where is the track displacement at time and a track contains coordinates spaced at regular time intervals of . From now on, will denote the time average of unless explicitly specified otherwise. The total time is and . Lag-times are the set of possible within the data set and was then fit to a power-law using the ‘scipy.optimize’ package in Python3 to estimate the exponent .
Rescaled ranges were calculated by creating a mean adjusted cumulative deviate series from original displacements and mean displacement . Then the rescaled range is calculated by
where . The rescaled range is then fitted to a power law where is the Hurst (1951). The ‘compute_Hc’ function in the ‘hurst’ package in Python3 estimates the Hurst exponent in this way.
Sequential ranges are defined as
where is the supremum and is the infimum for the set of real numbers. Then Feller (1951).
DLFNN structure and training
Request a detailed protocolThe fractional Brownian trajectories were generated using the Hosking method within the ‘FBM’ function available from the ‘fbm’ package in Python3. The DLFNN was built using Tensorflow Abadi et al. (2016) and Keras Chollet (2015) in Python3 and trained by using the simulated fractional Brownian trajectories. The training and testing of the neural network were performed on a workstation PC equipped with 2 CPUs with 32 cores (Intel(R) Xeon CPU E5-2640 v3) and 1 GPU (NVIDIA Tesla V100 with 16 GB memory). The structure of the neural network was a multilayer, feedforward neural network where all nodes of the previous layer were densely connected to nodes of the next layer. Each node had a ReLU activation function and the parameters were optimized using the RMSprop optimizer (see Keras documentation Chollet, 2015). Three separate structures were explored and examples of these structures for two hidden layers and five time point inputs are shown in Figure 1g,h and i. The triangular structure was predominantly used since this was the least computationally expensive and accuracy between different structures were similar. To compare the accuracy of different methods, the mean absolute error () of trajectories, , was used. Before inputting values into the neural network, the time series was differenced to make it stationary. The input values of a fBm trajectory were differenced and normalized so that . Since the model requires differenced and normalized input values, in theory it should be applicable to a wide range of datasets. However, further testing must be done in order to confirm this expectation.
Gaussian kernel density estimation
Request a detailed protocolKernel density estimation (KDE) is a non-parametric method to estimate the probability density function (PDF) of random variables. If random variables are distributed by an unknown density function , then the kernel density estimate is
where is the kernel function and is the bandwidth. In this paper, we have used a Gaussian KDE, , to estimate the two dimensional PDFs of the second and bottom row in Figure 1a. This was performed in Python3 using ‘scipy.stats.gaussian_kde’ and Scott’s rule of thumb for bandwidth selection.
Segmenting trajectories into persistent and anti-persistent segments
Request a detailed protocolFrom the estimates of Hurst exponent from the DLFNN, trajectories were segmented into persistent and anti-persistent segments. Given an experimental trajectory and window of length (an odd number) starting at , we obtain the estimate for the position at , where . This will give us a series of values, , which correspond to the positions, . Then, the values can be segmented into consecutive points of persistence and anti-persistence . The bounding values, 0.55 and 0.45, were used since the mean error of the DLFNN estimation method was . Any segment less than the length of was discarded as a precaution against spurious detection.
Directional segmentation of persistent segments
Request a detailed protocolOnce segments of persistence and anti-persistence were defined, we measured the displacement, time and velocity of these segments, shown in the bottom row of Figure 7 and Table 1. The persistent segments were filtered to be only from trajectories that travelled over 0.5 µm; contained more points than the window size; and switched behaviour more than twice in the trajectory. In addition, we assessed if persistent segments were anterograde or retrograde in direction. In order to do this, the centrosomal region was defined by the user as the point where the lysosomes, Rab5 and SNX1 organelles were the largest, brightest, or the most clustered. Image contrast enhancements, such as histogram equalization, were used to locate the centrosomes. By locating the centrosomal region and the cell boundary from user input, the persistent segments can then be classified as anterograde or retrograde. This was done by finding the cosine of the angles, , between the vector, , from the centrosome to the current particle position and the vector, , from the current particle position to the next particle position . The exact formula is . Using windows in a similar fashion as determining persistent and anti-persistent segments, corresponding to position was found for the points within a persistent segment. If , then the motion was deemed to be anterograde and if , retrograde. Sweeping through the points of , consecutive retrograde or anterograde points formed segments from the persistent segments. A threshold of was used.
Cell lines
Request a detailed protocolThe MRC-5 SV1 TG1 Lung fibroblast cell line was purchased from ECACC. MRC-5 cell lines stably expressing GFP-Rab5C and GFP-SNX1 were kindly provided by Drs. Guy Pearson and Evan Reid (Cambridge Institute for Medical Research, University of Cambridge). The GFP-SNX1 cell line has been previously described in Allison et al. (2017). Cell lines were routinely tested for mycoplasma infection. To generate the MRC-5 GFP-Rab5C stable cell line, GFP-Rab5C was PCRed from pIRES GFP-Rab5C Seaman (2004) using ‘Hpa1 GFP Forward’ (TAGGGAGTTAACATGGTGAGCAAGGGCGAGGA) and ‘Not1 Rab5C Reverse’ (ATCCCTGCGGCCGCTCAGTTGCTGCAGCACTGGC) oligonucleotide primers. The GFP-Rab5C PCR product and a pLXIN-I-NeoR plasmid were digested using Hpa1 (New England Biolabs - R0105) and Not1 (New England Biolabs - R3189) restriction enzymes. The GFP-Rab5C PCR product was then ligated into the digested pLXIN-I-NeoR using T4 DNA Ligase (New England Biolabs - M0202). The ligated plasmid was amplified in bacteria selected with ampicillin and verified using Sanger Sequencing. To generate the GFP-Rab5C MRC-5 cell line, Phoenix retrovirus producer HEK293T cells were transfected with the pLXIN-GFP-Rab5C-I-NeoR plasmid to generate retrovirus containing GFP-Rab5C. MRC-5 cells were inoculated with the virus, and successfully transduced cells were selected using 200 µg/mL Geneticin (G418 - Sigma-Aldrich G1397). Cells used for imaging were not clonally selected.
Live-imaging and tracking
Request a detailed protocolStably expressing MRC-5 cells were co-stained with LysoBrite Red (AAT Bioquest), imaged live using fluorescence microscopy and tracked with NNT aitracker.net; Newby et al. (2018). The cells were grown in MEM (Sigma Life Science) and 10% FBS (HyClone) and incubated for 48 hr at 37 in 5% CO2 on 35 mm glass-bottomed dishes (µ-Dish, Ibidi, Cat. No. 81150). For LysoBrite staining, LysoBrite was diluted 1 in 500 with Hank’s Balanced Salt solution (Sigma Life Science). Then 0.5 mL of this solution was added to cells on a 35 mm dish containing 2 mL of growing media and incubated at 37 for at least 1 hr. Cells were then washed with sterile PBS and the media replaced with growing media.
After at least 6 hr incubation, the growing media was replaced with live-imaging media composed of Hank’s Balanced Salt solution (Sigma Life Science, Cat. No. H8264) with added essential and non-essential amino acids, glutamine, penicillin/streptomycin, 25 mM HEPES (pH 7.0) and 10% FBS (HyClone). Live-cell imaging was performed on an inverted Olympus IX71 microscope with an Olympus 100 × 1.35 oil PH3 objective. Samples were illuminated using an OptoLED (Cairn Research) light source with 470 nm and white LEDs. For GFP, a 470 nm LED and Chroma ET470/40 excitation filter was used in combination with a Semrock FITC-3540C filter set. For Lysobrite-Red, a white light LED, Chroma ET573/35 was used with a dualband GFP/mCherry dichroic and an mCherry emission filter (ET632/60). GFP-Rab5-labeled endosomes were imaged in a total of 65 cells, from three independent experiments. GFP-SNX1-labeled endosomes were imaged in a total of 63 cells from four independent experiments. Lysosomes were imaged in separate experiments, with 71 cells imaged from three independent repeats. A stream of 20 ms exposures was collected with a Prime 95B sCMOS Camera (Photometrics) for 17 s using Metamorph software while the cells were kept at 37 (in atmospheric CO2 levels). The endosomes and lysosomes in the videos were then tracked using an automated tracking software (AITracker) Newby et al. (2018).
Confocal imaging
Request a detailed protocolTo compare the localization of SNX1 and Rab5, GFP-Rab5-MRC-5 cells were grown on #1.5 coverslips and then fixed in 3% (w/v) formaldehyde in PBS for 20 min at room temperature (RT). Coverslips were washed twice in PBS, quenched in PBS with glycine, then permeabilized by incubation for 5 min in 0.1% Triton X-100. After another wash in PBS, coverslips were labeled with antibodies to SNX1 and Rab5 for 1 h at RT, washed three times in PBS, then labeled with Alexa488-donkey anti-rabbit and Alexa594-donkey anti-mouse antibodies in 1 µg/mL DAPI in PBS for 30 min. After three PBS washes, coverslips were dipped in deionized water, air-dried and mounted on slides using Prolong Gold.
Images were collected on a Leica TCS SP8 AOBS inverted confocal using a 100x/1.40 NA PL apo objective. The confocal settings were as follows: pinhole, one airy unit; scan speed 400 Hz unidirectional; format 2048 × 2048. Images were collected using hybrid detectors (A488 and A594) or a PMT (DAPI) with these detection mirror settings; [Alexa488, 498 nm-577 nm; Alexa594, 602 nm-667 nm; DAPI, 420 nm-466 nm] using the SuperK Extreme supercontinuum white light laser for 488 nm (10.5%) and 594 nm (5%) excitation, and a 405 nm laser (5%) for DAPI. Images were collected sequentially to eliminate cross-talk between channels. When acquiring 3D optical stacks the confocal software was used to determine the optimal number of Z sections. The data were deconvolved using Huygens software before generating maximum intensity projections of 3D stacks using FIJI.
Software and code
Request a detailed protocolThe code and documentation for determining the Hurst exponent can be found in https://github.com/dadanhan/hurst-exp (copy archived at https://github.com/elifesciences-publications/hurst-exp; Han, 2019) and a GUI is available on https://zenodo.org/record/3613843#.XkPf2Wj7SUl.
Appendix 1
Comparison of HMM model against fBm model segmentation of experimental trajectories
In order to compare the effectiveness of the neural network and hidden Markov models (HMM), qualitative plots were made of real trajectories and their respective comparisions. The models in the HMM analysis approach had a maximum of three different motion states. It is clear from comparing the endosome track segmented using DLFNN (Figure 3) with Appendix 1—figures 1–3, that segmentation using hidden Markov models is not suitable for endosome trajectories. Perhaps, by increasing the number of states within models, the hidden Markov models can achieve similar results of the neural network, but this analysis becomes computationally expensive.
Appendix 2
Testing DLFNN accuracy for different diffusion coefficients
The DLFNN was compared to the MSD estimation method for simulated trajectories with different diffusion coefficients to ensure that the DLFNN estimation was not scale dependent.
Appendix 3
Measuring the residence time and flight length probability density functions of persistent and anti-persistent states
Classifying persistent and anti-persistent states by Hurst exponent values and respectively, individual lysosome and endosome trajectories were segmented with a moving window of 15 points. Data was extracted from microscopy movies from three independent experiments. GFP-Rab5 endosomes from 65 cells, GFP-SNX1 endosomes from 63 cells and lysosomes from 71 different cells were tracked using AITracker Newby et al. (2018). Then the trajectories were segmented into anti-persistent () and persistent () using the Hurst exponent estimates by DLFNN. The time duration and particle displacement of these segments were measured and then fitted to distributions. In this way, we could measure the stochastic switching between active and passive transport and the statistics of vesicle movement within these states.
Figure 4 shows the survival time probabilities of different states of motion (persistent and anti-persistent) in vesicle trajectories. is the probability that the vesicle will still be in the same state of motion after time has elapsed. Figure 4 shows that the persistent and anti-persistent states follow . The survival time probabilities show that lysosomes and endosomes are far more likely to remain trapped in a anti-persistent state than be persistently transported by motor proteins. While this is intuitively obvious in the context of cell biology, this analysis provides quantitative characterization of endosomal and lysosomal motility. Appendix 3—table 1 shows the parameters of fitting for Figure 4. Appendix 3—figure 1 shows the empirical probability density functions (PDF) of the particle displacements for different states of motion. Displacements of segments are fitted to Burr Type XII distributions,
where , , and .
As expected, this analysis demonstrates that both endosomes and lysosomes are far more likely to move large distances when they are in the persistent state. This reconciles how vesicles are able to move large distances even though they are more likely to stay in a anti-persistent state for long periods of time. The large displacements in the persistent state compete with long durations spent in the anti-persistent state.
Appendix 4
Calculating information criteria for GMM fittings
In order to determine the minimum amount of components necessary to model the histograms of Hurst exponent in Figure 5, the Akaike and Bayes Information Criterion were computed.
Data availability
Supporting files are on GitHub and Zenodo.
References
-
ConferenceTensorflow: a system for large-scale machine learning12th USENIX Symposium on Operating Systems Design and Implementation.
-
Defects in ER-endosome contacts impact lysosome function in hereditary spastic paraplegiaJournal of Cell Biology 216:1337–1355.https://doi.org/10.1083/jcb.201609033
-
Subdiffusion and anomalous local viscoelasticity in actin networksPhysical Review Letters 77:4470–4473.https://doi.org/10.1103/PhysRevLett.77.4470
-
Temporal analysis of active and passive transport in living cellsPhysical Review Letters 101:248103.https://doi.org/10.1103/PhysRevLett.101.248103
-
Swarming Bacteria migrate by lévy walkNature Communications 6:1–6.https://doi.org/10.1038/ncomms9396
-
Multifractional processes with random exponentPublicacions Matemàtiques 49:459–486.https://doi.org/10.5565/PUBLMAT_49205_11
-
Anomalous diffusion of proteins due to molecular crowdingBiophysical Journal 89:2960–2971.https://doi.org/10.1529/biophysj.104.051078
-
Strange kinetics of single molecules in living cellsPhysics Today 65:29–35.https://doi.org/10.1063/PT.3.1677
-
Hook is an adapter that coordinates kinesin-3 and dynein cargo attachment on early endosomesThe Journal of Cell Biology 204:989–1007.https://doi.org/10.1083/jcb.201309022
-
Inverse problems of anomalous diffusion theory: An artificial neural network approachJournal of Applied and Industrial Mathematics 10:311–321.https://doi.org/10.1134/S1990478916030017
-
Stochastic models of intracellular transportReviews of Modern Physics 85:135–196.https://doi.org/10.1103/RevModPhys.85.135
-
Objective comparison of particle tracking methodsNature Methods 11:281–289.https://doi.org/10.1038/nmeth.2808
-
Phosphatidylinositol-3-OH kinases are Rab5 effectorsNature Cell Biology 1:249–252.https://doi.org/10.1038/12075
-
Fractional brownian motion in crowded fluidsSoft Matter 8:4886–4889.https://doi.org/10.1039/c2sm25220a
-
De novo structure prediction with deeplearning based scoringAnnual Review of Biochemistry 77:6.
-
The asymptotic distribution of the range of sums of independent random variablesThe Annals of Mathematical Statistics 22:427–432.https://doi.org/10.1214/aoms/1177729589
-
Fractional brownian motions: memory, diffusion velocity, and correlation functionsJournal of Physics A: Mathematical and Theoretical 50:054002.https://doi.org/10.1088/1751-8121/50/5/054002
-
A FAM21-containing WASH complex regulates retromer-dependent sortingDevelopmental Cell 17:699–711.https://doi.org/10.1016/j.devcel.2009.09.009
-
The role of the cytoskeleton and molecular motors in endosomal dynamicsSeminars in Cell & Developmental Biology 31:20–29.https://doi.org/10.1016/j.semcdb.2014.04.011
-
Cryo-electron tomography reveals that dynactin recruits a team of dyneins for processive motilityNature Structural & Molecular Biology 25:203–207.https://doi.org/10.1038/s41594-018-0027-7
-
Bidirectional cargo transport: moving beyond tug of warNature Reviews Molecular Cell Biology 15:615–628.https://doi.org/10.1038/nrm3853
-
Microtubule motors mediate endosomal sorting by maintaining functional domain organizationJournal of Cell Science 126:2493–2501.https://doi.org/10.1242/jcs.122317
-
Long-term storage capacity of reservoirsTransactions of the American Society of Civil Engineers 116:770–799.
-
In vivo anomalous diffusion and weak ergodicity breaking of lipid granulesPhysical Review Letters 106:048103.https://doi.org/10.1103/PhysRevLett.106.048103
-
BookFirst Steps in Random Walks: From Tools to ApplicationsOxford University Press.https://doi.org/10.1093/acprof:oso/9780199234868.001.0001
-
Spectral content of a single Non-Brownian trajectoryPhysical Review X 9:011019.https://doi.org/10.1103/PhysRevX.9.011019
-
Self-similar gaussian processes for modeling anomalous diffusionPhysical Review E 66:021114.https://doi.org/10.1103/PhysRevE.66.021114
-
The restaurant at the end of the random walk: recent developments in the description of anomalous transport by fractional dynamicsJournal of Physics A: Mathematical and General 37:R161–R208.https://doi.org/10.1088/0305-4470/37/31/R01
-
Inferring transient particle transport dynamics in live cellsNature Methods 12:838–840.https://doi.org/10.1038/nmeth.3483
-
The enigmatic endosome - sorting the ins and outs of endocytic traffickingJournal of Cell Science 131:jcs216499.https://doi.org/10.1242/jcs.216499
-
ReportMultifractional Brownian Motion : Definition and Preliminary Results. Research Report RR-2645, INRIAProjet FRACTALES.
-
BookFractal Market Analysis: Applying Chaos Theory to Investment and EconomicsJohn Wiley & Sons.
-
The cytoplasmic dynein transport machinery and its many cargoesNature Reviews Molecular Cell Biology 19:382–398.https://doi.org/10.1038/s41580-018-0004-3
-
Assembly and activation of dynein–dynactin by the cargo adaptor protein Hook3Journal of Cell Biology 214:309–318.https://doi.org/10.1083/jcb.201604002
-
Cargo-selective endosomal sorting for retrieval to the Golgi requires retromerJournal of Cell Biology 165:111–122.https://doi.org/10.1083/jcb.200312034
-
Actin-dependent endosomal receptor recyclingCurrent Opinion in Cell Biology 56:22–33.https://doi.org/10.1016/j.ceb.2018.08.006
-
Models of anomalous diffusion in crowded environmentsSoft Matter 8:9043–9052.https://doi.org/10.1039/c2sm25701g
-
The rab gtpase familyGenome Biology 2:reviews3007.1.https://doi.org/10.1186/gb-2001-2-5-reviews3007
-
Elucidating the origin of anomalous diffusion in crowded fluidsPhysical Review Letters 103:038102.https://doi.org/10.1103/PhysRevLett.103.038102
-
Microrheology of complex fluidsReports on Progress in Physics 68:685–742.https://doi.org/10.1088/0034-4885/68/3/R04
-
Advances in the microrheology of complex fluidsReports on Progress in Physics 79:074601.https://doi.org/10.1088/0034-4885/79/7/074601
-
Anomalous subdiffusion is a measure for cytoplasmic crowding in living cellsBiophysical Journal 87:3518–3524.https://doi.org/10.1529/biophysj.104.044263
-
HookA is a novel dynein-early endosome linker critical for cargo movement in vivoThe Journal of Cell Biology 204:1009–1026.https://doi.org/10.1083/jcb.201308009
Article and author information
Author details
Funding
Wellcome Trust (215189/Z/19/Z)
- Daniel Han
EPSRC (EP/J019526/1)
- Nickolay Korabel
- Victoria J Allan
- Sergei Fedotov
- Thomas A Waigh
BBSRC (BB/H017828/1)
- Victoria J Allan
Wellcome Trust (108867/Z/15/Z)
- Anna Gavrilova
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Acknowledgements
The authors thank: Dr. Jay Newby and Zach Richardson (UNC Chapel Hill) for assistance in using the automated tracking system (AITracker); Prof. Philip Woodman, Prof. Martin Lowe, Prof. Matthias Weiss (Universität Bayreuth), Dr. Henry Cox, Dr. Jack Hart, Rebecca Yarwood and Hannah Perkins for discussions; and, Dr. Guy Pearson and Dr. Evan Reid (University of Cambridge) for providing the GFP-Rab5 and GFP-SNX1 MRC-5 cell lines. DH acknowledges financial support from the Wellcome Trust Grant No. 215189/Z/19/Z. SF, NK, TAW, and VJA acknowledge financial support from EPSRC Grant No. EP/J019526/1. VJA acknowledges support from the Biotechnology and Biological Sciences Research Council grant number BB/H017828/1. AG acknowledges financial support from the Wellcome Trust Grant No. 108867/Z/15/Z. The Leica SP8 microscope used in this study was purchased by the University of Manchester Strategic Fund. Special thanks goes to Dr. Peter March for his help with the confocal imaging.
Copyright
© 2020, Han et al.
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.
Metrics
-
- 1,958
- views
-
- 313
- downloads
-
- 45
- citations
Views, downloads and citations are aggregated across all versions of this paper published by eLife.
Download links
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Further reading
-
- Cell Biology
- Developmental Biology
In most murine species, spermatozoa exhibit a falciform apical hook at the head end. The function of the sperm hook is not yet clearly understood. In this study, we investigate the role of the sperm hook in the migration of spermatozoa through the female reproductive tract in Mus musculus (C57BL/6), using a deep tissue imaging custom-built two-photon microscope. Through live reproductive tract imaging, we found evidence indicating that the sperm hook aids in the attachment of spermatozoa to the epithelium and facilitates interactions between spermatozoa and the epithelium during migration in the uterus and oviduct. We also observed synchronized sperm beating, which resulted from the spontaneous unidirectional rearrangement of spermatozoa in the uterus. Based on live imaging of spermatozoa-epithelium interaction dynamics, we propose that the sperm hook plays a crucial role in successful migration through the female reproductive tract by providing anchor-like mechanical support and facilitating interactions between spermatozoa and the female reproductive tract in the house mouse.
-
- Cell Biology
The spatiotemporal transition of small GTPase Rab5 to Rab7 is crucial for early-to-late endosome maturation, yet the precise mechanism governing Rab5-to-Rab7 switching remains elusive. USP8, a ubiquitin-specific protease, plays a prominent role in the endosomal sorting of a wide range of transmembrane receptors and is a promising target in cancer therapy. Here, we identified that USP8 is recruited to Rab5-positive carriers by Rabex5, a guanine nucleotide exchange factor (GEF) for Rab5. The recruitment of USP8 dissociates Rabex5 from early endosomes (EEs) and meanwhile promotes the recruitment of the Rab7 GEF SAND-1/Mon1. In USP8-deficient cells, the level of active Rab5 is increased, while the Rab7 signal is decreased. As a result, enlarged EEs with abundant intraluminal vesicles accumulate and digestive lysosomes are rudimentary. Together, our results reveal an important and unexpected role of a deubiquitinating enzyme in endosome maturation.