Abstract
Intravital microscopy (IVM) enables live imaging of animals at single-cell level, offering essential insights into cancer progression. This technique allows for the observation of single-cell behaviors within their natural 3D tissue environments, shedding light on how genetic and microenvironmental changes influence the complex dynamics of tumors. IVM generates highly complex datasets that often exceed the analytical capacity of traditional uni-parametric approaches, which can neglect single-cell heterogeneous in vivo behavior and limit insights into microenvironmental influences on cellular behavior. To overcome these limitations, we present BEHAV3D Tumor Profiler (BEHAV3D-TP), a computational framework that enables unbiased single-cell classification based on a range of morphological and dynamic single cell features. BEHAV3D-TP integrates with widely used 2D and 3D image processing pipelines, enabling researchers without advanced computational expertise to profile cancer and healthy cell dynamics in IVM data. Here, we apply BEHAV3D-TP to study diffuse midline glioma (DMG), a highly aggressive pediatric brain tumor characterized by invasive progression. By extending BEHAV3D-TP to incorporate tumor microenvironment (TME) data from IVM or fixed correlative imaging, we demonstrate that distinct migratory behaviors of DMG cells are associated with specific TME components, including tumor-associated macrophages and vasculature. BEHAV3D-TP enhances the accessibility of computational tools for analyzing the complex behaviors of cancer cells and their interactions with the TME in IVM data.
Introduction
Cancer is a complex disease driven by a sequence of genetic and microenvironmental changes. As a result, tumors comprise many different cell populations that are in constant evolution1. This tumor heterogeneity has important biological and clinical implications as it differentially promotes key characteristics of individual cancer cells, including proliferation, invasion, and drug resistance 2. Yet, we are far from fully understanding all the dynamic and bi-directional interactions in heterogeneous tumors, and how these interactions influence cancer cell behavior at the single-cell level. Emerging single-cell technologies and analysis tools provide a new opportunity to profile individual cells within tumors. For example, recent spatial transcriptomic and proteomic profiling provides evidence for the existence of multiple distinct microenvironmental niches within one tumor 3. However, these techniques can only provide static information and make use of thin tissue sections that are only one cell layer thick. To investigate the real-time behavior of individual cells intravital microscopy (IVM) has been developed to study tumor cell behavior evolution over time but also in their three-dimensional native tissue environment.
IVM is a technique used to capture both spatial and temporal information at a single-cell level in living animals. Over the past years, it has provided many new insights into the dynamics of tumor heterogeneity and the development of therapy resistance 4–15. For example, intravital imaging of mouse breast cancer models revealed that only a small portion of tumor cells is motile 15, and that fast- and slow-migrating cells are present in distinct regions of the tumor 7,16. Moreover, additional heterogeneity exists among migrating tumor cells that can, for instance, move randomly or directionally relative to other tumor cells and/or surrounding healthy tissue 7. However, traditional IVM analyses have considered cancer cells or the tumor microenvironment (TME) as a homogeneous population, thereby ignoring heterogeneity at the single-cell level and the influence of the local microenvironment, where interactions between neighboring cells may affect cellular behavior. To address these complexities, recent studies have used unbiased approaches using morpho-kinetic parameters derived from live in vitro17 or in vivo imaging to classify cells and explore the single-cell behavioral landscape as an additional omic layer 18–20. In line with this concept of characterizing cellular dynamic properties for cell classification, we have previously developed an analytical platform termed BEHAV3D 19,21 allowing to perform behavioral phenotyping of engineered T cells targeting cancer. While BEHAV3D was initially developed to analyze T cell migratory behavior under controlled in vitro conditions, we sought to expand its application to investigate tumor cell behaviors in IVM data, where the complexity of the TME presents distinct analytical challenges. This manuscript builds on our foundational work but represents a significant advancement by adapting the pipeline specifically for IVM datasets.
While significant efforts have been made to develop open-source segmentation and tracking tools for live imaging data, including IVM22–27 fewer tools exist for the unbiased analysis of tumor dynamics. One major barrier is that implementing such analytical methods often requires substantial computational expertise, limiting accessibility for many biomedical researchers conducting IVM experiments. To bridge this gap, we present BEHAV3D Tumor Profiler (BEHAV3D-TP) by providing a robust, user-friendly tool that allows researchers to extract meaningful insights from dynamic cellular behaviors without requiring advanced programming skills. BEHAV3D-TP expands the capabilities of BEHAV3D by incorporating key features designed for in vivo tumor cell dynamics (Fig. 1). The pipeline includes extensions that integrate tumor cell behavior with spatial features within the native TME, using either in situ (IVM) or fixed correlative imaging to reveal how distinct spatial niches influence tumor dynamics.

BEHAV3D Tumor Profiler pipeline.
Schematic representation of the workflow showing data preparation, input and outputs in each of the three modules. a, Time-lapse image processing and preparation, based on segmentation and tracking of tumor (and labelled TME cells). Mounting Google Drive is optional but recommended to work in the Google Colab framework. b, Heterogeneity Module provides distinct behavioral clusters for cells, and relates them to dynamic features and provides a back-projection of the tracked cells. c, d, Optional modules, additional to the Heterogeneity module. c, Large-scale phenotyping module combines TME large-scale information with cell morphodynamic profiling to further depict population frequencies in distinct TME regions. d, Small-scale phenotyping module combines TME small-scale information with morphodynamic profiling to depict how the cellular environment can influence tumor cell behavior.
To further facilitate unbiased analysis of tumor dynamics, we developed BEHAV3D-TP as a flexible tool that supports both commercial and open-source data formats, ensuring broad compatibility across different research workflows. The pipeline supports 2D and 3D data formats generated by Imaris and by Fiji plugins such as TrackMate, MTrackJ, and ManualTracking, enabling processing of datasets from the most widely used segmentation and tracking solutions. We demonstrate the versatility and broad applicability of BEHAV3D-TP by applying it to a range of published tumor and healthy tissue IVM datasets.
Next, we focused on Diffuse Midline Glioma (DMG), a highly aggressive pediatric brain tumor characterized by invasive growth and its capacity to spread to other regions of the brain and the spinal cord 28. Our approach allowed us to observe associations between DMG cell migration behavior and specific microenvironmental factors, including tumor-associated macrophages and vasculature, by visualizing TME components either during or after IVM. In our study, we specifically focused on cancer cell migration as a specific feature of DMG, but our methodology could easily be extended to other cancer cell behaviors such as intravasation or metastatic colonization. Overall, BEHAV3D-TP provides an accessible computational approach for a better understanding of tumor-TME crosstalk and the functional implications of this communication in heterogeneous tumors.
Results
BEHAV3D Tumor Profiler: an accessible tool for mapping heterogeneity in tumor dynamics
To comprehensively map and analyze the dynamic heterogeneity of tumor cells within their TME we developed BEHAV3D-TP [https://github.com/imAIgene-Dream3D/BEHAV3D_Tumor_Profiler]. To enhance accessibility and encourage widespread adoption among researchers studying single tumor cell dynamics in live imaging and inspired by previous work on democratizing advanced image analysis26,29,30, we designed BEHAV3D-TP as a modular Jupyter Notebook featuring an intuitive graphical user interface (GUI) (Figure 1 and Supplementary Video 1). The platform runs directly in a web browser and requires only a Google account for access. BEHAV3D-TP implementation within the Google Colaboratory (Colab) framework not only ensures efficient cloud-based computation with free and scalable resources but also enhances tool accessibility by eliminating the need for local software installation, a common barrier for inexperienced users. Regardless of programming proficiency, users can navigate the computational pipeline to extract comprehensive insights into tumor dynamics (Figure 1). After time-lapse image file processing and preparation using various frameworks (Figure 1a), the central component of BEHAV3D-TP — called the heterogeneity module (Figure 1b) — enables researchers to uncover diverse patterns of tumor morphodynamic behavior. Additionally, we provide two extension modules—the large-scale phenotyping module (Figure 1c) and the small-scale phenotyping module (Figure 1d)— which integrate tumor cell behavior identified with the heterogeneity module with TME features based on different data types. The large-scale phenotyping module uses post-IVM fixed imaging data for tissue phenotyping, identifying extensive regions with specific TME characteristics, and assessing the distribution of distinct tumor cell behavioral patterns within these regions. The small-scale phenotyping module uses in situ-labelled TME structures from IVM data, facilitating the correlation of these TME features within the microenvironment of individual tumor cell neighborhoods. Both modules, in conjunction with the heterogeneity module, help to identify how different aspects of the TME influence distinct behavioral patterns of tumor cells.
To evaluate the capability of the BEHAV3D-TP heterogeneity module in identifying diverse morphodynamic cell patterns, we applied it to IVM datasets from various tumor and healthy models. The datasets, processed with different segmentation and tracking tools, were analyzed for multivariate similarities in morphological and dynamic features (summarized in Table 1) using the dynamic time warping algorithm21.
As an initial benchmark, we analyzed a previously published IVM dataset of two migratory and metastatic breast cancer cell lines (4T1 and MDA-MB231), tracked in 2D using the MTrackJ Fiji plugin (Supplementary Figure 1a) 15. BEHAV3D-TP provided a more granular characterization of these behaviors, uncovering additional migratory patterns not reported in the original study (Supplementary Figure 1b-c). Specifically, we identified behaviors such as Fast, Intermediate, Very slow and Static that had a different distribution among both tumor cell lines (Supplementary Figure 1d-e).
To further assess the versatility of BEHAV3D-TP, we applied it to 2D IVM data of terminal end buds (TEB) from healthy mammary gland tissue31. This dataset features confetti-labeled epithelial cell types and was analyzed using maximum intensity projections of multiple z planes showing cell morphology changes. As described in the original publication31 cell segmentation was performed with Cellpose 2.032 within the MaSCOT-AI workflow, followed by tracking using the TrackMate plugin in Fiji. This workflow not only confirmed the compatibility of BEHAV3D-TP with advanced segmentation frameworks but also its usage to unravel distinct morphodynamic patterns in non-tumor epithelial cells (Supplementary Figure 2b,c). Consistent with previous findings that HR+ TEB (Pr-cre/Confetti) exhibit greater migratory capacity than HR-TEB (Elf5-rtTA/TetO-Cre/Confetti), our analysis suggests that this difference is primarily driven by a distinct morphodynamic behavior (Supplementary Figure 2 c,d). Specifically, HR+ TEB more frequently exhibited characteristics of Cluster 2, defined by a rounder shape and increased motility. Despite the small sample size requiring further validation, these results demonstrate BEHAV3D-TP’s ability to uncover complex, multiparametric cellular behaviors that are often missed in analyses focused on single-value comparisons across conditions.
We next tested BEHAV3D-TP with a 3D image processing pipeline applied to IVM data from adult glioma (GBM) 7. In this case, cells were segmented using μSAM33, a deep-learning foundation model adapted for microscopy data (Segment Anything for Microscopy), and subsequently tracked with TrackMate27 Fiji plugin (Supplementary Figure 3a). BEHAV3D-TP identified distinct GBM morphodynamic patterns, each characterized by unique combinations of morphological and dynamic features and associated with specific spatial distributions (Supplementary Figure 3b-d). Cluster 1, consisting of large and slow-moving cells, was more isolated and located farther from neighboring cells compared to Cluster 6 (small, fast, persistent cells) and Cluster 4 (very small, static cells). These findings suggest that the compact spatial arrangement of small cells within the tumor may contribute to their reduced size.
Collectively, these findings underscore the versatility and broad applicability of BEHAV3D-TP across diverse biological systems, dimensionalities (2D and 3D), imaging modalities, and data processing pipelines, supporting its utility as a robust tool for the in-depth analysis of cellular behavioral patterns in IVM data.
Identification of highly heterogeneous in vivo cell behavior displayed by DMGs
We then applied our platform to get insights into the behavioral heterogeneity among pediatric DMG tumors, characterized by a highly invasive nature. We implanted mice with patient derived DMG cells expressing H2BmNeonGreen marker and performed IVM for up to 5.4 hours upon tumor development (Figure supplement 4a). We tracked intravitally imaged DMG cells from different mice using Imaris, a commercial software a widely adapted by the IVM community34–40 for its intuitive 3D visualization and analysis capabilities. In each imaged position, we evaluated not only the dynamic characteristics of individual DMG cells but also their spatial relationship to the tumor edge, which was delineated using Imaris Surface module (Figure 2a, see Methods). Next, to untangle the complexity of tumor cell dynamics in an unbiased manner, we used the BEHAV3D-TP heterogeneity module, implementing multiparametric single-cell time-series classification to identify distinct single-cell behavioral patterns (Figure 2 a, b). For this, we used kinetic parameters, including displacement, speed, persistence, and movement direction relative to the tumor edge (Table 1), followed by dimensionality reduction to classify cells. The BEHAV3D-TP heterogeneity module identified 7 DMG behavioral clusters: retreating, slow retreating, erratic, static, slow, slow invading, and invading (Figure 2b, c, d, Supplementary video 2). To accurately describe each of the clusters, we analyzed their most predominant features (Figure 2d) and back-projected the cluster information into the original time-lapse to visually inspect cell behavior in relation to the tumor (Figure 2a, c, Figure supplement 4b, Supplementary video 2). Of particular interest were cells from the invading and retreating clusters, characterized by fast movement away from and towards the tumor edge, respectively (Figure 2c-f, and Figure supplement 4c). In fact, in this particular DMG model, approximately 10% of the cancer cells were displaying invasive behavior (Figure supplement 4d), in line with the intrinsic infiltrative nature of DMG41. Interestingly, about another 10% of DMG cells were moving back to the tumor edge (retreating, slow retreating clusters) (Figure supplement 4d), behavior that has been previously observed for glioblastoma and suggested to be regulated by differential chemotactic signaling by the tumor edge and the surrounding brain parenchyma7. We also observed erratic cells that display fast non-directed migration behavior, and static cells that are non-migratory (Figure 2c-f). Crucially, the distinct behavioral patterns were detected in all intravitally imaged mice (Figure supplement 4d), ruling out any sample bias that might lead to clusters consisting solely of cells from a single tumor or mouse. This underscores the effectiveness of the BEHAV3D-TP in revealing representative heterogeneous tumor behavioral patterns.

Behavioral profiling of DMG cells with BEHAV3D-TP heterogeneity module.
a, Representative intravitally imaged position showing DMG cells tracked relative to tumor Edge (left panel). Tracks were classified according to DMG behavior (right, color coded by cluster). Representative of n = 18 independent positions from n=6 mice. b, UMAP plot showing seven color-coded DMG cell behavioral clusters identified by BEHAV3D-TP. Each datapoint represents one DMG cell track. A total of 981 individual cells were tracked in n = 18 independent positions from n=6 mice. c, Representative intravitally imaged positions and enlarged sections for showcasing distinct DMG behavioral clusters Invading (yellow), Retreating (green), Erratic (dark purple) and Static (light purple) through the time series. n = 18 independent positions from n=6 mice. Scale bars 10µm. d, Heatmap depicting relative values of DMG cell features indicated for each cluster, named according to their most distinct characteristics. Arbitrary units in respect to maximal and minimal values for each feature. See Table 1 for features description. Bubble size according to significance levels, all features represented have a significance level of P < 0.001 (***): mean_displ2, mean squared displacement; speed; delta displacement; displacement length; persistence; invasion. P-values represent the significance of differences across clusters tested through ANOVA for each feature. e, f, UMAP representation of DMG cells’ velocity relative to the tumor edge(µm) (e) and speed (µm/h) (f). Each datapoint represents one cell track and is colored following a color gradient. For each feature colors represent the mean DMG track values. Representative of n = 18 independent positions from n=6 mice.
Mapping in vivo tumor cell migratory properties to distinct TME regions identified through ex vivo large-scale 3D imaging
To investigate whether the TME influences behavioral heterogeneity among cancer cells, we developed two complementary approaches to correlate the identified behavioral clusters (Figure 2) to the composition of the TME (Figures 1c, 3a and 4a).

Mapping distinct DMG behavioral patterns to distinct TME regions.
a, Overview of the large-scale TME region phenotyping workflow. After IVM imaging session, the tissue is fixed and stained and then analyzed using mLSR-3D. CytoMAP Spatial Analysis Toolbox is used to identify distinct large-scale regions, that are subsequently matched to IVM imaging dataset (c). b, Representative fixed multispectral image of a mLSR3D imaged DMG tumor and zoomed-in images of TME large-scale regions: Void (blue outline), TAMM/vascularized (red outline) and TAMM/Oligo (yellow outline). DMG nuclei (blue), CD31 (pink), Olig2 (purple), and Iba1 (yellow) are represented on the imaged. Scale bars, 100 µm (overview), 30 µm (zoomed-in regions). c, 3D multispectral image DMG cell rendering color-coded per large TME region: Void (blue), TAMM/Oligo (yellow) and TAMM/vascularized (red) (left). Based on the spatial coordinates of DMG cells classified into specific TME regions by CytoMAP, cells within the mLSR-3D images were subsequently assigned to their respective TME regions. Regions were then visually mapped on intravital imaging data (right). Representative of n=6 mice. White outline indicates one of the tumor regions analyzed with BEHAV3D-TP from the full tumor volume. d Boxplots showing the frequencies of different DMG behavioral clusters in Void, TAMM/Oligo and TAMM/vascularized TME large-scale regions. For each behavioral cluster, the y-axis displays the z-scored percentage of cells, normalized per mouse to account for inter-mouse variability. Each point represents an individual imaged position, with shape indicating the mouse of origin. P-values represent the significance of differences across TME regions tested through ANOVA with Tukey post hoc, for each behavioral cluster. n = 18 independent positions from n=6 mice.

The BEHAV3D-TP small-scale phenotyping correlates DMG behavioral profiles with microenvironmental composition at a single-cell resolution.
a, Overview of the small-scale TME phenotyping module. During IVM imaging, information about spatial distribution of SR101+, CD20r+, and CD31+ cells is collected and processed by the BEHAV3D-TP small-scale phenotyping module. Single DMG cell spatial TME features like distance to its neighbors, number of cells in a radius or minimal distance to a cell type were measured. b, Heatmap depicting DMG cell small-scale niches’ features across distinct DMG behavioral clusters. Arbitrary units in respect to maximal and minimal values for each feature. Bubble size according to significance levels, from smallest (P < 0.05 (**)) to medium (P < 0.01 (**)) to biggest (P < 0.001 (***)): dist_10_cell, Distance to nearest 10 cells, P < 0.01 (**); n_SR101, number of SR101 cells, P < 0.05 (*); min_SR101, minimal distance to a SR101 cell, P < 0.05 (*); n_CD20r, number of CD20r cells, P < 0.05 (*); min_Cd20r, minimal distance to a CD20r cell, P < 0.01 (**); min_BV_dist, minimal distance to a Blood vessel, P < 0.001 (***). P-values represent the significance of differences across clusters tested through ANOVA for each feature. c, e, Boxplot depicting the Minimal distance to a CD20r+ TAMM (µm) (c) and the Minimal distance to a blood vessel (µm) (e) across DMG behavioral clusters. Each point represents an individual tracked cell, color depicts the imaged position and shape denotes the mouse. P-values represent the significance of differences across behavioral clusters tested through ANOVA with Tukey’s post hoc. P < 0.01 (**);P < 0.05 (*).P < 0.001 (***); P < 0.1 (·). c, n = 10 independent positions from n=3 mice. e, n = 8 independent positions from n=3 mice. d, Multispectral image showing the movement of DMG cells (grey) relative to CD20r+ TAMM (blue) and the Tumor core. The trajectories show a path from the initial (blue) to the final position (red). Scale bar, 10 µm. f, Time lapse multispectral images (left to right) showing the DMG cells (blue) displacement along CD31 blood vessel (purple) away from the tumor edge. Scale bars, 30 µm.
The first approach consists of performing large-scale TME phenotyping and identifying regions with a specific cellular composition and architecture within the TME of intravitally imaged tumors that were subsequently fixed. This is accomplished by using multispectral large-scale single-cell resolution 3D (mLSR-3D) imaging data42,43 and a spatial analysis framework called CytoMAP44 (Figure 3a). We selected microenvironmental components of interest, such as perivascular niches and glial cells, as they have been previously reported to play an important role in the invasive behavior of glioblastoma cells7,45–49. Specifically, intravitally imaged brains were collected immediately after the IVM imaging sessions and were fixed and stained for blood vessels (CD31), oligodendrocytes (Olig2), and tumor-associated microglia/macrophages (TAMM) (Iba1) (Figure 3b). Subsequent CytoMAP44 spatial phenotyping analysis identified three different environmental niches: Void regions (less vascularized and with low glial infiltration), TAMM/oligo regions (enriched in oligodendrocytes, TAMM, and tumor cells), and TAMM/vascularized regions (highly vascularized regions enriched in TAMM) (Figure 3b, and Figure supplement 5a-c). To investigate the heterogeneity of tumor cell behavior in relation to the identified microenvironmental niches, BEHAV3D-TP large-scale phenotyping module mapped the different niches (Void, TAMM/Oligo, and TAMM/vascularized) identified by CytoMAP onto 3D intravital imaging data (Figures 1c, 3c). In the TME-defined IVM-imaged positions we compared the frequencies of the different behavioral clusters that we identified with the BEHAV3D-TP heterogeneity module (Figure 3d). Interestingly, invading cells were more abundant in TAMM/vascularized regions compared to Void regions that contain a higher proportion of static cells, and TAMM/Oligo microenvironments contain more slow retreating cells compared to the other regions (Figure 3d, Figure supplement 5d). Finally, we compared the results obtained with BEHAV3D-TP to a more classical IVM analysis approach that relies on assessing single dynamic parameters. Interestingly, single parameters showed a restricted ability to identify differences in cellular behavior among various environments (Figure supplement 5e-g), underscoring the importance of multiparametric behavioral mapping in revealing more nuanced cellular behavior that cannot be captured solely by individual dynamic parameters.
Linkage of in vivo tumor cell behavior to the composition of the microenvironment at a single-cell level
With the goal of further refining TME phenotyping to better understand tumor cell behavior determinants, we implemented an alternative approach using the BEHAV3D-TP small-scale phenotyping module (Figure 1d, 4a). This module utilizes the detection of TME components during IVM to offer insights into their abundance and spatial relationship with DMG cells at a single-cell level. Together with the heterogeneity module that profiles the single-cell behavior of tumor cells (Figure 1), this additional module allows linking different DMG behavioral profiles with DMG cell small-scale niches (Figures 1d, 4a). For in vivo TME labeling, we injected mice with an anti-CD31-AF647 antibody to label blood vessels, and with either SR101, a fluorescent marker known to label oligodendrocytes and astrocytes 50–53, or CD20r, a novel molecule described to label microglial cells 54 (Figure supplement 6a, b). This allowed us to measure spatial TME characteristics of each single DMG cell, such as minimal distance to a certain TME component, the number of these cell types in a certain radius, or the cell density for this particular cell (Figure 1d). Interestingly, the BEHAV3D-TP small-scale phenotyping module revealed substantial TME heterogeneity across the different behavioral DMG clusters (Figure 4b). Compared to slow and slow-retreating cells, invading cells were usually found to be less densely positioned relative to other DMG cells (Figure 4b, and Figure supplement 6c), correlating with their invasive potential into the brain parenchyma. In line with the data from the large-scale TME phenotyping (Figure 3), our data suggests that invading DMG cells reside in a local environment that is enriched in TAMMs (Figure 4b). Indeed, invading cells are closer to TAMMs compared to erratic and slow migrating cells (Figure 4c), and move directionally towards TAMMs (Figure 4d, Supplementary video 3), suggesting that migration of this behavioral cluster is at least partially mediated by chemotaxis. Furthermore, all fast-migrating behavioral clusters (invading, erratic, and retreating) were found to be generally closer to blood vessels (Figure 4b and e), suggesting that perivascular invasion is a more efficient movement route for these cells (Figure 4f), a mode of migration that has been previously observed for adult glioblastoma cells as well 7,45,47–49. Lastly, particularly slow-retreating DMG cells were found in regions enriched for SR101+ cells (Figure 4b and Figure supplement 6d), perhaps reflecting oligodendrocyte-like (OC-like) tumor DMG cells that have been found near oligodendrocytes 55. Altogether, these data demonstrate the power of our BEHAV3D-TP pipeline in correlating single-cell tumor cell behavior to its local environment, with an important opportunity to identify novel environmental regulators of invasion.
Discussion
Here, we provide a new user-friendly platform tailored for IVM single tumor cell dynamics analysis, termed BEHAV3D-TP, aiming to better understand the mechanisms underlying tumor heterogeneity. In contrast to traditional pipelines that rely on the analysis of single parameters such as cell speed or displacement56–58 or that use an artificial threshold to assign a specific behavior to cells10, BEHAV3D-TP is an unbiased approach based on the integration of multiple parameters measured by IVM. Using the heterogeneity module of our BEHAV3D-TP pipeline, we uncovered behavioral phenotypes that have not been described before and that could not have been identified using single parameter analysis. For example, our analysis revealed invading and retreating clusters, composed of cells with a similar cell speed but with an opposite migration direction, an important biological and clinical difference. Likely, bidirectional migration is mediated by different chemotactic cues and by the composition of the local TME59. It is of vital importance for DMG and other cancer patients to better understand the biology underlying the different behavioral phenotypes, especially concerning invading cells that are difficult to therapeutically target 60.
Previous studies suggest a major role for the microenvironment in promoting tumor cell spread into the healthy brain 61–63. Indeed, using the complementary large- and small-scale TME phenotyping modules of BEHAV3D-TP, we identified substantial differences in the TME composition of the different behavioral DMG clusters. Our results also show that the small-scale TME analysis has a higher predictive value compared to the large-scale TME analysis, suggesting that a cell’s direct microenvironment is a more important regulator of its behavior compared to its macroenvironment. Future experiments directed towards identifying more TME components, for example using multispectral LSR-3D imaging42, could therefore further refine the large-scale phenotyping module by detecting subregion heterogeneity.
IVM enables simultaneous labeling of various TME components and allows real-time investigation of their association with tumor cell behavior. Indeed, we found that TAMMs and blood vessels were associated with specific behavioral phenotypes, showing the power of BEHAV3D-TP small-scale phenotyping module in identifying novel regulators of cellular behavior. This is exemplified by our finding that slow-retreating DMG cells were found in environments enriched for SR101+ cells, an observation that has not been made before. To take further advantage of BEHAV3D-TP, future work should be directed toward identifying more TME components, including cells of the adaptive immune system. For example, it would be interesting to use our pipeline on recently developed immunocompetent mouse models of DMG64,65, or in mice with a humanized immune system66. While our findings suggest that microenvironmental factors may influence tumor cell migration, further studies will be necessary to establish causal relationships. Additional experimental validation, such as macrophage ablation experiments, could help clarify the specific contributions of these factors.
While our current study does not provide direct functional validation of the distinct motility clusters identified, existing literature strongly supports the notion that cell dynamics can serve as a proxy for functional states and phenotypic heterogeneity. Prior work, including studies by our group19,67 as well as Crainiciuc et al.36 and Freckmann et al.20, has demonstrated that variations in cell motility patterns can reflect underlying functional characteristics. Specifically, cell morpho-dynamic features have been shown to correlate with differences in cell type identity, T-cell engagement, metastatic potential, and drug resistance states. This growing body of evidence suggests that tumor cell behavior, as captured by BEHAV3D-TP, may serve as a predictive tool for deciphering functional tumor heterogeneity. Future studies integrating transcriptomic or proteomic profiling of motility-defined subpopulations could further elucidate the biological significance of these behavioral phenotypes.
In addition to motility-based classification, features such as tumor cell morphology, proliferation state, and interactions with the tumor microenvironment can further refine tumor phenotyping. BEHAV3D-TP allows for the selection of diverse feature types, supporting datasets that include both dynamic, morphological and spatial parameters. However, we recognize that expanding the feature set may introduce biologically irrelevant noise, particularly in 3D microscopy data where limited z-axis resolution can lead to morphological artifacts. This highlights the potential need in the future to include unbiased feature selection strategies, such as bootstrapping methods68, to ensure the identification of meaningful and biologically relevant parameters. Careful consideration of these aspects is key to maximizing the interpretability and predictive value of analyses performed with BEHAV3D-TP.
To enhance the accessibility of BEHAV3D-TP for researchers keen on studying tumor cell behavioral profiles through live imaging, we have incorporated our software in a Google Colab notebook, allowing researchers with minimal programming skills to employ the tool online without the requirement to install specific software environments nor the need to directly interact with the code. The user can easily install the necessary dependencies, set up the working environment, process datasets and adjust parameters without requiring deep coding skills. Google Colab provides the necessary computational resources to be able to run the pipeline without demanding a powerful local machine. However, there are RAM usage and runtime limitations that could affect the analysis, given a big enough dataset in the free version of Google Colab. Given this and data privacy concerns, the workflow can also be run locally via a Jupyter Notebook, that can be downloaded from the Google Colab notebook. Aligned with the goals of BEHAV3D-TP, other methods utilizing the Google Colab framework are emerging, such as CellTracksColab29, which is a general tool for tracking data analysis. While CellTracksColab offers valuable insights into tracking data, BEHAV3D-TP is specifically designed for IVM data and includes additional features. These features include directionality metrics crucial for invasion studies, detailed analysis of identified behavioral populations, data back-projection, and correlation of these behaviors with both large-scale and small-scale TME features. This comprehensive approach provides a deeper understanding of the TME drivers behind intratumoral heterogeneity, making BEHAV3D-TP a robust tool for researchers investigating the complex behaviors of tumor cells in their natural environments. BEHAV3D-TP supports a broad range of data formats, including those generated by commercial Imaris and by open-source Fiji plugins such as TrackMate, MTrackJ, and ManualTracking, increasing the tool’s applicability to researchers using both commercial and open-source pipelines.
In summary, BEHAV3D-TP allows to get insights into the heterogeneity of tumor cell migration behavior in an accessible way; however, it would be exciting to extend the application to other behaviors, such as cell division or therapy response to study TME-mediated drug resistance.
Methods
Animal material
NOD.Cg-PrkdcscidIl2rgtm1Wjl/SzJ (NSG) mice were purchased from Charles River Laboratories (France). Experiments were conducted per Institutional Guidelines under acquired permission from the local Ethical Committee and as per current Dutch laws on Animal Experimentation. Mice were housed under sterile conditions using an individually ventilated cage (IVC) system and were fed with sterile food and water.
Human DMG sphere-forming culture
DMG007 (HSJD-DIPG-007) cells established from primary DMG material were grown in a base medium (TSM) consisting of 48% DMEM/F12 and 48% Neurobasal medium (Thermo Fisher) supplemented with GlutaMAX, 100mM Sodium Pyruvate, MEM non-essential amino acids and 1M Hepes buffer, at 1% each. Primocin (InvivoGen) at 50mg/ml was additionally added to the TSM. Working medium was prepared by adding 20ng/ml of human EGF and human basic FGF, 10ng/ml of PDGF-AA and PDGF-BB (Peprotech) and 2ug/ml of Heparin (StemCell Technologies). DMG cells were cultured at 37 °C in a humidified atmosphere with 5% CO2.
Fluorescent reporter cloning and lentiviral transduction
Fluorescent reporter construct was based on the combination of Histone2B-mNeonGreen, P2A and mScarlet I-CAAX gifted from Dr. Hugo Snippert (UMC Utrecht, The Netherlands), and inserted by In-Fusion HD Cloning Plus (Takarabio) into a lentiviral vector including cPPT/CTS, WPRE, an EF1a promoter and IRES-puromycin-resistance cassette11. Subsequently the above-mentioned elements were amplified by PCR and the amplicon was assembled in the final lentiviral backbone using Gibson Assembly (NEB). Sequences were validated using Sanger sequencing. DMG007 cells were transduced using a standard lentiviral transduction protocol and selected using puromycin to achieve a stable cell line.
Cranial imaging window (CIW) surgery and tumor cell injection
CIW surgery and tumor cell injection were performed on the same day as previously described 7,10. Briefly, mice were sedated with Hypnorm (Fluanison [neuroleptic] + Fentanyl [opioid]) (0.4 ml/kg) + Midazolam [benzodiazepine sedative] (2 mg/kg) at a dose of 1:1:2 in sterile water and mounted in a stereotactic frame. The head was secured using a nose clamp and two custom-made 3D printed ear bars, made out of Polylactic Acid (PLA, Geeetech, 700-001-043). The head was shaved, and the skin was cut circularly. The mouse was placed under a stereo-microscope to ensure precise surgical manipulation. The periosteum was scraped, and a circular groove of 5 mm diameter was drilled over the right parietal bone. The bone flap was lifted under a drop of cortex buffer (125 mM NaCl, 5 mM KCl, 10 mM glucose, 10 mM HEPES buffer, 2 mM MgSO4, and 2 mM CaCl2, pH 7.4), and the dura mater was removed. Gelfoam sponge (Pfizer) was used to stop potential bleedings. Next, 1 × 105 DMG007-H2B-mNeonGreen cells resuspended in 3 μl phosphate-buffered saline (PBS) were injected stereotactically using a 5 μl Hamilton syringe with a 2 pt style in the middle of the craniotomy at a depth of 0.5 mm. The exposed brain was sealed with silicone oil and a 6 mm coverslip was glued on top. Dental acrylic cement (Vertex) was applied on the skull surface, covering the edge of the coverslip, and a custom-made 3D printed ring made of biocompatible Polylactide acid (PLA, Geeetech, 700-001-0433) was glued around the coverslip to provide fixation during intravital imaging and to serve as a reservoir for a water drop required for the objective of the microscope. A single dose of 100 μg/kg of buprenorphine (Temgesic, BD pharmaceutical limited) was administered for post-surgical pain relief. Mice were closely monitored twice per week to assess behavior, reactivity, and appearance.
Intravital imaging
For DMG IVM imaging mice were intravitally imaged as previously described 7,10. In short, mice were sedated with isoflurane and placed face-down in a stereotactic frame. The Polylactide ring was used to fix the mouse’s head to the frame with custom-made Polylactide bars. Time-lapse images of the entire tumor volume were acquired for a maximum of 5.4 hours. The minimal time interval between serial images was set to 20 minutes. For tile scans, images of the complete z-stack of the tumor were acquired, with a step size of 2 µm. In a group of 3 mice, oligodendrocytes and astrocytes were imaged by an intravenous injection of 50 µL SR101 (Thermofisher) at a concentration of 5 mM dissolved in PBS. In a different group of 3 mice, TAMMs were imaged by intravenous injection of 50 μL 100 µM CDr2054. Simultaneously with the injection of either SR101 or CDr20, all mice received an intravenous injection of 10 ul CD31-AF647 antibody (ThermoFisher, A14716) to visualize the blood vessels.
Intravital imaging was performed on an upright FVMPE-RS multiphoton microscope (Olympus) equipped with a MaiTai DeepSee and an InSight DeepSee laser (Spectra-Physics), a 25x/1.05 numerical aperture water objective, and two GaAsP and two Multialkali photomultiplier tubes (Olympus). Images were acquired with simultaneous imaging with the MaiTai (960 nm) and Insight (1100 nm) lasers. Green, red, and far-red fluorescence was separated by 570 nm and 650 nm dichroic mirrors, and 610/70 nm and 705/90 nm filters (Semrock) and collected by GaAsP or Multialkali photomultiplier tubes. Scanning was performed in a bidirectional mode with a resonant scanner at 400 Hz and 12 bit, with a zoom of 1x, 512 × 512 pixels. For optimal detection of blood vessels (CD31-AF647), a single tile scan was made at the last timepoint with Insight laser tuned at 1250 nm. At the postprocessing step, this image was co-registered to the time-lapse movie.
Breast tumor IVM imaging was performed as described before15 and data was kindly provided by Dr. Nienke Vrisekoop. GBM IVM imaging was performed as described before7 and data was kindly provided by Prof. Jacco van Rheenen. Breast epithelial IVM imaging and cell tracking with MaSCOT-AI was performed as described before31 and single cell tracks were downloaded from Zenodo repository (14503476).
Co-registration of IVM imaged blood vessel imaging
CD31-AF647 tile scan featuring optimal visualization of blood vessels during live imaging was co-registered to the last timepoint of the time-lapse movie. Both images (last timepoint of time-lapse tile-scan and blood vessel tile-scan) were visually inspected to determine and annotate the internal landmarks using Imaris (Oxford Instruments), versions 9.5 to 9.6. These landmarks served as a reference for the co-registration software to overlap both images. To perform the co-registration, a modification of elastix69 was used; a python-based open-source software based on Insight Segmentation and Registration Toolkit (ITK) plus SimpleElastix70: a collection of different algorithms used on medical image registration. Due to the extensive number of potential parameter combinations, specific parameters were manually chosen. This selection was conducted using the Slicer3D visualization software, version 5.2.2.
Immunohistochemistry
3D immunohistochemistry was performed as described before 43. After the live imaging session, mouse brains were immersed in 5 ml 4% paraformaldehyde (PFA) pH 7.4 overnight on ice. After fixation, brains were blocked in 5-10 ml Wash Buffer 1 (2 ml Tween-20, 2 ml Triton X-100, 2 ml 10% SDS, and 2 g BSA in 1 l PBS) for 5 hours. For multiplex immunolabeling, a two- or three-round staining protocol was used as previously described42,43. Washing and incubation steps were performed in Wash Buffer 2 (1 ml Triton X-100, 2 ml 10% SDS, and 2 g BSA in 1 l PBS). A thick (1 mm) slice of the cortex part that was under the cranial imaging window was dissected with a scalpel before proceeding to immunolabeling. The following primary antibodies were used: rabbit anti-Olig2 1:100 (AB9610, Merk), goat anti-Iba1 1:200 (NB100-1028SS, NovusBio) and CD31-AF647 1:250 (A14716, ThermoFisher). As secondary antibodies, donkey anti-rabbit AF405 1:250 (ab175651, Abcam) and donkey anti-goat AF633 1:250 (A21082, ThermoFisher) were used. After the last washing step, tissues were optically cleared by three stepwise incubations of an increasing concentration of FUnGI71 clearing agent (25%/50%/75%, diluted in PBS) for 1h at room temperature42. The final incubation step with 100% FUnGI was performed overnight at 4°C.
mLSR3D imaging
mLSR3D imaging42,43 of thick slices of fixed mouse cortex was performed using a Zeiss LSM880 system equipped with a 32-channel spectral detector. The signal from all fluorophores present in the samples was collected in a single acquisition and linear unmixing was used to obtain separate channels. Unmixing was carried out by the Online Fingerprinting mode of the microscope. Pre-acquired references of each single fluorophore were used to enable multispectral on-the-fly unmixing. Imaging was performed using a 25x multi-immersion objective 0.8 NA (Zeiss 420852-9871) with a working distance of 570µm. Tile scans were acquired using a voxel size of 0.332×0.332×1.200 µm, a pixel dwell of 2µs, and a 10% tile overlap.
Imaris image processing
DMG IVM datasets were processed using Imaris software (Oxford Instruments, versions 9.5 to 10.1) for 3D visualization, shift correction, object rendering, and cell tracking of time-lapse movies.
Imaris Cell tracking
The Channel Arithmetics Xtension was used for channel unmixing of overlapping signals. The Spots ImarisTrack module was used for object detection and semi-automated tracking of tumor cells (autoregressive motion). Tumor cell tracks were manually corrected to ensure accurate tracking. Around 50-100 cells per position were manually corrected and labeled as such for posterior selection of accurate tracks. To determine the direction of tumor cell movement relative to the tumor core, at the image edge closer to the tumor core a “Tumor edge” surface object was manually rendered using the contour tool. The Distance Transformation Xtension was used to measure the distance between tumor cells and the “Tumor edge”. For tracked tumor cells, time-lapse data containing the coordinates of each cell, the values of cell speed, mean square displacement, displacement delta length, displacement length, and distance to “Tumor edge” were exported. See https://qbi.uq.edu.au/files/40820/ImarisManual.pdf for statistical details.
Imaris Microenvironmental factors rendering
For rendering the microenvironmental factors detected during IVM or by post-IVM LSR-3D imaging, the Surface and Spots modules of Imaris were used. Surfaces were used for the SR101, CDr20, Olig2, DAPI, and Iba1 stainings, and Spots were used for CD31+ protruding or elongated structures, as previously described 44. For rendered structures, positional data containing the coordinates of objects were exported for large-scale spatial phenotyping with Cytomap.
Fiji image processing
μSAM cell segmentation
Segmentation was performed using the μSAM plugin for Napari33, where vit-b model was selected to compute embeddings for each timeframe. Automatic segmentation was applied, and parameters were adjusted for optimal results. Manual corrections were made to remove unwanted surfaces or add missing cells. Once segmentation was complete, frames were combined into a single stack in ImageJ and tracked with Trackmate.
Fiji tracking
Breast tumor IVM data was manually tracked with Fiji MtrackJ plugin as previously described10,15.
Adult glioma cells, segmented with μSAM, were consequently tracked with Fiji TrackMate plugin. The labeled image stack, segmented using μSAM, was imported into ImageJ for cell tracking with the Fiji TrackMate plugin. The “Label Image Detector” was employed to identify individual cells, and the LAP Tracker was used to link cells across timeframes. Tracking parameters were optimized to account for missing frames and ensure accurate cell trajectories. The statistics for each tracked cell were subsequently exported. To integrate both dynamic and morphological data, a custom script was developed to merge the dynamic information from TrackMate with the morphological data obtained from the μSAM segmentation labels for each individual cell. This integration was achieved by assigning the “TRACK_ID” from the TrackMate “allspots” output file to each segmented instance extracted from the TIFF file. The assignment was performed using the “measure” function in scikit-image and the KDTree distance function from the scipy module, based on the x, y, and z positions of the cells.
The script is available both as a downloadable version on GitHub (https://github.com/imAIgene-Dream3D/MorphoTrack-merger) and as an online application (https://morphotrack-merger.streamlit.app/), making this tool more accessible for non-coding users.
Tumor large-scale spatial phenotyping with Cytomap
The positional data of various environmental surface features, segmented from LSR-3D imaging data, was analyzed for large-scale spatial phenotyping using the Cytomap Spatial Analysis Toolbox44. Briefly, neighborhoods with a 100 µm radius were generated. Neighborhoods were then clustered into 2 regions based on DMG cell positioning using the David Balwin algorithm. Using the gating tool, the tumor regions (containing DMG objects) were defined. Next, the neighborhoods were clustered again into 3 different regions based on the distribution of Iba1, Olig2, and CD31: Void, TAMM/Oligo, and TAMM/vascularized. By using the Manually Defined Regions option, only the tumor region was classified. Finally, for each region, fold-change values were calculated and exported using the Region Statistics tab. To map the assigned regions onto IVM movies, a 3D image of the cluster distribution within the tumor was generated and exported for each sample (Figure Supplement 5a). Next, regions within the IVM movies were visually matched to the corresponding regions identified by the Large-Scale Phenotyping module of Cytomap (Figure 3c). For each mouse, at least one or two representative positions per matched region type were selected, cropped, and analyzed to assess tumor cell behavior, following the previously described cell tracking methodology (Imaris Cell tracking).
BEHAV3D Tumor Profiler framework
BEHAV3D-TP was developed using the R Studio version 4.3.3. It features three modules: 1) Heterogeneity module with optional 2) Large-scale and/or 3) Small-scale phenotyping module. These modules are described in detail below, exemplified by the analysis of DMG data from this study. All of the modules are included in the same script available in Github [https://github.com/imAIgene-Dream3D/BEHAV3D_Tumor_Profiler], but can be run independently from one another. To acquire this independency, the optional modules are directly combined to the necessary sections of the Heterogeneity module. Consequently, the user can use whichever module is best suited for their purposes. The complete workflow— combining heterogeneity analysis with large- and small-scale phenotyping—is primarily optimized for datasets processed with Imaris due to its wide use in the IVM community and special suitability for 3D visualization and tracking. In order to further facilitate public access to the BEHAV3D-TP, a Google Colab notebook has also been created accessible through the same Github page [https://github.com/imAIgene-Dream3D/BEHAV3D_Tumor_Profiler]. This environment is friendly to anyone regardless of their coding expertise as it has a step-by-step follow-through execution through the pipeline.
In addition, to broaden accessibility and support alternative data processing pipelines, the core Heterogeneity module of BEHAV3D-TP is also compatible with Fiji-based tracking data, specifically outputs generated by TrackMate. MTrackJ and ManualTracking. A separate Google Colab notebook is provided for these workflows on the Github page, allowing users to easily import Fiji-processed datasets, adjust analysis parameters, identify different morpho-dynamic single cell patterns.
A Wiki demo run and a video tutorial (Supplementary Video 1) are also provided through the GitHub page [https://github.com/imAIgene-Dream3D/BEHAV3D_Tumor_Profiler] for further clarification.
To ensure that your input data aligns with the workflow, we provide an online application for data quality control (https://github.com/alievakrash/BEHAV3D_TP_dataQC). This tool allows users to visualize various features, grouped by a condition of interest, and check for issues such as a high number of missing values (NA). It enables users to assess their data for any inconsistencies or unexpected patterns before proceeding with further analysis.
Heterogeneity module
To account for missing time points and to create a time series with the same time interval for each tumor cell time series, linear interpolation was used to estimate the values of missing time points. To compare time series independently, tracks were cropped to the minimal common length among all tracks. In the case of DMG data to a 2.6 hour duration. For tracked tumor cells, time-lapse data containing the coordinates of each cell, the values of cell speed, mean square displacement, displacement delta length, displacement length, and relative distance to “Tumor edge” were used to calculate a cross-distance matrix between time series. First, we performed a principal component (PC) analysis and selected the number of PCs that explained at least 90% of data variance (3).
The previously calculated PCs were then used to compute the cross-distance matrix between each tumor cell multivariate time series using the dynamic time warping algorithm from the package “dtwclust”. To visualize heterogenous tumor cell behaviors in 2 dimensions, dimensionality reduction on the cross-distance matrix was performed by the Uniform Manifold Approximation and Projection method (“umap” package). Clustering was performed using the k-means clustering algorithm. For each cluster, the average values of distinct behavioral and environmental components were calculated and plotted as a heatmap (“pheatmap”).
Large-scale phenotyping module
The information obtained from mLSR3D and Cytomap about large-scale TME regions were combined with the DMG cells behavioral information (see above section Tumor large-scale spatial phenotyping with Cytomap) to examine the large-scale features of tumor cells. For tumor cells, the mean speed, square displacement and raw movement were analyzed.
Small-scale phenotyping module
The positional coordinates of tracked tumor cells and detected microenvironmental factors were used to determine the small-scale landscape of tumor cells. For tumor cells, the average distance to the closest 10 neighbors was measured to determine tumor cell density. For each tumor cell and each environmental component, the number of microenvironmental objects in a 30-µm radius and the distance to the closest object were computed. For each behavioral cluster, the values of closest neighbors, minimal distance to each environmental factor, and number of environmental objects in the 30 µm radius were plotted and compared.
Statistical analyses
Statistical analyses were performed using R. The representation of n may refer to individual mice, distinct imaging positions within different mice, or individual cell tracks, as indicated in the figure legends. Two-tailed unpaired t-tests were performed for comparison between two groups unless indicated otherwise (Figure supplement 1d). For comparisons of more than two groups we performed a one-way ANOVA (Figure 2d and Figure 4b) followed by Tukey HSD correction (Figure Supplement 4c (p values in legend), Figure 3d, Figure 4 c,e, Figure Supplement b, e-g, Figure Supplement 6 c,d). To compare the distribution of different morphodynamic clusters of TEB cells, we pooled all positions and mice due to the low number of cells per position. We then constructed a contingency table and performed a Chi-square test (Figure supplement 2d). To compare the distance to the nearest neighbors between morphodynamic clusters of GBM cells, a mixed-effects linear regression was performed with mouse as a random effect (Figure supplement 3d).
Data availability
DMG imaging data is publicly available at BioStudies accession number S-BIAD1759 (https://www.ebi.ac.uk/biostudies/studies/S-BIAD1759). Breast cancer IVM data was previously described15 and kindly provided by Dr Nienke Vrisekoop. Adult glioma IVM data was previously described7 and kindly provided by Prof. Jacco van Rhennen. Healthy breast epithelium IVM was previously described31 and kindly provided by Prof. Jane Visvader. Demo outputs and Jupyter notebooks of Imaris- and Fiji-processed data are provided in our GitHib repository (https://github.com/imAIgene-Dream3D/BEHAV3D_Tumor_Profiler).
Code availability
We provide the BEHAV3D-TP framework in a Google Colab user-friendly environment [https://colab.research.google.com/drive/1JI7ysqFf3tvdi6Df4YUsSZ8RbuXw8wba?usp=shari ng], as well as in an R script format in Github [https://github.com/imAIgene-Dream3D/BEHAV3D_Tumor_Profiler]. Additionally, a Wiki [https://github.com/imAIgene-Dream3D/BEHAV3D_Tumor_Profiler/wiki] to follow through a demo dataset as well as a video tutorial (Supplementary Video 1) has been developed for further assistance. For the BEHAV3D-TP heterogeneity module, we offer an online app to assess data quality (https://behav3d-tp-data-qc.streamlit.app/), with the corresponding code available on GitHub (https://github.com/alievakrash/BEHAV3D_TP_dataQC). Additionally, for quantifying morphological features derived from Microsam segmentation and integrating them with dynamic features from TrackMate, we provide another online app (https://morphotrack-merger.streamlit.app/) and related code on GitHub (https://github.com/imAIgene-Dream3D/MorphoTrack-merger).
Acknowledgements
We thank the Princess Máxima Center for Pediatric Oncology for technical support and the Hubrecht Institute, Zeiss and the Princess Maxima Imaging Center for imaging support and collaboration. We thank D. van Vuurden (Princess Máxima Center for Pediatric Oncology) and Dr. Ángel Montero Carcaboso (Sant Joan de Déu Barcelona Hospital) for providing primary DMG cultures; Dr Young-Tae Chang (Postech, Korea) for providing us the CD20r dye; Dr Nienke Vrisekoop for sharing breast cancer IVM data; Prof. Jacco van Rheenen and Wouter Beijk for sharing adult glioma IVM data; Prof Jane Visvader for sharing breast epithelial IVM data; Dr Colinda Scheele and Marcel Issler for sharing healthy breast IVM data (explored but not used in the current study); and members of the Dream3DLAB (Rios group) and imAIgene-lab (Alieva group) for offering critical feedback on the project. A.Z. was supported by a Veni fellowship from the Netherlands Organization for Scientific Research (09150161910076). R.C. and A.C.R were supported by an ERC-starting grant 2018 project (no. 804412). This work was produced with the support of a 2023 Leonardo Grant for Scientific Research and Cultural Creation, BBVA Foundation (LEO23-2-10305-BBM-BAS-144) and the V FERO-ASEICA Research Award (BFERO2024.04). M.A was supported by the Comunidad de Madrid (2022-T1/BMD-24021).
Additional files
References
- 1.Intratumoral heterogeneity in cancer progression and response to immunotherapyNat Med 27:212–224Google Scholar
- 2.Tumour heterogeneity and metastasis at single-cell resolutionNat. Cell Biol 20:1349–1360Google Scholar
- 3.Spatial profiling technologies illuminate the tumor microenvironmentCancer Cell 41:404–420Google Scholar
- 4.Intravital Insights into Heterogeneity, Metastasis, and Therapy ResponsesTrends Cancer 2:205–216Google Scholar
- 5.Intravital imaging to study cancer progression and metastasisNat. Rev. Cancer 23:25–42Google Scholar
- 6.Imaging windows for long-term intravital imagingIntraVital 3:e29917Google Scholar
- 7.Intravital imaging of glioma border morphology reveals distinctive cellular dynamics and contribution to tumor cell invasionSci. Rep 9:2054Google Scholar
- 8.Longitudinal Intravital Imaging of Brain Tumor Cell Behavior in Response to an Invasive Surgical BiopsyJ. Vis. Exp https://doi.org/10.3791/59278Google Scholar
- 9.Multimodal imaging of the dynamic brain tumor microenvironment during glioblastoma progression and in response to treatmentiScience 25:104570Google Scholar
- 10.Preventing inflammation inhibits biopsy-mediated changes in tumor cell behaviorSci. Rep 7:7529Google Scholar
- 11.Intravital FRET Imaging of Tumor Cell Viability and Mitosis during ChemotherapyPLoS ONE 8:e64029Google Scholar
- 12.Cranial imaging window implantation technique for longitudinal multimodal imaging of the brain environment in live miceSTAR Protoc 4:102197Google Scholar
- 13.Brief Report: Intravital Imaging of Cancer Stem Cell Plasticity in Mammary TumorsStem Cells 31:602–606Google Scholar
- 14.In Vivo Imaging Reveals Extracellular Vesicle-Mediated Phenocopying of Metastatic BehaviorCell 161:1046–1057Google Scholar
- 15.In vivo characteristics of human and mouse breast tumor cell linesExp. Cell Res 381:86–93Google Scholar
- 16.Cell Migration, Methods and ProtocolsMethods Mol. Biol. 1749:175–193Google Scholar
- 17.cellPLATO: an unsupervised method for identifying cell behaviour in heterogeneous cell trajectory dataJ. Cell Sci 137:jcs261887Google Scholar
- 18.Behavioural immune landscapes of inflammationNature 601:415–421Google Scholar
- 19.Uncovering the mode of action of engineered T cells in patient cancer organoidsNat. Biotechnol 41:60–69Google Scholar
- 20.Traject3d allows label-free identification of distinct co-occurring phenotypes within 3D culture by live imagingNat. Commun 13:5317Google Scholar
- 21.BEHAV3D: a 3D live imaging platform for comprehensive analysis of engineered T cell behavior and tumor responseNat. Protoc :1–33https://doi.org/10.1038/s41596-024-00972-6Google Scholar
- 22.Leukocyte Tracking Database, a collection of immune cell tracks from intravital 2-photon microscopy videosSci. Data 5:180129Google Scholar
- 23.CANCOL, a Computer-Assisted Annotation Tool to Facilitate Colocalization and Tracking of Immune Cells in Intravital MicroscopyJ. Immunol 208:1493–1499Google Scholar
- 24.Label-free imaging of immune cell dynamics in the living retina using adaptive opticseLife 9:e60547https://doi.org/10.7554/eLife.60547Google Scholar
- 25.ACME: Automatic feature extraction for cell migration examination through intravital microscopy imagingMéd. Image Anal 77:102358Google Scholar
- 26.DL4MicEverywhere: deep learning for microscopy made flexible, shareable and reproducibleNat. Methods 21:925–927Google Scholar
- 27.TrackMate 7: integrating state-of-the-art segmentation algorithms into tracking pipelinesNat Methods 19:829–832Google Scholar
- 28.Histopathological spectrum of paediatric diffuse intrinsic pontine glioma: diagnostic and therapeutic implicationsActa Neuropathol 128:573–581Google Scholar
- 29.CellTracksColab — A platform for compiling, analyzing, and exploring tracking databioRxiv https://doi.org/10.1101/2023.10.20.563252Google Scholar
- 30.Democratising deep learning for microscopy with ZeroCostDL4MicNat Commun 12:2276Google Scholar
- 31.Hormone-responsive progenitors have a unique identity and exhibit high motility during mammary morphogenesisCell Rep 43Google Scholar
- 32.Cellpose 2.0: how to train your own modelNat. Methods 19:1634–1641Google Scholar
- 33.Segment Anything for MicroscopyNat. Methods 22:579–591Google Scholar
- 34.Intravital microscopy of dynamic single-cell behavior in mouse mammary tissueNat. Protoc 16:1907–1935Google Scholar
- 35.Tumor cell plasticity, heterogeneity, and resistance in crucial microenvironmental niches in gliomaNat. Commun 12:1014Google Scholar
- 36.Behavioural immune landscapes of inflammationNature :1–7https://doi.org/10.1038/s41586-021-04263-yGoogle Scholar
- 37.Inflammation triggers ILC3 patrolling of the intestinal barrierNat. Immunol 23:1317–1323Google Scholar
- 38.Visualization of T Cell Migration in the Spleen Reveals a Network of Perivascular Pathways that Guide Entry into T ZonesImmunity 52:794–807Google Scholar
- 39.Neutrophils self-limit swarming to contain bacterial growth in vivoScience 372Google Scholar
- 40.Affinity-coupled CCL22 promotes positive selection in germinal centresNature 592:133–137Google Scholar
- 41.The intrinsic and microenvironmental features of diffuse midline glioma: Implications for the development of effective immunotherapeutic treatment strategiesNeuro-Oncol 24:1408–1422Google Scholar
- 42.Multispectral confocal 3D imaging of intact healthy and tumor tissue using mLSR-3DNat. Protoc 17:3028–3055Google Scholar
- 43.Revealing the spatio-phenotypic patterning of cells in healthy and tumor tissues with mLSR-3D and STAPL-3DNat. Biotechnol 39:1239–1245Google Scholar
- 44.CytoMAP: A Spatial Analysis Toolbox Reveals Features of Myeloid Cell Organization in Lymphoid TissuesCell Rep 31Google Scholar
- 45.Imaging glioma cell invasion in vivo reveals mechanisms of dissemination and peritumoral angiogenesisGlia 57:1306–1315Google Scholar
- 46.Microglia Induce PDGFRB Expression in Glioma Cells to Enhance Their Migratory CapacityiScience 9:71–83Google Scholar
- 47.Vessel co-option in glioblastoma: emerging insights and opportunitiesAngiogenesis 23:9–16Google Scholar
- 48.Perivascular invasion of primary human glioblastoma cells in organotypic human brain slices: human cells migrating in human brainJ. Neuro-Oncol 164:43–54Google Scholar
- 49.Tumor-specific migration routes of xenotransplanted human glioblastoma cells in mouse brainSci. Rep 14Google Scholar
- 50.Sulforhodamine 101 as a specific marker of astroglia in the neocortex in vivoNat. Methods 1:31–37Google Scholar
- 51.Specific In Vivo Staining of Astrocytes in the Whole Brain after Intravenous Injection of Sulforhodamine DyesPLoS ONE 7:e35169Google Scholar
- 52.Sulforhodamine 101, a widely used astrocyte marker, can induce cortical seizure-like activity at concentrations commonly usedSci. Rep 6Google Scholar
- 53.Unspecific labelling of oligodendrocytes by sulforhodamine 101 depends on astrocytic uptake via the thyroid hormone transporter OATP1C1 (SLCO1C1)Neurosci. Lett 631:13–18Google Scholar
- 54.Visualizing Microglia with a Fluorescence Turn-On Ugt1a7c SubstrateAngew. Chem. Int. Ed. 58:7972–7976Google Scholar
- 55.The landscape of tumor cell states and spatial organization in H3-K27M mutant diffuse midline glioma across age and locationNat. Genet 54:1881–1894Google Scholar
- 56.Oncogenic Kras induces spatiotemporally specific tissue deformation through converting pulsatile into sustained ERK activationNat. Cell Biol 26:859–867Google Scholar
- 57.Glioblastoma hijacks neuronal mechanisms for brain invasionCell 185:2899–2917Google Scholar
- 58.Extracellular fluid viscosity enhances cell migration and cancer disseminationNature 611:365–373Google Scholar
- 59.Metastasis: tumor cells becoming MENAcingTrends Cell Biol 21:81–90Google Scholar
- 60.Invaders Exposed: Understanding and Targeting Tumor Cell Invasion in Diffuse Intrinsic Pontine GliomaFront. Oncol 10Google Scholar
- 61.The Microenvironmental Landscape of Brain TumorsCancer Cell 31:326–341Google Scholar
- 62.Invasive glioma cells: The malignant pioneers that follow the currentCell 185:2846–2848Google Scholar
- 63.Glioblastoma Microenvironment and Invasiveness: New Insights and Therapeutic TargetsInt. J. Mol. Sci 24:7047Google Scholar
- 64.Generation of diffuse intrinsic pontine glioma mouse models by brainstem-targeted in utero electroporationNeuro-Oncol 22:381–392Google Scholar
- 65.Generation of immunocompetent syngeneic allograft mouse models for pediatric diffuse midline gliomaNeuro-Oncol. Adv 4:vdac079Google Scholar
- 66.Development of a human glioblastoma model using humanized DRAG mice for immunotherapyAntib. Ther 6:253–264Google Scholar
- 67.Mapping T cell dynamics to molecular profiles through behavior-guided transcriptomicsNat. Protoc :1–28https://doi.org/10.1038/s41596-024-01126-4Google Scholar
- 68.Variable selection for nonlinear dimensionality reduction of biological datasets through bootstrapping of correlation networksComput. Biol. Med 168Google Scholar
- 69.W. elastix: A Toolbox for Intensity-Based Medical Image RegistrationIEEE Trans. Méd. Imaging 29:196–205Google Scholar
- 70.SimpleElastix: A User-Friendly, Multi-Lingual Library for Medical Image Registration2016 IEEE Conf. Comput. Vis. Pattern Recognit. Work. (CVPRW) :574–582https://doi.org/10.1109/cvprw.2016.78Google Scholar
- 71.Intraclonal Plasticity in Mammary Tumors Revealed through Large-Scale Single-Cell Resolution 3D ImagingCancer Cell 35:618–632Google Scholar
Article and author information
Author information
Version history
- Sent for peer review:
- Preprint posted:
- Reviewed Preprint version 1:
- Reviewed Preprint version 2:
Cite all versions
You can cite all versions using the DOI https://doi.org/10.7554/eLife.102097. This DOI represents all versions, and will always resolve to the latest one.
Copyright
© 2024, Rios-Jimenez et al.
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.
Metrics
- views
- 589
- downloads
- 21
- citations
- 0
Views, downloads and citations are aggregated across all versions of this paper published by eLife.