A large field of view two-photon mesoscope with subcellular resolution for in vivo imaging
Abstract
Imaging is used to map activity across populations of neurons. Microscopes with cellular resolution have small (<1 millimeter) fields of view and cannot simultaneously image activity distributed across multiple brain areas. Typical large field of view microscopes do not resolve single cells, especially in the axial dimension. We developed a 2-photon random access mesoscope (2p-RAM) that allows high-resolution imaging anywhere within a volume spanning multiple brain areas (∅ 5 mm x 1 mm cylinder). 2p-RAM resolution is near diffraction limited (lateral, 0.66 μm, axial 4.09 μm at the center; excitation wavelength = 970 nm; numerical aperture = 0.6) over a large range of excitation wavelengths. A fast three-dimensional scanning system allows efficient sampling of neural activity in arbitrary regions of interest across the entire imaging volume. We illustrate the use of the 2p-RAM by imaging neural activity in multiple, non-contiguous brain areas in transgenic mice expressing protein calcium sensors.
https://doi.org/10.7554/eLife.14472.001Introduction
Over the last ten years cellular calcium imaging has become widely used to image activity in neuronal populations (Grienberger and Konnerth, 2012; Peron et al., 2015). Calcium imaging samples activity of all labeled neurons in an imaging volume and can readily be combined with visualization of cell type markers to analyze activity in specific cell types, the nodes of neural circuits (Kerlin et al., 2010; Fu et al., 2014; Peron et al., 2015).
The development of sensitive protein sensors for neuronal function has been a major driver for cellular activity imaging in vivo (Nagai et al., 2004; Tian et al., 2009; Horikawa et al., 2010; Zhao et al., 2011; Chen et al., 2013; Dana et al., 2016). More sensitive indicators allow measurement from larger numbers of neurons at fixed signal-to-noise ratios (SNR) (Wilt et al., 2013; Peron et al., 2015). Future improvements in protein sensors are expected to further increase the numbers of neurons that can be probed simultaneously.
The vast majority of cellular imaging in vivo has been done with 2-photon microscopy (Denk and Svoboda, 1997). 2-photon microscopy confines excitation in scattering tissue, which in turn underlies three-dimensional contrast with subcellular resolution (Denk et al., 1994). 2-photon microscopy demands that individual resolution elements (on the order of 1 µm3) are sampled sequentially, limiting its speed. Spurred by the development of fast solid state cameras, wide-field methods such as wide-field microscopy (Ziv et al., 2013), light-field microscopy (Prevedel et al., 2014), and light-sheet microscopy (Holekamp et al., 2008; Ahrens et al., 2013) have been used to measure neural activity. Scattering and out-of-focus fluorescence rapidly degrade signal and contrast when imaging in scattering tissue with wide-field methods compared to 2-photon microscopy (Peron et al., 2015). As a consequence, at any point in the image, signals from multiple neurons are mixed together. Unmixing these signals to extract neural activity of individual neurons is a challenging computational problem, which remains unsolved in general. In contrast, the high resolution and image contrast provided by 2-photon microscopy allows extraction of fluorescence signals corresponding to the activity of individual neurons and subcellular compartments (Stosiek et al., 2003; Sato et al., 2007; Akerboom et al., 2012; Chen et al., 2013; Petreanu et al., 2012).
Together with calcium imaging, 2-photon microscopy is now routinely used to examine behavior-related activity in populations of neurons (Harvey et al., 2012; Huber et al., 2012; Peron et al., 2015). The majority of studies image only dozens to hundreds of neurons in one brain region at a time. The advent of sensitive protein indicators for calcium (Nagai et al., 2004; Tian et al., 2009; Horikawa et al., 2010; Zhao et al., 2011; Chen et al., 2013) and transgenic animals expressing these indicators (Dana et al., 2014; Madisen, 2015) promises much higher throughput. 2-photon microscopy has already been used together with GCaMP6 (Chen et al., 2013) to measure activity in approximately 1800 pyramidal neurons at 7 Hz using 50 mW of power at the sample (Peron et al., 2015). Optimization of the delivered laser power and 2-photon excitation efficiency will allow tracking of more than 10,000 pyramidal neurons at similar signal-to-noise ratios and sampling frequencies. This opens up the possibility of tracking representative neuronal populations across multiple brain regions.
Even relatively simple animal behaviors involve multiple brain regions, which are often non-contiguous (Hernández et al., 2010; Guo et al., 2014). Simultaneous tracking of activity in these brain areas is not possible using standard microscopes, because mechanical movement of microscopes or specimens is slow. High-resolution microscopes have fields of view (FOV) that are smaller than most brain areas, whereas large FOV microscopes have small numerical apertures and cannot resolve individual neurons. To bridge the gap between single cells and brain regions we developed a mesoscale 2-photon microscope capable of imaging a FOV of 5 mm, with subcellular resolution. We use the term ‘mesoscale microscopy’ to refer to imaging with subcellular resolution and fields of view spanning multiple brain areas (several millimeters).
We implemented fast lateral and axial scanning to both maximize the number of neurons that can be sampled nearly simultaneously and the flexibility in choosing the imaged neurons. The fluorescence signal collected per unit time is ultimately limited by the average power that can be delivered to the specimen, which in turn is limited by heating. In the mouse brain the maximum allowed power is approximately Pmax = 200 mW (Podgorski and Ranganathan, 2016). The signal rate for one scanning beam is S1 = a Pmax2, where a is a parameter that depends on the illumination, the experimental preparation (e.g. the type and concentration of the fluorescent probe), and fluorescence detection. In another popular scheme the excitation beam is partitioned into n beams for multiplexed excitation (Lecoq et al., 2014; Okun et al., 2015). Dividing the power into n laser foci for multiplexed imaging, the signal is Sn = a n (Pmax/n)2. This division corresponds to reduced overall signal levels (by 1/n) and a corresponding reduction in the number of neurons sampled, at fixed signal-to-noise ratio. Increasing the power of each individual beam beyond a total (summed) power of Pmax = 200 mW would cause heating and associated damage. Given the relatively slow dynamics of calcium-related fluorescence (Peron et al., 2015), serial scanning with a single laser focus maximizes the number of neurons that can be probed.
Several 2-photon microscopes have been designed for large field of view in vivo imaging. Tsai et al designed an elegant scanning system based on off-the-shelf components, producing a scan field of 10 mm (Tsai et al., 2015). Stirman et al used a custom objective (Stirman et al., 2014) with a field of view of 3.5 mm. Neither system provides subcellular resolution in the axial dimension (14 μm and 12 μm, respectively), implying that signals from multiple neurons and neuropil may be conflated. In current implementations these instruments use standard galvo mirrors, which are too slow for some types of functional imaging. These microscopes also do not implement rapid axial scanning, which is critical for targeting specific neurons in different parts of the FOV. In addition, the microscopes are corrected for aberrations at only one excitation wavelength (800 nm and 910 nm respectively), limiting their use to a subset of fluorescent probes. A large FOV (5 mm) mesolens for confocal microscopy, with numerical aperture 0.47, has also been reported (McConnell et al., 2016).
We have developed a 2-photon random access mesoscope (2p-RAM), optimized for imaging populations of neurons in multiple brain regions during behavior. 2p-RAM provides diffraction-limited resolution in a cylindrical volume (∅ 5 mm x 1 mm). It is fully corrected for excitation light in the 900–1070 nm range, allowing 2-photon imaging of most widely used fluorescent proteins. 2p-RAM is based on a fast three-dimensional scanning system that allows random access to hundreds of thousands of neurons for targeted interrogation.
Results
We developed a 2-photon random access mesoscope (2p-RAM) with subcellular resolution. We first outline the key specifications, which correspond to specific engineering challenges. We then explain the optical path of the mesoscope, followed by a brief description of the design process. Finally we illustrate the mesoscope performance in calibration experiments and imaging neural activity in vivo.
Key specifications
First, the diameter of the FOV should be five millimeters. This size allows sampling of most cortical regions in the mouse brain that are nearly coplanar. For example, it would be possible to image the primary somatosensory cortex, the primary motor cortex and parts of secondary motor cortex nearly simultaneously (Figure 1A). Second, the mesoscope should have better than cellular resolution, implying axial resolutions substantially smaller than the typical size of a soma (diameter, 10 µm) (Peters and Kaiserman-Abramof, 1970). We specified a numerical aperture (NA) of 0.6, which translates to approximately 0.61 µm lateral resolution and 4.25 µm axial resolution (for λ = 970 nm; Figure 1B) (Zipfel et al., 2003). Third, the mesoscope should produce diffraction-limited performance and high two-photon excitation efficiency over the range of λ = 900–1070 nm. This spectral range corresponds to fluorescent protein sensors based on GFP and various red fluorescence proteins (Akerboom et al., 2013). Fourth, the mesoscope should maximize the collection of fluorescence signal, ideally with a large collection NA. We specified a collection NA of 1.0 (specifications list in Figure 1C).
Fifth, a key challenge for mesoscale 2-photon microscopy is efficient laser scanning. Faster scanning provides better time resolution for measurements of neural activity, reduced photodamage, and tracking larger numbers of neurons. Rapid scanning methods rely on resonant scanning mirrors (Fan et al., 1999) or acousto optic deflectors (AODs) (Reddy and Saggau, 2005), both of which have scan angles on the order of a few degrees, corresponding to relatively small (several hundred μm) scans in the specimen plane. To access the entire scan field rapidly we designed a lateral scan unit with multiple scanners in series. A fast resonant scan is moved over the specimen in a flexible manner using a galvanometer scanner, allowing rapid sampling of activity in widely dispersed brain regions (Figure 1D).
The sixth and final challenge is scanning along the optical axis of the microscope. In most scanning microscopes, focusing is achieved by moving the objective. Because of the mechanical inertia of the bulky objective, focusing is more than two orders of magnitude slower than lateral scanning (Göbel et al., 2007). This limit is unacceptable for mesoscale imaging because the structures of interest to be sampled in different brain regions are typically in focal planes that differ by up to several hundred micrometers (Figure 1E). We addressed this problem by implementing a rapid remote focusing unit in which a light-weight mirror is moved instead of the objective (Botcherby et al., 2012). Rapid remote focusing also allowed us to relax flatness of field specifications, because rapid focusing can partially correct for curved scan fields online.
Implementation
Overview
The 2p-RAM was assembled on a vertically mounted breadboard (Figure 2A,C,E). The refractive optics of the microscope are predicted to introduce 25,000 fs2 group-delay dispersion (GDD) (at λ = 1000 nm). GDD will cause the light arriving at the focus to be spread out in time, resulting in reduced efficiency for two-photon excitation (Denk et al., 1995). To reduce GDD at the sample, the Ti:Sapphire laser beam first passed through a prism-based GDD compensation unit (Akturk et al., 2006) (Figure 2B). With GDD compensation enabled, we measured a pulse width of 106 fs at the sample using an autocorrelator (Carpe; APE) (see Figure 2—figure supplement 1), comparable to the pulse width emitted by our laser (Mai Tai HP; Spectra Physics).
The microscope is motorized to allow flexible access to the specimen: it moves in x, y (>50 mm travel); it rotates around an axis that passes through the specimen plane and is parallel to the long axis of the microscope ( ± 20 degrees travel); it moves up and down along the beam axis for coarse focusing (travel +38 mm−13 mm). Since the microscope moves with respect to the laser, the beam was threaded into the microscope through a multi-stage periscope.
Remote focus unit
Within the core of the microscope, the beam first enters the remote focus (RF) unit through a polarizing beam splitting cube and a quarter wave plate. The RF unit consists of a custom RF objective, and a small mirror (mass, 170 mg; PF03-03-P01, Thorlabs) mounted on a voice coil (LFA 2010 with a sca814 controller; Equipment Solutions). The beam passes through the RF objective and is reflected by the mirror back through the RF objective. The quarter wave plate and polarizing beam splitting cube together then direct the beam into the lateral scan unit. The coatings of the RF objective were optimized for high transmission in the IR range. These coatings and the small number of elements (5) combined to give high transmission through the RF objective (97%).
The entrance aperture of the RF objective is conjugated to the entrance aperture of the imaging objective. The RF mirror is approximately conjugate to the focus in the specimen plane. Axial movement of the RF mirror changes the axial location of the focus in the specimen (scale factor, 1.23; i.e. a 100 µm move of the RF mirror causes a 123 µm move of the focus). Depending on the axial position of the RF mirror, the wavefront entering the imaging objective will be converging, parallel, or diverging. For standard microscope objectives, which obey the sine condition, only parallel rays will converge to a diffraction-limited point in the specimen (Born and Wolf, 1980). Spherical wavefronts in the objective pupil will produce spherical aberration at the focus. Rays entering the objective back aperture at its periphery will focus to a different point along the axis, thereby producing a larger focal volume with lower peak intensity. These spherical aberrations degrade resolution and contrast. The RF objective was designed to counteract the spherical aberrations produced by the imaging objective, so that diffraction-limited imaging can be achieved throughout the microscope’s imaging volume (Botcherby et al., 2012). The imaging objective also has axial chromatic aberration that varies with RF depth, which is compensated by the RF objective. The RF unit allows rapid axial movement of the focal plane, since the RF mirror can be moved much faster than the objective or the specimen.
Scanning system
We designed a lateral scanning unit to efficiently scan arbitrary regions of interest in the FOV of the microscope. A resonant scanner produces a fast line scan (24 kHz line rate) (CRS 12 K, Cambridge Technology). Because of the limited angular range of the scanner (10 degrees, optical peak-to-peak) this results in a scan range of 0.6 mm or less in the specimen plane. This scan line is moved over the specimen using a pair of galvo scanners.
Microscopes using remote focusing have to deal with non-planar wavefronts in their pupil locations. Maintaining conjugation between all scan mirrors and optic pupils is a critical issue for these microscopes. Otherwise, the movement of any scan mirror that is not conjugated to a subsequent optic pupil, such as the entrance pupil of the objective, will cause a lateral shift of the wavefront at that pupil. Wavefront non-planarity and lateral shift can cause significant optical aberrations.
The beam is directed through a pupil relay (PR1; magnification, 0.44) into the resonant scanner (open aperture, 4.8 mm), and then through a second identical pupil relay in reverse (PR2; magnification, 2.3) into a virtually conjugated galvo pair (VCGP). The VCGP unit conjugates the x and y scan galvo pair without a large-aperture relay made from refractive optics. Alternatively conjugation could have been accomplished using a custom pupil relay using refractive optics. However, due to its large size, this relay would be the most complex and expensive part of the microscope. The VCGP provides a compact and cost-effective solution.
The VCGP uses three galvo mirrors (rather than two) to ensure that the pupils of the x and y scanning galvos are coincident. The first two mirrors (open aperture, 20 mm; Cambridge Technology 6M2420X40B025S4 mirror on 6240HM40B galvo) are moved in the same plane so that the beam rotates about a pupil centered on the third mirror (open aperture, 14 mm, Cambridge 6M2314X44B025S4 mirror on 6231HM44C galvo), which rotates in the orthogonal direction. In this manner the pupil remains substantially stationary over a large scan range. The 20 mm, virtually conjugated galvo mirrors each have a scan range of 40 deg (optical peak-to-peak, OPTP). However, the virtual conjugate arrangement of these mirrors results in a total scan range of 32.2 deg OPTP at the following pupil. The 14 mm galvo mirror has a scan range of 44 deg OPTP. The 20 mm mirrors can perform a step across their entire range with step-and-settle time of 3.4 ms. Smaller steps with these mirrors, and all steps with the 14 mm mirror, are faster.
Objective
The exit pupil of the VCGP is imaged by another pupil relay (PR3; magnification, 2.3) onto the entrance pupil (diameter, 25.6 mm) of the imaging objective (NA, 0.6, focal length 21 mm) (Figure 2D). The excitation beam is routed into the imaging objective using a shortpass dichroic (DM1; size 70 x 99 mm; 750 nm shortpass custom coating design from Alluxa). The front lens has a tip diameter of 15 mm. The distance between the edge of the front lens and the top of the specimen is 2.7 mm. Because remote focusing moves the focal plane into the specimen without movement of the objective or specimen, the effective working distance of the objective is larger than 3 mm. In vivo imaging is usually performed through a microscope coverglass (Trachtenberg et al., 2002; Holtmaat et al., 2009). The optical system is corrected to operate in a diffraction-limited manner through a # 4 coverglass (450 µm of BK7 glass; equivalent to a stack of three # 1 coverglasses). Power transmission through the entire system is 13% (Figure 2B).
Fluorescence collection path
Fluorescence light passes through the primary dichroic (DM1) into the detector arm of the microscope. An optional second dichroic mirror (DM2) allows for an ancillary optical path for one-photon imaging and photostimulation. A third dichroic mirror (DM3) divides the fluorescence path into two signals, each directed into one of two GaAsP photomultiplier tubes (PMTs) (Hamamatsu H11706-40).
In a 2-photon microscope, the etendue of fluorescence light collection by the objective lens must be matched or exceeded by the etendue of the light detector. This condition is critical for optimal detection of precious signal photons. For most microscopes this condition is not an issue, as PMTs have photocathodes that are much larger than the objective FOV, as well as sizable collection angles (Tsai et al., 2002). For the 2p-RAM the imaging objective collects emitted light with an NA of 1.0, and a collection FOV of 6 mm (Oheim et al., 2001). The diameter of the imaging objective pupil relevant for fluorescence detection is 42 mm. The etendue of this collected emission light exceeds the etendue of the current state-of-the-art PMTs which have a photocathode diameter of 5 mm and a usable NA of approximately 0.9 (unpublished measurements). This makes it impossible for all of the fluorescence light collected by the objective to be directed onto the PMT using conventional imaging schemes (Mainen et al., 1999; Tsai et al., 2002). To overcome this problem we used oil to directly couple a custom-made condenser lens to the glass enveloping the PMT. This allowed the collection NA of the PMT to reach 1.4. In this manner all of the fluorescence that is collected by the imaging objective is projected onto the PMT for detection (not counting reflection losses).
Our collection path does not image the back pupil of the objective onto the PMT (Denk et al., 1995; Mainen et al., 1999), as that design would require significantly more complex collection optics. As a result, the spatial distribution of the signal on the PMT photocathode varies with location of the signal source within the sample. The spot size of the projected light from a point source in the sample on the photocathode varies from 1.5 mm to 2.7 mm, depending on the location of the source point. The microscope image is therefore sensitive to inhomogeneities in the photosensitivity of the PMT photocathode. For the most critical applications it may be necessary to select PMTs with homogeneous photocathodes or employ computational methods to correct for the inhomogeneity.
Optical design
The excitation path, including the RF objective, pupil relays 1–3, and imaging objective, was modeled in silico (Zemax). We searched for configurations of optical elements with diffraction-limited performance and high two-photon excitation efficiency across the ∅ 5x1 mm imaging volume, for excitation wavelengths over the range 900–1070 nm. Performance was assessed using the Strehl ratio (SR), which is a measure of the quality of optical image formation. Without aberrations an optical system has SR = 1; aberrations drive SR toward zero. We optimized for SR > 0.8 across the imaging volume, a commonly used criterion for diffraction-limited performance.
Two-photon excitation efficiency depends on the propagation time delay difference (PTD) for different rays across the pupil of the system (Estrada-Silva et al., 2009). For PTD not much less than the pulse duration, the efficiency of two-photon excitation would be severely reduced. PTD was kept to less than 50 fs (rms). As far as we know no other microscopy system has been designed with optimization of the PTD as a design criterion.
Other design parameters included: The number, size and complexity of the optical elements; focusing range of the RF unit; nature and cost of the optical glasses. Field curvature was limited to less than 160 µm over the 5 mm FOV. Finally, tolerancing was performed to minimize sensitivities and guide manufacturing (Code V). No stock lenses were used for these modules, as doing so in most cases would not allow sufficient control over the tolerances to meet performance specifications. The element count for each module was: RF objective, 5; pupil relay 1/2 (identical), 4; pupil relay 3, 6; imaging objective, 6. (The modules were manufactured by Jenoptik. Jupiter, Fl; part numbers RF objective: 14163200, pupil relay 1/2: 14506000, pupil relay 3: 14163100, imaging objective: 14163000; for a table of critical distances between these elements necessary for assembly see Figure 2—figure supplement 2). A detailed description of the custom optics and the design process will be published elsewhere.
Calibration experiments
Brightness across the field of view
We measured the signal brightness across the FOV. In a homogeneous sample, such as a solution of fluorophore, image brightness is determined by the two-photon excitation efficiency and the collection efficiency for fluorescence, both of which depend on position in the FOV. We acquired an image of a 1 mm thick bath of fluorescein (λ = 970 nm). At an imaging depth of 500 um, brightness was constant up to approximately 2.5 millimeters from the center, beyond which image brightness collapsed (Figure 3). The image showed inhomogeneities across the resonant scan (608 µm), apparent as shading in the vertical stripes in Figure 3A. The shading is produced by wave front error introduced by pupil relay 2 during rapid resonant scanning. Smaller resonant scans would reduce this shading. Inhomogeneities in brightness within the specified FOV were on the order of 30% (Figure 3C), including a small dip in brightness in the center of the field (this dip is caused by spatial inhomogeneity in the PMT sensitivity across its photocathode; see below).
Resolution
We next measured the resolution of the microscope. Fluorescent microbeads (0.5 μm; Fluoresbrite Calibration Grade YG microspheres CAT# 18859, Polysciences Inc.) were embedded in agar (1.5%; Agarose, Type III-A Sigma A9793) at a dilution of 1:10,000. Three-dimensional images stacks containing images of beads were collected at various positions in the imaging volume (λ = 970 nm). Resolution was estimated based on the lateral and axial full-width-at-half-max (FWHM) of the bead images (Figure 4). The lateral FWHM of the bead image was 0.66 ± 0.003 μm (SEM) and the axial FWHM was 4.09 ± 0.06 μm (SEM). Approximately 2 millimeters from the center of the FOV, the resolution started to degrade gradually (Figure 4I,J,K). At the edge of the FOV (2.5 mm from the center) the lateral FWHM was 0.89 ± 0.006 μm (SEM), and the axial FWHM 6.88 ± 0.07 μm (SEM). At the center of the FOV, performance was diffraction-limited up to 1 mm deep into the sample (Figure 4—figure supplement 1). This performance was similar at different positions in the field and different imaging depths up to 1 mm into the sample (Figure 4—figure supplement 2). Resolution was consistent across wavelengths from 900 nm to 1040 nm (the limit of the tuning range of our Ti:Sapphire laser) (Figure 4—figure supplement 3). Resolution also remained essentially unchanged for small (up to ± 2.5°) tilts of the coverglass with respect to the beam axis (Figure 4—figure supplement 4). We conclude that the 2p-RAM is capable of subcellular resolution over the entire imaging volume (∅ 5x1 mm cylinder) and is robust to moderate misalignments.
The brightness of the imaged beads dropped off towards the edge of the FOV (up to a factor of four 2.5 mm from the center of the FOV; Figure 4K). This is consistent with the observed increase in the size of the PSF (Figure 4J). In 2-photon microscopy, the brightness of objects that are on the order of, or smaller than the diffraction limit are highly sensitive to degradation in the PSF. Decreased fluorescence collection efficiency at the edges of the FOV could also contribute to dimmer images at the edge of the FOV. Conversely, resolution was consistent across the center of the field, (Figure 4I,J) suggesting that the dip in brightness (Figure 3) at the center of the field is likely due to a dip in PMT sensitivity in the center of the FOV (see below).
Collection efficiency
Biological 2-photon microscopy is typically limited by photodamage produced by excitation light. Better detection of fluorescence signal allows reduced excitation for fixed SNR. Optimizing fluorescence detection is therefore a critical aspect of designing a 2-photon microscope for in vivo imaging. In scattering samples the objective numerical aperture and its FOV contribute to fluorescence detection (Oheim et al., 2001). We therefore characterized the signal collection efficiency of our system as a function of position of the signal source and numerical aperture (Figure 5).
We separately varied the position of a light source and its NA while measuring the signal detected by the PMT (Figure 5A). A pinhole was mounted in front of the light source (LED) and imaged using an imaging system into the specimen plane. The NA of the light cone was controlled using an aperture in an intervening aperture plane. The microscope was moved on a 0.5 millimeter grid around this assembly.
The PMT signal was remarkably constant across the FOV and beyond (Figure 5B). The signal showed a modest dip in the center of the FOV (approximately 20% reduced sensitivity). This dip was tracked down to inhomogeneous sensitivity on the PMT photocathode (data not shown). This dip also likely accounts for the lower brightness at the center of the field (Figure 3).
We next changed the NA of the light source. The total light entering the objective was roughly proportional to the second power of the NA (Figure 5C). The signal detected by the PMT was proportional to the signal entering the objective up to NA 1.0, the specified NA for fluorescence detection of the imaging objective (Figure 5C,D). We conclude that our fluorescence collection system performs nearly optimally across the specified FOV (∅ 5 mm). The overall transmission of the collection path, including reflection and transmission losses, was 71%.
Field curvature and its correction using remote focusing
To characterize the field curvature of the microscope we imaged a thin and flat fluorescent sample (Figure 6A). If the scan transects the sample the fluorescent image is a circle (Figure 6B). The radius of the circle increases monotonically as the RF is adjusted downward. In this way we mapped the field curvature of the microscope. The focal position changed by up to 158 µm at 2.5 mm from the center of the FOV.
We implemented a field curvature correction by the RF unit in our scan control software. Following a 300 µm step, the RF mirror settles to better than 2.5 µm in 6.77 ± 0.02 ms (SEM) (Figure 6—figure supplement 1). The correction was done on a line-by-line basis, using the average position of the resonant mirror during the line as the position to correct. This scheme corrects the field curvature associated with movements of the slower galvo mirrors (i.e. along the vertical image stripes). Field curvature along the resonant scan could not be corrected in this manner because the RF unit does not have the necessary bandwidth. Not correcting the field curvature along the resonant axis (Figure 6C, bottom) causes striping artifacts present in the images (Figure 7).
In vivo imaging
We next imaged neurons in transgenic mice expressing fluorescent proteins. Mice were prepared with a stainless-steel head plate and a D-shaped cranial window using standard surgical procedures (Peron et al., 2015). The D-shaped window was 450 µm thick and made from three layers of custom cut coverglass (Potomac Photonics). The window spanned from the lambda suture to 3 mm anterior of Bregma and from the midline 5 mm laterally, allowing optical access to a large fraction of the cortical surface on the left hemisphere.
Low magnification, high-resolution images (λ = 970 nm) were acquired in anesthetized mice expressing GCaMP6f in a subset of pyramidal neurons (GP5.17 mice) or GCaMP6s in the vast majority of pyramidal neurons (GP4.3) (Dana et al., 2014). Superficial images showed the vascular pattern on the surface of the brain (GP5.17, Figure 7A,B; GP4.3, Figure 7C, Video 1). Higher magnification views revealed single neurons and their dendrites (Figure 7B). Resolution and contrast degrade with imaging depth in vivo, caused by aberration and scattering (Ji et al., 2012). However, images of neurons appeared as ring-like structures up to 600 µm deep in the tissue (Video 1), reflecting GCaMP exclusion from the nucleus (Tian et al., 2009) and demonstrating subcellular resolution of the 2p-RAM.
Deeper imaging, approximately 450 μm below the surface of the brain, revealed the outlines of the layer 4 barrels of the whisker representation area of the somatosensory cortex, and the lower limb and upper limb somatosensory areas (Figure 7E,F, Figure 7—figure supplement 1A; GP4.3). Layer 4 has decreased fluorescence because stellate cells do not express fluorescent proteins in these mice (Dana et al., 2014).
We next imaged GFP-labeled nuclei of excitatory neurons in emx1-Cre x lsl h2b-GFP mice (Madisen, 2015). We imaged the full FOV in 2 µm z-steps (up to 600 μm deep) and 1.2 x 1.3 μm2 pixels (Figure 7—figure supplement 1A). We automatically detected nuclei in three dimensions using a peak finding algorithm (peak_local_max, scikit-image) (Figure 7—figure supplement 1B). We detected a total of 207,359 nuclei in the volume (Figure 7—figure supplement 1C). This is a lower bound on the number of neurons accessible for functional imaging in the 2p-RAM.
In mice expressing YFP in a sparse subset of pyramidal neurons (YFP-H) (Feng et al., 2000) we were able to resolve individual spines (Figure 7—figure supplement 2).
We next imaged neural activity in behaving mice running on a treadmill in tactile virtual reality (Sofroniew et al., 2014, Sofroniew et al., 2015). We imaged a 4.4 mm x 4.2 mm FOV at 1.9 Hz in layer 2/3 (Figure 8—figure supplement 1A,B, Video 2; GP4.3 mice). A simple correlation analysis revealed over 3000 active neurons (Figure 8—figure supplement 1C,D).
The 2p-RAM can link activity at the level of brain regions and single neurons. For example, low magnification movies showed activity across multiple brain regions including somatosensory, parietal, and motor areas (Figure 8A; GP5.17 mice). We correlated the average activity from an area (region 1) in somatosensory cortex with activity in the rest of brain (Vanni and Murphy, 2014)(Figure 8B). We then imaged region 1 and three additional, widely separated regions (each 600x600 μm2) at higher speed (9.6 Hz) (Figure 8C, Video 3). Individual neurons showed fluorescence transients corresponding to trains of action potentials (Chen et al., 2013). We manually segmented individual neurons in each of the regions and computed the change in fluorescence (ΔF/F) over time (Figure 8E). We measured average activity in region 1 by computing the maximum of the ΔF/F traces across all neurons in that region at each time point. We then correlated this trace against all the ΔF/F traces of individual neurons (Figure 8D,F). Some neurons in the different areas showed high correlation with this average trace, whereas others showed uncorrelated activity (Okun et al., 2015). In this manner, the 2p-RAM can be used to relate activity across nearly the entire dorsal cortex with the activity of individual neurons in specific areas during behavior.
Discussion
We designed a 2-photon random access mesoscope (2p-RAM) that allows rapid microscopic investigation of neural tissue over large imaging volumes. The 2p-RAM has a numerical aperture of 0.6 and an imaging volume corresponding to a ∅5x1 mm cylinder. The imaging volume is approximately 100-fold larger compared to other microscopes with comparable resolution.
The 2p-RAM is optimized for high-resolution in vivo imaging. Lateral scanning is performed using a resonant scanner in series with a xy galvo scanner. Rapid scanning is achieved by moving the fast resonant scan over the FOV using the galvo mirrors. Even faster and more flexible scanning could potentially be achieved using acousto-optic deflectors (Duemani Reddy et al., 2008) instead of resonant scanners.
Rapid axial scanning is critical for mesoscale functional imaging in the intact brain. This is because neurons of interest will generally be at different imaging depths in different brain regions. It is also often of interest to interrogate the same brain region at different imaging depths. In the 2p-RAM, axial scanning is based on aberration-free focusing using a remote mirror (Botcherby et al., 2012). The mirror is moved in a plane nearly conjugate to the specimen plane to move the focus. Aberrations are corrected by passing the beam through a RF objective that produces complimentary aberrations to the imaging objective. In published optical arrangements, the beam is scanned laterally first, and is then sent into the RF system (Botcherby et al., 2012). This design puts constraints on the RF objective. In our system the beam is passed through the RF system before lateral scanning. This configuration allowed the etendue, and thus size, complexity, and cost, of the RF objective to be much lower than that of the imaging objective. We also optimized the coatings and the element count of the RF objective to minimize power losses that are normally high in remote focusing systems. The optics subsequent to the RF objective could be made such that the remote focusing is invariant to lateral scanning, and thus diffraction-limited focusing can be achieved over a large volume with this arrangement. Alternative axial scanning techniques, such as rapidly moving the objective (Göbel et al., 2007), are impractical due to the large size of the 2p-RAM objective. Electrotunable lenses introduce spherical and chromatic aberrations (Grewe et al., 2011).
The 2p-RAM has relatively large field curvature (Figure 6). Rapid remote focusing can help to compensate for field curvature in real time during scanning. Online correction of field curvature can only be achieved for the movements produced by the slower galvo scanners. The movements of the resonant scanner are too fast to be fully compensated, because RF systems implemented with either galvos (Botcherby et al., 2012), voice coils (Figure 6—figure supplement 1), or piezos (unpublished observations) cannot match the resonant scanning bandwidth. Fast resonant scan lines are by necessity tilted, which is more pronounced close to the edge of the FOV. For many in vivo applications the residual field curvature is expected to be only a small inconvenience, because neurons of interest in different brain areas are typically in different focal planes.
The serial scan system allows for both low-magnification imaging across a large area and high-resolution imaging across smaller, but widely separated, areas. Low-magnification imaging can be combined with online analysis to identify brain areas with particular activity patterns of interest. Once these areas are found, high-resolution imaging can interrogate populations of individual neurons within those areas. The low-magnification image can be used to optimally place these smaller imaging regions around the vasculature.
We performed GDD compensation to maximize peak power delivered for a given average power. Larger peak power then can be used to maintain the same signal to noise ratio during faster scanning with smaller pixel dwell times. Optimal placement of imaging regions and faster scanning combined with smaller jump times between regions will allow for simultaneous tracking of tens of thousands neurons across the cortex at 10 Hz.
Microscopes with yet larger fields of view are possible. However, given fixed NA, larger fields of view correspond to larger objectives. Larger PMTs will be required to efficiently collect the fluorescence transmitted by these giant objectives.
There is considerable interest in more natural, unconstrained, and therefore more variable animal behaviors. Relating the underlying neural population activity to behavior will require single-trial analysis, which is limited by the number of neurons that can be recorded in multiple brain regions (Churchland et al., 2007). Mesoscale recording systems, such as 2p-RAM, allow recordings from thousands of neurons across multiple brain areas. These large numbers are critical to achieve single-trial decoding of neural activity patterns during behavior.
Materials and methods
All surgical and experimental procedures were in accordance with protocols approved by the HHMI Janelia Research Campus Institutional Animal Care and Use Committee (IACUC 14–115). All mice were over 8 weeks old at the time of surgery. Two mice were females (both GP4.3; JAX 024275), and two were males (GP5.17; JAX 025393 and emx1-cre x lsl h2b-GFP; JAX 005628; JAX 023139, from lab of Josh Huang). Surgeries and anesthetized imaging were performed under isoflurane anesthesia (1–2%), while mice were maintained at 37°C with a heat blanket (Huber et al., 2012). Mice were given at least five days to recover from surgery before awake imaging experiments. Analysis code was written in Python and used Jupyter notebooks. Code, data, and CAD models are available at https://github.com/sofroniewn/2pRAM-paper.
References
-
Genetically encoded calcium indicators for multi-color neural activity imaging and combination with optogeneticsFrontiers in Molecular Neuroscience 6:2.https://doi.org/10.3389/fnmol.2013.00002
-
Optimization of a GCaMP calcium indicator for neural activity imagingJournal of Neuroscience 32:13819–13840.https://doi.org/10.1523/JNEUROSCI.2601-12.2012
-
Extremely simple single-prism ultrashort- pulse compressorOptics Express 14:10101–10108.https://doi.org/10.1364/OE.14.010101
-
Aberration-free three-dimensional multiphoton imaging of neuronal activity at kHz ratesProceedings of the National Academy of Sciences of the United States of America 109:2919–2924.https://doi.org/10.1073/pnas.1111662109
-
Techniques for extracting single-trial activity patterns from large-scale neural recordingsCurrent Opinion in Neurobiology 17:609–618.https://doi.org/10.1016/j.conb.2007.11.001
-
Anatomical and functional imaging of neurons using 2-photon laser scanning microscopyJournal of Neuroscience Methods 54:151–162.https://doi.org/10.1016/0165-0270(94)90189-9
-
BookTwo-photon molecular excitation in laser-scanning microscopyIn: Pawley JB, editors. Handbook of Biological Confocal Microscopy. New York: Plenum Press. pp. 445–458.
-
Fast two-layer two-photon imaging of neuronal cell populations using an electrically tunable lensBiomedical Optics Express 2:2035–2046.https://doi.org/10.1364/BOE.2.002035
-
Characterization and adaptive optical correction of aberrations during in vivo imaging in the mouse cortexProceedings of the National Academy of Sciences of the United States of America 109:22–27.https://doi.org/10.1073/pnas.1109202108
-
Visualizing mammalian brain area interactions by dual-axis two-photon calcium imagingNature Neuroscience 17:1825–1829.https://doi.org/10.1038/nn.3867
-
Expanded dynamic range of fluorescent indicators for Ca(2+) by circularly permuted yellow fluorescent proteinsProceedings of the National Academy of Sciences of the United States of America 101:10554–10559.https://doi.org/10.1073/pnas.0400417101
-
Two-photon microscopy in brain tissue: parameters influencing the imaging depthJournal of Neuroscience Methods 111:29–37.https://doi.org/10.1016/S0165-0270(01)00438-1
-
Comprehensive imaging of cortical networksCurrent Opinion in Neurobiology 32:115–123.https://doi.org/10.1016/j.conb.2015.03.016
-
The small pyramidal neuron of the rat cerebral cortex The Axon Hillock and Initial SegmentThe Journal of Cell Biology 39:604–619.https://doi.org/10.1083/jcb.39.3.604
-
Fast three-dimensional laser scanning scheme using acousto-optic deflectorsJournal of Biomedical Optics 10:064038.https://doi.org/10.1117/1.2141504
-
Natural whisker-guided behavior by head-fixed mice in tactile virtual realityJournal of Neuroscience 34:9537–9550.https://doi.org/10.1523/JNEUROSCI.0712-14.2014
-
In vivo two-photon calcium imaging of neuronal networksProceedings of the National Academy of Sciences of the United States of America 100:7319–7324.https://doi.org/10.1073/pnas.1232232100
-
Ultra-large field-of-view two-photon microscopyOptics Express 23:13833–13847.https://doi.org/10.1364/OE.23.013833
-
BookPrinciples, design and construction of a two photon scanning microscope for in vitro and in vivo studiesIn: Frostig R, editors. Methods for In Vivo Optical Imaging. Boca Raton, FL: CRC Press. pp. 113–171.
-
Nonlinear magic: multiphoton microscopy in the biosciencesNature Biotechnology 21:1369–1377.https://doi.org/10.1038/nbt899
-
Long-term dynamics of CA1 hippocampal place codesNature Neuroscience 16:264–266.https://doi.org/10.1038/nn.3329
Article and author information
Author details
Funding
Howard Hughes Medical Institute
- Karel Svoboda
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Acknowledgements
We thank Courtney Davis and Simon Peron for help with cranial window surgeries; David Tracy and Julie Bentley for help with optical design; Jon Arnold for mechanical engineering support; Jay Kumler, Dan Sykora, and Matt Falanga (Jenoptik) for help with optical design and testing; Jeff Brooker and Shane Patton (Thorlabs) for custom mechanical engineering; Aaron Kerlin and Vasily Goncharov for help with the remote focus system; Jeremy Freeman for help with analysis; Kaspar Podgorski, Arseny Finkelstein, Na Ji, Simon Peron, and Aaron Kerlin for comments on the manuscript.
Ethics
Animal experimentation: All procedures were in accordance with protocols approved by the Janelia Research Campus Institutional Animal Care and Use Committee. IACUC 14-115.
Copyright
© 2016, Sofroniew et al.
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.
Metrics
-
- 28,310
- views
-
- 4,117
- downloads
-
- 539
- citations
Views, downloads and citations are aggregated across all versions of this paper published by eLife.
Download links
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Further reading
-
- Biochemistry and Chemical Biology
- Structural Biology and Molecular Biophysics
Inhibition of Bruton’s tyrosine kinase (BTK) has proven to be highly effective in the treatment of B-cell malignancies such as chronic lymphocytic leukemia (CLL), autoimmune disorders, and multiple sclerosis. Since the approval of the first BTK inhibitor (BTKi), Ibrutinib, several other inhibitors including Acalabrutinib, Zanubrutinib, Tirabrutinib, and Pirtobrutinib have been clinically approved. All are covalent active site inhibitors, with the exception of the reversible active site inhibitor Pirtobrutinib. The large number of available inhibitors for the BTK target creates challenges in choosing the most appropriate BTKi for treatment. Side-by-side comparisons in CLL have shown that different inhibitors may differ in their treatment efficacy. Moreover, the nature of the resistance mutations that arise in patients appears to depend on the specific BTKi administered. We have previously shown that Ibrutinib binding to the kinase active site causes unanticipated long-range effects on the global conformation of BTK (Joseph et al., 2020). Here, we show that binding of each of the five approved BTKi to the kinase active site brings about distinct allosteric changes that alter the conformational equilibrium of full-length BTK. Additionally, we provide an explanation for the resistance mutation bias observed in CLL patients treated with different BTKi and characterize the mechanism of action of two common resistance mutations: BTK T474I and L528W.
-
- Structural Biology and Molecular Biophysics
Segmentation is a critical data processing step in many applications of cryo-electron tomography. Downstream analyses, such as subtomogram averaging, are often based on segmentation results, and are thus critically dependent on the availability of open-source software for accurate as well as high-throughput tomogram segmentation. There is a need for more user-friendly, flexible, and comprehensive segmentation software that offers an insightful overview of all steps involved in preparing automated segmentations. Here, we present Ais: a dedicated tomogram segmentation package that is geared towards both high performance and accessibility, available on GitHub. In this report, we demonstrate two common processing steps that can be greatly accelerated with Ais: particle picking for subtomogram averaging, and generating many-feature segmentations of cellular architecture based on in situ tomography data. Featuring comprehensive annotation, segmentation, and rendering functionality, as well as an open repository for trained models at aiscryoet.org, we hope that Ais will help accelerate research and dissemination of data involving cryoET.