Neuronal circuit mapping using electron microscopy demands laborious proofreading or reconciliation of multiple independent reconstructions. Here, we describe new methods to apply quantitative arbor and network context to iteratively proofread and reconstruct circuits and create anatomically enriched wiring diagrams. We measured the morphological underpinnings of connectivity in new and existing reconstructions of Drosophila sensorimotor (larva) and visual (adult) systems. Synaptic inputs were preferentially located on numerous small, microtubule-free 'twigs' which branch off a single microtubule-containing 'backbone'. Omission of individual twigs accounted for 96% of errors. However, the synapses of highly connected neurons were distributed across multiple twigs. Thus, the robustness of a strong connection to detailed twig anatomy was associated with robustness to reconstruction error. By comparing iterative reconstruction to the consensus of multiple reconstructions, we show that our method overcomes the need for redundant effort through the discovery and application of relationships between cellular neuroanatomy and synaptic connectivity.https://doi.org/10.7554/eLife.12059.001
The nervous system contains cells called neurons, which connect to each other to form circuits that send and process information. Each neuron receives and transmits signals to other neurons via very small junctions called synapses. Neurons are shaped a bit like trees, and most input synapses are located in the tiniest branches. Understanding the architecture of a neuron’s branches is important to understand the role that a particular neuron plays in processing information. Therefore, neuroscientists strive to reconstruct the architecture of these branches and how they connect to one another using imaging techniques.
One imaging technique known as serial electron microscopy generates highly detailed images of neural circuits. However, reconstructing neural circuits from such images is notoriously time consuming and error prone. These errors could result in the reconstructed circuit being very different than the real-life circuit. For example, an error that leads to missing out a large branch could result in researchers failing to notice many important connections in the circuit. On the other hand, some errors may not matter much because the neurons share other synapses that are included in the reconstruction.
To understand what effect errors have on the reconstructed circuits, neuroscientists need to have a more detailed understanding of the relationship between the shape of a neuron, its synaptic connections to other neurons, and where errors commonly occur. Here, Schneider-Mizell, Gerhard et al. study this relationship in detail and then devise a faster reconstruction method that uses the shape and other properties of neurons without sacrificing accuracy. The method includes a way to include data from the shape of neurons in the circuit wiring diagrams, revealing circuit patterns that would otherwise go unnoticed.
The experiments use serial electron microscopy images of neurons from fruit flies and show that, from the tiniest larva to the adult fly, neurons form synapses with each other in a similar way. Most errors in the reconstruction only affect the tips of the smallest branches, which generally only host a single synapse. Such omissions do not have a big effect on the reconstructed circuit because strongly connected neurons make multiple synapses onto each other.
Schneider-Mizell, Gerhard et al.'s approach will help researchers to reconstruct neural circuits and analyze them more effectively than was possible before. The algorithms and tools developed in this study are available in an open source software package so that they can be used by other researchers in the future.https://doi.org/10.7554/eLife.12059.002
Mapping neuronal circuits from electron microscopy (EM) volumes is hard (Helmstaedter, 2013). Manually working through large volumes is slow and prone to attentional errors (Kreshuk et al., 2011; Helmstaedter et al., 2011). Combining multiple independent reconstructions of the same neuron can reduce errors (Helmstaedter et al., 2011; Kim et al., 2014) at the cost of multiplying the required labor. Current computational approaches operate only with 'local' information, that is, the EM micrographs and algorithmically detected fine structures such as cell membranes and mitochondria. They are therefore sensitive to noise (Jain et al., 2010), particularly in anisotropic EM data where the smallest neurites may be thinner than the thickness of individual serial sections (Veeraraghavan et al., 2010; Helmstaedter, 2013). Machine-generated neuron reconstructions are therefore proof-read by humans (Chklovskii et al., 2010; Haehn et al., 2014).
Expert neuroanatomists are able to resolve ambiguities that novices and current algorithmic approaches cannot by using large-scale features of neurons to inform decisions made at the level of nanometer-scale image data. For example in Drosophila, where neurons are highly stereotyped, large branches in an EM reconstruction of a given cell can be confirmed by comparing the observed anatomy to that of homologous cells from light microscopy data or other reconstructions (Takemura et al., 2013; Ohyama et al., 2015). This suggests that one way to improve the toolkit for neuron reconstruction and circuit mapping is to facilitate the use of cell- and circuit-level features to find and resolve errors and ambiguities.
Crucially, different errors do not alter the wiring diagram equally. Missing small dendrites can be acceptable. Useful and reproducible wiring diagrams can be created even when omitting 56% of all postsynaptic sites (Takemura et al., 2013), but missing a single large branch hosting all the synapses in one neuropil region could omit connectivity to entire populations of partners. Prioritizing proofreading time toward those errors that most significantly affect the interpretation of the data improves reconstruction efficiency (Plaza et al., 2012; Kim et al., 2014).
To understand the effect of reconstruction errors on measured synaptic connectivity, we need to understand the relationship between synaptic connectivity and cellular neuroanatomy. Mesoscale anatomy, particularly the placement of large branches, is a key component of circuit structure (Zlatić et al., 2003, 2009; Wu et al., 2011; Couton et al., 2015). Similarly, the connectivity graph of a stereotyped circuit can relate back to anatomy by consideration of the location of the synaptic sites between pairs of neurons. However, little is known about the smallest scales of synaptic connectivity, the distribution of individual synapses on a neuron. Microtubule-free and actin-rich structures have been identified as key sites of excitatory input in the adult Drosophila visual system (Scott et al., 2003; Leiss et al., 2009), but it is unclear how ubiquitous these are in the nervous system.
Here, we describe a collection of quantitative anatomical and connectivity features across scales, from fine dendritic branches to multi-neuron graphs, and tools for measuring them to swiftly and accurately map a wiring diagram from EM. We implemented the calculation and visualization of such features on-demand as an extension of the web-based large image data viewer CATMAID (Saalfeld et al., 2009). We propose a novel method for interactively using these features to reconstruct neuronal circuits through iterative proofreading at the level of both EM images and higher level features. We validated this approach by comparing the speed and accuracy of our iterative method to a consensus method, where multiple independent reconstructions are used to calculate regions of agreement across individuals (Helmstaedter et al., 2013). Because the detection of high-impact errors can occur concurrently with reconstruction via interactive analysis, our tool removes the need for time-consuming repeated reconstructions (Helmstaedter et al., 2013; Kim et al., 2014). Moreover, because reconstructed neurons did not need to be hidden to ensure independence between repeated reconstructions, our method facilitates concurrent, synergistic collaboration between expert neuroanatomists who, for example, map circuits in different brain regions that happen to spatially overlap or synaptically interact. We demonstrate our methods by mapping a sensorimotor circuit in the Drosophila larva from proprioceptive sensory neurons to motor neurons.
We extended the web-based image data viewer CATMAID (Saalfeld et al., 2009) to enable a geographically distributed group of researchers to map neuronal circuitry. A neuron is reconstructed with a skeleton, a directed tree graph with one or more nodes in every cross-section of neurite in an EM volume (Helmstaedter et al., 2011; Cardona et al., 2012). Nodes have a spatial coordinate, as well as metadata including authorship, timestamp, review status, and optional annotations such as a radius value, text labels. Importantly, nodes also have a confidence value that can be lowered to indicate uncertainty in following a branch. Where possible, we root skeletons at the soma to model the anatomical notions of proximal and distal in the data structure.
Synapses (Figure 1A and Figure 1—figure supplement 1) are annotated as a relation from a node on the presynaptic neuron skeleton to an intermediate 'connector node' and then to a node of a postsynaptic neuron skeleton. To express the polyadic nature of insect synapses (Meinertzhagen and O’Neil, 1991), connector nodes can have multiple postsynaptic 'targets', but only one presynaptic 'source'. Reconstructions are immediately synchronized across all collaborators to avoid duplicate or conflicting work, and to take advantage of existing reconstructions to aid further reconstruction and circuit discovery.
As a case study of our method, we focused on sensorimotor circuits in an abdominal segment of the first instar Drosophila larval central nervous system (CNS) using an EM volume covering one and a half abdominal segments (Ohyama et al., 2015). In total for this work, nine lab members reconstructed and proofread 425 neuronal arbors spanning 51.8 mm of cable, with 24,068 presynaptic and 50,927 postsynaptic relations, (see 'Materials and methods' for details). Reconstruction time was 469 hours for reconstruction with synapse annotations plus 240 hours for review (see below), for an average rate of ∼73 microns of proofread arbor with synapses per hour.
To be able to use neuronal anatomy to guide circuit reconstruction, it was crucial to better understand the distribution of synaptic input onto Drosophila neurons. We started by looking in detail at the relationship between the synaptic inputs (Figure 1A–B) and microtubule cytoskeleton (Figure 1C–E) in EM reconstructions of neurons from different regions of the nervous system and life stages. For a diverse collection of neurons, we marked all locations where the arbor continued distal to a microtubule-containing process (Figure 1E, Figure 2A). We call such a terminal branch a 'twig'. By definition, all twigs have their base on a microtubule-containing backbone shaft. Following the classification in Leiss et al. (Leiss et al., 2009), a spine is a twig with a maximal depth of less than 3 µm and that is not a presynaptic varicosity (Figure 2A).
We found twigs in all neurons investigated, across multiple CNS regions and life stages of Drosophila, and in all cases, they were the dominant sites of synaptic input (Figure 2B–G). We first considered larval motor neurons aCC and RP2 (Landgraf et al., 1997), which have functional and structural similarities to vertebrate neurons (Sánchez-Soriano et al., 2005; Nicolï et al., 2010; Günay et al., 2015). In the first instar CNS, we find aCC and RP2 have numerous twigs, which together host more than 80% of their total number of postsynaptic sites (Figure 2C). We found a similar majority of inputs onto twigs in three hemisegmental pairs of premotor interneurons (Figure 2D) and brain neurons (Ohyama et al., 2015) in the first instar larva (Figure 2E). We tested whether the observed distribution of postsynaptic sites onto twigs generalizes across larval stages by comparing a somatosensory interneuron in the first instar to its homologue in late third instar (Figure 2F). At both life stages, we find more than 80% of inputs were onto twigs, suggesting that twigs are not a temporary developmental structure. In the adult fly, light microscopy-level analysis of lobula plate tangential cells of the visual system suggests a similar distribution of postsynaptic sites onto twigs (Leiss et al., 2009; Scott et al., 2003). We annotated EM skeletonizations of medullar Tm3 neurons reconstructed by Takemura et al. (2013) in the adult visual system neuropil and found that nearly all their inputs were onto twigs (Figure 2G). Our findings suggest that microtubule-free twigs are a general feature of Drosophila neurons and constitute the primary anatomical location of synaptic input. Spine-like twigs are found in all cell types, but host a variable, typically non-majority, amount of synaptic input (Figure 2C–G). We consider all twigs for the remainder of our analysis.
For a given presynaptic partner, a postsynaptic neuron could concentrate its input synapses onto a single region or distribute them widely. The spatial distribution of synaptic inputs has implications for dendritic processing (Polsky et al., 2004), developmental robustness (Couton et al., 2015), and as we show, reconstruction accuracy.
To study the relationship between presynaptic neurons and the anatomical locations of post-synaptic sites, we reconstructed all neurons synaptically connected to motor neurons aCC and RP2 in the third abdominal segment of a first instar larva (Figure 3A-D).
A dynamically generated and interactive table of synaptic connectivity in CATMAID enabled users to systematically trace all connected arbors. We found 198 identifiable neurons (Figure 3—figure supplement 1) and named them according to a developmental lineage-based nomenclature (Ohyama et al., 2015), classified 107 other arbors spanning the full segment into eight distinct intersegmental bundles (Figure 3—figure supplement 2), and classified 120 small fragments that could not be joined into larger arbors. We refer to the connection between a pre- and postsynaptic neuron as an ‘edge’ in the connectivity network, where each edge has a weight equal to the number of synapses between the two neurons. Motor neurons each received between 1 and 28 synaptic inputs from individual presynaptic neurons, with a maximum of 7.3% of all inputs coming from a single neuron (Figure 3E). The fraction of synapses accounted for by their presynaptic partners, rank-ordered by number of synapses, is well-fit by an exponential survival function, with a decay indicating that approximately the top 22 presynaptic partners of one motor neuron contribute 63% of all its synaptic inputs (Figure 3F).
We next asked how the synaptic input onto aCC and RP2 is distributed across independent twigs. Most individual twigs were small, with the median twig measuring 1 µm in cable and hosting 1 postsynaptic site. The largest typical twig had 16 µm of cable and 20 postsynaptic sites (Figure 3G). We find that presynaptic neurons connect to between 0 (backbone only) and 13 twigs, with nearly all connections with 3 or more synapses per edge being distributed across multiple twigs (Figure 3H). Similarly, numerically strong edges spanned multiple twigs in the adult visual system Tm3 neurons (Figure 3—figure supplement 3).
Different neuronal compartments have different metabolic requirements, such as vesicle recycling at presynaptic sites or restoring resting ion concentrations after postsynaptic response to neurotransmitter signaling (Attwell and Laughlin, 2001; Perkins et al., 2010). To investigate whether the spatial distribution of mitochondria is a signature of different arbor compartments, we annotated the location of all mitochondria in the four motor neurons and the six premotor interneurons from Figure 2D (Figure 4A–C). Most mitochondria (348/425) were associated with backbone across motor neurons (Figure 4D) and interneurons (Figure 4E). Surprisingly, we found that 97% of central presynaptic sites were located within 3 µm of a mitochondrion (Figure 4F), although only 47% of cable was located within the same distance. A similar rule did not hold with postsynaptic sites, which were more broadly distributed (Figure 4G). This suggests that presynaptic sites and mitochondria are kept near one another, making mitochondrial proximity a useful constraint for validating synapse annotation.
Consistent with this, presynaptic sites were typically also directly associated with microtubules (Figure 4H). Approximately 50% of presynaptic sites were located on the backbone and 90% were within 3 µm.
We next looked at the cell and circuit level for regularities that could inform proofreading.
In the Drosophila larva, developmentally homologous neurons are strongly stereotyped (Li et al., 2014), making quantitative analysis of their properties useful for identifying irregularities between homologous cells. Most cell types are represented in the fly nervous system by at least one homologous bilateral pair of individual cells. Bilateral homology suggests that both arbor morphology and synaptic wiring are mirrored, up to developmental noise (Ohyama et al., 2015). To let morphology guide proofreading, we developed a collection of neuroanatomical measurements that were independent of absolute location. These metrics, combined with 3d visualization, quickly summarize the structure of complex neurons to help identify and localize inconsistencies (Figure 5).
As a case study, we applied our tools to describe a complete sensorimotor circuit. During forward crawling, a peristaltic wave of muscle contraction travels from posterior to anterior segments (Hughes and Thomas, 2007; Heckscher et al., 2012). Signals from the segmentally repeated proprioceptive neurons dbd have been suggested to act via a polysynaptic inhibitory pathway to stop motor neuron activity after successful contraction of a given segment (Hughes and Thomas, 2007). To find pathways between proprioceptive and motor neurons, we further reconstructed axons for proprioceptive sensory neurons dbd, vbd, dmd1, ddaD, and ddaD (Hughes and Thomas, 2007; Grueber et al., 2007). Because of its implication in proprioceptive feedback (Hughes and Thomas, 2007), we further reconstructed all partners of the left and right dbd (Figure 6A).
Using a graph search within CATMAID, we identified all 1–3 hop pathways from dbd to motor neuron RP2. Comparison of the identifiable intermediate neurons revealed five pairs of homologous neurons with consistent shape, connectivity, and quantitative morphological properties (Figure 6B,C). Inconsistencies in any property led to further review to determine if they were due to reconstruction error, true developmental variability (Figure 6—figure supplement 1) , or limitations of the raw data. For example, one strong inconsistency in this network, the connection from A02l to A31k (Figure 6B), was due to the expected synapse locations being outside the imaged volume on one side but not the other (Figure 6—figure supplement 2).
The five pairs of identified neurons could also be matched to light-level images of neurons identified through sparse stochastic labeling (Nern et al., 2015) of neurons within a GAL4 expression pattern (Figure 6C). Of these, two directly premotor interneurons (A27j and A31k) are immunoreactive to anti-GABA (Figure 6—figure supplement 3), whereas the others, all from A02 lineage, are members of the glutamatergic neuron class described in Kohsaka et al. (2014). These novel, putatively inhibitory sensorimotor pathways are well-positioned to mediate a hypothesized 'mission accomplished' signal (Hughes and Thomas, 2007). This map also could explain why genetic silencing of A02 neurons was shown to slow peristalsis (Kohsaka et al., 2014), as doing so removes a major channel for proprioceptive feedback which is necessary for normal rates of persitaltic waves (Suster and Bate, 2002).
The physiology of synaptic input and output can differ across neuronal compartments. For example, presynaptic inhibition (inhibitory synaptic input onto axon terminals) is important for gain control in fly sensory circuits in a fundamentally distinct manner than dendritic inhibition (Clarac and Cattaert, 1996). This suggests that connectivity can be stereotyped at the compartmental level and therefore useful for proofreading. We thus sought a graph representation of a circuit that could faithfully distinguish distinct types of connections (Figure 7).
In Drosophila, many neuronal cell types have distinct input and output compartments, while a few have entirely intermingled inputs and outputs. Our approach assumes that the neuron can be split into distinct compartments, and at the end checks to see if the split was successful. First, we calculate all paths along the skeleton from each of the neuron’s input synapses to each of its output synapses and for each node of the skeleton compute the number of centripetal (toward soma) and centrifugal (away from soma) paths that pass through it (Figure 7A–B). This quantity, which we call “synapse flow centrality” (SFC), is analogous to a synapse-specific version of betweenness centrality (Newman, 2010). For most neuronal arbors, we find that the most proximal skeleton node with the highest centrifugal SFC corresponds to an intuitive generalization of the locations of spike initiation zones in known polarized neurons of Drosophila (Gouwens and Wilson, 2009; Günay et al., 2015) and other insects (Gabbiani et al., 2002).
We quantify how completely input and output are separated on a neuron with a 'segregation index,' an entropy-based measure of the amount of input/output mixing in each compartment, normalized by that of the whole arbor (see 'Materials and methods'). A very low segregation index means that pre- and post-synaptic sites are intermingled and an axon/dendrite compartmentalization is inappropriate (Figure 7—figure supplement 1). Using this approach, we classified all identifiable neurons found in both the left and right hemisegments of the proprio-motor circuitry described above. Of the 3834 synapses between these cells, we found 79% were axo-dendritic (3033), 11% axo-axonic (424), 9% dendro-dendritic (334) and 1% dendro-axonic (43).
We consider two examples of how compartment-enriched graphs add important anatomical detail to small microcircuits. First, we analyzed how different proprioceptive inputs converge onto motor neuron RP2 (Figure 7C–E). By splitting interneuron A02b into axon and dendrite, we observed that its dendrites receive bilateral proprioceptive input, while its axon synapses both onto the ipsilateral RP2 and axo-axonically onto its strong premotor partner, A03a1 in both hemisegments (Figure 7C). In contrast, while dbd only connects indirectly with A02b (Figure 6A), it synapses exclusively ipsilaterally and axo-axonicaly onto A03a1 (Figure 7C). This suggests that the role of dbd in modulating motor patterns could be qualitatively different than the other proprioceptive sensory neurons, since its direct pathways are typically longer or involve connections types other than axo-dendritic.
Second, we analyzed interactions between the premotor neurons of aCC and RP2 (Figure 7D,E). We found that a neuron presynaptic to the aCC motor neuron on both sides targets dendro-dendritically a pre-RP2 neuron (A27h), potentially coordinating the joint excitation of their targets (Figure 7D). We also found a premotor interneuron (A27e) with reciprocal connections with a GABAergic premotor interneuron (A27j; see Figure 6—figure supplement 3) that receives convergent inputs from dorsal proprioceptive neurons (dmd1, ddaD, ddaE; Figure 7D). This suggests that A27j might not only act as an inhibitory premotor input in response to proprioceptive activity, but also have subtler modulatory effects onto other sources of motor input.
Specific connections can also be allocated to specific arbor compartments, which could be used to localize proofreading guided by inconsistencies in connectivity. We thus extended the concept of splitting a neuron into two arbor compartments to an arbitrary number, by defining a compartment as a cluster of synapses near each other along the arbor cable (see 'Materials and methods'). As an example, we consider the axon terminal of dbd, which enters at the interface between two segments and extends symmetric arbors toward the anterior and posterior segments (Figure 8A). The synapses form multiple well-separated clusters that we can visualize as a group of graph nodes (Figure 8B–C), revealing that the anterior and posterior branches synapse onto homologous interneurons (A08a) for their respective segments (Figure 8D–E). This pattern suggests that each A08a cell gets convergent input from the dbd of two consecutive segments, which could reflect that adjacent pairs of segments move together during locomotion (Heckscher et al., 2012).
Based on the suite of features described above, we developed a two-step iterative method of proofreading after an initial reconstruction (Figure 9). An initial systematic review consists in traversing a whole arbor from distal to proximal to follow the expected gradual changes in anatomical properties (e.g. caliber tapering and cytoskeletal changes from microtubule-free to increasing number of microtubules). By freeing mental attention from complex spatial navigation, we found that the systematic review leads to the quick discovery of attentional errors, such as missed synapses, or anatomical inconsistencies, such as a non-contiguous microtubule cytoskeleton. The systematic review status is stored on a per-skeleton node and per-contributor basis (see 'Materials and methods' for details). To allow contributors to incorporate the level of proofreading for each neuron into their evaluation of the neurons and circuits, review status of a neuron is displayed throughout CATMAID, as measured by fraction of the skeleton nodes reviewed. For example, when listing synaptic partners for neurons of interest, the review status of all partners is shown alongside information such as neuron name and number of associated synapses.
Next, contributors reconstruct the same set of neurons in a different hemisegment (such as the contralateral side) and then inspect high-level quantitative anatomical and connectivity measurements for inconsistencies (Figure 9). In most cases, these inconsistencies can be associated with specific compartments of a neuronal arbor, which are then subjected to focused review. This approach helps ensure that the broad structure of the neuron is consistent and that the large branches are correct, as errors in them would significantly alter the reconstructed circuit. CATMAID provides tools for transitioning from a potential error identified at a high level, to the images supporting the reconstructed skeletons involved. The key property enabling this is the interactivity of CATMAID’s built-in analytical tools that allow for navigating from graphs, 3d views and plots to lists of synapses and spatial locations, and ultimately to the original skeletonizations overlaid on the images (Figures 5 and 9).
Irregularities noticed in higher level features only serve to guide attention, not determine correctness. Any error correction is performed manually on the basis of local information as contained within the EM images (e.g. microtubules, texture, or consistency with neighboring neurites). Despite strong stereotypy in general, developmental variability is present even at the level of high-order branches although often in ways that do not affect connectivity (Figure 6—figure supplement 1).
Our approach to circuit mapping consists of a single initial arbor reconstruction, followed by edits by the same or different collaborators during proofreading or incidental discovery of errors during subsequent work. Small arbor pieces, left over from pruning when proofreading other neurons or from explorative reconstructions in search of specific neurons, are merged in. We refer to this as “iterative,” as compared to consensus methods that combine multiple independent reconstructions (Helmstaedter et al., 2011; Takemura et al., 2013; Kim et al., 2014).
We evaluated the accuracy of our method for Drosophila circuits by comparing our results to the those of a consensus approach. We selected six interconnected neurons from the premotor network for independent reconstruction by four individuals. Each individual skeletonized and reviewed his or her reconstructions. Consensus skeletons were then computed for each neuron using RESCOP (Helmstaedter et al., 2011).
Both methods resulted in extremely similar arbors, although each method found branches not seen in the other (Figure 10A, Figure 10—figure supplement 1). All sites of disagreement between the two methods were validated by an expert to determine a gold-standard morphology. Reconstruction and review of these six neurons in the iterative approach took a total of 26.37 hours, while the redundant method by four people took a total of 107.73 hours, almost exactly four times as long.
Existing consensus approaches only calculate neuronal morphology, not synaptic connectivity. Each chunk of the consensus skeleton is associated with the subset of the independent skeletons that are mutually consistent at that location. For some branches, all four individuals agreed, while in others the consensus was based on fewer skeletons. We estimated the connectivity between consensus skeletons by adding each postsynaptic site from each independent skeleton in the consensus, normalized by the number of skeletons contributing to the consensus at that location. Therefore, a given synapse would have a weight of one, the typical value, if it were annotated in all independent skeletons.
We found that both methods recover an identical set of edges in the wiring diagram, with similar number of synapses per edge (Figure 10B,C). We next considered the fine differences between consensus skeletons and skeletons reconstructed with our method. The six gold-standard neurons had a total of 1341 postsynaptic sites, with 111 on neurites only present in the consensus skeletons, 229 on neurites only in our method’s reconstructions, and 1001 in the arbor found by both. We located 91 missed or incomplete branches (false negatives) in our method, 89 in twigs and 2 in backbones; and 7 incorrect continuations (false positives), 6 in twigs and 1 in backbone. False positives added 30 incorrect postsynaptic inputs in total. Individual missed branches were small in size, complexity, and number of synapses (Figure 10E–G), with more than 40 missed or truncated twigs having no influence on connectivity (Figure 10F). The 3 errors in backbones occurred in small distal dendritic shafts containing one single microtubule, resulting in 7 missed and 4 false postsynaptic sites. Error rates for synaptic output were even lower. The gold-standard neurons had a total of 510 presynaptic sites, of which 509 were found by our iterative reconstructions.
Our data suggest that anatomical structure strongly influences the rate of reconstruction errors in our iterative method. Our total error rate is dominated by false negatives and is much higher for twigs (16.2 µm/error) than for backbone (375.8 µm/error). While attentional errors seemed to dominate missed branches, data ambiguities were often associated with backbone errors. One backbone false merge happened across two adjacent sections in poor registration with one another, while an erroneous truncation occurred across a section where electron-dense precipitate occluded the neurite and its surrounding area.
Neuroanatomy strongly constrains the effect of a typical error on the wiring diagram because, as shown above, the most likely error is to miss a twig and an individual twig hosts few or no synapses.
To estimate the probability of omitting a true edge in the wiring diagram, we analyzed the distribution of synaptic contacts across twigs as a function of the total number of synapses per edge. Edges comprising multiple synaptic contacts were found to be distributed across multiple twigs (Figure 3J). With the RESCOP-based validation, we found that our method identified 88% (672/761) of twigs, containing 91.7% of synapses (1230/1341). From these two observations, we estimated the probability of completely missing a true edge as a function of the number of morphological synapses per edge. We found that our method recovers more than 99% of the wiring diagram edges that have at least 3 synapses (Figure 11A), assuming twigs are missed uniformly at random (see Figure 11—figure supplement 1).
In Drosophila, we are primarily interested in the most reliable edges between cell types, as those are most likely to generalize across individual animals. Moreover, we are concerned less about adding extra synapses to true connections and more about adding false edges that would be interpreted as pathways that are not actually present. To estimate the likelihood of introducing a false edge between cell types not just once, but twice (e.g. in a left and right pair of homologs), we simulated adding false twigs to a neuron. The probability of adding a false edge depends both on the probability of adding a false twig (observed false positive error rate: 7 errors in 605 twigs) and the number of nearby but unconnected neurons with presynaptic sites. This will vary depending on the circuit in question. For example, a neuropile with all-to-all connectivity will have no opportunity for false positive edges, while in an array of rigorously separated labeled lines any false positive synapse would be a false positive edge. Further, larger neurons offer more opportunities for false positives than smaller neurons.
For a concrete and realistic example, we consider the motor neuron RP2 (a large neuron). We estimated the number of proximate but unconnected neurons by considering all axons presynaptic to all motor neuron dendritic fields that overlap RP2’s dendrites (Figure 11B). We assume that a false-positive reconstruction error distributes m synapses across all available axons at random. Even if we assume that m is always among the largest observed (m = 20, which is far larger than the average; Figure 3G), our model suggests that for the RP2 wiring diagram we can trust symmetric connections of at least 2 synapses (Figure 11C). We further note that the small size of individual twigs and the ability in CATMAID to jump directly to the image data associated with synapses comprising an edge make review of a suspect false positive edge extremely fast, on the order of seconds.
Since most errors were of omission and took the form of truncated twigs, we also measured the effect of omitting the distal ends of twigs. Considering again aCC and RP2, we looked at the connectivity observed by considering only synapses located at a given depth into the twig relative to its base on the backbone (Figure 12A). With all twigs cropped to zero depth, only inputs onto the backbone remain. More than 90% of postsynaptic sites lay within 5 µm of the backbone (Figure 12B). We observed that the first 2 µm already yields at least two synapses, recovering ∼90% of the most connected partners. The first 4 µm similarly detects ∼90% of all partners with 2 or more synapses and 27/28 pairs of homologous edges (Figure 12C). These results indicate that, given the observed distribution of synapses over multiple twigs, wiring diagram edges with many synapses are robust to errors of omission such as truncated twigs. Considering the marginal time involved in reconstructing the full extent of twigs (Figure 12C), this robustness could be intentionally exploited towards discovering strong synaptic partners in a time-efficient manner.
Neurons are highly structured cells. A human expert’s success at circuit mapping from EM volumes stems from the ability to use this structure and apply cell and circuit-level context to interpret nanometer-scale image data. Here, we presented our approach to circuit mapping in EM by building tools in CAT-MAID that ease and emphasize the use of high level features concurrent with image-level reconstruction. While every reconstruction and editing decision is performed manually, it is informed by a host of quantitative neuroanatomical and connectivity measures computed on demand and, where possible, tightly linked to specific locations in the EM image volumes. In addition to applying existing metrics, we also devised novel algorithms and measures to describe the distribution of synapses across neurons, a feature uniquely well-measurable by EM. Because this method is based extensively on existing information, contributors iterate reconstructions towards more and more correct states. We showed that this more efficiently produces data at least as accurate as computing the consensus of multiple independent reconstructions.
Central to our approach is the observation that Drosophila neurons contain a contiguous microtubule-rich backbone and numerous small microtubule-free distal twigs. We found that small twigs are the primary site of synaptic input for Drosophila neurons and that numerically strong connections between neurons are spread across many distinct twigs. If, contrary to observations, neurons were to only contact each other via a single twig that hosts many postsynaptic sites, then this connection would be fragile with respect to developmental noise (Couton et al., 2015). Backbones define the spatial extent and stereotyped shape of a neuron, and we found that most presynaptic sites are located on or very near the backbone’s microtubules and mitochondria. Our findings are consistent with the notion that metabolic needs and microtubule-based trafficking are limiting factors for the structure of synaptic output.
These different biological requirements for different neuronal compartments are reflected in the rate of reconstruction errors. The large calibers and relatively gradual turns associated with microtubules made errors on backbone less frequent by a factor of nearly 20 relative to on smaller and tortuous twigs. However, we propose that the circuit’s resilience to developmental noise, achieved in part by connecting via multiple twigs, underlies the resilience of wiring diagrams to the omission of small dendritic branches, the most typical error observed both here and in reconstructions in the fly visual system (Takemura et al., 2013).
Irregularities within a cell type guide review toward small fractions of specific neuronal arbors that could be responsible for a potential error. While reconstructing a neuron, a user can quickly pull up its complete anatomy and connectivity to compare to homologous cells or inspect for irregularities and, crucially, return immediately to the locations in the image data necessary to make the appropriate decisions. We find that this smooth flow from image data to high level features and back to image data—without post hoc or offline analysis—is possibly the most important feature in our EM reconstruction technique.
Dispensing with repeated reconstruction without reducing accuracy enables our method to support concurrent neuron reconstruction by many collaborators. This setup prevents duplicated work while ensuring that important locations are visited multiple times. For example, synaptic relations are inspected at least twice in different ways, once each from the pre- and postsynaptic side. The presence of existing and correct skeletons in complicated areas, such as registration errors between consecutive sections or gaps, reduces the time necessary for resolving possible ambiguities and effectively provides an extra step of proof-reading by not allowing contradictory reconstructions. Further savings originate in the reuse of data, for example exploratory reconstruction of backbones in search of specific neurons or branches pruned during proofreading are merged into the arbor currently being reconstructed. In summary, in a collaborative environment, the more neurons that are reconstructed, the faster new ones can be added, and the fewer errors existing reconstructions will contain.
Automated methods will be necessary to map circuits with more than a few thousand neurons (Helmstaedter, 2013), but they require extensive proof-reading (Chklovskii et al., 2010; Plaza et al., 2012; Haehn et al., 2014). Our methods for analysis of arbor morphology, synaptic distribution and circuit structure and reliability, and their application in proof-reading, apply equally to manually and automatically reconstructed neurons. Neuroanatomical measurements suggest mixed strategies for leveraging both automated algorithms and human effort. For example, mitochondria can be reliably located automatically (Lucchi et al., 2011; Funke et al., 2014) which, together with our finding of a distance constraint between mitochondria and presynaptic sites, could assist in automated synapse detection (Kreshuk et al., 2011; Becker et al., 2012; Kreshuk et al., 2014). Similarly, the properties of neuronal backbone and twigs suggest that algorithms for the automatic detection of microtubules in serial section EM would be a profitable source of constraints for automated reconstruction of neurites across consecutive sections (Vazquez-Reina et al., 2011; Funke et al., 2012). While we only considered the relationship between error rate and the presence or absence of microtubules, with the use of automated detection methods it will be important to look at more detailed measures of arbors such as the number of micro-tubules, curvature, or caliber.
Our iterative reconstruction method explicitly uses fundamental properties of dendritic arborizations to achieve circuit reconstruction accuracy without sacrificing speed. Both in insect and in vertebrates, dendritic arbors present two structural compartments: one with microtubules–the shafts–and one without– all the spines and twigs (Rolls and Jegla, 2015). Shaft synapses are less likely to be missed because both sides of the synapse present microtubules. Our finding that the connection between two neurons is resilient to errors of omission of spines or twigs is based on the redundancy afforded by the distribution of postsynaptic sites across the receiving arbor. Instances of this pattern have been observed in mammals in multiple brain regions (Hamos et al., 1987; Bock et al., 2011; Kasthuri et al., 2015). However, the particulars of the distribution of postsynaptic sites over the postsynaptic arbor will be specific to each species—even to brain regions or cell types within each species—and therefore must be measured for the tissue of interest. We have shown that this distribution enables estimating an acceptable false negative rate, the amount of missed synaptic connections that still allow the recovery of strong synaptic connections in the wiring diagram, and thus determines the minimal effort that must be dedicated to twigs or spines.
A fundamental difference between insect and mammalian neurons is that in mammals, the axons can be of small caliber, but represent a substantial fraction of all cable (Helmstaedter et al., 2013). Nonetheless, axons need transport of cytosolic elements such as vesicles and mitochondria, which are delivered primarily via microtubules, as well as the anchoring of such elements onto the microtubule cytoskeleton (Sheng and Cai, 2012). As we have shown, microtubules provide a strong signal that enables overcoming ambiguities in serial section EM. Therefore cytoskeletal detail, as visible in rich EM images, can greatly facilitate the reconstruction of mammalian axons despite their small calibers.
Catastrophic reconstruction errors are those that affect the backbone of a neuron, dramatically altering the observed circuit wiring diagram. These are generally false positives that originate at ambiguous regions of the image data, and which result in the addition of a large incorrect branch. In Drosophila, we exploited the strong morphological stereotypy and unique identity of every neuron to swiftly detect these kind of errors, which are rare, by comparing the overall arbor morphology of homologous neurons across individuals or bilaterally. In nervous systems without uniquely identifiable neurons, these kind of structural errors can be detected either by comparing a reconstructed arbor with prior light-microscopy imaging of the same sample (Bock et al., 2011; Briggman et al., 2011), or by compiling statistical descriptions of cell type morphology and connectivity (Sümbül et al., 2014; Jonas and Kording, 2015).
Larval locomotion, like many motor patterns, results from rhythmic activation of motor neurons (Heckscher et al., 2012), but few central components of the underlying premotor circuitry had been identified (Kohsaka et al., 2014; Couton et al., 2015). Our reconstruction of propriomotor circuitry revealed a complex network comprised of numerous cell types, including a subset of those previously described (Kohsaka et al., 2014). We identified a rich collection of local neurons, including neurons anatomically well-suited to provide common drive to synergistic muscles (Schaefer et al., 2010) and thus likely a key motor network components. Using anatomically faithful simplifications of neuronal structure, we found several premotor microcircuits employing dendro-dendritic and axo-axonic synapses in parallel with conventional axo-dendritic synaptic connections. For example we found a GABAergic input pre- and post-synaptic to motor neuron input, a motif also observed in mammalian motor circuits (Fyffe and Light, 1984).
Although the motor system is rhythmically active in the absence of sensory input (Suster and Bate, 2002), proprioceptive sensory feedback is required for natural coordination and timing (Hughes and Thomas, 2007; Song et al., 2007). We found diverse and complex circuitry for relaying proprioceptive information, including GABAergic and glutamatergic neurons directly relaying proprioceptive input to motor neurons. This motif is well-posed to provide an inhibitory 'mission accomplished' signal to suppress motor neuron activity after a successful contraction during forward locomotion (Hughes and Thomas, 2007). However, we also observed that many synaptic partners of dbd were themselves presynaptic to neurons downstream of the other proprioceptive axons, suggesting other, more complex roles for proprioceptive feedback in modulating motor activity. Surprisingly, the axon terminals of proprioceptive neurons themselves almost entirely lacked presynaptic input. This suggests that proprioceptive input is privileged by the larval nervous system and not under fast, dynamic modulation by central circuitry (Clarac and Cattaert, 1996), unlike proprioceptive afferents in the locust leg (Burrows and Matheson, 1994) and other somatosensory modalities in the larva (Ohyama et al., 2015).
Wiring diagrams have been deemed necessary, yet not sufficient, for understanding neural circuits (Bargmann, 2012) and a fast approach for discarding hypotheses of circuit function (Denk et al., 2012; Takemura et al., 2013). The neuronal wiring reconstructed here offers insights into the structure of an insect motor circuit and its control by sensory feedback, and serves as a complementary resource for detailed functional studies. With the circuit mapping tools and methods demonstrated here, fast, accurate, and targeted reconstruction of circuits in Drosophila larva (Ohyama et al., 2015) and adult, and other species (e.g. Platynereis, Randel et al., 2015) is possible.
Wild-type Drosophila first instar larval central nervous systems were manually dissected by mechanical separation of the anterior tip of the larva from the posterior portion in PBS, and immediately transferred to 2% glutaraldehyde in 0.1 M Na-cacodylate, pH 7.4 buffer. Samples were post-fixed in 1% OsO4 in the same buffer and stained en bloc with 1% aqueous uranyl acetate before subsequent dehydration in ethanol and propylene oxide, and embedding in Epon. Serial 45 nm sections were cut with a Leica UC6 ultramicrotome using a Diatome diamond knife, and picked up on Synaptek slot grids with Pioloform support films. Sections were stained with uranyl acetate followed by Sato’s lead (Sato, 1968). Sections were then imaged at 4.4 nm × 4.4 nm resolution using Leginon (Suloway et al., 2005) to drive an FEI Tecnai 20 transmission electron microscope. The resulting 77,000 image tiles were contrast-corrected, montaged and registered with TrakEM2 (Cardona et al., 2012) using the nonlinear elastic method (Saalfeld et al., 2012). The generated data volume of 22,775×18,326×462 voxels corresponds to a volume of 91×73×21 µm3. The data set covers approximately the posterior half of abdominal segment A2, and a nearly complete abdominal segment A3.
For display in CATMAID, we Gaussian-smoothed montages of registered EM images (sigma=0.7 pixels, sufficient to remove high-frequency noise to increase the effectiveness of JPEG compression without sacrificing perceptual image quality) and then generated an image pyramid with five zoom levels and diced it to collections of 256 × 256 pixel tiles (512 × 512 and larger can work better for fast Internet connections), stored in JPEG format (75% compression and stripped of headers with jpeg-optim). This approach reduced data storage from over 700 to 90 gigabytes, which were served from a fast seek time solid-state hard drive.
We setup a single server machine (Intel Xeon X5660 with 12 cores, 48 GB of RAM, 10 Gb network card) running Ubuntu 12.04 to host the PostgreSQL database, the image server and the Django server. LDAP id caching was enabled for best performance. Images were stored on high-performance solid-state drives mounted with noatime flag or as read-only, and served via proxy with in-RAM varnishd for caching. The database was configured with large shared buffers (4 GB) and autovacuum on (naptime: 8642 min; scale factor 0.4; analyze scale factor 0.2; cost delay -1; cost limit -1) for optimal performance. We chose to serve pages with Nginx, running 8 processes, with epoll on, 768 worker connections, disabled logs and gzip on (except for JPEG image tiles) for best performance, and with public caching and no-expire settings for images. Django was run via Gunicorn with python 2.7 using 8 processes.
Reconstruction in CATMAID, as presented here, is based on manual annotation of neurons from image stacks. Where possible, we’ve honed the interface to reduce the amount of interaction users need to perform while reconstructing neurons. Humans skeletonize a neuronal arbor by placing nodes within a window showing the image stack. A new node, generated by a key press or mouse click, becomes the topological ‘child’ of an explicitly selected ‘active node’. The active node updates to the most recently created node, and branch points are generated by selecting a node that already has child nodes and generating an additional one. When branches are observed, we place a small stub down that branch to ease later follow-up. Since neurons are typically linear at short distances, nodes do not have be manually placed in every image section. In image sections between those containing manually placed skeleton nodes, CATMAID produces intermediate, linearly interpolated virtual nodes that can be interacted with like a real skeleton node. If edited (e.g. moved, attached to a synapse, or used as a branch point), the virtual node becomes a real node manifested in the database.
When a continuation for a neuron has already been reconstructed, the two arbors can be merged with a single click. This is particularly common in the case of synapses, where pre- or post-synaptic placeholder, isolated skeleton nodes (i.e. a skeleton consisting of a single node) are placed to fully describe the synapse. If two arbors both have multiple skeleton nodes, an attempted merge of the two must be confirmed visually in an interactive 3d display, to avoid obvious inconsistencies like multiple soma or an unexpected arbor structure (e.g. spatially intertwined dendritic branches).
Other, optional metadata can also be associated with nodes. A neurite radius can be measured for each skeleton node, with cylinders modeling arbor segments in 3d and spheres modeling the somas. Each skeleton node may also be tagged with any number of arbitrary text snippets to express metadata. Search tools enable finding tags in a specific skeleton or across the data set. Free text can be used to denote structures of interest (e.g. 'Golgi apparatus') or as a personal or team communication convention (e.g. 'check this synapse'). Tags used frequently or to guide analysis (e.g. ‘microtubules end’) can be mapped to a single key press.
Synapses are made by creating a special class of node (a ‘connector’) that can be related to a single presynaptic node and multiple postsynaptic nodes. We opt to place the connector node within the presynaptic neuron near the visible characteristics of the synapse, the presynaptic density and nearby vesicle cloud. Each relation is annotated with a confidence value from 1 to 5, with 5 being the default and highest confidence. Again, efficient user interaction simplifies manual annotation. A synaptic connector node can be created with a single click either pre- or post-synaptic to the active skeleton node, based on holding different modifier keys. When the connector node is active, clicking nodes while holding modifier keys produces a pre- or post-synaptic link to it. If no node is already present when the user does this, a new node is generated with the desired link type. Alternative types of connectors with their own constraints (for example abutment or gap junctions) are straight-forward to add.
To guide the flow of reconstruction, we rely on special text tags that describe a user’s decisions about how to continue a neurite. By default, a node without any child (i.e. a ‘leaf node’ in the topological tree structure) is expected to need further continuation. When a user decides they have reached the end of a neurite, they can hit the ‘K’ key to label that node with the text tag ‘ends’, indicating that no more continuation is necessary. In cases of ambiguity in how to continue, other tags are used to indicate no further continuation is currently possible: ‘uncertain end’, to be used if the user cannot decide if a neurite ends, and ‘uncertain continuation’, to be used if there is an expectation of a continuation due to, for example, microtubules, but the specific continuation is unclear. In effect, then, the process of finishing a neuronal reconstruction becomes a task of continuing every unlabeled leaf node until no more exist. Eventually, all open leaves have been explicitly declared finished and the first draft of the arbor is complete. To ease this process, a single key press (‘R’) will position the field of view on the closest unlabeled leaf node of a selected neuron, making it simple and efficient to jump to to the next part of the arbor in need of reconstruction.
Systematic review of a skeleton consists in visualizing each of its skeleton nodes in sequence, adding or editing nodes and synaptic relations as necessary. For this purpose, we partition the arbor to generate the smallest possible set of the largest possible sequences of continuous nodes to minimize the number of times that the reviewer has to switch to a different arbor path. We sort leaf nodes by path length (in number of intermediate nodes) to the root node in descending order. Starting from the most distal leaf node, we generate a sequence of nodes all the way to the root. Then we pick the second most distal node and generate another sequence of nodes until reaching a branch point that has already been assigned to a sequence, and so on for each remaining leaf node. When done, sequences of nodes are sorted by length. The reviewer then iterates each sequence, automatically marking each node as reviewed upon visiting it (using ‘q’ and ‘w’ key bindings to go forward and backward in a sequence, and ‘e’ to jump to the beginning of the longest unreviewed sequence). As a visual aid, each node is centered in the screen, facilitating the detection of changes in the contour of the sectioned neurite, as well as drastic shifts of the field of view that indicate an error (e.g. a jump to an adjacent neurite). The enforcement of a unique directionality and simple one-dimensional path—from distal ends towards inner parts of the arbor or the soma—facilitates noticing glaring inconsistencies such as a path starting off large and microtubule-rich, then reducing to small and microtubule-free, then becoming again large and microtubule-rich. In other words, a review approach coherent with the expected tapering out of neurite caliber and cytoskeleton from soma to distal ends adds context that helps the reviewer.
The total fraction of nodes of a skeleton that have been reviewed is indicated in most tools that can display lists of neurons (e.g. selection table, connectivity tables, connectivity graph), as well as a skeleton coloring mode in the 3d viewer. This enables simple visualization of the current status of review of e.g. all upstream and downstream synaptic partners of one or more neurons in the connectivity widget, of all neurons in a wiring diagram in the connectivity graph, or the review status of a specific branch in the 3d viewer. Given that one or more users may review any node of a skeleton, and the different proficiency of each user, settings allow users to create of a team of other users whose reviews are trusted. Review status visualization can thus be limited to only a user’s own reviews, to the union of everyone’s reviews, or to the union of all reviews performed by the team of trusted reviewers.
Synapses are effectively reviewed multiple times, given that they are seen from at least two arbors (the pre- and the postsynaptic); more in the case of polyadic synapses, as nearly all synapses in the Drosophila larva are. We consider synapses as two elements: the presynaptic relation between a skeleton node and a connector node and the postsynaptic relation between a skeleton node of a neuron and the connector node. Reviewing the associated skeleton node tacitly marks its part of the synapse as reviewed.
To further facilitate systematic review, a 'Skeleton Analytics' tool automatically detects and lists in an interactive table some potential issues that must be addressed in a neuron or collection of neurons. The listing is interactive, allowing jumping to the associated field of view in the image data to determine whether or not the issue describes a genuine error.
Skeleton nodes tagged with 'ends' which are not leaf nodes.
Skeleton nodes tagged with 'TODO', 'uncertain end' or 'uncertain continuation'.
Leaf nodes that are not tagged with neither 'ends' nor 'not a branch.
Autapses, synapses where the a neuron is pre- and postsynaptic at a single synaptic site. While autapses are known to exist in some nervous systems, all autapses in the larva we have found so far indicated errors in reconstruction.
Potentially duplicated synapses: when a neuron synapses twice onto another neuron within a small cable distance it is possible that the synaptic active zone has been annotated multiple times erroneously.
Potentially duplicated postsynaptic relations: when a skeleton receives more than one postsynaptic relation from the same connector, is possible that the extra postsynaptic relations are accidental duplicates rather than, for example, two different dendritic twigs of the same postsynaptic skeleton.
Lack of a node tagged as 'soma', or the root node of the skeleton not corresponding to a node tagged as 'soma'. The case of multiple somas is generally noticed immediately and addressed without needing special tools.
A correctly reconstructed neuronal arbor must be biologically plausible. The distribution of micro-tubules is a biologically grounded approach to subdivide an arbor for analysis. Additionally micro-tubules are robust to artifacts in serial section EM (e.g. missing sections and noise), since they span many sections while remaining straight and in a consistent configuration within a neurite (Figure 1). Errors in the backbone are readily detected by comparing with homologous neurons, or by the extreme and evident consequences of the reconstruction error, such as dramatic changes in direction (sharp angle without branching), the presence of more than one soma, missing large axonal or dendritic trees, or violations of the self-avoidance of neuronal processes, which is often but not always observed.
While most twigs were short and had few synaptic contacts, we did find three interesting outliers (see Figure 2G) Each outlier twig was much larger and some included neurites that, upon careful inspection, were in the backbone in their contralateral homolog. This could suggest that parts of the larger twigs could become backbone at a later developmental time point, or they contained labile microtubules that were not captured in the EM sample preparation. Furthermore, these three outlier twigs all had smooth endoplasmatic reticulum at their base and branched very early, suggesting that they are effectively a pair of twin twigs. Considered alone, each half fell within the dimensions of typical large twigs.
Neurons of the same cell type share many properties in common. For Drosophila, we define cell type as the pair of left and right homologs, symmetric across the midline, as observed from light-microscopy (Li et al., 2014; Vogelstein et al., 2014). Most cell types repeat across multiple consecutive segments, though a few do not. Exceptionally a cell type may consist of more than one pair of cells, or of a single unpaired cell with a bilaterally symmetric arbor. Quantitative analysis of the anatomy, synaptic distribution and connectivity for a group of neurons containing potential pairs of homologs helps with detecting potential issues by comparing homologs with each other and with other types.
Reconstructions of homologous neurons can differ due to true developmental differences (Figure 6— figure supplement 1), errors in EM reconstruction, misidentification of homology, or asymmetries in imaging data (Figure 3—figure supplement 3). To help detect and classify these differences, we generate interactive plots of numerous user-selected metrics on demand. If a pair of homologs is consistently more similar to each other than to other neurons for all three kinds of metrics—anatomy, synaptic distribution and connectivity—the likelihood that the pair contains significant, symmetric, and independent errors is low, and therefore other neurons can be prioritized for review.
We consider several anatomical quantifications that are independent of absolute spatial coordinates and orientation, avoiding issues of mirroring and alignment of neurons (see Suppl. Text). To determine which measures are most helpful for identifying homologous neurons, we applied a distance metric learning method (Xing et al., 2002) that scales individual dimensions to minimize Euclidean distance between homologs and maximize distance from other cells. The two most effective measures were total cable length of branches other than the main branch and normalized difference between the number of input and output synapses.
The distribution of synapses over an arbor is characteristic of each cell type. Some cell types have distinct input and output regions with or without dendritic outputs and axonic inputs, while others have arbors with entirely intermingled inputs and outputs (Figure 7—figure supplement 1). We devised a novel metric, the 'segregation index', that measures the degree of separation between input and output regions of an arbor. First, we calculate the number of paths from input synapses to output synapses that pass through every node on the skeleton, a quantity we call synapse flow centrality (SFC). We found that the point on the arbor with the highest centrifugal SFC (which considers for any skeleton node only distal outputs and proximal inputs) best separates the axon (distal) from the dendrites (proximal).
To detect and analyze neurons with similar network roles, we reduce neuronal arbors and synapses to nodes and edges in a graph. From the adjacency matrix describing the connectivity, we measure the signal flow and perform graph partitioning via spectral graph analysis (Varshney et al., 2011). We find that neurons of the same cell type can group together, even when the number of neurons is variable such as in the optic lobe of Drosophila larva (Simon Sprecher, Ivan Larderet & Albert Cardona, unpublished observations).
Electron microscopy image volumes of neuropils contain noise. For serial section transmission EM, noise originates during fixation (e.g. broken membranes and reduced extracellular space), serial-sectioning (e.g. folds, cracks, missing sections, thick sections), counter-staining (e.g. precipitated heavy metals, dust particles, or absence of staining due to microscopic air bubbles), and imaging (e.g. locally uneven illumination, tile-wise constant noise originating in improper correction of the camera’s dark- and brightfields); for examples see Supplemental Figure 2 in Saalfeld et al., 2012.
The most common form of noise consists in missing data either as a partial occlusion of a section, or by the loss of one or more sections. When reconstructing a neuronal arbor, upon reaching an area with missing data (a gap), we use both global and local cues to identify the correct continuation, labeling the skeleton edge that crosses the gap with an appropriate confidence value to express our degree of certainty in the decision. These low-confidence skeleton edges enter into the visualization and analytical tools for further evaluation. Generally, the direction, caliber, and cytoplasmic characteristics of the neuron and its neighboring neurons suffices to identify the corresponding continuation on the other side of the gap. The larger the gap and smaller the neurite, typically the lower the confidence in the identification of the correct continuation.
Locally, gaps up to 500 nm (e.g. 10 serial sections) are crossable using microtubules. The number, direction, and spatial arrangement of microtubules in a neurite are constant over lengths of micrometers, making them reliable structures over many sections (Figure 1). Similarly, mitochondria take tubular shapes inside neurites, and their sparseness and relatively constant dimensions identify a neurite across consecutive serial sections (Figure 1). Other cues can include the smooth endoplasmatic reticulum that lines large and mid-size neurites; the presence of vesicles of a specific kind (e.g. dark, 50-nm diameter neuropeptide vesicles, or clear large unevenly shaped vesicles, or small, packed clear-core cholinergic vesicles, and others); or other distinctive characteristics such as the presence of microtubules on a specific side of the neurite, or membrane-associated structures, or distinctive cytoplasm texture, such as relative darkness compared to neighboring neurites.
Globally, the properties of a neuronal arbor help to identify continuations across gaps. For example, an axonal neurite tends to continue being axonal in nature within the gap-sized span of a few hundred nanometers; same for dendrites. An obvious feature is that differentiated neurons present a single soma; continuations that lead to a second soma are therefore most likely incorrect.
As described above, to identify a neuron quickly in the larva, the first few minutes are best spent skeletonizing the largest structures on the backbone and tracing them to the soma. This minimal representation generally suffices to identify the neuronal lineage and the overall span of the arbor. When the correct neuron has been found, reconstructed in full and reviewed, we begin to map its synaptic partners.
To find out the strongly connected partners of a neuron, we use the connectivity table that aggregates all synaptic relationships, whether with fully reconstructed neurons or single-node skeletons used as placeholders to indicate synaptic partners. Starting at each single-node skeleton, we reconstruct the arbor all the way to the soma by choosing, at every branch point, the larger caliber (may require jumping back to the last branch node occasionally), momentarily ignoring the rest of the arbor. This partial reconstruction suffices to obtain a minimum of information about the partner arbor, such as the lineage. Partner neurons that receive more than one synapse from the neuron of interest will quickly accumulate further fractions of their arbors. These preferred partners—those with many synapses with the arbor of interest—can then be selected for full-arbor reconstruction, while the completion of single-synapse partners (of which a neuron has many, and which in the Drosophila larva may play a lesser role in understanding the circuit role of a neuron) can be postponed.
Interactive, partial wiring diagrams calculated on demand during neuron reconstruction guide circuit mapping and the identification of errors. Connectivity-dependent coloring schemes highlight desired features of the circuit, sorting neurons into groups.
A common case is the inspection one or more orders of synaptic neighborhoods. Given one or more neurons of interest (such as RP2), we load all synaptic partners into the graph. For small circuits, visual comparisons between the neighborhoods of left and right homologs can identify similar neurons (e.g. by coloring by stereotyped properties such as the ratio of inputs and outputs, or by their graph centrality; see below) and highlights missing or differently connected neurons, prompting focused review. Coloring the circuit graph relative to a central neuron highlights the relative synaptic order of all other neurons.
Given two neurons, an important circuit question is if there are any paths between them and, if so, through what neurons. This can be queried and added to the graph from within the graph widget, with filters for how many synapses an edge must be.
Other coloring modes include by betweenness centrality (Brandes, 2001) of the wiring diagram (calculated as a directed graph), which stresses the role of a neuron within a circuit; and by the percentage of review of the neuronal arbor, indicating at a glance the approximate level of completeness within a group.
When reconstructing neuronal arbors with skeletons, the nodes of the skeletons are annotated with a confidence value signifying the degree of certainty in the continuation of the axon or dendrite. We carry on this confidence into the dynamic wiring diagram representation by splitting the skeleton that models a neuronal arbor at the low-confidence edges, resulting in independent graph nodes. The connectivity of these fragments aids in evaluating their impact on the wiring diagram and their potential correctness.
Neural circuits targeted for reconstruction must be imaged in volumes large enough to encapsulate the complete neuronal arbors of interest (Helmstaedter, 2013). Finding specific neurons in unreconstructed data demands prior knowledge, for example using image volumes of genetically labeled neurons, and reference markers like neuroglian or fasciclin II tracts (Landgraf et al., 2003) that have anatomical correlates that are conspicuous in EM. The ability to navigate vast volumes at intermediate or low resolution aids in identifying large features such as nuclei, nerves, trachea, or neuropil boundaries, helpful for crossing the resolution gap between light-level microscopy and EM. Although not used in the project described here, to further facilitate finding specific neurons of interest in vast EM volumes, CATMAID supports overlaying other volumetric image data, such as registered confocal stacks.
Given a good guess of the approximate location, finding a neuron of interest involves reconstructing partial backbones (the low-order, microtubule-rich processes). This typically consumes only 10–20 minutes per arbor, due to the large caliber, presence of continuous microtubules, and the paucity of synapses on backbone. In larval Drosophila, even partially reconstructed backbones suffice to identify individual neurons by comparing with high resolution single neuron images at light level, given that the lowest-level branches are typically sufficient for unique identifiability of individual neurons. In our experience, the best starting points are stereotyped features like the main branch points, tracts, commissural crossings, or the neuropil entry point of the primary neurite bundle of all sibling neurons of the same lineage (Cardona et al., 2010). Unfinished backbones remain for other contributors to expand or merge into full arbors later, if desired.
In an environment where multiple contributors simultaneously reconstruct neuronal arbors, eventually an ongoing reconstruction reaches that of another contributor. Attempted edits are resolved according to predefined permission rules for who can edit whose work. These rules are implemented as permissions granted to a contributor to alter another contributor’s work. The status of “superuser” enables a trusted expert neuroanatomist to edit at will.
Our system operates at two levels: locked and unlocked skeletons. Skeletons that are deemed complete are locked by the contributor, and by default cannot be edited by others unless they have been granted permission to do so. Unlocked skeletons, such as partial reconstructions produced when searching for a specific neuron or when pruning away incorrect branches, can be merged or split by others at will. Neurons are unlocked by default and locking is only to be used upon completion, which prevents sudden and unexpected changes in established results. Individual skeleton nodes and their relations to connectors (which express synapses) can only be edited by the original author, or by others that have been explicitly granted permission to edit the contributions of the original author. In case of conflict or insufficient permissions, a notification system delivers the request to the contributor who can review and effect the change. The result of the work of multiple contributors can be visualized in the 3d viewer, with each node of the skeleton colored according to the identity of the contributor.
Collaborative reconstructions require that contributors be able to trust the work of others. It is therefore important for a project manager to be able to track the work of each contributor. To estimate an individual’s speed and quality, we consider only contributions that have been reviewed by others, within a specific time period. We quantify the number of edits performed by the reviewer, in particular splits (cutting away an incorrect branch), merges (appending a missing branch) and the addition or removal of synapses. While speed and quality are independent, we typically see that better contributors are also faster.
After an initial period, lasting anywhere from a couple of days to about 2 weeks of continuous work, a contributor typically becomes acquainted with the reconstruction task and stops adding erroneous synapses or merging branches from different neurons into one. Remaining errors are typically missing branches or synapses, which are far easier to resolve and have a less significant impact on interpretation of the wiring diagram.
We observe that different areas of the nervous system exhibit profound differences in arbor and synapse morphology, from extensively branching trees in some ventral nerve cord neurons to cloistered self-contacting axons like A02l or in the olfactory lobes (data not shown). Subjectively, contributors that reconstructed neurons in diverse areas of the nervous system experienced a larger variety of shapes and morphologies, which correlated with the acquisition of greater skill.
With many expert contributors come many points of view on how to describe neurons. Instead of enforcing a specific ontology, we allow the annotation of any neuron with arbitrary text snippets. These annotations can express a variety of potentially overlapping concepts, from body regions to cell types, gene expression patterns, genetic driver lines and neurotransmitter profiles, among others. The flexibility afforded by the annotation system supports uses from long-term, contributor-centric publication-ready naming schemes to single-use lists helping personal data organization or team collaboration. Our tools allow queries for one or combinations of annotations, as well as metadata such as time or user associated with an annotation.
To make annotations discoverable, we construct a hierarchical tree structure that starts off with three entries: the list of all annotations, the list of all neurons, and the list of all contributors, with each paginated list reducible by regular expression matching. For each annotation, we display five lists: neurons annotated with it, annotations annotated with it (which act as meta-annotations), annotations that it annotates (acting itself as a meta-annotation), the list of contributors that have used it to annotate an entity (a neuron or an annotation), and the list of co-annotations (other annotations onto the neurons that it annotates). Each annotation, neuron and contributor is expandable, letting the user navigate a graph of relations. For co-annotations, further expansions constrain the listing of neurons to those that share all chosen annotations. For example, starting at annotation ‘segment A3’, continuing with the co-annotation ‘left’, and then the co-annotation ‘GABA’, leads to the listing of all GABAergic neurons on the left hemisegment of abdominal segment A3. Similarly, starting from ‘GABA’ could lead to ‘A3’ and ‘left’ as well, resulting in the same list of neurons. This approach enables the co-existence of many contributor-centric representations of the same neuronal circuits.
Annotations also enable the co-existence of multiple nomenclatures for naming neurons. These could be for example by GAL4 line, by developmental grouping (a name composed of region, segment, lineage and birth order), or by gene expression. In CATMAID, many widgets lists neurons by name. These displayed names are customizable, so that each contributor can see his or her own names, even if the neurons in question were created by others. Each contributor chooses a setting for neuron display names among multiple possibilities, including skeleton IDs, own annotations, all annotations, or most usefully, annotations that are themselves annotated with, for example, 'Janelia GAL4 line' or 'Developmental nomenclature' to indicate naming schemes.
In order to associate synaptic connectivity not to whole neurons, but to regions of neurons, we adopt an approach where we cluster nearby synapses. Mean shift clustering has been shown to be an effective approach to finding synapse clusters in 3d without assuming a particular number of groups a priori (Binzegger et al., 2007). This approach involves convolving synapse locations with a Gaussian kernel to estimate the density of synapses in space. A cluster is then the set of synapses for which, starting at their location, gradient ascent reaches the same density peak. However, locations on one neuron that are close in space can be very far apart along the neuron. Here, instead of considering the density of a neuron’s synapses in 3d space, we use a similar procedure to estimate the density of synapses at every point on the arbor (following the cable) and define synapse clusters in the same manner. The only parameter in both approaches is the width of the Gaussian kernel, a physically meaningful parameter.
For these purposes, we define the skeletonization of a neuron to be a graph with a set of nodes N with locations Xi for i ∈ N and skeleton edges ε (note that a ‘skeleton edge’ is between nodes in the skeleton of a single neuron and does relate to synapses). Because the neuron’s graph is tree-like, there is a unique non-overlapping path on the graph between any two points i,j∈N with distance δij. All synapses (both inputs and outputs) associated with the neuron are represented by the set of their associated nodes, S ⊂ N, noting that the same node can be associated with multiple synapses and thus appear multiple times in S. For every node in the neuron graph, we compute the synapse density
where λ is a bandwidth parameter that effectively determines the size of clusters, and presynaptic sites of polyadic synapses are counted as many times as they have postsynaptic partners. Note that due to branches, a single synapse close to a branch point may contribute more total density than one that is very distant, reflecting its greater within-graph proximity to more of the arbor. We then look for all maxima in the synapse density and the basins of attraction that flow to them via gradient ascent (i.e. starting at a given node, moving along the maximally positive difference in density between adjacent nodes). A cluster of synapses is then all synapses associated with nodes found within a single basin of attraction of the density function. For neurons found in the 1st instar larva, with ≈500–2000 µm of cable, bandwidths around 8–30 µm provide clusterings that match the subjective description of either 'dendritic arbor' or 'axon'. Smaller bandwidth values result in more granular breakdowns of dendritic and axonal trees (e.g. dbd axons in Figure 5G).
We define synapse flow centrality (SFC) as the number of possible paths between input synapses and output synapses at each point in the arbor. We compute the flow centrality in three flavors: (1) centrifugal, which counts paths from proximal inputs to distal outputs; (2) centripetal, which counts paths from distal inputs to proximal outputs; and (3) the sum of both.
We use flow centrality for four purposes. First, to split an arbor into axon and dendrite at the maximum centrifugal SFC, which is a preliminary step for computing the segregation index, for expressing all kinds of connectivity edges (e.g. axo-axonic, dendro-dendritic) in the wiring diagram, or for rendering the arbor in 3d with differently colored regions. Second, to quantitatively estimate the cable distance between the axon terminals and dendritic arbor by measuring the amount of cable with the maximum centrifugal SFC value. Third, to measure the cable length of the main dendritic shafts using centripetal SFC, which applies only to insect neurons with at least one output synapse in their dendritic arbor. And fourth, to weigh the color of each skeleton node in a 3d view, providing a characteristic signature of the arbor that enables subjective evaluation of its identity.
A textbook neuron has a purely dendritic arbor and a purely axonal arbor, that is, one neuronal compartment that only receives inputs and another that only delivers outputs onto other neurons. In reality, dendro-dendritic and axo-axonic synapses are present in both invertebrates (Wilson and Mainen, 2006; Olsen and Wilson, 2008) and vertebrates (Rudomin and Schmidt, 1999; Wilson and Mainen, 2006; Pinault et al., 1997). We have observed that homologous neurons (e.g. identifiable neurons in the left and right hemisegments) have a similar synaptic distribution, which differs from that of other neurons. In Drosophila, we find neurons with highly separated input and output (e.g. motor neurons and many types of projection neurons), neurons with entirely intermingled inputs and outputs (possibly non-spiking interneurons [Burrows, 1992]), and everything in between.
Having clustered synapses into groups (either by synapse clustering or by splitting the neuron by centrifugal synapse flow centrality), we ask how neuronal inputs and outputs are distributed among the clusters. If the clustering can adequately separate axon from dendrite, then a highly polar neuron will have most of its outputs on the 'axon' cluster and most of its inputs on the 'dendrite' cluster. Motor neurons in the abdominal segments of the Drosophila larva are examples of completely polarized neurons. Conversely, highly non-polar neurons can have inputs and outputs distributed homogeneously throughout their arbor. An example of the latter are non-spiking neurons that perform extremely local computations, such as GABAergic antennal lobe interneurons (Wilson and Laurent, 2005).
A measure of synaptic sign distribution in a neuronal arbor has the potential to distinguish similar yet uniquely different neurons, as well as to suggest broad functional roles of the neuron. Here, we describe an algorithm to quantify the degree of segregation between input and outputs in a neuronal arbor.
For each synapse cluster i on a neuron with Ni synapses, compute the fraction pi that are postsynaptic. We measure the uniformity of the distribution of inputs and outputs within cluster i by computing its entropy, for which we consider synapses as entities with two possible states: input or output. At the limits, when all synapses of the cluster are either inputs or outputs, its entropy is zero. When half of the synapses are inputs and the other half are outputs, the entropy is maximal. The contribution of each cluster i to the total entropy is weighted by its fraction of the total synapses (either inputs or outputs).
The entropy of the input/output distribution for each cluster is then
The total entropy for the arbor is then just
However, for reference we need to compare this to an unstructured arbor (i.e. non-clustered) with the same total number of inputs and outputs; for this, we consider the whole arbor as one cluster, and we compute
(where is just the total fraction of synapses that are inputs).
We define the segregation index as
so that H = 0 corresponds to a totally unsegregated neuron, while H = 1 corresponds to a totally segregated neuron. Note that even a modest amount of mixture (e.g. axo-axonic inputs) corresponds to values near H = 0.5–0.6 (Figure 7—figure supplement 1). We consider an unsegregated neuron (H ¡ 0.05) to be purely dendritic due to their anatomical similarity with the dendritic domains of those segregated neurons that have dendritic outputs.
We validated our iterative reconstruction method, where users’ actions are not independent of one another, by comparing our results to that of an established consensus methods involving multiple independent reconstructions. Six neurons (three hemilateral pairs with a total of 2387 µm of cable in the iterative method) were chosen for validation on the criteria that their morphology was well-contained within the EM volume and the entire group formed a connected network. Four contributors (authors CMSM and SG, as well as Ingrid Andrade and Javier Valdés-Alemán) who had little to no prior involvement with the selected neurons were given six seed nodes at the soma of each selected neuron. The number of contributors was chosen based on available, trained users at the time. Each contributor reconstructed the six neurons (skeletons plus synapses) in an otherwise completely unannotated volume that only he or she was working in and then did skeleton-centered review of their own neurons. To determine a consensus skeleton from these four reconstructions, we re-implemented the RESCOP algorithm Helmstaedter et al. (2011) in MATLAB (Mathworks, Inc) with slight variations due to differences in the details of skeleton-annotation tools. CATMAID skeletons were resampled so that adjacent nodes were no further than 80 nm apart. Nodes in independent reconstructions were considered consistent if they were within 600 nm of one another, a value chosen because smaller values resulted in correct reconstructions of low-order branch points to be inconsistent.
We developed a minimal method to estimate the consensus connectivity because existing consensus skeleton methods are purely morphological. Any point on the consensus skeleton consists of chunks of one or more skeletons from the individual contributors. We opted to sum all synapses in the consensus skeleton, but to weight each so that if every user annotated the same synapse it would have a total weight of 1. For example, if three contributors reconstructed a given dendritic branch in the consensus skeleton, but only two annotated a postsynaptic site associated with a specific active zone, the consensus synapse would have weight 2/3.
To estimate the probability of completely missing an edge as a function of the number of synapses in the edge, we combine the twig distribution with the error rates obtained from multi-user reconstruction. We found that our reconstruction identified 672 out of 761 twigs, giving our method a recall rate for complete twigs of q = 0.88. Let the distribution of nb twigs across edges with m synapses be p(nb; m). Assuming each branch has a probability q of being correctly observed, the probability of not observing a specific connection across all nb twigs is . The probability of omitting an edge with m synapses is thus given by
In our reconstruction method, we emphasize connections that are found consistently between cells of the same type, typically hemisegmental homologs of a presynaptic and postsynaptic neuron. Using a simple model, we approximate the likelihood of introducing a symmetric, but false, edge between cell types in our wiring diagram due to reconstruction mistakes. Consider two neurons, j = 1,2, of the same cell type, with the dendrites of each sufficiently close to N axons to physically permit connections. To add an incorrect edge to the connectivity graph and not just reweight an existing one, any added branches must have synapses from otherwise unconnected neurons. Let the number of axons with zero true connectivity be N0. Assuming symmetry, the number of axons for both neurons should be similar. We then suppose that errors add m synapses to each neuron, with each synapse assigned uniformly at random to axon i G (1, 2,.., N), with the final added edge count onto neuro n j from axon i given by ki,j. For clarity, we order the axons such that i ≤ N0 designates an axon with no true connectivity. We then ask what is the probability that both ki,1, ki,2 > kθ for any i ≤ N0.
The parameters of this model will vary depending on the properties of the neuron and neuropil in question. For example, larger neurons will have more opportunities for error than smaller ones, while neurons with more stringent synaptic specificity have more true zero edges than broadly synaps-ing neurons. To estimate a realistic set of values for the neurons here, we consider the validation data.
Because nearly all false positives occur on the terminal arbors, the number of synapses added by error m can be expressed as m = rLt, the product of the rate of incorrect branches per length of twig r, the total length of twigs Lt, and the expected synapses per added twig . Based on the independent reconstructions, we estimate r as 6 false-positive errors per 1.63 × 103 µm, = 5 synapses, and a typical Lt = 257 µm, making m = 5. Determining N and N0 is difficult, as it requires knowledge of axons that would not be in the connectivity-driven reconstruction. We estimate reasonable values using the aCC and RP2 network, since aCC dendrites strongly overlap RP2 dendrites, but have several presynaptic neurons not shared with RP2 (Figure 4B). In addition to the axons presynaptic to RP2, we find a mean of N0 = 36 inputs exclusive to aCC, so we estimate N = 87. We simulated the 106 iterations of the model for kθ = 1-4. To investigate more extreme errors than the ones measured, we also considered m = 37 synapses, the largest twin twig observed across all neurons looked at, and m = 20 synapses, a more typical value for the largest twig of a single neuron.
Skeletons are chimeras, with multiple contributors creating various parts at different points in time. We estimate the total amount of time spent skeletonizing an arbor—including its synapses—by counting the number of 20-second intervals that contain at least one skeleton node or connector node related to the skeleton. This approach is robust to the discontinuity in time and authorship of adjacent skeleton nodes, but tends to overestimate slightly reconstruction time, given the contribution of 20-second intervals for single nodes that were created earlier in time as pre- or postsynaptic placeholder skeletons with a single node, and which were subsequently merged into the growing skeleton. If the latter were each counted as contributing 6 seconds only, reconstruction times per skeleton typically shrink between 15 and 25%.
We estimate the time for the systematic review of a neuron similarly, with the added caveat that parts of the same arbor may have been reviewed more than once. We count the number of minutes for which at least one skeleton node was reviewed, for every contributor that reviewed a fraction of the arbor, and then add up all the minutes of each contributor.
The data volume used was described in Ohyama et al. (2015). It is comprised of 462 sections, each 45 nm thick and imaged at 4x4 nm per pixel resolution. It is bounded anteriorly approximately at the intersegmental nerve entry point in segment A2 and posteriorly near the segmental nerve entry of segment A3. Sections were cut approximately 8° angle relative to true transverse, resulting in a slightly skewed volume with the left side posterior to the right.
Using their characteristic morphology, we identified and reconstructed motor neurons U1, U2, the three VUM motor neurons, aCC, RP5 and RP2 and sensory neurons dbd, dmd1, ddaD, ddaE, and vbd for segment A3. Because dbd, ddaD and ddaE axon terminals also project into anterior and posterior segments, we used segmental repetition to identify the projections of these neurons from adjacent segments that participate in the local circuitry of A3. We chose to focus on dbd, aCC, and RP2 and continued to reconstruct all arbors synaptically connected to the pair of sensory axons and two pairs of motor neuron dendrites for these cells in A3.
We found 425 arbors spanning 51.8 millimeters of cable, with a total of 24,068 presynaptic and 50,927 postsynaptic relations. Nine people contributed data for the finished product: Albert Cardona (200,773/641,740 nodes), Casey Schneider-Mizell (171,718/641,740 nodes), Julie Tran (64,362/641,740 nodes), Stephan Gerhard (34,837/641,740 nodes), John Patton (10,385/641,740 nodes), Ingrid Andrade (8,667/641,740 nodes), Chris Doe (1,505/641,740 nodes), Mark Longair (1022/641,740 nodes), and Akira Fushiki (675/641,740 nodes). Some reconstructions (147,554/641,740 nodes) were imported into CATMAID from prior work in the same volume in TrakEM2 by Albert Cardona, Casey Schneider-Mizell, Mark Longair, Alexander Berthold van der Bourg, and Kenny Floria. All reconstructions were reviewed in CATMAID.
Each arbor was named and described as an identifiable neuron (198 arbors), an ascending or descending projection that spans the full anteroposterior dimension of the imaged volume (107 arbors), a neuron spilling over from adjacent segments beyond the imaged volume (84 arbors), or an unresolvable fragment (36 arbors) (see Figure 3—figure supplement 1, Figure 3—figure supplement 2). The 198 identifiable neurons amount to 83% of all cable, 88% of all inputs and 62% of all outputs, with ascending or descending projections contributing 29% of all outputs. The anatomy and connectivity of all arbors can be found in the Supplemental Data.
CNS of Drosophila larva were dissected in PBG (10% NGS [Normal Goat Serum] in 1% PBS) with tweezers under a scope and fixed with 4% paraformaldehyde in 1% PBS for 30 min, washed 3×10 min in PBT (1% Triton-X100 in 1% PBS), blocked for 1 hr in PBG, then washed 3×10 min in PBGT (1% Triton-X100 in PBG), and incubated with primary antibodies (rabbit anti-GABA: Sigma A2053 at 1/1000; chick anti-GFP: Abcam ab13970 at 1/2000) in PBGT for 24 hr at 4°C on small Eppendorf tubes laid on a gentle horizontal shaker. They were then washed 4×15 min in PBT, and incubated with secondary antibodies (goat anti-chick 488: Invitrogen, at 1/500; goat anti-rabbit 568: Invitrogen, at 1/500) in PBGT at 4°C in Eppendorf tubes wrapped in aluminum foil on a horizontal shaker for 24 hr, subsequently washed in PBT 4×15 min (wrapped in foil), and mounted on poly-lysine coated glass slides. Then samples were dehy drated by dipping the slides in an alcohol series (30%, 50%, 70%, 90% in distilled water, then twice 100%) and then in 100% xylene (3 times) using Columbia glass jars with slits for slides; then mounted on glass slides in DePeX (Li et al., 2014) using spacer coverslips on the sides. Glass slides were left to dry in a large Petri dish with a lid, wrapped in foil and at 4°C for 3 days. Imaging was done with a Zeiss 710 confocal laser-scanning microscope. Positive immunoreactivity was confirmed by consistent labeling across multiple GFP-labeled cells per imaged nervous system in two or more nervous systems.
An energy budget for signaling in the grey matter of the brainJournal of Cerebral Blood Flow and Metabolism 21:1133–1145.https://doi.org/10.1097/00004647-200110000-00001
Beyond the connectome: how neuromodulators shape neural circuitsBioEssays : News and Reviews in Molecular, Cellular and Developmental Biology 34:458–465.https://doi.org/10.1002/bies.201100185
Learning context cues for synapse segmentation in EM volumesIn: N Ayache, H Delingette, P Golland, K Mori, editors. Medical Image Computing and Computer-Assisted Intervention – MICCAI 2012. Berlin, Heidelberg: Springer. pp. 585–592.https://doi.org/10.1007/978-3-642-33415-3_72
Stereotypical bouton clustering of individual neurons in cat primary visual cortexJournal of Neuroscience 27:12242–12254.https://doi.org/10.1523/JNEUROSCI.3753-07.2007
A presynaptic gain control mechanism among sensory neurons of a locust leg proprioceptorJournal of Neuroscience 14:272–282.
Local circuits for the control of leg movements in an insectTrends in Neurosciences 15:226–232.https://doi.org/10.1016/0166-2236(92)90040-F
Identifying neuronal lineages of drosophila by sequence analysis of axon tractsJournal of Neuroscience 30:7538–7553.https://doi.org/10.1523/JNEUROSCI.0186-10.2010
Branch architecture of the fly larval abdominal serotonergic neuronsDevelopmental Biology 320:30–38.https://doi.org/10.1016/j.ydbio.2008.03.038
Semi-automated reconstruction of neural circuits using electron microscopyCurrent Opinion in Neurobiology 20:667–675.https://doi.org/10.1016/j.conb.2010.08.002
Invertebrate presynaptic inhibition and motor controlExperimental Brain Research 112:163–180.
Structural neurobiology: missing link to a mechanistic understanding of neural computationNature Reviews. Neuroscience 13:351–358.https://doi.org/10.1038/nrn3169
Efficient automatic 3D reconstruction of branching neurons from EM dataComputer Vision and Pattern Recognition. pp. 1004–1011.
Candidate sampling for neuron reconstruction from anisotropic electron microscopy volumesMICCAI Proceedings.
The ultrastructure of group ia afferent fiber synapses in the lumbosacral spinal cord of the catBrain Research 300:201–209.
Design and evaluation of interactive proofreading tools for connectomicsIEEE Transactions on Visualization and Computer Graphics 20:2466–2475.https://doi.org/10.1109/TVCG.2014.2346371
Synaptic circuits involving an individual retinogeniculate axon in the catThe Journal of Comparative Neurology 259:165–192.https://doi.org/10.1002/cne.902590202
High-accuracy neurite reconstruction for high-throughput neuroanatomyNature Neuroscience 14:1081–1088.https://doi.org/10.1038/nn.2868
A sensory feedback circuit coordinates muscle activity in drosophilaMolecular and Cellular Neurosciences 35:383–396.https://doi.org/10.1016/j.mcn.2007.04.001
Machines that learn to segment images: a crucial technology for connectomicsCurrent Opinion in Neurobiology 20:653–666.https://doi.org/10.1016/j.conb.2010.07.004
The origin, location, and projections of the embryonic abdominal motorneurons of drosophilaJournal of Neuroscience 17:9642–9655.
Synaptic organization in the adult drosophila mushroom body calyxThe Journal of Comparative Neurology 517:808–824.https://doi.org/10.1002/cne.22184
Supervoxel-based segmentation of mitochondria in em image stacks with learned shape featuresIEEE Transactions on Medical Imaging 31:474–486.https://doi.org/10.1109/TMI.2011.2171705
Synaptic organization of columnar elements in the lamina of the wild type in drosophila melanogasterThe Journal of Comparative Neurology 305:232–263.https://doi.org/10.1002/cne.903050206
Optimized tools for multicolor stochastic labeling reveal diverse stereotyped cell arrangements in the fly visual systemProceedings of the National Academy of Sciences of the United States of America 112:E2967.https://doi.org/10.1073/pnas.1506763112
NetworksOxford: Oxford University Press.https://doi.org/10.1093/acprof:oso/9780199206650.001.0001
Genetically encoded dendritic marker sheds light on neuronal connectivity in drosophilaProceedings of the National Academy of Sciences of the United States of America 107:20553–20558.https://doi.org/10.1073/pnas.1010198107
Dendrodendritic and axoaxonic synapses in the thalamic reticular nucleus of the adult ratJournal of Neuroscience 17:3215–3233.
Computational subunits in thin dendrites of pyramidal cellsNature Neuroscience 7:621–627.https://doi.org/10.1038/nn1253
Presynaptic inhibition in the vertebrate spinal cord revisitedExperimental Brain Research 129:1–37.https://doi.org/10.1007/s002210050933
A modified method for lead staining of thin sectionsJournal of Electron Microscopy 17:158–159.
Role of intrinsic properties in drosophila motoneuron recruitment during fictive crawlingJournal of Neurophysiology 104:1257–1266.https://doi.org/10.1152/jn.00298.2010
Small GTPase Cdc42 is required for multiple aspects of dendritic morphogenesisJournal of Neuroscience 23:3118–3123.
Mitochondrial transport in neurons: impact on synaptic homeostasis and neurodegenerationNature Reviews. Neuroscience 13:77–93.https://doi.org/10.1038/nrn3156
Peripheral multidendritic sensory neurons are necessary for rhythmic locomotion behavior in drosophila larvaeProceedings of the National Academy of Sciences of the United States of America 104:5199–5204.https://doi.org/10.1073/pnas.0700895104
Automated molecular microscopy: the new leginon systemJournal of Structural Biology 151:41–60.https://doi.org/10.1016/j.jsb.2005.03.010
Are dendrites in drosophila homologous to vertebrate dendrites?Developmental Biology 288:126–138.https://doi.org/10.1016/j.ydbio.2005.09.026
A genetic and computational approach to structurally classify neuronal typesNature Communications 5:3512.https://doi.org/10.1038/ncomms4512
Structural properties of the caenorhabditis elegans neuronal networkPLoS Computational Biology 7:e1001066.https://doi.org/10.1371/journal.pcbi.1001066
Segmentation fusion for connectomicsICCV.
Increasing depth resolution of electron microscopy of neural circuits using sparse tomographic reconstructionProceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR).
Early events in olfactory processingAnnual Review of Neuroscience 29:163–201.https://doi.org/10.1146/annurev.neuro.29.051605.112950
Distance metric learning with application to clustering with side-informationAdvances in Neural Information Processing Systems pp. 505–512.
Ronald L CalabreseReviewing Editor; Emory University, United States
In the interests of transparency, eLife includes the editorial decision letter and accompanying author responses. A lightly edited version of the letter sent to the authors after peer review is shown, indicating the most substantive concerns; minor comments are not usually included.
Thank you for submitting your work entitled "Quantitative neuroanatomy for connectomics in Drosophila" for consideration by eLife. Your article has been favorably evaluated by Eve Marder (Senior Editor) and three reviewers, one of whom, Ronald L. Calabrese, is a member of our Board of Reviewing Editors, and another is Kristen Harris.
The reviewers have discussed the reviews with one another and the Reviewing Editor has drafted this decision to help you prepare a revised submission.
The authors report an enhancement of a semi-automated technique for serial section EM reconstruction of neuronal circuitry in Drosophila larva and adults. Specifically, they extended the web-based image data viewer CATMAID (Saalfeld et al., 2009) to enable multiple researchers to map neuronal circuitry. A neuron is reconstructed with a skeleton, a directed tree graph with one or more nodes in every cross-section of neurite in an EM volume. Synapses are annotated as a relation from a node on the presynaptic neuron skeleton to an intermediate "connector node" and then to a node of a postsynaptic neuron skeleton. Reconstructions are immediately synchronized across all users to avoid duplicate or conflicting work, and to take advantage of existing reconstructions to aid further reconstruction and circuit discovery.
They use the method on test cases and make several interesting discoveries that validate the method and contribute to our understanding of Drosophila neuronal networks. For example, they show that the vast majority of postsynaptic sites are on microtubule free dendritic twigs, some spine like, and that presynaptic sites are on branches near microtubules and mitochondria. Moreover, they reconstruct a proprioceptive network from sensory axons to motor neurons and provide insightful micro-anatomical comparisons between putative inhibitory and excitatory interneurons.
The expert reviews are complimentary and point out two major concerns that should be addressed in revision.
1) The presentation should be redone to clarify the impact of the work and to take full advantage of the eLife format. The full impact and import of the technical advance is not made clear to the non-expert reader. A flow chart of the method should be added in the main text (supported by the text) that demonstrates the collaborative process and points out where in the collaborative process each of the 'high-level' metrics/comparisons were made. The interesting biological findings of the paper are not sufficiently explored in the main text but rather relegated to supplementary data. Because there are no figure limitations in eLife more of the interesting biological data should be brought forward into the text and perhaps emphasized more in Discussion.
2) There is a concern that the method, while principled effectively for insect neurons, may not be generalizable to other systems. The authors can do more to discuss how their conceptual framework in designing their method can be made applicable in other systems.
The expert reviews are appended because they add specificity to the above concerns and also address more minor points in need of clarification and/or revision.
From Eve Marder, Senior Editor: Please take full advantage of the eLife format to make figures as high-quality and large as they need be to make their points. This paper should be visually spectacular, so make it so by taking advantage of figure supplements, or just increasing the number of figures. eLife discourages all use of supplemental text and figures, so please bring everything possible into the main body of the text.
Nearly all of my comments reside within the realm of how to make the writing clearer to the reader and are open to the discretion of the authors to implement as suggested, or in different ways.
The data support all of the major conclusions as well as convincingly support the use of an integrative process with its great time-savings, over the consensus model (that requires repeated full reconstructions by many people). When the EM images are outstanding, as they are in this work, then the iterative approach is surely more efficient and equally accurate to a consensus approach.
My one main comment is that the authors need to define the two different approaches in the Abstract, Introduction, Methods, and Discussion more clearly – the references are a little obtuse right now, and even though I think I know the difference (iterative being not repeated full reconstruction of neurons where they are easy to follow vs. consensus being full reconstructions of whole neurons by multiple people – costing 4-10 times the amount of time).
I fully agree from our own experience that curation of difficult points (iteration) in the neuropil by multiple users coming to the synapse from different perspectives, is a much better approach and the data presented here demonstrate it conclusively and should serve to guide future work.
The mitochondrial findings (synapses all within 3 μm of a mitochondrion) have strong functional implications. In of themselves these findings could constitute a whole paper. I would like to see them in a whole paper, or at least brought to the fore in this paper. Burying them in the supplemental data is a disservice to this major finding.
As the authors point out, perhaps the biggest advances in the manuscript are the extensions of CATMAID that enable interactive collaborative analysis of circuits. They make a compelling case for this approach by analyzing networks of tens to hundreds of neurons. However, the manuscript is a complicated mixture of pointing out the unique features of Drosophila neurons that make them amenable to the described approach (Figures 1–2, 6) and the description of the actual methods employed and error quantification (Figure 3–5). I understand why the authors organized it as they did, but the necessity to point out the unique features of fly neurons before getting to the various analysis methods raises the question of how generalizable their approach is to neurons in other nervous systems.
Many of the conclusions and error quantifications hinge on the localization of presynaptic input synapses to twigs and the distribution of inputs across twigs. The authors draw the somewhat obvious conclusion that the localization of synapses along neurites will alter the impact of tracing errors. If, however, the morphologies of vertebrate/mammalian neurons are substantially more intricate, it is not clear how many of the principles described in the manuscript will carry over. I am thinking of, for example, thin 100 nm unmyelinated cortical axons extending over millimeters of path length where single errors could significantly impact a connectivity matrix by mis-assignment of all synapses downstream of an error. I commend the authors of making full use of the benefits of Drosophila neuroanatomy, but I remain unsure that many of their conclusions are generally applicable to neurons/circuits in other species.
Something like a flowchart demonstrating the collaborative process would also help. I realize this is described in the supplemental text, but I think a diagram would help the reader understand at which point in the collaborative process each of the 'high-level' metrics/comparisons were made. As written the application of each of the analysis tools seems ad hoc. Is this how the authors intend this to be read? This is particularly an issue with Figure 3, which shows 4 different wiring diagrams each using different analysis tools. Given that the authors are not constrained to a 6-figure paper in eLife (as far as I am aware), Figure 3 could have been broken out into multiple figures each demonstrating a particular analysis tool in more detail.https://doi.org/10.7554/eLife.12059.031
The expert reviews are complimentary and point out two major concerns that should be addressed in revision. 1) The presentation should be redone to clarify the impact of the work and to take full advantage of the eLife format. The full impact and import of the technical advance is not made clear to the non-expert reader. A flow chart of the method should be added in the main text (supported by the text) that demonstrates the collaborative process and points out where in the collaborative process each of the 'high-level' metrics/comparisons were made. The interesting biological findings of the paper are not sufficiently explored in the main text but rather relegated to supplementary data. Because there are no figure limitations in eLife more of the interesting biological data should be brought forward into the text and perhaps emphasized more in Discussion.
We appreciate the suggestion to better use the eLife format and have made a number of changes to accomplish this. The principle changes to this end include:
A) We added a new Figure 1 with richer synapse and microtubule imagery taken from the previous supplemental figures.
B) We added a new Figure 4 and an associated section in the Results describing the mitochondria data that was previously in a supplemental figure.
C) We added a new Figure 5 showcasing the many views of the same data that our method requires and our software affords. This was based on a previous supplemental figure.
D) We added a new Figure 9 providing a flow chart of the method.
E) We eliminated the supplemental text and moved its contents into the Results and Methods sections.
F) We added several movies that help illustrate the 3d anatomy of neurons shown in main text figures.
2) There is a concern that the method, while principled effectively for insect neurons, may not be generalizable to other systems. The authors can do more to discuss how their conceptual framework in designing their method can be made applicable in other systems.
We have added a Discussion section – “Generalizability of our iterative method to other organisms” – that goes into more detail on the design principles that we believe are universal for neuronal reconstruction. The key points are: 1) measurements of connectivity statistics (e.g. how many synapses are associated with an edge) and the dependence on anatomy of reconstruction errors allow better estimates of acceptable error rates, 2) ultrastructural elements, particularly microtubules, can disambiguate situations where membrane alone is difficult, and 3) statistical properties of morphology and connectivity can help discover outliers that come from false positive errors adding large branches and numerous synapses.
The expert reviews are appended because they add specificity to the above concerns and also address more minor points in need of clarification and/or revision. From Eve Marder, Senior Editor: Please take full advantage of the eLife format to make figures as high-quality and large as they need be to make their points. This paper should be visually spectacular, so make it so by taking advantage of figure supplements, or just increasing the number of figures. eLife discourages all use of supplemental text and figures, so please bring everything possible into the main body of the text.
We thank the editor for the encouraging suggestion, and have made the changes described above to accommodate it.
Nearly all of my comments reside within the realm of how to make the writing clearer to the reader and are open to the discretion of the authors to implement as suggested, or in different ways. The data support all of the major conclusions as well as convincingly support the use of an integrative process with its great time-savings, over the consensus model (that requires repeated full reconstructions by many people). When the EM images are outstanding, as they are in this work, then the iterative approach is surely more efficient and equally accurate to a consensus approach. My one main comment is that the authors need to define the two different approaches in the Abstract, Introduction, Methods, and Discussion more clearly – the references are a little obtuse right now, and even though I think I know the difference (iterative being not repeated full reconstruction of neurons where they are easy to follow vs. consensus being full reconstructions of whole neurons by multiple people – costing 4-10 times the amount of time).
We have taken this advice and added a more explicit description of the two methods throughout the paper. In the Abstract, we mention our comparison between the two approaches in the last sentence. In the final paragraph of the Introduction, we clarified the description of iterative versus consensus methods. We have also brought more complete explanations of reconstruction and proofreading into the Methods section.
I fully agree from our own experience that curation of difficult points (iteration) in the neuropil by multiple users coming to the synapse from different perspectives, is a much better approach and the data presented here demonstrate it conclusively and should serve to guide future work. The mitochondrial findings (synapses all within 3 um of a mitochondrion) have strong functional implications. In of themselves these findings could constitute a whole paper. I would like to see them in a whole paper, or at least brought to the fore in this paper. Burying them in the supplemental data is a disservice to this major finding.
We thank the reviewer for the interest in this data, and have moved it to a Results section, “Presynaptic sites are associated with mitochondria and microtubules,” and created a new main text figure (Figure 4) that carries the same data and addresses other issues raised below.
As the authors point out, perhaps the biggest advances in the manuscript are the extensions of CATMAID that enable interactive collaborative analysis of circuits. They make a compelling case for this approach by analyzing networks of tens to hundreds of neurons. However, the manuscript is a complicated mixture of pointing out the unique features of Drosophila neurons that make them amenable to the described approach (Figures 1–2, 6) and the description of the actual methods employed and error quantification (Figure 3–5). I understand why the authors organized it as they did, but the necessity to point out the unique features of fly neurons before getting to the various analysis methods raises the question of how generalizable their approach is to neurons in other nervous systems. Many of the conclusions and error quantifications hinge on the localization of presynaptic input synapses to twigs and the distribution of inputs across twigs. The authors draw the somewhat obvious conclusion that the localization of synapses along neurites will alter the impact of tracing errors. If, however, the morphologies of vertebrate/mammalian neurons are substantially more intricate, it is not clear how many of the principles described in the manuscript will carry over. I am thinking of, for example, thin 100 nm unmyelinated cortical axons extending over millimeters of path length where single errors could significantly impact a connectivity matrix by mis-assignment of all synapses downstream of an error. I commend the authors of making full use of the benefits of Drosophila neuroanatomy, but I remain unsure that many of their conclusions are generally applicable to neurons/circuits in other species.
We appreciate this thoughtful criticism, especially as the experience of the authors is dominated by Drosophila neurons. First, there remains much fruitful work to be done in stereotyped organisms other than the larva, including the adult fly, Platynereis, and C. elegans. For such systems, we believe that this method will carry over with only modest changes. For less stereotyped systems such as vertebrates, we believe that several conceptual aspects of our design process are of general use. We have added an extended discussion of how the advances described here would apply in Discussion section “Generalizability of our iterative reconstruction method to other organisms”.
Something like a flowchart demonstrating the collaborative process would also help. I realize this is described in the supplemental text, but I think a diagram would help the reader understand at which point in the collaborative process each of the 'high-level' metrics/comparisons were made. As written the application of each of the analysis tools seems ad hoc. Is this how the authors intend this to be read?
We have added a flow chart (Figure 9) to better outline the method. While all the steps are voluntary to perform, the systematic review status is made clear within individual widgets as described in the Methods section “Proofreading and error correction.” The method described demands that key neurons and connections for a given reconstruction be evaluated by each class of features.
This is particularly an issue with Figure 3, which shows 4 different wiring diagrams each using different analysis tools. Given that the authors are not constrained to a 6-figure paper in eLife (as far as I am aware), Figure 3 could have been broken out into multiple figures each demonstrating a particular analysis tool in more detail.https://doi.org/10.7554/eLife.12059.032
- Casey M Schneider-Mizell
- Stephan Gerhard
- Tom Kazimiers
- Feng Li
- Maarten F Zwart
- Andrew Champion
- Frank M Midgley
- Richard D Fetter
- Stephan Saalfeld
- Albert Cardona
- Casey M Schneider-Mizell
- Stephan Gerhard
- Mark Longair
- Albert Cardona
- Casey M Schneider-Mizell
- Stephan Gerhard
- Mark Longair
- Albert Cardona
- Mark Longair
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
We thank James Truman for the use of single cell light-microscopy images; Ingrid Andrade and Javier Valdés-Alemán for reconstructing redundant skeletons for the RESCOP comparison; John Patton, Ingrid Andrade, Kenny Floria, Alex Berthold van der Bourg, Lukas von Ziegler and Julie Tran for reconstructing about 20% of all arbor cable; Daniel Bonnéry for discussions about statistics; Davi Bock for conceiving the notion of low-confidence edge in an arbor; Goran Cerić, Tom Dolafi and Ken Carlile for IT support; Nicholas Strausfeld for the term ‘twig’ and fruitful discussions; Eric Perlman for code and IT tips; Marta Zlatic, Tomoko Ohyama, Chris Q. Doe, Matthias Landgraf, Akinao Nose, Anna Kreshuck, Fred Hamprecht, Akira Fushiki, Pau Rué, David Wood, Jan Funke, Steve Plaza, Davi Bock and Greg Jefferis for comments; Brett Mensch for discussions. Funding came from the HHMI Janelia Visiting Scientist program (AC), Swiss National Science Foundation grant 31003A 132969 (AC), HHMI, and the Institute of Neuroinformatics of the University of Zurich and ETH Zurich.
- Ronald L Calabrese, Emory University, United States
© 2016, Schneider-Mizell et al.
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.