Research: Decoupling of the minority PhD talent pool and assistant professor hiring in medical school basic science departments in the US
Abstract
Faculty diversity is a longstanding challenge in the US. However, we lack a quantitative and systemic understanding of how the career transitions into assistant professor positions of PhD scientists from underrepresented minority (URM) and well-represented (WR) racial/ethnic backgrounds compare. Between 1980 and 2013, the number of PhD graduates from URM backgrounds increased by a factor of 9.3, compared with a 2.6-fold increase in the number of PhD graduates from WR groups. However, the number of scientists from URM backgrounds hired as assistant professors in medical school basic science departments was not related to the number of potential candidates (R2=0.12, p>0.07), whereas there was a strong correlation between these two numbers for scientists from WR backgrounds (R2=0.48, p<0.0001). We built and validated a conceptual system dynamics model based on these data that explained 79% of the variance in the hiring of assistant professors and posited no hiring discrimination. Simulations show that, given current transition rates of scientists from URM backgrounds to faculty positions, faculty diversity would not increase significantly through the year 2080 even in the context of an exponential growth in the population of PhD graduates from URM backgrounds, or significant increases in the number of faculty positions. Instead, the simulations showed that diversity increased as more postdoctoral candidates from URM backgrounds transitioned onto the market and were hired.
https://doi.org/10.7554/eLife.21393.001Introduction
Enhancing the diversity of the research workforce has been a longstanding priority of scientific funding agencies (Tabak and Collins, 2011; Valantine and Collins, 2015; National Institutes of Health, 2015; National Institute of General Medical Sciences, 2015). Scientists from certain underrepresented minority (URM) racial/ethnic backgrounds—specifically, African American/Black, Hispanic/Latin@, American Indian, and Alaska Native—receive 6% of NIH research project grants (Ginther et al., 2016, 2011; National Institutes of Health, 2012b) despite having higher representation in the relevant labor market (Heggeness et al., 2016), and constituting 32% of the US population (National Institutes of Health, 2012b). The vast majority of NIH funding—approximately 83%—is awarded to investigators at extramural institutions, many of whom serve as faculty members at academic and research institutions (Johnson, 2013). In particular, MD-granting medical schools and their affiliates (henceforth, medical schools) that belong to the Association of American Medical Colleges (AAMC) receive 67% of NIH extramural funding, and comprised the entire top 20 of NIH-funded institutions in FY2015 (National Institutes of Health, 2016). As a result, the goal of diversifying the biomedical investigator pool necessitates diversifying the professoriate generally, and in medical schools specifically.
Faculty members play critical and unique roles within the scientific enterprise, shaping the national research agenda, and cultivating the next generation of scientists and scholars (Clauset et al., 2015; Leggon, 2010). However, a 2011 report from the National Academies of Sciences said “diversifying faculties is perhaps the least successful of the diversity initiatives” (National Academy of Sciences, 2011). Student protests on college campuses across the country in the 2015 academic year often centered on the need for more faculty diversity, and highlighted the lack thereof, especially in scientific disciplines (Griffin, 2016). As the nation continues to diversify, broadening participation within the research enterprise and professoriate is believed to be critically important for maintaining an adequate domestic scientific workforce, and ensuring the research enterprise effectively meets the needs of the entire population (National Institutes of Health, 2012b; National Academy of Sciences, 2011).
This work focuses on three possible reasons for the low number of scientists from URM backgrounds in the professoriate relative to their peers from well-represented (WR) backgrounds (specifically, White, Asian, and all other non-URM groups) that are amenable to intervention by the scientific community: (i) the size of the URM PhD talent pool, (ii) the number of available faculty positions, and (iii) the transition of the available URM PhD and postdoctoral talent pool onto the faculty job market, and their subsequent hiring. Educational disparities between students from URM and WR backgrounds begin early in life, and accumulate from K-12 through early independence (National Institutes of Health, 2012b; Garrison, 2013). Thus, it is possible that the cumulative impact of these disparities is the URM PhD and postdoctoral talent pool that is too small to sustain meaningful levels of faculty diversity (Garrison et al., 2009). If so, intervention strategies would need to focus primarily on building the talent pool.
Additionally, current faculty diversity efforts occur against the backdrop of systemic changes within biomedicine. Following the doubling of the NIH budget between 1998 and 2003, there was a significant increase in the number of PhDs awarded, without commensurate increase in the number of faculty positions (Stephan, 2012; Alberts et al., 2014). This led to labor market imbalances in which there are significantly more scientists who desire faculty positions than the supply of such positions. Further, it is estimated that fewer than 11% of all life science PhDs enter faculty positions in any institution type (National Science Board, 2014). This raises the possibility that the low number of faculty from URM groups is mainly a function of broader stresses on the faculty job market or changes in the overall labor market for PhDs (Zolas et al., 2015). If so, intervention strategies could focus on expanding the number of new faculty positions available, thus creating more opportunities for scientists from all backgrounds.
Beyond the number of faculty positions available, there is evidence that graduate students and postdocs from all backgrounds lose interest in faculty careers in research-intensive universities as their training progresses (Fuhrmann et al., 2011; Gibbs et al., 2015; Sauermann and Roach, 2012). Moreover, at PhD completion URM men and women report lower levels of interest in faculty positions at research-intensive universities than their WR counterparts, even when controlling for career interests at PhD entry, scholarly productivity, mentorship or research self-efficacy (Gibbs et al., 2014). Thus, part of the lack of representation could be due to disproportionately low application rates by URM PhD graduates and postdocs for these positions for reasons ranging from values misalignment (Gibbs et al., 2013), implicit and explicit biases (Colon Ramos and Quiñones-Hinojosa, 2016; Jarvis, 2015), or perceptions of hypercompetition within academic research that makes the positions particularly unattractive in the current funding climate (McDowell et al., 2014).
Increasing diversity in the applicant pool and equitable evaluation in the hiring process are strategies that promote faculty diversity (Turner, 2002; Sheridan et al., 2010; Moody, 2004; Smith, 2015). While systematic data are not available on the demographics of faculty applicants, the chair of a recent faculty search in systems biology at Harvard university reported very low numbers of applications from women and scientists from URM backgrounds (Eddy, 2015), lending credence to the notion that faculty applicant pools lack diversity. If this is the case, intervention strategies could focus on enhancing diversity in the applicant pool and ensuring equitable evaluation to increase faculty diversity.
The static nature of faculty diversity, especially in research-intensive environments, suggests that new approaches are necessary for achieving the goal of workforce diversity. In particular, computational modeling approaches such as System Dynamics (SD) have been used to examine the macro-scale impacts of potential policy interventions on the biomedical postdoctoral workforce (Ghaffarzadegan et al., 2014), and new faculty hiring (Larson and Diaz, 2012). The goal of this work is to:
Provide a systematic and quantitative perspective on changes in the numbers of biomedical PhDs and assistant professorships in medical school basic science departments by scientists from URM and WR backgrounds between 1980-2014.
Build and validate a System Dynamics (SD) model that can capture major trends in the career progression of PhD scientists from URM and WR backgrounds into this segment of the professoriate.
Utilize the SD model to test the impact of various intervention strategies to faculty diversity in the short-term (through 2030) and long-term (through 2080). Specifically, we model the impact on faculty diversity at the assistant professor stage by increasing: (i) the size of the talent pool of PhDs from URM backgrounds, (ii) the number of assistant professor positions available, or (iii) the rate of transition of PhDs from URM backgrounds into the applicant pool of assistant professorships.
We focus on medical school basic science departments because of the availability of comprehensive, longitudinal demographic data (in contrast to the broader biomedical workforce, where career outcome data are lacking [Polka et al., 2015; National Institutes of Health, 2012a]). Our goal is that these analyses can provide an example for other areas of the scientific community working to address their own diversity challenges.
Results
Trends in PhD Graduation and assistant professorship growth: 1980-2014
Figure 1 shows how the representation of scientists from URM and WR backgrounds in the populations of biomedical PhD graduates, and assistant professors in medical school basic science departments has changed from 1980-2014 (complete data are available in Figure 1—source data 1). These analyses include the annual population (Figure 1Ai,Bi), population growth relative to 1980 (Figure Aii,Bii), and the percentages of scientists from each population from each group (Figure 1Aiii,Biii). Data on the populations of PhD graduates and assistant professors in medical school basic science departments were obtained from the National Science Foundation Survey of Earned Doctorates (as compiled by Federation of American Societies for Experimental Biology), and the AAMC Faculty Roster, respectively (please see methods section for more information).
-
Figure 1—source data 1
- https://doi.org/10.7554/eLife.21393.003
For both URM and WR populations, there was significant growth in the number of PhD graduates, and significant yet slower growth in the population of assistant professors (Figure 1). However, there were differences in the magnitudes of these changes across time. The annual number of URM PhD graduates grew more than nine-fold from 1980–2013 (from n=93 to n=868), whereas the population of URM assistant professors grew 2.6-fold (from n=132 in 1980 to n=341 in 2014; Figure 1Ai–ii). In comparison, for scientists from WR backgrounds growth in assistant professors was more closely aligned with growth in PhD graduates–there was a 2.2-fold increase in the annual number of PhD graduates (from n=3989 in 1980 to n=8789 in 2013; Figure 1Bi–ii), and a 1.7-fold increase for population of assistant professors (n=3246 in 1980 to n=5562 in 2014; Figure 1Bi–ii). While the population of PhD graduates grew more quickly than that of assistant professors for all groups over time, this difference was greater in the URM population than the WR population. That is, there was a statistically significant interaction between URM status and position (β=1.60; p=3.6*10−7; PhD graduates relative to assistant professors), above the impacts URM status (β=0.0602, p=0.005), position alone (β = 0.229, p=0.28), or the increases that occurred as the system grew through time (β = 0.0895, p=2*10−16).
Figure 1Aiii and Biii show the proportions of URM and WR PhD graduates in the overall pool (solid lines) and among U.S. citizens and permanent residents (dotted lines). Among the pool of U.S. citizens and permanent residents, the proportion of URM PhD graduates grew from 2.5% in 1980 to 13% in 2013, whereas in the overall pool the proportion of URM PhD graduates grew from 2.3% in 1980 to 9% in 2013. In contrast, the percentage of URM assistant professors grew from 3.9% in 1980 to 5.8% in 2014 (Figure 1Aiii).
Between 2005-2013, a total of 5,842 biomedical PhDs were awarded to scientists from URM backgrounds; however, there were six fewer URM assistant professors in basic science departments in 2014 than in 2005 (n=341 in 2014 versus 347 in 2005). For scientists from WR backgrounds, there was 31% growth in the annual number of PhD graduates (n=8789 in 2013 compared to n=6703 in 2005) and 8.6% growth in the population of assistant professors (n=5562 in 2014 compared to n=5122 in 2005). Thus, while the populations of PhD graduates and assistant professors has grown since 1980 for scientists from all backgrounds, the magnitude of the growth of PhD graduates relative to assistant professors differed greatly between URM and WR scientists.
Hiring patterns of URM and WR assistant professors in basic science
The patterns of assistant professor hiring differed across populations. For scientists from URM backgrounds, there was a 7.6-fold increase in the size of the potential candidate pool (Figure 2Ai); however, the size of the potential URM candidate pool was not significantly correlated with the number of URM assistant professors hired each year (R2=0.12, p=0.07; Figure 2Aii). In contrast, for scientists from WR backgrounds there was a 2.2-fold growth in the size of the candidate pool (Figure 2Bi), and the size of the potential candidate pool was significantly correlated with the number of assistant professors hired (R2=0.48, p=2.54*10−5; Figure 2Bii). For scientists from URM backgrounds, the proportion of the candidate pool hired into assistant professor positions decreased from year to year (β=-0.14, p=9.6*10−4), while for scientists from WR backgrounds the proportion of the potential candidate pool hired did not change significantly over time (β=0.004, p=0.77). Thus, despite growth in the pools of potential URM and WR candidates, the nature of entry into assistant professor positions differed significantly between the two populations, with little connection between the size of the URM available candidate pool, and the numbers entering into assistant professor positions (full data are available in Figure 2—source data 1 and 2).
-
Figure 2—source data 1
- https://doi.org/10.7554/eLife.21393.005
-
Figure 2—source data 2
- https://doi.org/10.7554/eLife.21393.006
System dynamics model development and calibration
We created a System Dynamics model capturing the flows of PhD graduates from URM and WR backgrounds into assistant professor positions. This abstract model (Gilbert, 2007) expands on the traditional “pipeline” view of assistant professor hiring (Figure 3A), and is calibrated with the empirical data mentioned above (Figure 3B for intermediate conceptual model, and Figure 3C for final model; the source code provides the model software file). Hiring trends (e.g. growth in pool size, relationship between potential candidate pool and number of assistant professors hired) were largely consistent across the intersections of gender and URM or WR status (Figure 2—figure supplement 1). Thus, for modeling, we focused only on URM/WR status, and not their intersections with gender.
The core assumptions of the model are that the number of assistant professors hired is based on: 1) the number of positions available, and 2) the number of candidates pursuing these positions. Candidates on the market are composed primarily of the subset of postdoctoral scientists pursuing faculty careers in medical school basic science departments (evidence suggests that the rates of transition into postdoctoral training are comparable between URM and WR PhD graduates [National Science Foundation, 2015b]). Based on market hiring conditions, one-fifth of the candidates on the market drop out of the market annually. That is, if the probability of being hired is relatively high (>20%) all candidates remain on the market that year; otherwise, one-fifth of the available pool drops out of the system. Thus, the average “half-life” of a candidate on the market who is not hired is five years (similar to the period of postdoctoral training for candidates pursuing faculty positions in research-intensive environments [National Institutes of Health, 2012a]).
The model also posits that URM and WR candidates are hired in direct proportion to their representation on the market. That is, the model’s output assumes that that racial bias does not impact hiring. Further, the model assumes that differences in relative strength on the job market across URM status do not impact hiring, because URM PhD graduates have lower interest in faculty careers in research-intensive environments than WR PhDs graduates even if they have graduated from the same institutions and have the same levels of scholarly productivity (Gibbs et al., 2015; Gibbs et al., 2014).
Based on the analyses presented above, the career pathways for scientists from URM and WR backgrounds were represented separately, but were linked based on the total number of assistant professor slots available. Within each population, we assumed a fixed proportion of graduates would pursue and enter faculty positions in research-intensive environments (i.e. "faculty aspire”). The size of the “faculty aspire" pool was based on hiring trends 1980-1997, before the NIH budget doubling and subsequent expansion of the biomedical PhD pool. All other PhDs would pursue other careers (i.e. “other aspire”). Without intervention, the “faculty aspire” and “other aspire” populations grow in proportion to the total number of PhD graduates (i.e. “baseline PhD graduate growth rate”). We further assumed that efforts by the scientific community to enhance the diversity of the PhD pool (“URM target growth rate”) would increase the pool of URM “other aspire” PhDs, some of whom will then transition to the faculty market. Key variables—including baseline PhD graduate growth rate, URM target growth rate, proportions of URM or WR scientists pursuing faculty positions, and the number of positions available—were derived from national survey data, while the transition rate represented a free parameter for analysis. Full details of the model are provided in the methods section and model equations and parameter values are presented in Appendix-Tables 1 and 2.
We calibrated our model against empirical trends in PhD graduations (R2=0.99, p<0.0001; Figure 4Ai) and chose the number of available slots to match empirical assistant professor hiring trends (R2=0.96, p<0.0001; Figure 4Aii). The resulting model output captured 79% of the variance in overall assistant professor hiring (R2=0.79, p<0.0001; Figure 4Aiii). When disaggregated by URM and WR status, the model captures 51% of the variance in URM hiring (Figure 4Biii; R2=0.51, p<0.0001), and 78% of the variance in WR assistant professor hiring (R2=0.78, p<0.0001; Figure 4Ciii). Thus, the model captures major trends in URM and WR hiring rates, over and above what is captured by just examining the size of the talent pool (Figure 2B).
Intervention strategies to increasing assistant professor diversity
We used the model to test the impact of three different intervention strategies on the diversity of the assistant professor pool in the short-term (through 2030; Figure 5A), and long-term (through 2080, Figure 5B). These strategies were: (i) increasing the size of the talent pool of PhDs from URM backgrounds (given the current transition rate), (ii) increasing the number of assistant professor positions available (given the current transition rate), or (iii) increasing the rate of transition of PhDs from URM backgrounds into the applicant pool of assistant professorships (with subsequent hiring). Unlike a “facsimile model” that would be designed to explicitly predict precise values of outcome metrics (in this case, precise numbers of PhD graduate and assistant professor ratios), our model is an “abstract model,” meaning that simulations are intended to examine the qualitative behavior associated with hypothetical policy outcomes, assuming that the system continues to follow its historic behavior (Gilbert, 2007). Specifically, from 1980-2013, the number of URM PhD graduates grew at an exponential rate. Therefore, all model runs assumed continued exponential growth of URM PhD graduates (lower growth rates of PhD graduates did not change the qualitative behavior of our model’s output).
-
Figure 5—source data 1
- https://doi.org/10.7554/eLife.21393.011
-
Figure 5—source data 2
- https://doi.org/10.7554/eLife.21393.012
In 2014, 5.8% of assistant professors in basic science departments were from URM backgrounds. This level of representation is consistent with a transition rate of 0.25% of "other aspire" URM PhDs onto the market (Figure 5—source data 1). Given a 0.25% transition rate, short-term simulations (Figure 5A) showed that, increasing the size of URM talent pool or the numbers of assistant professor positions available were not sufficient to increase faculty diversity. Specifically, the model predicted that by 2030, 13.8% of biomedical PhDs would be URMs, but that only 5.9% of assistant professors would be URMs whether the number of assistant professor positions remained the same (Figure 5Ai) or grew by 100 positions annually beginning in 2015 (Figure 5Aii). Put another way, the model predicted that growing the URM PhD pool 53% above current levels (i.e. 13.8% v. the current 9%) would result in a less than 2% increase in the representation of URM assistant professors. Thus, in the presence of a low transition rate, the model predicted that increasing the size of the talent pool or the number of available positions would not lead to a significant increase in the representation of URM assistant professors through 2030.
Instead, the simulations predicted that increased diversity would result from increased transition of candidates onto the market and their subsequent hiring. Increasing the transition rate to 10% increased URM representation in the assistant professor pool to between 12.4–12.5% in 2030 given the same (Figure 5Aiii) or increased number of positions available (Figure 5Aiv). That is, increasing the transition rate increased URM faculty representation by more than two-fold above what would be predicted from simply increasing the number of URM scientists exponentially through 2030.
To test if there was a threshold above which the URM PhD talent pool was sufficient to result in increased faculty diversity, we conducted simulations through 2080 (with the caveat that as the time horizons extend unforeseen external factors are likely to arise that could attenuate predictive power). The model predicted if the URM PhD population continued to grow at an exponential rate through 2080, 73% of PhDs would be URMs (at which point these populations would no longer be underrepresented). However, in the presence of the 0.25% transition rate, the model predicted that in 2080 fewer than 10% of assistant professors would be URMs, no matter the number of positions available (Figure 5Bi and Bii). In contrast, the simulations predicted that if the transition rate increased to 10%, URM assistant professor representation would be between 56.5-58.3% given the same (Figure 5Biii) or increased number of positions available (Figure 5Biv). Thus, these model simulations indicate that in the short and long-term, given the low transition rate, the size of the URM talent pool, and number of available positions in the overall market had a minimal impact on faculty diversity (even in the absence of labor market discrimination). Instead, increased faculty diversity resulted from ensuring the growing URM PhD and postdoctoral pools transitioned onto the job market and were hired (the impact of other transition rates are shown in Figure 5—source data 1 and 2). These simulations assume no racial bias in hiring; the presence of discrimination against URM scientists would attenuate any increases in faculty diversity.
Discussion
Increasing faculty diversity in academic science departments has been a long-standing challenge and has received renewed attention in recent years (Ginther et al., 2016; Ginther et al., 2011; Griffin, 2016; Duehren and Muluk, 2016; Myers et al., 2012). Here, we used data from medical school basic science departments to highlight the impact of potential intervention strategies on the diversity of assistant professors. By illuminating some of the dynamics with respect to faculty diversity in medical schools, we aim to better understand diversity challenges in other segments of the scientific enterprise (including other university settings, industry, and government).
Although the dearth of URM faculty members in medical schools typically has been framed as a "pipeline" problem—i.e. a lack of available URM talent—our analysis shows that the rate of PhD production for scientists from URM backgrounds has increased significantly over the past 33 years, and at a faster rate than that of WR scientists. Despite this progress, there was no statistical linkage between the size of the pool of URM talent, and the number of URM assistant professors hired in basic science departments of medical schools (Figure 2; imputed values assuming 6-year turnover in assistant professor population; findings hold for longer periods of turnover). These findings suggest a decoupling of PhD production and faculty attainment in these environments for scientists from URM backgrounds. In contrast, WR assistant professor hiring numbers were more closely related to the total number of WR PhD graduates. Therefore, broader changes in the biomedical academic labor market—i.e., more trainees than faculty positions, elongated pathways to independence, and declining research funding (Alberts et al., 2014; McDowell et al., 2014; Larson and Ghaffarzadegan, 2014)–are insufficient to explain differences in faculty attainment between postdoctoral scientists from URM and WR backgrounds.
Obtaining an assistant professorship position requires, at a minimum: (i) a position to be available; (ii) a candidate to be interested in and apply for the position; and (iii) the applicant to be favorably evaluated, offered the position and ultimately accept the position. Systematic data on the applications, evaluations, offers and acceptances for assistant professor candidates in any academic discipline are not typically made available (due to privacy and confidentiality laws), thus we were unable to include this information in the model. However, a recent study has shown that inequality and hierarchy characterize assistant professor hiring across disciplines, and that prestige of doctoral institution plays a major role in who is hired (Clauset et al., 2015). While 80% of Black and Hispanic science PhD graduates obtain their degrees from Carnegie classification research universities (high or very high research activity), this number is lower than the proportion of White and Asian PhD graduates from these institutions (90%) (National Science Foundation, 2015b). Thus, it is possible that part of the difference can be attributed to the nature of the assistant professor hiring process itself, which emphasizes training background. A more in-depth analysis of this aspect of faculty hiring the biomedical sciences remains a topic for future work.
Beyond institutional pedigree, previous work has shown that interest in assistant professor careers at research-intensive universities such as medical schools declines as training progresses (Fuhrmann et al., 2011; Sauermann and Roach, 2012), and these declines are larger for PhDs and postdocs from URM backgrounds relative to their WR counterparts (Gibbs et al., 2015; Gibbs et al., 2014). Importantly, differences in interest in these assistant professor positions between URM and WR scientists remained when controlling for first-author publication rate, advisor relationships, PhD training institution, research self-efficacy, and training experiences (Gibbs et al., 2014). This suggests that there are fundamental aspects of the environment, or nature of faculty work in research-intensive universities that cause otherwise equally qualified URMs to differentially choose other career paths.
Indeed, prominent scientists from URM backgrounds have written about the unique experiences, challenges, and biases (implicit and explicit) faced while conducting science in these environments (Colon Ramos and Quiñones-Hinojosa, 2016; Jarvis, 2015). Further, there is an emerging body of literature on the distinct values that motivate many scientists from URM backgrounds to pursue scientific careers (e.g. giving back to or serving as a role model in their community of origin), the importance of congruence between personal values and career opportunities to fulfill them for scientists of all backgrounds, and the perception that faculty environments at research-intensive institutions such as medical schools may not enable sufficient engagement with the distinct values of URM scientists (Gibbs et al., 2013; Estrada et al., 2011; Thoman et al., 2015; Smith et al., 2014; Powers et al., 2016).
The modeling data we presented indicate that given current rates of transition from PhD to assistant professorship among URMs, the percentage of URM assistant professors in basic science departments of U.S. medical schools could remain below 10% in the short- and long-term (i.e. by 2080), even in the context of exponential growth of the URM PhD and postdoctoral pool and the absence of discrimination. Thus, faculty diversity efforts that rely primarily on enhancing rates of PhD graduates (i.e. “filling the pipeline”) can only have their desired impact if they are coupled with efforts to get these candidates on the market and hired. This would require making faculty positions and work environments attractive and supportive to these scientists, ensuring the proper types of support (e.g. funding, mentorship and sponsorship) to allow URM postdocs to effectively progress to independence (Valantine et al., 2016), and ensuring institutional faculty recruitment, evaluation, and retention processes support scientists from all backgrounds (Gasman, 2016). Such efforts would have to take into account factors such as the broader landscape in which scientists from all backgrounds have greater career options (Nature, 2014), and the specific career development of women from URM backgrounds (Gibbs et al., 2014; Gibbs et al., 2013; National Research Council, 2013) who make up the majority of URM biomedical PhD graduates (National Science Foundation, 2015b).
While the challenge of achieving faculty diversity has been longstanding, with concerted and targeted effort, the numeric realities of assistant professor hiring and turnover mean that higher diversity could be achieved relatively quickly among junior faculty. On average, the pool of assistant professors turns over every six years. The analysis presented here demonstrated that in recent years, assistant professor hiring has been relatively stable at around 1000 positions each year (or roughly 7 assistant professors per institution across all basic science departments annually). Thus, to achieve parity with the pool of PhD graduates (estimated to grow to 10% URM in 2016) would require hiring around 100 URM assistant professors annually at medical schools. Put another way, if roughly two-thirds of medical schools hired (and retained) just one faculty member from an URM background annually for the next six years, the system would reach parity with the PhD pool within one tenure cycle. While this would still not reflect the proportion of people from URM backgrounds in the overall population (currently greater than 30%), this would represent a meaningful first step to addressing the longstanding goal of enhancing scientific excellence by increasing faculty diversity.
Materials and methods
Data sources
Request a detailed protocolBiomedical PhD attainment data were obtained from the National Science Foundation’s Survey of Earned Doctorates (SED), an annual census of individuals receiving research doctorates from accredited U.S. institutions (National Science Foundation, 2015a), as compiled by the Federation of American Societies for Experimental Biology (FASEB) (Garrison and Campbell, 2015). FASEB tallies and publishes annually the number of PhDs granted in biomedical disciplines (including those who earned PhDs as a single degree or in combination with an MD) from 1980-2013. To calculate the total number of PhD graduates in the U.S., we added together the number of biomedical PhDs awarded to U.S. Citizens and permanent residents, temporary residents, and individuals with unknown citizenship. To calculate the number of PhD graduates from URM backgrounds, we added together the number of U.S. citizen and permanent resident PhD graduates who identified as one of the following: “Black/African-American (non-Hispanic/Latino),” “Hispanic/Latino,” or “American Indian or Alaska Native” (National Institutes of Health, 2015). PhD graduates from all non-URM backgrounds (White, Asian or Pacific Islander, “Other,” “Unknown” and non-citizens) were called “well represented” (WR). These data are shown in Figure 1—source data 1.
To determine trends in representation of faculty in medical school basic science departments, we obtained faculty data from the AAMC Faculty Roster, 1980-2014 Association of American Medical Colleges. 2015. The AAMC Faculty Roster has collected comprehensive information on the characteristics of full-time faculty members at accredited allopathic U.S. medical schools since 1966. We focused specifically on assistant professors in basic science departments because on average 88% of the faculty members in these departments have earned PhDs (either as a single degree or in combination with and MD). For consistency, assistant professors who identified as “Black,” “Hispanic/Latino,” and “American Indian or Alaska Native” were considered URM. Assistant professors from all other backgrounds were considered WR. These data are also shown in Figure 1—source data 1.
Assistant professor hiring trends
Request a detailed protocolTo calculate the aggregate number of assistant professors hired each year, we made two assumptions: (i) the length of time that an individual occupied the position of assistant professor was six years based on traditional academic promotion cycles (Stanford University, 2016; Yale School of Medicine, 2014), and similarly, (ii) one-sixth of the WR and URM assistant professors left the rank of assistant professor in 1980 (either to become associate professors, or pursue other career options). The numbers of assistant professors hired were then imputed based on real changes in the populations of URM and WR assistant professors each year. For example, if the assistant professor population changed from n1 in year one to n2 in year two, and the number of assistant professors leaving in year one was l1, then the number of assistant professors hired in year two (h2) equaled (n2-n1) + l1. Thus, using real data showing that there were n1=132 assistant professors from URM backgrounds in 1980, and n2=129 in 1981, we assumed that one-sixth of the assistant professors left the rank in year 1980 (l1=22), and thus h2=19. These data are shown in Figure 2—source data 1.
Available evidence indicates that scientists who pursue faculty careers in the biomedical sciences remain in postdoctoral training for five or more years (National Institutes of Health, 2012a). To estimate the pool of potential candidates for assistant professor positions, we assumed that PhD graduates (postdocs) remained in the pool of potential candidates for a total of five years, including the year in which they graduated (similar results were found when the length of time in the pool was four or six years). To calculate the pool of available candidates, we totaled the number of PhD graduates in the preceding five years, and subtracted the total number of assistant professors hired in medical school basic science departments in the preceding four years. For example, the pool of available candidates in the year 2010 equaled the sum of the PhD graduates from 2006–2010 less the candidates hired from 2006–2009. The percentage of the pool hired was derived by dividing the number of assistant professors hired each year by the size of the available pool. These data are shown in Figure 2—source data 2. These calculations were used to understand the current landscape and the connection between the available talent pool and faculty hiring, but were not used in the system dynamics model described below.
To determine the relationships between various constructs, we performed statistical analysis in R (version 3.2.2) (R Core Team, 2015). Specifically, we used a linear regression model to compare the growth of PhD graduates relative to the growth of assistant professors between URM and WR populations, where population relative to 1980 levels was the dependent variable, and independent variables included time (i.e. year), URM status (0= well-represented, 1=underrepresented minority), position (0=assistant professor, 1=PhD graduate), and the interaction between URM status and position. We also calculated Pearson’s correlation coefficient between the size of the candidate pools and the number of assistant professors hired in each group. Finally, we examined how the proportion of the pool hired varied across time using a linear model with proportion assistant professors hired as the dependent variable and year as the independent variable, for scientists from URM and WR backgrounds. All figures were made in GraphPad Prism (version 6) and Adobe Illustrator (version 16.0.4).
System dynamics model of assistant professor hiring
Request a detailed protocolWe used System Dynamics (SD) to create an abstract model (Gilbert, 2007) that could adequately explain macro-scale trends in the transition from the biomedical PhD pool into assistant professor positions in basic science departments at medical schools, and be used to predict the impacts of potential intervention strategies for increasing faculty diversity. We focused on entry into assistant professor positions since these positions turn over more rapidly than the overall faculty pool, and generally pull from recent PhD graduates and postdocs. All other areas of the workforce (i.e. faculty positions in other university contexts, research positions in industry or government, non-research positions occupied by PhDs) as well as longitudinal tracking of individual career transitions are beyond the scope of the model.
SD is a modeling framework that emphasizes the role of a system’s structure on its ultimate behavior (Homer and Hirsch, 2006; Meadows, 2008), and has been used along with other approaches to model other aspects of the biomedical workforce and faculty hiring (Ghaffarzadegan et al., 2014; Larson and Diaz, 2012; Ghaffarzadegan et al., 2015). SD models implement these “loop-driven” dynamics through three basic types of elements: (1) stocks, which represent the accumulation of a quantity (e.g. assistant professors) and are represented by boxes; (2) flows, which represent the rate of change in a quantity (e.g. hiring rate for assistant professors), and are represented by hourglasses; and (3) variables, representing factors that can interact with stocks and flows in complex ways (e.g. number of assistant professors slots available), represented by words that have thin, blue causal arrows. In SD diagrams, clouds represent factors that are outside the system boundary, i.e., that extend beyond the range of the model. All modeling was done using Vensim PLE.
Our model extends beyond the standard “pipeline” conceptualization of faculty hiring (Figure 3A). There are three stocks accounting for progress from PhD graduation through assistant professor hiring: number of PhD graduates, number of candidates on the market (i.e., those PhD graduates who become postdoctoral scientists and pursue faculty careers), and number of assistant professors. Candidates on the market are hired into the stock of assistant professors at a rate equal to the total number of slots available. New assistant professors remain in the position for six years, at which point they leave the system boundary either through promotion or contract termination (“assistant professor tenure or leave”). Thus, the overarching structure of this model is that the number of assistant professors hired is based on the number of slots available, and the number of candidates pursuing these positions.
We expanded upon this standard model in a number of ways (See Figure 3B for intermediate conceptual model, and Figure 3C for final model structure). All equations and initial parameter values are shown in Appendix—tables 1 and 2, and the final model is in the source code. Based on the analysis presented in Figure 2, and the distinct underlying patterns with respect to assistant professor position attainment after PhD completion, we separated the pathways for the career progression of URM and WR scientists. Further, for both URM and WR scientists, we assumed there was a fixed proportion of people who would pursue and enter assistant professor positions in medical school basic science departments (called “faculty aspire”), and all other PhDs would pursue careers in other sectors (called, “other aspire”; this can include research careers outside of academia, faculty careers in teaching-intensive environments, or careers away from bench research) (Fuhrmann et al., 2011; Gibbs et al., 2015; Gibbs et al., 2013).
The number of “faculty aspire” candidates is based upon the number of URM and WR assistant professors hired in the period of 1980-1997 (prior to the NIH budget doubling which lead a significant expansion in the number of biomedical PhDs). Without intervention, as the total number of PhD graduates grows, the pools of “URM faculty aspire,” “URM other aspire,” “WR faculty aspire,” and “WR other aspire” are expected grow proportionally. The overall PhD graduate growth rate is represented as a variable termed “baseline PhD graduate growth rate.” This is a piecewise linear function that mirrors the actual growth in the overall number of PhD graduates from 1980- 2013.
The model assumes all PhD graduates in the “faculty aspire” stock pursue assistant professorships in research-intensive environments. The remaining graduates pursue other careers and depart the system. Each year, the system attempts to fill all “slots available.” Further, depending on market hiring conditions, 20% of the candidates on the market drop out of the market annually. That is, if the probability of being hired is relatively high (>20%) all candidates remain on the market that year. Otherwise, one-fifth of the available pool drops out of the system. Thus, the “half-life” of a candidate on the market who is not hired is 5 years (similar to the current period of postdoctoral training for candidates pursuing faculty positions in research intensive environments [National Institutes of Health, 2012a]).
Candidates are chosen from the stocks of WR and URM candidates in proportion to their respective representations on the market. For example, if there are 100 slots available, and 25% of the candidates on the market are from URM backgrounds and 75% are from WR backgrounds, then 25 slots will be filled by URMs and 75 slots will be filled by WRs. Although the career development pathways for WR and URM students are separate, the total number of assistant professor slots available links them. If there are not enough candidates to fill all slots, these slots are removed from the system. Specifically, we posit that candidates in a specific group (URM or WR) are hired with likelihood proportional to their representation on the market. That is, the model posits no hiring bias.
Beyond the baseline student growth rate, “URM target growth rate” (Figure 3C) is a variable that represents the concerted effort of the scientific community (e.g. funders, institutions, scientific societies) to increase the representation of scientists from URM backgrounds in the PhD pool over and above what would occur with natural system growth. This growth rate increases exponentially throughout the duration of the model, matching the empirical trend of URM biomedical PhD population growth from 1980-2013. The “URM target growth rate” is conceptualized as the result of external intervention; thus, these additional URM scientists are initially added to the “URM other aspire” stock. For model simulations, the overall number of scientists in the “URM other aspire” stock is the greater of either the baseline growth rate, or the URM target growth rate. A proportion of URM PhD graduates who begin in the “other aspire” stock may then choose to pursue a faculty career. The “transition rate” is a free parameter that represents the proportion of URM "other aspire" graduates that choose to pursue faculty careers Because there has not been similar intervention to increase the number of scientists from WR backgrounds entering the PhD pool and faculty market, they do not have a transition rate. Thus, the total number of URM candidates on the market is equal to the number who would have entered the market in proportion to the overall growth of the system (i.e. "URM Faculty Aspire"), and the number who entered as a result of external intervention and then chose to pursue faculty careers (i.e. “URM Other Aspire” scientists who transition) minus those who have dropped out of the market ("URM Market Dropout").
To determine the initial number of faculty aspire candidates for both URM and WR scientists (“Faculty Aspire P0”) we used the average number of assistant professors hired from 1980-1997, corresponding to the period before the NIH budget doubling, which drove significant growth of the biomedical enterprise (Johnson, 2013). The value of “URM Faculty Aspire P0” is 34.4, and “WR Faculty Aspire P0” is 567.7. The growth rates for each population (UR or WR) were then scaled to match empirical trends, resulting in numbers of PhD graduates. The patterns of growth differed between scientists from WR and URM backgrounds (piecewise linear and exponential respectively). Thus, for scientists from WR backgrounds, we used the difference between the 1980 population of PhD graduates and “WR Faculty Aspire” candidates to calculate the “WR other aspire P0.” For URM scientists, we fit an exponential function to URM student growth data and used the associated coefficient to derive the “URM other aspire P0”.
Finally, the number of assistant professor “slots available” is a piecewise function fit to data imputed from historical counts of assistant professors. Specifically, we made the simplifying assumption that there were a fixed number of slots available per year (i.e., flat hiring), with a step increase in 1998, when the NIH budget-doubling lead to an era of expansion in the biomedical sciences. Thus, the numbers of slots available from 1980-1997 (n=602.1 slots), and 1998-2013 (n=1064.7 slots) represent the average number of total assistant professors hired during these periods. The final model structure is shown in Figure 3C (the source code has model file).
Limitations
Request a detailed protocolThere are a number of limitations to the analyses presented. Postdoctoral training has become an almost uniform prerequisite to obtaining a faculty position in biomedical research. There are no reliable estimates on the number of postdocs in the US (currently or historically), thus these data were not included in the model (National Academy of Sciences NAoE, and Institute of Medicine, 2014). However, available data suggest comparable postdoctoral transition rates across race/ethnicity for PhD graduates (National Science Foundation, 2015b). Further, we recognize that scientists from URM and WR groups are not all uniform (i.e. there are differences across race/ethnicity groups, and between them by dimensions including but not limited to socioeconomic background). However, the small numbers of scientists from any individual URM group on the faculty did not allow for further disaggregation and separate modeling of URM populations. Additionally, some scientists (from all racial-ethnic backgrounds) complete their training outside of the U.S., and then obtain faculty positions within the U.S. For example, a Black or Hispanic scientist who completed their training outside of the U.S., and then obtained a faculty position within the U.S. would be counted as a URM faculty member, even though they were not part of the URM PhD pool (which only includes U.S. Citizens and Permanent Residents who completed their training within the U.S.). There are no systematic data available on the numbers of scientists from either WR or URM racial-ethnic backgrounds who fit this category (National Institutes of Health, 2012a), thus these data were not included in the model. From the perspective of examining the transition from PhD to assistant professor in medical school basic science departments, a central focus of this work, the entry of scientists that identify as being part of an URM group into faculty positions but who were not trained in the U.S. would lead to an overestimation of the proportion of URM PhD graduates hired as assistant professors. Finally, between the period of 1980-2013, many universities adopted policies that allow for flexibility in the traditional six-year tenure clock (American Association of University Professors, 2004). Thus, our assumption of a fixed, six-year tenure clock may also lead to an overestimation of the number of assistant professors hired each year, but it is consistent with the standard timeframe used by number of leading institutions (Stanford University, 2016; Yale School of Medicine, 2014).
Appendix 1
Model equations and parameter values
References
-
Systematic inequality and hierarchy in faculty hiring networksScience Advances 1:e1400005.https://doi.org/10.1126/sciadv.1400005
-
Toward a model of social influence that explains minority student integration into the scientific communityJournal of Educational Psychology 103:206–222.https://doi.org/10.1037/a0020743
-
Underrepresentation by race-ethnicity across stages of U.S. science and engineering educationCBE Life Sciences Education 12:357–363.https://doi.org/10.1187/cbe.12-12-0207
-
WebsiteAn Ivy League professor on why colleges don’t hire more faculty of color: ‘We don’t want them’The Washington Post. Accessed 2016.
-
Research workforce diversity: The case of balancing national versus international postdocs in US biomedical researchSystems Research and Behavioral Science 31:301–315.https://doi.org/10.1002/sres.2190
-
A note on PhD population growth in biomedical sciencesSystems Research and Behavioral Science 23:402–405.https://doi.org/10.1002/sres.2324
-
Career development among American biomedical postdocsCBE Life Sciences Education 14:ar44.https://doi.org/10.1187/cbe.15-03-0075
-
Race, ethnicity, and NIH research awardsScience 333:1015–1019.https://doi.org/10.1126/science.1196783
-
Measuring diversity of the National Institutes of Health-Funded workforceAcademic Medicine 91:1164–1172.https://doi.org/10.1097/ACM.0000000000001209
-
System dynamics modeling for public health: background and opportunitiesAmerican Journal of Public Health 96:452–458.https://doi.org/10.2105/AJPH.2005.062059
-
Surviving as an underrepresented minority scientist in a majority environmentMolecular Biology of the Cell 26:3692–3696.https://doi.org/10.1091/mbc.E15-06-0451
-
BookBrief History of NIH Funding: Fact Sheet WashingtonDC: Congressional Research Service.
-
Too many PhD graduates or too few academic job openings: The basic reproductive number R0 in academiaSystems Research and Behavioral Science 31:745–750.https://doi.org/10.1002/sres.2210
-
Diversifying science and engineering faculties: Intersections of race, ethnicity, and genderAmerican Behavioral Scientist 53:1013–1028.https://doi.org/10.1177/0002764209356236
-
Thinking in Systems: A Primer Chelsea Green PublishingThinking in Systems: A Primer Chelsea Green Publishing.
-
Changes in the representation of women and minorities in biomedical careersAcademic Medicine 87:1525–1529.https://doi.org/10.1097/ACM.0b013e31826d7189
-
BookThe Postdoctoral Experience RevisitedWashington, D.C: The National Academies Press.
-
BookExpanding Underrepresented Minority Participation, xvWashington, DC: National Academies Press.
-
BookSeeking Solutions: Maximizing American Talent by Advancing Women of Color in Academia: Summary of a ConferenceWashington, D.C: The National Academies Press.
-
BookScience and Engineering IndicatorsArlington, VA: National Science Foundation (NSB 14-01).
-
Women, Minorities, and Persons with Disabilities in Science and Engineering (NSF 15-311)Women, Minorities, and Persons with Disabilities in Science and Engineering (NSF 15-311), Arlington, VA.
-
A call for transparency in tracking student and postdoc career outcomesMolecular Biology of the Cell 26:1413–1415.https://doi.org/10.1091/mbc.E14-10-1432
-
BookR: A Language and Environment for Statistical Computing. ViennaAustria: R Foundation for Statistical Computing.
-
BookDiversity's Promise for Higher Education: Making It Work (2nd Edn)Baltimore: Johns Hopkins University Press.
-
Giving back or giving up: Native American student experiences in science and engineeringCultural Diversity and Ethnic Minority Psychology 20:413–429.https://doi.org/10.1037/a0036945
-
BookHow Economics Shapes ScienceCambridge, Massachusetts: Harvard University Press.
-
BookDiversifying the Faculty: A Guidebook for Search CommitteesWashington, D.C: Association of American Colleges and Universities.
Decision letter
-
Peter RodgersReviewing Editor; eLife, United Kingdom
In the interests of transparency, eLife includes the editorial decision letter and accompanying author responses. A lightly edited version of the letter sent to the authors after peer review is shown, indicating the most substantive concerns; minor comments are not usually included.
Thank you for submitting your article "Decoupling of the Minority PhD Talent Pool & Assistant Professor Hiring in Medical School Basic Science Departments" to eLife for consideration as a Feature Article. Your article has been reviewed by two peer reviewers and the eLife Features Editor, and this decision letter has been compiled to help you prepare a revised submission.
Summary:
This paper attempts to examine issues related to the hiring and retention of PhD underrepresented minorities (URM) in assistant professor positions at academic medical centers. It uses a system dynamics (SD) model to assess expectations of how many PhD URM individuals we should expect to see entering assistant professor positions. While others (Myers & Husbands-Fealing, 2012; Heggeness et al. 2016) have examined issues of representation along the 'pipeline,' this work expands on those efforts by examining specifically issues related to hiring and the flow and stock of assistant professors in academic medicine centers and, specifically, URM hiring. Additionally, the extention to an SD model is a unique analysis for this population and with this data.
Essential revisions:
1) This might be a discipline issue, but I find it confusing that in the body of the paper and in the figures, the data source is not cited! It is only cited in the back as an appendix of sorts. Data sources should be cited throughout the text and at the bottom of each figure.
2) Equation documentation should improve. In your appendix you should use more conventional approaches for model documentation than simple copy-paste of Vensim formula. Also, report all your parameters in a table with proper references (fine if it appears in the Appendix). For model documentation example, see other SD works such as Ghaffarzadegan, Hawley and Desai, 2014.
3) Definitions of subgroups need to be more precise. Instead of saying "including[…]" or "(i.e. white)," precise definitions should be clearly articulated within the paper of exactly how subgroups are defined.
4) One of the weaknesses of an SD model is that you are not able to account for individual agents' behavior, like in agent-based models. Lots of changes in the external environment (e.g. changes in funding streams, policies, and alternative opportunities) have the potential to influence an individual agent's actions in ways that are not necessarily linear and not accounted for in the model the authors present.
5) While the authors acknowledge the issue of postdocs in the supporting documentation, they do not even mention postdocs in the main paper. The reality is that hardly anyone transitions directly from PhD receipt to an assistant professor position, and the postdoc experience is extremely diverse. What if the differences the authors are seeing here are not a result of stalled entrance into the assistant professor position, but rather stalled entrance into a postdoc that will make the individual attractive for an assistant professor position. This dilemma and absence in their model must, at a minimum, be discussed in the body of the paper. Ideally, the authors would be able to incorporate some assumptions about the postdoc phase into their model.
6) The authors have no data on who is applying for assistant professor positions (as they acknowledge in the third paragraph of the Discussion). Therefore, there is no way to really claim, as they do, that if institutions increased their efforts to hire more URM, this would increase diversity in the assistant professor pool.
7) In the main model there is no drop-out from the pool of people in the market (that is, people stay in the market forever). I see that in your sensitivity analysis you report that you have conducted an analysis of effect of drop-out from the pool of people in the market. Very good, but I would argue that this should be in the main model. You simulate the model until 2080, and by then the whole population has retired and many have died! So, simply replace the results of your sensitivity analysis as the main analysis. I understand that this might not affect the results, but it is a better modeling practice.
8) The simulation period of 55 years in future is simply too long. And the assumption that 73% of PhD graduates will be URM feels unrealistic unless you provide evidence (if 73% of a population are minorities, then they are ORM: over-represented minorities!). I suggest the authors to simulate for the next 1-2 decades; there are many things that can happen until 2080 which your model cannot predict and are out of the boundary of your analysis.
9) One may argue that the reason "URM Faculty Aspire P0" is much smaller than the "WR Faculty Aspire P0" is that you are assuming that hiring in faculty positions is proportional to population of the pools. URM might be weaker in the market or be discriminated. From a modeling standpoint, your model has two degrees of freedom, if you assume there is no "weight" toward hiring WR relative to URM, you end up with much higher "WR Faculty Aspire P0" anyway. I think the best way, but difficult, is to provide some references for this argument (that there is less faculty aspiration among URM). The easier way is to clarify that you are aware of this assumption and discuss its implications in your policy recommendation. You may need to modify your language throughout the paper too.
https://doi.org/10.7554/eLife.21393.017Author response
[…]
Essential revisions:
1) This might be a discipline issue, but I find it confusing that in the body of the paper and in the figures, the data source is not cited! It is only cited in the back as an appendix of sorts. Data sources should be cited throughout the text and at the bottom of each figure.
We have added the following sentence to the main text and to Figure 1: “Data on the populations of PhD graduates and assistant professors in medical school basic science departments were obtained from the National Science Foundation Survey of Earned Doctorates (as compiled by the Federation of American Societies for Experimental Biology, and the AAMC Faculty Roster, respectively (please see Methods section for more information).”
2) Equation documentation should improve. In your appendix you should use more conventional approaches for model documentation than simple copy-paste of Vensim formula. Also, report all your parameters in a table with proper references (fine if it appears in the Appendix). For model documentation example, see other SD works such as Ghaffarzadegan, Hawley and Desai, 2014.
We have updated equation documentation consistent with the notation used by Ghaffarzadegan et al. (2014). This is now in appendix 1.
3) Definitions of subgroups need to be more precise. Instead of saying "including[…]" or "(i.e. white)," precise definitions should be clearly articulated within the paper of exactly how subgroups are defined.
We have endeavored to clarify these terms. The Introduction now reads:
“Scientists from certain underrepresented minority (URM) racial/ethnic backgrounds – specifically, African American/Black, Hispanic/Latin@, American Indian, and Alaska Native – receive 6% of NIH research project grants [Ginther, Kahn and Schaffer, 2016; Ginther et al., 2011; National Institutes of Health, 2012] despite having higher representation in the relevant labor market [Heggeness et al., 2016], and constituting 32% of the US population [National Institutes of Health, 2012].[…] This work focuses on three possible reasons for the low number of scientists from URM backgrounds in the professoriate relative to their peers from well-represented (WR) backgrounds (specifically, White, Asian, and all other non-URM groups) that are amenable to intervention by the scientific community”
The Methods now read:
“To calculate the number of PhD graduates from URM backgrounds, we added together the number of U.S. citizen and permanent resident PhD graduates who identified as one of the following: “Black/African-American (non-Hispanic/Latino),” “Hispanic/Latino,” or “American Indian or Alaska Native” [National Institutes of Health, 2015]. PhD graduates from all non-URM backgrounds (White, Asian or Pacific Islander, “Other,” “Unknown” and non-citizens) were called “well represented” (WR).”
We used definitions of “underrepresented minority” and “well-represented” groups consistent with the NIH definitions (http://grants.nih.gov/grants/guide/notice-files/NOT-OD-15-053.html), and conventions in the biomedical training and diversity literature:
http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0114736
http://www.lifescied.org/content/15/3/ar41.long
http://www.lifescied.org/content/15/3/ar33.full
4) One of the weaknesses of an SD model is that you are not able to account for individual agents' behavior, like in agent-based models. Lots of changes in the external environment (e.g. changes in funding streams, policies, and alternative opportunities) have the potential to influence an individual agent's actions in ways that are not necessarily linear and not accounted for in the model the authors present.
In general, each modeling methodology has its strengths and weaknesses. System Dynamics (SD) models excel at capturing stocks, flows, nonlinear causal loops, and overall aggregate trends. The nature of our data is that they are aggregated and continuous. Thus, for the questions we aimed to address, specifically assessing the impact at an aggregate level of different intervention strategies on flows of PhDs from URM and WR backgrounds into faculty positions, SD modeling techniques are both adequate and preferred. This approach is standard in this domain; see, e.g., Larson and Diaz (examining the impact of retirement age on faculty hiring: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3737001/), and Ghaffarzadegan and colleagues (examining the impact of different strategies on systems level postdoc diversity: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4215734/). In order to further clarify this point, we have added the additional reference by Larson and Diaz throughout the paper to refer readers to other examples of how SD modeling can be used to address the types of questions posed here.
However, we agree with the reviewer that Agent-Based modeling (ABM) is better suited to modeling behavior at the level of the individual. In line with the reviewer’s comments, Bonabeau (2002) notes that ABMs excel when “Individual behavior is nonlinear and can be characterized by thresholds, if-then rules, or nonlinear coupling. Individual behavior exhibits memory, path-dependence, and hysteresis, non-markovian behavior, or temporal correlations, including learning and adaptation. Agent interactions are heterogeneous and can generate network effects.” In the event that we are able to gather data validating the extent to which these heterogeneities lead to systematic sources of error in our results, we hope to use ABM in future work.
5) While the authors acknowledge the issue of postdocs in the supporting documentation, they do not even mention postdocs in the main paper. The reality is that hardly anyone transitions directly from PhD receipt to an assistant professor position, and the postdoc experience is extremely diverse. What if the differences the authors are seeing here are not a result of stalled entrance into the assistant professor position, but rather stalled entrance into a postdoc that will make the individual attractive for an assistant professor position. This dilemma and absence in their model must, at a minimum, be discussed in the body of the paper. Ideally, the authors would be able to incorporate some assumptions about the postdoc phase into their model.
We thank the referee for pointing out our need for greater clarity, and have modified the main text to more clearly discuss the issue of postdocs. Specifically, we have:
Clarified that “candidates on the market” refers primarily to postdocs pursuing faculty positions in medical school basic science departments;
Highlighted the fact using the model that includes market drop out (see essential revision #7), the average half-life for “candidates on the market” who are not hired is five years, and that this consistent with the average length of time for postdoctoral study for candidates pursuing faculty positions in research-intensive environments (NIH Biomedical Research Workforce Report, 2012);
Added a brief discussion of focusing on postdoctoral transitions into the Discussion section.
We too recognize the importance of postdoctoral training in career development of biomedical PhDs (the lead author was previously on the Board of Directors for the National Postdoctoral Association). As has been noted by elsewhere (notably the 2012 NIH Biomedical Workforce Report, and the 2014 National Academies of Sciences report, “The Postdoctoral Experience Revisited”) data quality about postdocs in the United States remains very poor—estimates about their numbers range from 30,000 – 100,000. Thus, we did not feel there was adequate and rigorous data to include postdocs in the model.
With respect to question of stalled entrance into postdoc positions by URMs, available data from the NSF (specifically, table 8-3 of the “Women, Minorities and Persons with Disabilities” Report: https://www.nsf.gov/statistics/2015/nsf15311/tables/pdf/tab8-3-updated-2016-06.pdf; “Location and type of postgraduate activity for U.S. citizen and permanent resident S&E doctorate recipients with definite postgraduate plans, by ethnicity and race: 2014”) indicate that rates of postdoctoral transition are largely consistent across URM and WR status.
Specifically from 2004-2014 Hispanics were 53.4% of URM PhD graduates, African Americans are 43.3% of URM PhD graduates, and American Indian Alaska/Natives are 3.3% of URM PhD graduates. Using the NSF rates of postdoctoral study, we see that 41.5% of URM PhD graduates have definitive plans to progress to postdoctoral study post PhD (41.5% URM postdoc transition rate =0.534*(46.7% Hispanic postdoc rate) + 0.433*(35.7% African American postdoc rate) + 0.033 (33.3% American Indian/Alaska Native postdoc rate)).
Among WR groups, from 2004-2014, Whites were 55.6% of WR PhD graduates, Asians were 9.6% of WR graduates and “Other” ethnicities are 34.8% of WR PhD graduates. Using the NSF rates of postdoctoral study, we see that 42.6% of WR PhD graduates have definitive plans to progress to postdoctoral study (42.6% WR postdoc transition rate = 0.556*(41.7% White postdoc transition rate) + 0.096*(33.9% Asian postdoc transition rate) + 0.348*(44.7% Other” postdoc transition rate). We have added the following sentence to the manuscript when describing the model:
“Candidates on the market are composed primarily of the subset of postdoctoral scientists pursuing faculty careers in medical school basic science departments, and current evidence suggests that the rates of transition to postdoctoral training are comparable between URM and WR PhD graduates [Smith, 2015]”.
6) The authors have no data on who is applying for assistant professor positions (as they acknowledge in the third paragraph of the Discussion). Therefore, there is no way to really claim, as they do, that if institutions increased their efforts to hire more URM, this would increase diversity in the assistant professor pool.
We agree with the reviewer that systematic data regarding the demographics of faculty applicants would be ideal. However, these data are not available, which we acknowledge in the manuscript, “systematic data are not available on the demographics of faculty applicants.” However, it is established in the higher education and faculty development literature that increasing diversity in the applicant pool is a proven strategy to increase diversity in the professoriate (C. Turner, Diversifying the Faculty: A Guidebook for Search Committees, 2002; J. Moody, Faculty Diversity: Problems and Solutions, 2004; D. Smith, Diversity’s Promise for Higher Education: Making it Work, 2015).
These data are not likely to become available for many reasons, including confidentiality and legal restrictions (two examples of university HR policies regarding privacy are presented below):
https://hr.uoregon.edu/records/classified-employee-records-and-data
Furthermore, Gibbs et al. 2014 demonstrated that URMs have lower interest in faculty positions at research-intensive universities (like medical schools) in comparison to their WR colleagues. In addition to the authors’ personal experiences (as one who works professionally in the area of workforce diversity, a very common reason given for the lack of faculty diversity is the lack of applicants), the lack of diversity in a recent applicant pool was emphasized and substantiated by a search committee chair at Harvard: http://www.nature.com/news/insider-s-view-of-faculty-search-kicks-off-discussion-online-1.19165). Therefore, we feel that it is appropriate to highlight the need to increase applications from URM scientists as a means of enhancing diversity. We have endeavored to clarify this logic in the manuscript and have added the additional references by Moody and Smith (Introduction, sixth paragraph).
7) In the main model there is no drop-out from the pool of people in the market (that is, people stay in the market forever). I see that in your sensitivity analysis you report that you have conducted an analysis of effect of drop-out from the pool of people in the market. Very good, but I would argue that this should be in the main model. You simulate the model until 2080, and by then the whole population has retired and many have died! So, simply replace the results of your sensitivity analysis as the main analysis. I understand that this might not affect the results, but it is a better modeling practice.
We have replaced the current model to incorporate market drop out and have updated the figures, figure legends, and text appropriately.
8) The simulation period of 55 years in future is simply too long. And the assumption that 73% of PhD graduates will be URM feels unrealistic unless you provide evidence (if 73% of a population are minorities, then they are ORM: over-represented minorities!). I suggest the authors to simulate for the next 1-2 decades; there are many things that can happen until 2080 which your model cannot predict and are out of the boundary of your analysis.
Per the reviewer’s suggestion, we have included a model run ending in 2030.
We have kept a longer model run in (through 2080) to illuminate for readers how given a “best case scenario” of a limitless URM talent pool and no discrimination, the current structure would not achieve increased faculty diversity unless there is also an increased transition rate. We have acknowledged in the text that there are many things that are likely to change that would impact long-term predictive capability of the model (see Discussion, second paragraph).
9) One may argue that the reason "URM Faculty Aspire P0" is much smaller than the "WR Faculty Aspire P0" is that you are assuming that hiring in faculty positions is proportional to population of the pools. URM might be weaker in the market or be discriminated. From a modeling standpoint, your model has two degrees of freedom, if you assume there is no "weight" toward hiring WR relative to URM, you end up with much higher "WR Faculty Aspire P0" anyway. I think the best way, but difficult, is to provide some references for this argument (that there is less faculty aspiration among URM). The easier way is to clarify that you are aware of this assumption and discuss its implications in your policy recommendation. You may need to modify your language throughout the paper too.
Two previous papers by the lead author provide evidence of lower interest in faculty careers at major research universities among scientists from URM backgrounds:
Gibbs et al., “Biomedical Science PhD Career Interest Patterns by Race/Ethnicity and Gender,” PLOS ONE 2014(PMID: 25493425; reference 24) demonstrated that at PhD completion, the URM men and URM women have lower interest than their WR counterparts in faculty positions at research-intensive universities, even when controlling for career pathway interest at PhD entry, first-author publication rate, faculty support, research self-efficacy, and graduate training experiences.
Gibbs et al., “Career Development of American Biomedical Postdocs,” CBE Life Sciences Education 2015(PMID: 26582238; reference 22), showed that in a cross section of American postdocs, URM women had the lowest interest in faculty positions at research-intensive universities of all groups, even when accounting for career pathway interest at PhD entry, first-author publication rate, faculty support, research self-efficacy, and graduate training experiences.
Therefore, there is evidence that apart from level of preparation, URMs have lower level of interest in faculty positions at research-intensive universities. We have highlighted these references more clearly in the manuscript (Introduction, fifth paragraph; subsection “Intervention Strategies to Increasing Assistant Professor Diversity”).
The P0 values were based on imputed hiring trends for scientists from URM and WR backgrounds from 1980-1997. That is, we assumed what happened historically with URM and WR faculty hiring would carry forward as the system grew. We have clarified this in the text.
We do make the conservative assumption of no discrimination. We do recognize that discrimination can remain a problem in academic hiring. However, we did not include this in the model because we were unaware of high quality, systemic evidence that could be used to quantify its impact. We have noted in the revised manuscript (subsection “Intervention Strategies to Increasing Assistant Professor Diversity”) that discrimination will further attenuate efforts to enhance faculty diversity. The goal of the model was to highlight to readers that even in the absence of discrimination, increasing faculty diversity will remain a challenge unless there is greater attention to enhancing post PhD (i.e. postdoctoral) transitions onto the market and their subsequent hiring. We thank the reviewer for helping us to clarify this point.
https://doi.org/10.7554/eLife.21393.018Article and author information
Author details
Funding
No external funding was received for this work.
Acknowledgements
The authors thank Andrew Miklos and Dorit Zuk for presubmission review and comments, and Malika Fair for helpful conversations.
Publication history
- Received:
- Accepted:
- Accepted Manuscript published:
- Version of Record published:
Copyright
This is an open-access article, free of all copyright, and may be freely reproduced, distributed, transmitted, modified, built upon, or otherwise used by anyone for any lawful purpose. The work is made available under the Creative Commons CC0 public domain dedication.
Metrics
-
- 14,774
- views
-
- 2,001
- downloads
-
- 132
- citations
Views, downloads and citations are aggregated across all versions of this paper published by eLife.
Download links
Downloads (link to download the article as PDF)
Open citations (links to open the citations from this article in various online reference manager services)
Cite this article (links to download the citations from this article in formats compatible with various reference manager tools)
Further reading
-
The research community needs to do more to support scientists from underrepresented groups.
-
Research culture needs to be improved for the benefit of science and scientists.