Career paths in the life sciences have changed dramatically in recent decades, partly because the number of early-career researchers seeking permanent research positions has continued to significantly exceed the number of positions available (Cyranoski et al., 2011; Schillebeeckx et al., 2013). Other changes have included efforts to improve research culture, growing concerns about mental health (Evans et al., 2018; Levecque et al., 2017), increased collaboration (Vermeulen et al., 2013), an increased proportion of project-based funding (Lepori et al., 2007; Jonkers and Zacharewicz, 2016) and greater awareness of careers outside academic research (Hayter and Parker, 2019). Nevertheless, many PhD students and postdocs remain keen to pursue careers in research and, if possible, secure a permanent position as a Principal Investigator (PI) at a university or research institute (Fuhrmann et al., 2011; Gibbs et al., 2015; Lambert et al., 2020; Roach and Sauermann, 2017; Sauermann and Roach, 2012).

Data on career paths in the life sciences have become increasingly available in recent years (Blank et al., 2017; Council for Doctoral Education, 2020), and such data are useful to individuals as they plan their careers, and also to funding agencies and institutions as they plan for the future. In this article we report the results of a time-resolved analysis of the career paths of 2284 researchers who completed a PhD or postdoc at the European Molecular Biology Laboratory (EMBL) between 1997 and 2020. This period included major global events, such as financial crisis of 2007 and 2008 (Izsak et al., 2013; Pellens et al., 2018), and also major events within the life sciences (such as the budget of the US National Institutes of Health doubling between 1998 and 2003 and then plateauing; Wadman, 2012; Zerhouni, 2006).

EMBL is an intergovernmental organisation with six sites in Europe, and its missions include scientific training, basic research in the life sciences, and the development and provision of a range of scientific services. The organization currently employs more than 1110 scientists, including over 200 PhD students, 240 postdoctoral fellows, and 80 PIs. EMBL has a long history of training PhD students and postdocs, and the EMBL International PhD Programme – one of the first structured PhD programmes in Europe – has a completion rate of 92%, with students taking an average of 3.95 years to submit their thesis (data for 2015–2019). More recently, EMBL has launched dedicated fellowship programmes with structured training curricula for postdocs.

Data collection for this study was initially carried out in 2017 and updated in 2021. Using manual Google searches, we located publicly available information identifying the current role of 89% (2035/2284) of the sample (Table 1). These alumni were predominantly based in the European Union (60%, 1224/2035), other European countries including UK and Switzerland (20%), and the US (11%). For 71% of alumni (1626/2284), we were able to reconstruct a detailed career path based on online CVs and biographies (see Methods). EMBL alumni also ended up in a range of careers, which were classified as follows: Academia: Principal Investigator; Academia: Postdoc; Academia: Other research/teaching/service role; Industry Research; Science-related Non-research; and Non-science-related. We also collected data on different types of jobs within the last three of these career areas (Table 2).

On average, the alumni in our sample published an average of 4.5 research articles about their work at EMBL, and were the first author on an average of 1.6 of those articles (Table S1 in Supplementary file 1). Overall, 90% of the sample (2047/2284) authored at least one article about their EMBL work, and 73% (1666/2284) were the first author on at least one article. The average time between being awarded a PhD and taking up a first role in a specific career area ranged from 4.2 years for Non-science-related positions to 6.8 years for a Principal Investigator (PI) position.

Most alumni remain in science

The majority of alumni (1263/2284=55.3%) were found to be working in an academic position in 2021, including 636 who were PIs, 244 who were in Academia: Postdoc positions, and 383 who were working in Academia: Other positions, which included teaching, research and working for a core facility/technology platform (Figure 1A). Just under one-sixth (332/2284=14.5%) were employed in Industry Research positons, and a similar proportion (349/2284=15.3%) were employed in Science-related Non-research positions, such as technology transfer, science administration and education, and corporate roles at life sciences companies. Around 4% were employed in professions not related to science, and the current careers of around 11% of alumni were unknown.

Figure 1 with 3 supplements see all

Download asset Open asset

Figure 1—source data 1

Summary data plotted in Figure 1A, B.

https://cdn.elifesciences.org/articles/78706/elife-78706-fig1-data1-v1.xlsx

Download elife-78706-fig1-data1-v1.xlsx

Of those who became PIs, 75.3% moved from a postdoc to their first PI position, with 20.6% moving from an Academia: Other position (Figure 1—figure supplement 1A). On average, PhD alumni became PIs 6.1 calendar years after their PhD defence, and postdoc alumni became PIs 2.5 years after completing their EMBL postdoc. Almost half of the postdoc alumni who became PIs did so directly after completing their EMBL postdoc (168 of 343). Other postdoc alumni made the transition later, most frequently after one additional postdoc (71 alumni) or a single Academia: Other position (56 alumni). 40 alumni held multiple academic positions between their EMBL postdoc and their first PI position, and eight had one or more non-academic positions during this period.

The career paths of those in other positions were more varied (Figure 1—figure supplement 1B–E). For example, for alumni who moved into Industry Research, 20.2% entered their first industry role directly from their PhD, 56.4% from a postdoc position, and 13.3% from Academia: Other positions. Moreover, 71.6% remained in this type of role long-term.

The wide variation in job titles used outside academia makes it difficult to assess career progression, but almost 60% (453/766) of alumni working outside academia had a current job title that included a term indicative of a management-level role (such as manager, leader, senior, head, principal, director, president or chief). For leavers from the last five years (2016–2020), this number was 45% (78/174), suggesting that a large proportion of the alumni who leave academia enter – or are quickly promoted to – managerial positions.

For further analysis, EMBL alumni were split into three 8 year cohorts. More recent cohorts were larger, reflecting the growth of the organization between 1997 and 2020, and also contained a higher percentage of female researchers (Table 3). When comparing cohorts, we observed some differences in the specific jobs being done by alumni outside academia 2021 (Table S2 in Supplementary file 1). For example, the percentage of alumni involved in ‘data science, analytics, software engineering’ roles increased from 2% (11/625) for the 1997–2004 cohort to 4% (37/896) for the 2013–2020 cohort. However, the absolute number of alumni for most jobs outside academia was small, so our time-resolved analysis therefore focussed on the broader career areas described above.

Table 3

Completion years	PhD cohorts			Postdoc cohorts			All
	1997–2004	2005–2012	2013–2020	1997–2004	2005–2012	2013–2020	All
n =	256	341	372	369	422	524	2284
n (%) known current role	225 (88%)	306 (90%)	332 (89%)	336 (88%)	364 (86%)	472 (90%)	2035 (89%)
n (%) detailed career path	220 (70%)	258 (79%)	413 (77%)	179 (60%)	271 (61%)	285 (79%)	1626 (71%)
n (%) female	85 (33%)	157 (46%)	173 (47%)	136 (37%)	149 (35%)	207 (40%)	907 (40%)

The proportion of EMBL alumni who become PIs has decreased with time

To estimate the probability of alumni from different cohorts entering a specific career each year after completing a PhD or postdoc at EMBL, we fitted the data to a Cox proportional hazards model. This is a statistical regression method that is commonly used to model time-to-event distributions from observational data with censoring (i.e., when not all study subjects are monitored until the event occurs, or the event never occurs for some of the subjects). In brief, we fitted the data to a univariate Cox proportional hazards model to calculate hazard ratios, which represent the relative chance of the event considered (here: entering a specific career) occurring in each cohort with respect to the oldest cohort. We also calculated Kaplan–Meier estimators, which estimate the probability of the event (entering a specific career) at different timepoints.

For both PhD and postdoc alumni entering PI positions, we observe hazard ratios of less than one in the Cox models when comparing the newer cohorts with the oldest cohort (Table S4 in Supplementary file 1), which indicates that the chances of becoming a PI have become lower for the newer cohorts. The Kaplan–Meier plots illustrate lower percentages of PIs among alumni from the most recent cohorts compared to the oldest cohort at equivalent timepoints (Figure 2A). Nevertheless, becoming a PI remained the most common career path for alumni from the 2005–2012 cohort (90/341=26.4% for PhD alumni) and (123/422=29.1% for postdoc alumni), and the most recent cohort of alumni appear to be on a similar trajectory.

Figure 2 with 1 supplement see all

Download asset Open asset

Kaplan–Meier plots show increased proportions of the 2005–2012 and 2013–2020 cohorts entering Science-related Non-research and Non-science-related positions, compared to the 1997–2004 cohort for both PhD and postdoc alumni (Figure 2D, E). For the most recent (2013–2020) cohort, there was also an increased rate of entry into Industry: Research positions compared to alumni from PhD and postdoc cohorts from 1997 to 2004 and 2005–2012 (Figure 2C, Table S4 in Supplementary file 1). For Academia: other positions, the rate of entry was similar for all three PhD cohorts, though some differences between cohorts were observed for postdoc alumni (Figure 2B).

Gender differences in career outcomes

Many studies have reported that female early-career researchers are less likely to remain in academia (Alper, 1993; Martinez et al., 2007). Consistent with these studies, male alumni from EMBL were more likely than female alumni to end up in a PI position (Figure 3A and B; Table S5 in Supplementary file 1). However, for alumni from 1997 to 2012, there was no statistically significant difference in the length of time taken by male and female alumni to become PIs (Figure 3—figure supplement 1). Female alumni were more likely to end up in a Science-related Non-research position, and male alumni were more likely to end up in an Industry Research or Non-science-related position (Figure 3; Figure 3—figure supplement 2). However, female alumni were also more likely to be classified as unknown, and since it is more difficult to follow careers outside the academic world, it is possible that the number of women who established careers outside academia (in positions such as Industry Research, Science-related Non-research, and Non-science-related) is higher than our results suggest.

Figure 3 with 2 supplements see all

Download asset Open asset

Figure 3—source data 1

Summary data plotted in Figure 3A.

https://cdn.elifesciences.org/articles/78706/elife-78706-fig3-data1-v1.xlsx

Download elife-78706-fig3-data1-v1.xlsx

Future PIs, on average, published more papers while at EMBL

Publication metrics have been linked to the likelihood of obtaining (van Dijk et al., 2014; Tregellas et al., 2018) and succeeding (von Bartheld et al., 2015) in a faculty position. In this study, alumni who became PIs had more favourable publication metrics from their EMBL work – for example, they published more articles, and their papers had higher CNCI values. (CNCI is short for Category Normalized Citation Impact, and a CNCI value of one means that the number of citations received was the same as the average for other articles in that field published in the same year; Figure 4A and B; Table S6 in Supplementary file 1). Using univariate Cox models for time to PI as a function of number of first-author research articles from EMBL work, we estimated that a postdoc with one first-author publication was 3.2 times more likely to be found in a PI position than a postdoc without a first-author publication (95% confidence interval [2.2, 4.7]), and a post-doc with two or more first-author publications was 6.6 times more likely (95% confidence interval [4.7, 9.3]; Figure 4C).

Figure 4 with 2 supplements see all

Download asset Open asset

Figure 4—source data 1

Summary data plotted in Figure 4A, B and D.

https://cdn.elifesciences.org/articles/78706/elife-78706-fig4-data1-v1.xlsx

Download elife-78706-fig4-data1-v1.xlsx

Changes in the publications landscape

Reports suggest that the number of authors on a typical research article in biology has increased over time, as has the amount of data in a typical article (Vale, 2015; Fanelli and Larivière, 2016); a corresponding decrease in the number of first-author research articles per early-career researcher has also been reported (Kendal et al., 2022). For articles linked to the PhD students and postdocs in this study, the mean number of authors per article has more than doubled between 1995 and 2020 (Figure 5A). The mean number of articles per researcher did not change between the three cohorts studied (Figure 5B; the mean was 3.6 articles per researcher), but researchers from the second and third cohorts published fewer first-author articles than those from the first cohorts (Figure 5C). However, more recent articles had higher CNCI values (Figure 5D). The proportion of EMBL articles that included international collaborators also increased from 47% in 1995 to 79% in 2020.

Figure 5

Download asset Open asset

Figure 5—source data 1

Summary data plotted in Figure 5.

https://cdn.elifesciences.org/articles/78706/elife-78706-fig5-data1-v1.xlsx

Download elife-78706-fig5-data1-v1.xlsx

Many early-career researchers are employed on fixed-term contracts funded by project-based grants, sometimes for a decade or more (OECD, 2021; Acton et al., 2019), and surveys suggest that early-career researchers are concerned about career progression (Woolston, 2020; Woolston, 2019). We hope PhD students and postdocs will be reassured to learn that the skills and knowledge they acquire during their training are useful in a range of careers both inside and outside acaemica.

Further changes to the career landscape in the life sciences are likely in future, not least as a result of the long-term impacts of the COVID-19 pandemic (Bodin, 2020). It is essential, therefore, that early-career researchers are provided with opportunities to reflect on their strengths, to understand the wide range of career options available to them, and to develop new skills.

The provision of effective support for PhD students and postdocs will require input from different stakeholders – including funders, employers, supervisors and policy makers – and the engagement of the early-career researchers themselves. At EMBL, a career service was launched in 2019 for all PhD students and postdocs, building on a successful EC-funded pilot project that offered career support to 76 postdocs in the EMBL Interdisciplinary Postdoc Programme. The EMBL Fellows’ Career Service now offers career webinars and a blog to the whole scientific community as well as additional tailored support for EMBL PhDs and postdocs including individual career guidance, workshops, resources and events. Funders and policymakers may also need to reassess the sustainably of academic career paths, and to review how funding is allocated between project-based grants and mechanisms that can support PI and non-PI positions with longer-term stability. These measures will will also support equality, diversity and inclusion in science, particularly if paired with research assessment practices that consider factors that can affect apparent research productivity such as career breaks, teaching and service activities.

Factors related to publication are highly predictive of entry into PI careers, and one challenge for an early-career researcher hoping to pursue such a career is to balance the number of articles they publish with the subjective quality of these articles. The trend towards fewer first-author articles per researcher likely reflects a global trend towards articles with more authors and a greater focus on collaborative and/or interdisciplinary approaches to research. Working on a project that involves multiple partners provides an early-career researcher with the opportunity to develop a range of skills, including teamwork, leadership and creativity. Such projects also allow researchers to tackle challenging biological questions from new angles to advance in their field of research, something viewed very positively by academic hiring committees (Hsu et al., 2021; Clement et al., 2020; Fernandes et al., 2020); however, multi-partner interdisciplinary projects can also take longer to complete. It is therefore important that early-career researchers and their supervisors discuss the potential impact and challenges of (prospective) projects, and what can be done to reduce any risks. For example, open science practices – including author credit statements, FAIR data, and pre-printing – can make project contributions more transparent and available faster (Kaiser, 2017; McNutt et al., 2018; Wilkinson et al., 2016; Wolf et al., 2021).

We plan to update our observational data every four years, and to maintain data on the career paths of alumni for 24 years after they leave EMBL. This will help us to identify any further changes in the career landscape and to better understand long-term career outcomes in the life sciences. Silva et al., 2019 have also described a method for tracking career outcomes on a yearly basis with estimations of the time and other resources required. We encourage institutions to consider whether they can adapt our methods, or Silva’s method, to the administrative processes and data-privacy regulations applicable at their institutions.

Future studies should also ideally include mixed-method longitudinal studies, which would allow information on career motivations, skills development, research environment, job application activity and other factors to be recorded. Combining the results of such studies with data on career outcomes would allow multifactorial and complex issues, such as gender differences in career outcomes, to be investigated, and would also provide policymakers with a fuller picture of workforce trends. Such studies would, however, require multiple institutions to commit to supplying large amounts of data every year, and coordinating the collection and analysis of such data year-on-year would be a major undertaking that would require the support of funders and institutions.

A Cox proportional hazards regression model was fitted to the data in order to predict time-to-event probabilities for each type of career outcome based on different covariates including cohort, publication variables and gender. Multivariate Cox models were fitted using a ridge penalty with penalty parameter chosen by 10-fold cross-validation. Harrell’s C-index was calculated for each fit in an outer cross-validation scheme for validation and analysis of different models, with 10-fold cross-validation.

The data were collated for the provision of statistics, and are stored in a manner compliant with EMBL's internal policy on data protection. This policy means that the full dataset cannot be made publicly available (because the nature of the data means that sufficient anonymisation is not possible). Summary statistics for the main data table can be found in Supplementary file 1 (Table S1). Rmarkdown documentation of the analysis and figures can be found here and is available on GitHub (copy archived at Coulthard and Lu, 2022).

1. 1. Acton SE
   2. Bell AJ
   3. Toseland CP
   4. Twelvetrees A

   (2019) A survey of new PIs in the UK

   eLife 8:e46827.

   https://doi.org/10.7554/eLife.46827

   • PubMed
   • Google Scholar
2. 1. Alper J

   (1993) The pipeline is leaking women all the way along

   Science 260:409–411.

   https://doi.org/10.1126/science.260.5106.409

   • Google Scholar
3. 1. Blank R
   2. Daniels RJ
   3. Gilliland G
   4. Gutmann A
   5. Hawgood S
   6. Hrabowski FA
   7. Pollack ME
   8. Price V
   9. Reif LR
   10. Schlissel MS

   (2017) A new data effort to inform career choices in biomedicine

   Science 358:1388–1389.

   https://doi.org/10.1126/science.aar4638

   • PubMed
   • Google Scholar
4. 1. Bodin M

   (2020) University redundancies, furloughs and pay cuts might loom amid the pandemic, survey finds

   Nature.

   https://doi.org/10.1038/d41586-020-02265-w

   • PubMed
   • Google Scholar
5. 1. Clement L
   2. Dorman JB
   3. McGee R

   (2020) The Academic Career Readiness Assessment: Clarifying hiring and training expectations for future biomedical life sciences faculty

   CBE Life Sciences Education 19:ar22.

   https://doi.org/10.1187/cbe.19-11-0235

   • PubMed
   • Google Scholar
6. Software

   1. Coulthard R
   2. Lu J

   (2022) EMBL-Career-Analysis, version swh:1:rev:f82a94f925fb44aa59383e0afc167b4f4f0c67bd

   Software Heritage.

   https://archive.softwareheritage.org/swh:1:dir:8e764aae6f23b2d2a6a4ecb3322ada777e604388;origin=https://github.com/Huber-group-EMBL/EMBL-Career-Analysis;visit=swh:1:snp:66c550eefce2ed4462b612ac31ee4d219cc97f6c;anchor=swh:1:rev:f82a94f925fb44aa59383e0afc167b4f4f0c67bd
7. Website

   1. Council for Doctoral Education

   (2020) Tracking the Careers of Doctorate Holders

   Accessed September 23, 2023.

   https://eua-cde.org/component/attachments/attachments.html?id=2988
8. 1. Cyranoski D
   2. Gilbert N
   3. Ledford H
   4. Nayar A
   5. Yahia M

   (2011) The PhD factory

   Nature 472:276–279.

   https://doi.org/10.1038/472276a

   • PubMed
   • Google Scholar
9. 1. Evans TM
   2. Bira L
   3. Gastelum JB
   4. Weiss LT
   5. Vanderford NL

   (2018) Evidence for a mental health crisis in graduate education

   Nature Biotechnology 36:282–284.

   https://doi.org/10.1038/nbt.4089

   • PubMed
   • Google Scholar
10. 1. Fanelli D
    2. Larivière V

    (2016) Researchers’ individual publication rate has not increased in a century

    PLOS ONE 11:e0149504.

    https://doi.org/10.1371/journal.pone.0149504

    • PubMed
    • Google Scholar
11. 1. Fernandes JD
    2. Sarabipour S
    3. Smith CT
    4. Niemi NM
    5. Jadavji NM
    6. Kozik AJ
    7. Holehouse AS
    8. Pejaver V
    9. Symmons O
    10. Bisson Filho AW
    11. Haage A

    (2020) A survey-based analysis of the academic job market

    eLife 9:e54097.

    https://doi.org/10.7554/eLife.54097

    • PubMed
    • Google Scholar
12. 1. Fuhrmann CN
    2. Halme DG
    3. O’Sullivan PS
    4. Lindstaedt B

    (2011) Improving graduate education to support a branching career pipeline: Recommendations based on a survey of doctoral students in the basic biomedical sciences

    CBE Life Sciences Education 10:239–249.

    https://doi.org/10.1187/cbe.11-02-0013

    • PubMed
    • Google Scholar
13. 1. Gibbs KD
    2. McGready J
    3. Griffin K

    (2015) Career development among American biomedical postdocs

    Cell Biology Education 14:ar44.

    https://doi.org/10.1187/cbe.15-03-0075

    • Google Scholar
14. 1. Hayter CS
    2. Parker MA

    (2019) Factors that influence the transition of university postdocs to non-academic scientific careers: An exploratory study

    Research Policy 48:556–570.

    https://doi.org/10.1016/j.respol.2018.09.009

    • Google Scholar
15. 1. Hsu NS
    2. Rezai-Zadeh KP
    3. Tennekoon MS
    4. Korn SJ

    (2021) Myths and facts about getting an academic faculty position in neuroscience

    Science Advances 7:eabj2604.

    https://doi.org/10.1126/sciadv.abj2604

    • PubMed
    • Google Scholar
16. Website

    1. Izsak K
    2. Markianidou P
    3. Lukach R
    4. Wastyn A

    (2013) Impact of the Crisis on Research and Innovation Policies. Study for the European Commission DG Research by Technopolis Group Belgium and Idea Consult

    Accessed September 23, 2023.

    https://www.technopolis-group.com/wp-content/uploads/2020/02/The-impact-of-the-financial-crisis-on-research-and-innovation-policies-in-EU-Member-States.pdf
17. Book

    1. Jonkers K
    2. Zacharewicz T

    (2016) Research Performance Based Funding Systems: A Comparative Assessment

    JRC Publications Repository.

    https://doi.org/10.2760/70120

    • Google Scholar
18. 1. Kaiser J

    (2017) Are preprints the future of biology? A survival guide for scientists

    Science 1:aaq0747.

    https://doi.org/10.1126/science.aaq0747

    • Google Scholar
19. 1. Kendal D
    2. Lee KE
    3. Soanes K
    4. Threlfall CG

    (2022) The great publication race’ vs ‘abandon paper counting’: Benchmarking ECR publication and co-authorship rates over past 50 years to inform research evaluation

    F1000Research 11:95.

    https://doi.org/10.12688/f1000research.75604.1

    • Google Scholar
20. 1. Lambert WM
    2. Wells MT
    3. Cipriano MF
    4. Sneva JN
    5. Morris JA
    6. Golightly LM

    (2020) Career choices of underrepresented and female postdocs in the biomedical sciences

    eLife 9:e48774.

    https://doi.org/10.7554/eLife.48774

    • PubMed
    • Google Scholar
21. 1. Lepori B
    2. van den Besselaar P
    3. Dinges M
    4. Potì B
    5. Reale E
    6. Slipersæter S
    7. Thèves J
    8. van der Meulen B

    (2007) Comparing the evolution of national research policies: What patterns of change?

    Science and Public Policy 34:372–388.

    https://doi.org/10.3152/030234207X234578

    • Google Scholar
22. 1. Levecque K
    2. Anseel F
    3. De Beuckelaer A
    4. Van der Heyden J
    5. Gisle L

    (2017) Work organization and mental health problems in PhD students

    Research Policy 46:868–879.

    https://doi.org/10.1016/j.respol.2017.02.008

    • Google Scholar
23. 1. Martinez ED
    2. Botos J
    3. Dohoney KM
    4. Geiman TM
    5. Kolla SS
    6. Olivera A
    7. Qiu Y
    8. Rayasam GV
    9. Stavreva DA
    10. Cohen-Fix O

    (2007) Falling off the academic bandwagon. Women are more likely to quit at the postdoc to principal investigator transition

    EMBO Reports 8:977–981.

    https://doi.org/10.1038/sj.embor.7401110

    • PubMed
    • Google Scholar
24. 1. McKiernan EC
    2. Schimanski LA
    3. Muñoz Nieves C
    4. Matthias L
    5. Niles MT
    6. Alperin JP

    (2019) Use of the Journal Impact Factor in academic review, promotion, and tenure evaluations

    eLife 8:e47338.

    https://doi.org/10.7554/eLife.47338

    • PubMed
    • Google Scholar
25. 1. McNutt MK
    2. Bradford M
    3. Drazen JM
    4. Hanson B
    5. Howard B
    6. Jamieson KH
    7. Kiermer V
    8. Marcus E
    9. Pope BK
    10. Schekman R
    11. Swaminathan S
    12. Stang PJ
    13. Verma IM

    (2018) Transparency in authors’ contributions and responsibilities to promote integrity in scientific publication

    PNAS 115:2557–2560.

    https://doi.org/10.1073/pnas.1715374115

    • PubMed
    • Google Scholar
26. Book

    1. OECD

    (2021) Reducing the Precarity of Academic Research Careers

    OECD iLibrary.

    https://doi.org/10.1787/0f8bd468-en

    • Google Scholar
27. 1. Pellens M
    2. Peters B
    3. Hud M
    4. Rammer C
    5. Licht G

    (2018) Public investment in R&D in reaction to economic crises - A longitudinal study for OECD countries

    SSRN Electronic Journal 1:3122254.

    https://doi.org/10.2139/ssrn.3122254

    • Google Scholar
28. 1. Reithmeier R
    2. O’Leary L
    3. Zhu X
    4. Dales C
    5. Abdulkarim A
    6. Aquil A
    7. Brouillard L
    8. Chang S
    9. Miller S
    10. Shi W
    11. Vu N
    12. Zou C

    (2019) The 10,000 PhDs project at the University of Toronto: Using employment outcome data to inform graduate education

    PLOS ONE 14:e0209898.

    https://doi.org/10.1371/journal.pone.0209898

    • PubMed
    • Google Scholar
29. 1. Roach M
    2. Sauermann H

    (2017) The declining interest in an academic career

    PLOS ONE 12:e0184130.

    https://doi.org/10.1371/journal.pone.0184130

    • PubMed
    • Google Scholar
30. 1. Sauermann H
    2. Roach M

    (2012) Science PhD career preferences: Levels, changes, and advisor encouragement

    PLOS ONE 7:e36307.

    https://doi.org/10.1371/journal.pone.0036307

    • PubMed
    • Google Scholar
31. 1. Schillebeeckx M
    2. Maricque B
    3. Lewis C

    (2013) The missing piece to changing the university culture

    Nature Biotechnology 31:938–941.

    https://doi.org/10.1038/nbt.2706

    • PubMed
    • Google Scholar
32. 1. Silva EA
    2. Mejía AB
    3. Watkins ES

    (2019) Where do our graduates go? A tool kit for tracking career outcomes of biomedical PhD students and postdoctoral scholars

    CBE Life Sciences Education 18:le3.

    https://doi.org/10.1187/cbe.19-08-0150

    • PubMed
    • Google Scholar
33. Website

    1. Stanford Biosciences

    (2021) Alumni Career Outcomes by Cohort

    Accessed September 10, 2021.

    https://biosciences.stanford.edu/prospective-students/alumni-career-outcomes-dashboard/alumni-career-outcomes-by-cohort/
34. Website

    1. Stanford IT&DS

    (2020) The Stanford PhD Alumni Employment Project

    Accessed January 17, 2020.

    https://tableau.stanford.edu/t/IRDS/views/StanfordPhDAlumniEmployment/StanfordPhDAlumniEmploymentDashboard?%3Aembed_code_version=3&%3Aembed=y&%3AloadOrderID=0&%3Adisplay_spinner=no&%3Adisplay_count=n&%3AshowVizHome=n&%3Aorigin=viz_share_link
35. 1. Stayart CA
    2. Brandt PD
    3. Brown AM
    4. Dahl T
    5. Layton RL
    6. Petrie KA
    7. Flores-Kim EN
    8. Peña CG
    9. Fuhrmann CN
    10. Monsalve GC

    (2020) Applying inter-rater reliability to improve consistency in classifying PhD career outcomes

    F1000Research 9:8.

    https://doi.org/10.12688/f1000research.21046.2

    • PubMed
    • Google Scholar
36. 1. Tregellas JR
    2. Smucny J
    3. Rojas DC
    4. Legget KT

    (2018) Predicting academic career outcomes by predoctoral publication record

    PeerJ 6:e5707.

    https://doi.org/10.7717/peerj.5707

    • PubMed
    • Google Scholar
37. Website

    1. UCSF Graduate Division

    (2021) PhD Program Statistics

    Accessed September 9, 2021.

    https://graduate.ucsf.edu/program-statistics
38. Website

    1. University of Chicago

    (2021) Career Outcomes of PhD Alumni

    Accessed August 20, 2021.

    https://biosciences.uchicago.edu/after-uchicago/outcomes
39. Website

    1. University of Michigan

    (2018) Rackham Doctoral Program Statistics

    Accessed November 9, 2018.

    https://tableau.dsc.umich.edu/#/site/UM-Public/views/RackhamDoctoralProgramStatistics/ProgramStatistics
40. Website

    1. University Toronto

    (2021) Employed and Engaged: Career Outcomes of Our PhD Graduates

    Accessed September 10, 2021.

    https://www.sgs.utoronto.ca/about/explore-our-data/10000-phds-project/
41. 1. Vale RD

    (2015) Accelerating scientific publication in biology

    PNAS 112:13439–13446.

    https://doi.org/10.1073/pnas.1511912112

    • PubMed
    • Google Scholar
42. 1. van Dijk D
    2. Manor O
    3. Carey LB

    (2014) Publication metrics and success on the academic job market

    Current Biology 24:R516–R517.

    https://doi.org/10.1016/j.cub.2014.04.039

    • PubMed
    • Google Scholar
43. 1. Vermeulen N
    2. Parker JN
    3. Penders B

    (2013) Understanding life together: a brief history of collaboration in biology

    Endeavour 37:162–171.

    https://doi.org/10.1016/j.endeavour.2013.03.001

    • PubMed
    • Google Scholar
44. 1. von Bartheld CS
    2. Houmanfar R
    3. Candido A

    (2015) Prediction of junior faculty success in biomedical research: Comparison of metrics and effects of mentoring programs

    PeerJ 3:e1262.

    https://doi.org/10.7717/peerj.1262

    • Google Scholar
45. 1. Wadman M

    (2012) A workforce out of balance

    Nature 486:304.

    https://doi.org/10.1038/486304a

    • PubMed
    • Google Scholar
46. 1. Wilkinson MD
    2. Dumontier M
    3. Aalbersberg IJJ
    4. Appleton G
    5. Axton M
    6. Baak A
    7. Blomberg N
    8. Boiten JW
    9. da Silva Santos LB
    10. Bourne PE
    11. Bouwman J
    12. Brookes AJ
    13. Clark T
    14. Crosas M
    15. Dillo I
    16. Dumon O
    17. Edmunds S
    18. Evelo CT
    19. Finkers R
    20. Gonzalez-Beltran A
    21. Gray AJG
    22. Groth P
    23. Goble C
    24. Grethe JS
    25. Heringa J
    26. ’t Hoen PAC
    27. Hooft R
    28. Kuhn T
    29. Kok R
    30. Kok J
    31. Lusher SJ
    32. Martone ME
    33. Mons A
    34. Packer AL
    35. Persson B
    36. Rocca-Serra P
    37. Roos M
    38. van Schaik R
    39. Sansone SA
    40. Schultes E
    41. Sengstag T
    42. Slater T
    43. Strawn G
    44. Swertz MA
    45. Thompson M
    46. van der Lei J
    47. van Mulligen E
    48. Velterop J
    49. Waagmeester A
    50. Wittenburg P
    51. Wolstencroft K
    52. Zhao J
    53. Mons B

    (2016) The FAIR Guiding Principles for scientific data management and stewardship

    Scientific Data 3:160018.

    https://doi.org/10.1038/sdata.2016.18

    • PubMed
    • Google Scholar
47. 1. Wolf JF
    2. MacKay L
    3. Haworth SE
    4. Cossette M-L
    5. Dedato MN
    6. Young KB
    7. Elliott CI
    8. Oomen RA

    (2021) Preprinting is positively associated with early career researcher status in ecology and evolution

    Ecology and Evolution 11:13624–13632.

    https://doi.org/10.1002/ece3.8106

    • PubMed
    • Google Scholar
48. 1. Woolston C

    (2019) PhDs: the tortuous truth

    Nature 575:403–406.

    https://doi.org/10.1038/d41586-019-03459-7

    • Google Scholar
49. 1. Woolston C

    (2020) Uncertain prospects for postdoctoral researchers

    Nature 588:181–184.

    https://doi.org/10.1038/d41586-020-03381-3

    • Google Scholar
50. 1. Zerhouni EA

    (2006) NIH in the post-doubling era: Realities and strategies

    Science 314:1088–1090.

    https://doi.org/10.1126/science.1136931

    • PubMed
    • Google Scholar

Decision letter after peer review:

Thank you for submitting your article "Meta-research: The changing career paths of PhDs and postdocs trained at EMBL" to eLife for consideration as a Feature Article. Your article has been reviewed by three peer reviewers, and the evaluation has been overseen by the eLife Features Editor (Peter Rodgers). The three reviewers have agreed to reveal their identity: Barbara Janssens; Sarvenaz Sarabipour; Reinhart Reithmeier.

The reviewers and editors have discussed the reviews and we have drafted this decision letter to help you prepare a revised submission. Please also note that eLife does not permit figures in supplementary materials: instead we allow primary figures to have figure supplements. I can suggest how to accommodate the figures in your supplementary materials if your article is accepted.

The eLife Features Editor will also contact you separately about some editorial issues that you will need to address.

Summary:

This paper deals with career outcomes for some 2284 PhD graduates and post-doctoral fellows from the European Molecular Biology Laboratories, a prestigious research institute that attracts top talent from around the world – the first of its kind. The paper is rich in data beyond simple career outcomes over time and includes gender, publications and collaboration. The methodology involved internet searches like other studies and was enhanced by robust statistical analyses. This important and timely study fills a gap in our knowledge, highlights the important role that institutions like EMBL play in training the next generation of researchers and innovators, and may stimulate other universities and research institutes to do the same. However, there are a number of points that need to be addressed to make the article suitable for publication.

Essential revisions:

1. It is a great achievement to show career destinations for 89% of the 2284 searched for. However the question is in which cohort the 249 "unknown" belong: it could be more transparent to keep those numbers included also in the detailed cohort analysis. It is also unclear, whether the cohort sizes reflect the actual number of researchers who left EMBL in that time period or whether data were lacking. The cohorts reported here increased about 33% from 2004 to 2012 and another 9% by 2020 (Table 2). Could it be, that for more recent cohorts more data are available – for example due to the fact that younger researchers can be found on social media like LinkedIn?

2. The main and interesting conclusion in the abstract is that of the 45% of alumni not continuing in academic research, one third does industry research and one third is in a science-related profession. Other interesting take-home messages are, that a large proportion of alumni changing sectors enter – or are quickly promoted to – managerial positions, that of those who entered a research position in industry one in ten returned to academia and that female Alumni were found less frequently in PI roles. It would be interesting to know, whether there is a difference in these numbers between cohorts – e.g. if more alumni return from industry to academia in recent cohorts and whether female researchers stay longer in postdoc roles (which could influence the total number of female PIs at a given time point).

3. In the time-resolved analysis the authors claim that the probability of being found as a PI in Academia diminished by about 15% after the first cohort (Figure 2C). However the question is whether the absolute number of PIs also decreased. This could be clarified with some reference numbers in the supplementary materials. When calculating the % of the given cohort sizes at different institutes (supp. Table 4) some differences (increase vs decrease) in the number of PIs can be found. Even if the hypothesis that the differences between cohorts are not EMBL-specific, and reflect a wide-spread change in the number of PhDs and postdocs relative to available PI positions seems valid, it would be good to clarify this issue.

4. Interesting findings is also the significant change in time between PhD and first PI position of 0.8 calendar years between the 2004 and 2012 cohorts. It is not surprising that publication factors are highly correlated with entry into PI positions: indeed all ECRs who became PIs published well, but, not all ECRs who published well became PIs! Publications have become more collaborative over the last decade (the number of coauthors has doubled and the number of first author publications per ECR diminished). Another relevant observation is the lack of correlation with group leader seniority or nationality. Group publications were also predictive for other research and science-related careers. Finally a strong observation is that 45% of leavers from the last 5-years who were found to be working outside of academia held senior or management-level roles. These findings can be reassuring for ECRs and the authors could consider to clearly state these in their conclusions.

5. Regarding the career tracking method used for this study: doing google searches for 2284 Alumni is a plausible effort and has probably been time consuming. A question for other research institutes and universities would be, whether this method of career tracking is scalable and/or feasible to continue as a regular task, or whether the authors see this as a one-time effort. If so, what kind or extent of career tracking would the authors recommend to continue sustainably? Performing career tracking is quite relevant, as institutes worldwide now start to be asked to deliver such data to governments and funding agents.

6. In Discussion and future work, it would be valuable to briefly discuss/aspire that institutions such as EMBL compile and publicly report on this type of data/records analysis together with surveys (what authors call mixed methods) of career intent and research environment.

i. With surveys one could have the number of EMBL trainees that actually applied for PI jobs.

ii. The fact that women were found less frequently in PI jobs does not reveal if (1) women apply less frequently or (2) search committees offer PI jobs less often to women or (3) combination of the two.

iii. Surveys together with the data presented in this work can examine the role of lab environment during training and job application.

7. An observation that authors have in the manuscript is that women are less represented as AcPIs (academic PIs). But it's not possible to claim it's an active mechanism. It would be valuable if authors plot the timeline by gender so readers could see the noise.

8. In various panels of Figures 2-4, please clarify if "Time after EMBL" (the label on the x-axis) means "Time after leaving EMBL" or "Time after arrival at EMBL".

Also, it appears that regardless of the cohort, postdocs have increased chances to become a PI only years after they leave EMBL, why? did they go on to do a second postdoc?

9. Please discuss supplementary table 4 in the text, and highlight any common findings from these studies.

10. The authors may also wish to comment on how some members of faculty recruitment committees may need to be trained to recognize bias in relying too heavily on citation indices and first author publications in hiring decisions rather than the scientific contribution of highly-qualified candidates to collaborative projects.

Essential revisions:

1. It is a great achievement to show career destinations for 89% of the 2284 searched for. However the question is in which cohort the 249 "unknown" belong: it could be more transparent to keep those numbers included also in the detailed cohort analysis. It is also unclear, whether the cohort sizes reflect the actual number of researchers who left EMBL in that time period or whether data were lacking. The cohorts reported here increased about 33% from 2004 to 2012 and another 9% by 2020 (Table 2). Could it be, that for more recent cohorts more data are available – for example due to the fact that younger researchers can be found on social media like LinkedIn?

Thank you for these comments, we are happy to clarify here and in the manuscript:

The cohort sizes reflect the number of all PhD students and postdoctoral fellows who left in that time period, according to the official institutional administrative records. The organization grew during the time period included in the study (1997-2020), and the number of PhD students and postdocs in the later cohorts is therefore greater. It excludes individuals who were marked as deceased in our alumni records at the point the data was originally shared with us (June 2017 for 1997-2016 leavers and April 2021 for 2017-2020 leavers; or whose death we learned of during the update of our career tracking data in summer 2021 (through an updated alumni record, or if we found an online obituary)).

For each PhD or postdoc cohort, the percentage of alumni whose current position is unknown is between 9% and 14%, with no consistent trends with time. However, for the oldest cohort we less frequently found a complete online CV or biosketch that was detailed enough to confirm the type of position held for the full-time span since EMBL, particularly for postdoc alumni. Fewer of the older cohort therefore have a detailed CV/career path and there is a higher percentage of unknowns for specific timepoints after EMBL.

Changes to manuscript:

We have added an additional row with the number and percentage of alumni with detailed career paths for each cohort in Table 2 – new row = n(%) detailed career path

We have also clarified that the increased cohort size is due to growth in sentence that refers to this table: “More recent cohorts were also larger (Table 2), reflecting growth of the organization between 1997 and 2020.”

Column charts showing type of position by cohort (Figure 1B and Figure 1 —figure supplement 2 as 1B, but for other time-points) now include all alumni, not just those with a full career path available.

2. The main and interesting conclusion in the abstract is that of the 45% of alumni not continuing in academic research, one third does industry research and one third is in a science-related profession. Other interesting take-home messages are, that a large proportion of alumni changing sectors enter – or are quickly promoted to – managerial positions, that of those who entered a research position in industry one in ten returned to academia and that female Alumni were found less frequently in PI roles. It would be interesting to know, whether there is a difference in these numbers between cohorts – e.g. if more alumni return from industry to academia in recent cohorts and whether female researchers stay longer in postdoc roles (which could influence the total number of female PIs at a given time point).

‘if more alumni return from industry to academia in recent cohorts’

This is difficult to assess due to the different career lengths and small numbers transitioning from one type of career to another. For example, of 415 alumni who we have a career path for and had at least one Industry role, just 22 returned to a faculty position. Twelve of these were from the oldest cohort (of 117 who held an industry role), compared to 7 (of 178) for the most recent cohort. Similarly, for PI to industry, 21 transitions were observed from the 539 career paths – 16 from the oldest cohort (from 231) and 1 (from 128) in the newest. Given that the propensity to transition may also change with career length, it is difficult to make comparisons or detect meaningful trends from these small numbers.

“whether female researchers stay longer in postdoc roles (which could influence the total number of female PIs at a given time point).”

We did not observe a statistically significant difference in length between PhD and becoming a PI, but agree that his is interesting and that it should be included in the manuscript.

To add this to the manuscript we made three changes: Additional figure supplement showing the average PhD to PI length for male vs female alumni [as previous figure comparing 2005-2012 and 1997-2004 cohorts, but now comparing female vs male alumni] (Figure 3 —figure supplement 1) – this suggests that male and female researchers spend similar times in postdoc roles as the differences are not statistically significant.

We have now included Kaplan Maier plots by gender, which also illustrate the entry into PI (and other) roles with time (as Figure 3B -C and Figure 3 —figure supplement 2 additional plots for AcOt, IndR, NonSci).

We also expand discussion of these data in the main text – see below with new detail italicised. (note: to allow more detailed discussion without requiring repetition of the information, we have moved this section after the sections on changes in career outcomes, where the Kaplan-Meier and PhD to PI length are first discussed).

Gender differences in career outcomes

Many studies have reported that female ECRs are less likely to remain in an academic career (44, 45). Consistent with these previous studies, we observed that male alumni were found more frequently in PI roles (Figure 3A-B; Table S5 in Supplementary information). Figure 3A-B; Table S5 in Supplementary information. There was no statistically significant difference in the time to obtain a PI role between male and female alumni for alumni from 1997-2012, who became PIs within 9-years (Figure 3—figure supplement 1). The difference in career outcomes is therefore unlikely to be explained by different career dynamics for male and female alumni.

Female alumni were more frequently found in science-related non-research roles than male alumni (Figure 3A). In our Cox models, there was also a statistically significant difference between genders in entry into science-related non-research roles for postdoc alumni [p = 0.016] (Figure 3C; Table S5 in Supplementary information).

We more frequently found male alumni in industry research and non-science-related roles than their female colleagues (Figure 3A; Figure 3—figure supplement 2B-C). However, a higher percentage of female than male alumni could not be located. As academics are usually listed on institutional websites, often with a historical publication list that allows unambiguous identification, we expect that most alumni who were not located are employed in the non-academic sector. This means that, considering the higher percentage of female alumni with unknown career paths (where non-academic careers are likely over-represented), the true percentage of female alumni in industry research and non-science-related roles is likely higher, and possibly comparable with the percentage of male alumni in these roles.

3. In the time-resolved analysis the authors claim that the probability of being found as a PI in Academia diminished by about 15% after the first cohort (Figure 2C). However the question is whether the absolute number of PIs also decreased. This could be clarified with some reference numbers in the supplementary materials. When calculating the % of the given cohort sizes at different institutes (supp. Table 4) some differences (increase vs decrease) in the number of PIs can be found. Even if the hypothesis that the differences between cohorts are not EMBL-specific, and reflect a wide-spread change in the number of PhDs and postdocs relative to available PI positions seems valid, it would be good to clarify this issue.

We have added information on the absolute number of PIs for each group in the supplementary table that collates the data published from other institutions and comparable EMBL data (in original manuscript table 4; now Table S3 in Supplementary file 1). We have also expanded discussion of this table the text in response to comment 9 (see comment 9 below) and include the absolute numbers.

Additional clarification

In the datasets, the number of PhDs trained per year has increased with time at all institutions. The cohort size – and how much this has increased for more recent cohorts however varies – for example, Stanford’s 2011-2015 cohort was just 18% larger than its 2000-2005 cohort (503 vs 426), whilst the University of Toronto’s 2012-2015 is 96% larger than its 2000-2003 (1234 vs 629). For EMBL, the PhD cohort sizes increased 45% from 256 for the 1997-2004 cohort, to 372 for 2013-2020. Therefore, the absolute number of PIs with time is difficult to compare between institutions. We therefore feel that the percentage of alumni entering different career options is the most pragmatic measure for comparing how career outcomes are changing with time. It can be viewed as the ‘chance’ of a ECR from a specific programme of entering that career area. If an institution continues to train the same absolute number of PIs per year, but trained many more scientists, it nevertheless saw a big difference the career outcomes of its alumni, with more alumni entering non-PI roles.

4. Interesting findings is also the significant change in time between PhD and first PI position of 0.8 calendar years between the 2004 and 2012 cohorts. It is not surprising that publication factors are highly correlated with entry into PI positions: indeed all ECRs who became PIs published well, but, not all ECRs who published well became PIs! Publications have become more collaborative over the last decade (the number of coauthors has doubled and the number of first author publications per ECR diminished). Another relevant observation is the lack of correlation with group leader seniority or nationality. Group publications were also predictive for other research and science-related careers. Finally a strong observation is that 45% of leavers from the last 5-years who were found to be working outside of academia held senior or management-level roles. These findings can be reassuring for ECRs and the authors could consider to clearly state these in their conclusions.

We have made the following changes to the manuscript to emphasise the positive aspects of our career findings (but balance the editorial comment that “If possible please shorten the first paragraph of the discussion and avoid any unnecessary repetition of material from earlier in the article.”).

This now reads:

“Many ECRs are employed on fixed-term contracts funded by project-based grants, sometimes for a decade or more (52, 53), and surveys suggest that ECRs are concerned about career progression (18-22). We hope ECRs will be reassured by the results of our time-resolved analysis that indicate that the skills and knowledge developed as an ECR can be applied in academia, industry and other sectors. Within academic research, service and teaching, we observed a marked reduction in the percentage of alumni entering PI roles; nevertheless, academic careers continue to be an important career destination. The percentage of alumni entering career areas outside academic research, service and teaching has increased, and our data suggest that ECRs’ skills are valued in these careers; 45% of leavers from the last 5-years who were found to be working outside of academic research and teaching held senior or management-level roles.”

5. Regarding the career tracking method used for this study: doing google searches for 2284 Alumni is a plausible effort and has probably been time consuming. A question for other research institutes and universities would be, whether this method of career tracking is scalable and/or feasible to continue as a regular task, or whether the authors see this as a one-time effort. If so, what kind or extent of career tracking would the authors recommend to continue sustainably? Performing career tracking is quite relevant, as institutes worldwide now start to be asked to deliver such data to governments and funding agents.

We have expanded the Discussion section ‘Future career studies’ to include a recommendation as follows:

“Evaluating the outcomes of training programmes, and making these data transparently available is a valuable exercise that can provide information to policymakers, transparency for ECRs, and help institutions provide effective career development support. We plan to update our observational data every four years, and maintain data on the career paths of alumni for 24 years after they leave EMBL. This will help us to identify any further changes in the career landscape and better understand long-term career outcomes. Silva et al. (2019) (73) have also described a method for completing career outcome tracking on a yearly basis with estimations of the time and other resources required. We encourage institutions to consider whether they can adapt our, or Silva’s method to the administrative processes and data-privacy regulations applicable at their institutions.”

6. In Discussion and future work, it would be valuable to briefly discuss/aspire that institutions such as EMBL compile and publicly report on this type of data/records analysis together with surveys (what authors call mixed methods) of career intent and research environment.

i. With surveys one could have the number of EMBL trainees that actually applied for PI jobs.

ii. The fact that women were found less frequently in PI jobs does not reveal if (1) women apply less frequently or (2) search committees offer PI jobs less often to women or (3) combination of the two.

iii. Surveys together with the data presented in this work can examine the role of lab environment during training and job application.

Changes to manuscript: We have re-written the ‘Future career studies’ section of the discussion to incorporate these points. This now reads:

“Future studies should also ideally include mixed-method longitudinal studies. This would allow career motivations, skills development, research environment, job application activity, and other factors to be recorded by surveys during ECR training. Correlating these factors to career and training outcomes would allow investigation of multifactorial and complex issues such as gender differences in career outcomes, and provide policymakers with a fuller picture of workforce trends. Such studies will, however, require large sample sizes from multiple institutions and would need significant time investment and coordination over a long time period. The commitment and the support of funders and institutions would therefore be critical.”

7. An observation that authors have in the manuscript is that women are less represented as AcPIs (academic PIs). But it's not possible to claim it's an active mechanism. It would be valuable if authors plot the timeline by gender so readers could see the noise.

Changes to manuscript: We have generated Kaplan Maier plots by gender for entry into each career area, and include these in Figure 3 and Figure 3 —figure supplement 2 (see discussion of reviewer comment 2, above). The hazard ratios, 95% confidence intervals and p values are provided in a supplementary table in file 1 so that the confidence can be judged.

8. In various panels of Figures 2-4, please clarify if "Time after EMBL" (the label on the x-axis) means "Time after leaving EMBL" or "Time after arrival at EMBL".

We have added a clarification in the figure legend (“Time after EMBL refers to the number of calendar years between defence of an EMBL PhD and first PI role (for PhD alumni)) – or number of calendar years between leaving the EMBL postdoc programme and first PI role (for postdoc alumni)”, or clarified this in the figure labels, for each figure.

Also, it appears that regardless of the cohort, postdocs have increased chances to become a PI only years after they leave EMBL, why? did they go on to do a second postdoc?

We have expanded on this in the Results section ‘EMBL alumni contribute to research and innovation in academic and non-academic roles’, adding the following text:

“On average, PhD alumni became PIs 6.1 calendar years after their PhD defence. For postdoc alumni, the start year of the first PI role was on average 7.3 calendar years after their PhD and 2.5 years after completing their EMBL postdoc. Almost half of EMBL postdoc alumni who became PIs did so directly after completing their EMBL postdoc (168 of 343 alumni with a detailed career path available). Other postdoc alumni made the transition later, most frequently after one additional postdoc (71 alumni) or a single academic research / teaching / service position (56 alumni). Some alumni held multiple academic (40 alumni), or one or more non-academic positions (8 alumni) between their EMBL postdoc and first PI role.”

And to provide balance / to avoid focusing only on academic careers, we also include an additional sentence in the subsequent paragraph on non-academic areas:

“The average time between being awarded a PhD and the first industry research, science-related or non-science-related role was 5.0, 5.3 and 4.2 calendar years respectively.”

9. Please discuss supplementary table 4 in the text, and highlight any common findings from these studies.

We have expanded the discussion of this in the Results section ‘The percentage of EMBL alumni becoming PIs is similar to data released by North American institutions for both older and more recent cohorts’. [note that due to rearrangements, supplementary table 4 is now ‘Table S3 in Supplementary file 1’]. This now reads:

“A number of institutions have released cohort-based PhD outcomes data online or in publications (32, 44-49). Of these, a recent dataset from Stanford University offers the longest career tracking, reporting outcomes for PhD graduates from 20 graduation years (2000-2019) (44). In this dataset, Stanford University reported that 34% (145/426) of its 2000-2005 PhD alumni were in research-focussed faculty roles in 2018. This is comparable to the 37% (78/210) we observe for the EMBL alumni for the same time period. For 2011-2015 graduates, comparable percentages of Stanford (13%, 63/503) and EMBL (11%, 25/234) graduates were also in PI roles in 2018 (Figure 1C). Figure 1 – Supplement 3 plots data from five other datasets alongside equivalent data from EMBL (further details of each dataset are available in the Table S3 in Supplementary file 1). This includes a published dataset from the University of Toronto (32, 49), which reported that 31% (192/629) of its 2000-2003 life science division graduates and 25% (203/816) of its 2004-2007 life science graduates were in tenure stream roles in 2016. The equivalent EMBL data is comparable at 39% (52/132) and 28% (49/172) of graduates in PI roles respectively. Across all six datasets, EMBL and the other institutes generally have a similar proportion of alumni entering PI roles for comparable cohorts. This is consistent with our hypothesis that the differences between cohorts are not EMBL-specific, and reflect a wide-spread change in the number of PhDs and postdocs relative to available PI positions.”

10. The authors may also wish to comment on how some members of faculty recruitment committees may need to be trained to recognize bias in relying too heavily on citation indices and first author publications in hiring decisions rather than the scientific contribution of highly-qualified candidates to collaborative projects.

We have expanded this section of the discussion (third paragraph of ‘Addressing ECR career challenges’ in the discussion), also mentioning the trend to narrative CVs that has accelerated recently. This now reads:

“Research assessment and availability of funding play an important role in determining the career prospects of an academic. Therefore, it is also vital that factors that may lead to misperception of the productivity of ECRs, such as involvement in large-scale projects, career breaks, or time spent on teaching and service, are considered in research assessment during hiring, promotion and funding decisions. Initiatives such as the San Francisco Declaration on Research Assessment (DORA) and Coalition for Advancing Research Assessment (CoARA) have been advocating for an increased focus on good practice in evaluating research outputs, and many institutions and funders have reviewed their practices. Cancer Research UK, for example, now asks applicants to its grants to describe three to five research achievements, which can include non-publication outputs (64) and narrative CV formats that allow candidates to put their achievements in context are also becoming more common (61). The impact of the coronavirus pandemic on research productivity of researchers with caregiving responsibilities makes such actions imperative (65-67). We welcome this increased focus on qualitative assessment of scientific contribution, rather than reliance on publication metrics. To ensure successful implementation and to avoid unintended consequences (such as introducing new biases), it will be important for funders and institutions to provide appropriate guidance and/or training to evaluators and to carefully monitor implementation. Other initiatives that may help ECR involved in ambitious projects to demonstrate their contributions include more transparent author contribution information in publications (68, 69) and promotion of "FAIR" principles of data management (70). The increasing use of preprints (41, 71) is also likely to have a positive effect on the careers of ECRs involved in projects with longer time scales (72).”

Author details

1. Junyan Lu

   Junyan Lu, Genome Biology Unit, European Molecular Biology Laboratory, Heidelberg, Germany

   Present address

   Medical Faculty, Heidelberg University, Heidelberg, Germany

   Contribution

   Data curation, Formal analysis, Visualization, Methodology, Writing – review and editing

   Competing interests

   No competing interests declared

   "This ORCID iD identifies the author of this article:" 0000-0002-9211-0746

2. Britta Velten

   Britta Velten, Genome Biology Unit, European Molecular Biology Laboratory, Heidelberg, Germany

   Present address

   Centre for Organismal Studies and Interdisciplinary Center for Scientific Computing, University of Heidelberg, Heidelberg, Germany

   Contribution

   Data curation, Formal analysis, Methodology, Visualization, Writing – review and editing

   Contributed equally with

   Bernd Klaus

   Competing interests

   No competing interests declared

   "This ORCID iD identifies the author of this article:" 0000-0002-8397-3515

3. Bernd Klaus

   Bernd Klaus, Genome Biology Unit, European Molecular Biology Laboratory, Heidelberg, Germany

   Present address

   Häfele SE & Co KG, Nagold, Germany

   Contribution

   Data curation, Formal analysis, Visualization, Methodology, Writing – review and editing

   Contributed equally with

   Britta Velten

   Competing interests

   No competing interests declared

   "This ORCID iD identifies the author of this article:" 0000-0003-1169-1225

4. Mauricio Ramm

   Mauricio Ramm, EMBL International Centre for Advanced Training, European Molecular Biology Laboratory, Heidelberg, Germany

   Present address

   Institute of Biomedicine, University of Turku, Turku, Finland

   Contribution

   Investigation, Methodology

   Competing interests

   No competing interests declared

   "This ORCID iD identifies the author of this article:" 0000-0001-8456-3246

5. Wolfgang Huber

   Wolfgang Huber, Genome Biology Unit, European Molecular Biology Laboratory, Heidelberg, Germany

   Contribution

   Supervision, Methodology, Writing – review and editing

   Competing interests

   No competing interests declared

   "This ORCID iD identifies the author of this article:" 0000-0002-0474-2218

6. Rachel Coulthard-Graf

   Rachel Coulthard-Graf, EMBL International Centre for Advanced Training, European Molecular Biology Laboratory, Heidelberg, Germany

   Contribution

   Conceptualization, Data curation, Formal analysis, Investigation, Visualization, Methodology, Writing – original draft, Writing – review and editing

   For correspondence

   rachel.coulthard@embl.de

   Competing interests

   No competing interests declared

   "This ORCID iD identifies the author of this article:" 0000-0003-1916-8498

• 8,876

  views

• 305

  downloads

• 1

  citations

Views, downloads and citations are aggregated across all versions of this paper published by eLife.