Research Culture: Surveying the experience of postdocs in the United States before and during the COVID-19 pandemic
Abstract
In the interest of advocating for the postdoctoral community in the United States (US), we compared the results of surveys of postdocs carried out in 2019 and in late 2020. We found that respondents’ mental health and wellness were significantly impacted by the pandemic irrespective of their gender, race, citizenship, or other identities. Career trajectories and progression were also affected, as respondents reported being less confident about achieving career goals, and having more negative perceptions of the job market compared to before the pandemic. Postdocs working in the US on temporary visas reported experiencing increased stress levels due to changes in immigration policy. Access to institutional Postdoctoral Offices or Associations positively impacted well-being and helped mitigate some of the personal and professional stresses caused by the pandemic.
Introduction
Postdocs have long been referred to as the invisible component of the University (National Research Council, 1969). Although they comprise a significant portion of the scientific workforce, postdocs often lack job security, receive lower pay in comparison to non-academic peers in government or industry, and frequently lack employee-type benefits such as paid family leave (Shen, 2015; Alund et al., 2020).
The COVID-19 pandemic has only made things worse for postdocs due to lab closures, rotating (work) schedules, and hiring and salary freezes. Things were especially difficult for postdocs with families, as school and daycare closures significantly disrupted research continuity (Park, 2020; National Academies of Sciences, Engineering, and Medicine, 2021). For example, early in the pandemic it was reported that nearly two-thirds of postdocs believed that their long-term career prospects were negatively affected by the COVID-19 pandemic (Woolston, 2020a; Woolston, 2020b). Roughly eight out of ten postdocs surveyed also reported that the pandemic had hampered their ability to conduct experiments and collect data, and more than half had difficulty communicating with supervisors and colleagues. Furthermore, numerous universities retracted or deferred new faculty job offers, leaving postdocs (who are the source of future academics) to either consider different career paths or extend their current positions.
The impact of the pandemic on postdocs is not unlike the severe and far-reaching effects observed throughout the biomedical workforce, such as significant job losses, educational disparities, and elevated mental health issues (Levine et al., 2021; Jagsi et al., 2021; Gao et al., 2021; Doyle et al., 2021; Korbel and Stegle, 2020; Carr et al., 2021; Yan, 2020; Servick et al., 2020; Andrade et al., 2022; Myers et al., 2020). Although the financial impact of COVID-19 on scientific productivity has not yet been fully realized, the National Institutes of Health (NIH) estimates a $16 billion loss because of delayed research, and the Bureau of Labor Statistics reported the largest decline in college and university employment since the 1950s (Baumann, 2021; Bauman, 2021; Bauman, 2020).
We have long been interested in the postdoctoral experience in the United States (US) with respect to career choices, mentorship, grants and gender disparities. In 2018, we published the first comprehensive survey of postdocs since 2005 (Davis, 2005), assessing the satisfaction and career plans of over 7,500 postdocs from 351 institutions across the US (McConnell et al., 2018). To continue tracking these aspects of the postdoc experience, we conducted a second survey of over 6,000 postdocs in 2019 (June to December). As the effects of the COVID-19 pandemic began to be felt widely, a follow-up survey was conducted in the Fall of 2020 (between October 1 and November 3) on a subset (n=1,942) of the 2019 survey respondents to assess the impact of the pandemic on this postdoc trainee population.
Here, we present a comparison of survey data collected before and during the COVID-19 pandemic. We investigated how the pandemic impacted postdocs’ mental health and wellness, career trajectories and progression, and their confidence in achieving their career goals. The survey also explored specific challenges faced by international postdocs during the pandemic when the government enacted new policies restricting international travel, immigration, and visa access. Additionally, we enquired how access to Postdoctoral Offices (PDOs), which are run by professionals and funded by institutions, and Postdoctoral Associations (PDAs), which are largely managed by postdocs themselves, impacted the respondents’ overall well-being during the pandemic. These institutional services represent the postdoc community and support their training and professional development, but their role in the pandemic had not been previously explored.
Results
Comparing demographic data from the pre-pandemic and pandemic survey
In 2019, 6,292 respondents participated in our national postdoc survey, of which 5,929 identified as postdocs working in the US (we only analyzed responses from US-based postdocs). In October of 2020, 1,942 of the 6,292 respondents who participated in the 2019 survey, completed a follow-up survey assessing the effects of the COVID-19 pandemic. Of these, 1,722 (89%) were still in a postdoctoral position at a US institution. From here on, we refer to the 2019 survey as the pre-pandemic survey and the 2020 survey as the pandemic survey. Furthermore, in our analyses of current postdocs, we removed the 11% of respondents in the pandemic survey who were no longer in postdoctoral positions; however, we analyzed their career outcomes separately in Figure 7.
As shown in Figure 1, the demographics of the respondents to the pandemic survey largely mirrored those of the pre-pandemic survey. The number of respondents in the pandemic and pre-pandemic survey by US state is shown in Figure 1—figure supplement 1A-B. There were slightly more responses from individuals who identified as female (61% vs 58%) and non-binary/third gender (0.9% vs 0.4%), and fewer self-identified males (38% vs 42%) in the pandemic survey compared to the pre-pandemic survey (Figure 1A).
Race and ethnicity varied between the pre-pandemic and pandemic survey respondents, with a 4% increase in the proportion of respondents who identify as white, and a corresponding 4% decrease in the respondents who identify as Asian; however, no differences were observed between the proportion of respondents from underrepresented minority backgrounds (URMs; 13% in both surveys; Figure 1B; Figure 1—figure supplement 1C). We combined individuals into these three main categories (white, Asian and URM) due to the small number of respondents in some racial and ethnic groups (see Methods for a full description and Supplementary file 3 for a more granular breakdown). The number of responses from other identity groups (i.e., disability, LGBTQ, and veterans) also did not vary between the two surveys (Figure 1—figure supplement 1D).
The number of respondents who were US citizens or permanent residents (referred to as US citizens/PR throughout this manuscript) increased from 53% (pre-pandemic survey) to 57% (pandemic survey). There was a corresponding decrease in international respondents (47% pre-pandemic vs. 43% pandemic) who were working in the US on temporary visas (J1, H1B, TN, F1, F1-OTP, E3 visas; Figure 1C). Given that we conducted the pandemic survey within a sub-population of those in the pre-pandemic survey at a later date, the age of the pandemic respondents was slightly higher than the pre-pandemic respondents, and as expected, they were more advanced in their postdoc (Figure 1D–E).
There was a significant decrease in respondents in the field of medicine (13% pre-pandemic and 9% pandemic), while there was no significant change in the representation of any other field (Figure 1F). Respondents were from various disciplines, mostly within the life sciences (48%), followed by medicine, physical sciences, engineering, psychology, environmental sciences, and social sciences, among other research areas. Lastly, there was a significant increase in access to a PDO (65.6% pre-pandemic vs 70% pandemic), which was mainly due to increased awareness, but no differences in access to a PDA (Figure 1—figure supplement 1F-G).
The impact of COVID-19 on postdoc well-being
To directly assess the effects of COVID-19 on postdocs, we queried three general areas: stressors during the pandemic, institutional response to the pandemic, and ability to meet basic needs. In an open-ended question inquiring about main stressors during the pandemic, postdocs indicated that their main stressors were a combination of work, family, and emotional burdens (such as uncertainty, isolation, fear, and anxiety) as shown by the word cloud analysis of the responses (Figure 2A–B). Additional responses to the open-ended question are included in Table 1 along with responses to another question querying how the pandemic impacted research productivity. 2,768 comments were collected in total, which further demonstrates the impact of the pandemic on the postdoctoral population.
Individual responses showed how postdocs experienced different types of burdens. Parents and caregivers faced the burden of “being a full time [sic] postdoc and staying home with two kids” or caring for a loved one who was/is struggling with COVID-19. As one postdoc indicated, “my girlfriend has been recovering from COVID-19 since March. It’s a grueling process to watch and support.” A large number of postdocs also indicated that work progress was more difficult due to “getting research done within limited shifts and hours” and an overall fear of “loss of productivity”. Many international postdocs were concerned about their visas and one respondent even indicated that the international office at their institution told them “...you will lose your job if you leave the country for any reason and are not a resident.”
Laboratory shutdowns also had an adverse impact on postdocs’ relationships with their Principal Investigator (PI) and coworkers. When asked if respondents were able to maintain regular contact with their PI and coworkers, half of the respondents (50%) reported they had, but not as much as before the pandemic and 1% reported no contact (49% reported maintaining as much contact as before the pandemic). In open-ended responses, postdocs indicated facing high demands from PIs and unrealistic expectations to be productive during the pandemic (examples in Table 1). Some felt that work from home was expected to be "business as usual" and there was immense pressure to “work round the clock”, “work long hours and continuously produce results” and “produce data when no lab activities are allowed”. One respondent indicated inability to utilize institutional support services due to over-work: “the PI puts a large amount of pressure and therefore there is really no time to make use of any of the resources”.
Conversely, supportive PIs were lauded for their role in lessening stress. Respondents mentioned: “I did not have a lot of stress factors. I was lucky to have a supportive PI that understood how stressful a time this can be and set a pretty low expectation bar”; “working from home during shutdown with a 5 yo kid was impossible, really stressful and I am happy my PI was understanding and let me work half time.”
Institutional responses to COVID-19 and the impact of PDAs and PDOs
Next, we examined the institutional response to COVID-19, which ranged from completely satisfied to completely unsatisfied. Most postdocs indicated that they were completely or mostly satisfied with their institution’s response to COVID-19 (59%) (Figure 2C). In particular, postdocs with access to a PDO were significantly more satisfied than those who did not (Figure 2D). On the other hand, there were no differences in satisfaction with their institution’s response between those with or without access to a PDA (Figure 2D), or with respect to gender, citizenship status, race and ethnicity, or identity (multivariate ordinal logistic regression, P>0.05, data not shown). Notably, there was also a non-negligible portion (4%) of postdocs who indicated they were completely unsatisfied with their institution’s response to COVID-19, with one respondent commenting, “... my institution did almost NOTHING to ensure that faculty and staff can be safely back at work”.
Meeting basic needs during the pandemic
Although the majority of postdocs indicated that all of their basic needs were met during the pandemic (64%), a substantial portion (36%) indicated that their needs concerning mental health (21%), childcare (11%), healthcare (7%) and/or food (2%) were unmet (Figure 2E). Additionally, 3% of postdocs mentioned other unmet needs in their responses, including the inability to pay bills or exercise, and loss of access to transportation, work safety, human connections, or loss of salary, retirement benefits, or annual raise. Furthermore, although the majority of postdocs indicated that all of their basic needs were met, their comments suggested that the pandemic had made meeting those needs more difficult: “My husband lost his job, and while we are not in danger of basic needs not being met it does change some things and adds additional stress”.
Postdocs who had access to a PDA or PDO (although not statistically significant for the latter) were more likely to have their basic needs met (65% PDA; 66% PDO) than those who did not (50% PDA; 56% PDO; Figure 2F). Furthermore, postdocs with access to a PDO or a PDA were less likely to have their mental health needs unmet (PDO: 32% (no) vs. 19% (yes); PDA: 37% (no) vs. 20% (yes)); no differences were observed between those not aware and aware of a PDA or PDO at their institution (Figure 2F). Postdocs who identified as Asian – the majority of whom were international (76%) – were more likely than white postdocs to report unmet needs with respect to health care (12% vs 6%) or food (6% vs 1%) (Figure 2—figure supplement 1A). Postdocs who identified as LGBTQ reported an increase in food (5% vs 2%) and mental health (30% vs 20%) needs unmet compared to postdocs who did not identify as LGBTQ. (Figure 2—figure supplement 1B). The latter was also observed in postdocs with disabilities compared to postdocs without disabilities (40% vs 20%; Figure 2—figure supplement 1C). No differences were observed according to URM status (Figure 2—figure supplement 1A) or gender (multivariate logistic regression, P>0.05, data not shown).
Postdoc parents were particularly affected by pandemic-related shutdowns and reported difficulties meeting childcare needs. While we did not directly inquire whether respondents in the pandemic survey had children (in the pre-pandemic survey, 20% of postdocs answered that they had children), 10% of respondents mentioned in comments that ensuring their children had proper care was a major stressor and led to severe work disruptions. Additionally, 68% of these comments were from female respondents and 32% from males, suggesting a greater burden of childcare for female postdocs. Overall, childcare was the 5th most frequently mentioned stressor (Figure 2A–B). Parents mentioned “I have lost childcare for my baby and it has had a significant impact on my ability to write, complete research goals, and apply for grants”; “It was difficult to do any writing- or reading-based work because the day cares were closed, and my partner and I had to divide the day into childcare/work time”; “Loss of productivity due to loss of childcare, feeling like I am slipping behind my colleagues without children”. Some reported feeling burnt out from putting in long hours and mentioned lack of support from their peers and their university; “Lack of childcare and intense pressure from PI to continue long hours at home”; “Loss of childcare and co-workers not respectful of the loss of childcare”; “My institution enacted strict... "shift schedules" that were outside of childcare hours so I was unable to work a full work week. However, I was expected to produce the same (if not more) results/data to make up for the time we were locked out” (additional examples in Table 1).
Impact of COVID-19 on international postdocs
When we focused on residency status, we saw that more international postdocs (vs. US citizens/PR) reported having food needs unmet (4% vs 1%), while US citizens/PR (vs. international postdocs) reported more difficulty in obtaining childcare (13% vs 9%) (Figure 3A). Additionally, international respondents (n=718) expressed specific worries regarding their residency status. The majority of international postdocs reported apprehension about immigration or visas either due to recent policy changes in the US (84%) or in general (11%) (Figure 3B). The primary concerns noted were traveling (75%), US immigration policy changes (69%), and travel bans (68%) (Figure 3C, Table 1). Furthermore, more international females than males were worried about immigration issues (89% vs 78%) (Figure 3—figure supplement 1A); specifically, travel (80% vs 70%), delays in visa renewal (65% vs 56%), and travel bans (72% vs 62%) (Figure 3—figure supplement 1B).
Compared to white international postdocs, both Asian and URM international postdocs were more concerned about changes in jobs (42% Asian and 43% URM vs 29% White), visa status (49% and 52% vs 41%) and US immigration policy (70% and 80% vs 66%); and were less concerned about traveling (62% and 78% vs 87%). Additionally, international Asian postdocs were also less concerned about Embassy closures (51% Asian vs 59% white) and travel bans (57% vs 78%) (Figure 3—figure supplement 1C). Finally, international LGBTQ postdocs were more concerned about US immigration policy changes compared to non-LGBTQ postdocs (80% vs 69%).
Impact of the pandemic on mental health and wellness
Overall, 76% of respondents stated that the COVID-19 pandemic had impacted their mental health, with 32% stating that it had a high or very high impact (Figure 4A). In open-ended responses, postdocs mentioned significant impacts on their mental health due to isolation and pandemic associated stressors leading to reduced productivity, inability to focus and work effectively: “My mental health has been struggling, which has negative consequences on my ability to focus”; “The isolation has had a negative effect on my mental health … ”; “Mental health diminished productivity despite being able to work 100% remotely” (see Table 1 for more examples).
All gender, race and ethnicity, and identity groups indicated a significant impact on mental health. However, certain groups reported more of an impact than others; females reported a greater impact than males (80% vs 68%); white and URM postdocs reported more of an impact than Asian postdocs (78% and 80% vs 68%); members of the LGBTQ community (83% vs 75%) and postdocs with disabilities (88% vs 76%) reported more of an impact than postdocs not identifying with these groups (Figure 4B).
Effect of institutional support on mental health and wellness
Parallel to this impact on mental health, access to institutional mental health resources rose by 15% (Figure 5A), which appears to be linked to an increase in awareness, although only 17% of postdocs indicated use of these resources. Female postdocs reported higher usage of these resources compared to male postdocs (21% vs 10%; Figure 4B). Notably, postdocs without access to, or who were unaware of, institutional mental health resources were more likely to have their mental health impacted by COVID-19 than postdocs with access to those resources (Figure 5B).
Indeed, postdocs were more likely to have their mental health needs met if their institution provided these resources (84%) than if their institution either did not provide them (42%) or if they were unaware of these resources at their institution (68%, Figure 5C). Postdocs at institutions that provided mental health resources were also more likely to have all their basic needs met (69%) compared to those without (35%) or unaware of these resources (50%) (Figure 5D). Unsurprisingly, postdocs that did not have access to mental health resources at their institutions, were also more likely to have other basic needs unmet such as food (8% (no) vs 2% (yes)) or health care (21% (no) vs 7% (yes); Figure 5—figure supplement 1A).
In written responses, several postdocs mentioned that their institutions provided mental health resources; however, they were often unaffordable or inaccessible: “ … doesn't take postdocs appointments for mental health or other such services they are completely booked [sic].”; “Limited financial resources to pay to access mental health resources as "free" sessions through employer was used pre-COVID.”; “ … has mental health resources but they are not free at all.”; “Note, the mental health resources available to post-docs and faculty here are minimal, but they do exist -- mostly things like meditation workshops. … However, whether any of these resources are available to postdocs depends on whether our funding is internal ('associates', as I am) or external ('fellows', who receive fewer benefits)”. These stark differences between institutions with mental health resources and those without, highlight the widespread importance of mental health care and its correlation with quality of life in the postdoctoral population.
As previously indicated (Figure 2F), access to a PDA and/or a PDO also increased the likelihood of mental health needs being met. This trend may be due in part to a larger proportion of postdocs with access to a PDO/PDA also having access to mental health resources (82% and 80%) compared to those that did not (59% and 61%) or were unaware (66% and 60%) (Figure 5E–F). Postdocs with a PDO/PDA were also more likely to use their institution’s mental health resources (19% and 18%) compared to those that did not have access (9% and 11%) or were unaware of these resources (13% and 9%, Figure 5E–F).
How the pandemic affected the career trajectory of postdocs
The pandemic dramatically impacted career trajectories of the postdocs due to lab shutdowns, inability to communicate with faculty supervisors and research group members, and most significantly, additional family responsibilities, etc., compared to one year earlier (see word cloud in Figure 2A–B and select comments in Table 1). This resulted in reduced research productivity, delayed job searches, lowered confidence in attaining the desired career, and uncertainty in overall career trajectory. Even though the postdocs were older and had more years of experience when re-surveyed (Figure 1D–E), a smaller proportion were currently looking for positions (64% pre-pandemic, 56% during the pandemic), with 11% of postdocs specifically delaying their job search because of the pandemic (Figure 6A). In addition, postdocs were less confident in achieving their career goals than before the pandemic (Figure 6B, 76% said they were very confident to somewhat confident pre-pandemic compared to 68% during the pandemic), which may be contributing to the observed decline in those actively pursuing new positions (Figure 6A). Furthermore, more postdocs were undecided about their future careers than before the pandemic (9%–12%) (Figure 6C). Together, these results highlight the substantial increase in career uncertainty felt by postdocs.
Overall, 34% of postdocs reported changing their career plans during the pandemic, with 23% of respondents indicating that COVID-19 was the direct cause of their change (Figure 6D). The postdocs that changed their career plans (both due to and not due to the pandemic), were more likely to be undecided about future careers (20% (due to the pandemic); 20% (not due to the pandemic) vs. 7% (did not change career plans)) or considering non-academic positions (28%; 37% vs 14%), and much less likely to be seeking an academic position (51%; 43% vs 79%) compared to postdocs who did not change their career plans (66% of surveyed postdocs) (Figure 6—figure supplement 1A).
Of those postdocs who indicated a change in career plans (both due and not due to the pandemic), the main reasons cited were: (i) difficulty in obtaining the desired position (77%), (ii) insufficient job security (52%), and (iii) balancing family and career (50%) (Figure 6E). Additionally, reasons for career change differed by citizenship status and race/ethnicity. International postdocs cited more peer pressure (8% vs 1%) and geographic constraints (42% vs 35%) than US citizen/PR, while the latter noted more difficulty in obtaining desired positions (83% vs 69%) as well as balancing family and career (58% vs 39%, Figure 6—figure supplement 1B). More white and URM postdocs indicated geographic constraints as a reason for changing career trajectory compared to Asians (41% vs 29%, Figure 6—figure supplement 1C). Lastly, no differences were observed by gender or identity groups with respect to reasons for changing career trajectory (multivariate logistic regression, P>0.05, data not shown).
The majority of postdocs surveyed also reported a change in their perception of the job market (81%) (Figure 6F), with more US citizens/PR than international postdocs (85% vs 74%, Figure 6—figure supplement 1D) reporting a change in perception. No differences were observed based on gender or identity groups (multivariate logistic regression, P>0.05, data not shown). This altered perception was observed for both the academic and non-academic job markets (Figure 6G and H). Overall, the majority of the respondents viewed the current academic job market as poor (66%) or fair (26%), which is a significant change compared to the pre-pandemic survey, where fewer postdocs viewed the market as poor (44%) and more viewed it as fair (33%). Although the perception of the job market outside of academia was better - 28% of the respondents found it either excellent or good compared to academic careers (8%) - there was still a decrease in perception from the pre-pandemic survey.
Career changes during the pandemic
The postdoctoral position is considered temporary, with the ultimate goal of providing the necessary training and experience to successfully transition to more permanent careers. To better understand the effects of the pandemic on career outcomes, we surveyed those who were no longer in postdoctoral positions. Of those who responded to the second survey, 11% (219/1,941) were no longer postdocs, with 14% indicating that this career transition was a consequence of the pandemic (Figure 7A).
Overall, 56% of the postdocs who made career transitions remained in academic positions (clinical, research staff, or faculty), while nearly 8% were unemployed. When we separately examined postdocs who made career transitions as a consequence or irrespective of the pandemic, we observed a profound difference in career outcomes. The former group was more likely to be unemployed (38% vs 6%) and less likely to be in academic positions than postdocs who chose to leave their position regardless of the pandemic (24% vs 65%). However, we observed little difference in those pursuing non-academic careers (38% vs 29%; Figure 7B).
Discussion
Early in March of 2020, the COVID-19 pandemic forced research facilities across the US to drastically alter their activities. This resulted in a cascade of events, including loss of research progress, delayed career advancement and a significant disruption of work and life activities. Although there have been multiple reports of the pandemic’s impact on the STEM workforce, few have discussed the impact on postdocs specifically (Woolston, 2020a; Woolston, 2020b; Gao et al., 2021; Doyle et al., 2021; Korbel and Stegle, 2020; Carr et al., 2021; Aubry et al., 2021; Seitz et al., 2020; Deryugina et al., 2021; Nature, 2020).
To investigate the impact of the pandemic on the postdoctoral experience, we took advantage of our recently completed 2019 National Postdoctoral Survey 2.0 and re-surveyed the same population during the pandemic. Rather than interrogating during the first few months with all the uncertainty of full lockdowns, etc., we surveyed postdocs at the start of the second wave (in the US), when many institutions were partially open with social distancing, masking, etc., but still before access to vaccines, and immediately before the 2020 US elections. The data provided a unique opportunity to directly assess the effects of the pandemic on the postdoctoral experience and perform a comparative analysis of the same cohort before and during the pandemic. As well, the pandemic survey was only open during a restricted period (1 month), and therefore allowed us to capture a defined period of the pandemic.
The results of the pandemic survey showed that access to institutional resources like PDAs and PDOs is important not only for postdocs to complete their work in safe and supportive environments, as is often the focus of these institutional assets, but also for their mental and physical wellbeing. This intriguing correlation between postdocs’ satisfaction with their institution’s response to the pandemic, specifically whether their mental health, childcare and basic needs were met, are important aspects that need further examination. In the ~7 months between the beginning of the pandemic and this survey, potential long-term consequences impacting career progression for many postdocs, such as delayed job searches, lost productivity, canceled positions, fewer opportunities and altered career trajectories have already been observed. These experiences may result in more postdocs becoming disenchanted with their career trajectories.
Our results have been implicated in other studies, including a Nature survey early in the pandemic, that found postdocs all over the world were impacted by loss of productivity, uncertain job prospects, lab closures, travel bans and experienced mental health issues (Woolston, 2020a; Woolston, 2020b). In more recent reports, mental health and career impacts due to the pandemic have been experienced by all members of the university, across a multitude of fields (Doyle et al., 2021; Gao et al., 2021; Korbel and Stegle, 2020; Servick et al., 2020; Yan, 2020). Unfortunately, there has been a greater impact on underrepresented minorities and female academics, especially those with young children (Staniscuaski et al., 2021; Deryugina et al., 2021). These reports and ours highlight the pandemic’s toll on all members of the academy, and emphasize where institutional resources should be targeted.
The longer-term effects of the pandemic on the postdoctoral population, however, are not able to be predicted from our data, since our study was only conducted over a short period of time during the pandemic. Thus, further studies are needed to assess how the pandemic ultimately affects career trajectories. Likewise, it is also premature to predict irreversible trends. However, while we are barely out of the COVID-induced disruptions, there are some glimpses of positive changes that are emerging (Gardner et al., 2021; Gould, 2021; Shah et al., 2021). For example, in order to mitigate isolation and perpetuate a learning environment when labs shut down in early 2020, institutional entities responsible for professional skill-building and career-promoting programming pivoted to remote platforms with some interesting outcomes (Andrade et al., 2022). Remote sessions now appear to be not only acceptable, but may even be preferred by trainees, as they are more accessible, provide more efficient use of time and offer flexibility (such as having the possibility to watch recorded sessions later). Since PDOs and PDAs often provide these types of professional development programs, this may explain why postdocs with access to these institutional assets were significantly more satisfied. Again, this is a potentially important factor that needs further exploration.
Limitations and future directions
As with all such surveys, there were a few limitations to our study. First, while the pandemic survey was conducted on a subset of the pre-pandemic respondents, the responses were collected anonymously according to our IRB protocol. We therefore were unable to do a direct one-to-one comparison of pre-pandemic to pandemic responses on an individual basis. Second, in the pandemic survey, we did not directly ask if respondents were parents or caregivers and were only able to partially assess this through questions that required written responses to pandemic related stressors. Therefore, we were limited in our ability to assess exactly how many postdocs had caregiving responsibilities that disrupted their research and career progression, and further studies are needed to investigate how wide-spread the impact was on these postdocs.
Third, because of small sample sizes, we were also limited in evaluating certain demographic metrics such as LGBTQ and disability status, as well as individuals who identified as non-binary/third gender. Furthermore, to parse out potential differences between racial and ethnic groups, we pooled individuals into three broad groups; white, Asian and URM (see Methods for more details about how these groups were assigned). As a result, specific races/ethnicities were not examined individually in this study.
Individual pandemic experiences varied greatly throughout the pandemic, undoubtedly influenced by factors such as geographic location, type of institution, timeframe within the pandemic, caregiving responsibilities, and how amendable a person’s research is to remote work. Our study did not assess how effects differed across the country based on geographic location or type of institution (for example, an institute with more resources, budget, and personnel dedicated to postdoc affairs vs. others). Nevertheless, we did capture responses from postdocs across the US, with higher response rates in locations that would be expected to have more postdocs, such as on the East Coast and in California (Figure 1—figure supplement 1A-B). We also did not directly analyze how the experience varied for postdocs in different fields. Some postdocs were likely able to transition readily to remote work for a period of time, with little to no disruption to their research (e.g., biostatisticians), while others may have had their research productivity significantly hindered or disrupted due to limited access to their laboratories. These are all important factors that will need to be evaluated in future studies.
Lastly, our study focuses on a specific period of time (Fall 2020) when the urgency and uncertainty of the initial shutdown period had lessened. However, there have been successive waves of the pandemic, the effects of which will require additional investigation. Further studies should also ascertain whether the pandemic had any positive impacts on postdocs, such as the ability to continue to work remotely under certain circumstances or make new professional connections via video conferencing, etc. (Levine et al., 2021; Gardner et al., 2021; Gould, 2021; Shah et al., 2021).
Conclusion
As we and others have previously reported, postdocs are an often overlooked and forgotten population in academia, with a non-negligible number of institutions being unaware of their total postdoc population, let alone the concerns of postdocs. Access to employee benefits varies widely, with untoward consequences for postdocs who lack access to certain essential services (National Research Council, 1969; Shen, 2015; Alund et al., 2020). In a position that emphasizes sacrifice for research, institutions should be more proactive in discerning the basic needs of their postdocs, and make appropriate resources and benefits available, including access to paid family leave, healthcare, mental health and wellness services for the postdocs and their families, as well as affordable childcare options.
PDOs are the appropriate institutional entities to ensure that postdocs’ minimal basic needs are met and should assume responsibility for developing policies, disseminating essential benefits and coordinating with their PDAs in providing career-enhancing programming. Furthermore, having postdoctoral leadership and organization, through PDAs, gives postdocs a voice and an avenue for communicating the needs of postdocs within the institution. Moving forward, we plan to continue to survey this cohort of US-based postdocs in order to generate a better understanding of the long-term consequences of the COVID-19 pandemic on postdoc experiences and outcomes. Ultimately, understanding the needs of this critical workforce will also broadly benefit the future of science and research.
Methods
Survey design and dissemination
The National Postdoctoral Survey was designed to capture the experiences and demographic information of postdoctoral fellows and scholars across the US. The survey was initially conceived and developed by postdocs within the University of Chicago’s Biological Sciences Division Postdoctoral Association (PDA) in 2016, in order to identify important issues within the postdoctoral community and inform and equip those who advocate for postdoctoral policies to make positive changes. The results of the first National Postdoc Survey were published by McConnell et al. in 2018.
In 2019, a second updated version of the National Postdoc Survey was launched by the University of Chicago PDA. This version, referred to as the “pre-pandemic survey”, collected responses from postdocs in the US from June 4, 2019 until December 31, 2019. Our survey design and dissemination protocol were approved by the University of Chicago Institutional Review Board, IRB Protocol Number 15–1724.
In order to make postdocs across the US aware of the survey, multiple types of grass-roots outreach were used in a similar manner to McConnell et al. First, we performed online website searches for Postdoc Offices (PDOs) at doctoral degree-granting universities or research institutions in the US that train postdocs. We compiled a list of publicly available email addresses for institutional representatives of these PDOs. If we were unable to identify a PDO, or if an institution did not have a PDO, then contact information was collected instead for an administrative or faculty representative within an Office of Research, Graduate School, or Provost, or for a similar official who might have access to postdocs. We also collected contact information, if available, for postdoc leaders of Postdoctoral Associations (PDA), who were contacted if institutions did respond to our initial outreach or if an institution’s response rate was deemed low compared to the 2016 National Postdoc Survey. We emailed over 400 institutional PDOs, other administrative contacts or PDA leaders, described the goals of the survey, and asked them to distribute our survey link and invitation to the postdocs at their institution. Over the course of the seven months that the survey was open, follow-up emails were sent to our contacts to remind them to send the email to their postdocs, or to distribute the survey link if they had not already done so.
In addition to our outreach to institutional representatives, we shared the survey on social media websites including Twitter and LinkedIn, launched a website dedicated to the National Postdoc Survey, and prepared an email campaign to advertise the survey which was distributed by the National Postdoctoral Association to its large national listserv of postdocs and postdoc advocates. These additional methods were used to enhance awareness of the survey and distribute the survey link directly to postdocs who may not have received it through their institution.
During the seven months that the survey was open, responses from 6,292 postdocs were collected from over 300 institutions in nearly every state in the nation. All responses were collected anonymously, but most respondents (5,594 (89%)) voluntarily provided contact information in a separate form to draw names for survey incentive prizes. Of the 6,292 respondents to the survey, 5,929 identified as postdocs at a US institution and only their responses were used for analysis.
While analysis of the 2019 pre-pandemic survey data was underway, the COVID-19 pandemic commenced, and it became evident that a follow-up survey was necessary to assess the changes brought on by the pandemic in the mindsets and current situations of postdocs. Questions were designed in 2020 for a shorter “pandemic survey” to query what changes the postdocs experienced in their career goals and whether their plans changed since the pandemic started, current perceptions of the job market in academia, and how their research and life has been affected by the pandemic. All postdocs who completed the initial pre-pandemic survey and submitted their email addresses for recontact (5,594 in total) were asked to complete this second pandemic survey, which was launched on October 1, 2020 and was only open for one month. Many emails bounced, suggesting that many postdocs from the previous cohort had defunct addresses.
In total, 1,942 responses to the pandemic survey were collected. Of these responses, 1,722 (88.6%) were submitted by researchers currently in postdoctoral positions in the US, and these responses are analyzed here. Pre-pandemic and pandemic survey questionnaires are included in supplementary file 1 and supplementary file 2 respectively.
Data analyses
Participants were queried about their race and ethnicity with the following options: white/Caucasian, Asian/Asian American, South Asian/South East Asian, Black/African American, Hispanic/Latino, Middle Eastern, Native American or Alaska Native, and Pacific Islander or Hawaiian Native. For all analyses, due to low numbers of respondents, certain racial/ethnic categories were consolidated into three groups: (1) underrepresented minorities (URM) as defined by the NIH (https://diversity.nih.gov/about-us/population-underrepresented): Black or African American, Hispanic or Latino, Native American or Alaska Native, Native Hawaiian or Pacific Islander; (2), Asians (Asian/Asian American and South Asian/Southeast Asian); and (3) white (white/Caucasian and Middle Eastern – which were grouped based on the categorization provided by the NIH and US census). The NIH also defines those with disabilities (analyzed separately here) and those from disadvantaged backgrounds (this category was not queried in this study) to also be underrepresented in the biomedical, clinical, behavioral, and social sciences. Unless stated otherwise, international postdocs and US citizens/permanent residents were included in all the analyses as long as the postdocs were working in the US.
All questions were optional, thus, non-respondents for each question were removed before each analysis. The number of respondents used for each analysis are indicated in the legend/figure panels. To assess similarities between the pre-pandemic and pandemic surveys, we used the Chi-square test in the presence of categorical data (basic R function). We used the same test to assess the postdocs who transitioned out of their position during the pandemic, due to the lack of additional data available for this group. For the other analyses, we performed multivariate tests including gender, race and ethnicity, residency, LGBTQ status, having a disability, access to a PDO and access to a PDA as covariates. To assess differences, we used either ordinal logistic regression in the presence of ordinal dependent variables (using the R package “MASS”), logistic regression (basic R function) and multinomial logistic regression (using R package “nnet”) accordingly. Results are described in the legend as Odds Ratio (OR) [95% Confidence Interval (CI)] with the p-value. We considered p-values <0.05 to be significant. In the manuscript, p-values of <0.05 were identified as *, P<0.01 ** and P<0.001 ***. Word clouds were generated in Python using the wordcloud package. Figures were generated using Python version 3.7.6.
Data availability
The survey questions can be found in additional data files (Supplementary File 1 and Supplementary File 2). All the statistical details and anonymized data such as the percentage of respondents can be found in figures, figure legends as well as method and results sections. Because of the sensitive information, the full data cannot be shared to maintain the confidentiality of surveyed subjects, personal information is not shared as stipulated in IRB.
References
-
Academic ecosystems must evolve to support a sustainable postdoc workforceNature Ecology & Evolution 4:777–781.https://doi.org/10.1038/s41559-020-1178-6
-
COVID-19 threatens faculty diversity: postdoctoral scholars call for actionMolecular Biology of the Cell 33:507.https://doi.org/10.1091/mbc.E21-10-0507
-
Impacts of COVID-19 on ecology and evolutionary biology faculty in the United StatesEcological Applications 31:e2265.https://doi.org/10.1002/eap.2265
-
Academic careers and the COVID-19 pandemic: reversing the tideScience Translational Medicine 13:eabe7189.https://doi.org/10.1126/scitranslmed.abe7189
-
BookCOVID-19 Disruptions Disproportionately Affect Female AcademicsNational Bureau of Economic Research.https://doi.org/10.3386/w28360
-
The impact of the COVID-19 pandemic on underrepresented early-career PhD and physician scientistsJournal of Clinical and Translational Science 5:e174.https://doi.org/10.1017/cts.2021.851
-
Potentially long-lasting effects of the pandemic on scientistsNature Communications 12:6188.https://doi.org/10.1038/s41467-021-26428-z
-
Remote learning barriers and opportunities for graduate student and postdoctoral learners in career and professional skill development: a case studyJournal of Microbiology & Biology Education 22:ev22i1.https://doi.org/10.1128/jmbe.v22i1.2451
-
Promoting equity for women in medicine - seizing a disruptive opportunityThe New England Journal of Medicine 384:2265–2267.https://doi.org/10.1056/NEJMp2104228
-
ReportVoices from the field: the impact of COVID-19 on early career scholars and doctoral students [Focus group study report]American Educational Research Association; Spencer Foundation.
-
Unequal effects of the COVID-19 pandemic on scientistsNature Human Behaviour 4:880–883.https://doi.org/10.1038/s41562-020-0921-y
-
BookThe Impact of COVID-19 on the Careers of Women in Academic Sciences, Engineering, and MedicineThe National Academies Press.https://doi.org/10.17226/26061
-
ReportThe invisible university: postdoctoral education in the United StatesThe National Academies Press.
-
The invisible university is COVID-19 positiveTrends in Genetics 36:543–544.https://doi.org/10.1016/j.tig.2020.05.010
Decision letter
-
Julia DeathridgeReviewing Editor; eLife, United Kingdom
-
Peter RodgersSenior Editor; eLife, United Kingdom
In the interests of transparency, eLife publishes the most substantive revision requests and the accompanying author responses.
Thank you for submitting your article "The Effect of COVID-19 on the Postdoctoral Experience: a comparison of pre-pandemic and pandemic surveys" to eLife for consideration as a Feature Article. Your article has been reviewed by three peer reviewers, and the evaluation has been overseen by two members of the eLife Features Team (Julia Deathridge and Peter Rodgers). None of the reviewers wished to reveal their identity.
The reviewers and editors have discussed the reviews and we have drafted this decision letter to help you prepare a revised submission.
Summary:
This study investigates the impact of the COVID-19 pandemic on postdocs in the United States. Schwartz and colleagues surveyed 1,722 postdocs across 300 institutes in 2020 (during the second wave of the pandemic), and compared the results to a previous survey they conducted in 2019, which includes responses from almost 6,000 postdocs. The data revealed that the pandemic had widespread impacts on the mental health, research productivity, and career trajectories of postdocs. Particular demographic subgroups also faced additional burdens. Some of these challenges were less prevalent for respondents who had access to a Postdoctoral Office or Postdoctoral Affairs Association at their institution. However, there are a number of points that need to be addressed to make the article suitable for publication.
Essential revisions:
1) The results section is very detailed which makes it difficult to identify the main findings of the survey. To make the results easier to follow, please can you split this part of the manuscript into more sections (particularly the part on COVID-19 impact: lines 119-219) and give each subsection a heading summarizing the finding that is the most important. For example,
– lines 136-152 could fall under the heading "Postdocs with access to PDOs were more satisfied with their institution's response to the pandemic"
– lines 251-281: "Postdocs with access to mental health resources were more likely to have their basic needs met"
– Lines 284-298: "Postdocs were less confident in achieving their career goals than before the pandemic"
This may require changing the order in which some of the results are discussed so that those reporting on a related topic are more clearly grouped together. For example, all the data about the benefit of PDOs/PDAs could be grouped into a single section, and the data on basic needs (lines 153-162 and 209-219) could also be grouped together.
The above examples are not exhaustive and are just suggestions. Please use your own judgment to decide which findings to group together and the main result you would like to highlight in the relevant subheading.
2) The discussion frequently restates the results rather than interprets them (for example: Page 17, Lines 351 to 357; Page 18, Lines 375-378, 379-380; and Page 19, Lines 398-403, 406-407).
Please reduce these repetitions and expand on the points listed below:
i) As pointed out in line 364, there have now been a few reports about the pandemic's effect on the workforce, including postdocs. How does the data fit with this literature, and altogether what is the takeaway message with respect to the new findings presented here? How do you interpret the demographic differences observed?
ii) How the challenges faced by postdocs compare to the rest of academia.
iii) In Line 409 - Can you be more specific about "hints of long-term consequences"? What are you suggesting would be the long-term consequences of reduced productivity, delayed job searches, etc?
iv) Do your data speak to irreversible trends that will impact the workforce, or rather do they suggest areas where specific interventions could be impactful/warranted? What are the future directions of this work?
v) Were there any positive impacts of the pandemic?
3) Please add a Limitations section which should include the following points (as well as lines 379-393 in the Discussion):
i) The pandemic was experienced very differently and at different times among different geographic locations in the United States. There is no mention of this or how it may affect the conclusions of the manuscript since this is not a nationally representative sample of postdocs.
ii) The impact of the pandemic was different for postdocs in different fields. For example, basic scientists who had their labs shut down were in very different situations than biostatisticians who could more easily continue to work from home
iii) Potential for response bias. Because the pandemic survey was only sent to those who provided email addresses, it raises concerns that the people who responded were inherently different than those who did not provide an email address. Additionally, people who were unemployed may have been more likely to spend time answering the pandemic survey than those who were employed
iv) A main take home that the authors point out is that the presence of Postdoc Offices or Postdoc Associations as a positive impactor on some challenges faced by responders. However, based on the current study this claim is only correlative. For example, it is unclear if the respondents had accessed their local PDO/PDA or had just heard of them. Furthermore, various other contributors are also not included in the present study, such as type of institution (availability or abundance of resources, personnel dedicated to postdoc affairs, budgets, etc.), geographical location of the institution, number of postdocs within the institute, location of PDO (university-wide or college-specific), disciplinary area of research, and community and camaraderie among colleagues.
4) The article concludes that the pandemic profoundly impacted the career trajectories of postdocs. However, the long-term impact of the pandemic on the career trajectories of postdocs is not clear from the current data, since the survey results only represent a single snapshot in time during the first year of the pandemic.
Please can you tone down this statement and include the caveat that the current data only represents a snapshot in time. Furthermore, are there any other studies that support this claim?
5) Please update the definition for underrepresented that is used in this manuscript and analyses (pages 22-23) so it is consistent with the NIH definition: https://diversity.nih.gov/about-us/population-underrepresented.
6) The paper contains a number of univariate analyses. Please can you indicate whether or not you adjusted your p-values for multiple comparisons?
7) Figure 1 - figure supplement 1: In C, D, E the bar heights don't match the number labels (%)- e.g. all bars that say 1% should be the same height, bars that say 2% should be the same height, bars that say 0% should be the same height, bars that say 4% should be the same height. The bar marked 8% in panel D doesn't match where 8% would be on the y axis, etc. Please double-check the data and replot or relabel as appropriate.
8) Your analyses could be strengthened by using multivariate ordinal logistic regression models and/or logistic regression models. On page 9, line 168, you state that the majority of Asian post-docs were international and more likely to have unmet healthcare needs. If you created a multivariate logistic regression model, the reader would be able to determine whether race or international status (and other factors) were independently associated with unmet needs. Please consider doing this for some or all of the analyses; however, we do not insist on this.
9) Fig 5D/Supplemental Fig 5: it would be interesting to see what these data look like by gender, particularly as it appears to be a general national trend that women are leaving the workforce at higher rates and experiencing particular challenges balancing family and career. Again, please consider doing this analysis; however, we do not insist on this.
https://doi.org/10.7554/eLife.75705.sa1Author response
[Editor’s note: Further changes were made following revisions to the manuscript in response to queries and discussions with the editor. As a result, some of the comments below may differ from the published version of the article.]
Essential revisions:
1) The results section is very detailed which makes it difficult to identify the main findings of the survey. To make the results easier to follow, please can you split this part of the manuscript into more sections (particularly the part on COVID-19 impact: lines 119-219) and give each subsection a heading summarizing the finding that is the most important. For example,
– lines 136-152 could fall under the heading "Postdocs with access to PDOs were more satisfied with their institution's response to the pandemic"
– lines 251-281: "Postdocs with access to mental health resources were more likely to have their basic needs met"
– Lines 284-298: "Postdocs were less confident in achieving their career goals than before the pandemic"
This may require changing the order in which some of the results are discussed so that those reporting on a related topic are more clearly grouped together. For example, all the data about the benefit of PDOs/PDAs could be grouped into a single section, and the data on basic needs (lines 153-162 and 209-219) could also be grouped together.
The above examples are not exhaustive and are just suggestions. Please use your own judgment to decide which findings to group together and the main result you would like to highlight in the relevant subheading.
We would like to thank the reviewer for these comments and giving us the opportunity to clarify the Results section. The Results section was edited, and additional headings were added:
“COVID-19 Impact on Postdoc Well-being” New line: 121-157
“Institutional Responses to COVID-19 and Impact of PDAs and PDOs” New line: 158-175
“Meeting Basic Needs During the Pandemic” New line: 176-239
“Effect of Institutional Support on Mental Health and Wellness” New line: 255-295
For consistency, topic headings rather than conclusion statements were used for the headings.
2) The discussion frequently restates the results rather than interprets them (for example: Page 17, Lines 351 to 357; Page 18, Lines 375-378, 379-380; and Page 19, Lines 398-403, 406-407).
Please reduce these repetitions and expand on the points listed below:
Repetition of the Results in the conclusion section was initially included to emphasize the key findings, but we acknowledge that this is redundant. In order to reduce repetition and improve the focus and flow of the Discussion, we deleted:
Lines 354-357 (original/submitted version)
“Unsurprisingly, given that the pandemic survey was conducted in a subset of the pre-pandemic survey, the demographics were comparable between the two surveys, with the exception of the respondents being older and further along in their careers, as expected.”
Lines 379-380 (original/submitted version)
“As previously indicated, this survey provides a unique “before-and-during” opportunity to observe the effects of COVID-19 on postdoctoral life.”
Lines 401-403 (original/submitted version)
“Here we’ve shown that nearly a quarter of all postdocs felt that their mental health needs were unmet during the pandemic and just as unsettling, a non-negligible proportion struggled with access to food (2%) and healthcare (7%).”
Lines 406-407 (original/submitted version)
“Moreover, respondents that were no longer in postdoctoral positions due to the pandemic had higher rates of unemployment. We did not collect detailed information about these former postdocs and more follow-up studies are needed to track their outcomes.”
We also moved lines 375-378 (original/submitted version) to the Results section (New lines 127-130).
“2,768 comments were collected in total, which further demonstrates the impact of the pandemic on the postdoctoral population.”
i) As pointed out in line 364, there have now been a few reports about the pandemic's effect on the workforce, including postdocs. How does the data fit with this literature, and altogether what is the takeaway message with respect to the new findings presented here? How do you interpret the demographic differences observed?
To acknowledge several new reports on the impact of the pandemic on the STEM workforce, additional references have been added to the Discussion. Our findings highlight the importance of institutional resources for the mental health and well-being of the postdoctoral population. This is our main takeaway message – “As we22 and others have previously reported, postdocs are an often overlooked and forgotten population in academia, with a non-negligible number of institutions being unaware of their total postdoc population, let alone the concerns of postdocs. Access to employee benefits varies widely1-3, with untoward consequences for postdocs who lack access to certain essential services. In a position that emphasizes sacrifice for research, institutions should be more proactive in discerning the basic needs of their postdocs, and make appropriate resources and benefits available, including access to paid family leave, healthcare, mental health and wellness services for the postdocs and their families, as well as affordable childcare options. Offices of Postdoctoral Affairs are the appropriate institutional entities to ensure that postdocs’ minimal basic needs are met and should assume responsibility for coordinating and disseminating these essential benefits.” (New lines 445-455) and we have highlighted this further in the Discussion.
(New lines 377-382)
“As is apparent from our survey, access to institutional resources like PDAs and PDOs is important not only for the ability of postdocs to complete their work in safe and supportive environments, as is often the focus of institutional efforts, but also for their mental and physical wellbeing. This intriguing correlation between postdocs’ satisfaction with their institution's response to the pandemic, and specifically whether their mental health needs were met, are important aspects that need further examination.”
We found few demographic differences especially with abilities to meet different basic and mental health needs during the pandemic. While these point towards an alarming trend, it would be premature for us to interpret any demographic differences observed. We hope that our work will encourage future studies to explore the long-term effects of the pandemic on specific demographics.
ii) How the challenges faced by postdocs compare to the rest of academia.
This is an important discussion point and we appreciate the reviewers giving us the opportunity to expand beyond our focus on the burdens of postdocs. Additional references were added to the Introduction and Discussion in order to emphasize the challenges faced by postdocs and others in the academic environment.
New lines (22-25):
“The COVID-19 pandemic has only made this status worse for postdocs due to lab closures, rotating (work) schedules, hiring and salary freezes, etc.; and especially for postdocs with families since school and daycare closures significantly disrupted research continuity 4,5.”
New Lines (362-363):
“Although there have been multiple reports of the pandemic’s impact on the STEM workforce13-16,24-27 few have discussed postdocs specifically21,27.”
iii) In Line 409 - Can you be more specific about "hints of long-term consequences"? What are you suggesting would be the long-term consequences of reduced productivity, delayed job searches, etc?
This is a very important question, which deserves further attention, and new text and references were added to suggest potential long-term effects. Our intent is to follow up on these outcomes in future studies to directly address the outcomes as the pandemic subsides.
New Lines (386-396):
“These experiences, especially combined with the frequently reported increase in mental health concerns, may result in more postdocs becoming disenchanted with their career trajectories. The long-term effects of the pandemic on the postdoctoral population, however, are unclear from our data, which was only conducted over a short period of time during the pandemic and further studies are needed to assess how the pandemic ultimately affected career trajectories. Although it is difficult from current data and probably premature to predict irreversible trends: the recent study 28 on the previously discussed gender gap in academic publications during the pandemic 29-40 suggests that long-term outcomes may be more nuanced than previously reported. While we are barely out of the COVID-induced disruptions, some glimpses of positive changes are beginning to come forth 41-43.”
iv) Do your data speak to irreversible trends that will impact the workforce, or rather do they suggest areas where specific interventions could be impactful/warranted? What are the future directions of this work?
Please see point iii above, that also addresses irreversible trends. Suggestions for future studies, which we plan to pursue, have been added in several paragraphs in the expanded limitations section.
New lines (377-382):
“As is apparent from our survey, access to institutional resources like PDAs and PDOs is important not only for the ability of postdocs to complete their work in safe and supportive environments, as is often the focus of institutional efforts, but also for their mental and physical wellbeing. This intriguing correlation between postdocs’ satisfaction with their institution's response to the pandemic, specifically whether their mental health, childcare and basic needs were met, are important aspects that need further examination.”
New lines (402-406):
“Since PDOs often provide professional development programming, etc., these findings suggest a potential reason why postdocs nationally were significantly more satisfied in the presence of these institutional assets, which would have been responsible for enhanced remote programming; again, an important factor that deserves more exploration.”
New lines (433-435):
“We chose a period (Fall 2020) when the urgency and uncertainty of the initial shutdown period had lessened. However, this only provides a small snapshot in time during the pandemic.”
New lines (436-441):
“We also did not directly analyze how the experience varied for postdocs in different fields. Some postdocs were likely able to transition readily to remote work for a period of time, with little to no disruption to their research (e.g., Biostatisticians), while others may have had their research productivity significantly hindered or disrupted due to limited access to their laboratories. These are all important factors that will need to be evaluated in future studies.”
v) Were there any positive impacts of the pandemic?
Although we would not necessarily suggest that the pandemic had any positive impacts, there were some noted examples where the consequences of the pandemic resulted in positive changes. To address this question, we have added potential positive impacts and additional references for context to the Discussion.
New lines (442-444):
“Lastly, further studies should also ascertain whether the pandemic had any positive impacts on postdocs, such as the ability to continue to work remotely under certain circumstances or make new professional connections via video conferencing, etc.8,41-43.”
New lines (394-402):
“While we are barely out of the COVID-induced disruptions, some glimpses of positive changes are beginning to come forth 41-43. As an example, in order to mitigate isolation and perpetuate a learning environment when labs shut down in early 2020, institutional entities responsible for professional skill-building and career-promoting programming pivoted to remote platforms with some interesting outcomes16. For instance, remote sessions now appear to be not only acceptable, but may even be preferred by trainees, as they are more accessible, provide more efficient use of time and offer flexibility (such as having the possibility to watch recorded sessions later)16.”
3) Please add a Limitations section which should include the following points (as well as lines 379-393 in the Discussion):
We thank reviewers for noting that our previous limitations section was not clear enough, thus, we have expanded on the limitations section in the Discussion as requested. Please see details below.
i) The pandemic was experienced very differently and at different times among different geographic locations in the United States. There is no mention of this or how it may affect the conclusions of the manuscript since this is not a nationally representative sample of postdocs.
This reviewer’s comment is valid as the pandemic has had a wide range of consequences individually. Although we were underpowered to do analyses based on geographic location within the US, we did limit the window of response to just a 1-month period so that responses would be more reflective of a specific point in time in the pandemic. Additionally, all of these variables have now been included in the Discussion as requested.
New lines (424-436):
“Individual pandemic experiences varied greatly throughout the pandemic, undoubtedly influenced by factors such as geographic location, type of institution, timeframe within the pandemic, caregiving responsibilities, and type of research which was amenable to remote work. Our study did not assess whether there was an unequal distribution of the effects across the country based on geographic location or type of institution (for example, an institute with more resources, budget, and personnel dedicated to postdoc affairs vs. others) within the United States. Nevertheless, we did capture responses from postdocs across the US, with higher response rates in locations that we expect would have more postdocs, such as on the East Coast and in California (Figure 1 - supplementary figure 1A-B). We chose a period (Fall 2020) when the urgency and uncertainty of the initial shutdown period had lessened. However, this only provides a small snapshot in time during the pandemic. Unfortunately, there have been successive waves of the pandemic, the effects of which will require further exploration.”
ii) The impact of the pandemic was different for postdocs in different fields. For example, basic scientists who had their labs shut down were in very different situations than biostatisticians who could more easily continue to work from home
We acknowledge this important variable which is now mentioned in the discussion.
New lines (436-441):
“We also did not directly analyze how the experience varied for postdocs in different fields. Some postdocs were likely able to transition readily to remote work for a period of time, with little to no disruption to their research (e.g., Biostatisticians), while others may have had their research productivity significantly hindered or disrupted due to limited access to their laboratories. These are all important factors that will need to be evaluated in future studies.”
Furthermore, as mentioned above, we acknowledge that individual, institutional and regional differences in COVID response have made the pandemic a very different experience for everyone involved. It is our hope that by including quotes of individual responses to open-ended questions in the survey, we address these wide ranges of experiences.
iii) Potential for response bias. Because the pandemic survey was only sent to those who provided email addresses, it raises concerns that the people who responded were inherently different than those who did not provide an email address. Additionally, people who were unemployed may have been more likely to spend time answering the pandemic survey than those who were employed
As with any survey-based research, response bias is a concern, and it is possible that certain aspects of these results may be skewed. However, given that the second survey was conducted in a subset of those individuals who responded to the initial survey and analyses were primarily conducted as comparisons between the two surveys, we anticipate that potential bias will be mitigated in our study design. Furthermore, to clarify, 5,594 email addresses were collected in 2019, representing over 89% of all survey respondents, thus the pandemic survey was distributed to the majority of pre-pandemic survey respondents. This is now clarified in the Methods section (lines 454 and 466 in the original/submitted version). Many emails “bounced” -likely due to postdocs having left their institution by the time the pandemic survey was issued–and we were unable to follow up with these respondents. Those respondents who were no longer postdocs, whether they were newly employed in positions other than as a postdoc or unemployed, were analyzed separately in a different section of the results. This has been clarified in the Results and Methods sections.
New lines (498-500):
“All responses were collected anonymously, but most respondents (5,594 (89%)) voluntarily provided contact information…”
New lines (509-516):
“All postdocs who completed the initial pre-pandemic survey and submitted their email addresses for recontact (5,594 total postdocs) were asked to complete this second pandemic survey, which was launched on October 1, 2020 and was only open for one month. Many emails bounced, suggesting that many postdocs from the previous cohort had defunct addresses. In total, 1,942 responses to the pandemic survey were collected. Of these responses, 1,722 (88.6%) were submitted by researchers currently in postdoctoral positions in the United States, and these responses are analyzed here.”
iv) A main take home that the authors point out is that the presence of Postdoc Offices or Postdoc Associations as a positive impactor on some challenges faced by responders. However, based on the current study this claim is only correlative. For example, it is unclear if the respondents had accessed their local PDO/PDA or had just heard of them. Furthermore, various other contributors are also not included in the present study, such as type of institution (availability or abundance of resources, personnel dedicated to postdoc affairs, budgets, etc.), geographical location of the institution, number of postdocs within the institute, location of PDO (university-wide or college-specific), disciplinary area of research, and community and camaraderie among colleagues.
We agree with the reviewer that our findings are correlative, as are most survey-based research findings. We have addressed the text so that this is clear throughout the paper.
This sentence has been added to the discussion and the caveats are further discussed in the section that follows.
New lines (424-427):
“Individual pandemic experiences varied greatly throughout the pandemic, undoubtedly influenced by factors such as geographic location, type of institution, timeframe within the pandemic, caregiving responsibilities, and type of research which was amenable to remote work.”
As suggested by the reviewers, we agree that many other factors could have impacted how each postdoc experienced the pandemic and the presence of PDA/PDO is not the only positive impactor. It is also true that the presence of a PDA/PDO itself reflects the availability or abundance of resources, personnel, and budgets at an institute. Investigating these individual factors is beyond the scope of our present study and we have emphasized in the Discussion that future studies should address this issue. While we cannot conclude if our respondents had only heard of the resource or had actually used their resources, our correlative findings indicate that the presence of PDA/PDOs at the institute has had a positive impact during the pandemic. It highlights their importance, the work they do and resources they provide to enhance postdoc wellness, and institutions that do not already do so should dedicate budgets and personnel for these assets.
4) The article concludes that the pandemic profoundly impacted the career trajectories of postdocs. However, the long-term impact of the pandemic on the career trajectories of postdocs is not clear from the current data, since the survey results only represent a single snapshot in time during the first year of the pandemic.
Please can you tone down this statement and include the caveat that the current data only represents a snapshot in time. Furthermore, are there any other studies that support this claim?
There have not been any studies that we are aware of that have reported on how the pandemic has affected the career trajectories of postdocs, although there have been some reports on its consequences on faculty, which we have referenced. We have tempered this statement by adding the following sentence.
New lines (388-391)
“The long-term effects of the pandemic on the postdoctoral population, however, are unclear from our data, which was only conducted over a short period of time during the pandemic and further studies are needed to assess how the pandemic ultimately affected career trajectories.”
5) Please update the definition for underrepresented that is used in this manuscript and analyses (pages 22-23) so it is consistent with the NIH definition: https://diversity.nih.gov/about-us/population-underrepresented.
The NIH definition for racial categories was used and is now cited in the Methods section as requested.
New lines (520-531)
“Participants were queried about their race and ethnicity with the following options: white/Caucasian, Asian/Asian American, South Asian/South East Asian, Black/African American, Hispanic/Latino, Middle Eastern, Native American or Alaska Native, and Pacific Islander or Hawaiian Native. For all analyses, due to low numbers of respondents, certain racial/ethnic categories were consolidated into three groups: (1) underrepresented minorities (URM) as defined by the NIH (https://diversity.nih.gov/about-us/population-underrepresented): Black or African American, Hispanic or Latino, Native American or Alaska Native, Native Hawaiian or Pacific Islander; (2), Asians (Asian/Asian American and South Asian/Southeast Asian); and (3) white (white/Caucasian and Middle Eastern). The NIH also defines those with disabilities (analyzed separately here) and those from disadvantaged backgrounds (this category was not queried in this study) to also be underrepresented in the biomedical, clinical, behavioral, and social sciences.”
6) The paper contains a number of univariate analyses. Please can you indicate whether or not you adjusted your p-values for multiple comparisons?
Based on comment number 8 below, we reanalyzed our data using multivariate analysis, including multiple variables in the model: Gender, Race and Ethnicity, Residency, LGBTQ status, having a disability, access to a PDO and access to a PDA. This allowed us to observe new results (see the response to comment #8) and avoid adjusting for multiple comparisons.
7) Figure 1 - figure supplement 1: In C, D, E the bar heights don't match the number labels (%)- e.g. all bars that say 1% should be the same height, bars that say 2% should be the same height, bars that say 0% should be the same height, bars that say 4% should be the same height. The bar marked 8% in panel D doesn't match where 8% would be on the y axis, etc. Please double-check the data and replot or relabel as appropriate.
We would like to thank the reviewer for identifying these discrepancies. More precise percentages were added in the figures to better match the y-axis. Please see updated Figure 1-figure supplement 1 C, D, E, F, G. Other supplementary figures were also modified for consistency (Figure 2-figure supplement 1, Figure 3-figure supplement 1, Figure 4-figure supplement 1 and Figure 5-figure supplement 1).
8) Your analyses could be strengthened by using multivariate ordinal logistic regression models and/or logistic regression models. On page 9, line 168, you state that the majority of Asian post-docs were international and more likely to have unmet healthcare needs. If you created a multivariate logistic regression model, the reader would be able to determine whether race or international status (and other factors) were independently associated with unmet needs. Please consider doing this for some or all of the analyses; however, we do not insist on this.
We would like to thank the reviewers for these suggestions. We re-analyzed our data using either a multivariate logistic regression model or a multivariate ordinal logistic regression model, when appropriate. The majority of the results were strengthened, and we also observed newly significant ones. The new results are now specified in the Figure legends for Figure 2F; Figure 2- Figure supplement 1 A; Figure 3A; Figure 3- Figure supplement 1 A, B, C, D; Figure 4
New significant results:
Figure 2 F, having access to a PDA significantly impacted having mental health needs met.
Figure 4E-F, a smaller portion of postdocs unaware of mental health resources had their mental health needs or all their basic needs met.
We also added new supplementary Figures due to new findings:
Figure 2 Figure supplement 1 B. Using the multivariate logistic regression model, we observed significantly unmet basic needs based on LGBTQ status.
Figure 2 Figure supplement 1 C. Using the multivariate logistic regression model, we observed significantly unmet basic needs based on disability status.
Figure 3 Figure supplement 1 C and D. Using the multivariate logistic regression model, we observed significant differences in Immigration concerns according to race and ethnicity (C) and LGBTQ status (D).
Figure 5 - Supplementary 1C-D: Significant results according to geographic constraints
Some results did not remain significant, mainly due to confounding and were removed from the paper.
Figure 2 D, postdoc unaware of PDO did not significantly differ from postdoc with a PDO regarding satisfaction of an institutional response.
Figure 2F, having access to a PDA did not impact having all basic needs met when using the multivariate analysis.
Figure 3A, no more significant differences between citizenship status and health care needs met. The effect was driven by Asian postdocs.
Figure 4B, no difference observed between non-binary/third gender and male for the impact on mental health and use of institutional resources.
Figure 4B, no significant differences were observed according to residency.
Figure 4B, Postdocs with disabilities did not use more mental health resources.
Figure 4H, Postdocs having access to a PDA and using mental health resources is not significant anymore.
Figure 4- Supplementary 1, Postdocs unaware of mental health resources did not differ significantly from those having access according to food and health care needs met. The postdocs with no access to mental health resources remains significantly different from the ones that have access to these resources.
Figure 5 - Supplementary 1C, no more difference according to peer pressure, was confounded with residency status
Figure 5 - Supplementary 1E, no more difference in job market perception according to race/ethnicity. The figure was removed.
We also added the models in the method section.
New lines (534-544)
“To assess similarities between the pre-pandemic and pandemic surveys, we used the Chi-square test in the presence of categorical data (basic R function). We used the same test to assess the postdocs who transitioned out of their position during the pandemic, due to the lack of additional data available for this group. For the other analyses, we performed multivariate tests including gender, race and ethnicity, residency, LGBTQ status, having a disability, access to a PDO and access to a PDA as covariates. To assess differences, we used either ordinal logistic regression in the presence of ordinal dependent variables (using the R package “MASS”), logistic regression (basic R function) and multinomial logistic regression (using R package “nnet”) accordingly. Results are described in the legend as Odds Ratio (OR) [95% Confidence Interval (CI)] with the p-value.”
9) Fig 5D/Supplemental Fig 5: it would be interesting to see what these data look like by gender, particularly as it appears to be a general national trend that women are leaving the workforce at higher rates and experiencing particular challenges balancing family and career. Again, please consider doing this analysis; however, we do not insist on this.
Fig 5D showed that a large % of postdocs changed their career plans (34%) of which the majority was due to the pandemic. However, these changes in plans did not differ by gender.
These results were mentioned in our final sentence of the paragraph.
New lines (327-329):
“Lastly, no differences were observed by gender or identity groups with respect to reasons for changing career trajectory (Multivariate logistic regression, p>0.05, data not shown).”
Additionally, no differences by gender were observed for reasons for changing career trajectory (New lines 333-334), or job market perception change (New lines 327-329).
https://doi.org/10.7554/eLife.75705.sa2Article and author information
Author details
Funding
Fond de recherche du Quebec en Sante (Postdoctoral fellowship)
- Andréanne Morin
National Institute on Drug Abuse (Grant Number T32DA043469)
- Seetha Krishnan
The funders had no role in study design, data collection and interpretation, or the decision to submit the work for publication.
Acknowledgements
We thank Dr. Valerie Miller (UIC) for her assistance with the 2019 survey instrument design and dissemination; the Future of Research directors for suggesting the inclusion of mental health and wellness queries in the survey; and we are especially grateful to Drs. Erin Heckler (Yale University) and Imogen Hurley (UW Madison) for valuable comments. We are very grateful to the many Postdoctoral Associations, administrators, faculty directors, and others who helped distribute our survey to postdocs across the country. Finally, we wish to especially express our gratitude to the postdocs who shared their experiences with us by participating in the surveys.
Ethics
Participation in this survey was completely voluntary. In the introduction to this survey, we informed the participants of its purpose, and that results of the survey would be disseminated, in aggregate. All responses were recorded in a secure RedCap Database, so they could not be traced back to individual respondents. Responses were combined for data analysis to maintain respondent anonymity throughout data analysis. Our survey design and dissemination protocol was approved by the University of Chicago Institutional Review Board, IRB Protocol Number 15-1724.
Publication history
- Received:
- Preprint posted:
- Accepted:
- Version of Record published:
Copyright
© 2022, Morin, Helling, Krishnan et al.
This article is distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use and redistribution provided that the original author and source are credited.
Metrics
-
- 2,335
- views
-
- 226
- downloads
-
- 14
- citations
Views, downloads and citations are aggregated across all versions of this paper published by eLife.