Get 20M+ Full-Text Papers For Less Than $1.50/day. Subscribe now for You or Your Team.

Learn More →

The trade-off between graduate student research and teaching: A myth?

The trade-off between graduate student research and teaching: A myth? Many current faculty believe that teaching effort and research success are inversely correlated. This trade-off has rarely been empirically tested; yet, it still impedes efforts to increase the use of evidence-based teaching (EBT), and implement effective teaching a1111111111 a1111111111 training programs for graduate students, our future faculty. We tested this tradeoff for a1111111111 graduate students using a national sample of life science PhD students. We characterize a1111111111 how increased training in EBT impacts PhD students' confidence in their preparation for a a1111111111 research career, in communicating their research, and their publication number. PhD stu- dents who invested time into EBT did not suffer in confidence in research preparedness, scientific research communication, or in publication number. Instead, overall, the data trend towards a slight synergy between investing in EBT and research preparation. Thus, OPENACCESS the tension between developing research and teaching skills may not be salient for today's Citation: Shortlidge EE, Eddy SL (2018) The trade- graduate students. This work is proof of concept that institutions can incorporate training off between graduate student research and in EBT into graduate programs without reducing students' preparedness for a research teaching: A myth? PLoS ONE 13(6): e0199576. career. Although some institutions already have graduate teaching programs, increasing https://doi.org/10.1371/journal.pone.0199576 these programs at scale, and including training in EBT methods could create a new ave- Editor: Etsuro Ito, Waseda University, JAPAN nue for accelerating the spread of evidence-based teaching and improved teaching across Received: March 6, 2018 higher education. Accepted: June 8, 2018 Published: June 25, 2018 Copyright:© 2018 Shortlidge, Eddy. This is an open access article distributed under the terms of the Creative Commons Attribution License, which Introduction permits unrestricted use, distribution, and reproduction in any medium, provided the original In recent decades, a multitude of organizations have challenged institutions of higher educa- author and source are credited. tion to increase student retention in science, technology, engineering and mathematics Data Availability Statement: All relevant data are (STEM) [1±3]. One path to achieving this goal is to increase implementation of the teaching within the paper and its Supporting Information practices that research has largely found to be effective for students. These practices are typi- files. cally student-centered, and may be referred to as ªactive learningº or, more broadly, ªevi- Funding: The authors received no specific funding dence-basedº [2, 4±6]. Despite this national push, scant evidence has been found of systemic for this work. movement in faculty teaching practices towards evidence-based teaching (EBT), and, instead, many barriers to change have been identified [7±14]. Although it is critical to continue work- Competing interests: The authors have declared that no competing interests exist. ing with current faculty on EBT, a complementary effort to increase the use of EBT by future PLOS ONE | https://doi.org/10.1371/journal.pone.0199576 June 25, 2018 1 / 13 The trade-off between graduate student research and teaching: A myth? faculty, current graduate students, has the potential to accelerate the adoption of these prac- tices nation-wide. Some institutions offer training in EBT that graduate students can opt into if they are aware of the options. These opportunities might include short 1-hr workshops, concentrated `teach- ing boot-camps', and semester long courses [15, 16]. Unfortunately, short trainings seem to have limited effectiveness for changing teaching practices [16±18]. Effective training programs generally require a substantial time commitmment of a semester or more [10, 19±21]. Empiri- cal examples of the impact of more extensive training is relatively sparse, but all suggest the same pattern. In one study, researchers implemented a GTA training focused on leading inquiry labs and found GTAs self-reported improved teaching skills as a result [22]. PhD stu- dents in a multi-year fellowship program run by the National Science Foundation reported improvement in their use of student-centered teaching [21, 23]. Similarly, a year-long program focused on effective teaching practices found 68% of participants reported improvement through the program [24]. Connolly et al. recently found graduate students that engaged in extended training, especially formal courses, described increased self-efficacy in course plan- ning and teaching methods over other forms of teaching development [25]. Thus, the existing studies suggest these longer training programs in EBT can impact at least self-reported use of teaching practices by graduate students. Currently, many STEM departments do not structure substantial teaching development opportunities for graduate students into their graduate curriculum [24]. If departments do have mandatory trainings, they tend to focus on procedures and policies rather than pedagogy, let alone EBT methods [15, 17, 19, 26±29]. Departments may not embed longer-term pedagog- ical training into their doctoral programs because of a pervasive perception of a tension between research and teaching in the sciences [19]. This belief is characterized by the assump- tion that any time spent teaching, or even learning about teaching methods, will take away from research productivity for faculty [14, 17, 30, 31] and graduate students [30, 32]. Research is prioritized in this trade-off, and this prioritization is reinforced by institutional incentiviza- tionÐresearch brings in grant money, publications, and prestige that are all emphasized in the promotion and tenure process over teaching. Thus, research is commonly viewed as where more time should be spent [17, 32±34]. Although pervasive, this trade-off has rarely been empirically evaluated, and where it has been, the results are mixed. Meta-analyses of the existing research investigating trade-offs between research and teaching found no consistent patternÐat least for faculty [31, 35]. Yet, despite this lack the evidence, the perception of a tension between how academics should be spending their time persists [14, 31, 35±43], and is likely passed down to graduate students through their advisor and/or departmental culture [19, 32]. This perception of a tension between research and teaching has at least two potential costs. The first is that by not offering graduate students training in EBT, the spread of EBT practices is slowed. The second is a potential cost to the students themselves. In the United States alone thousands of graduate students earn doctorate degrees each year. In 2016, of these newly minted PhDs, 45% of them where employed in academia [44], indicating an intent to pursue a career in academia which will likely have a teaching component. Even PhDs who ultimately seek a tenure-track position at research-intensive intuitions find themselves in jobs that involve much more than just being proficient at research [32, 37, 45±48]. This point is highlighted in the oft-cited The Priorities of the Professoriate report [37], which called for a characterization of the role of faculty to encompass a more holistic vision of scholarship among academic faculty, which includes excellence in teaching. Focusing graduate student training exclusively on research may underprepare these future faculty for the reality of the complex roles faculty members assume, including spending a significant amount of teaching. PLOS ONE | https://doi.org/10.1371/journal.pone.0199576 June 25, 2018 2 / 13 The trade-off between graduate student research and teaching: A myth? This under-preparedness is already being felt by some graduate students as illustrated by bio- medical postdoctoral scholars reporting that their graduate programs did not provide them with adequate career training and support [49]. Thus, the potential costs of not training graduate students in evidence-based teaching are clear, but is there a trade-off for incorporating teaching development programs into graduate training? Does it hurt their preparedness for a research career? Little work has been done to quantify how graduate students actually invest their time and the impacts of these investments on their progress. One study empirically tested how time spent as a Graduate Teaching Assis- tant (GTA) related to a student's ability to write a research grant proposal, and found that stu- dents who spent time teaching actually had improved proposal writing skills over those that did not teach [50]. Yet, this study tested impacts of time spent on teaching, not the amount of time spent on learning to teach well. In the current study, we explore the hypothesis that there is a trade-off between PhD stu- dents investing in EBT and being prepared for a research career in academia. We use the term `invest' in EBT because time is consumed when seeking out and gaining training in EBT, and this time is often separate and in addition to time spent as a GTA. We focus on life science PhD students as the life sciences consistently award the greatest number of PhDs across the STEM disciplinesÐin 2016 23% of all earned doctorates were in the life sciences [44]. We test for a potential trade-off between research and teaching for life science PhD students by investi- gating three interrelated proxies for preparedness for a research career: confidence that their PhD training program has prepared them to be a researcher, confidence in their ability to communicate their research, and the number of peer-reviewed publications students have pro- duced to date from their PhD work. We chose these three indicators because they have reper- cussions for retention in research careers in academia. Confidence in one's research and communication skills are critical components of a successful research career [37, 51±54]. The number of publications a student has out of their PhD is also a significant predictor of long term success in academia [55, 56]. Following the pervasive notion of an antagonism between research and teaching, one could assume that if PhD students invest in EBT training, they will not be as prepared for an academic research career as those who focus less time on training in teaching, and more on research. Here we test for this potential trade-off. Materials and methods Life Sciences Graduate Student Survey For this study, life science PhD students were recruited online to complete the Life Sciences Graduate Student Survey, (LSGSS, S1 Fig). The LSGSS was designed to gauge graduate stu- dents' self-reported awareness of, training in, and use of evidence-based teaching methods, as well as report their confidence and training in a variety of tasks and experiences one might have as a graduate student in the life sciences related to research, teaching, and communica- tion. The LSGSS underwent iterative validity measures to establish that the items on the instru- ment measure the intended constructs [57, 58]. Members of two education research groups as well as multiple STEM graduate students vetted survey items for validity through think-aloud interviews and by piloting the survey and receiving feedback. Based on item feedback, ambigu- ous questions or unclear wording was addressed and modified for the final instrument. Gradu- ate students were not compensated for participating in the survey and their responses were not linked to their name or other identifying information. The study was approved by the Portland State University IRB (#163844). EBT practices index. Participants reported the training they received in eight common EBT practices in their current graduate program on a four point Likert scale ranging from no PLOS ONE | https://doi.org/10.1371/journal.pone.0199576 June 25, 2018 3 / 13 The trade-off between graduate student research and teaching: A myth? training (1), observation only (2), a little training (3) to lots of training (4). The practices were chosen based on existing surveys that had been used to determine faculty familiarity with EBT [8]. Because of confusion among participants during think-aloud interviews, several of the initial practices were removed. The final set of EBT practices were presented with written definitions for each practice in the survey, and included: case studies, clickers, concept maps, course-based undergraduate research experiences, discussion-based instruction/Socratic method, flipped classroom, problem-based learning and/or inquiry-based learning, process oriented guided inquiry learning (POGIL), learning assistants, and think-pair-share. Finally, before analysis we removed the learning assistant item and the course-based undergraduate research experience. These showed lower levels of training then any of the other items and unlike the other practices, these lower responses could be driven by institutional differences. If an institution did not support course-based undergraduate research experiences, or a learning assistant program than there would be no reason for training to be offered in it. We summed student responses on the final 8 items to form an index of their training in EBT. Both observation and no training responses were scored as 0, because they did not repre- sent investment in formal training. A little training was coded as 1 and A lot of training was coded as 2 to indicated the added time investment this might indicate. Thus, a student with a four for training in EBT could have a little training in four practices, a lot of training on two practices, or a little training on two and a lot of training on one. Our index cannot separate these scenarios, but it does tell us that a student with an index value of four likely invested more time in training than a student with a one (a little training in one practice). The training in EBT index ranged from 0 to 15 (likely representing a lot of training in 7 of the 8 practices and a little training in 1; S1 Fig). The mean in the sample was 3 ± 3.4 (sd) indi- cating a little training in three practices or a lot of training in one practice and a little training in one other practice. Outcome variables. The outcome measures of interest were three indicators of a PhD stu- dent's preparation for a research career: confidence in their research training, and confidence in ability to communicate their research, and publications out of their PhD to date. Survey items regarding research and science communication preparedness were modified from a sur- vey measuring the career goals and choices of biomedical postdoctoral scholars [49]. Students answered four Likert-type items regarding their confidence that their graduate training has adequately prepared them to pursue a research career including: writing grant proposals, writing peer-reviewed scientific journal articles, running a research lab, and collab- orating on research with individuals of other scientific disciplines. Each individual item had four possible responses ranging from `not at all' to `definitely' adequately trained. We summed student response on the individual questions to create an index of confidence in research training. We created an index instead of considering these items part of a scale that could be averaged because we do not expect students to answer the same way on all the individual items. For example, despite both items representing an aspect of research preparation, it is pos- sible a student could report high confidence in their training in grant writing, but not running a research lab. The research confidence index could range from 4 (no confidence in any aspect of research training) to 16 (absolute confidence in all aspects of research training). The mean response on this index was 11.4 ± 2.6 (S2 Fig). Students answered three Likert-type items about their confidence communicating their research to other scientists in a professional setting, other scientists in an informal setting, and non-scientists in informal settings. These questions had four response options ranging from `not at all confident' to `very confident'. As with confidence in research training, we summed students' scores on these items to create a research communication confidence index. The index could range from 3 to 12. The mean student response was 9.3 ± 1.8 (S2 Fig). PLOS ONE | https://doi.org/10.1371/journal.pone.0199576 June 25, 2018 4 / 13 The trade-off between graduate student research and teaching: A myth? Finally, participants reported how many peer-reviewed research papers they have published to date from their current PhD program (regardless of authorship position) on a scale from 0 to 3 or more publications. Few students reported two publications, so we pooled this level with the 3+ publications category. Thus, the final outcome variable for number of publications had three levels: 0 publications, 1 publication, and two or more publications (S2 Fig) Control variables. To isolate the effect of training in EBT, we included several potential control variables related to a student's experience in graduate school. Participants reported the percent of financial support for their PhD that has come from being a GTA. This variable serves as a proxy for the proportion of their time spent teaching and thus not working on their research. Students also reported their year in the PhD program and whether or not they had previously earned a Master's degree. We expect both of these variables to impact confidence and publication number out of their PhD. Participant recruitment. Students were recruited through professional scientific society listservs, departmental listservs, and snowball sampling. The LSGSS was built using the Quali- trics online survey platform, and the survey link was available from June 2016 through August 2016. The survey was accessed by over 900 individuals and completed by over 500 individuals. Graduate students self-selected to take the survey (Table 1). Only individuals who consented for their responses to be used for research and completed the entire survey were kept in the data set. Description of study sample. Of the survey respondents 437 were our focal sample: PhD students. We further refined our sample by removing individuals who were in the first year of their PhD program (n = 73), as they have not been in their program long enough for learning about EBTs to have an opportunity to impact their research preparation. In addition, we removed anyone who had already earned a PhD in a different discipline as that experience would make them substantially different from students earning a PhD for the first time and they were too few in number to make this a control variable in the model (n = 17). Finally, we removed students who were seeking non-traditional biology PhDs such as biology education and science and society because we believed the relationships between research and learning about EBTs might be different for students pursuing research in traditional fields like microbi- ology or ecology. Again, the sample was too small (n = 9) to include this variable as a control. In summary, the analyses reported here include only the 338 PhD students studying tradi- tional life science research topics (i.e. not biology education, philosophy of science, etc.) who had already completed at least one year of their PhD program before taking the survey (Table 1). Overall, 8.2% of participants were underrepresented minorities and 9.2% did not Table 1. Participant demographics. Race/Ethnicity Year in PhD Program Career Goals Non-URM 83% 2 22% Research Faculty 30% URM 8% 3 25% Non-academic Research 29% NA 9% 4 18% Teaching Faculty 22% 5 19% Non-Research 12% Gender 6+ 17% Unsure 7% Female 58% University Type Age (years) Male 36% R1 72% < 27 38% NA 4% R2/R3 19% 27±30 25% Other 2% Other or NA 9% >30 37% Description of study sample (N = 338 life science PhD students). https://doi.org/10.1371/journal.pone.0199576.t001 PLOS ONE | https://doi.org/10.1371/journal.pone.0199576 June 25, 2018 5 / 13 The trade-off between graduate student research and teaching: A myth? respond to the race/ethnicity question or were undetermined. The majority of participants identified as female (58.3%), 1.8% were non-binary, and 3.6% did not respond to the question nd about gender. Participants represented a range of years in their graduate school (2 year: rd th th th 21.6%; 3 : 25.1%; 4 : 17.7%; 5 : 18.9%; 6 or higher: 16.6%). The majority of participants attended very high or high research institutions (72%), the remaining attended moderate research institutions/other institutions by Carnegie Classification of Institutions of Higher Education . Graduate students in the final sample represented 19 different sub-disciplines. The dominant three were: ecology (22.1%), cellular/molecular (17.6%), and evolutionary biol- ogy (16.2%). Our study sample is statistically indistinguishable from the life science graduate student population in the US [44] in gender, age, and institution type, but our sample consists of less underrepresented minority life science PhD students compared to national proportions (Chi squared = 34.32; p <0.0001). Model selection. We used linear regression models (outcomes: research preparedness and science communication), and the proportional log-odds model (outcome: publications), to characterize the relationships between the outcome variables, the controls (whether or not a student had a Master's degree, year in their programs, and proportion of financial support coming from teaching), and training in EBT. Model selection with Akaike's Information Crite- rion (AIC) was used to identify the subset of these variables that best fit the data. We started by fitting a complex model that included the control variables, training in EBT, as well as three interaction terms: 1) year in program and proportion of financial support coming from teach- ing, 2) financial support and training in EBT, and 3) year in program and training in EBT. We searched all possible combinations of these variables to identify the best-fit and most parsimo- nious models for the three outcome variables. All models were fit in R version 3.3.2 [58] using the MuMIn package [59]. Models with aΔAIC 2 or less are considered equivalent and models withΔAIC > 10 are poor predictors of the data. The models presented in the main body of the paper are the final best-fit and most parsimo- nious models. We report the 95% confidence set of models for each outcome variable in S1 Table. We then report the regression coefficients from the identified best models for each out- come variable in S2 Table. Results and discussion Investing in EBT does not reduce sense of being well-trained for a research career Increased training in EBT practices did not reduce students' confidence that their research training has adequately prepared them to be a researcher (Fig 1). Instead, there was a slightly positive relationship (β = 0.15 ± 0.042, t = 3.64, p = 0.0003). Thus, there is no support for the prediction that the time PhD students spend pursuing EBT practices negatively impacts how they perceive their preparedness to do research. Investing in EBT does not reduce confidence in ability to communicate research Student training in EBT increased student confidence in communicating their research (0.10 ± 0.029, t = 3.45, p = 0.0006, Fig 2). Interestingly, the amount of financial support from teaching was not selected to be included in the best models and even in the models it was in the term was not significant. Thus, it seems that teaching experience alone does not increase communication confidenceÐonly training in EBT allows students to reach this desirable outcome. PLOS ONE | https://doi.org/10.1371/journal.pone.0199576 June 25, 2018 6 / 13 The trade-off between graduate student research and teaching: A myth? Fig 1. Training in EBT predicts increased confidence in preparedness for a research career. The estimates illustrated in this figure derive from the best-fit linear regression model: Research training adequacy index ~ Training in EBT index (see model selection table S1 Table). Bars represent upper and lower 95% confidence limits around the predicted response. https://doi.org/10.1371/journal.pone.0199576.g001 Investing in EBT does not reduce publication number After controlling for whether a PhD student had previously earned a Master's degree and their year in a PhD program, there was no evidence for a relationship between training in EBT and the number of papers a PhD student had published to date (β = 0.04 ± 0.032, t = 1.32, p = 0.19, Fig 2. More training in EBT predicts increased confidence in communicating scientific research. The estimates derive from the best-fit linear regression model: Research communication index ~ Training in EBT index (see model selection table S1 Table). Bars represent upper and lower 95% confidence limits around the predicted response. https://doi.org/10.1371/journal.pone.0199576.g002 PLOS ONE | https://doi.org/10.1371/journal.pone.0199576 June 25, 2018 7 / 13 The trade-off between graduate student research and teaching: A myth? Fig 3. Investment in EBT is not detrimental to research productivity. Graduate student training in EBT does not significantly predict research productivity as measured by number of peer-reviewed publications from their PhD program to date. The estimates illustrated here are derived from the best-fit proportional log odds model controlling for year in program, and whether they already have a Master's degree. Bars represent upper and lower 95% confidence limits around the predicted probability. https://doi.org/10.1371/journal.pone.0199576.g003 Fig 3). These results indicate no support for the hypothesized trade-off between pursuing opportunities to learn about EBT practices during graduate school and a student's research productivity as measured by published papers. The trend actually hints at the potential for the opposite pattern: for each unit increase in a student's average training in EBT practices, they were 1.04 times more likely to have at least one additional paper. For example, students with the mean EBT training index had a 47% chance of having zero publications and students in the third quartile of the EBT training index (6.5) were slightly less likely to have zero publica- tions (43% chance). In higher education, there is widespread perception of an inevitable trade-off between being a productive researcher and investing time in teaching. Academic culture, graduate stu- dent mentors, and graduate students themselves may assume that these perceived trade-offs apply to graduate students [17, 19, 45]. Yet, the data presented here do not support this trade- off. Instead, our data support a different hypothesis: graduate students who invest in EBT can be just as competitive of researchers as those who do not make this investment. PLOS ONE | https://doi.org/10.1371/journal.pone.0199576 June 25, 2018 8 / 13 The trade-off between graduate student research and teaching: A myth? Training in EBT practices has been identified as key construct of a recommended frame- work for GTA training [18], and recent studies suggest that substantial training in EBT can result in the adoption of these practices. A study on the FIRST IV program for post-doctoral scholars demonstrated increased use of EBT after two-years in the professional development program [60]. Similarly, a study found that longer training programs, and especially semester long courses increased graduate student self-efficacy in EBT, and follow-up interviews with these students revealed the majority were employing these methods five years later [19, 25]. These studies, and several studies of teaching self-efficacy (e.g. [25], suggest that investing in these training programs can impact how graduate students teach). Further, there is beginning to be evidence that graduate students desire this training in EBT. Yet, training in EBT is typically not structured into the PhD training required by their department, and the types of professional development opportunities that result in persistent benefits are not widespread, even at the institutional level [16, 17, 19, 29, 32]. A national study of life science graduate students found that students who had participated in teaching profes- sional development often had to seek out those opportunities beyond their departments [19]. An interview study with a national sample of life science graduate students found similar results and discovered that while most participants had some formal teaching training, only a few claimed receiving substantial training in any student-centered strategies [29]. Yet, encour- agingly, 84% of participants saw value in EBT, the majority of which reported having the desire to use them in their own teaching. Together these findings suggest that if institutions invest in providing dedicated programs for graduate students to learn best practices in teaching, they will not be sabotaging graduate student research progress, but will be fulfilling a desire stu- dents have to learn the practices and potentially increase implementation of EBT in higher education. Given our results and those of studies described above, we propose an alternative hypothe- sis to the `trade-off' between teaching and research preparedness for graduate students: invest- ment in training in EBT may enhance graduate student preparedness for the multifaceted roles that faculty members play [32, 41, 46]. Not providing professional development in peda- gogy may undermine a PhD student's competitiveness relative to students who receive training or have chosen to seek out training independently, especially if the students research produc- tivity and confidence coming out of their PhD programs are otherwise comparable. Given that 38% of graduating PhDs (41% in the life sciences) in 2016 did not yet have definite employ- ment lined up, diversifying one's portfolio will certainly be key to an individual securing a position in academia, regardless of the specific requirements of that position. Limitations Self-report data has recognized shortcomings including that information can be both under- reported and/or inflated [61] In addition, our sample comes from a self-selecting student pop- ulation and, despite our sample being fairly representative of the demographics of life science graduate students nationally, it not represent the perceptions or experiences of the overall population of life science graduate students. In particular, in our study the students who engaged in training in EBT likely opted in, so our results may not generalize to students who are required to participate in such training. Yet, the results presented here can be considered proof of concept that training programs in EBT could benefit graduate students rather than harm them. It is also important to note that we did not directly measure time spent on research, but did include the amount of time supported as a GTA in our models. This would be an important study to doÐto understand how EBT training programs impact how and where graduate PLOS ONE | https://doi.org/10.1371/journal.pone.0199576 June 25, 2018 9 / 13 The trade-off between graduate student research and teaching: A myth? students invest their time. Finally, this study did not incorporate graduate students from other STEM disciplines. The findings from life science PhD students are a relevant first step to understanding the graduate student experience, and we anticipate broadening the study to other disciplines. Conclusions This research provides initial support for engaging today's graduate students in EBTÐpossibly leading to more rapid change in teaching in higher education classrooms. The data demonstrate that PhD students are not hindered by gaining training in EBT in graduate school. If these future faculty move into life science departments valuing research and teaching, they could catalyze a long-awaited paradigm shift towards faculty who develop high quality research pro- grams and simultaneously strive to meet national calls for improved undergraduate education. Supporting information S1 Fig. Life Sciences Graduate Student Survey instrument (LSGSS). (DOCX) S2 Fig. Raw distributions of variables used in analyses. Continuous variables are in gray and categorical are in black. (DOCX) S3 Fig. Raw data. (CSV) S1 Table. 95% confidence intervals of models for the relationships of training in evidence- based practices on three outcomes: Publications from graduate studies, adequacy of train- ing in research, and confidence communicating science. (DOCX) S2 Table. Regression coefficients from best model in the model set for each of the three outcomes with training in EBTS as a predictor. (DOCX) Acknowledgments We would like to thank Kyahn Daraee, Greggory Dallas, Miles Fletcher and the Chemistry and Biology Education Research Groups at Portland State University for help with survey develop- ment and validation. We also thank Kathleen Quardokus-Fisher, Scott Freeman, Emma C. Goodwin, and Melissa McCartney for their valuable comments on previous drafts of the man- uscript and to the three PLOS ONE reviewers who helped to greatly improve the manuscript with their excellent suggestions. Without the graduate students who donated their time to par- ticipate in the survey, this study would not have been possible. Author Contributions Conceptualization: Erin E. Shortlidge, Sarah L. Eddy. Data curation: Erin E. Shortlidge, Sarah L. Eddy. Formal analysis: Erin E. Shortlidge, Sarah L. Eddy. Methodology: Erin E. Shortlidge. PLOS ONE | https://doi.org/10.1371/journal.pone.0199576 June 25, 2018 10 / 13 The trade-off between graduate student research and teaching: A myth? Project administration: Erin E. Shortlidge. Visualization: Erin E. Shortlidge, Sarah L. Eddy. Writing ± original draft: Erin E. Shortlidge, Sarah L. Eddy. Writing ± review & editing: Erin E. Shortlidge, Sarah L. Eddy. References 1. PCAST. Engage to Excel: Producing One Million Additional College Graduates with Degrees in Sci- ence, Technology, Engineering, and Mathematics. Washington, DC; 2012. 2. Brewer CA, Smith D. Vision and change in undergraduate biology education: a call to action. American Association for the Advancement of Science, Washington, DC. 2011. 3. National Research Council: BIO2010: Transforming undergraduate education for future research biolo- gists. 2003. 4. Freeman S, Eddy SL, McDonough M, Smith MK, Okoroafor N, Jordt H, et al. Active learning increases student performance in science, engineering, and mathematics. Proceedings of the National Academy of Sciences. 2014:201319030. 5. Haak DC, Hille R, Lambers J, Pitre E, Freeman S. Increased structure and active learning reduce the achievement gap in introductory biology. Science. 2011; 332(6034):1213±6. https://doi.org/10.1126/ science.1204820 PMID: 21636776 6. Graham MJ, Frederick J, Byars-Winston A, Hunter A-B, Handelsman J. Increasing Persistence of Col- lege Students in STEM. Science. 2013; 341(6153):1455±6. https://doi.org/10.1126/science.1240487 PMID: 24072909 7. Michael J. Faculty perceptions about barriers to active learning. College Teaching. 2007; 55(2):42±7. 8. Lund TJ, Stains M. The importance of context: an exploration of factors influencing the adoption of stu- dent-centered teaching among chemistry, biology, and physics faculty. International Journal of STEM Education. 2015; 2(1):1±21. 9. Henderson C, Dancy MH. Barriers to the use of research-based instructional strategies: The influence of both individual and situational characteristics. Physical Review Special TopicsÐPhysics Education Research. 2007; 3(2):020102. 10. Henderson C, Beach A, Finkelstein N. Facilitating change in undergraduate STEM instructional prac- tices: an analytic review of the literature. Journal of Research in Science Teaching. 2011; 48(8):952±84. 11. Stains M, Harshman J, Barker M, Chasteen S, Cole R, DeChenne-Peters S, et al. Anatomy of STEM teaching in North American universities. Science. 2018; 359(6383):1468±70. https://doi.org/10.1126/ science.aap8892 PMID: 29599232 12. Borrego M, Froyd JE, Hall TS. Diffusion of engineering education innovations: A survey of awareness and adoption rates in US engineering departments. Journal of Engineering Education. 2010; 99 (3):185±207. 13. Borrego M, Henderson C. Increasing the Use of Evidence-Based Teaching in STEM Higher Educa- tion: A Comparison of Eight Change Strategies. Journal of Engineering Education. 2014; 103(2):220± 14. Brownell SE, Tanner KD. Barriers to faculty pedagogical change: lack of training, time, incentives, and, tensions with professional identity? CBE-Life Sciences Education. 2012; 11(4):339±46. https://doi.org/ 10.1187/cbe.12-09-0163 PMID: 23222828 15. Schussler EE, Read Q, Marbach-Ad G, Miller K, Ferzli M. Preparing biology graduate teaching assis- tants for their roles as instructors: an assessment of institutional approaches. CBE-Life Sciences Edu- cation. 2015; 14(3):ar31. https://doi.org/10.1187/cbe.14-11-0196 PMID: 26231562 16. Feldon DF, Jeong S, Peugh J, Roksa J, Maahs-Fladung C, Shenoy A, et al. Null effects of boot camps and short-format training for PhD students in life sciences. Proceedings of the National Academy of Sci- ences. 2017; 114(37):9854±8. 17. Gardner GE, Jones MG. Pedagogical Preparation of the Science Graduate Teaching Assistant: Chal- lenges and Implications. Science Educator. 2011; 20(2):31±41. 18. Reeves TD, Marbach-Ad G, Miller KR, Ridgway J, Gardner GE, Schussler EE, et al. A Conceptual Framework for Graduate Teaching Assistant Professional Development Evaluation and Research. CBE-Life Sciences Education. 2016; 15(2):es2. https://doi.org/10.1187/cbe.15-10-0225 PMID: PLOS ONE | https://doi.org/10.1371/journal.pone.0199576 June 25, 2018 11 / 13 The trade-off between graduate student research and teaching: A myth? 19. Connolly M, Savoy J, Lee Y, Hill L. Building a better future STEM faculty: How doctoral teaching pro- grams can improve undergraduate education. Madison, WI: Wisconsin Center for Education Research, University of Wisconsin-Madison. 2016. 20. Prevost LB, Vergara CE, Urban-Lurain M, Campa H. Evaluation of a High-Engagement Teaching Pro- gram for STEM Graduate Students: Outcomes of the Future Academic Scholars in Teaching (FAST) Fellowship Program. Innovative Higher Education. 2018; 43(1):41±55. 21. Mitchell J, Levine R, Gonzalez R, Bitter C, Webb N, White P. Evaluation of the National Science Foun- dation Graduate Teaching Fellows in K-12 Education (GK-12) Program. 2003. 22. Gormally C, Brickman P, Hallar B, Armstrong N. Lessons learned about implementing an inquiry-based curriculum in a college biology laboratory classroom. Journal of College Science Teaching. 2011; 40 (3):45±51. 23. Trautmann NM, Krasny ME. Integrating teaching and research: A new model for graduate education? BioScience. 2006; 56(2):159±65. 24. Vergara CE, Urban-Lurain M, Campa H, Cheruvelil KS, Ebert-May D, Fata-Hartley C, et al. FAST- Future Academic Scholars in Teaching: A high-engagement development program for future STEM fac- ulty. Innovative Higher Education. 2014; 39(2):93±107. 25. Connolly MR, Lee Y-G, Savoy JN. The Effects of Doctoral Teaching Development on Early-Career STEM Scholars' College Teaching Self-efficacy. CBEÐLife Sciences Education. 2018; 17(1):ar14. https://doi.org/10.1187/cbe.17-02-0039 PMID: 29440074 26. Tanner K, Allen D. Approaches to biology teaching and learning: On integrating pedagogical training into the graduate experiences of future science faculty. CBE-Life Sciences Education. 2006; 5(1):1±6. https://doi.org/10.1187/cbe.05-12-0132 PMID: 17012182 27. Rushin JW, De Saix J, Lumsden A, Streubel DP, Summers G, Bernson C. Graduate teaching assistant training: a basis for improvement of college biology teaching & faculty development? The American Biol- ogy Teacher. 1997:86±90. 28. Luft JA, Kurdziel JP, Roehrig GH, Turner J. Growing a garden without water: Graduate teaching assis- tants in introductory science laboratories at a doctoral/research university. Journal of Research in Sci- ence Teaching. 2004; 41(3):211±33. 29. Goodwin EC, Cao J, Fletcher M, Flaiban J, Shortlidge EE. Catching the Wave: Are Biology Graduate Students On Board with Evidence-Based Teaching? CBE Life Sciences Education. 2018;Forthcoming. 30. Torvi DA. Engineering graduate teaching assistant instructional programs: training tomorrow's faculty members. Journal of Engineering Education. 1994; 83(4):376±82. 31. Jenkins A. A guide to the research evidence on teaching-research relations. York: Higher Education Academy, 2004. 32. Austin AE. Preparing the next generation of faculty: Graduate school as socialization to the academic career. The Journal of Higher Education. 2002; 73(1):94±122. 33. Fairweather JS. Beyond the rhetoric: Trends in the relative value of teaching and research in faculty sal- aries. Journal of higher Education. 2005:401±22. 34. Austin AE, Sorcinelli MD. The future of faculty development: Where are we going? New Directions for Teaching and Learning. 2013; 2013(133):85±97. 35. Hattie J, Marsh HW. The relationship between research and teaching: A meta-analysis. Review of edu- cational research. 1996; 66(4):507±42. 36. Shortlidge EE, Bangera G, Brownell SE. Faculty Perspectives on Developing and Teaching Course- Based Undergraduate Research Experiences. BioScience. 2016; 66(1):54±62. 37. Boyer EL. Priorities of the Professoriate. Carnegie Foundation for the Advancement of Teaching, Princeton, NJ. 1990. 38. Austin AE. Institutional and departmental cultures: The relationship between teaching and research. New Directions for Institutional Research. 1996; 1996(90):57±66. 39. Drennan LT. Quality Assessment and the Tension between Teaching and Research. Quality in Higher Education. 2001; 7(3):167±78. 40. Shin JC, Arimoto A, Cummings WK, Teichler U. Teaching and research in contemporary higher educa- tion: Springer; 2015. 41. Fox MF. Research, teaching, and publication productivity: Mutuality versus competition in academia. Sociology of education. 1992:293±305. 42. Crimmel HH. The Myth of the Teacher-Scholar. Liberal Education. 1984; 70(3):183±98. 43. Astin AW, Chang MJ. Colleges that emphasize research and teaching: can you have your cake and eat it too? Change: The Magazine of Higher Learning. 1995; 27(5):45±50. PLOS ONE | https://doi.org/10.1371/journal.pone.0199576 June 25, 2018 12 / 13 The trade-off between graduate student research and teaching: A myth? 44. National Science Foundation. National Center for Science and Engineering Statistics. Survey of Earned Doctorates. https://wwwnsfgov/statistics/2018/nsf18304/. 2016. 45. Austin AE. Creating a bridge to the future: Preparing new faculty to face changing expectations in a shifting context. The Review of Higher Education. 2003; 26(2):119±44. 46. Austin AE, McDaniels M. Using doctoral education to prepare faculty to work within Boyer's four domains of scholarship. New Directions for Institutional Research. 2006; 2006(129):51±65. 47. Blackburn RT, Lawrence JH. Faculty at work: Motivation, expectation, satisfaction: Johns Hopkins Uni- versity Press; 1995. 48. Tierney WG, Bensimon EM. Promotion and tenure: Community and socialization in academe: SUNY Press; 1996. 49. Gibbs KD, McGready J, Bennett JC, Griffin K. Biomedical science Ph. D. career interest patterns by race/ethnicity and gender. PLoS One. 2014; 9(12):e114736. https://doi.org/10.1371/journal.pone. 0114736 PMID: 25493425 50. Feldon DF, Peugh J, Timmerman BE, Maher MA, Hurst M, Strickland D, et al. Graduate students' teaching experiences improve their methodological research skills. Science. 2011; 333(6045):1037±9. https://doi.org/10.1126/science.1204109 PMID: 21852504 51. Brownell SE, Price JV, Steinman L. Science Communication to the General Public: Why We Need to Teach Undergraduate and Graduate Students this Skill as Part of Their Formal Scientific Training. Jour- nal of Undergraduate Neuroscience Education. 2013; 12(1):E6. PMID: 24319399 52. Roach M, Sauermann H. A taste for science? PhD scientists' academic orientation and self-selection into research careers in industry. Research Policy. 2010; 39(3):422±34. 53. Garvey WD, Griffith BC. Scientific communication: Its role in the conduct of research and creation of knowledge. American psychologist. 1971; 26(4):349. 54. Weigold MF. Communicating science: A review of the literature. Science communication. 2001; 23 (2):164±93. 55. Williamson IO, Cable DM. Predicting early career research productivity: The case of management fac- ulty. Journal of Organizational Behavior. 2003; 24(1):25±44. 56. Laurance WF, Useche DC, Laurance SG, Bradshaw CJ. Predicting publication success for biologists. BioScience. 2013; 63(10):817±23. 57. Association AER, Association AP, Education NCoMi, Educational JCoSf, Testing P. Standards for edu- cational and psychological testing: Amer Educational Research Assn; 1999. 58. Team RC. R: A language and environment for statistical computing (Internet). Vienna, Austria: R Foun- dation for Statistical Computing; 2014. 2015. 59. Barton K. MuMIn: Multi-Model Inference. 2015;R package version 1.15.6. 60. Ebert-May D, Derting TL, Henkel TP, Middlemis Maher J, Momsen JL, Arnold B, et al. Breaking the Cycle: Future Faculty Begin Teaching with Learner-Centered Strategies after Professional Develop- ment. CBE-Life Sciences Education. 2015; 14(2). 61. Chan D. So why ask me? Are self-report data really that bad. Statistical and methodological myths and urban legends: Doctrine, verity and fable in the organizational and social sciences. 2009:309±36. PLOS ONE | https://doi.org/10.1371/journal.pone.0199576 June 25, 2018 13 / 13 http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png PLoS ONE Pubmed Central

The trade-off between graduate student research and teaching: A myth?

PLoS ONE , Volume 13 (6) – Jun 25, 2018

Loading next page...
 
/lp/pubmed-central/the-trade-off-between-graduate-student-research-and-teaching-a-myth-IeyxlXtdtD

References (65)

Publisher
Pubmed Central
Copyright
© 2018 Shortlidge, Eddy
ISSN
1932-6203
eISSN
1932-6203
DOI
10.1371/journal.pone.0199576
Publisher site
See Article on Publisher Site

Abstract

Many current faculty believe that teaching effort and research success are inversely correlated. This trade-off has rarely been empirically tested; yet, it still impedes efforts to increase the use of evidence-based teaching (EBT), and implement effective teaching a1111111111 a1111111111 training programs for graduate students, our future faculty. We tested this tradeoff for a1111111111 graduate students using a national sample of life science PhD students. We characterize a1111111111 how increased training in EBT impacts PhD students' confidence in their preparation for a a1111111111 research career, in communicating their research, and their publication number. PhD stu- dents who invested time into EBT did not suffer in confidence in research preparedness, scientific research communication, or in publication number. Instead, overall, the data trend towards a slight synergy between investing in EBT and research preparation. Thus, OPENACCESS the tension between developing research and teaching skills may not be salient for today's Citation: Shortlidge EE, Eddy SL (2018) The trade- graduate students. This work is proof of concept that institutions can incorporate training off between graduate student research and in EBT into graduate programs without reducing students' preparedness for a research teaching: A myth? PLoS ONE 13(6): e0199576. career. Although some institutions already have graduate teaching programs, increasing https://doi.org/10.1371/journal.pone.0199576 these programs at scale, and including training in EBT methods could create a new ave- Editor: Etsuro Ito, Waseda University, JAPAN nue for accelerating the spread of evidence-based teaching and improved teaching across Received: March 6, 2018 higher education. Accepted: June 8, 2018 Published: June 25, 2018 Copyright:© 2018 Shortlidge, Eddy. This is an open access article distributed under the terms of the Creative Commons Attribution License, which Introduction permits unrestricted use, distribution, and reproduction in any medium, provided the original In recent decades, a multitude of organizations have challenged institutions of higher educa- author and source are credited. tion to increase student retention in science, technology, engineering and mathematics Data Availability Statement: All relevant data are (STEM) [1±3]. One path to achieving this goal is to increase implementation of the teaching within the paper and its Supporting Information practices that research has largely found to be effective for students. These practices are typi- files. cally student-centered, and may be referred to as ªactive learningº or, more broadly, ªevi- Funding: The authors received no specific funding dence-basedº [2, 4±6]. Despite this national push, scant evidence has been found of systemic for this work. movement in faculty teaching practices towards evidence-based teaching (EBT), and, instead, many barriers to change have been identified [7±14]. Although it is critical to continue work- Competing interests: The authors have declared that no competing interests exist. ing with current faculty on EBT, a complementary effort to increase the use of EBT by future PLOS ONE | https://doi.org/10.1371/journal.pone.0199576 June 25, 2018 1 / 13 The trade-off between graduate student research and teaching: A myth? faculty, current graduate students, has the potential to accelerate the adoption of these prac- tices nation-wide. Some institutions offer training in EBT that graduate students can opt into if they are aware of the options. These opportunities might include short 1-hr workshops, concentrated `teach- ing boot-camps', and semester long courses [15, 16]. Unfortunately, short trainings seem to have limited effectiveness for changing teaching practices [16±18]. Effective training programs generally require a substantial time commitmment of a semester or more [10, 19±21]. Empiri- cal examples of the impact of more extensive training is relatively sparse, but all suggest the same pattern. In one study, researchers implemented a GTA training focused on leading inquiry labs and found GTAs self-reported improved teaching skills as a result [22]. PhD stu- dents in a multi-year fellowship program run by the National Science Foundation reported improvement in their use of student-centered teaching [21, 23]. Similarly, a year-long program focused on effective teaching practices found 68% of participants reported improvement through the program [24]. Connolly et al. recently found graduate students that engaged in extended training, especially formal courses, described increased self-efficacy in course plan- ning and teaching methods over other forms of teaching development [25]. Thus, the existing studies suggest these longer training programs in EBT can impact at least self-reported use of teaching practices by graduate students. Currently, many STEM departments do not structure substantial teaching development opportunities for graduate students into their graduate curriculum [24]. If departments do have mandatory trainings, they tend to focus on procedures and policies rather than pedagogy, let alone EBT methods [15, 17, 19, 26±29]. Departments may not embed longer-term pedagog- ical training into their doctoral programs because of a pervasive perception of a tension between research and teaching in the sciences [19]. This belief is characterized by the assump- tion that any time spent teaching, or even learning about teaching methods, will take away from research productivity for faculty [14, 17, 30, 31] and graduate students [30, 32]. Research is prioritized in this trade-off, and this prioritization is reinforced by institutional incentiviza- tionÐresearch brings in grant money, publications, and prestige that are all emphasized in the promotion and tenure process over teaching. Thus, research is commonly viewed as where more time should be spent [17, 32±34]. Although pervasive, this trade-off has rarely been empirically evaluated, and where it has been, the results are mixed. Meta-analyses of the existing research investigating trade-offs between research and teaching found no consistent patternÐat least for faculty [31, 35]. Yet, despite this lack the evidence, the perception of a tension between how academics should be spending their time persists [14, 31, 35±43], and is likely passed down to graduate students through their advisor and/or departmental culture [19, 32]. This perception of a tension between research and teaching has at least two potential costs. The first is that by not offering graduate students training in EBT, the spread of EBT practices is slowed. The second is a potential cost to the students themselves. In the United States alone thousands of graduate students earn doctorate degrees each year. In 2016, of these newly minted PhDs, 45% of them where employed in academia [44], indicating an intent to pursue a career in academia which will likely have a teaching component. Even PhDs who ultimately seek a tenure-track position at research-intensive intuitions find themselves in jobs that involve much more than just being proficient at research [32, 37, 45±48]. This point is highlighted in the oft-cited The Priorities of the Professoriate report [37], which called for a characterization of the role of faculty to encompass a more holistic vision of scholarship among academic faculty, which includes excellence in teaching. Focusing graduate student training exclusively on research may underprepare these future faculty for the reality of the complex roles faculty members assume, including spending a significant amount of teaching. PLOS ONE | https://doi.org/10.1371/journal.pone.0199576 June 25, 2018 2 / 13 The trade-off between graduate student research and teaching: A myth? This under-preparedness is already being felt by some graduate students as illustrated by bio- medical postdoctoral scholars reporting that their graduate programs did not provide them with adequate career training and support [49]. Thus, the potential costs of not training graduate students in evidence-based teaching are clear, but is there a trade-off for incorporating teaching development programs into graduate training? Does it hurt their preparedness for a research career? Little work has been done to quantify how graduate students actually invest their time and the impacts of these investments on their progress. One study empirically tested how time spent as a Graduate Teaching Assis- tant (GTA) related to a student's ability to write a research grant proposal, and found that stu- dents who spent time teaching actually had improved proposal writing skills over those that did not teach [50]. Yet, this study tested impacts of time spent on teaching, not the amount of time spent on learning to teach well. In the current study, we explore the hypothesis that there is a trade-off between PhD stu- dents investing in EBT and being prepared for a research career in academia. We use the term `invest' in EBT because time is consumed when seeking out and gaining training in EBT, and this time is often separate and in addition to time spent as a GTA. We focus on life science PhD students as the life sciences consistently award the greatest number of PhDs across the STEM disciplinesÐin 2016 23% of all earned doctorates were in the life sciences [44]. We test for a potential trade-off between research and teaching for life science PhD students by investi- gating three interrelated proxies for preparedness for a research career: confidence that their PhD training program has prepared them to be a researcher, confidence in their ability to communicate their research, and the number of peer-reviewed publications students have pro- duced to date from their PhD work. We chose these three indicators because they have reper- cussions for retention in research careers in academia. Confidence in one's research and communication skills are critical components of a successful research career [37, 51±54]. The number of publications a student has out of their PhD is also a significant predictor of long term success in academia [55, 56]. Following the pervasive notion of an antagonism between research and teaching, one could assume that if PhD students invest in EBT training, they will not be as prepared for an academic research career as those who focus less time on training in teaching, and more on research. Here we test for this potential trade-off. Materials and methods Life Sciences Graduate Student Survey For this study, life science PhD students were recruited online to complete the Life Sciences Graduate Student Survey, (LSGSS, S1 Fig). The LSGSS was designed to gauge graduate stu- dents' self-reported awareness of, training in, and use of evidence-based teaching methods, as well as report their confidence and training in a variety of tasks and experiences one might have as a graduate student in the life sciences related to research, teaching, and communica- tion. The LSGSS underwent iterative validity measures to establish that the items on the instru- ment measure the intended constructs [57, 58]. Members of two education research groups as well as multiple STEM graduate students vetted survey items for validity through think-aloud interviews and by piloting the survey and receiving feedback. Based on item feedback, ambigu- ous questions or unclear wording was addressed and modified for the final instrument. Gradu- ate students were not compensated for participating in the survey and their responses were not linked to their name or other identifying information. The study was approved by the Portland State University IRB (#163844). EBT practices index. Participants reported the training they received in eight common EBT practices in their current graduate program on a four point Likert scale ranging from no PLOS ONE | https://doi.org/10.1371/journal.pone.0199576 June 25, 2018 3 / 13 The trade-off between graduate student research and teaching: A myth? training (1), observation only (2), a little training (3) to lots of training (4). The practices were chosen based on existing surveys that had been used to determine faculty familiarity with EBT [8]. Because of confusion among participants during think-aloud interviews, several of the initial practices were removed. The final set of EBT practices were presented with written definitions for each practice in the survey, and included: case studies, clickers, concept maps, course-based undergraduate research experiences, discussion-based instruction/Socratic method, flipped classroom, problem-based learning and/or inquiry-based learning, process oriented guided inquiry learning (POGIL), learning assistants, and think-pair-share. Finally, before analysis we removed the learning assistant item and the course-based undergraduate research experience. These showed lower levels of training then any of the other items and unlike the other practices, these lower responses could be driven by institutional differences. If an institution did not support course-based undergraduate research experiences, or a learning assistant program than there would be no reason for training to be offered in it. We summed student responses on the final 8 items to form an index of their training in EBT. Both observation and no training responses were scored as 0, because they did not repre- sent investment in formal training. A little training was coded as 1 and A lot of training was coded as 2 to indicated the added time investment this might indicate. Thus, a student with a four for training in EBT could have a little training in four practices, a lot of training on two practices, or a little training on two and a lot of training on one. Our index cannot separate these scenarios, but it does tell us that a student with an index value of four likely invested more time in training than a student with a one (a little training in one practice). The training in EBT index ranged from 0 to 15 (likely representing a lot of training in 7 of the 8 practices and a little training in 1; S1 Fig). The mean in the sample was 3 ± 3.4 (sd) indi- cating a little training in three practices or a lot of training in one practice and a little training in one other practice. Outcome variables. The outcome measures of interest were three indicators of a PhD stu- dent's preparation for a research career: confidence in their research training, and confidence in ability to communicate their research, and publications out of their PhD to date. Survey items regarding research and science communication preparedness were modified from a sur- vey measuring the career goals and choices of biomedical postdoctoral scholars [49]. Students answered four Likert-type items regarding their confidence that their graduate training has adequately prepared them to pursue a research career including: writing grant proposals, writing peer-reviewed scientific journal articles, running a research lab, and collab- orating on research with individuals of other scientific disciplines. Each individual item had four possible responses ranging from `not at all' to `definitely' adequately trained. We summed student response on the individual questions to create an index of confidence in research training. We created an index instead of considering these items part of a scale that could be averaged because we do not expect students to answer the same way on all the individual items. For example, despite both items representing an aspect of research preparation, it is pos- sible a student could report high confidence in their training in grant writing, but not running a research lab. The research confidence index could range from 4 (no confidence in any aspect of research training) to 16 (absolute confidence in all aspects of research training). The mean response on this index was 11.4 ± 2.6 (S2 Fig). Students answered three Likert-type items about their confidence communicating their research to other scientists in a professional setting, other scientists in an informal setting, and non-scientists in informal settings. These questions had four response options ranging from `not at all confident' to `very confident'. As with confidence in research training, we summed students' scores on these items to create a research communication confidence index. The index could range from 3 to 12. The mean student response was 9.3 ± 1.8 (S2 Fig). PLOS ONE | https://doi.org/10.1371/journal.pone.0199576 June 25, 2018 4 / 13 The trade-off between graduate student research and teaching: A myth? Finally, participants reported how many peer-reviewed research papers they have published to date from their current PhD program (regardless of authorship position) on a scale from 0 to 3 or more publications. Few students reported two publications, so we pooled this level with the 3+ publications category. Thus, the final outcome variable for number of publications had three levels: 0 publications, 1 publication, and two or more publications (S2 Fig) Control variables. To isolate the effect of training in EBT, we included several potential control variables related to a student's experience in graduate school. Participants reported the percent of financial support for their PhD that has come from being a GTA. This variable serves as a proxy for the proportion of their time spent teaching and thus not working on their research. Students also reported their year in the PhD program and whether or not they had previously earned a Master's degree. We expect both of these variables to impact confidence and publication number out of their PhD. Participant recruitment. Students were recruited through professional scientific society listservs, departmental listservs, and snowball sampling. The LSGSS was built using the Quali- trics online survey platform, and the survey link was available from June 2016 through August 2016. The survey was accessed by over 900 individuals and completed by over 500 individuals. Graduate students self-selected to take the survey (Table 1). Only individuals who consented for their responses to be used for research and completed the entire survey were kept in the data set. Description of study sample. Of the survey respondents 437 were our focal sample: PhD students. We further refined our sample by removing individuals who were in the first year of their PhD program (n = 73), as they have not been in their program long enough for learning about EBTs to have an opportunity to impact their research preparation. In addition, we removed anyone who had already earned a PhD in a different discipline as that experience would make them substantially different from students earning a PhD for the first time and they were too few in number to make this a control variable in the model (n = 17). Finally, we removed students who were seeking non-traditional biology PhDs such as biology education and science and society because we believed the relationships between research and learning about EBTs might be different for students pursuing research in traditional fields like microbi- ology or ecology. Again, the sample was too small (n = 9) to include this variable as a control. In summary, the analyses reported here include only the 338 PhD students studying tradi- tional life science research topics (i.e. not biology education, philosophy of science, etc.) who had already completed at least one year of their PhD program before taking the survey (Table 1). Overall, 8.2% of participants were underrepresented minorities and 9.2% did not Table 1. Participant demographics. Race/Ethnicity Year in PhD Program Career Goals Non-URM 83% 2 22% Research Faculty 30% URM 8% 3 25% Non-academic Research 29% NA 9% 4 18% Teaching Faculty 22% 5 19% Non-Research 12% Gender 6+ 17% Unsure 7% Female 58% University Type Age (years) Male 36% R1 72% < 27 38% NA 4% R2/R3 19% 27±30 25% Other 2% Other or NA 9% >30 37% Description of study sample (N = 338 life science PhD students). https://doi.org/10.1371/journal.pone.0199576.t001 PLOS ONE | https://doi.org/10.1371/journal.pone.0199576 June 25, 2018 5 / 13 The trade-off between graduate student research and teaching: A myth? respond to the race/ethnicity question or were undetermined. The majority of participants identified as female (58.3%), 1.8% were non-binary, and 3.6% did not respond to the question nd about gender. Participants represented a range of years in their graduate school (2 year: rd th th th 21.6%; 3 : 25.1%; 4 : 17.7%; 5 : 18.9%; 6 or higher: 16.6%). The majority of participants attended very high or high research institutions (72%), the remaining attended moderate research institutions/other institutions by Carnegie Classification of Institutions of Higher Education . Graduate students in the final sample represented 19 different sub-disciplines. The dominant three were: ecology (22.1%), cellular/molecular (17.6%), and evolutionary biol- ogy (16.2%). Our study sample is statistically indistinguishable from the life science graduate student population in the US [44] in gender, age, and institution type, but our sample consists of less underrepresented minority life science PhD students compared to national proportions (Chi squared = 34.32; p <0.0001). Model selection. We used linear regression models (outcomes: research preparedness and science communication), and the proportional log-odds model (outcome: publications), to characterize the relationships between the outcome variables, the controls (whether or not a student had a Master's degree, year in their programs, and proportion of financial support coming from teaching), and training in EBT. Model selection with Akaike's Information Crite- rion (AIC) was used to identify the subset of these variables that best fit the data. We started by fitting a complex model that included the control variables, training in EBT, as well as three interaction terms: 1) year in program and proportion of financial support coming from teach- ing, 2) financial support and training in EBT, and 3) year in program and training in EBT. We searched all possible combinations of these variables to identify the best-fit and most parsimo- nious models for the three outcome variables. All models were fit in R version 3.3.2 [58] using the MuMIn package [59]. Models with aΔAIC 2 or less are considered equivalent and models withΔAIC > 10 are poor predictors of the data. The models presented in the main body of the paper are the final best-fit and most parsimo- nious models. We report the 95% confidence set of models for each outcome variable in S1 Table. We then report the regression coefficients from the identified best models for each out- come variable in S2 Table. Results and discussion Investing in EBT does not reduce sense of being well-trained for a research career Increased training in EBT practices did not reduce students' confidence that their research training has adequately prepared them to be a researcher (Fig 1). Instead, there was a slightly positive relationship (β = 0.15 ± 0.042, t = 3.64, p = 0.0003). Thus, there is no support for the prediction that the time PhD students spend pursuing EBT practices negatively impacts how they perceive their preparedness to do research. Investing in EBT does not reduce confidence in ability to communicate research Student training in EBT increased student confidence in communicating their research (0.10 ± 0.029, t = 3.45, p = 0.0006, Fig 2). Interestingly, the amount of financial support from teaching was not selected to be included in the best models and even in the models it was in the term was not significant. Thus, it seems that teaching experience alone does not increase communication confidenceÐonly training in EBT allows students to reach this desirable outcome. PLOS ONE | https://doi.org/10.1371/journal.pone.0199576 June 25, 2018 6 / 13 The trade-off between graduate student research and teaching: A myth? Fig 1. Training in EBT predicts increased confidence in preparedness for a research career. The estimates illustrated in this figure derive from the best-fit linear regression model: Research training adequacy index ~ Training in EBT index (see model selection table S1 Table). Bars represent upper and lower 95% confidence limits around the predicted response. https://doi.org/10.1371/journal.pone.0199576.g001 Investing in EBT does not reduce publication number After controlling for whether a PhD student had previously earned a Master's degree and their year in a PhD program, there was no evidence for a relationship between training in EBT and the number of papers a PhD student had published to date (β = 0.04 ± 0.032, t = 1.32, p = 0.19, Fig 2. More training in EBT predicts increased confidence in communicating scientific research. The estimates derive from the best-fit linear regression model: Research communication index ~ Training in EBT index (see model selection table S1 Table). Bars represent upper and lower 95% confidence limits around the predicted response. https://doi.org/10.1371/journal.pone.0199576.g002 PLOS ONE | https://doi.org/10.1371/journal.pone.0199576 June 25, 2018 7 / 13 The trade-off between graduate student research and teaching: A myth? Fig 3. Investment in EBT is not detrimental to research productivity. Graduate student training in EBT does not significantly predict research productivity as measured by number of peer-reviewed publications from their PhD program to date. The estimates illustrated here are derived from the best-fit proportional log odds model controlling for year in program, and whether they already have a Master's degree. Bars represent upper and lower 95% confidence limits around the predicted probability. https://doi.org/10.1371/journal.pone.0199576.g003 Fig 3). These results indicate no support for the hypothesized trade-off between pursuing opportunities to learn about EBT practices during graduate school and a student's research productivity as measured by published papers. The trend actually hints at the potential for the opposite pattern: for each unit increase in a student's average training in EBT practices, they were 1.04 times more likely to have at least one additional paper. For example, students with the mean EBT training index had a 47% chance of having zero publications and students in the third quartile of the EBT training index (6.5) were slightly less likely to have zero publica- tions (43% chance). In higher education, there is widespread perception of an inevitable trade-off between being a productive researcher and investing time in teaching. Academic culture, graduate stu- dent mentors, and graduate students themselves may assume that these perceived trade-offs apply to graduate students [17, 19, 45]. Yet, the data presented here do not support this trade- off. Instead, our data support a different hypothesis: graduate students who invest in EBT can be just as competitive of researchers as those who do not make this investment. PLOS ONE | https://doi.org/10.1371/journal.pone.0199576 June 25, 2018 8 / 13 The trade-off between graduate student research and teaching: A myth? Training in EBT practices has been identified as key construct of a recommended frame- work for GTA training [18], and recent studies suggest that substantial training in EBT can result in the adoption of these practices. A study on the FIRST IV program for post-doctoral scholars demonstrated increased use of EBT after two-years in the professional development program [60]. Similarly, a study found that longer training programs, and especially semester long courses increased graduate student self-efficacy in EBT, and follow-up interviews with these students revealed the majority were employing these methods five years later [19, 25]. These studies, and several studies of teaching self-efficacy (e.g. [25], suggest that investing in these training programs can impact how graduate students teach). Further, there is beginning to be evidence that graduate students desire this training in EBT. Yet, training in EBT is typically not structured into the PhD training required by their department, and the types of professional development opportunities that result in persistent benefits are not widespread, even at the institutional level [16, 17, 19, 29, 32]. A national study of life science graduate students found that students who had participated in teaching profes- sional development often had to seek out those opportunities beyond their departments [19]. An interview study with a national sample of life science graduate students found similar results and discovered that while most participants had some formal teaching training, only a few claimed receiving substantial training in any student-centered strategies [29]. Yet, encour- agingly, 84% of participants saw value in EBT, the majority of which reported having the desire to use them in their own teaching. Together these findings suggest that if institutions invest in providing dedicated programs for graduate students to learn best practices in teaching, they will not be sabotaging graduate student research progress, but will be fulfilling a desire stu- dents have to learn the practices and potentially increase implementation of EBT in higher education. Given our results and those of studies described above, we propose an alternative hypothe- sis to the `trade-off' between teaching and research preparedness for graduate students: invest- ment in training in EBT may enhance graduate student preparedness for the multifaceted roles that faculty members play [32, 41, 46]. Not providing professional development in peda- gogy may undermine a PhD student's competitiveness relative to students who receive training or have chosen to seek out training independently, especially if the students research produc- tivity and confidence coming out of their PhD programs are otherwise comparable. Given that 38% of graduating PhDs (41% in the life sciences) in 2016 did not yet have definite employ- ment lined up, diversifying one's portfolio will certainly be key to an individual securing a position in academia, regardless of the specific requirements of that position. Limitations Self-report data has recognized shortcomings including that information can be both under- reported and/or inflated [61] In addition, our sample comes from a self-selecting student pop- ulation and, despite our sample being fairly representative of the demographics of life science graduate students nationally, it not represent the perceptions or experiences of the overall population of life science graduate students. In particular, in our study the students who engaged in training in EBT likely opted in, so our results may not generalize to students who are required to participate in such training. Yet, the results presented here can be considered proof of concept that training programs in EBT could benefit graduate students rather than harm them. It is also important to note that we did not directly measure time spent on research, but did include the amount of time supported as a GTA in our models. This would be an important study to doÐto understand how EBT training programs impact how and where graduate PLOS ONE | https://doi.org/10.1371/journal.pone.0199576 June 25, 2018 9 / 13 The trade-off between graduate student research and teaching: A myth? students invest their time. Finally, this study did not incorporate graduate students from other STEM disciplines. The findings from life science PhD students are a relevant first step to understanding the graduate student experience, and we anticipate broadening the study to other disciplines. Conclusions This research provides initial support for engaging today's graduate students in EBTÐpossibly leading to more rapid change in teaching in higher education classrooms. The data demonstrate that PhD students are not hindered by gaining training in EBT in graduate school. If these future faculty move into life science departments valuing research and teaching, they could catalyze a long-awaited paradigm shift towards faculty who develop high quality research pro- grams and simultaneously strive to meet national calls for improved undergraduate education. Supporting information S1 Fig. Life Sciences Graduate Student Survey instrument (LSGSS). (DOCX) S2 Fig. Raw distributions of variables used in analyses. Continuous variables are in gray and categorical are in black. (DOCX) S3 Fig. Raw data. (CSV) S1 Table. 95% confidence intervals of models for the relationships of training in evidence- based practices on three outcomes: Publications from graduate studies, adequacy of train- ing in research, and confidence communicating science. (DOCX) S2 Table. Regression coefficients from best model in the model set for each of the three outcomes with training in EBTS as a predictor. (DOCX) Acknowledgments We would like to thank Kyahn Daraee, Greggory Dallas, Miles Fletcher and the Chemistry and Biology Education Research Groups at Portland State University for help with survey develop- ment and validation. We also thank Kathleen Quardokus-Fisher, Scott Freeman, Emma C. Goodwin, and Melissa McCartney for their valuable comments on previous drafts of the man- uscript and to the three PLOS ONE reviewers who helped to greatly improve the manuscript with their excellent suggestions. Without the graduate students who donated their time to par- ticipate in the survey, this study would not have been possible. Author Contributions Conceptualization: Erin E. Shortlidge, Sarah L. Eddy. Data curation: Erin E. Shortlidge, Sarah L. Eddy. Formal analysis: Erin E. Shortlidge, Sarah L. Eddy. Methodology: Erin E. Shortlidge. PLOS ONE | https://doi.org/10.1371/journal.pone.0199576 June 25, 2018 10 / 13 The trade-off between graduate student research and teaching: A myth? Project administration: Erin E. Shortlidge. Visualization: Erin E. Shortlidge, Sarah L. Eddy. Writing ± original draft: Erin E. Shortlidge, Sarah L. Eddy. Writing ± review & editing: Erin E. Shortlidge, Sarah L. Eddy. References 1. PCAST. Engage to Excel: Producing One Million Additional College Graduates with Degrees in Sci- ence, Technology, Engineering, and Mathematics. Washington, DC; 2012. 2. Brewer CA, Smith D. Vision and change in undergraduate biology education: a call to action. American Association for the Advancement of Science, Washington, DC. 2011. 3. National Research Council: BIO2010: Transforming undergraduate education for future research biolo- gists. 2003. 4. Freeman S, Eddy SL, McDonough M, Smith MK, Okoroafor N, Jordt H, et al. Active learning increases student performance in science, engineering, and mathematics. Proceedings of the National Academy of Sciences. 2014:201319030. 5. Haak DC, Hille R, Lambers J, Pitre E, Freeman S. Increased structure and active learning reduce the achievement gap in introductory biology. Science. 2011; 332(6034):1213±6. https://doi.org/10.1126/ science.1204820 PMID: 21636776 6. Graham MJ, Frederick J, Byars-Winston A, Hunter A-B, Handelsman J. Increasing Persistence of Col- lege Students in STEM. Science. 2013; 341(6153):1455±6. https://doi.org/10.1126/science.1240487 PMID: 24072909 7. Michael J. Faculty perceptions about barriers to active learning. College Teaching. 2007; 55(2):42±7. 8. Lund TJ, Stains M. The importance of context: an exploration of factors influencing the adoption of stu- dent-centered teaching among chemistry, biology, and physics faculty. International Journal of STEM Education. 2015; 2(1):1±21. 9. Henderson C, Dancy MH. Barriers to the use of research-based instructional strategies: The influence of both individual and situational characteristics. Physical Review Special TopicsÐPhysics Education Research. 2007; 3(2):020102. 10. Henderson C, Beach A, Finkelstein N. Facilitating change in undergraduate STEM instructional prac- tices: an analytic review of the literature. Journal of Research in Science Teaching. 2011; 48(8):952±84. 11. Stains M, Harshman J, Barker M, Chasteen S, Cole R, DeChenne-Peters S, et al. Anatomy of STEM teaching in North American universities. Science. 2018; 359(6383):1468±70. https://doi.org/10.1126/ science.aap8892 PMID: 29599232 12. Borrego M, Froyd JE, Hall TS. Diffusion of engineering education innovations: A survey of awareness and adoption rates in US engineering departments. Journal of Engineering Education. 2010; 99 (3):185±207. 13. Borrego M, Henderson C. Increasing the Use of Evidence-Based Teaching in STEM Higher Educa- tion: A Comparison of Eight Change Strategies. Journal of Engineering Education. 2014; 103(2):220± 14. Brownell SE, Tanner KD. Barriers to faculty pedagogical change: lack of training, time, incentives, and, tensions with professional identity? CBE-Life Sciences Education. 2012; 11(4):339±46. https://doi.org/ 10.1187/cbe.12-09-0163 PMID: 23222828 15. Schussler EE, Read Q, Marbach-Ad G, Miller K, Ferzli M. Preparing biology graduate teaching assis- tants for their roles as instructors: an assessment of institutional approaches. CBE-Life Sciences Edu- cation. 2015; 14(3):ar31. https://doi.org/10.1187/cbe.14-11-0196 PMID: 26231562 16. Feldon DF, Jeong S, Peugh J, Roksa J, Maahs-Fladung C, Shenoy A, et al. Null effects of boot camps and short-format training for PhD students in life sciences. Proceedings of the National Academy of Sci- ences. 2017; 114(37):9854±8. 17. Gardner GE, Jones MG. Pedagogical Preparation of the Science Graduate Teaching Assistant: Chal- lenges and Implications. Science Educator. 2011; 20(2):31±41. 18. Reeves TD, Marbach-Ad G, Miller KR, Ridgway J, Gardner GE, Schussler EE, et al. A Conceptual Framework for Graduate Teaching Assistant Professional Development Evaluation and Research. CBE-Life Sciences Education. 2016; 15(2):es2. https://doi.org/10.1187/cbe.15-10-0225 PMID: PLOS ONE | https://doi.org/10.1371/journal.pone.0199576 June 25, 2018 11 / 13 The trade-off between graduate student research and teaching: A myth? 19. Connolly M, Savoy J, Lee Y, Hill L. Building a better future STEM faculty: How doctoral teaching pro- grams can improve undergraduate education. Madison, WI: Wisconsin Center for Education Research, University of Wisconsin-Madison. 2016. 20. Prevost LB, Vergara CE, Urban-Lurain M, Campa H. Evaluation of a High-Engagement Teaching Pro- gram for STEM Graduate Students: Outcomes of the Future Academic Scholars in Teaching (FAST) Fellowship Program. Innovative Higher Education. 2018; 43(1):41±55. 21. Mitchell J, Levine R, Gonzalez R, Bitter C, Webb N, White P. Evaluation of the National Science Foun- dation Graduate Teaching Fellows in K-12 Education (GK-12) Program. 2003. 22. Gormally C, Brickman P, Hallar B, Armstrong N. Lessons learned about implementing an inquiry-based curriculum in a college biology laboratory classroom. Journal of College Science Teaching. 2011; 40 (3):45±51. 23. Trautmann NM, Krasny ME. Integrating teaching and research: A new model for graduate education? BioScience. 2006; 56(2):159±65. 24. Vergara CE, Urban-Lurain M, Campa H, Cheruvelil KS, Ebert-May D, Fata-Hartley C, et al. FAST- Future Academic Scholars in Teaching: A high-engagement development program for future STEM fac- ulty. Innovative Higher Education. 2014; 39(2):93±107. 25. Connolly MR, Lee Y-G, Savoy JN. The Effects of Doctoral Teaching Development on Early-Career STEM Scholars' College Teaching Self-efficacy. CBEÐLife Sciences Education. 2018; 17(1):ar14. https://doi.org/10.1187/cbe.17-02-0039 PMID: 29440074 26. Tanner K, Allen D. Approaches to biology teaching and learning: On integrating pedagogical training into the graduate experiences of future science faculty. CBE-Life Sciences Education. 2006; 5(1):1±6. https://doi.org/10.1187/cbe.05-12-0132 PMID: 17012182 27. Rushin JW, De Saix J, Lumsden A, Streubel DP, Summers G, Bernson C. Graduate teaching assistant training: a basis for improvement of college biology teaching & faculty development? The American Biol- ogy Teacher. 1997:86±90. 28. Luft JA, Kurdziel JP, Roehrig GH, Turner J. Growing a garden without water: Graduate teaching assis- tants in introductory science laboratories at a doctoral/research university. Journal of Research in Sci- ence Teaching. 2004; 41(3):211±33. 29. Goodwin EC, Cao J, Fletcher M, Flaiban J, Shortlidge EE. Catching the Wave: Are Biology Graduate Students On Board with Evidence-Based Teaching? CBE Life Sciences Education. 2018;Forthcoming. 30. Torvi DA. Engineering graduate teaching assistant instructional programs: training tomorrow's faculty members. Journal of Engineering Education. 1994; 83(4):376±82. 31. Jenkins A. A guide to the research evidence on teaching-research relations. York: Higher Education Academy, 2004. 32. Austin AE. Preparing the next generation of faculty: Graduate school as socialization to the academic career. The Journal of Higher Education. 2002; 73(1):94±122. 33. Fairweather JS. Beyond the rhetoric: Trends in the relative value of teaching and research in faculty sal- aries. Journal of higher Education. 2005:401±22. 34. Austin AE, Sorcinelli MD. The future of faculty development: Where are we going? New Directions for Teaching and Learning. 2013; 2013(133):85±97. 35. Hattie J, Marsh HW. The relationship between research and teaching: A meta-analysis. Review of edu- cational research. 1996; 66(4):507±42. 36. Shortlidge EE, Bangera G, Brownell SE. Faculty Perspectives on Developing and Teaching Course- Based Undergraduate Research Experiences. BioScience. 2016; 66(1):54±62. 37. Boyer EL. Priorities of the Professoriate. Carnegie Foundation for the Advancement of Teaching, Princeton, NJ. 1990. 38. Austin AE. Institutional and departmental cultures: The relationship between teaching and research. New Directions for Institutional Research. 1996; 1996(90):57±66. 39. Drennan LT. Quality Assessment and the Tension between Teaching and Research. Quality in Higher Education. 2001; 7(3):167±78. 40. Shin JC, Arimoto A, Cummings WK, Teichler U. Teaching and research in contemporary higher educa- tion: Springer; 2015. 41. Fox MF. Research, teaching, and publication productivity: Mutuality versus competition in academia. Sociology of education. 1992:293±305. 42. Crimmel HH. The Myth of the Teacher-Scholar. Liberal Education. 1984; 70(3):183±98. 43. Astin AW, Chang MJ. Colleges that emphasize research and teaching: can you have your cake and eat it too? Change: The Magazine of Higher Learning. 1995; 27(5):45±50. PLOS ONE | https://doi.org/10.1371/journal.pone.0199576 June 25, 2018 12 / 13 The trade-off between graduate student research and teaching: A myth? 44. National Science Foundation. National Center for Science and Engineering Statistics. Survey of Earned Doctorates. https://wwwnsfgov/statistics/2018/nsf18304/. 2016. 45. Austin AE. Creating a bridge to the future: Preparing new faculty to face changing expectations in a shifting context. The Review of Higher Education. 2003; 26(2):119±44. 46. Austin AE, McDaniels M. Using doctoral education to prepare faculty to work within Boyer's four domains of scholarship. New Directions for Institutional Research. 2006; 2006(129):51±65. 47. Blackburn RT, Lawrence JH. Faculty at work: Motivation, expectation, satisfaction: Johns Hopkins Uni- versity Press; 1995. 48. Tierney WG, Bensimon EM. Promotion and tenure: Community and socialization in academe: SUNY Press; 1996. 49. Gibbs KD, McGready J, Bennett JC, Griffin K. Biomedical science Ph. D. career interest patterns by race/ethnicity and gender. PLoS One. 2014; 9(12):e114736. https://doi.org/10.1371/journal.pone. 0114736 PMID: 25493425 50. Feldon DF, Peugh J, Timmerman BE, Maher MA, Hurst M, Strickland D, et al. Graduate students' teaching experiences improve their methodological research skills. Science. 2011; 333(6045):1037±9. https://doi.org/10.1126/science.1204109 PMID: 21852504 51. Brownell SE, Price JV, Steinman L. Science Communication to the General Public: Why We Need to Teach Undergraduate and Graduate Students this Skill as Part of Their Formal Scientific Training. Jour- nal of Undergraduate Neuroscience Education. 2013; 12(1):E6. PMID: 24319399 52. Roach M, Sauermann H. A taste for science? PhD scientists' academic orientation and self-selection into research careers in industry. Research Policy. 2010; 39(3):422±34. 53. Garvey WD, Griffith BC. Scientific communication: Its role in the conduct of research and creation of knowledge. American psychologist. 1971; 26(4):349. 54. Weigold MF. Communicating science: A review of the literature. Science communication. 2001; 23 (2):164±93. 55. Williamson IO, Cable DM. Predicting early career research productivity: The case of management fac- ulty. Journal of Organizational Behavior. 2003; 24(1):25±44. 56. Laurance WF, Useche DC, Laurance SG, Bradshaw CJ. Predicting publication success for biologists. BioScience. 2013; 63(10):817±23. 57. Association AER, Association AP, Education NCoMi, Educational JCoSf, Testing P. Standards for edu- cational and psychological testing: Amer Educational Research Assn; 1999. 58. Team RC. R: A language and environment for statistical computing (Internet). Vienna, Austria: R Foun- dation for Statistical Computing; 2014. 2015. 59. Barton K. MuMIn: Multi-Model Inference. 2015;R package version 1.15.6. 60. Ebert-May D, Derting TL, Henkel TP, Middlemis Maher J, Momsen JL, Arnold B, et al. Breaking the Cycle: Future Faculty Begin Teaching with Learner-Centered Strategies after Professional Develop- ment. CBE-Life Sciences Education. 2015; 14(2). 61. Chan D. So why ask me? Are self-report data really that bad. Statistical and methodological myths and urban legends: Doctrine, verity and fable in the organizational and social sciences. 2009:309±36. PLOS ONE | https://doi.org/10.1371/journal.pone.0199576 June 25, 2018 13 / 13

Journal

PLoS ONEPubmed Central

Published: Jun 25, 2018

There are no references for this article.