Graduate Students Who Teach Are More Skilled at Research
According to recent research appearing in Science, the traditional advice to graduate students to minimize their time spent teaching and maximize their time spent on research may ultimately harm the development of their research skills.
Previous research examining the relationship between teaching and outcomes has been difficult to interpret. For example, in one study, 524 students self-reported their publications and presentations, and these numbers were compared between students teaching and conducting research versus students only conducting research. Students teaching had higher presentation and publication rates. But this relied on self-report; would it hold true if we had more objective measures?
In their article, Feldon et al. describe their research study in which 95 graduate students within the first three years of their education completed a validated research skills measure at two time points: at the beginning and end of an academic year. The research skills measure involved the creation and revision of a research proposal in the student’s area of interest. No feedback was provided between the two time points.
Analyses revealed that student teacher-researchers were moderately better at generating testable hypotheses (d = .40) and at generating valid research designs (d = .48) than student researchers. This indicated to the authors that “teaching experience can contribute substantially to the improvement of essential research skills.”
Hold on a minute… how did they conclude causality? Teaching experience “contributing” to research skills implies that teaching causes an increase in research skills, but that conclusion is unjustified given the non-experimental design. After a bit of digging in the online supplement, I discovered that they included the Time 1 scores as a covariate in their MANCOVA to attempt to account for pre-existing group differences, but that does not change the fact that this is a correlational study.
Sure, there are differences between groups. The causal element could be group membership (teacher-researcher vs researcher). But it could also be any number of individual differences correlated with group membership but uncorrelated with pre-test scores. Perhaps, as I suggested earlier, more highly skilled/qualified graduate students are attracted to teaching roles? Perhaps students also teaching simply have more to prove? The source of this variance is unclear.
Perhaps more disconcerting – the authors only report 2 of the 10 dimensions as statistically significant in the expected direction. The other 8 were not; in fact, one was even opposite of the hypothesized direction.
Even with these limitations, the results are still interesting. Graduate students teaching do have higher scores on two outcome dimensions, even when controlling for pre-test differences. Why does this happen? Is it causation, or an interaction between graduate student individual differences and time?
In conclusion, I found this study somewhat of a paradox. It is in Science, which is a top-tier journal by any account, but it is a non-experimental design with causal conclusions. So most surprisingly to me, this study proves you can get a correlational design from the social sciences with 95 participants published in Science. Who knew?Footnotes:
- Feldon, D., Peugh, J., Timmerman, B., Maher, M., Hurst, M., Strickland, D., Gilmore, J., & Stiegelmeyer, C. (2011). Graduate Students’ Teaching Experiences Improve Their Methodological Research Skills Science, 333 (6045), 1037-1039 DOI: 10.1126/science.1204109 [↩]
|Previous Post:||Unfolding the IKEA Effect: Why We Love the Things We Build|
|Next Post:||Gladwell Was Wrong: High and Very High Ability Employees Perform Differently|