- Research article
- Open Access
Enhancing motivation with the “virtual” supervisory role: a randomized trial
BMC Medical Education volume 15, Article number: 76 (2015)
We aimed to explore the influence of a motivationally-enhanced instructional design on motivation to learn and knowledge, hypothesizing that outcomes would be higher for the enhanced instructional format.
Medicine residents completed four online learning modules on primary care topics. Using a crossover design, learners were randomized to receive two standard and two motivationally-enhanced learning modules. Both formats had self-assessment questions, but the enhanced format questions were framed to place learners in a supervisory/teaching role. Learners received a baseline motivation questionnaire, a short motivation survey before and after each module, and a knowledge posttest.
One hundred twenty seven residents were randomized. 123 residents (97%) completed at least one knowledge posttest and 119 (94%) completed all four posttests. Across all modules, a one-point increase in the pretest short motivation survey was associated with a 2.1-point increase in posttest knowledge. The change in motivation was significantly higher for the motivationally enhanced format (standard mean change −0.01, enhanced mean change +0.09, difference = 0.10, CI 0.001 to 0.19; p = 0.048). Mean posttest knowledge score was similar (standard mean 72.8, enhanced mean 73.0, difference = 0.2, CI −1.9 to 2.1; p = 0.90).
The motivationally enhanced instructional format improved motivation more than the standard format, but impact on knowledge scores was small and not statistically significant. Learners with higher pre-intervention motivation scored better on post-intervention knowledge tests, suggesting that motivation may prove a viable target for future instructional enhancements.
A learner’s motivation can be a significant determinant in overall academic achievement. Medical educators strive to teach effectively, but unmotivated trainees may not acquire knowledge as well as trainees with higher drives to learn . Since motivation is a learner characteristic, teachers often question what they can do to improve motivation from an instructional standpoint. Previous studies on motivation have targeted learner groups with limited relevance to medical education [2-6]. Incorporation of or access to online platforms has improved motivation in college students [2,3]. In one study of a computer-aided learning environment, video-based instruction had a more motivating effect than text-based instruction . Granting a learner’s choice in training can improve motivation in adults , and in children, putting problems into fantasy contexts can improve motivation and learning . Suggestions to enhance motivation among health professions trainees have been proposed , but the most effective mechanisms to increase motivation to learn in this population are unknown.
Many models of motivation for learning incorporate some variation of two core concepts, namely expectancy (the extent to which the learner expects to succeed) and value (the importance of learning to that learner). The expectancy-value theory of motivation suggests that the expectation of success positively influences the learner’s perception of learning importance. Expectancy is influenced by a learner’s perceptions of his or her own competence, goals, and the expected difficulty of the task . Task value encompasses learners’ perception of task importance, interest in the task, and their perception of the task’s relevance to their future goals . In non-medical education research, task value perceptions predicted college students’ midterm scores , and high school students were more likely to learn mathematics and less likely to avoid mathematics when they perceived mathematics as offering high task value . Among medical students, low-performing students have reported lower task value beliefs , and task value beliefs have shown positive associations with academic achievement . There has been a call for increasing research on motivation in medical education, but as Kusurkar described in 2012, medical education literature lacks publications that link curriculum development to stimulation of learner motivation [1,14]. In this study, we aimed to explore the influence of a motivationally-enhanced instructional design on motivation to learn and knowledge scores, hypothesizing that outcomes would be higher for the enhanced format.
Empiric evidence does little to inform efforts to directly enhance motivation to learn. However, it is commonly accepted that being required to teach a topic enhances both motivation and learning, and some theories of instruction bear this out [15,16]. Limited research corroborates the idea that putting learners into a teaching or supervisory role will enhance motivation and/or learning. For example, one study found that peer tutoring activity correlated with higher motivation among medical students . Other studies have found that residents given formal teaching responsibilities showed improved learning of a given topic compared to lectures or self-study , and that residents perceive that teaching medical students improves their own learning [19,20]. Based on these promising findings, we hypothesized that placing residents in a “virtual” teaching role - that is, in the context of supervising a medical student - would enhance motivation and learning.
To evaluate this hypothesis we conducted a randomized crossover trial comparing standard and motivationally-enhanced online learning modules in a course for medicine residents.
Setting and sample
This study was undertaken at an academic medical center between November 2010 and June 2011. There were 168 residents (144 internal medicine, 24 family medicine) in the Mayo School of Graduate Medical Education in Rochester, Minnesota eligible to participate in the study. The study was deemed minimal risk and exempt after Mayo Clinic IRB review. Prior to study initiation, informed consent was obtained. As part of the consent process, participants were informed that the study would “compare two module formats to see if one format promotes more effective learning than the other”.
The Internal Medicine Ambulatory Care curriculum included four online learning modules that covered primary care topics: hypertension, obesity, coronary artery disease, and chronic obstructive pulmonary disease. These modules were updated to include current guidelines and evidence for each condition. Modules were released at approximately two-week intervals, and residents could finish available modules in any order. Each module contained text, images, hyperlinked resources, and case-based self-assessment questions. The learning modules were created using Articulate Presenter (www.articulate.com), a program that creates Flash presentations from PowerPoint slides. Both module formats consisted of didactic information with a total of 10 to 12 self-assessment questions interspersed throughout the module. The standard format self-assessment questions were typical case-based knowledge questions. The motivationally-enhanced format included the same question content, but the clinical cases were framed to have residents imagine themselves supervising a medical student in clinic. Response options were changed from a list of management approaches (standard format) to a list of responses and rationale one might use in a teaching role (enhanced format). Table 1 provides an example of each question format. Both formats provided the answer and explanation to the question immediately after the resident provided a response.
Residents who chose to participate completed two modules in the standard learning format and two in the motivationally-enhanced format. Participants were randomly assigned to one of four groups, with each group following a different sequence of module formats in a crossover exposure design (see Figure 1). MINIM (https://www-users.york.ac.uk/~mb55/guide/minim.htm) was used for randomization with stratification by post-graduate year (PGY) and continuity clinic site. Participant consent was obtained before group allocation. Residents who declined to participate in the study received all four modules in the standard format.
Instruments and outcomes
Primary outcome measures were motivation (measured at baseline and then before and after each module) and posttest knowledge score. Secondary outcome measures included time, mental effort, and perceptions of which format was more efficient, more effective for learning, more motivating and overall preferred.
To measure baseline motivation, all residents completed the Motivated Strategies for Learning Questionnaire (MSLQ) prior to beginning their first learning module . This 31-question instrument uses a 7-point scale (1 = not true of me, 7 = very true of me) and has validity evidence for use in this context . Since motivation may vary by topic, residents also completed a short 13-question motivation inventory immediately before each learning module. The pre-module short motivation inventory was adapted from the MSLQ by selecting task value and self-efficacy questions that had high factor loadings from a previous factor analysis study . The post-module short motivation inventory included task value questions (the same task value questions as in the pre-module motivation inventory), and single questions about time to complete each module, mental effort, and time elapsed between completing the module and starting the posttest. We collected information on gender, training program, and post-graduate year.
After completing each module, residents took a knowledge posttest. The test consisted of 14 to 18 (depending on the module) multiple choice questions adapted based on formal item analysis from questions used in previous research .
After finishing all four modules and posttests, residents completed a course evaluation survey containing questions about module format preference, efficiency, effectiveness, and which was more motivating (“which format did you prefer/find more efficient/find more effective/which format best motivated you to learn?”). These items used a 7-point scale (1 = strongly prefer standard format, 7 = strongly prefer enhanced format).
Posttest knowledge scores, motivation scores, time spent, and mental effort were compared between formats using mixed linear models that accounted for repeated measures and for differences between modules. Additional adjustments included residency program, post-graduate year, and gender. We analyzed format preferences using the Wilcoxon signed rank test (testing whether results differed from the scale median). Of 168 residents eligible to participate, we estimated 75% participation and 20% drop-out leaving an anticipated 100 residents to complete the study. Using an expected standard deviation of 10 percentage points, 100 subjects would provide 85% power to detect a difference of 3 points (effect size 0.3) on knowledge tests, which we felt to be a minimum meaningful difference. All individuals were analyzed in the groups to which they were randomly assigned. All analyses used two-sided alpha error of 0.05. All analyses were done using de-identified data.
One hundred twenty seven residents gave consent to participate and were randomized. One hundred twenty three residents (97%) completed at least one knowledge posttest, 119 (94%) completed all four posttests, and 64 (50%) completed the course evaluation survey as summarized in Figure 1. Table 2 summarizes demographic data. Internal consistency for the knowledge posttest was good (Cronbach’s alpha 0.76). Statistical adjustments for training program, gender, post-graduate year, and time between module completion and posttest did not change any of the study findings reported below (results not shown).
Impact of intervention on motivation, knowledge, and time
The change in task value motivation from pre-module to post-module, as measured by the short motivation inventory, was significantly higher for the motivationally-enhanced format (standard format mean change −0.01, enhanced format mean change +0.09, difference = 0.10, CI 0.001 to 0.19; p = 0.048). The mean posttest knowledge score did not differ significantly between the standard and motivationally enhanced modules (standard mean 72.8, enhanced mean 73.0, difference = 0.2, CI −1.9 to 2.1; p = 0.90). The self-reported time to complete each module and perceived mental effort were also similar between formats; see Table 3.
Association between motivation and knowledge scores
Across all modules, a one-point increase in the pretest short motivation inventory (just prior to each module) was associated with a 2.1-point increase in posttest knowledge (b = 2.1, p = 0.003). There were no statistically significant relationships between the baseline MSLQ and posttest motivation or knowledge scores.
Course evaluation and learner preferences
On the post-course evaluation, residents had no significant preference for module type (mean 3.4, CI 3.1 to 3.7, p = 0.63 compared with the scale median, N = 63). They also felt the two modules were similarly motivating (mean 4.1, CI 3.7 to 4.4, p = 0.72), efficient (mean 3.8, CI 3.5 to 4.2, p = 0.33), and effective (mean 4.0, CI 3.7-4.3, p = 1).
We hypothesized that an intervention designed to enhance motivation by having the residents imagine themselves in a supervisory role would improve both motivation and knowledge. In this randomized trial we confirmed a statistically significant improvement in task value motivation scores for the enhanced modules, but the impact on knowledge scores was small and not statistically significant. We also found an association between module-specific motivation and post-module knowledge test scores. Post-course evaluation results are limited by low response rates (which could bias results), but suggest the two modules were similar with respect to perceived effectiveness and efficiency.
The learners with higher motivation in this study had better test scores, which is consistent with previous research demonstrating associations between task value, course enjoyment, and exam results . One could argue that resident trainees, by nature of their chosen career path, have a strong motivation to learn at baseline. However, it has been suggested that negative achievement emotions can still impact performance in this type of learner . As such, baseline motivation may be a target to improve learning. It is possible that if a motivational module to enhance expectancy and task value preceded a learning module, the learner could engage in positive motivational emotions before a learning activity or knowledge test. Certain motivational teaching behaviors may enhance motivation , but a formal motivation curriculum and its effect on learning has not been explored. An intervention to increase baseline motivation could ultimately be effective for knowledge acquisition.
It is notable that topic-specific motivation (measured by the pre-module motivation inventory) was associated with improved knowledge posttest scores. By contrast, and contrary to our earlier findings , overall motivation measured by the MSLQ was not associated with knowledge scores. This suggests that motivation to learn may be topic-specific; for example, a learner might be more motivated to learn about hypertension than COPD. Future efforts to adapt instructional design may choose to target topic-specific motivation rather than general motivation; for example, having a learner commit to individual learning goals before a module may enhance self-efficacy and improve motivation to learn a specific topic.
Motivation was enhanced in this study by having learners imagine themselves in a supervisory role. This finding supports the idea that supervisory or teaching activities can stimulate motivation [15,17]. Since lower performing students have lower task value and self-efficacy beliefs , supervisory or teaching activities may be particularly important when trying to boost motivation in struggling students.
Although theories of learning and limited evidence suggest that teaching and supervisory roles should enhance learning [15-20], we failed to find evidence to support that hypothesis. Most likely, asking residents to imagine themselves in a supervisory role lacked the authenticity and urgency required to stimulate learning. Future studies could potentially enhance task value by having the virtual supervisor explain to the medical student why learning a specific module topic might be important during residency training; this could be done within a learning module or within self-assessment questions. Alternatively, a higher stakes virtual teaching role with higher acuity patients (e.g. a senior resident supervising inpatient rounds) may improve the task value of the intervention. It is also possible that learning in this study was enhanced but that the timing or measurement of this outcome was inadequate to detect the difference.
Task value motivation was the measure for this study, however, changes in other factors (e.g. feelings of well-being, fatigue, symptoms of burn-out) were not measured. There is some conflicting evidence on whether measures of well-being are associated with medical knowledge and motivation to learn [13,24]. A future study could integrate measures of well-being into its motivational assessments.
The present findings indicate that an instructional variation can influence motivation and that motivation is associated with performance. While certainly not definite, these findings show some promise and suggest the need for further research in the area of motivationally-directed instructional design.
Although there was a significant improvement in motivation, posttest knowledge scores were similar between module formats. We note that well-done negative studies contribute to the field by demonstrating what does not work in a particular situation. It is unlikely that we missed an important effect due to inadequate power, since we achieved our target sample size, and since the confidence intervals surrounding the observed difference exclude our a priori meaningful difference. This study was conducted in a single academic institution, and the baseline motivational characteristics of these participants may not reflect those of internal medicine and family medicine residents nationwide. If the residents in our sample had higher baseline motivation, it could lead to a ceiling effect (i.e., smaller potential difference between residents). As noted above, the virtual nature of the supervisory role lacked the authenticity and urgency of a real-life supervisory experience.
Additional strengths of this study included minimizing allocation bias by randomization and using motivation and knowledge assessment instruments whose scores had been validated for use in this learner population.
The findings that putting residents into a supervisory role may increase motivation, and that higher levels of motivation are associated with better test scores suggests that motivation may prove a viable target for future efforts to improve learning. Topic-specific motivation may be more amenable to enhancement than overall motivation. Further investigation into the relationship between motivational enhancements and knowledge outcomes is warranted.
Kusurkar RA, Croiset G, Mann KV, Custers E, Ten Cate O. Have motivation theories guided the development and reform of medical education curricula? A review of the literature. Acad Med. 2012;87(6):735–43.
de Lange P, Suwardy T, Mavondo F. Integrating a virtual learning environment into an introductory accounting course: determinants of student motivation. Account Educ: Int J. 2003;12(1):1–14.
Barber LK, Bagsby PG, Grawitch MJ, Buerck JP. Facilitating self-regulated learning with technology: evidence for student motivation and exam improvement. Teach Psychol. 2011;38(4):303–8.
Choi HJ, Johnson SD. The effect of context-based video instruction on learning and motivation in online courses. Am J Dist Educ. 2005;19(4):215–27.
Baldwin TT, Magjuka RJ, Loher BT. The perils of participation: effects of choice of training on trainee motivation and learning. Pers Psychol. 1991;44(1):51–65.
Parker LE, Lepper MR. Effects of fantasy contexts on children’s learning and motivation: making learning more fun. J Pers Soc Psychol. 1992;62(4):625–33.
Kusurkar RA, Croiset G, Ten Cate OTJ. Twelve tips to stimulate intrinsic motivation in students through autonomy-supportive classroom teaching derived from self-determination theory. Med Teach. 2011;33(12):978–82.
Eccles JS, Wigfield A. Motivational beliefs, values, and goals. Annu Rev Psychol. 2002;53:109–32.
Pintrich PR. The role of motivation in promoting and sustaining self-regulated learning. Int J Educ Res. 1999;31(6):459–70.
Bong M. Role of self-efficacy and task-value in predicting college students’ course performance and future enrollment intentions. Contemp Educ Psychol. 2001;26(4):553–70.
Lau S, Liem AD, Nie Y. Task- and self-related pathways to deep learning: the mediating role of achievement goals, classroom attentiveness, and group participation. Br J Educ Psychol. 2008;78(Pt 4):639–62.
Artino Jr AR, Hemmer PA, Durning SJ. Using self-regulated learning theory to understand the beliefs, emotions, and behaviors of struggling medical students. Acad Med: J Assoc Am Med Coll. 2011;86(10 Suppl):S35–8.
Artino AR, La Rochelle JS, Durning SJ. Second-year medical students’ motivational beliefs, emotions, and achievement. Med Educ. 2010;44(12):1203–12.
Artino Jr AR, Holmboe ES, Durning SJ. Can achievement emotions be used to better understand motivation, learning, and performance in medical education? Med Teach. 2012;34(3):240–4.
Merrill MD. First principles of instruction : assessing and designing effective, efficient, and engaging instruction. San Francisco, CA: Pfeiffer; 2013.
Dandavino M, Snell L, Wiseman J. Why medical students should learn how to teach. Med Teach. 2007;29(6):558–65.
Sobral DT. What kind of motivation drives medical students’ learning quests? Med Educ. 2004;38(9):950–7.
First LR, Lauerman R, Fenton T, Herzog L, Snyder JD. Learning by teaching. A resident-taught oral therapy program for acute diarrhea. Clin Pediatr (Phila). 1992;31(10):602–7.
Apter A, Metzger R, Glassroth J. Residents’ perceptions of their role as teachers. J Med Educ. 1988;63(12):900–5.
Busari JO, Prince KJ, Scherpbier AJ, Van Der Vleuten CP, Essed GG. How residents perceive their teaching role in the clinical setting: a qualitative study. Med Teach. 2002;24(1):57–61.
Pintrich PR, Smith DAF, Garcia T, McKeachie WJ. Reliability and predictive validity of the motivated strategies for learning questionnaire (MSLQ). Educ Psychol Meas. 1993;53:801–13.
Cook DA, Thompson WG, Thomas KG. The motivated strategies for learning questionnaire: score validity among medicine residents. Med Educ. 2011;45(12):1230–40.
Cook DA, Thompson WG, Thomas KG, Thomas MR. Lack of interaction between sensing-intuitive learning styles and problem-first versus information-first instruction: a randomized crossover trial. Adv Health Sci Educ. 2009;14(1):79–90.
West CP, Shanafelt TD, Cook DA. Lack of association between resident doctors’ well-being and medical knowledge. Med Educ. 2010;44(12):1224–31.
The authors acknowledge support from the Mayo Clinic Department of Medicine Write-up and Publish grant.
The authors declare that they have no competing interests.
MTW developed modules, consented participants, collected data, and wrote/edited the manuscript. KGT assisted in study design, module development, and manuscript editing. WGT assisted in study design, module development, and manuscript editing. DAC designed the study, developed modules, performed statistical analysis and edited the manuscript. All authors read and approved the final manuscript.
MTW is Assistant Professor of Medicine and Firm Chief for Resident Education, Mayo Clinic College of Medicine; and a Consultant in the Division of Primary Care Internal Medicine, Mayo Clinic, Rochester, Minnesota. KGT is Associate Professor of Medicine and Associate Program Director, Internal Medicine Residency Program, Mayo Clinic College of Medicine; and a Consultant in the Division of Primary Care Internal Medicine, Mayo Clinic, Rochester, Minnesota. WGT is an Associate Professor of Medicine, Mayo Clinic College of Medicine; and a Consultant in the Division of Preventive, Occupational, and Aerospace Medicine, Mayo Clinic, Rochester, Minnesota. DAC is Professor of Medicine and Medical Education and Associate Director, Mayo Clinic Online Learning, Mayo Clinic College of Medicine; and a Consultant in the Division of General Internal Medicine, Mayo Clinic, Rochester, Minnesota.
About this article
Cite this article
Wingo, M.T., Thomas, K.G., Thompson, W.G. et al. Enhancing motivation with the “virtual” supervisory role: a randomized trial. BMC Med Educ 15, 76 (2015). https://doi.org/10.1186/s12909-015-0348-8
- Motivation enhancement
- Task value
- Instructional design
- Test performance