Skip to main content
Download PDF

Video-based communication assessment for weight management counseling training in medical residents: a mixed methods study

BMC Medical Education volume 22, Article number: 899 (2022) Cite this article

Abstract

Background

Physician delivered weight management counseling (WMC) occurs infrequently and physicians report lack of training and poor self-efficacy. The purpose of this study was to develop and test the Video-based Communication Assessment (VCA) for weight management counseling (WMC) training in medical residents.

Methods

This study was a mixed methods pilot conducted in 3 phases. First, we created five vignettes based on our prior data and expert feedback, then administered the vignettes via the VCA to Internal Medicine categorical residents (n = 16) from a University Medical School. Analog patients rated responses and also provided comments. We created individualized feedback reports which residents were able to view on the VCA. Lastly, we conducted debriefing interviews with the residents (n = 11) to obtain their feedback on the vignettes and personalized feedback. Interviews were transcribed, and we used thematic analysis to generate and apply codes, followed by identifying themes.

Results

Descriptive statistics were calculated and learning points were created for the individualized feedback reports. In VCA debriefing interviews with residents, five themes emerged: 1) Overall the VCA was easy to use, helpful and more engaging than traditional learning and assessment modes, 2) Patient scenarios were similar to those encountered in the clinic, including diversity, health literacy and different stages of change, 3) The knowledge, skills, and reminders from the VCA can be transferred to practice, 4) Feedback reports were helpful, to the point and informative, including the exemplar response of how to best respond to the scenario, and 5) The VCA provide alternatives and practice scenarios to real-life patient situations when they aren’t always accessible.

Conclusions

We demonstrated the feasibility and acceptability of the VCA, a technology delivered platform, for delivering WMC to residents. The VCA exposed residents to diverse patient experiences and provided potential opportunities to tailor providers responses to sociological and cultural factors in WMC scenarios. Future work will examine the effect of the VCA on WMC in actual clinical practice.

Peer Review reports

Background

Currently, two-thirds of US adults are living with overweight or obesity. It is estimated that by 2030, half of Americans will have obesity, reflecting an adult population that is transitioning from overweight to obesity [1]. Weight management counseling (WMC) by physicians during routine care has shown to result in increased patient motivation, physical activity, improved diet, and clinically significant weight loss [2, 3]. Weight loss has been significantly associated with improved health outcomes and a reduction in mortality risk [4, 5]. Unfortunately, rates of WMC in primary care are suboptimal [6], and physicians report a lack of WMC training and poor self-efficacy as barriers to providing WMC to their patients [7,8,9]. WMC is challenging, as physicians must discuss complex topics (e.g., weight history, diet, physical activity), support diverse patients, and refer patients to appropriate programs. Thus training across the medical education continuum is recommended [10,11,12,13]. Curriculum guidelines, competencies and learning objectives for WMC have been recommended by the Association of American Medical Colleges [14], but integration into curriculum has been limited [15]. Residency is a key time in physicians training as they assume major patient care responsibilities and learn critical skills in ambulatory practice [16, 17]. However, residents are unprepared to provide WMC and require a comprehensive evidence-based program [17,18,19].

Integrating a new training program within the residency curriculum is challenging. Residents’ schedules are complex as they divide their time between providing care at the hospital and ambulatory setting. The learning needs of medical trainees also change over the course of training. While the focus is on foundational training in medical school, it shifts towards experiential learning during residency. The Video-based Communication Assessment (VCA) is an innovative system providing experiential learning through practice and feedback developed by the National Board of Medical Examiners (NBME) [20,21,22,23]. The VCA presents the learner with brief vignettes depicting various patient scenarios and captures learners’ spoken communication (i.e., their actual words and voice tone) in response to vignettes. Accessible via smartphone application or web browser, the VCA allows learners to practice and receive feedback on their communication with patients in their own time. Thus, the VCA may be well-suited to support the learning needs of the residents.

In this paper we describe the development and testing of patient vignettes in the VCA regarding WMC for medical residents and subsequently providing formative feedback on their skill. We also examined the acceptability and practical application of the VCA system from the point of view of medical residents following use of the system.

Methods

Design

This study was a mixed methods pilot conducted in 3 phases (see Fig. 1). The study team consisted of medical school researchers (JF, KM, LP, RS, JO), NBME researchers (AD, AK) and one clinician educator (EM) who had extensive experience in designing, implementing, and evaluating weight management curricula. The study team was assisted by four clinical provider expert consultants with experience in WMC. First, the study team created five vignettes intended to elicit each of the 5As (Ask, Advise, Assess, Assist, and Arrange). The 5As framework has also been used in prior trials to teach and evaluate the quality of patient-centered counseling [24] and WMC [25, 26]. Our teams prior work using the 5As framework showed they provided an efficient approach for busy clinicians seeking to counsel patients in brief encounters [27,28,29]. Next, we administered the vignettes to Internal Medicine residents from a University Medical School, including obtaining crowdsourced ratings from analog patients and creating and providing the personalized feedback which residents were able to view on the VCA. Lastly, we conducted debriefing interviews with the residents who completed the VCA to obtain their feedback on the vignettes and personalized feedback. This study was approved by the Institutional Review Board at the University Medical School.

Fig. 1
figure 1

Overall study design by phase

Full size image

Phase 1: vignette development

First, the study team drew on their prior trial examining the effect of a multi-modal WMC on counseling skills for health behavior change in medical students [30]. The prior trial compared students receiving the multi-modal WMC curriculum to those receiving traditional education on outcomes of a 23-item checklist integrated into the 5A framework based on the 2013 Guideline for the Management of Overweight and Obesity in Adults published by The Obesity Society and American College of Cardiology/American Heart Association [31]. We first highlighted checklist items that fewer than 50% of the intervention students performed during a study assessment. For example, only 24.6% discussed weight history and prior weight loss experience with their patient. Once this list was created, the team then solicited feedback from four external clinical providers with extensive experience in WMC. With their feedback, the team came to consensus on the 5 essential behaviors (of the original 23) to assess in patient scenarios, including one for each of the 5A constructs (see Results). The team then received training in how to create the description of the clinical situation, and patient script. Two research team members each created one of the five vignettes, which were reviewed and revised by the entire team. We solicited feedback from the Program Director for the Primary Care Track in the Internal Medicine residency program (EM) at the University Medical School in the process. Once vignettes and scripts were finalized, we recruited a diverse group of actors to portray the vignettes and videotaped them. The actors were portrayed in the vignettes multiple times, changing their voice tones, facial expressions etc. The team reviewed the videos and selected the ones that would be the most appropriate for the residents. Figure 2 shows the sample VCA case.

Fig. 2
figure 2

Sample VCA case

Full size image

Phase 2: VCA pilot testing

Administration of the VCA

The Internal Medicine residency program director emailed all third year Internal Medicine Residency students and the post-doctoral fellows (N = 56) enrolled in the Fellowship programs at UMass Medical School. The email introduced them to the study through a Fact Sheet and asked for voluntary participation. Two reminder emails were sent to non-respondents. Residents and post-doctoral fellows who volunteered were provided detailed instructions on how to log on to a dedicated website or download the freely available National Board of Medical Examiners (NBME) VCA app on a smartphone or tablet. Participants who completed the VCA pilot were provided a $50 gift card to compensate them for their time.

Crowdsourced ratings and comments

We used the Amazon Mechanical Turk platform [32, 33] to recruit analog patients to review, rate, and comment on the responses. Analog patients are untrained lay people who are asked to rate their impressions of a medical interaction while imagining themselves as the patient in the encounter [34]. They are often used to assess patient perceptions when using traditional patients is unethical or impractical due to high costs and lack of time [32,33,34]. Analog patients have been shown to produce reliable ratings of physician communication skills using the VCA [35].

Each resident response was rated by 10–22 analog patients for five items, with the stem of “I would feel this provider…” 1. Understood how I was feeling, 2. Cared about me, 3. Respected what I had to say, 4. Listened carefully to me, and 5. Explained things in a way I could understand. Response options included: 1) Not at all 2) A little 3) Somewhat 4) Very much 5) Completely. A final rating question asked: “Overall, this provider’s response was:” with response options being 1) Poor 2) Fair 3) Good 4) Very Good 5) Excellent. After rating the last response in the set, the analog patient was prompted to answer a single open-ended question: “What would you want the provider to say if you were the patient in this situation?” We calculated individual means and standard deviations from these 6 questions of the resident’s response for each vignette generated from the analog patients’ rating, along with the cohort’s mean and standard deviations. We also calculated their overall score (mean score across all 5 vignettes), and the cohort overall mean. Quantitative ratings were created by averaging the 6 Likert scale questions; thus, the continuous scores were derived from ordinal approximations of continuous variables.

Creation of feedback reports

Based on analog patient ratings, the team reviewed the top three resident responses for each vignette and selected an exemplary response to be included in the feedback reports. We then generated actionable recommendations called “Learning Points”, on how to communicate effectively in the specific situation portrayed in the vignette, drawing heavily on the analog patients’ feedback on what they would have liked the resident to have said [36]. The final VCA feedback reports included three key elements: 1) analog patient ratings summarized as described above, 2) access to the audio recording of the exemplary response, and 3) “learning points” for each vignette based on careful review of the analog patients’ comments on what they would have wanted the provider to say, curated by communication experts to ensure appropriateness and clarity. The residents own response was also included in the feedback report to allow for comparison, and the original vignette text and video was available as context if desired. Residents received this report within 4 weeks of completing the VCA. Figure 3 depicts a sample VCA feedback report.

Fig. 3
figure 3

Sample feedback report

Full size image

Phase 3: resident debriefing interviews

We conducted semi-structured telephone interviews with participants who completed the VCA training with the goal of exploring residents’ use and perception of the VCA and their implementation into practice. The interview guide was developed iteratively with qualitative experts and VCA developers on the team. Residents who completed the training were sent an email invitation. Interviews were approximately 30-min in length, conducted by a research team member (see Additional file 1). All participants provided verbal consent prior to completing the interview. Participants who completed interviews were provided a $50 gift card to compensate them for their time.

Analysis

All quantitative data presented were calculated using R version 4.1.0, including means and standard deviations of the analog patients’ ratings for each individual user and the entire cohort by vignette. For creation of the learning points and selecting exemplar responses, research team members were oriented to the process previously described by Mazor et al. [36]. After analog patients’ written responses to the open-ended question were downloaded into an Excel spreadsheet, unusable responses (blank or irrelevant statements) were removed from the analysis. Two research team members were assigned to each vignette to develop learning points based on the previously used approach of thematic analysis [37]. This involved generating codes and applying them to the data, using an iterative, inductive process to generate more codes as the data was analyzed. We generated themes from the data and selected illustrative quotes to represent each theme. Learning points and illustrative quotes were collated and presented to the entire research team for refinement, and to ensure that these were consistent with known best practices. Exemplar responses were selected from user responses that had the highest mean analog patient ratings by vignette.

All debriefing interviews were transcribed verbatim. We used thematic analysis to generate and apply codes, followed by identifying themes and illustrative quotes representing each theme. Four research team members each reviewed subsets of the transcripts in full, then, using open-ended coding, assigned codes/themes to segments of the text. Team members then met to conduct coding checks to ensure inter-rater agreement and resolve any disputes in coding [38]. Once resolved, they discussed perspectives and themes that emerged from the interviews. Emergent themes related to residents’ perceptions of the VCA and implementation into practice arose. Those themes and illustrative quotes are outlined in detail.

Results

Of the 56 eligible residents, twenty-one initiated the VCA. Of the twenty-one, sixteen completed the full VCA pilot. Of the 16, eleven were male (68.8%) and 5 were female (31.2%). All participants were Internal Medicine categorial residents.

Ratings, learning points and exemplar responses

The characteristics of the analog patient raters are presented in Table 1. More than half were males (n = 129, 57%) and higher educated, holding a Bachelor’s degree or higher (n = 183, 81%). The overall mean rating of residents’ responses to the vignettes from the analog patients was 3.7 (standard deviation 0.2, range 3.3, 4.1). By 5A construct, the means ranged from 3.55 to 3.85 on a scale of 1 to 5 (see Table 2). The learning points and illustrative quotes by vignette (and 5A construct) are also shown in Table 2. Analog patients provided recommendations on how they would like the provider to respond. Some also provided direct language on what the provider should say to someone in that scenario.

Table 1 Analog patient rater characteristics (N = 226)
Full size table
Table 2 Overall mean (SD) ratings and sample learning points and illustrative quotes by vignette/5A construct
Full size table

Qualitative feedback from VCA debriefing

Of the 16 participants completing the VCA, 11 completed debriefing interviews. We identified five themes regarding resident experiences with the VCA and application to practice. We present the themes and illustrative quotes below:

Theme 1: Overall the VCA was easy to use, helpful and more engaging than traditional learning and assessment modes

Participants noted the VCA was more engaging and provided additional ways to learn outside of the usual methods.

“VCA is a very cool app. And it's a nice, interesting way of being more engaging than us reading through PowerPoint slides.”

“And in medical school we have written exams, but there's not many oral exams really, or low pressure things like this was, because I could record again, so it was very low pressure.”

Participants noted the ease of using the app and liked being able to do it at their convenience.

“I thought the app was really easy to use. I honestly woke up, I made breakfast and then I just did it while I was eating breakfast and it was super easy.”

Theme 2: Patient scenarios were similar to those encountered in the clinic, including diversity, health literacy and different stages of change

Participants noted the similarities in the VCA to what they actually see in the clinic.

“I thought it was realistic. Like everything that happened in those case scenarios is something that I've encountered in clinic.”

Participants discussed the physical and psychosocial diversity presented in scenarios, including patient’s readiness to change and motivation levels.

“I think you had a good range of people. I mean, different demographics and also different stages of change and different kind of understanding of what's going on with their health and health literacy as well.”

“…and you had some diverse reactions to things, which I thought was pretty interesting just because it's not all just people who are motivated or positive. There are people who are defensive... So it was a nice spectrum of how people could respond..”

Theme 3: The knowledge, skills, and reminders from the VCA can be transferred to practice

Some residents intended to implement their new knowledge and skills into their own WMC practices with patients.

“I think the fact that you are providing an ideal response, you actually have something that you're using, you're getting the tone of voice, you're getting everything in there and then you can just copy that if you want to and implement that in your own practice.”

“I'll definitely bring it up to my patients more knowing how it should be done because I know it's a very sensitive topic for some people and just having this guideline really helps bring up the topic to patients. Just knowing how people appreciate it being done.”

“I had the opportunity to think about what I wanted to say without the pressure of somebody sitting there in front of me. I think it was helpful in the sense that weight can be a very uncomfortable topic for anybody. So just having the opportunity to think about it before I say something gives me like a little bit of a rubric that I can spring off of next time that it's in-person.”

Theme 4: Feedback reports were helpful, to the point and informative, including the exemplar response of how to best respond to the scenario.

Participants noted that getting feedback on the ideal response and what the patient wanted to hear was very helpful.

“I enjoyed how every patient there was a bullet of exactly what an ideal response would be. I felt like I made it more purposeful because I think that feedback is one of the best ways that we learn in that… having deep feedback as detailed as it was, was important. You can see that bar graph at the top that compared you to your peers so you get a better understanding of how well or how poorly you did not that that was the point of this exercise, but if you just get an idea of how much, or how little you need to refine your skills. I actually really enjoyed the way the format was. They hit the strong points without rambling too much”

“I thought it was helpful at the very end where it was kind of like the highlights of what the patient would have wanted to hear. I think those little nuggets are the most helpful.”

Theme 5: The VCA provides alternative and practice scenarios to real-life patient situations when they are not always accessible

Participants made mention of appreciating the clinical encounters when they were not actually able to be in the clinic or practice with real patients.

“Especially if we're in a situation where now there's like more EA learning and you know, the students are not going to have those patient encounters through OSCEs or however they were used to doing them. I think this is a great way to work around that.”

“With COVID we miss a lot of our clinic time, so I felt like I missed a big chunk of it. And just to have something to refresh me about how things are done in the clinic is really good.”

“...you do get to kind of do a dry run of what you want to say in a whole bunch of different scenarios before you actually speak to a patient…”

Discussion

This study demonstrates the VCA is a promising tool for supporting residents in learning weight management counseling. Residents responded favorably, indicating the VCA is usable and acceptable. Different learning styles may benefit from the use of multi modal techniques, as noted by the residents’ mention of the VCA being more engaging than traditional methods of PowerPoint slides. Residents also felt the assessments were “low stakes”, providing unique opportunities to improve their skills through practice without being penalized.

Analog patients are becoming more widely used in research and are a valuable source of bringing the patient’s voice into the clinical encounter [39]. Responses of the analog patient raters underscore patients’ desire for empathy, understanding, compassion and caring in addressing their weight concerns. This is consistent with Mazor and colleagues’ findings of patients offering advice for how providers can empathize with patients [36]. For example, analog patients stated, “I'd want to hear the doctor being empathetic, warm, and taking time to point out it was a journey that they, too, cared about me taking.” Prior health interventions have found that expert-written messages were more “biomedical” (avoidance, behavioral strategies, health), while peer messages had more “social” and “real-life” content (expectations, money, quality of life, attitudes, and friends) [40]. Providing lay language from analog patients on how to communicate may help providers resonate with patients as they can reflect shared experiences and possibly address sociocultural characteristics [41]. One analog patient touched upon shared experiences with providers, “…if the provider used more language to reaffirm how I was feeling or perhaps even references their own struggle at times…”.

During the vignette development process, we aimed to provide a diverse sample of patients and clinical scenarios. Residents’ comments in the interviews suggest we achieved this (i.e., “…you had a good range of people…different demographics, different stages of change and health literacy …you had some diverse reactions to things”). Preparing medical residents to encounter diverse patient populations is critical. Racial and ethnic disparities have been noted in obesity and chronic health conditions – Non-Hispanic Black and Hispanic adults have the greatest prevalence of obesity in the US [42]. Racial and ethnic differences are associated with higher mortality rates from diabetes, cardiovascular disease, and cancer [43]. There is a need for culturally sensitive approaches to weight management interventions [44]. The opportunity to practice communicating with patients from different backgrounds via the VCA may provide opportunities to tailor exemplar responses to contextual factors for patient scenarios and characteristics.

COVID-19 presented a challenge to residency training programs across the US. Residency directors moved classes to online formats, restricting site rotations, and limiting in-person gatherings in order to reduce patient contact and reduce the spread of the virus [45, 46]. Though the VCA technology was developed prior to COVID-19, it can help to address these challenges. While WMC is the focus of our trial, prior work using the VCA has included other patient scenarios, including medication adherence, antibiotic use, medication costs and recent medical diagnoses [36]. Given the customizable nature of the VCA tool, it presents opportunities for other clinical scenarios to be presented and skills practiced. A common theme that emerged from resident interviews was the knowledge, skills, obtained via the VCA is transferable; many residents volunteered that they intended to implement what they had learned into their own WMC practices. Several behavioral theories suggest that behavioral intentions predict subsequent behavior [47,48,49], including in healthcare professionals [50]. Given that many moderating factors and complexities of patient encounters may lessen the ability to predict actual behavior, vignettes have been used to address this. Prior work using vignettes to predict prescribing behavior amongst physicians explained 26.8% of variance in behavior assessed objectively [51], and vignettes may hold promise in increasing physicians behavioral performance and subsequent behavioral intentions [50].

This study has limitations. As noted in Mazor et al. [22], future trials need to assess whether VCA scores are correlated with other measures of clinician-patient communication, patient experience, or patient satisfaction, potentially through patient exit interviews. It is also necessary to assess whether practice and feedback using the VCA results in improved provider performance in delivering effective WMC to patients in routine clinical care. We see these as next steps in a large-scale randomized trial implementing VCA training into medical education curriculum. Further consideration needs to be given to examining the associations between analog patient characteristics, including gender, race, ethnicity, education, and weight status, and their ratings of responses. Like prior work using the Amazon Mechanical Turk platform to recruit analog patients [36, 39, 52,53,54,55], our analog patients had high education levels. We were also unaware of the weight status of our analog patients, thus they may not represent a population with overweight and obesity. However, recent data show analog patient responses to two patient communication vignettes (cancer and obesity) from analog patients with those conditions were highly correlated to responses from analog patients without those conditions [56]. While the VCA has the option to restrict analog patient raters to meet prescreening patient criteria, analog patient responses and ratings from those without pre-specified health conditions may serve as proxies, but further research is warranted. We also were unable to conduct comparisons of provider characteristics on preferences for use of the VCA for WMC, despite prior evidence that female physicians have displayed less negative attitudes toward WMC than their male counterparts [57]. With our qualitative interview sample consisting of 69% males showing a high overall level of acceptability for WMC training via the VCA, future larger trials may investigate gender differences. Lastly, we created patient vignettes addressing provider 5A behaviors we observed were lacking (< 50%) in our prior trial, but other behaviors may need to be addressed or frameworks studied.

Conclusion

We demonstrated the feasibility and acceptability of the VCA, a technology delivered platform, to deliver WMC to medical residents. Our use of analog patients to review and respond to residents WMC responses allowed us to generate learning points for each of the 5A constructs our vignettes addressed. Further, residents noted appreciating the diversity and range of patient experiences to which the VCA exposed them, providing potential opportunities to tailor providers’ responses to sociological and cultural factors in WMC scenarios. As medical evidence is constantly evolving, several organizations, including the Institute of Medicine and the Obesity Medicine Education Collaborative, recommend WMC training beyond medical school to reinforce and extend prior training [58, 59]. The VCA would be a novel and convenient approach to provide this training. Future work will examine the effect of the VCA on WMC in actual clinical practice.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Abbreviations

NBME:

National Board of Medical Examiners

WMC:

Weight management counseling

VCA:

Video Communication Assessment

References

  1. Ward ZJ, Bleich SN, Cradock AL, Barrett JL, Giles CM, Flax C, et al. Projected U.S. State-Level Prevalence of Adult Obesity and Severe Obesity. New Engl J Med. 2019;381(25):2440–50.

    Article  Google Scholar 

  2. Kreuter MW, Chheda SG, Bull FC. How does physician advice influence patient behavior?: Evidence for a priming effect. Arch Fam Med. 2000;9(5):426.

    Article  Google Scholar 

  3. Rose S, Poynter P, Anderson J, Noar S, Conigliaro J. Physician weight loss advice and patient weight loss behavior change: a literature review and meta-analysis of survey data. Int J Obes. 2013;37(1):118–28.

    Article  Google Scholar 

  4. Group LAR, Yeh HC, Bantle JP, Cassidy-Begay M, Blackburn G, Bray GA, et al. Intensive weight loss intervention and cancer risk in adults with type 2 diabetes: analysis of the Look AHEAD randomized clinical trial. Obesity. 2020;28(9):1678–86.

    Article  Google Scholar 

  5. Cohen JB. Hypertension in obesity and the impact of weight loss. Curr Cardiol Rep. 2017;19(10):1–8.

    Article  Google Scholar 

  6. Bleich SN, Pickett-Blakely O, Cooper LA. Physician practice patterns of obesity diagnosis and weight-related counseling. Patient Educ Couns. 2011;82(1):123–9.

    Article  Google Scholar 

  7. Kushner RF. Barriers to providing nutrition counseling by physicians: a survey of primary care practitioners. Prev Med. 1995;24(6):546–52.

    Article  Google Scholar 

  8. Block JP, DeSalvo KB, Fisher WP. Are physicians equipped to address the obesity epidemic? Knowledge and attitudes of internal medicine residents. Prev Med. 2003;36(6):669–75.

    Article  Google Scholar 

  9. Thompson SC, Schwankovsky L, Pitts J. Counselling patients to make lifestyle changes: the role of physician self-efficacy, training and beliefs about causes. Fam Pract. 1993;10(1):70–5.

    Article  Google Scholar 

  10. Kushner RF, Horn DB, Butsch WS, Brown JD, Duncan K, Fugate CS, et al. Development of Obesity Competencies for Medical Education: A Report from the Obesity Medicine Education Collaborative. Obesity (Silver Spring, Md). 2019;27(7):1063–7.

    Article  Google Scholar 

  11. Ryan MS, Lockeman KS, Feldman M, Dow A. The Gap Between Current and Ideal Approaches to the Core EPAs: A Mixed Methods Study of Recent Medical School Graduates. Medical Science Educator. 2016;26(3):463–73.

    Article  Google Scholar 

  12. Mastrocola MR, Roque SS, Benning LV, Stanford FC. Obesity education in medical schools, residencies, and fellowships throughout the world: a systematic review. Int J Obes. 2020;44(2):269–79.

    Article  Google Scholar 

  13. Bull J. Literature, Tools and Curricula Supporting the Core Entrustable Professional Activities Pilot Study: Working Document Copyright AAMC 2017. Updated 06/26/2017. Available from: https://drive.google.com/file/d/0BxGdxLZGVpwHazgwTG5yckJrbTg/view.

  14. AoAM C. Report VIII Contemporary Issues in Medicine: The Prevention and Treatment of Overweight and Obesity. Medical School Objectives Project. 2007.

  15. Chisholm A, Hart J, Mann KV, Harkness E, Peters S. Preparing medical students to facilitate lifestyle changes with obese patients: a systematic review of the literature. Acad Med. 2012;87(7):912–23.

    Article  Google Scholar 

  16. Accreditation Council for Graduate Medical Education. Common Program Requirements 2021. Available from: https://www.acgme.org/globalassets/PFAssets/ProgramRequirements/CPRResidency2021.pdf.

  17. Butsch WS, Robison K, Sharma R, Knecht J, Smolarz BG. Medicine Residents are Unprepared to Effectively Treat Patients with Obesity: Results from a U.S. Internal Medicine Residency Survey. J Med Educ Curr Dev. 2020;7:2382120520973206.

    Google Scholar 

  18. Vitolins MZ, Crandall S, Miller D, Eddie I, Marion G, Spangler JG. Obesity Educational Interventions in U.S. Medical Schools: A systematic Review and Identified Gaps. Teaching and Learning in Medicine: An International Journal. 24. 2012 ed. London, England: Routledge; 2012. p. 267–72.

  19. Adams KM, Kohlmeier M, Zeisel SH. Nutrition education in U.S. medical schools: latest update of a national survey. Acad Med. 2010;85(9):1537–42.

    Article  Google Scholar 

  20. NBME. Video Based Communication Assessment- National Board Medical Examiners [Web]. NBME; 2018. (Cited 2018 Feb 28). Available from: https://www.youtube.com/watch?v=ZqdZKVk7aak.

  21. KM M, A K, R H, A DA, TG M, AF T, et al. Using Crowdsourced Analog Patients to Provide Feedback on Physician Communication Skills (In press). Patient education and counseling. 2021.

  22. Mazor KM, King AM, Hoppe RB, Kochersberger AO, Yan J, Reim JD. Video-Based Communication Assessment: Development of an Innovative System for Assessing Clinician-Patient Communication. JMIR Med Educ. 2019;5(1):e10400.

    Article  Google Scholar 

  23. Kathleen Mazor E, Ann King, MA, Ruth Hoppe, MACP, MD, Angelo D'Addario, MA, Thomas H., Gallagher M, editors. Using Crowdsourced Analog Patients to Provide Feedback on Physician Communication. International Conference on Communication in Healthcare 2019; SAn Diego, CA.

  24. Glasgow RE, Emont S, Miller DC. Assessing delivery of the five ‘As’ for patient-centered counseling. Health Promot Int. 2006;21(3):245–55.

    Article  Google Scholar 

  25. Jay M, Gillespie C, Ark T, Richter R, McMacken M, Zabar S, et al. Do internists, pediatricians, and psychiatrists feel competent in obesity care? J Gen Intern Med. 2008;23(7):1066–70.

    Article  Google Scholar 

  26. Jay M, Schlair S, Caldwell R, Kalet A, Sherman S, Gillespie C. From the patient’s perspective: the impact of training on resident physician’s obesity counseling. J Gen Intern Med. 2010;25(5):415–22.

    Article  Google Scholar 

  27. Ockene JK, Kristeller J, Goldberg R, Amick TL, Pekow PS, Hosmer D, et al. Increasing the efficacy of physician-delivered smoking interventions: a randomized clinical trial. J Gen Intern Med. 1991;6(1):1–8.

    Article  Google Scholar 

  28. Ockene JK, Adams A, Hurley TG, Wheeler EV, Hebert JR. Brief physician- and nurse practitioner-delivered counseling for high-risk drinkers: Does it work? Arch Intern Med. 1999;159:2198–205.

    Article  Google Scholar 

  29. Ockene IS, Hebert JR, Ockene JK, Saperia GM, Stanek E, Nicolosi RJ, et al. Effect of physician-delivered nutrition counseling training and an office-support program on saturated fat intake, weight, and serum lipid measurements in a hyperlipidemic population: Worcester Area Trial for Counseling in Hyperlipidemia (WATCH). Arch Intern Med. 1999;159(7):725–31.

    Article  Google Scholar 

  30. Ockene JK, Pbert L, Crawford S, Frisard CF, Pendharkar JA, Sadasivam RS, et al. Teaching medical students to help patients manage their weight: outcomes of an eight-school randomized controlled trial. J Gen Intern Med. 2021;36(10):3000–7.

    Article  Google Scholar 

  31. Jensen MD, Ryan DH, Apovian CM, Ard JD, Comuzzie AG, Donato KA, et al. AHA/ACC/TOS guideline for the management of overweight and obesity in adults: a report of the American College of Cardiology/American Heart Association Task Force on Practice Guidelines and The Obesity Society. Circulation. 2014;129(25 Suppl 2):S139–40.

    Google Scholar 

  32. Sheehan KB. Crowdsourcing research: Data collection with Amazon’s Mechanical Turk. Commun Monogr. 2018;85(1):140–56.

    Article  Google Scholar 

  33. Buhrmester M, Kwang T, Gosling SD. Amazon’s Mechanical Turk: A New Source of Inexpensive, Yet High-Quality, Data? Perspect Psychol Sci. 2011;6(1):3–5.

    Article  Google Scholar 

  34. Blanch-Hartigan D, Hall JA, Krupat E, Irish JT. Can naive viewers put themselves in the patients’ shoes?: reliability and validity of the analogue patient methodology. Med Care. 2013;51(3):e16-21.

    Article  Google Scholar 

  35. White AA, King AM, D’Addario AE, Brigham KB, Dintzis S, Fay EE, et al. Video-Based Communication Assessment of Physician Error Disclosure Skills by Crowdsourced Laypeople and Patient Advocates Who Experienced Medical Harm: Reliability Assessment With Generalizability Theory. JMIR Medical Education. 2022;8(2):e30988.

    Article  Google Scholar 

  36. Mazor KM, King AM, Hoppe RB, D’Addario A, Musselman TG, Tallia AF, et al. Using crowdsourced analog patients to provide feedback on physician communication skills. Patient Educ Couns. 2021;104(9):2297–303.

    Article  Google Scholar 

  37. Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3(2):77–101.

    Article  Google Scholar 

  38. Osika A. mHealth Monitor 2017. (5/16/2019). Available from: Available at: https://smokefree.gov/mhealthmonitor/inter-rater-reliability-irr-valuable-metric-qualitative-research.

  39. Blanch-Hartigan D, Hall JA, Krupat E, Irish JT. Can naive viewers put themselves in the patients’ shoes?: reliability and validity of the analogue patient methodology. Med Care. 2013;51(3):e16–21.

    Article  Google Scholar 

  40. Coley HL, Sadasivam RS, Williams JH, Volkman JE, Schoenberger YM, Kohler CL, et al. Crowdsourced peer- versus expert-written smoking-cessation messages. Am J Prev Med. 2013;45(5):543–50.

    Article  Google Scholar 

  41. Coley HL, Sadasivam RS, Williams JH, Volkman JE, Schoenberger YM, Kohler CL. Crowdsourced peer- versus expert-written smoking-cessation messages. Am J Prev Med. 2013;45:543–50.

    Article  Google Scholar 

  42. Petersen R, Pan L, Blanck HM. Racial and Ethnic Disparities in Adult Obesity in the United States: CDC’s Tracking to Inform State and Local Action. Prev Chronic Dis. 2019;16:E46-E.

    Article  Google Scholar 

  43. Harper S, Lynch J, Burris S, Smith GD. Trends in the black-white life expectancy gap in the United States, 1983–2003. JAMA. 2007;297(11):1224–32.

    Article  Google Scholar 

  44. Lindberg NM, Stevens VJ, Halperin RO. Weight-loss interventions for hispanic populations: the role of culture. J Obes. 2013;2013. Article ID 542736, 6 pages. https://doi.org/10.1155/2013/542736.

  45. Ferrel MN, Ryan JJ. The Impact of COVID-19 on Medical Education. Cureus. 2020;12(3):e7492-e.

    Google Scholar 

  46. Chick RC, Clifton GT, Peace KM, Propper BW, Hale DF, Alseidi AA, et al. Using Technology to Maintain the Education of Residents During the COVID-19 Pandemic. J Surg Educ. 2020;77(4):729–32.

    Article  Google Scholar 

  47. Bandura A, Freeman WH, Lightsey R. Self-efficacy: the exercise of control. J Cogn Psychother. 1997;13:158–66. https://doi.org/10.1891/0889-8391.13.2.158.

    Article  Google Scholar 

  48. Ajzen I. The theory of planned behavior. Organ Behav Hum Decis Process. 1991;50(2):179–211.

    Article  Google Scholar 

  49. Fishbein M, Ajzen I. Belief, attitude, intention, and behavior: an introduction to theory and research. Reading, Mass.: Addison-Wesley Pub. Co; 1975 1975//.

  50. Godin G, Bélanger-Gravel A, Eccles M, Grimshaw J. Healthcare professionals’ intentions and behaviours: A systematic review of studies based on social cognitive theories. Implement Sci. 2008;3(1):36.

    Article  Google Scholar 

  51. Harrell GD, Bennett PD. An evaluation of the expectancy value model of attitude measurement for physician prescribing behavior. J Mark Res. 1974;11(3):269–78.

    Article  Google Scholar 

  52. Berinsky AJ, Huber GA, Lenz GS. Evaluating online labor markets for experimental research: Amazon. com’s Mechanical Turk. Pol Anal. 2012;20(3):351–68.

    Article  Google Scholar 

  53. Casey LS, Chandler J, Levine AS, Proctor A, Strolovitch DZ. Intertemporal differences among MTurk workers: Time-based sample variations and implications for online data collection. SAGE Open. 2017;7(2):2158244017712774.

    Article  Google Scholar 

  54. Hillen MA, de Haes HC, van Tienhoven G, van Laarhoven HW, van Weert JC, Vermeulen DM, et al. Oncologists’ non-verbal behavior and analog patients’ recall of information. Acta Oncol. 2016;55(6):671–9.

    Article  Google Scholar 

  55. Van Vliet LM, Van Der Wall E, Albada A, Spreeuwenberg PM, Verheul W, Bensing JM. The validity of using analogue patients in practitioner–patient communication research: systematic review and meta-analysis. J Gen Intern Med. 2012;27(11):1528–43.

    Article  Google Scholar 

  56. D’Addario A, King, A., Mazor, K., Houriet, A., Musselman, T., Hoppe, R., editor Similarities between clinically matched and unmatched analogue patient raters: a mixed methods study. International Conference on Communication in Healthcare; 2022; Glasgow, UK. In Press.

  57. Foster GD, Wadden TA, Makris AP, Davidson D, Sanderson RS, Allison DB, et al. Primary care physicians’ attitudes about obesity and its treatment. Obes Res. 2003;11(10):1168–77.

    Article  Google Scholar 

  58. Kushner RF, Horn DB, Butsch WS, Brown JD, Duncan K, Fugate CS, et al. Development of obesity competencies for medical education: a report from the Obesity Medicine Education Collaborative. Obesity. 2019;27(7):1063–7.

    Article  Google Scholar 

  59. Vanselow N, Cuff PA. Improving medical education: Enhancing the behavioral and social science content of medical school curricula. 2004.

    Google Scholar 

Download references

Acknowledgements

Not applicable

Funding

The corresponding author was supported through the NHLBI (1K12HL138049-01). The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.

Author information

Authors and Affiliations

  1. Department of Population and Quantitative Health Sciences, University of Massachusetts Chan Medical School, 368 Plantation St, Worcester, MA, 01605, USA

    Jamie M. Faro, Lori Pbert, Rajani S. Sadasivam & Judith K. Ockene

  2. National Board of Medical Examiners, Philadelphia, USA

    Angelo D’Addario & Ann M. King

  3. Meyers Health Care Institute, University of Massachusetts Medical School, 385 Grove St, Worcester, MA, USA

    Kathleen M. Mazor

  4. Department of Medicine, University of Massachusetts Chan Medical School, 55 Lake Ave. North, Worcester, MA, USA

    Kathleen M. Mazor & Elizabeth A. Murphy

  5. Department of Social and Behavioral Sciences, Harvard University, 677 Huntington Ave, Cambridge, MA, USA

    Alan C. Geller

Authors
  1. Jamie M. Faro
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Angelo D’Addario
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ann M. King
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Kathleen M. Mazor
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Lori Pbert
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Rajani S. Sadasivam
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Alan C. Geller
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Elizabeth A. Murphy
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Judith K. Ockene
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

JF: Conceptualization, Methodology, Formal Analysis, Writing; AD: Conceptualization, Methodology, Formal Analysis, Writing; AK: Conceptualization, Methodology, Formal Analysis, Writing; KM: Conceptualization, Methodology, Formal Analysis, Writing; LP: Conceptualization, Writing, Investigation; RS: Methodology, Formal Analysis, Writing; AG: Conceptualization, Formal Analysis, Writing; EM: Methodology, Supervision, Writing; JK: Supervision, Conceptualization, Formal Analysis, Writing. All authors reviewed the manuscript. The author(s) read and approved the final manuscript.

Corresponding author

Correspondence to Jamie M. Faro.

Ethics declarations

Ethics approval and consent to participate

Approval was obtained from the Institutional Review Board at the University of Massachusetts Medical School. Verbal consent was obtained from participants given the remote nature of data collection and minimal risk of the study, as determined, and approved by the Institutional Review Board at UMass Chan Medical School. The procedures used in this study adhere to the tenets of the Declaration of Helsinki.

Consent for publication

All participants recorded for the Video Communication Assessment vignettes have signed media consent forms stating that the National Board of Medical Examiners owns the rights to the videos.

Competing interests

The authors declare that they have no competing interests" in this section.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

Interview questions for VCA debriefing.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Faro, J.M., D’Addario, A., King, A.M. et al. Video-based communication assessment for weight management counseling training in medical residents: a mixed methods study. BMC Med Educ 22, 899 (2022). https://doi.org/10.1186/s12909-022-03984-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12909-022-03984-6

Keywords

BMC Medical Education

ISSN: 1472-6920

Contact us