Skip to content

Advertisement

BMC Medical Education

What do you think about BMC? Take part in

Open Access
Open Peer Review

This article has Open Peer Review reports available.

How does Open Peer Review work?

Perceptions of mistreatment among trainees vary at different stages of clinical training

  • Afif N. Kulaylat1,
  • Danni Qin2,
  • Susie X. Sun1,
  • Christopher S. Hollenbeak1, 3,
  • Jane R. Schubart1,
  • Antone J. Aboud2,
  • Donald J. Flemming4,
  • Peter W. Dillon1,
  • Edward R. Bollard5 and
  • David C. Han1Email author
BMC Medical EducationBMC series – open, inclusive and trusted201717:14

https://doi.org/10.1186/s12909-016-0853-4

Received: 11 August 2016

Accepted: 22 December 2016

Published: 14 January 2017

Abstract

Background

Mistreatment of trainees remains a frequently reported phenomenon in medical education. One barrier to creating an educational culture of respect and professionalism may be a lack of alignment in the perceptions of mistreatment among different learners. Through the use of clinical vignettes, our aim was to assess the perceptions of trainees toward themes of potential mistreatment at different stages of training.

Methods

Based on observations from external experts embedded in the clinical learning environment, six thematic areas of potential mistreatment were identified: verbal abuse, specialty-choice discrimination, non-educational tasks, withholding/denying learning opportunities, neglect and gender/racial insensitivity. Corresponding clinical vignettes were created and distributed to 1) medical students, 2) incoming interns, 3) residents/fellows. Perceptions of the appropriateness of the interactions depicted in the vignettes were measured on a 5-point Likert scale. Scores were categorized into neutral or appropriate (≤3) or inappropriate (i.e. mistreatment) (>3) and compared using chi-squared tests.

Results

Four hundred twenty seven trainees participated (182 students, 120 interns, 125 residents/fellows). Proportions of students perceiving mistreatment differed significantly from those of interns and residents/fellows in domains of verbal abuse, specialty discrimination and gender/racial insensitivity (p < 0.05). In scenarios comparing interns to residents/fellows, no significant differences were noted in perceptions of mistreatment in the domains of non-educational tasks, withholding learning and neglect.

Conclusions

Perceptions of mistreatment differ at different developmental stages of medical training. After exposure to the clinical learning environment, perceptions of incoming interns did not differ from those of residents/fellows, implicating clinical rotations as a key period in indoctrinating students into the prevailing culture. More longitudinal studies are needed to confirm or better examine this phenomenon.

Keywords

Clinical learning environmentACGMEHidden curriculumProfessionalismCore competenciesMilestonesBurnout

Background

Professionalism is a core competency of the Accreditation Council on Graduate Medical Education (ACGME), and a critical component of the Clinical Learning Environment Review (CLER) [1]. Professionalism is central to creating a culture of respect, providing the foundation for an optimal educational environment for trainees [24]. However, differences in perception among learners on what constitutes mistreatment may present a barrier to fostering this culture.

In promoting a professional learning environment, addressing mistreatment remains an enduring challenge in medical training [516]. Much of the study of mistreatment in medical training has been based on the Association of American Medical Colleges (AAMC) Graduation Questionnaire [5]. The prevalence of reported mistreatment among graduating medical students has consistently ranged between 17 and 20% annually [5]. Beyond hampering the clinical learning environment (CLE), the negative consequences of this behavior on trainees have been well documented [613]. Some authors have conceded that efforts to eradicate learner mistreatment have been hindered by the effect of the “hidden curriculum [14]”. Others have highlighted the “eye of the beholder”, describing the spectrum of differing perspectives engendered by the term “mistreatment [12]”. Greater understanding of this issue has become a priority of both the AAMC and the American Medical Association [5]. Accordingly, the AAMC proposed five major domains requiring further study, evidence and discussion: 1) a definition of mistreatment, 2) the reporting of mistreatment, 3) the assessment of alleged mistreatment, 4) any intervention after mistreatment was identified, and 5) the prevention of mistreatment [5].

Within this framework, we sought to characterize our organizational culture around the issue of learner mistreatment [17, 18]. The present study has implications for both the “definition of mistreatment”, and the “assessment of alleged mistreatment”. In this pilot experience, our aims were to 1) use clinical vignettes to depict institution-specific interactions that might potentially represent mistreatment and 2) assess perceptions of mistreatment among medical trainees. We hypothesized that learners’ perceptions of mistreatment change as they advance in clinical training.

Methods

This study was reviewed by the Penn State College of Medicine (PSCOM) Institutional Review Board and determined to be exempt from formal review.

The Culture of Respect in Education (CORE) initiative was developed as part of an institutional effort to improve the CLE at PSCOM [19]. Addressing learner mistreatment was identified as an initial target to promote CORE, with the aim of clarifying and aligning perceptions of mistreatment between trainee expectations and organizational culture. To obtain external expertise in workplace environment professionalism, this process was developed and implemented with the Penn State School of Labor and Employment Relations (SLER). A graduate student, mentored by experts in SLER, was embedded within our patient care teams for a period of 8 weeks, and observed the interactions between members of the healthcare team on the wards, clinics, conferences and operating rooms. As an observer without prior healthcare experience, this individual provided us with an external lens into our CLE.

Based on this experience, six institution-specific thematic areas of potential learner mistreatment were identified: 1) Verbal abuse/public humiliation, 2) Specialty discrimination, 3) Performing non-educational tasks, 4) Withholding/denying learning opportunities, 5) Neglect, 6) Gender/racial insensitivity. Corresponding paper-based clinical vignettes were developed between SLER faculty and senior clinicians including the Designated Institutional Official and Vice-Chair for Education in the Department of Surgery (see Fig. 1 and Additional file 1).
Fig. 1

Example of vignette (Verbal abuse/public humiliation)

These vignettes were delivered to trainees as part of their onboarding process or curricular training. For students, training was delivered prior to commencement of clinical rotations. For interns, training was delivered prior to assuming clinical responsibilities. For residents/fellows, this exercise was incorporated into their Graduate Medical Education (GME) curriculum. Trainees were asked to rate the interactions depicted in the scenarios on a 5-point Likert scale where “1” represented completely appropriate behavior, “3” represented neutral behavior and “5” represented completely inappropriate behavior. The response rate was 100% among attendees. Medical student and intern attendance comprised 100% of the total possible attendance, while resident/fellow attendance comprised 26% (125/478) of the total possible attendance.

Likert responses were dichotomized into inappropriate (i.e. mistreatment) (score of greater than three) or neutral/appropriate (scores of three or less). Proportions of learners reporting mistreatment in the evaluated clinical vignettes were compared across groups of learners with chi-squared tests. The vignettes addressing the themes of “verbal abuse/public humiliation”, “gender/racial insensitivity” and “specialty discrimination” were delivered to all learners. The vignettes addressing the themes of “neglect”, “withholding/denying learning opportunities” and “performing non-educational tasks”, were modified for delivery to the medical students, and therefore, were not included in the analysis for these themes. All analyses were performed with STATA software (version 10/MP; Stata Corp., College Station, TX). p values < 0.05 were considered significant.

Results

There were 427 trainees that participated (182 students, 120 interns, 125 residents/fellows). Proportions of learners reporting mistreatment across clinical vignettes is presented graphically in Fig. 2. Across the three clinical vignettes (verbal abuse/public humiliation; specialty discrimination; gender/racial insensitivity) in which students, interns and resident/fellows were compared, there was a significant difference in the perceptions of students when compared to both interns and to residents/fellows (p < 0.05 for all). In contrast, the perceptions between interns and residents/fellows were not significantly different for these three scenarios. In the remaining three scenarios (neglect; withholding of learning opportunities; and performing non-educational tasks) where interns and resident/fellows were compared, there were no significant differences noted in their overall perceptions of mistreatment in the aforementioned clinical vignettes. Additionally, in the scenario describing “specialty discrimination”, in contrast to the other scenarios, there was an increased perception of mistreatment among interns and residents/fellows when compared to students. Finally, in the scenarios describing “performing non-educational tasks” and “withholding/denying of learning opportunities” less than 50% of learners identified these scenarios as depicting mistreatment, relating that the majority found these scenarios to be neutral or appropriate interactions.
Fig. 2

Proportions of learners reporting perception of mistreatment across case vignettes. Error bars reflect 95% confidence intervals

Discussion

When evaluating our trainees’ perceptions of mistreatment using clinical vignettes, we found that the perceptions of mistreatment among students differed significantly from interns and residents/fellows across various clinical vignettes. Furthermore, when comparing perceptions of mistreatment among incoming interns and residents/fellows, there were no significant differences. Additionally, there were themes such as “performing non-educational tasks” and “withholding/denying learning opportunities” where the majority of respondents found these scenarios to represent neutral or appropriate behavior rather than mistreatment or inappropriate conduct. Summatively, these findings highlight discordant perceptions of mistreatment among trainees at different levels in certain themes, with more concordant perceptions of mistreatment in others. Furthermore, the similarity between the perceptions toward mistreatment among incoming interns and residents/fellows when compared to medical students implicates the CLE as a key period in influencing or shaping these perceptions.

In a study using video-based clinical vignettes to identify what constitutes medical student abuse among medical students, residents, nurses and attending physicians, Ogden et al found that these groups generally agreed upon what constitutes abuse [20]. The themes selected for their study, “belittlement”, “ethnic insensitivity”, “negative feedback”, “sexual harassment” and “excluding from a learning opportunity” closely parallel themes identified at our institution and others, demonstrating the pervasiveness of these issues [5, 14, 21, 22]. Similar to our study, in the scenarios of “belittlement”, “ethnic insensitivity” and “sexual harassment”, these themes were generally perceived to represent mistreatment. Likewise, in the scenario where a medical student was excluded from witnessing a procedure, respondents did not categorize this as an example of mistreatment.

Other studies have highlighted a “hidden curriculum” or environmental factors that may undermine efforts to address mistreatment. Over a 13-year period, researchers at UCLA adopted a proactive and multifaceted approach to address these components and eradicate medical student mistreatment [14]. However, the incidence of mistreatment, thematic patterns and severity of episodes, remained constant throughout the endeavor. The results of our study suggest that exposure to the clinical environment indoctrinates students to the prevailing organizational culture. This was evident in our study as students prior to their clinical rotations harbored certain perceptions of mistreatment; however, after exposure to the clinical environment, and on matriculation as an intern (prior to any clinical intern rotations), incoming interns already shared attitudes that were more similar to those of residents/fellows than those of students.

A great deal of literature has emerged on the pervasiveness of burnout in medical training [8, 2326]. Burnout has been associated with emotional exhaustion, lower empathy, depersonalization of care and decreased professionalism [8, 2326]. Higher proportions of burnout have been demonstrated in medical students, residents and early career physicians compared to the general population, and in a study of US surgical residents, nearly 70% met the criteria for burnout in one of the studied inventories [25, 26]. One study demonstrated a strong association between burnout and the prevalence of mistreatment, particularly recurrent episodes of mistreatment [8]. Factors within the learning and work environment, rather than individual attributes, are the major drivers of burnout [24]. In this context, our findings may represent a desensitization or depersonalization toward issues of mistreatment among incoming interns and residents/fellows who have already been indoctrinated into the clinical learning environment compared to students.

Perception of mistreatment is a complex issue, providing measurable challenges in addressing mistreatment among trainees [5, 12, 14, 16, 17]. Medical students must transition from being the center of the educational process during their initial years of training, to a patient- and relationship-centered training paradigm where patients, families and their care take priority. Fried et al postulated that as students progress through their training, they may be better adjusted and understand their role in a complex health care system [14]. This evolution or maturation of attitudes may explain the findings of the present study, which also extends beyond medical students to post-graduate trainees.

When qualitatively assessing medical students’ perceptions of mistreatment, Gan et al proposed that learners may be referring to a spectrum with blatant episodic occurrences of mistreatment (e.g. physical abuse, sexual discrimination) on one end and a suboptimal learning environment on the other end [12]. While the former was rare and generally well-encompassed by institutional mistreatment policies, the latter was felt to be more distressing by students and included: feeling undervalued, having limited voice, performing work without perceived educational value, and a lack of a sense of belonging within the structure of the medical team [12].

Collectively, these studies expand our understanding of mistreatment, and our data may provide further insight into the role of the CLE in evolving professional behaviors. While our data suggest that perceptions of mistreatment are different at various changes of clinical training, not all domains showed more tolerance of unprofessional behavior by learners at more advanced levels of training. Additionally, attitudes toward two vignettes were neutral, without any significant change across level of training. This may suggest either vignettes that did not adequately assess the domain, or that these domains have been adequately addressed at this institution. It may also be that these domains encompass themes that are more contraversial among trainees, or behaviors for which learners have a higher threshold to label as mistreatment. In aggregate, these data highlight the potentially institution-specific nature of a professionalism curriculum, focused on existing and desired institution-specific organizational culture.

Limitations

There are limitations to consider in this pilot experience. The vignettes represent a collaborative effort between senior faculty in SLER and Graduate Medical Education, but are not validated instruments. While the themes identified in this study were consistent with prior research, through literature review, bias may have been introduced into the process of observation and cataloguing forms of mistreatment, potentially omitting and failing to identify “new” forms of mistreatment. Furthermore, the themes depicted in the clinical vignettes were obtained from field notes by the observer embedded in the CLE and in consultation with the aforementioned experts, but were not obtained through rigorous validated qualitative methods.

The sample size was limited, particularly amongst residents and fellows. While for students and interns the exercise was delivered as part of the onboarding process, for clinical residents and fellows, it was delivered as part of the graduate medical student curriculum which is not mandatory due to ongoing clinical responsibilities. This may introduce the potential for sampling bias. Half of the vignettes were modified to make them more accessible to the students, who were early in their clerkship experience. Consequently, we were unable to include the perceptions of these learners in the respective models for these themes. Furthermore, there were shifts in the level of training of the victim in the various scenarios. While this was intended to provide diversity to the scenarios, it may also have inadvertently introduced an additional bias related to group membership, sympathy and interpersonal relatedness of respondents evaluating the clinical vignettes. Finally, the themes of mistreatment and trainee perceptions identified relate specifically to an experience at a single academic institution and may not reflect the experiences of other institutions.

Conclusions

Perceptions of mistreatment differ between levels of clinical trainees, with perceptions that appear to change after exposure to the clinical learning environment. Clinical rotations during medical school play a key role in indoctrinating students into the prevailing medical culture. It is unclear how and to what extent the CLE and the often cited “hidden curriculum” are responsible for these differing perspectives at different stages of clinical training. Focusing on this transition period in student training, as well as uncovering the underlying factors, such as burnout, that may result in desensitization or depersonalization of more experienced clinical trainees or faculty to matters of mistreatment will be important steps in changing medical culture and improving the CLE. As such, refinement of these clinical vignettes, further examination of the CLE, as well as larger and longitudinal studies, would be of significant benefit in better understanding the issue of learner mistreatment in medical training.

Notes

Abbreviations

AAMC: 

Association of American Medical Colleges

ACGME: 

Accreditation Council on Graduate Medical Education

CLE: 

Clinical learning environment

CLER: 

Clinical Learning Environment Review

CORE: 

Culture of Respect in Education

PSCOM: 

Penn State College of Medicine

SLER: 

School of Labor and Employment Relations

Declarations

Acknowledgments

The authors would like to thank the Harvard-Macy Program for Post-Graduate Trainees, Lureye Myers MS and Beth Herman MPA, and Audrey Stokes MD for their contributions to this project. They would also like to thank Kimberly Walker and Lisa McCully for their assistance with the formatting of this manuscript.

Funding

This study was not supported by external funding.

Availability of data and materials

The datasets during and/or analysed during the current study available from the corresponding author on reasonable request.

Author contributions

The study conception and design, data analysis and manuscript preparation by AF, SXS and DQ. Study methodology, data analysis and interpretation and manuscript review by CSH and JRS. Study conception and design, developing clinical vignettes and manuscript review by AJA, DJF, PWD and ERB. Study conception and design, developing clinical vignettes, manuscript review and overseeing the research project by DH and ERB. All authors read and approved the final manuscript.

Competing interests

The authors declare that they have no competing interests.

Consent for publication

Not applicable.

Ethics approval and consent to participate

This study was determined to be exempt from formal review by the Penn State College of Medicine (PSCOM) Institutional Review Board. As the study did not involve the collection of identifiable data, it was also determined to be exempt from obtaining formal written participant consent. Participants were informed of the potential use of study data for research purposes.

Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Authors’ Affiliations

(1)
Department of Surgery, The Pennsylvania State University, College of Medicine
(2)
School of Labor and Employment Relations, The Pennsylvania State University
(3)
Department of Public Health Sciences, The Pennsylvania State University, College of Medicine
(4)
Department of Radiology, The Pennsylvania State University, College of Medicine
(5)
Department of Medicine, The Pennsylvania State University, College of Medicine

References

  1. Nasca TJ, Philibert I, Brigham T, Flynn TC. The next GME accreditation system--rationale and benefits. N Engl J Med. 2012;366(11):1051–6.View ArticleGoogle Scholar
  2. Wynia MK, Papadakis MA, Sullivan WM, Hafferty FW. More than a list of values and desired behaviors: a foundational understanding of medical professionalism. Acad Med. 2014;89(5):712–4.View ArticleGoogle Scholar
  3. Leape LL, Shore MF, Dienstag JL, et al. Perspective: a culture of respect, part 2: creating a culture of respect. Acad Med. 2012;87(7):853–8.View ArticleGoogle Scholar
  4. Leape LL, Shore MF, Dienstag JL, et al. Perspective: a culture of respect, part 1: the nature and causes of disrespectful behavior by physicians. Acad Med. 2012;87(7):845–52.View ArticleGoogle Scholar
  5. Mavis B, Sousa A, Lipscomb W, Rappley MD. Learning about medical student mistreatment from responses to the medical school graduation questionnaire. Acad Med. 2014;89(5):705–11.View ArticleGoogle Scholar
  6. Woolley DC, Moser SE, Davis NL, Bonaminio GA, Paolo AM. Treatment of medical students during clerkships based on their stated career interests. Teach Learn Med. 2003;15(3):156–62.View ArticleGoogle Scholar
  7. Haviland MG, Yamagata H, Werner LS, Zhang K, Dial TH, Sonne JL. Student mistreatment in medical school and planning a career in academic medicine. Teach Learn Med. 2011;23(3):231–7.View ArticleGoogle Scholar
  8. Cook AF, Arora VM, Rasinski KA, Curlin FA, Yoon JD. The prevalence of medical student mistreatment and its association with burnout. Acad Med. 2014;89(5):749–54.View ArticleGoogle Scholar
  9. Lubitz RM, Nguyen DD. Medical student abuse during third-year clerkships. JAMA. 1996;275(5):414–6.View ArticleGoogle Scholar
  10. Richman JA, Flaherty JA, Rospenda KM, Christensen ML. Mental health consequences and correlates of reported medical student abuse. JAMA. 1992;267(5):692–4.View ArticleGoogle Scholar
  11. Heru A, Gagne G, Strong D. Medical student mistreatment results in symptoms of posttraumatic stress. Acad Psychiatry. 2009;33(4):302–6.View ArticleGoogle Scholar
  12. Gan R, Snell L. When the learning environment is suboptimal: exploring medical students’ perceptions of “mistreatment”. Acad Med. 2014;89(4):608–17.View ArticleGoogle Scholar
  13. Oser TK, Haidet P, Lewis PR, Mauger DT, Gingrich DL, Leong SL. Frequency and negative impact of medical student mistreatment based on specialty choice: a longitudinal study. Acad Med. 2014;89(5):755–61.View ArticleGoogle Scholar
  14. Fried JM, Vermillion M, Parker NH, Uijtdehaage S. Eradicating medical student mistreatment: a longitudinal study of one institution’s efforts. Acad Med. 2012;87(9):1191–8.View ArticleGoogle Scholar
  15. Fnais N, Soobiah C, Chen MH, et al. Harassment and discrimination in medical training: a systematic review and meta-analysis. Acad Med. 2014;89(5):817–27.View ArticleGoogle Scholar
  16. Bursch B, Fried JM, Wimmers PF, et al. Relationship between medical student perceptions of mistreatment and mistreatment sensitivity. Med Teach. 2013;35(3):e998–1002.View ArticleGoogle Scholar
  17. Rees CE, Monrouxe LV. “A morning since eight of just pure grill”: a multischool qualitative study of student abuse. Acad Med. 2011;86(11):1374–82.View ArticleGoogle Scholar
  18. Singer SJ, Falwell A, Gaba DM, et al. Identifying organizational cultures that promote patient safety. Health Care Manag Rev. 2009;34(4):300–11.View ArticleGoogle Scholar
  19. Dillon PW, Paz HL. Team-based surgical care: an important role for academic health centers. JAMA Surg. 2014;149(10):999–1000.View ArticleGoogle Scholar
  20. Ogden PE, Wu EH, Elnicki MD, et al. Do attending physicians, nurses, residents, and medical students agree on what constitutes medical student abuse? Acad Med. 2005;80(10 Suppl):S80–83.View ArticleGoogle Scholar
  21. Hendelman W, Byszewski A. Formation of medical student professional identity: categorizing lapses of professionalism, and the learning environment. BMC Med Educ. 2014;14:139.View ArticleGoogle Scholar
  22. Heru AM. Using role playing to increase residents’ awareness of medical student mistreatment. Acad Med. 2003;78(1):35–8.View ArticleGoogle Scholar
  23. West CP, Shanafelt TD. The influence of personal and environmental factors on professionalism in medical education. BMC Med Educ. 2007;7:29.View ArticleGoogle Scholar
  24. Dyrbye L, Shanafelt T. A narrative review on burnout experienced by medical students and residents. Med Educ. 2016;50:132–49.View ArticleGoogle Scholar
  25. Elmore LC, Jeffe DB, Jin L, et al. National survey of burnout among US general surgery residents. J Am Coll Surg. 2016;223(3):440–51.View ArticleGoogle Scholar
  26. Dyrbye L, West CP, Satele D, et al. Burnout among US medical students, residents, and early career physicinas relative to the general US population. Acad Med. 2014;89:443–51.View ArticleGoogle Scholar

Copyright

© The Author(s). 2017

Advertisement