Perceptions of the 2011 ACGME duty hour requirements among residents in all core programs at a large academic medical center

Abstract

Background

The Accreditation Council for Graduate Medical Education (ACGME) implemented revisions to resident duty hour requirements (DHRs) in 2011 to improve patient safety and resident well-being. Perceptions of DHRs have been reported to vary by training stage and specialty among internal medicine and general surgery residents. The authors explored perceptions of DHRs among all residents at a large academic medical center.

Methods

The authors administered an anonymous cross-sectional survey about DHRs to residents enrolled in all ACGME-accredited core residency programs at their institution. Residents were categorized as medical and pediatric, surgery, or other.

Results

In total, 736 residents representing 24 core specialty residency programs were surveyed. The authors received responses from 495 residents (67%). A majority reported satisfaction (78%) with DHRs and believed DHRs positively affect their training (73%). Residents in surgical specialties and in advanced stages of training were significantly less likely to view DHRs favorably. Most respondents believed fatigue contributes to errors (89%) and DHRs reduce both fatigue (80%) and performance of clinical duties while fatigued (74%). A minority of respondents (37%) believed that DHRs decrease medical errors. This finding may reflect beliefs that handovers contribute more to errors than fatigue (41%). Negative perceived effects included diminished patient familiarity and continuity of care (62%) and diminished clinical educational experiences for residents (41%).

Conclusions

A majority of residents reported satisfaction with the 2011 DHRs, although satisfaction was significantly less among residents in surgical specialties and those in advanced stages of training.

Background

In 1999, the Institute of Medicine released a landmark report, “To Err Is Human: Building a Safer Health System,” which implicated medical errors as a principal cause of patient morbidity and mortality [1]. The report concluded that deaths due to preventable medical errors exceeded deaths attributed to motor vehicle accidents, breast cancer, or acquired immunodeficiency syndrome. In 2003, the Accreditation Council for Graduate Medical Education (ACGME) instituted duty hour requirements (DHRs) as a component of common standards governing resident education, with the goal of improving patient safety and resident well-being. The standards required a limit of 80 weekly work hours averaged over 4 weeks, a limit on continuous duty of 24 h with an additional 6 h for transfers of care, 1 day off in every 7, and a limit on in-house call to once in every 3 nights [2, 3]. In 2008, the Institute of Medicine published “Resident Duty Hours: Enhancing Sleep, Supervision and Safety,” which recommended enhanced monitoring of duty hours, regulation of resident caseloads, enhanced supervision, and improved transitions of patient care, or handovers, and simultaneously acknowledged an absence of crucial research investigations [4]. The ACGME implemented revised standards in 2011 to more closely regulate duty hours and trainee supervision. Among the new regulations were a limit of 16 contiguous work hours for first-year trainees, a limit of 4 h for transfer of care after a 24-h work period, a recommendation of 10 h off duty (required 8 h off duty) between duty periods, and requirements for improved handovers of care and supervision of residents [5].

Performance impairment due to sleep deprivation and fatigue is well established [6,7,8]. However, the effects of the ACGME DHRs on resident well-being and education, as well as patient safety, continue to be debated. Some studies have suggested that DHRs are beneficial for alertness [9] and are supported by residents [10, 11]; other studies have raised concerns about adverse effects on clinical training [12, 13] and overall quality of patient care [13, 14]. One structured review of the empirical literature on duty hour limits and patient care and resident outcomes found that existing studies assessing safety and quality in teaching institutions have yielded heterogeneous results [15]. Studies demonstrating positive effects of DHRs were more likely to have been conducted in medical specialties, while those conducted within surgical disciplines raised concern about the negative effects of DHRs on patient safety and continuity of care [15].

Determining the impact of DHRs on a complex system of medical education and health care delivery continues to be an important area of scholarship. Improving our understanding of residents’ attitudes and opinions about DHRs may provide valuable insights. Philibert [16] reported that programs in which residents view duty hour compliance as a strength are characterized as more efficient, collegial, and responsive to problems. Existing literature suggests that there may be heterogeneity in perceptions of DHRs among the specialties and the stages of training, as highlighted by a recent study demonstrating that internal medicine respondents favored DHRs more than general surgery respondents among a subset analysis of 49 respondents at 1 institution. In addition, in this study, first-year residents viewed DHRs in a more positive manner than senior residents and faculty [17].

Our anecdotal experience from a large academic medical center with 736 residents enrolled in 24 ACGME-accredited core residency programs suggests that residents generally view DHRs positively, though with coinciding concerns over lost educational opportunities. In this study, we aimed to explore resident satisfaction with the ACGME DHRs and perceptions of the impact of DHRs on patient care, their education, fatigue mitigation, and medical errors. We also aimed to explore differences in satisfaction with DHRs and perceptions of the overall effects of DHRs on training by specialty type and stage of training. We hypothesized that significant differences in perceptions of DHRs exist between surgical and nonsurgical specialties, as well as junior and senior residents.

Methods

All residents currently enrolled in ACGME-accredited core residency programs at Mayo Clinic’s campus in Rochester, Minnesota were eligible to participate in our cross-sectional survey. The Mayo Clinic Institutional Review Board approved the study.

We collected data from August 11 through October 1, 2014. Residents were invited through email to complete an anonymous electronic survey that included an informed consent statement on the first page. An email reminder was distributed midway through the survey period. Participation was voluntary, and residents received no incentive to participate. Study data were collected and managed using REDCap (Research Electronic Data Capture) electronic data capture tools hosted at Mayo Clinic. REDCap is a secure, Web-based application designed to support data capture for research studies [18].

We asked residents to provide information related to their demographic characteristics; satisfaction with and attitudes about DHRs; perceptions of culture and DHRs; perceptions of fatigue, medical errors, and relation to DHRs; and perceptions of the educational effect of DHRs. No individual survey questions were mandatory. We asked participants to record their specialty, and they were informed that specialty data would be reported only in aggregate specialty groupings. Data were not reported individually for core residencies, because the program size for some specialties was too small to ensure respondent confidentiality if reported independently.

Residency programs were categorized into 3 specialty groups for comparison: medical and pediatric (med/peds) (ie, internal medicine and subspecialties and pediatric and adolescent medicine); surgical (surgery) (ie, anesthesiology, dental specialties, neurologic surgery, obstetrics and gynecology, ophthalmology, orthopedic surgery, otorhinolaryngology, surgery and subspecialties, and urology); and other (other) (ie, dermatology, emergency medicine, family medicine, genetics, neurology, pathology and laboratory medicine, physical medicine and rehabilitation, psychiatry, radiation oncology, radiology, sports medicine, transitional year, and other). This categorization represents the subspecialty grouping applied by the Mayo School of Graduate Medical Education at Mayo Clinic in Minnesota. Residents were categorized as junior if they were in their first or second postgraduate year (PGY) and senior if they were in or beyond their third PGY.

We summarized survey responses using frequency counts and percentages. Percentages were calculated using the total number of nonmissing responses obtained for an individual question. Comparisons between junior and senior residents and among specialty types regarding satisfaction with DHRs and effect on training were evaluated with Wilcoxon rank sum and Kruskal-Wallis tests. Cronbach α was calculated for key survey questions that addressed similar concepts. Statistical analyses were performed with statistical software (version 9.3; SAS Institute Inc). P < .05 was considered statistically significant.

The reliability, validity, and psychometric properties of our instrument were addressed through a multifaceted approach. We conducted a literature review to identify existing survey research assessing resident perspectives on DHRs, which informed the construction of our survey instrument. A portion of our instrument was adapted from a previously published survey that targeted a national population of neurosurgical residents [12]. To address content validity, a multidisciplinary group of medical educators (in the specialties anesthesiology, emergency medicine, general surgery, internal medicine, obstetrics and gynecology, pediatrics, and psychiatry) reviewed and edited our survey questions. A pilot survey was conducted among these medical educators to eliminate questions that could be misinterpreted or could show bias. Pilot survey respondents provided feedback on participant solicitation and consent, content, question-and-answer wording, and the methodology of survey administration.

Results

Demographic characteristics of respondents

We identified 736 residents who met study criteria and invited them to participate in our survey. We received 495 responses (response rate, 67%), of which 382 surveys (77%) were completed in entirety. Residents from PGY-1 through PGY-6 and above were represented, and junior residents comprised 36% of respondents. Women comprised 40% of our cohort, and 66% of respondents were married. Of the 439 respondents (89%) who provided a specialty, 131 (30%) were categorized as med/peds, 151 (34%) as surgery, and 157 (36%) as other. Table 1 summarizes the respondent demographic data.

Table 1 Demographic Characteristics of the 495 Survey Respondents

Satisfaction with and attitudes about duty hours

A majority of residents (78%) reported satisfaction with the ACGME DHRs and reported that the requirements affect their training in an overall positive manner (73%) (Cronbach α=.70). Junior residents were significantly more likely (P ≤ .001) than senior residents to report satisfaction with DHRs (84% vs 74%) and an overall positive effect on their training (85% vs 66%). Residents in surgical specialties were significantly less likely (P ≤ .001) to report satisfaction with DHRs (66%) or an overall positive effect on training (63%) than residents in med/peds (87% and 76%) or other (82% and 81%) specialties (Table 2).

Table 2 Resident Satisfaction and Comparison by PGY and Specialty

Perceptions of culture and duty hour violations

Most respondents believed that DHRs were respected within their institution (93%), are enforced (95%), and were reflected in their work schedule (94%) (Cronbach α=.92) (Table 3). Some residents reported exceeding the 28-h maximum duty hour requirement (8%) or the 80-h weekly maximum duty hour limit (11%) more than rarely within the past year. Many residents believed that there are situations when a violation of DHRs may be justified (80%). Few reported having been specifically asked to violate duty hour rules (6%) either by a peer (n = 2), a senior resident (n = 7), an attending physician (n = 12), or some other person (n = 5).

Table 3 Resident Perceptions of Culture and Duty Hour Violations

Perceptions of fatigue, medical errors, and relation to duty hours

Most residents believed that fatigue (89%) and patient handovers (90%) contribute to adverse events (Table 4). A majority of residents believed DHRs reduced resident fatigue (80%) and reduced the incidence of residents performing clinical duties while fatigued (74%). Many residents believed that they (71%) and their colleagues (66%) were able to perceive when fatigue affected the care they provide. However, only 37% of residents believed that DHRs decreased medical errors, whereas 44% believed the standards had no effect on medical errors and 19% believed medical errors were increased by DHRs. More than half of respondents (62%) believed the standards decreased patient familiarity and continuity of care. Of respondents, 41% believed that patient handovers contributed more to adverse events than fatigue, compared with 27% who believed fatigue is the larger contributor.

Table 4 Resident Perceptions of Fatigue, Medical Errors, and Relation to Duty Hours

Perceptions of educational impact of duty hour requirements

Among residents, 26% indicated that DHRs enhanced their clinical educational experiences, whereas 33% believed the requirements had no effect and 41% felt the requirements diminished their clinical experiences (Table 5). When questioned about perceptions of duty hour effects on board examinations, academic productivity, and scheduled educational conferences, opinions were mixed. Opinions about the 16-h work limit for interns also varied; however, a majority of residents (73%) believed that their specialty should be subject to the same DHRs as other specialties.

Table 5 Resident Perceptions of Educational Impact of Duty Hour Requirements

Discussion

In this cross-sectional survey study of residents enrolled in all ACGME-accredited core residency programs at a large academic medical center, we found that a majority of residents were satisfied with the ACGME DHRs and perceived them as having an overall positive effect on their training.

Residents training in specialties categorized as surgical were significantly less likely to be satisfied with the DHRs or to report DHRs having a positive effect on their training than those categorized as medical and pediatric or other. Our results mirror an existing theme in the medical education literature, wherein concerns about the DHRs impact on surgical training in particular are highlighted [12, 15, 19,20,21]. Prior assessments of attitudes about DHRs by specialty have been reported, although among smaller samples and generally comparing 2 individual specialties. A multicenter survey study of 159 general surgery and internal medicine trainees from 3 centers demonstrated similar opinions about DHRs [22]. A more recent study of 202 general surgery and internal medicine residents and faculty compared a subset of 49 resident respondents and found that surgical residents favored DHRs significantly less than their internal medicine counterparts [17]. Our findings indicate that residents in specialties broadly categorized as surgical view the DHRs significantly less favorably than their colleagues in nonsurgical specialties. We chose not to report findings by individual specialty to ensure the confidentiality of respondents who are enrolled in programs with few trainees.

Residents in advanced stages of training, defined as PGY-3 and above, were also significantly less likely to be satisfied with DHRs or to report overall benefit to their training than those at a PGY-1 or 2 level. A national survey of family medicine residents similarly found that PGY-1 residents viewed DHRs more favorably than those in the PGY-2 year (25% vs 23%) [23]. That our finding is of greater magnitude may reflect the comparison of junior residents to those at considerably more advanced stages of training. The Flexibility in Duty Hour Requirements for Surgical Trainees (FIRST) trial, a prospective, randomized trial assessing impact of duty hour flexibility for general surgical trainees, also demonstrated increased concerns among senior residents, compared with junior residents, about negative effects of standard DHRs on patient safety and continuity of care [24].

Despite the differences we observed between the surgical versus nonsurgical disciplines and senior versus junior residents, it is worth stating that a majority of these subgroups did ultimately report overall satisfaction with the DHRs. Most respondents also indicated that the DHRs were respected and enforced by their institution. While most indicated that situations do exist where violation of DHRs is justified, few reported more than sporadic violations within the past year.

Although a majority of respondents believed the DHRs mitigate resident fatigue, only 37% believed that the requirements decreased medical errors. More than one-half of respondents believed that DHRs did not impact (44%) or increased (19%) medical errors. Our findings are congruent with a study using a grounded-theory analysis of resident comments, that found residents did not associate patient safety with DHR compliance [16, 25]. This may be in part due to a perception that patient handovers have increased and continuity of care has decreased. Our study does not directly address this question; however, we did find that a majority of residents believed that patient handovers contribute equally or more significantly to adverse patient events than fatigue. Arora and colleagues [10] found interns’ perceptions of the tradeoff between lack of care continuity and fatigue to depend largely on clinical context. Other studies have demonstrated that residents cite handovers as an important factor contributing to adverse events [15, 26], and existing empirical studies and national resident surveys have demonstrated a significant increase in the number of patient handovers following implementation of DHRs [13, 27].

Only 26% of residents perceived the DHRs to have a positive impact on their clinical educational experience. Prior studies have demonstrated findings of perceived reductions in bedside teaching, clinical educational experiences [22], and surgical opportunities [12, 20]. However, it is of importance to note that a large review of DHRs among surgical residents revealed no adverse effects on residents’ operative experience [28]. A subsequent systematic review associated the 16-h duty maximums with a nonsignificant trend toward worsened educational outcomes [21]. Similarly, the FIRST trial showed no significant difference between standard and flexible duty hour groups with regard to overall educational quality [24].

Strengths of our study are the large sample size and high resident response rate. In addition, we surveyed residents currently enrolled in all ACGME-accredited core residency programs at a large academic institution, and included residents at all levels of training within those programs. We also endeavored to conduct a thorough evaluation of the survey instrument by piloting our survey among experienced medical educators prior to its implementation.

Limitations of our study include a cross-sectional study design, single-institution sampling, and a subjective assessment by the study subject relating to Level 1 outcomes [29]. Because our survey was optional, it may also be limited by sampling bias. Despite the high response rate, it is possible that those who opted not to take the survey are dissimilar from those who chose to respond. Future work should focus on multi-institutional assessments that would allow for greater generalizability and an understanding of resident perceptions of DHRs across the specific individual specialties. Further, use of qualitative research methods, such as those used by Philibert [16], may prove useful in determining the underlying reasons for residents’ perceptions of DHRs [30].

Conclusion

In this cross-sectional survey study of residents enrolled in all ACGME-accredited core residency programs at a large academic medical center, a majority of respondents were satisfied with the current ACGME DHRs and believed they affected their training in an overall positive manner. Residents in surgical specialties and those in advanced stages of training were significantly less likely to view DHRs favorably, although in these subgroups as well, a majority of the respondents did report overall satisfaction with the DHRs.