Is the presence of medical trainees associated with increased mortality with weekend admission?

Background

Several studies have demonstrated increased inhospital mortality following weekend admission. We hypothesized that the presence of resident trainees reduces the weekend mortality trends.

Methods

We identified all patients with a non-elective hospital admission from 1/1/2003 through 12/31/2008. We abstracted vital status on discharge and calculated the Charlson comorbidity score for all inpatients. We compared odds of inpatient mortality following non-elective admission on a weekend day as compared to a weekday, while considering diagnosis, patient characteristics, comorbidity, hospital factors, and care at hospitals with resident trainees.

Results

Data were available for 48,253,968 patient discharges during the six-year study period. The relative risk of mortality was 15% higher following weekend admission as compared to weekday admission. After adjusting for diagnosis, age, sex, race, income level, payer, comorbidity, and weekend admission the overall odds of mortality was higher for patients in hospitals with fewer nurses and staff physicians. Mortality following a weekend admission for patients admitted to a hospital with resident trainees was significantly higher (17%) than hospitals with no resident trainees (p < 0.001).

Conclusions

Low staffing levels of nurses and physicians significantly impact mortality on weekends following non-elective admission. Conversely, patients admitted to hospitals with more resident trainees had significantly higher mortality following a weekend admission.

A growing number of studies have demonstrated increased mortality on weekends for patients suffering from several urgent medical and surgical diagnoses [1, 2]. Increasingly, there is evidence suggesting that patient care, especially for those with time-sensitive conditions [3], is compromised during weekends and that patients become unnecessarily vulnerable on weekends. No clear explanation for this mortality difference exists; however a number of potential factors should be considered. Factors influencing excess weekend mortality may include reduced staff levels, wide physician cross-coverage, and fewer specialized diagnostic, procedural, and treatment options on the weekend [3].

One of the greatest concerns regarding weekend staffing is that fewer nurses and staff physicians are available, while less-experienced caregivers provide the bulk of care. In addition, resident physicians or trainees often provide many urgent care services on nights and weekends. Given the often front line role that resident physicians have in patient care on weekends, we performed an analysis to delineate the potential effect of resident trainees on disparate outcomes based on day of admission. Our hypothesis was that resident trainees act as front line caregivers and thus, hospitals with residency programs may experience a reduced overall mortality following weekend admission. Low staffing levels and a lack of resident trainees may lead to care that is untimely and error prone resulting in higher mortality following weekend admission.

Data source

We obtained all-payer discharge data from January 1, 2003, through December 31, 2008, via the Nationwide Inpatient Sample (NIS) of the Healthcare Cost and Utilization Project of the Agency for Healthcare Research and Quality. The NIS—the largest source of all-payer hospital discharge information in the United States—contains data from approximately 7 million to 8 million hospital stays per year in 1000 hospitals in over 30 states [4]. The hospitals sampled can vary from year to year but the sample approximates 20% of US community hospitals including large university hospitals and smaller regional facilities. The database provides information regarding patient demographics, socioeconomic factors, admission profiles, hospital profiles, state codes, discharge diagnoses, procedure codes, total charges, and vital status at hospital discharge. Along with other hospital discharge databases, the NIS has been used to review trends in surgical care and outcomes [5], volume outcome relationships [6], and disparities in care [7]. A data use agreement is held by the Agency for Healthcare Research and Quality, and our study was considered exempt by the Lahey Clinic Institutional Review Board.

The American Hospital Association (AHA) Annual Survey of Hospitals database was obtained in order to determine facility structural characteristics, service lines, staffing, and the presence of resident trainees at each hospital. The AHA database contains hospital-specific information on over 6000 hospitals and over 450 health-care systems, including 700 data elements [8]. The purpose of the AHA database is to generate a comprehensive and inclusive overview of hospitals while permitting the tracking of hospital performance over time. AHA data have been extensively used to study hospital-based outcomes [9], hospital policies [10], and reimbursement [11].

Study population

All patients discharged during the time frame sampled were included (both medical and surgical patients). We used the elective variable to exclude all patients with an admission for elective reasons and included only those patients with nonelective admission [4]. Thus, patients with emergency and urgent indications for admission were included in our study.

Admission day

The data set permits identification of admission day as a weekend or weekday. We recorded this variable as admitted during a weekend (i.e., Saturday or Sunday) or a weekday (i.e., Monday through Friday) [1, 4].

Covariates

Our analysis adjusted for the following covariates: age, sex, race, income level, payer, major diagnostic categories (subgroupings of diagnosis-related groups),¹ and the Charlson comorbidity index score. Age was included as a continuous variable. Sex was entered as a dichotomous variable. Race was divided into white, black, Hispanic, Asian or Pacific Islander, Native American, or other. Income level was categorized into quartiles per estimated median household income of residents in the patient’s zip code [4]. The median income quartiles are classified as follows: $0 to $38 999, $39 000 to $47 999, $48 000 to $62 999, and $63 000 or more [4].

Payer was recorded as follows: Medicare, Medicaid, private including health maintenance organization, self-pay, no charge, or other [4]. Major diagnostic categories were used to adjust for diagnoses and reflect larger groupings of diagnostic-related groups made available in the provided data set and downloadable for review from the US Department of Health and Human Services, Centers for Medicare and Medicaid Services [12]. Major diagnostic categories have been used to evaluate hospitalization risk [13], mortality risk [14], and other outcomes [15]. We also evaluated comorbidity with the Deyo modification of the Charlson comorbidity index [16]. Briefly, we ascertained the presence of 17 comorbid conditions and then weighted them according to the original report. An elevated Charlson comorbidity index score has been demonstrated to correlate with higher mortality rate [17].

Hospital bed size categories were obtained from the American Hospital Association Annual Survey of Hospitals and based on the number of short-term acute care beds.

Staffing

Staffing levels were obtained from the American Hospital Association Annual Survey of Hospitals [8]. We analyzed the role of full-time registered nurses and full-time physicians on mortality by developing ratios of either nurse or physician per hospital bed. We categorized these two variables into tertiles, low, medium, or high.

Presence of resident trainees

The teaching status of the hospital was obtained from the American Hospital Association Annual Survey of Hospitals [8]. Presence of resident trainees was categorized into tertiles. Given that half of all facilities had no residents, this was the lowest tertile. The middle tertile included 1–26 resident trainees. The highest tertile included greater than or equal to 27 resident trainees.

Outcome

The data set permits identification of vital status at the time of discharge. The variable is coded as died during hospitalization or did not die during hospitalization. Deaths that occurred after discharge are not identifiable from our data set [4].

Statistical analysis

Statistical analyses were performed using SAS statistical software, version 9.2 (SAS Institute Inc, Cary, North Carolina). We analyzed univariate associations with patient admission day (weekend vs. weekday) using t tests for continuous variables and χ2 tests for categorical variables. Results were considered statistically significant at p < 0.05, and all statistical tests were 2-tailed. We included all covariates in our regression model. The analyses were conducted with and without missing data. To confirm results, we performed imputation of missing data using the multiple imputation procedure from SAS Institute Inc [18]. Imputation substitutes missing values with plausible values that characterize the uncertainty regarding the missing data [19, 20]. This process results in valid statistical inferences that properly reflect the uncertainty due to missing values, for example, confidence intervals with the correct probability coverage. The multiply imputed dataset was then analyzed by using standard logistic regression for the complete data.

We tested for interactions between staffing levels, resident trainees and admission day on mortality in the regression analysis.

Cohort

Data were available for 48,253,968 patient discharges during the six-year study period, of which 26,038,921 were non-elective. Demographics, patient characteristics, and comorbidity are listed in Table 1 in relation to day of admission. In addition, Table 2 lists the hospital characteristics, staffing levels, and other AHA variables included in our analysis.

Univariate analysis

The relative risk of mortality was15% higher on the weekend as compared to a weekday (Figure 1). Patients admitted on the weekend were on average older (47.9 vs. 46.9 years) than those admitted during a weekday. Males were more likely to be admitted on a weekend than females (23.3% vs. 22.8%). Whites were less likely to be admitted on a weekend than all other racial groups. Lower income categories were more likely to be admitted on a weekend than the highest quartile group. Self-paying and patients without health insurance were more likely to be admitted on the weekend (25.4% and 25.0%, respectively) than patients with other primary methods of payment. On average, patients admitted during the weekend had a higher comorbidity score (Tables 1 and 2).

The risk of mortality on the weekend as compared to a weekday. Chi-square analysis for significance.

Full size image

Multivariate analysis

After adjusting for diagnosis, age, sex, race, income level, payer, comorbidity, and weekend admission the overall odds of mortality was higher for patients in hospitals with fewer nurses and staff physicians. Conversely, hospitals with more physicians or nurses per hospital bed were associated with a 10% reduction in mortality after a weekend admission (Odds Ratio = 0.9: CI 0.9-0.9). In addition, mortality was higher for patients in hospitals with more beds (Odds Ratio = 1.1: CI 1.0-1.1) and more resident trainees (Odds Ratio = 1.05: CI 1.04-1.07) (Table 3).

Tests for interactions

We identified no interactions between staffing (registered nurse or physician) and admission day on mortality. However, we identified significant interactions for the presence of resident trainees. Mortality following a weekend admission to a hospital with the highest tertile of resident trainees was 17% higher (odds ratios 1.17 vs. 1.05) than hospitals with no resident trainees (p < 0.001) (Table 4) after adjusting for all covariates outlined in Table 3. This excess mortality following a weekend admission is significantly higher than the 5% increase observed between tertiles when admission occurs on a weekday (p-value for interaction < 0.001).

Using national all-payer discharge data, we confirmed significant differences in inpatient mortality as a function of day of admission. We also identified associations between staffing levels (both nursing and physician) and the outcome of mortality. However, the presence of resident physicians did not mitigate the effect of weekend day admission on mortality. Instead we found the reverse, a direct correlation between the presence of resident trainees and higher mortality. Most importantly, we identified interactions between admission day and the presence of resident trainees on the likelihood of inpatient mortality. These results may indicate that inadequate resident supervision by staff physicians during weekend patient care may adversely impact patient outcomes.

A prior study [21] did identify increased mortality at hospitals classified as “teaching” in the one state and with a smaller sample of medical diagnoses. However given the limited number of diagnoses and sample size in that study [21], we performed the study with a larger group of diagnoses, with nonelective admissions, and with a national sample of patients. In emergency settings, we hypothesized that trainees provide continuous on-site patient care, which is both invaluable and timely. Hospitals with residency training programs would thus harness the benefits of a team structure to care, endorsing multiple patient evaluations and re-evaluations and a care system focused on checks and balances. For example, in the setting of an intensive care unit, Poses and colleagues reported that the combined judgment of two junior or senior house officers was as good as that of the attending physician in managing the intensive care unit patient [22]. In a review by Kupersmith, teaching hospitals demonstrated better-quality measures, particularly measures of process, than did nonteaching hospitals [23]. The attention to detail inherent in a setting where trainees are present, general use of current medical literature to guide clinical decision making, and more frequent and thorough case reviews should contribute to a lower incidence of adverse occurrences [24]. In fact, improved outcomes have been demonstrated in some studies evaluating the role of residency programs. In a review of outcomes based on teaching status, lower risk-adjusted mortality was noted in major teaching hospitals for elderly patients with common conditions such as acute myocardial infarction, congestive heart failure, and pneumonia [25]. Contrary to these prior findings, our study of nonelective admissions to acute care hospitals revealed the opposite effect. It should be understood however, that our study was specific to nonelective admissions on the weekend alone.

In addition to the role of trainees on admission day outcomes, the difference in mortality following weekend admission as compared to weekdays was noted at hospitals without resident trainees as well. However, the mortality differences based on day of admission were particularly augmented at those hospitals in which residents train. We used tertiles for cutoffs of trainees to understand this effect because of the lack of data demonstrating any particular trainee presence as correlated with outcome. We noted that although mortality was higher on weekends whether or not a facility had a training program, that the mortality difference was substantially higher if the patient was admitted on a weekend to a facility with more resident trainees. The consistent elevation in mortality based on a weekend admission however implicate a more central structural or process measure, which is more fundamental than the role of trainees. It is likely that a common factor that is linked to residency training is critical to this admission day outcomes difference. This common factor may be related to supervision, provider staffing, care integration, or other specific provider factors. Our data did demonstrate higher mortality after weekend admission for patients in hospitals with fewer nurses and staff physicians, but this staffing finding is contrary to the resident trainee effect. Thus, although there is a value to more staff nurses [26], and physicians, more resident trainees seem to have the opposite effect on mortality. This conflicting finding leads us to more questions than answers regarding the role of staffing on healthcare outcomes.

Our study has limitations based on the data used for analysis. Although the administrative data used in our study are population based, there is the potential for information and misclassification bias. It is unlikely that mortality or day of admission were improperly abstracted from the medical record; however, staffing levels and the presence of trainees may not be as rigorously documented. The data are limited to inpatient mortality and there is not assumption that the mortality trend persists beyond the inpatient setting. It should be understood that our data do not tie a direct link between the care provided by a trainee and the outcome of mortality. Our data only demonstrate that the increased mortality noted when patients are admitted on a weekend is worse when a facility has resident trainees. In addition to this concern, it is possible that patients admitted during the weekend have more comorbidities or potentially more severe illnesses at hospitals with resident trainees. Although we have adjusted for comorbidity, an assessment of disease severity at presentation is not possible with the available data. However, others have not identified significant differences in healthcare resource groupings indicating high comorbidity or complications at National Health Service hospitals in England across admission day [2]. Thus, despite these limitations, the strength of our study is in the large population studied implying that the results are representative and generalizable to the nation.

In conclusion, our data indicate that the role of staffing and resident trainees is an important area of focus for patient safety. Our study does not argue against a positive benefit of resident trainees to the sponsoring institution, the local community, affiliated academic health center, and the greater community [24]. Rather, our data suggest that the role of resident supervision may be an important target for quality weekend medical care. Although a causal link between supervision and outcome can not be identified in this study, our data do demonstrate that hospitals with many trainees have the highest mortality burden following a weekend admission. An assessment of rounding practices, trainee-directed procedures, and/or call routines of supervising physicians would help answer questions raised by our study. Following these assessments, strategies can be developed and implemented to standardize care across admission day.

Financial support

Wise Educational Grant.

Affiliations

1. Department of Colon and Rectal Surgery, Lahey Clinic, Tufts University, 41 Mall Rd, Burlington, MA, 01805, USA

   • Rocco Ricciardi
   • , Jason Nelson
   • , Patricia L Roberts
   • , Peter W Marcello
   • , Thomas E Read
   •  & David J Schoetz

Corresponding author

Correspondence to Rocco Ricciardi.

Competing interests

Dr. Schoetz is the Chair of Medical Education at Lahey Hospital and Medical Center.

Authors’ contributions

Conception and Design: RR, JN, Acquisition of Data: RR, Analysis and Interpretation of Data: RR, JN, DJS, TER, PLR, PWM, Drafting the Article: RR, JN, Critical Revision: RR, JN, DJS, TER, PLR, PWM, Final Manuscript Approval: RR, JN, DJS, TER, PLR, PWM. All authors read and approved the final manuscript.

Below are the links to the authors’ original submitted files for images.

Reprints and Permissions