- Research article
- Open Access
- Open Peer Review
The impact of a musculoskeletal training program on residents’ recognition and treatment of osteoporosis
BMC Medical Education volume 19, Article number: 223 (2019)
Osteoporosis is inadequately treated in primary care settings. Under-recognition of the condition among male Veterans may contribute to this problem. In order to improve understanding of bone health in older male patients, we developed the “Musculoskeletal (MSK) Education Week”, a multidisciplinary clinical training initiative within a primary care ambulatory rotation for internal medicine (IM) residents at the Salt Lake City VA Medical Center. The objective of this study was to evaluate the impact of this program on trainees’ recognition of osteoporosis or treatment of this condition following the training experience.
We examined several clinical behaviors of post-graduate year 1 (PGY-1) IM trainees following their participation in the MSK Education Week between July 1–April 30, 2014. To determine the prevalence of these clinical behaviors, we conducted an observational study of patients age 50 and older enrolled at the Salt Lake City VA Healthcare System from July 1, 2013 to May 31, 2014. We used time-dependent multivariable Cox proportional hazard models to evaluate the impact of the training program on 4 osteoporosis-related outcomes: (1) completion of dual energy X-ray absorptiometry (DXA) scan, (2) diagnosis of osteopenia, (3) diagnosis of osteoporosis, and (4) initiation of osteoporosis medications.
Twenty-six PGY-1 IM residents participated in the MSK Education Week, and 43,678 Veterans were identified over these periods of observation. In the Veterans cohort, 1154 had an encounter with a provider who had completed the training (and were therefore “exposed” to the training) and 42,524 Veterans did not. After adjusting for confounders, the effect of the provider training program was significant for DXA (HR = 1.78, 95% CI: 1.11, 2.87), osteoporosis diagnosis (HR = 3.90, 95% CI: 2.09, 7.29), and initiation of medications (HR = 2.87, 95% CI: 2.02, 4.09) outcomes.
We have shown that IM residents’ participation in the MSK Education Week was associated with significantly improvements in their completion of DXA scans, diagnosis of osteoporosis, and initiation of fracture-reducing medications in a population of US Veterans. Long-term follow up is needed to determine whether these initial results are followed by actual reductions in osteoporotic fractures.
More than 10 million adults in the United States age 50 or older have osteoporosis, leading to a prevalence of 10.3% in this age group. Moreover, when including adults with osteopenia, the prevalence of overall low bone mass is 43.9% in older adults . It is expected that, by 2025, the total cost of osteoporosis-related fractures in the United States will be more than $25 billion . Although low bone mass is common, bone density screening is underutilized, especially in older men. According to a systematic review, the screening frequencies of at-risk population ranged from 1 to 47% . In addition, a large scale observational study found that nearly two-thirds of patients did not receive osteoporosis medications during 1-year period following an osteoporosis diagnosis . Similar issues are seen within the Department of Veterans Affairs (VA) where less than one-quarter of Veterans who experience a low-trauma fracture are appropriately evaluated and treated .
One possible solution to increase osteoporosis awareness among clinicians is through provider education programs. Such programs have been shown to improve clinician knowledge and clinical practice in other clinical areas. For example, a recent randomized trial of a physician education program for asthma designed to improve therapeutic and communication skills found that the patients whose primary care physician had attended the training program had fewer symptomatic days and fewer asthma-related emergency department visits . However, there have been relatively few published descriptions of structured educational programs for health care providers or trainees in the area of musculoskeletal (MSK) care.
In 2012, we established the Center of Excellence (COE) in patient-centered MSK Care and Education, a key component of which is the monthly “MSK Education Week”, a multidisciplinary clinical training initiative developed within a primary care ambulatory rotation which is now required for all post-graduate year 1 (PGY-1) internal medicine (IM) residents . This structured educational experience cultivates both confidence and competence; learners from a wide range of training backgrounds and levels report increased ability in performing shoulder and knee exams, and are able to demonstrate these skills in a two-station observed structured clinical examination (OSCE) . The scope of the COE MSK Education Week includes training in metabolic bone disease. Risk factors, diagnostic definitions, guidelines for screening, and current treatment options for osteopenia and osteoporosis are discussed by an endocrinologist with expertise in bone health.
The objective of this study was to evaluate the impact of the COE MSK Education Week on IM residents’ osteoporosis management behaviors in their subsequent ambulatory care training experiences. We did this by assessing outcomes capturing osteoporosis treatment or recognition following participation in this training.
COE MSK week program and trainee cohort
The development, implementation, and three-year sustainment of the COE MSK Education Week have been previously described . This five-day, structured, immersive educational experience is held each month, and attended on average by 6–8 participants who are health professions students or postgraduate trainees. Over the five days of this course, two half-days are focused on metabolic aspects of bone health, which is organized across in five modules: 1) osteoporosis definitions, screening guidelines, and diagnostic pathways; 2) the use of fracture risk assessment tools, including FRAX; 3) the evaluation, prevention, and treatment of vitamin D deficiency; 4) osteoporosis treatment options; and 5) the clinical assessment of treatment outcomes, with particular emphasis on when to refer patients for subspecialty care. A printed syllabus containing information relevant to these modules is provided at the beginning of the week, and is reviewed in the half-day sessions in a structured, interactive discussion format facilitated by an endocrinologist with expertise in osteoporosis (MG). Supervised clinical experiences later in the week reinforce this learning by providing opportunities to use this information in patient care.
The trainee cohort consisted of 26 PGY1 IM categorical residents who participated in the MSK Education Week at some point during July 12,013–April 30, 2014. Of these 26 MSK Education Week participants, 8 (31%) were female and the mean (SD) age at the time of training was 29.4 (4.2). Although the VHASLC serves as a clinical training affiliate for other health professions education programs, including “preliminary” PGY-1 residents preparing for specialty training (e.g., anesthesia, neurology, etc.), these learners did not participate in the MSK Education Week and were not included in the definition of the trainee cohort.
Study design and patient cohort
We conducted a historical cohort study of patients age 50 and older enrolled at the SLCVAMC for primary care. To ensure that those patients in the study were regular users of the VA healthcare system, we excluded patients who did not have a primary care encounter within 6 months prior to index date (July 1, 2013). The study was reviewed by the University of Utah Institutional Review Board and determined an observation report of quality improvement data to be exempt from Human Studies Review.
Exposures and outcomes
The exposure for our analysis was a treatment episode with a provider who had completed the COE MSK Education Week. This was a time-varying exposure as patients in our study encountered COE-trained providers based on the timing of their clinical appointments and the timing of the providers’ COE training. The outcomes in this study included (1) completion of dual energy X-ray absorptiometry (DXA) scan (2), diagnosis of osteopenia (3), diagnosis of osteoporosis, and (4) initiation of osteoporosis medications.
Patient characteristics were compared between patients who were treated by a COE-trained provider and those who were not using chi-square tests. We calculated crude rates per 10,000 patient-days and rate ratios for each outcome for both groups. The 95% confidence intervals for these rates were constructed using a method that relates the chi-square and Poisson distributions . In addition, these rates were used to calculate unadjusted rate ratios between the two groups. Finally, we used time-dependent, multivariable Cox proportional hazards models to evaluate the impact of the COE program on these outcomes. This analysis evaluated the impact of the first year of the COE MSK Education Week trainings. In our analysis, patients were followed – with time characterized by days – beginning on the index date until either having an outcome event or being censored on May 31, 2014. Patients contributed person-time to the non-COE group prior to being exposed to a COE-trained provider. A Cox proportional hazards model was chosen for this analysis due to the ability of this approach to efficiently handle a time-varying exposure.
Our multivariable models adjusted for potential confounders in the relationship between COE MSK Education Week and osteoporosis management outcomes such as age, sex, alcohol use, tobacco use, diabetes, prior fractures, hyperparathyroidism, vitamin D deficiency, renal disease, and medication exposures in our multivariable models. The diagnoses were identified using ICD-9 codes and medication exposures included anticonvulsants, aromatase inhibitors, androgen deprivation therapy, and testosterone.
This study was conducted using data from the Corporate Data Warehouse (CDW), which is a national repository of data from the VA electronic medical record and several other VA clinical and administrative systems. Through the CDW, we identified diagnoses through International Classification of Diseases, Ninth Revision, Clinical Modification (ICD-9) codes. These codes included 733.00, 733.01, 733.02, 33.03, and 733.09 for osteoporosis and 733.90 for osteopenia. Pharmacy records were used to identify osteoporosis medications dispensed and included alendronate, risidronate, ibandronate, calcitonin, raloxifene, teriperatide, and denosumab. Using these datasets, we constructed indicator variables for each of these outcomes if the item was present.
Table 1 depicts the characteristics of the 43,678 Veterans in our analysis cohorts. Of the patients in our cohort, 1154 had an encounter with a provider who had completed the COE MSK Education Week (and were therefore “exposed” to the training) and 42,524 patients did not. The patients in the MSK cohort were significantly older compared to the patients in the non-MSK cohort (p < 0.0001). Across both groups, a majority of patients were white (82.0%), although the proportion of whites was significantly higher in the MSK group (81.7% vs. 91.2%, p < 0.0001). Patients in the MSK group were more likely to be male (94.2% vs. 91.3%, p < 0.0001) but the overwhelming majority in both groups were male. Finally, patients in the MSK cohort were more likely to have previous exposure to steroids and testosterone (12.2% vs. 2.9%, p < 0.001; 3.6% vs. 1.7%, p < 0.0001).
Unadjusted rates for each of the outcomes, along with 95% confidence intervals (CIs), are presented in Table 2. Patients with an encounter with a provider who had participated in the COE MSK Education Week were more likely to have each outcome when compared to patients in the non-MSK cohort, with the strongest effect being seen in the diagnosis of osteoporosis (RR = 7.09, 95% CI: 4.41, 11.21) and completion of DXA scan (RR = 4.36, 95% CI: 3.02, 6.06).
Results from the univariate and multivariable regression models are summarized in Table 3. In the univariate analyses, participation in the COE MSK Education Week was associated with an increase in each of the outcomes, with the HRs (95% CI) ranging from 6.96 (3.77–12.82) for osteoporosis diagnosis to 2.41 (1.52–3.85) for osteopenia diagnosis. After adjusting for confounders, the MSK training was still associated with an increase of the outcomes measured and was statistically significant for DXA scan (HR = 1.78, 95% CI: 1.11, 2.87), osteoporosis diagnosis (HR = 3.90, 95% CI: 2.09, 7.29), and treatment initiation (HR = 2.87, 95% CI: 2.02, 4.09) outcomes.
In this paper, we examined an innovative education program designed to increase the rate at which medical residents utilize screening and treatment for patients at risk for osteoporosis. We explored the association between the implementation of this program and a number of intermediate MSK outcomes. The ideal outcome to assess in these analyses would have been fragility fractures. However, because they are relatively rare events, fractures were not well-suited for an analysis within a short time frame. The intermediate outcomes that we assessed are highly correlated with future fracture risk so it is possible that an effect on fracture may be seen in the future. After controlling for confounders through a multivariable regression model, we found that treatment with bisphosphonate medications, completion of DXA scan, and diagnosis of osteoporosis in patients from the COE-MSK Week group were significantly improved when compared to patients from the non-COE MSK Week cohort.
We observed that the COE-MSK Week cohort has higher rates of co-morbid conditions and medications use in comparison the non-COE-MSK Week group. This difference may in part be due to the tendency to assign patients with more complex medical conditions to trainee clinics at academic institutions. Our multivariable analysis was designed to address this issue; however, the potential for residual confounding cannot be fully excluded.
Our results can be placed in the context of those from other published studies. For example, a randomized controlled trial including 828 primary care providers (PCPs) and 13,455 patients evaluated the impact of an education program on undergoing a bone mineral density (BMD) test and initiating a fracture reducing medication. The study found that the brief program of patient and physician education did not improve osteoporosis management . An observational study found that a PCP workshop was associated with higher rates of BMD testing and initiation with bone-specific medications in elderly women, but did not significantly improve osteoporosis management in men . Our study showed that the COE MSK Education Week could improve the completion of DXA and diagnosis of osteoporosis. The difference between the current study and previous studies may be due to differences in the design of the education programs with greater training intensity during the MSK Week.
A number of randomized controlled trials have examined interventions to improve management of patients at risk for osteoporosis following a fracture event. Examples of these interventions include patient education through a PCP [12, 13], an electronic medical record reminder to a PCP or a patient , education for both the PCP and the patient [15,16,17], and strategies to shift the responsibility for diagnosing and treating the osteoporosis from the PCP to another provider [18, 19]. A systematic review found that these interventions yielded a risk ratio for BMD screening of 2.80 (95% CI: 2.16–3.64) and a risk ratio for anti-resorptive therapy of 2.48 (95% CI: 1.92–3.20) . These are similar to the effect sizes that we found in our study.
Finally, our results can be compared with those from a knowledge translation tool involving a risk assessment questionnaire that generates patient-specific treatment recommendations and education at the point of care. Kastner et al. found that this tool was associated with significant increases in DXA screening (3.4%; 95% CI: 2.0–4.7) and treatment with osteoporosis medications (0.5%; 95% CI: 0.2–0.9) for patients at risk for osteoporosis. However, the magnitudes of these increases were much smaller than our findings.
It is important to note that our study has several limitations. Although we controlled for a number of covariates in the regression models, this approach may not be sufficient to eliminate all of the confounding caused by the difference between two groups. There may be important provider-level characteristics that influenced both the enrollment in the COE training program and the outcomes in our study. These may include diagnostic skills, intellectual interest in bone health, or previous bone health training. Unfortunately, these provider-level characteristics were not available in our data. Another limitation is that, because this study was conducted in a VA population, it may be difficult to generalize the findings to other healthcare systems. For instance, our cohort was overwhelmingly male (91.4%). In addition, because we only used VA data in our study, events that occurred outside the VA system were not captured in the variables constructed for our analyses. Finally, although we believe that the increased rates of screening and prescription reflect retention and application of principles learned during the MSK Education Week, it is possible that this knowledge was acquired in other rotations. In that case, however, the effect would be expected across the comparison patient cohort as well, and we would not expect to see the statistical significance of the results we have observed.
Despite these limitations, our study had a number of strengths that contribute to the importance of our findings. First, we utilized the VA’s extensive electronic medical record to capture both exposure and outcomes. Second, while Veterans often receive healthcare in non-VA settings , the VA is the largest integrated healthcare system in the US . This, along with having selected patients to be included in our study based on having had a primary care encounter prior to the index date, gives us confidence that we have captured most of the outcomes data for the patients in our cohort. Third, our measurement of objective outcomes complements the self-assessment outcomes that are typically captured in evaluations of healthcare educational programs. And finally, our analysis utilized a large control group, which consisted of all Veterans who had been assigned a primary care provider at the SLCVAMC who did not have an encounter with a provider who had been trained through the COE program.
The implementation of the COE in musculoskeletal care was associated with significantly increased the completion of DXA scan and diagnosis of osteoporosis in a population of US veterans in the SLCVAMC. However, initiation of fracture-reducing medications, and diagnosis of osteopenia were not significantly different in patients who were seen by providers who had received COE training compared to patients who were seen by providers who had not participated in this training.
Availability of data and materials
The data used for these analyses is located within VA Informatics and Computing Infrastructure (VINCI), a secure, central analytic platform for performing research and supporting clinical operations activities within the Department of Veterans Affairs (VA). As dictated by VA policies, the data for this study (and any other study conducted within VINCI) cannot be removed from this remote computing environment. However, access to the data can be granted to credentialed researchers.
Bone mineral density
Center of Excellence
Dual energy X-ray absorptiometry
Observed structured clinical examination
Primary care provider
Salt Lake City VA Medical Center
Department of Veterans Affairs
Wright NC, Looker AC, Saag KG, Curtis JR, Delzell ES, Randall S, et al. The recent prevalence of osteoporosis and low bone mass in the United States based on bone mineral density at the femoral neck or lumbar spine. J Bone Miner Res. 2014;29(11):2520–6.
Burge R, Dawson-Hughes B, Solomon DH, Wong JB, King A, Tosteson A. Incidence and economic burden of osteoporosis-related fractures in the United States, 2005-2025. J Bone Miner Res. 2007;22(3):465–75.
Morris CA, Cabral D, Cheng H, Katz JN, Finkelstein JS, Avorn J, et al. Patterns of bone mineral density testing: current guidelines, testing rates, and interventions. J Gen Intern Med. 2004;19(7):783–90.
Siris ES, Modi A, Tang J, Gandhi S, Sen S. Substantial under-treatment among women diagnosed with osteoporosis in a US managed-care population: a retrospective analysis. Curr Med Res Opin. 2014;30(1):123–30.
Management of Osteoporosis in Veterans with Fractures, Report No. 09–03138-191 VA Office of the Inspector General. Washington DC2010.
Cabana MD, Slish KK, Evans D, Mellins RB, Brown RW, Lin X, et al. Impact of physician asthma care education on patient outcomes. Health Educ Behav. 2014;41(5):509–17.
Battistone MJ, Barker AM, Grotzke MP, Beck JP, Berdan JT, Butler JM, et al. Effectiveness of an Interprofessional and multidisciplinary musculoskeletal training program. J Grad Med Educ. 2016;8(3):398–404.
Battistone MJ, Barker AM, Beck JP, Tashjian RZ, Cannon GW. Validity evidence for two objective structured clinical examination stations to evaluate core skills of the shoulder and knee assessment. BMC Med Educ. 2017;17(1):13.
Ulm KA. Simple method to calculate the confidence interval of a standardized mortality ratio (SMR). Am J Epidemiol. 1990;131(2):373–5.
Solomon DH, Katz JN, Finkelstein JS, Polinski JM, Stedman M, Brookhart MA, et al. Osteoporosis improvement: a large-scale randomized controlled trial of patient and primary care physician education. J Bone Miner Res. 2007;22(11):1808–15.
Laliberte MC, Perreault S, Dragomir A, Goudreau J, Rodrigues I, Blais L, et al. Impact of a primary care physician workshop on osteoporosis medical practices. Osteoporos Int. 2010;21(9):1471–85.
Davis JC, Guy P, Ashe MC, Liu-Ambrose T, Khan K. HipWatch: osteoporosis investigation and treatment after a hip fracture: a 6-month randomized controlled trial. J Gerontol A Biol Sci Med Sci. 2007;62(8):888–91.
Gardner MJ, Brophy RH, Demetrakopoulos D, Koob J, Hong R, Rana A, et al. Interventions to improve osteoporosis treatment following hip fracture. A prospective, randomized trial. J Bone Joint Surg Am. 2005;87(1):3–7.
Feldstein A, Elmer PJ, Smith DH, Herson M, Orwoll E, Chen C, et al. Electronic medical record reminder improves osteoporosis management after a fracture: a randomized, controlled trial. J Am Geriatr Soc. 2006;54(3):450–7.
Cranney A, Lam M, Ruhland L, Brison R, Godwin M, Harrison MM, et al. A multifaceted intervention to improve treatment of osteoporosis in postmenopausal women with wrist fractures: a cluster randomized trial. Osteoporos Int. 2008;19(12):1733–40.
Majumdar SR, Johnson JA, McAlister FA, Bellerose D, Russell AS, Hanley DA, et al. Multifaceted intervention to improve diagnosis and treatment of osteoporosis in patients with recent wrist fracture: a randomized controlled trial. CMAJ. 2008;178(5):569–75.
Solomon DH, Polinski JM, Stedman M, Truppo C, Breiner L, Egan C, et al. Improving care of patients at-risk for osteoporosis: a randomized controlled trial. J Gen Intern Med. 2007;22(3):362–7.
Majumdar SR, Beaupre LA, Harley CH, Hanley DA, Lier DA, Juby AG, et al. Use of a case manager to improve osteoporosis treatment after hip fracture: results of a randomized controlled trial. Arch Intern Med. 2007;167(19):2110–5.
Miki RA, Oetgen ME, Kirk J, Insogna KL, Lindskog DM. Orthopaedic management improves the rate of early osteoporosis treatment after hip fracture. A randomized clinical trial. J Bone Joint Surg Am. 2008;90(11):2346–53.
Little EA, Eccles MP. A systematic review of the effectiveness of interventions to improve post-fracture investigation and management of patients at risk of osteoporosis. Implement Sci. 2010;5:80.
Hynes DM, Koelling K, Stroupe K, Arnold N, Mallin K, Sohn MW, et al. Veterans' access to and use of Medicare and veterans affairs health care. Med Care. 2007;45(3):214–23.
Neily J, Mills PD, Young-Xu Y, Carney BT, West P, Berger DH, et al. Association between implementation of a medical team training program and surgical mortality. JAMA. 2010;304(15):1693–700.
This material is the result of work supported with resources and the use of facilities at the George E. Wahlen Department of Veterans Affairs Medical Center, Salt Lake City, Utah. This material is based on work supported by Specialty Care Center of Innovation, Veterans Health Administration and Department of Veterans Affairs, Health Services Research and Development.
This study was supported with funding from the VA Health Services Research and Development Service (grant numbers IK2HX000860 and I50HX001240) and the Office of Academic Affiliations and Office of Specialty Care, United States Veterans Health Administration. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Ethics approval and consent to participate
All relevant ethical safeguards have been met in relation to patient or subject protection. Institutional Review Board (IRB) approval for this study was obtained through the University of Utah’s IRB and the VA’s Office of Research and Development, therefore this study was performed in accordance with the ethical standards contained in the 1964 Declaration of Helsinki and its later amendments. This IRB approval included a waiver of written consent.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Nelson, R.E., Ma, J., Miller, K. et al. The impact of a musculoskeletal training program on residents’ recognition and treatment of osteoporosis. BMC Med Educ 19, 223 (2019). https://doi.org/10.1186/s12909-019-1653-4
- Provider training