Skip to main content
Download PDF

Incorporating interactive workshops into bedside teaching: completion of a multi-modal rheumatology rotation significantly increases internal medicine residents’ competency and comfort with comprehensive knee examinations

BMC Medical Education volume 22, Article number: 355 (2022) Cite this article

Abstract

Background

Studies have elucidated the lack of competency in musculoskeletal (MSK) examination skills amongst trainees. Various modalities have been studied, however, there remains a dearth of literature regarding the effectiveness of bedside teaching versus dedicated workshops. Our aim was to determine if incorporating a workshop into a rheumatology rotation would be effective in increasing medicine residents’ competency and comfort with knee examinations when compared to the rotation alone.

Methods

Over 16 months, rotators were randomized to workshop plus rotation versus rotation alone. Participants were tested on their knee examination skills using an objective structured clinical examination (OSCE). Surveys were administered assessing to what degree the rotation was beneficial. Comfort and helpfulness were measured using a 5-point Likert scale. Paired and independent samples t-tests were used for comparisons.

Results

Fifty-seven residents participated. For both groups, there were improvements between pre- and post-OSCE scores (workshop p < 0.001, no workshop p = 0.003), and levels of comfort with examination (workshop p < 0.001, no workshop p < 0.001). When comparing groups, there were differences favoring the workshop in post-OSCE score (p = < 0.001), mean change in OSCE score (p < 0.001) and mean change in comfort with knee examination (p = 0.025).

Conclusion

An elective in rheumatology augmented residents’ MSK competency and comfort. Incorporation of a workshop further increased knowledge, skills and comfort with diagnosis and treatment. Current educational research focuses on alternatives to traditional methods. This study provides evidence that a multi-modal approach, combining traditional bedside and interactive models, is of benefit.

Peer Review reports

Background

Musculoskeletal (MSK) complaints are the most common conditions evaluated in the ambulatory care setting [1]. Though the prevalence of MSK pathology in the population is considerable, especially among the aging population [2], less than 3% of time in Liaison Committee on Medical Education accredited medical school curricula is devoted to MSK medicine [3]. As a result, graduating medical students have a considerable deficit in MSK knowledge [3, 4] that persists into post-graduate training and beyond.

In one study evaluating knowledge, 210 graduating medical students in the United Kingdom were given a validated assessment of MSK knowledge [5]. Only 21% of students passed the examination and 40% rated themselves as competent in MSK medicine. In another study [6], 170 postgraduate and faculty participants took a practical test of anatomic structures commonly involved in rheumatic diseases. When the entire cohort was considered, the mean correct answer was 46.6% with rheumatology fellows scoring significantly higher than non-rheumatologists.

Various teaching modalities have been developed to attempt to remedy known gaps including lecture-based [7,8,9], peer-to-peer [10,11,12,13] and workshop-based learning [14,15,16,17,18]. Though a surplus of high-quality evidence is lacking [19], much of the previously published literature supports the use of patient educators, small group sessions, computer assisted learning and especially workshops in the enhancement and retention of MSK knowledge and skills.

In an Irish study [20], 140 fourthyear medical students rotated through a new interactive musculoskeletal module over the course of 2 weeks. This module included lectures, interactive tutorials, case discussions, and clinical examination demonstrations. Students found the interactive tutorial approach (48%) to be the most effective teaching method.

Inter and multidisciplinary teaching has been shown to be effective in increasing knowledge gaps [21, 22]. In one study [21], a “musculoskeletal week” program was developed and presented to internal medicine, physical medicine and rehabilitation, and orthopedic residents as well as students and residents from other health profession programs. Faculty from multiple specialties taught skills with practical application. Self-reported scores and confidence with shoulder and knee complaints increased significantly and these were confirmed by evaluation.

Traditional teaching (i.e., at the bedside) has been the mainstay of both undergraduate and graduate medical education. Subspecialty elective rotations have been shown to increase specific skills and knowledge [23]. In a study by Goldenberg et al. [24], 24 internal medicine residents participated in a rheumatology elective (12 ambulatory and 12 inpatient). Both groups performed significantly better in tests of knowledge and clinical performance compared to groups of residents and medical students that did not undergo the elective.

To our knowledge, no studies have been performed comparing the effectiveness of traditional bedside teaching alone versus the addition of dedicated workshops. The aim of this study was to determine if incorporating a MSK workshop into a 2-week clinical rotation in rheumatology would result in an increase internal medicine residents’ competency and comfort with knee examinations when compared to the rotation alone.

Methods

Ethical approval and sample recruitment

The Rush University Medical Center Institutional Review Board granted approval for the study and informed consent was obtained from all participants. This was a single center study. Internal medicine and preliminary residents of all PGY levels were asked to voluntarily participate at the start of the elective. No resident declined to participate. The rheumatology elective curriculum is compromised equally of inpatient and outpatient experiences over a 2-week period, without formal didactics on musculoskeletal examination skills. During the 16-month study period, from January 2018 to April 2019, each block of resident rotators were randomized to workshop plus rotation versus rotation alone, with every other group receiving the workshop (Fig. 1). There were no exclusion criteria.

Fig. 1
figure 1

Participant enrollment flow diagram

Full size image

Pre-rotation evaluation

Participants were tested on their knee examination skills at the start of the rotation by one of two trained evaluators using an objective structured clinical examination (OSCE), graded on a linear scale, for a total of 14 points. For every maneuver completed correctly, 1 point was given. For an element attempted but completed incorrectly, 0.5 points was given (Additional file 1: Appendix A).

Workshop design

Those randomized to the intervention group were provided a 1-hour workshop, which was designed with input from a rheumatology faculty focus group. The session consisted of a didactic presentation (based on Bates’ Guide to Physical Examination and History Taking [25]), video (The New England Journal of Medicine, Videos in Clinical Medicine- Clinical Evaluation of the Knee [26]) and supervised hands-on application of skills. For the didactic portion, a PowerPoint© was used which consisted of a review of anatomical structures and physical examination techniques (inspection, palpation, assessing for fluid, range of motion testing, and provocative tests). For the skills component, residents were partnered and practiced the physical examination on each other with direct attending oversight and demonstration. Immediately following the rotation, all residents were retested using the OSCE.

Pre- and post-rotation evaluation

Residents were administered a pre- and post-rotation survey assessing to what degree the rotation enhanced their comfort with knee examination skills, comfort with diagnosing and treating common musculoskeletal complaints, and to what degree elective completion was helpful. Participants were also asked to attribute what percentage of various experiences contributed to their total musculoskeletal knowledge (totaling 100%). Examples of these experiences included skills learned during medical school, completion of a rheumatology elective, and independent study.

Statistical analysis

Comfort and helpfulness were measured using a 5-point Likert scale (1: not comfortable and 5: very comfortable). Paired and independent samples t-tests were used for pre and post as well as between group comparisons. Inter-rater variability was measured between the two OSCE evaluators. The significance value alpha was set to 0.05 for these analyses. Statistical analysis was completed using SPSS software, version 22.

Results

Cohort and Interrater variability

Fifty-seven residents participated in the study; ten were lost to follow-up due to being removed from the rotation for call obligations, or taking a sick day. As the number of residents assigned to rheumatology varied biweekly, group sizes were unequal with 24 receiving the workshop and 23 completing the elective alone. Only 10% were aware of this study prior to rotation start. Baseline characteristics pre-rotation are shown in Table 1. There were no statistically significant differences between the workshop and no workshop groups at baseline. Inter-rater variability was calculated using the intraclass correlation coefficient and was found to be 0.995–0.997. This is considered to be excellent [27] per Koo and Li, 2016.

Table 1 Baseline Characteristics (Mean ± Standard Deviation)
Full size table

Intravariable analysis-experimental group

As shown in Table 2, for the workshop group, there were significant improvements between pre- and post-OSCE scores (p < 0.001), levels of comfort with knee examination skills (p < 0.001), the number of lower extremity MSK conditions that residents felt comfortable diagnosing (p < 0.001), and treating (p = 0.003). Of the experiences that residents felt contributed to their musculoskeletal knowledge, only completion of the rheumatology elective showed significant contribution (p < 0.001).

Table 2 Pre-Rotation Versus Post-Rotation Outcomes (Mean ± Standard Deviation)
Full size table

Intravariable analysis-control group

For the no workshop group, also shown in Table 2, there were significant improvements between pre- and post-test OSCE scores (p = 0.003) and levels of comfort with knee examination skills (p < 0.001), and the percentage of total MSK knowledge that rheumatology elective completion resulted in (p < 0.001). No significant differences were found between the number of lower extremity MSK conditions that residents felt comfortable diagnosing (p = 0.296), and treating (p = 0.131).

Post-rotation group comparative analysis

When comparing groups post-rotation, as shown in Table 3, there were significant differences favoring the workshop group in post-OSCE score (p = < 0.001), helpfulness of the rotation in enhancing MSK examination skills (p = 0.033) and the number of lower extremity MSK conditions that residents felt comfortable diagnosing (p = 0.046). There were no significant differences post-rotation between the control and experimental group in the number of lower extremity MSK conditions that residents felt comfortable treating. Similarly, there was no difference noted in total MSK knowledge from the rheumatology elective.

Table 3 Post-Rotation Variables (Mean ± Standard Deviation)
Full size table

Group comparative analysis-outcomes

When comparing the workshop to the no workshop group, there were significant differences favoring the workshop group in mean change in OSCE scores (mean absolute change workshop = 6.33 ± 2.06; mean absolute change no workshop = 2.30 ± 3.17, p < 0.001) and comfort with knee examinations (mean absolute change workshop = 1.57 ± 0.843; mean absolute change no workshop = 0.96 ± 0.93, p = 0.025) pre- and post-rotation.

Discussion

To our knowledge, this is the only study directly comparing subspecialty elective completion to an elective combined with a MSK workshop. Existing literature supports a lack of competency in application of MSK examination skills [28,29,30,31]. In a study by Schmale [28], all second through fourth- year medical students were invited to participate in a survey consisting of short answer questions on MSK medicine previously validated for MSK competency. Results revealed increasing scores by level of education. Percent passing ranged from 0% for the second-year students to 43% at the fourth-year level. Shortfalls in MSK knowledge persisted post-medical school graduation. In another study [29], 300 primary care physicians were selected and completed a questionnaire and an assessment of cognitive competency in rheumatology. While the survey indicated that MSK complaints made up 30–40% of their practice, only 25% achieved a passing score. In concordance with the existing literature, we were able to demonstrate a baseline deficiency in MSK knee examination skills for internal medicine residents as evidenced by low baseline OSCE scores across the group as a whole.

Our results add further evidence that internal medicine residents also lack confidence in clinical skills as illustrated by low levels of baseline comfort with knee examinations and baseline perceived ability to diagnose and treat MSK conditions. In a study by Katz and Oswald [30, 32], 216 Canadian internal medicine residents received a survey ranking self-confidence in specialty skills. Self-confidence in rheumatology was the lowest of the specialties. In another study by Kroop et al. [31, 33], a self-assessed confidence survey was administered to PGY-1 and PGY-3 internal medicine residents. The survey assessed confidence in performing a rheumatologic history and physical examination, procedures, ordering/interpreting lab tests and caring for patients with rheumatologic conditions. Self-assessed confidence in joint procedures was consistently low in both groups. When comparing PGY 3 residents who did or did not take a rheumatology elective, the confidence was higher for exam skills and shoulder injection in residents who completed the elective. Among the 57 internal medicine residents who participated in our study, we were able to show that rheumatology elective completion alone significantly enhanced competency and comfort with musculoskeletal examination skills, aligning with this and with previously published literature on elective experiences [23, 24].

In a study by Hergenroeder et al. [16], 58 pediatric residents during a 1-month adolescent medicine rotation received a workshop on the knee and ankle. The workshop consisted of a video, direct observation, and demonstration of the technique by the resident. The residents increased their correct performance significantly and this effect was maintained at 9 months. In another study by Denizard-Thompson et al. [14], 36 residents received a half-day session on shoulder and knee complaints. This included a presentation highlighting history, examination and procedural skills and a charades game in which competitors demonstrated joint examinations. After the session, residents showed significantly increased confidence in MSK examinations and injections. When comparing those receiving a workshop in addition to a rheumatology elective to those who completed the elective alone, we also observed important differences. The workshop group scored significantly higher on the post-rotation OSCE, had greater increases in comfort with examination and had higher levels of perceived helpfulness of the rotation in both enhancing MSK skills and diagnosing MSK conditions. This supports the use of interactive workshops in increasing knowledge and clinical skills [14, 15].

Our study has several limitations. A power calculation was not performed and thus sample size adequacy could not be formulated. Ten residents were lost to follow-up, decreasing our possible sample size. Additionally, the study was conducted at a single tertiary academic center, perhaps limiting generalizability. Though we did not specifically analyze outcome by PGY level, we were able to demonstrate that the groups were similar at baseline in OSCE scores and levels of comfort. Another limitation includes evaluating lack of long-term retention rates of physical examination skills between the groups.

Future directions include replicating the study with more participants, pursuing multi-institutional collaboration, investigating outcomes within other specialties/sub-specialties and exploring long term retention rates.

Conclusion

This study showed that an elective experience in rheumatology augmented internal medicine residents’ MSK competency and comfort. Incorporation of an interactive MSK workshop further increased residents’ knowledge, skills and comfort with diagnosing and treating rheumatologic conditions more than the elective alone. The current climate in educational research focuses on alternative approaches to traditional teaching methods. This study provides considerable evidence that a multi-modal approach in post-graduate education, combing traditional bedside and interactive models, is of benefit.

Availability of data and materials

The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.

Abbreviations

MSK:

Musculoskeletal

OSCE:

Observed structure clinical examination

References

  1. Schappert SM, Rechtsteiner EA. Ambulatory medical care utilization estimates for 2007. Vital Health Stat Ser 13. 2011;169(169):1–38.

    Google Scholar 

  2. United States Bone and Joint Initiative. The burden of musculoskeletal diseases in the United States (BMUS). 3rd ed. Rosemont; 2014. Available at http://www.boneandjointburden.org. Accessed on (5/29/19)

  3. Freedman KB, Bernstein J. The adequacy of medical school education in musculoskeletal medicine. J Bone Joint Surg. 1998;80(10):1421–7.

    Article  Google Scholar 

  4. Pinney SJ, Regan WD. Educating medical students about musculoskeletal problems. Are community needs reflected in the curricula of Canadian medical schools? J Bone Joint Surg. 2001;83(9):1317–20.

    Article  Google Scholar 

  5. Al-Nammari SS, Pengas I, Asopa V, Jawad A, Rafferty M, Ramachandran M. The inadequacy of musculoskeletal knowledge in graduating medical students in the United Kingdom. J Bone Joint Surg. 2015;97(7):e36.

    Article  Google Scholar 

  6. Navarro-Zarza JE, Hernandez-Diaz C, Saavedra MA, et al. Preworkshop knowledge of musculoskeletal anatomy of rheumatology fellows and rheumatologists of seven north, central, and south american countries. Arthritis Care Res. 2014;66(2):270–6.

    Article  Google Scholar 

  7. Smith CC, Newman L, Davis RB, Yang J, Ramanan R. A comprehensive new curriculum to teach and assess resident knowledge and diagnostic evaluation of musculoskeletal complaints. Med Teach. 2005;27(6):553–8.

    Article  Google Scholar 

  8. Schiff A, Salazar D, Vetter C, Andre J, Pinzur M. Results of a near-peer musculoskeletal medicine curriculum for senior medical students interested in orthopedic surgery. J Surg Educ. 2014;71(5):734–7.

    Article  Google Scholar 

  9. Khorsand D, Khwaja A, Schmale GA. Early musculoskeletal classroom education confers little advantage to medical student knowledge and competency in the absence of clinical experiences: a retrospective comparison study. BMC Med Educ. 2018;18(1):46.

    Article  Google Scholar 

  10. Smith MD, Henry-Edwards S, Shanahan EM, Ahern MJ. Evaluation of patient partners in the teaching of the musculoskeletal examination. J Rheumatol. 2000;27(6):1533–7.

    Google Scholar 

  11. Button JH, Bruel BM, Francisco GE. Assessment of musculoskeletal examination skills: Physiatry residents as evaluators and models. Am J Phys Med Rehabil. 2007;86(11):926–34.

    Article  Google Scholar 

  12. Perry ME, Burke JM, Friel L, Field M. Can training in musculoskeletal examination skills be effectively delivered by undergraduate students as part of the standard curriculum? Rheumatology (Oxford). 2010;49(9):1756–61.

    Article  Google Scholar 

  13. Martinez J, Harris C, Jalali C, Tung J, Meyer R. Using peer-assisted learning to teach and evaluate residents' musculoskeletal skills. Med Educ. 2015;20:27255.

    Google Scholar 

  14. Denizard-Thompson N, Feiereisel KB, Pedley CF, Burns C, Campos C. Musculoskeletal basics: the shoulder and the knee workshop for primary care residents. MedEdPORTAL. 2018;14:10749–8265.10749.

    Google Scholar 

  15. Murphy HJ, Karpinski AC, Messer A, et al. Resident workshop standardizes patient handoff and improves quality, confidence, and knowledge. South Med J. 2017;110(9):571–7.

    Article  Google Scholar 

  16. Hergenroeder AC, Chorley JN, Laufman L, Fetterhoff AC. Pediatric residents' performance of ankle and knee examinations after an educational intervention. Pediatrics. 2001;107(4):E52.

    Article  Google Scholar 

  17. Saavedra MA, Navarro-Zarza JE, Alvarez-Nemegyei J, et al. Self-assessed efficacy of a clinical musculoskeletal anatomy workshop: a preliminary survey. Reumatologia Clinica. 2015;11(4):224–6.

    Article  Google Scholar 

  18. Saavedra MA, Villasenor-Ovies P, Harfush LA, et al. Educational impact of a clinical anatomy workshop on 1st-year orthopedic and rheumatology fellows in Mexico City. Clin Rheumatol. 2016;35(5):1299–306.

    Article  Google Scholar 

  19. O'Dunn-Orto A, Hartling L, Campbell S, Oswald AE. Teaching musculoskeletal clinical skills to medical trainees and physicians: a best evidence in medical education systematic review of strategies and their effectiveness: BEME guide no. 18. Med Teach. 2012;34(2):93–102.

    Article  Google Scholar 

  20. Vioreanu MH, O'Daly BJ, Shelly MJ, Devitt BM, O'Byrne JM. Design, implementation and prospective evaluation of a new interactive musculoskeletal module for medical students in Ireland. Ir J Med Sci. 2013;182(2):191–9.

    Article  Google Scholar 

  21. Battistone MJ, Barker AM, Grotzke MP, Beck JP, Berdan JT, Butler JM, et al. Effectiveness of an Interprofessional and multidisciplinary musculoskeletal training program. J Grad Med Educ. 2016;8(3):398–404.

    Article  Google Scholar 

  22. Battistone MJ, Barker AM, Grotzke MP, Beck JP, Lawrence P, Cannon GW. "mini-residency" in musculoskeletal care: a National Continuing Professional Development Program for primary care providers. J Gen Intern Med. 2016;31(11):1301–7.

    Article  Google Scholar 

  23. Hale A, Glassman R, Fessler D, Mukamal KJ, Stead W. Meeting the needs of the resident trainee during an elective subspecialty rotation. Int J Med Educ. 2016;7:115–8.

    Article  Google Scholar 

  24. Goldenberg DL, Meenan RF, Allaire S, Cohen AS. The educational impact of a rheumatology elective. Arthritis Rheum. 1983;26(5):658–63.

    Article  Google Scholar 

  25. Bickley LS, Szilagyi PG, Hoffman RM. Bates' guide to physical examination and history taking. 12th ed. Philadelphia: Wolters Kluwer; 2017.

    Google Scholar 

  26. Schraeder TL, Terek RM, Smith CC. Clinical evaluation of the knee. Major search engines and directories. https://www.nejm.org/doi/full/10.1056/NEJMvcm0803821. Updated July 22, 2010. Accessed 29 May 2019.

  27. Koo TK, Li MY. A guideline of selecting and reporting Intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15(2):155–63.

    Article  Google Scholar 

  28. Schmale GA. More evidence of educational inadequacies in musculoskeletal medicine. Clin Orthop Relat Res. 2005;437:251–9.

    Article  Google Scholar 

  29. Abou-Raya A, Abou-Raya S. The inadequacies of musculoskeletal education. Clin Rheumatol. 2010;29(10):1121–6.

    Article  Google Scholar 

  30. Saleh K, Messner R, Axtell S, Harris I, Mahowald ML. Development and evaluation of an integrated musculoskeletal disease course for medical students. J Bone Joint Surg. 2004;86(8):1653–8.

    Article  Google Scholar 

  31. DiGiovanni BF, Sundem LT, Southgate RD, Lambert DR. Musculoskeletal medicine is underrepresented in the american medical school clinical curriculum. Clin Orthop Relat Res. 2016;474(4):901–7.

    Article  Google Scholar 

  32. Katz SJ, Oswald AE. How confident are internal medicine residents in rheumatology versus other common internal medicine clinical skills: an issue of training time or exposure? Clin Rheumatol. 2011;30(8):1081–93.

    Article  Google Scholar 

  33. Kroop SF, Chung CP, Davidson MA, Horn L, Damp JB, Dewey C. Rheumatologic skills development: what are the needs of internal medicine residents? Clin Rheumatol. 2016;35(8):2109–15.

    Article  Google Scholar 

Download references

Acknowledgements

The authors would like to thank Eric Blanco, for providing assistance with objective structured clinical examinations.

Funding

None.

Author information

Authors and Affiliations

  1. Division of Allergy, Immunology & Rheumatology, The State University of New York at Buffalo, Buffalo, NY, USA

    Alysia Kwiatkowski

  2. Division of Rheumatology, Rush University Medical Center, Chicago, IL, USA

    Najia Shakoor, Augustine Manadan, Joel A. Block & Sonali Khandelwal

Authors
  1. Alysia Kwiatkowski
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Najia Shakoor
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Augustine Manadan
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Joel A. Block
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Sonali Khandelwal
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

AK was involved in all aspects of study design, data collection/analysis, and drafting of manuscript. NS was involved in study design, data analysis, and manuscript editing. AM was involved in study design. JB was involved in study design, data analysis, and manuscript editing. SK was involved in all aspects of study design, data collection, and analysis. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Alysia Kwiatkowski.

Ethics declarations

Ethics approval and consent to participate

The Rush University Medical Center Institutional Review Board granted approval for the study and informed consent was obtained from all participants. All methods were carried out in accordance with relevant guidelines and regulations.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kwiatkowski, A., Shakoor, N., Manadan, A. et al. Incorporating interactive workshops into bedside teaching: completion of a multi-modal rheumatology rotation significantly increases internal medicine residents’ competency and comfort with comprehensive knee examinations. BMC Med Educ 22, 355 (2022). https://doi.org/10.1186/s12909-022-03425-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12909-022-03425-4

Keywords

BMC Medical Education

ISSN: 1472-6920

Contact us