- Research
- Open Access
- Published:
Incorporating interactive workshops into bedside teaching: completion of a multi-modal rheumatology rotation significantly increases internal medicine residents’ competency and comfort with comprehensive knee examinations
BMC Medical Education volume 22, Article number: 355 (2022)
Abstract
Background
Studies have elucidated the lack of competency in musculoskeletal (MSK) examination skills amongst trainees. Various modalities have been studied, however, there remains a dearth of literature regarding the effectiveness of bedside teaching versus dedicated workshops. Our aim was to determine if incorporating a workshop into a rheumatology rotation would be effective in increasing medicine residents’ competency and comfort with knee examinations when compared to the rotation alone.
Methods
Over 16 months, rotators were randomized to workshop plus rotation versus rotation alone. Participants were tested on their knee examination skills using an objective structured clinical examination (OSCE). Surveys were administered assessing to what degree the rotation was beneficial. Comfort and helpfulness were measured using a 5-point Likert scale. Paired and independent samples t-tests were used for comparisons.
Results
Fifty-seven residents participated. For both groups, there were improvements between pre- and post-OSCE scores (workshop p < 0.001, no workshop p = 0.003), and levels of comfort with examination (workshop p < 0.001, no workshop p < 0.001). When comparing groups, there were differences favoring the workshop in post-OSCE score (p = < 0.001), mean change in OSCE score (p < 0.001) and mean change in comfort with knee examination (p = 0.025).
Conclusion
An elective in rheumatology augmented residents’ MSK competency and comfort. Incorporation of a workshop further increased knowledge, skills and comfort with diagnosis and treatment. Current educational research focuses on alternatives to traditional methods. This study provides evidence that a multi-modal approach, combining traditional bedside and interactive models, is of benefit.
Background
Musculoskeletal (MSK) complaints are the most common conditions evaluated in the ambulatory care setting [1]. Though the prevalence of MSK pathology in the population is considerable, especially among the aging population [2], less than 3% of time in Liaison Committee on Medical Education accredited medical school curricula is devoted to MSK medicine [3]. As a result, graduating medical students have a considerable deficit in MSK knowledge [3, 4] that persists into post-graduate training and beyond.
In one study evaluating knowledge, 210 graduating medical students in the United Kingdom were given a validated assessment of MSK knowledge [5]. Only 21% of students passed the examination and 40% rated themselves as competent in MSK medicine. In another study [6], 170 postgraduate and faculty participants took a practical test of anatomic structures commonly involved in rheumatic diseases. When the entire cohort was considered, the mean correct answer was 46.6% with rheumatology fellows scoring significantly higher than non-rheumatologists.
Various teaching modalities have been developed to attempt to remedy known gaps including lecture-based [7,8,9], peer-to-peer [10,11,12,13] and workshop-based learning [14,15,16,17,18]. Though a surplus of high-quality evidence is lacking [19], much of the previously published literature supports the use of patient educators, small group sessions, computer assisted learning and especially workshops in the enhancement and retention of MSK knowledge and skills.
In an Irish study [20], 140 fourthyear medical students rotated through a new interactive musculoskeletal module over the course of 2 weeks. This module included lectures, interactive tutorials, case discussions, and clinical examination demonstrations. Students found the interactive tutorial approach (48%) to be the most effective teaching method.
Inter and multidisciplinary teaching has been shown to be effective in increasing knowledge gaps [21, 22]. In one study [21], a “musculoskeletal week” program was developed and presented to internal medicine, physical medicine and rehabilitation, and orthopedic residents as well as students and residents from other health profession programs. Faculty from multiple specialties taught skills with practical application. Self-reported scores and confidence with shoulder and knee complaints increased significantly and these were confirmed by evaluation.
Traditional teaching (i.e., at the bedside) has been the mainstay of both undergraduate and graduate medical education. Subspecialty elective rotations have been shown to increase specific skills and knowledge [23]. In a study by Goldenberg et al. [24], 24 internal medicine residents participated in a rheumatology elective (12 ambulatory and 12 inpatient). Both groups performed significantly better in tests of knowledge and clinical performance compared to groups of residents and medical students that did not undergo the elective.
To our knowledge, no studies have been performed comparing the effectiveness of traditional bedside teaching alone versus the addition of dedicated workshops. The aim of this study was to determine if incorporating a MSK workshop into a 2-week clinical rotation in rheumatology would result in an increase internal medicine residents’ competency and comfort with knee examinations when compared to the rotation alone.
Methods
Ethical approval and sample recruitment
The Rush University Medical Center Institutional Review Board granted approval for the study and informed consent was obtained from all participants. This was a single center study. Internal medicine and preliminary residents of all PGY levels were asked to voluntarily participate at the start of the elective. No resident declined to participate. The rheumatology elective curriculum is compromised equally of inpatient and outpatient experiences over a 2-week period, without formal didactics on musculoskeletal examination skills. During the 16-month study period, from January 2018 to April 2019, each block of resident rotators were randomized to workshop plus rotation versus rotation alone, with every other group receiving the workshop (Fig. 1). There were no exclusion criteria.
Pre-rotation evaluation
Participants were tested on their knee examination skills at the start of the rotation by one of two trained evaluators using an objective structured clinical examination (OSCE), graded on a linear scale, for a total of 14 points. For every maneuver completed correctly, 1 point was given. For an element attempted but completed incorrectly, 0.5 points was given (Additional file 1: Appendix A).
Workshop design
Those randomized to the intervention group were provided a 1-hour workshop, which was designed with input from a rheumatology faculty focus group. The session consisted of a didactic presentation (based on Bates’ Guide to Physical Examination and History Taking [25]), video (The New England Journal of Medicine, Videos in Clinical Medicine- Clinical Evaluation of the Knee [26]) and supervised hands-on application of skills. For the didactic portion, a PowerPoint© was used which consisted of a review of anatomical structures and physical examination techniques (inspection, palpation, assessing for fluid, range of motion testing, and provocative tests). For the skills component, residents were partnered and practiced the physical examination on each other with direct attending oversight and demonstration. Immediately following the rotation, all residents were retested using the OSCE.
Pre- and post-rotation evaluation
Residents were administered a pre- and post-rotation survey assessing to what degree the rotation enhanced their comfort with knee examination skills, comfort with diagnosing and treating common musculoskeletal complaints, and to what degree elective completion was helpful. Participants were also asked to attribute what percentage of various experiences contributed to their total musculoskeletal knowledge (totaling 100%). Examples of these experiences included skills learned during medical school, completion of a rheumatology elective, and independent study.
Statistical analysis
Comfort and helpfulness were measured using a 5-point Likert scale (1: not comfortable and 5: very comfortable). Paired and independent samples t-tests were used for pre and post as well as between group comparisons. Inter-rater variability was measured between the two OSCE evaluators. The significance value alpha was set to 0.05 for these analyses. Statistical analysis was completed using SPSS software, version 22.
Results
Cohort and Interrater variability
Fifty-seven residents participated in the study; ten were lost to follow-up due to being removed from the rotation for call obligations, or taking a sick day. As the number of residents assigned to rheumatology varied biweekly, group sizes were unequal with 24 receiving the workshop and 23 completing the elective alone. Only 10% were aware of this study prior to rotation start. Baseline characteristics pre-rotation are shown in Table 1. There were no statistically significant differences between the workshop and no workshop groups at baseline. Inter-rater variability was calculated using the intraclass correlation coefficient and was found to be 0.995–0.997. This is considered to be excellent [27] per Koo and Li, 2016.
Intravariable analysis-experimental group
As shown in Table 2, for the workshop group, there were significant improvements between pre- and post-OSCE scores (p < 0.001), levels of comfort with knee examination skills (p < 0.001), the number of lower extremity MSK conditions that residents felt comfortable diagnosing (p < 0.001), and treating (p = 0.003). Of the experiences that residents felt contributed to their musculoskeletal knowledge, only completion of the rheumatology elective showed significant contribution (p < 0.001).
Intravariable analysis-control group
For the no workshop group, also shown in Table 2, there were significant improvements between pre- and post-test OSCE scores (p = 0.003) and levels of comfort with knee examination skills (p < 0.001), and the percentage of total MSK knowledge that rheumatology elective completion resulted in (p < 0.001). No significant differences were found between the number of lower extremity MSK conditions that residents felt comfortable diagnosing (p = 0.296), and treating (p = 0.131).
Post-rotation group comparative analysis
When comparing groups post-rotation, as shown in Table 3, there were significant differences favoring the workshop group in post-OSCE score (p = < 0.001), helpfulness of the rotation in enhancing MSK examination skills (p = 0.033) and the number of lower extremity MSK conditions that residents felt comfortable diagnosing (p = 0.046). There were no significant differences post-rotation between the control and experimental group in the number of lower extremity MSK conditions that residents felt comfortable treating. Similarly, there was no difference noted in total MSK knowledge from the rheumatology elective.
Group comparative analysis-outcomes
When comparing the workshop to the no workshop group, there were significant differences favoring the workshop group in mean change in OSCE scores (mean absolute change workshop = 6.33 ± 2.06; mean absolute change no workshop = 2.30 ± 3.17, p < 0.001) and comfort with knee examinations (mean absolute change workshop = 1.57 ± 0.843; mean absolute change no workshop = 0.96 ± 0.93, p = 0.025) pre- and post-rotation.
Discussion
To our knowledge, this is the only study directly comparing subspecialty elective completion to an elective combined with a MSK workshop. Existing literature supports a lack of competency in application of MSK examination skills [28,29,30,31]. In a study by Schmale [28], all second through fourth- year medical students were invited to participate in a survey consisting of short answer questions on MSK medicine previously validated for MSK competency. Results revealed increasing scores by level of education. Percent passing ranged from 0% for the second-year students to 43% at the fourth-year level. Shortfalls in MSK knowledge persisted post-medical school graduation. In another study [29], 300 primary care physicians were selected and completed a questionnaire and an assessment of cognitive competency in rheumatology. While the survey indicated that MSK complaints made up 30–40% of their practice, only 25% achieved a passing score. In concordance with the existing literature, we were able to demonstrate a baseline deficiency in MSK knee examination skills for internal medicine residents as evidenced by low baseline OSCE scores across the group as a whole.
Our results add further evidence that internal medicine residents also lack confidence in clinical skills as illustrated by low levels of baseline comfort with knee examinations and baseline perceived ability to diagnose and treat MSK conditions. In a study by Katz and Oswald [30, 32], 216 Canadian internal medicine residents received a survey ranking self-confidence in specialty skills. Self-confidence in rheumatology was the lowest of the specialties. In another study by Kroop et al. [31, 33], a self-assessed confidence survey was administered to PGY-1 and PGY-3 internal medicine residents. The survey assessed confidence in performing a rheumatologic history and physical examination, procedures, ordering/interpreting lab tests and caring for patients with rheumatologic conditions. Self-assessed confidence in joint procedures was consistently low in both groups. When comparing PGY 3 residents who did or did not take a rheumatology elective, the confidence was higher for exam skills and shoulder injection in residents who completed the elective. Among the 57 internal medicine residents who participated in our study, we were able to show that rheumatology elective completion alone significantly enhanced competency and comfort with musculoskeletal examination skills, aligning with this and with previously published literature on elective experiences [23, 24].
In a study by Hergenroeder et al. [16], 58 pediatric residents during a 1-month adolescent medicine rotation received a workshop on the knee and ankle. The workshop consisted of a video, direct observation, and demonstration of the technique by the resident. The residents increased their correct performance significantly and this effect was maintained at 9 months. In another study by Denizard-Thompson et al. [14], 36 residents received a half-day session on shoulder and knee complaints. This included a presentation highlighting history, examination and procedural skills and a charades game in which competitors demonstrated joint examinations. After the session, residents showed significantly increased confidence in MSK examinations and injections. When comparing those receiving a workshop in addition to a rheumatology elective to those who completed the elective alone, we also observed important differences. The workshop group scored significantly higher on the post-rotation OSCE, had greater increases in comfort with examination and had higher levels of perceived helpfulness of the rotation in both enhancing MSK skills and diagnosing MSK conditions. This supports the use of interactive workshops in increasing knowledge and clinical skills [14, 15].
Our study has several limitations. A power calculation was not performed and thus sample size adequacy could not be formulated. Ten residents were lost to follow-up, decreasing our possible sample size. Additionally, the study was conducted at a single tertiary academic center, perhaps limiting generalizability. Though we did not specifically analyze outcome by PGY level, we were able to demonstrate that the groups were similar at baseline in OSCE scores and levels of comfort. Another limitation includes evaluating lack of long-term retention rates of physical examination skills between the groups.
Future directions include replicating the study with more participants, pursuing multi-institutional collaboration, investigating outcomes within other specialties/sub-specialties and exploring long term retention rates.
Conclusion
This study showed that an elective experience in rheumatology augmented internal medicine residents’ MSK competency and comfort. Incorporation of an interactive MSK workshop further increased residents’ knowledge, skills and comfort with diagnosing and treating rheumatologic conditions more than the elective alone. The current climate in educational research focuses on alternative approaches to traditional teaching methods. This study provides considerable evidence that a multi-modal approach in post-graduate education, combing traditional bedside and interactive models, is of benefit.
Availability of data and materials
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.
Abbreviations
- MSK:
-
Musculoskeletal
- OSCE:
-
Observed structure clinical examination
References
Schappert SM, Rechtsteiner EA. Ambulatory medical care utilization estimates for 2007. Vital Health Stat Ser 13. 2011;169(169):1–38.
United States Bone and Joint Initiative. The burden of musculoskeletal diseases in the United States (BMUS). 3rd ed. Rosemont; 2014. Available at http://www.boneandjointburden.org. Accessed on (5/29/19)
Freedman KB, Bernstein J. The adequacy of medical school education in musculoskeletal medicine. J Bone Joint Surg. 1998;80(10):1421–7.
Pinney SJ, Regan WD. Educating medical students about musculoskeletal problems. Are community needs reflected in the curricula of Canadian medical schools? J Bone Joint Surg. 2001;83(9):1317–20.
Al-Nammari SS, Pengas I, Asopa V, Jawad A, Rafferty M, Ramachandran M. The inadequacy of musculoskeletal knowledge in graduating medical students in the United Kingdom. J Bone Joint Surg. 2015;97(7):e36.
Navarro-Zarza JE, Hernandez-Diaz C, Saavedra MA, et al. Preworkshop knowledge of musculoskeletal anatomy of rheumatology fellows and rheumatologists of seven north, central, and south american countries. Arthritis Care Res. 2014;66(2):270–6.
Smith CC, Newman L, Davis RB, Yang J, Ramanan R. A comprehensive new curriculum to teach and assess resident knowledge and diagnostic evaluation of musculoskeletal complaints. Med Teach. 2005;27(6):553–8.
Schiff A, Salazar D, Vetter C, Andre J, Pinzur M. Results of a near-peer musculoskeletal medicine curriculum for senior medical students interested in orthopedic surgery. J Surg Educ. 2014;71(5):734–7.
Khorsand D, Khwaja A, Schmale GA. Early musculoskeletal classroom education confers little advantage to medical student knowledge and competency in the absence of clinical experiences: a retrospective comparison study. BMC Med Educ. 2018;18(1):46.
Smith MD, Henry-Edwards S, Shanahan EM, Ahern MJ. Evaluation of patient partners in the teaching of the musculoskeletal examination. J Rheumatol. 2000;27(6):1533–7.
Button JH, Bruel BM, Francisco GE. Assessment of musculoskeletal examination skills: Physiatry residents as evaluators and models. Am J Phys Med Rehabil. 2007;86(11):926–34.
Perry ME, Burke JM, Friel L, Field M. Can training in musculoskeletal examination skills be effectively delivered by undergraduate students as part of the standard curriculum? Rheumatology (Oxford). 2010;49(9):1756–61.
Martinez J, Harris C, Jalali C, Tung J, Meyer R. Using peer-assisted learning to teach and evaluate residents' musculoskeletal skills. Med Educ. 2015;20:27255.
Denizard-Thompson N, Feiereisel KB, Pedley CF, Burns C, Campos C. Musculoskeletal basics: the shoulder and the knee workshop for primary care residents. MedEdPORTAL. 2018;14:10749–8265.10749.
Murphy HJ, Karpinski AC, Messer A, et al. Resident workshop standardizes patient handoff and improves quality, confidence, and knowledge. South Med J. 2017;110(9):571–7.
Hergenroeder AC, Chorley JN, Laufman L, Fetterhoff AC. Pediatric residents' performance of ankle and knee examinations after an educational intervention. Pediatrics. 2001;107(4):E52.
Saavedra MA, Navarro-Zarza JE, Alvarez-Nemegyei J, et al. Self-assessed efficacy of a clinical musculoskeletal anatomy workshop: a preliminary survey. Reumatologia Clinica. 2015;11(4):224–6.
Saavedra MA, Villasenor-Ovies P, Harfush LA, et al. Educational impact of a clinical anatomy workshop on 1st-year orthopedic and rheumatology fellows in Mexico City. Clin Rheumatol. 2016;35(5):1299–306.
O'Dunn-Orto A, Hartling L, Campbell S, Oswald AE. Teaching musculoskeletal clinical skills to medical trainees and physicians: a best evidence in medical education systematic review of strategies and their effectiveness: BEME guide no. 18. Med Teach. 2012;34(2):93–102.
Vioreanu MH, O'Daly BJ, Shelly MJ, Devitt BM, O'Byrne JM. Design, implementation and prospective evaluation of a new interactive musculoskeletal module for medical students in Ireland. Ir J Med Sci. 2013;182(2):191–9.
Battistone MJ, Barker AM, Grotzke MP, Beck JP, Berdan JT, Butler JM, et al. Effectiveness of an Interprofessional and multidisciplinary musculoskeletal training program. J Grad Med Educ. 2016;8(3):398–404.
Battistone MJ, Barker AM, Grotzke MP, Beck JP, Lawrence P, Cannon GW. "mini-residency" in musculoskeletal care: a National Continuing Professional Development Program for primary care providers. J Gen Intern Med. 2016;31(11):1301–7.
Hale A, Glassman R, Fessler D, Mukamal KJ, Stead W. Meeting the needs of the resident trainee during an elective subspecialty rotation. Int J Med Educ. 2016;7:115–8.
Goldenberg DL, Meenan RF, Allaire S, Cohen AS. The educational impact of a rheumatology elective. Arthritis Rheum. 1983;26(5):658–63.
Bickley LS, Szilagyi PG, Hoffman RM. Bates' guide to physical examination and history taking. 12th ed. Philadelphia: Wolters Kluwer; 2017.
Schraeder TL, Terek RM, Smith CC. Clinical evaluation of the knee. Major search engines and directories. https://www.nejm.org/doi/full/10.1056/NEJMvcm0803821. Updated July 22, 2010. Accessed 29 May 2019.
Koo TK, Li MY. A guideline of selecting and reporting Intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15(2):155–63.
Schmale GA. More evidence of educational inadequacies in musculoskeletal medicine. Clin Orthop Relat Res. 2005;437:251–9.
Abou-Raya A, Abou-Raya S. The inadequacies of musculoskeletal education. Clin Rheumatol. 2010;29(10):1121–6.
Saleh K, Messner R, Axtell S, Harris I, Mahowald ML. Development and evaluation of an integrated musculoskeletal disease course for medical students. J Bone Joint Surg. 2004;86(8):1653–8.
DiGiovanni BF, Sundem LT, Southgate RD, Lambert DR. Musculoskeletal medicine is underrepresented in the american medical school clinical curriculum. Clin Orthop Relat Res. 2016;474(4):901–7.
Katz SJ, Oswald AE. How confident are internal medicine residents in rheumatology versus other common internal medicine clinical skills: an issue of training time or exposure? Clin Rheumatol. 2011;30(8):1081–93.
Kroop SF, Chung CP, Davidson MA, Horn L, Damp JB, Dewey C. Rheumatologic skills development: what are the needs of internal medicine residents? Clin Rheumatol. 2016;35(8):2109–15.
Acknowledgements
The authors would like to thank Eric Blanco, for providing assistance with objective structured clinical examinations.
Funding
None.
Author information
Authors and Affiliations
Contributions
AK was involved in all aspects of study design, data collection/analysis, and drafting of manuscript. NS was involved in study design, data analysis, and manuscript editing. AM was involved in study design. JB was involved in study design, data analysis, and manuscript editing. SK was involved in all aspects of study design, data collection, and analysis. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
The Rush University Medical Center Institutional Review Board granted approval for the study and informed consent was obtained from all participants. All methods were carried out in accordance with relevant guidelines and regulations.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
12909_2022_3425_MOESM1_ESM.pdf
Additional file 1.
12909_2022_3425_MOESM2_ESM.docx
Additional file 2.
12909_2022_3425_MOESM3_ESM.docx
Additional file 3.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Kwiatkowski, A., Shakoor, N., Manadan, A. et al. Incorporating interactive workshops into bedside teaching: completion of a multi-modal rheumatology rotation significantly increases internal medicine residents’ competency and comfort with comprehensive knee examinations. BMC Med Educ 22, 355 (2022). https://doi.org/10.1186/s12909-022-03425-4
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12909-022-03425-4
Keywords
- Workshop
- Physical examination
- Bedside teaching
- Resident
- Knee examination
- Musculoskeletal