Skip to main content

Successful implementation of a longitudinal skill-based teaching curriculum for residents

Abstract

Background

Despite significant teaching responsibilities and national accreditation standards, most residents do not receive adequate instruction in teaching methods. Published reports of residents-as-teachers programs vary from brief one-time exposures to curricula delivered over several months. A majority of interventions described are one or two-day workshops with no clear follow-up or reinforcement of skills. A three-year longitudinal teaching skills curriculum was implemented with these goals: 1) deliver an experiential skill-based teaching curriculum allowing all residents to acquire, practice and implement specific skills; 2) provide spaced skills instruction promoting deliberate practice/reflection; and 3) help residents gain confidence in their teaching skills.

Methods

One hundred percent of internal medicine residents (82/82) participated in the curriculum. Every 10 weeks residents attended a topic-specific experiential skills-based workshop. Each workshop followed the same pedagogy starting with debriefing/reflection on residents’ deliberate practice of the previously taught skill and introduction of a new skill followed by skill practice with feedback. Every year, participants completed: 1) assessment of overall confidence in each skill and 2) retrospective pre-post self-assessment. A post-curriculum survey was completed at the end of 3 years.

Results

Residents reported improved confidence and self-assessed competence in their teaching skills after the first year of the curriculum which was sustained through the three-year curriculum. The curriculum was well received and valued by residents.

Conclusions

A formal longitudinal, experiential skills-based teaching skills curriculum is feasible and can be delivered to all residents. For meaningful skill acquisition to occur, recurrent continuous skill-based practice with feedback and reflection is important.

Peer Review reports

Background

Residents spend significant time on teaching activities regardless of their specialty or future career plans [1, 2], often having primary responsibility for teaching medical students on inpatient wards. The Accreditation Council for Graduate Medical Education (ACGME) and the Liaison Committee on Medical Education (LCME) require residents receive training to develop teaching skills, but do not specify content or implementation of skill development [3, 4]. Despite significant teaching responsibilities and national accreditation standards, most residents do not receive adequate skill-based instruction in teaching methods [2, 5].

Some studies indicate that resident teaching programs can be effective in improving self-reported behavior and confidence to teach [6,7,8]. Published reports of residents-as-teachers (RAT) programs vary from brief one-time exposures to curricula delivered over several months [9, 10]. A majority of interventions described are one or two-day teaching skills workshops with no clear follow-up or reinforcement of these skills [9, 10]. However, short interventions often do not lead to lasting improvements in teaching ability, and decrements in teaching skills have been reported without periodic reinforcement [7, 11].

There is a paucity of literature describing longitudinal skill-based teaching curricula with recurring re-enforcement that spans the entirety of residency training and includes all residents in a program rather than just selected learners interested in teaching. To address this need we implemented a three-year longitudinal teaching skills curriculum with these goals: 1) deliver an experiential skill-based teaching curriculum allowing all residents to acquire, practice and implement specific skills for effective teaching; 2) provide recurring spaced teaching skills instruction promoting deliberate practice and reflection; and 3) help residents gain confidence in their teaching skills. Here we describe the design, implementation, evaluation and effectiveness of this curriculum.

Methods

Design and implementation

Prior to implementing this curriculum, the Department of Internal Medicine (IM) offered a “Teaching Resident Rotation” to third-year residents in which teaching experiences were concentrated into 1 month and only accommodated one-third of the cohort. In July 2015 the residency program adopted a 4 + 1 (X + Y) schedule which allowed implementation of a longitudinal 3-year teaching skills curriculum for all residents (Fig. 1) [12].

Fig. 1
figure 1

Sample “Y” week schedule

The curriculum was designed and implemented using a six-step approach to curriculum development [13]. In the planning phase the Resident Teaching Skills Committee comprised of educators and residents from the Department of IM as well as medical education experts from the Office of Consultation and Research in Medical Education (OCRME) conducted a review of RAT literature [7, 9, 10, 14]. The committee created a list of teaching topics relevant to residents’ teaching responsibilities and opportunities. Each member independently ranked topics in order of importance (Supplemental Table 1). The most highly ranked topics were discussed, and fifteen teaching skills were chosen to be delivered over 3 years. Teaching skills sessions with associated learning objectives are listed in Table 1. Every 10 weeks residents participated in a program required topic-specific experiential skills-based workshop (60 min) which utilized various educational strategies including video-taped scenarios, small-group discussions and role-play. These strategies helped us to incorporate deliberate practice and reflection in the workshops. Facilitators of the teaching skills sessions were experts in the content area specific to the session. If additional facilitators were required for skill practice, they were trained by the session experts.

Table 1 Teaching skills sessions with associated learning objectives and activities

These instructional strategies helped us to incorporate skill practice, deliberate practice and reflection. Each workshop followed the same pedagogy (Fig. 2) starting with debriefing/ reflection on residents’ deliberate practice of the previously taught skill and introduction of a new skill followed by practice with feedback from clinician educators and peers. To promote deliberate practice, before leaving the workshop every resident committed to a personal action plan aimed at furthering skill development related to that session topic. Pocket cards summarizing key take-home points were distributed at the end of each session (Supplemental Table 2A-H). Residents were expected to attempt to implement their personal action plan and these experiences were debriefed allowing for individual/group reflection to deepen learning and efficacy in using these skills. Pocket cards with workshop learning objectives were distributed electronically to all departmental faculty allowing them to reinforce and provide workplace-based feedback on the teaching skill residents were practicing. (Supplemental Table 3).

Fig. 2
figure 2

Pedagogy and topics utilized for teaching skills sessions

Study participants

All IM and Medicine-Psychiatry residents (82/82; 100%) participated in the curriculum.

Overall data was collected for 3 years; PGY1, PGY2 and PGY3 cohort data was collected for 3, 2 and 1 year, respectively. Participants completed a curricular satisfaction at the end of 3 years (Supplemental Table 7).

Data collection and measurement instruments

Several measures were used to assess characteristics of participants and perceived impact of the curriculum on learners’ confidence and skills. Information on baseline experience and teaching interest (Supplemental Table 4) was collected from all residents at the beginning of Year One. At the end of each year (for 3 years), participants completed: 1) assessment of overall confidence in using each teaching skill (Supplemental Table 5); and 2) retrospective pre-post self-assessment comparing their perceived competence with each teaching skill at the end of each year. (Supplemental Table 6). Response to the Association of American Medical Colleges (AAMC) Graduation Questionnaire (GQ) survey asking medical students to evaluate IM resident teaching effectiveness during their clerkships was reviewed prior to and after implementation of the teaching skills curriculum to further assess impact of the curriculum.

Data analysis

Confidence and self-assessed competence in performing each teaching skill was assessed using a 5-point scale (“4” or “5” considered confident and self-assessed competence). Wilcoxon signed-rank test was used to test change in response at each post-assessment compared to baseline and compared to prior year post-assessment. Jonckheere-Terpstra test for ordered differences was used to assess the differences in confidence scores among program years. Statistical analyses were performed using SAS version 9.4.

This project was deemed non-human-subjects research by the Institutional Review Board of the University of Iowa.

Results

Baseline data

The baseline survey was completed by 92% (75/82) of participants. Eighty-nine percent (67/75) of residents indicated interest in teaching, 77% (58/75) anticipated teaching will be part of their career and 25% (19/75) reported previous participation in a formal teaching course.

Confidence data

Confidence scores after 1 year of curriculum indicated majority of residents felt confident in their teaching skills (Supplemental Table 8A). Confidence scores (creating a positive learning environment, showing respect for learners and using wait time when questioning learners) showed significant improvement after 2 years of the curriculum (Supplemental Table 8B). There were significant differences noted in the confidence skills between PGY1s and PGY 2/3 s in four categories (dealing with challenging learners, facilitating a small group, providing feedback consistently and identifying important skills for teachers). The only significant confidence measure difference between PGY2/3 s after 2 years in the curriculum was facilitating a small group session. No degradation was seen in third-year residents’ self-reported confidence in teaching skills.

Pre-Post self-assessment data

Data reported by PGY1s after participating in the curriculum for 1 year showed significant improvement in all self-assessed skills (Table 2). PGY2s reported significant improvement in all but three categories (engaging in discussion about medical issues, feeling comfortable stating “I am not sure” and showing respect for learners). PGY3s reported significant improvement in all categories except two (feeling comfortable stating “I am not sure” and showing respect for learners). Self-assessment of teaching skills after participating in the curriculum for 2 years continued to show significant improvement in all but one of the teaching skills in the PGY 2/3 s (showing respect for learners) (Table 3).

Table 2 Self-assessment: change score (pre/post) after first year of participation in curriculum by program year
Table 3 Self-assessment: change score (pre/post) after second year participation in curriculum by program year

AAMC graduation questionnaire data

Following the implementation of the curriculum IM residents’ ratings by medical students on the question “Residents provide effective teaching during the clerkship” significantly exceeded all medical schools (97.6% Carver College of Medicine students agreed/strongly agreed vs 92.9% for all medical schools) as compared to prior to implementation ratings (93.5% Carver College of Medicine students agreed/ strongly agreed vs 93.3% for all medical schools (Supplemental Table 9).

Curricular evaluation data

Curriculum evaluation was completed by 67% (55/82) participants. Residents rated the curriculum highly and 82% (45/55) thought it provided them with longitudinal comprehensive teaching skills and 75% (41/55) reported it provided a comprehensive program for their development as a teacher. Only 49% (27/55) reported getting feedback from faculty on teaching skills being taught during the curriculum (Table 4).

Table 4 Teaching skills curriculum evaluation

Discussion

Based on accreditation standards, residents must be adequately prepared to perform their teaching responsibilities [3, 4]. Irrespective of the external standards, residency programs have a vested interest in developing residents into effective teachers. In a national survey of residency program directors, 55% reported their programs offered residents formal teaching skills instruction [5]. While most of our residents expressed interest in teaching, the majority lacked previous experience in a formal teaching curriculum.

We successfully implemented a longitudinal three-year skill-based curriculum which incorporated skill practice, deliberate practice and reflection. Continuous skills-based practice and feedback is vital for acquisition and maintenance of any skill [15]. Having a dedicated block of time enabled this longitudinal teaching skills curriculum to be delivered to all IM residents on a scheduled, recurring basis. This allowed residents to engage in formal teaching skills practice and reflection over regular predictable intervals which likely enhanced their skill acquisition and confidence. Wamsley et al. and Edwards et al. have argued for the importance of reinforcing teaching principles to prevent degradation of teaching skills over time [7, 11]. This longitudinal structure for curricular implementation is also supported by a study which demonstrated that ‘spaced education’ (educational encounters spread out and repeated over time) improved learner retention of skills/curricular material [16]. While it is not possible to know whether interest and satisfaction would remain high without the teaching skill curriculum, it is likely that the curriculum may contribute to sustaining enthusiasm for teaching by providing on-going mentored support, practice and discussion. Skill improvement in all cohorts suggests that this longitudinal curriculum helped minimize skill degradation.

Residents reported improved confidence and self-assessed competence in their teaching skills after the first year of the curriculum and this was sustained through the three-years. The curriculum was well received and valued by our residents. Comparison of pre and post intervention responses to the AAMC GQ for effective clerkship teaching by IM residents also showed improvement in the residents’ ratings as effective teachers.

There are several possible limitations to our findings. It was conducted at one program in a single university setting which limits its generalizability. Teaching skill confidence and competence were assessed by self-report. However, the results were strengthened by the fact they compared the same individual’s progression in the curriculum over 3 years. The confidence and self-assessment surveys are self-administered instruments, making them subject to social desirability biases. The retrospective pre-post format was chosen for the self-assessment of skill competence to minimize response shift bias. This bias can underestimate program effectiveness in traditional pre-post surveys because participants may overestimate their knowledge prior to training [17, 18]. This study involved different cohorts over a three-year period who may have different characteristics (previous teaching skills training as well as teaching experiences), though the results presented followed the same individuals’ progression through the curriculum. In addition, it was an educational intervention study where the cohort with more time on task would generally be expected to have better outcomes. Therefore, a more accurate picture of teaching skill ability would require an objective measurement of teaching skills as well as work-place based assessment. Using Objective Structured Teaching Exercise (OSTE) performance data for the skills taught in the curriculum would be an objective way to assess the utility of our intervention.

Some valuable lessons were learned during the implementation of this curriculum. First-year residents are now provided a separate session to orient them to the curriculum. To ensure that all residents receive a similar experience, a cohort of motivated faculty are required to deliver the same content for five consecutive weeks. For meaningful skill acquisition continuous skill-based practice and feedback is important. Only half of the residents who responded to the survey reported getting feedback from faculty regarding their teaching skills in the workplace. This suggests more deliberate faculty development is needed rather than simply providing them with pocket cards and learning objectives electronically as done in our study. To more objectively study resident teaching skill acquisition and retention, we are in the process of designing and implementing annual OSTEs and incorporating workplace-based direct observation with feedback. Other tools which have been studied to successfully incorporate faculty feedback based on workplace-based observation include mini- CEX, clinical encounter cards, multi-source feedback and direct observation of teaching skills [19, 20].

Conclusions

A formal longitudinal, experiential skills-based teaching skills curriculum is feasible and can be delivered to all residents. While IM residents expressed great interest in teaching, most had not participated in a formal teaching skills curriculum. Self-reported assessment data indicated improvement in resident confidence and teaching skills. Implementation of the curriculum is time-intensive and requires dedicated faculty. For meaningful skill acquisition to occur, recurrent continuous skill-based practice with feedback and reflection is important.

Availability of data and materials

The datasets generated during and/or analyzed are available from the corresponding authors on reasonable request.

Abbreviations

ACGME:

Accreditation Council for Graduate Medical Education

LCME:

Liaison Committee on Medical Education

RAT:

Residents-as-Teacher

IM:

Internal Medicine

OCRME:

Office of Consultation and Research in Medical Education

PGY1:

Postgraduate Year One

PGY2:

Postgraduate Year Two

PGY3:

Postgraduate Year Three

AAMC:

Association of American Medical Colleges

GQ:

Graduation Questionnaire

OSTE:

Objective Structured Teaching Exercise

References

  1. Post RE, Quattlebaum RG, Benich JJ 3rd. Residents-as-teachers curricula: a critical review. Acad Med. 2009;84(3):374–80. https://doi.org/10.1097/ACM.0b013e3181971ffe.

    Article  Google Scholar 

  2. Busari JO, Prince KJ, Scherpbier AJ, Van Der Vleuten CP, Essed GG. How residents perceive their teaching role in the clinical setting: a qualitative study. Med Teach. 2002;24(1):57–61. https://doi.org/10.1080/00034980120103496.

    Article  Google Scholar 

  3. Liaison Committee on Medical School. Functions and Structure of a Medical School: Standards for Accreditation of Medical Education Programs Leading to the MD Degree. https://lcme.org/publications/#Standards. Accessed 1 Mar 2021.

  4. Accreditation Council for Graduate Medical Education. ACGME common program requirements for Graduate Medical Education. https://www.acgme.org/What-We-Do/Accreditation/Common-Program-Requirements. Accessed 1 Mar 2021.

  5. Morrison EH, Friedland JA, Boker J, Rucker L, Hollingshead J, Murata P. Residents-as-teachers training in U.S. residency programs and offices of graduate medical education. Acad Med. 2001;76(10 Suppl):S1–4. https://doi.org/10.1097/00001888-200110001-00002.

    Article  Google Scholar 

  6. Spickard A 3rd, Corbett EC Jr, Schorling JB. Improving residents’ teaching skills and attitudes toward teaching. J Gen Intern Med. 1996;11(8):475–80. https://doi.org/10.1007/BF02599042.

    Article  Google Scholar 

  7. Wamsley MA, Julian KA, Wipf JE. A literature review of “resident-as-teacher” curricula: do teaching courses make a difference? J Gen Intern Med. 2004;19(5 Pt 2):574–81. https://doi.org/10.1111/j.1525-1497.2004.30116.x.

    Article  Google Scholar 

  8. Greenberg LW, Goldberg RM, Jewett LS. Teaching in the clinical setting: factors influencing residents’ perceptions, confidence and behaviour. Med Educ. 1984;18(5):360–5. https://doi.org/10.1111/j.1365-2923.1984.tb01283.x.

    Article  Google Scholar 

  9. Hill AG, Yu TC, Barrow M, Hattie J. A systematic review of resident-as-teacher programmes. Med Educ. 2009;43(12):1129–40. https://doi.org/10.1111/j.1365-2923.2009.03523.x.

    Article  Google Scholar 

  10. Bree KK, Whicker SA, Fromme HB, Paik S, Greenberg L. Residents-as-teachers publications: what can programs learn from the literature when starting a new or refining an established curriculum? J Grad Med Educ. 2014;6(2):237–48. https://doi.org/10.4300/JGME-D-13-00308.1.

    Article  Google Scholar 

  11. Edwards JC, Kissling GE, Brannan JR, Plauche WC, Marier RL. Study of teaching residents how to teach. J Med Educ. 1988;63(8):603–10. https://doi.org/10.1097/00001888-198808000-00003.

    Article  Google Scholar 

  12. Shalaby M, Yaich S, Donnelly J, Chippendale R, DeOliveira MC, Noronha C. X + Y scheduling models for internal medicine residency programs-a look Back and a look forward. J Grad Med Educ. 2014;6(4):639–42. https://doi.org/10.4300/JGME-D-14-00034.1.

    Article  Google Scholar 

  13. Thomas PA, Kern DE, Hughes MT, Chen BY. Curriculum development for medical education: a six-step approach. 3rd ed. Baltimore: The Johns Hopkins University Press; 2016.

    Google Scholar 

  14. McKeon BA, Ricciotti HA, Sandora TJ, Ramani S, Pels R, Miloslavsky EM, et al. A consensus guideline to support resident-as-teacher programs and enhance the culture of teaching and learning. J Grad Med Educ. 2019;11(3):313–8. https://doi.org/10.4300/JGME-D-18-00612.1.

    Article  Google Scholar 

  15. Ericsson KA. Deliberate practice and the acquisition and maintenance of expert performance in medicine and related domains. Acad Med. 2004;79(10 Suppl):S70–81. https://doi.org/10.1097/00001888-200410001-00022.

    Article  Google Scholar 

  16. Kerfoot BP, DeWolf WC, Masser BA, Church PA, Federman DD. Spaced education improves the retention of clinical knowledge by medical students: a randomised controlled trial. Med Educ. 2007;41(1):23–31. https://doi.org/10.1111/j.1365-2929.2006.02644.x.

    Article  Google Scholar 

  17. Drennan J, Hyde A. Controlling response shift bias: the use of the retrospective pre- test design in the evaluation of a master’s programme. Assess Eval High Educ. 2008;33(6):699–709. https://doi.org/10.1080/02602930701773026.

    Article  Google Scholar 

  18. Levinson WGG, Skeff K. Retrospective versus actual pre-course self-assessments. Eval Health Prof. 1990;13(4):445–52.

    Article  Google Scholar 

  19. Norcini J, Burch V. Workplace-based assessment as an educational tool: AMEE guide no. 31. Med Teach. 2007;29(9):855–71. https://doi.org/10.1080/01421590701775453.

    Article  Google Scholar 

  20. Katz NT, McCarty-Gillespie L, Magrane DM. Direct observation as a tool for needs assessment of resident teaching skills in the ambulatory setting. Am J Obstet Gynecol. 2003;189(3):684–7. https://doi.org/10.1067/S0002-9378(03)00883-4.

    Article  Google Scholar 

Download references

Acknowledgements

The authors would like to thank Teresa Ruggle, Bridgette Zimmerman and Kristin Greiner for their contributions to this paper.

Funding

The three-year longitudinal skill-based teaching curriculum for all residents was made possible in part by a grant from the University of Iowa Hospitals and Clinics Graduate Medical Education Innovation Funding.

Author information

Authors and Affiliations

Authors

Contributions

All authors conceived the study, and participated in its design, and coordination. JR, KJ, LA and MS participated in the analysis. All authors helped to draft the manuscript and read and approved the final manuscript.

Corresponding author

Correspondence to Jane Rowat.

Ethics declarations

Ethics approval and consent to participate

This project was deemed non-human-subjects research by the Institutional Review Board of the University of Iowa.

Consent for publication

Not applicable.

Competing interests

Manish Suneja serves in the role of associate editor for BMC Med Ed journal; other authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1: Supplemental Table 1.

Teaching skills topic inventory.

Additional file 2: Supplemental Table 2.

Workshop pocket cards.

Additional file 3: Supplemental Table 3.

Email distribution of teachings skills information to faculty.

Additional file 4: Supplemental Table 4.

Resident baseline experience and teaching interest.

Additional file 5: Supplemental Table 5.

Teaching skills confidence survey.

Additional file 6: Supplemental Table 6.

Teaching skills self-assessment.

Additional file 7: Supplemental Table 7.

Teaching skills curriculum evaluation.

Additional file 8: Supplemental Table 8A.

Confidence score after first year of participation in curriculum by program year. Supplemental Table 8B. Confidence score after second year of participation in curriculum by program year.

Additional file 9: Supplemental Table 9.

AAMC graduation questionnaire: “Residents provide effective teaching during clerkship.”

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Rowat, J., Johnson, K., Antes, L. et al. Successful implementation of a longitudinal skill-based teaching curriculum for residents. BMC Med Educ 21, 346 (2021). https://doi.org/10.1186/s12909-021-02765-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12909-021-02765-x

Keywords