Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Entrustability levels of general internal medicine residents

BMC Medical Education volume 21, Article number: 185 (2021) Cite this article

Abstract

Background

Entrustable professional activities (EPAs) are those activities that a health professional can perform without direct supervision in a defined environment. Bridging the gap between competencies and learning objectives, EPAs have made assessing the performances of health professional more realistic. The main objective of the present study was developing and customizing EPAs for Iranian Internal Medicine Residency Programs.

Results

After reviewing the publications, residency curricula and logbooks, and collecting experts’ ideas, the initial list of EPAs was developed. Then, in a focus group, the list was refined, the entrustability level of each residency year was determined, and finally, the EPA-competency cross-tab was established, and in the next step, through a one- round Delphi, the results were validated. Twenty-eight EPAs were developed. Some of them were definitely suitable for the higher levels of residency, such that they had to be accomplished under direct supervision until the end of the program. On the other hand, some of EPAs were those that residents, even from the first year, are expected to perform independently or under indirect supervision. Most of the EPAs cover a wide range of competencies.

Conclusion

Determining the entrustability level of each residency year in each EPA as well as the competency- EPA matrix has crucial effect on the quality of the graduates. It seems that our findings are applicable in developing countries like Iran.

Peer Review reports

Introduction

Transition to the paradigm of competency-based education, from process- based or time-based one, requires attainment of a shared language and transforming the competencies to such constructs that are not too much subjective [1,2,3]. It has been unclear what is expected from the learner to perform in the practical context [4]. As a result, the new paradigm has imposed a need to some means and methods that can evidently evaluate the quality of performances in the work places. Such evidences must be compared to the learners’ activities in the clinical settings [5,6,7]. Moreover, currently, most of the high stake decisions like promoting to a higher level of study and entering the practice are mainly made by means of knowledge based summative assessments, particularly in graduate programs. This is more or less because of the complications regarding the high objective tests [8]. Some of the problems with such examinations like Objective Structured Clinical Exam (OSCE) are the need for advanced plans for time and cost allocation [9]. Therefore, formative work based assessments like mini clinical evaluation examination (mini-CEX) are recently more acknowledged [10, 11]. However, the psychometric investigations of these examinations have revealed different results and conclusions; some with paradoxical results even with questioning the reliability and feasibility of them [12, 13]. Therefore, it is essential to apply instruments capable to measure and evaluate the subjective and complicated constructs of competencies, along with helping medical schools become more socially accountable [14]. Such examinations must be as much authenticate as possible [15].

After suggesting EPAs by Ten Cate [4], these activities were described and their application was increasingly considered day after day; firstly in some professional medical specialties,and then, from 2013 to 2014 for general physicians in developed countries [16,17,18,19], and even other medical courses such as pharmacology [20]. It has increasingly become spread in medical education literature. EPAs are essential activities of any discipline (profession, specialty or sub specialty program), which the professionals must perform independently without direct supervision in a defined environment after acquiring appropriate competencies [3]. They are the units of the observable clinical works [21] and play a guiding role for clinical teachers for training and assessing the learners so as to make decision about the level of their entrustability and capability to accomplish the activities without close supervision. Ten Cate has stratified entrutability into five levels [6]. In the first level, the health professional learner is mainly an observer and is not allowed to get involved in the activity. The second level corresponds to the one in which (s) he may undertake the activity under close and active supervision by the clinician. In the third level, the learner performs the activity with indirect supervision and the clinician involves if needed. The learner performs the task independently without any supervision in the fourth entrustability level. And finally, in the fifth level, (s) he is eligible to supervise lower level learners. The EPAs were originally developed for graduate medical education (GME) [22,23,24]. Beeson at al. defined EPAs for emergency medicine [25]. Psychiatry, family medicine, anesthesiology and surgery were also the other programs for which the EPAs have been developed [26,27,28,29]. However, the gap perceived in continuum from undergraduate medical education (UGME) to GME, resulted in developing some EPAs for entering residency in addition to EPAs for undergraduate programs [16, 18, 30,31,32,33]. Moreover the sociocultural differences of the societies and health delivery systems in different countries and educational institutions have resulted in diversity of EPAs both in their numbers and contents. The United States has defined 13 EPAs for undergraduate medical education [34], while in Canada, despite using the American EPAs as the prototype, the number was decreased to 12 [35]. Besides to the number and content, there is another profound difference in terms of centrality and decentralization of the ways of developing EPAs. The USA and Canada centrally defined EPAs [34, 35] while Utrecht University in the Netherlands, Charit University in Germany and the Medical School of California in San Francisco developed their own EPAs [36,37,38]. As the result, EPAs are concepts that should be defined and customized for any community in order for training and assessing their health professionals, based on the needs. One of the main causes of the diversity in developing and implementing the EPAs among different communities might be stemmed from the differences in educational systems of undergraduate and graduate medical education. Such differences exist in admission, training programs, and even the rules and regulations of entering the graduates to practice. The present study, therefore, is going to determine what essential activities internal medicine residents have in developing countries like Iran. And at which entrustability level, they must be at the end of each residency year. The findings could be applied in all countries with similar situations, especially in East Mediterranean Regional Office (EMRO) countries.

Setting

This study was conducted in Internal Medicine clinical department of Isfahan University of Medical Sciences, Isfahan, Iran, in order for developing the EPAs of internal medicine specialty residency program. After getting M.D. degree, the prospect residents take an annual national entrance exam. The participants are ranked regarding their scores and then-after they select their preferred specialty program. The admitted residents spend 4 years in a mostly hospital based graduate program. Besides formative evaluations throughout the program, they must take a progress test at the end of each year. Promoting to the higher level of study is based on their progress test scores. If they get the minimum pass level, required for the progression, they are eligible for moving to the next residency year, and if not, they are not allowed and must repeat that level. At the end of the fourth year, residents take another annual national final exam for getting the board certificate.

Internal medicine department of Isfahan University of Medical Sciences, school of medicine, with 61 clinical faculty members, trains 80 specialty residents each year within four residency years. The residents take various sub-specialty and general internal medicine rotations and the rotations take 1 month in length.

Methods

Different studies followed different methodologies for developing EPAs. Ten cate et al. have suggested three steps for defining the EPAs as identification, processing, and validating [39, 40]. We extend them to six steps as follows:

  1. 1)

    Determining the characteristics of EPAs: These features were used as the main criteria for defining, processing and validating the EPAs in the following steps. Moreover, these features were applied for reaching to a shared language among the study team as well as with clinicians in order for accepting or rejecting any suggested statement.

  2. 2)

    Reviewing the literature and publications through a scoping review: This step was accomplished for fining the update EPAs developed specifically for internal medicine. We searched PUBMED, SCOPUS, and google scholar for English publications about similar experiences from 2005 to 2020. We used these keywords: “entrustable professional activities” “internal medicine” “internship“ ”residency” “undergraduate”, and “fellowship”. We also reviewed the guidelines such as Accreditation Council for Graduate Medical Education (ACGME) publications [41,42,43]. PUBMED search was performed as following: (Filters applied: Abstract, Free full text, Full text, Journal Article, in the last 5 years, Humans, English, MEDLINE): (entrustable professional activities). For SCOPUS data base we used this formula: (TITLE-ABS-KEY (“entrustable professional activities”) AND TITLE-ABS-KEY (internal AND medicine) AND TITLE-ABS-KEY (internship) OR TITLE-ABS-KEY (residency) OR TITLE-ABS-KEY (undergraduate) OR TITLE-ABS-KEY (fellowship). In Google Scholar the following string were used: entrustable professional activities“ AND (residents OR interns) And “internal Medicine”. We included only those publications that were about the specialty program of general internal medicine but not sub-specialties or undergraduate level of internal medicine like clerkship. We excluded also those cases that reported a limited part of the curriculum like discharging the patient. The screening results were crossed over between the first and second authors.

  3. 3)

    Developing initial EPAs: With consideration of the national and institutional internal medicine residency curriculum [44, 45] as well as the residents’ electronic logbook (mobile log application), these documents were also reviewed for developing initial EPAs.

  4. 4)

    Extracting the results of preceding steps: We screened the activities, EPAs and other results, yielded from step 1st to 3rd, and developed the initial list of EPAs.

  5. 5)

    Refining and confirming the final EPAs: We formed a focus group discussion with a number of internal medicine clinicians. The criteria for participation were as: being internal medicine specialist with direct contribution in general internal medicine residency training, having at least 10 year experiences in teaching and assessment of internal medicine residents, being professor or associate professor, being interested in improvement of the residency program with conducting at least one educational research project or two papers in educational journals. The head of internal medicine department nominated 20 academic members who had our inclusion criteria. Since the optimal number of focus group participants is six to twelve [46], we invited 10 clinicians for the session. Informed verbal consent to participate was obtained from all participants at the beginning of the session. They participated in refining and screening the initial list as well as the entrustability level of each residency year. The focus group also determined the information sources, eligible for evaluating the residents against the EPAs. As the final section of the meeting, the focus group cross-tabbed the EPAs with competencies. For this purpose, we used the competencies, stablished by secretariat of council of general practitioners’ education for undergraduate medical education. They include clinical skills, communication skills, patient care (diagnosis, treatment and rehabilitation), health promotion and preventive medicine, and the G.Ps’ role (in that, personal development and continuous learning, professionalism, ethics and medical law, and finally, decision making, reasoning and problem solving skills are considered).

  6. 6)

    Reaching the final number and content of the EPAs: As the final step, we sent an open ended questionnaire attached to the EPAs to those nominated academics who did not attend the focus group session. We sent them via email and asked participants to evaluate and endorse the content validity of the focus group resulted EPAs based on the characteristics yielded in the first step. They were also asked to confirm the entrustability levels and EPA-competency matrix. Eventually, we reached the final number and content of the EPAs, based on the conclusions from all resources.

Findings

Within the first step, we determined the characteristics and features of EPAs including being parts of the profession, being directly related to the patient, and being observable, repetitive, assessable, doable by one resident, doable in a defined time frame, critical, and requiring especial knowledge, attitude and skills [3, 39].In the second step and through the scoping review, we found 308 items in the initial search; and eliminating duplicates resulted in 288 titles from which, after twice reviewing the titles and abstracts independently by the first and second authors, we selected 72 articles for a full text review. Those articles that were not in the internal medicine residency programs or those studying a limited area or a sub-specialty program were excluded. We also excluded the articles reporting the mere implementation of the EPAs. Figure 1 shows the quantity of the results in each step of search flow.

Fig. 1
figure 1

flow diagram of internal medicine EPAs scoping review

Full size image

Only 4 articles studied developing EPAs in general internal medicine residency program [47,48,49,50]. Table 1 illustrates them in brief besides their resulted EPAs. The first one is the report of the initiative of the Education Redesign Committee of the Alliance for Academic Internal Medicine that reached to 16 EPAs. The next one was the result of a study in University of California in San Francisco (UCSF), and school of medicine. They devised a 30 item EPA table. The third study developed the EPAs for all 7 bed-side procedures of internal medicine residents. And the last but not the least, developed 29 EPAs throughout the four stages of internal medicine residency program (3 for entering stage, 7 for foundations, 11 for the core of the program, and finally, 8 titles for arriving at the practical work place).

Table 1 EPAs resulted in studies on internal medicine residency programs adapted from O’dawed et al. [51]
Full size table

In the third step, the national and institutional curricula were reviewed. The national curriculum has listed the internal medicine residents’ activities in their diverse roles including preventive, diagnostic-therapeutic, care giving, educational, research, and administrative roles. Moreover, these programs have included the cognitive and procedural skills for residents. In the institutional curriculum of Isfahan University of Medical Sciences, the activities, assigned to each residency year, were also indicated. And lastly, the log book, installed on the residents’ cellphones and mainly planed for procedural activities, was utilized as another source of initial EPAs.

At the end of the fourth stage, 41 activities were resulted as the initial EPAs for all four residency years. These titles had a profound variation in terms of both the content and nature. So, they needed to be more elaborated.

In the fifth stage, 10 clinical academics accepted to attend the meeting. Twenty-eight activities were developed as the EPAs for all four residency years. Table 2 shows the results. These EPAs cover all aspects of the internal medicine residency program. They consist of all roles and responsibilities of an internal medicine specialist including the therapeutic, educational, consultation, procedural and administrative roles.

Table 2 Internal medicine residency EPAs and their entrustability levelsa for each year
Full size table

At the end of the focus group meeting, the EPAs were cross-tabbed with competencies. The related competencies to each EPA are shown in Table 3. Determining the appropriate evaluators was the final topic to be discussed in the meeting. The current and the last supervisors and chief residents all agreed up on as the key informants to evaluate residents against the EPAs using a common instrument.

Table 3 EPA-competency matrix
Full size table

In the last step of the study, for content validity of the results, after follow up, all of the ten academic internists responded to our email. Their recommendations and suggestions were discussed in the research team meeting, and eventually, EPAs, entrustability levels, and EPA-competency matrix were finalized.

Discussion

In this study we developed and finalized 28 EPAs for internal medicine residents. We also determined the level of entrustment at the end of each residency year and the interrelation between the final EPAs and those competencies expected from medical doctors in Iran. We already knew that different studies developed EPAs in different ways [6]. However, collecting, refining and validating are more common steps in most of the publications [51]. Gathering the initial statements, like the ones in our study, has been based on the literature review and group discussions, followed by revising and filtering steps. In this way, Hauer et al. only collected the opinions of the chief residents for processing the initial titles [38]. Caverzagie et al. mainly investigated the experts’ ideas [47], while in other studies, the ideas of learners in different levels have been scrutinized. For example, in Australia and New Zealand, the first and second year psychiatric residents’ EPAs were developed by using the fellowship residents’ suggestions [26]. However, in other programs like pediatrics, radiology, and anesthesia, clinical faculty members and the members of the central committees of the programs were invited [28, 52, 53].

The steps, followed in this study, were to some extent similar to the five steps, proposed by Kwan et al. including topic selection, content development, developing initial titles, getting feedback from stakeholders, and filtering and finalizing the activities [54]. Though, different ways such as comparing to other programs and conducting Delphi rounds have been suggested for collecting the initial titles [48].

Our final list of 28 EPAs is in accordance with the range of 20 to 40 titles, suggested by Ten Cate [6]. Although some authors reported much fewer EPAs like Chan et al. that studied only the patient handover [55], other studies developed more activities [56]. Moreover, there are some other kinds of study that classified the EPAs. For instance, Fessler et al. used three groups as pulmonary cares, pulmonary critical cares, and combination of these two groups of activities [57]. Graafland et al. developed 66 EPAs for sub divisions of anesthesiology as anesthesiology, emergency, gastroenterology, general surgery, gynecology, psychiatry and radiology [58].

Considering the EPAs listed in Table 2, it is inferred that these EPAs are not similar with regard to the time of entrustment. For example, patient admission and discharge is an activity which is done independently and without supervision only in the fourth year of residency; while, history taking and physical examination are the ones on which a second year resident must be capable to supervise the junior learners. Besides to these, the issue of what is professional activity, what is a task, what is a competency, and what is a competency category is difficult to parse -- even ten Cate seems to waiver in his descriptions of specificity in his various papers. Somewhere between sweeping general statements that cannot be directly measured (“the resident will have good patient care skills”) and specific, measurable tasks (“the resident will be able to perform a paracentesis”) lie the professional activities are unique to physicians in that specialty, are observable and measurable, and are part of the essential professional work of the specialty and not a general medical ability [7].

One of the advantages of our study is nominating the evaluators, which is noticeable with regard to the scarcity of the implementation and evaluation studies on EPAs. Nonetheless, peter et al. working on this phase of EPA study suggested using available information resources for assessing the residents [59].

Another advantage of the current study is determining the entrustability level of different residency years. It is while Mink et al. merely defined the meaning of each entrustability level in pediatrics fellowship program [60]. Hauer et al. only explored the perceptions of the faculty members and residents about the year a resident becomes entrustable on a given EPA [48].

There is another advantage for this study which is the comprehensiveness for all aspects of the residency program including the settings and competency domains; whereas, many studies reported development of EPAs in very limited areas of internal medicine graduate study like safe patient discharge [49, 61].

As shown in the competency-EPA matrix (Table 3), most of the EPAs are such broad that are related to many competencies. It means that each EPA is necessary for meeting more than one competency. It would absolutely be indicative of the inclusiveness of each EPA. It is in accordance with the Ten Cate’s suggestion [6]. He has mentioned elsewhere that the breadth of EPAs depends on the time they are used. For summative end of course decision making purposes named as “statements of awarded responsibility (STARS)” we need broader EPAs than formative uses throughout the course. For the latter we need to define nested EPAs [39]. As a result, and since we aimed to devise an end of year EPA list, some of them are more inclusive. It is suggested as next the step to implement the resulted EPAs in a pilot study so that they could be incorporated to a broader extent such as the national exams. Moreover, our further work would be defining the nested EPAs for broad ones.

Limitation

One of the limitations of this study could be using no residents’ points of view; nonetheless, we considered the residency logbook contents.

Another limitation of our study is being a single institutional initiative. Using the viewpoints of academics and residents of other medical universities is also suggested.

Availability of data and materials

The datasets used and/or analysed during the current study available from the corresponding author on reasonable request.

References

  1. Carraccio C, RJT E. Analyses/literature reviews: evaluating competence using a portfolio: a literature review and web-based application to the ACGME competencies. Teach Learn Med. 2004;16(4):381–7.

    Article  Google Scholar 

  2. Carraccio CL, Englander R. From Flexner to competencies: reflections on a decade and the journey ahead. Acad Med. 2013;88(8):1067–73.

    Article  Google Scholar 

  3. Englander R, Frank JR, Carraccio C, Sherbino J, Ross S, Snell L, et al. Toward a shared language for competency-based medical education. Med Teach. 2017;39(6):582–7.

    Article  Google Scholar 

  4. Ten Cate O. Entrustability of professional activities and competency-based training. Med Educ. 2005;39(12):1176–7.

    Article  Google Scholar 

  5. Lurie SJ, Mooney CJ, Lyness JM. Commentary: pitfalls in assessment of competency-based educational objectives. Acad Med. 2011;86(4):412–4.

    Article  Google Scholar 

  6. Ten Cate O. A primer on entrustable professional activities. Korean J Med Educ. 2018;30(1):1–10.

    Article  Google Scholar 

  7. Ten Cate O, Scheele FJAM. Competency-based postgraduate training: can we bridge the gap between theory and clinical practice? Acad Med. 2007;82(6):542–7.

    Article  Google Scholar 

  8. Hatala R, Cook DA, Brydges R, Hawkins R. Constructing a validity argument for the objective structured assessment of technical skills (OSATS): a systematic review of validity evidence. Adv Health Sci Educ. 2015;20(5):1149–75.

    Article  Google Scholar 

  9. Brown C, Ross S, Cleland J, Walsh K. Money makes the (medical assessment) world go round: the cost of components of a summative final year objective structured clinical examination (OSCE). Med Teach. 2015;37(7):653–9.

    Article  Google Scholar 

  10. Hodwitz K, Tays W, Reardon R. Redeveloping a workplace-based assessment program for physicians using Kane’s validity framework. Can Med Educ J. 2018;9(3):e14.

    Article  Google Scholar 

  11. Norcini J, Burch V. Workplace-based assessment as an educational tool: AMEE Guide No. 31. Med Teach. 2007;29(9–10):855–71.

    Article  Google Scholar 

  12. Alves de Lima A, Barrero C, Baratta S, Castillo Costa Y, Bortman G, Carabajales J, et al. Validity, reliability, feasibility and satisfaction of the mini-clinical evaluation exercise (mini-CEX) for cardiology residency training. Medical Teach. 2007;29(8):785–90.

    Article  Google Scholar 

  13. Hawkins RE, Margolis MJ, Durning SJ, Norcini JJ. Constructing a validity argument for the mini-clinical evaluation exercise: a review of the research. Acad Med. 2010;85(9):1453–61.

    Article  Google Scholar 

  14. Hoverman A, Hepner E, Isaacs B, Johnson MT. Using the Entrustable Professional Activity Framework to Guide Medical School Training Enhancement. Med Sci Educ. 2016;26(4):737–42.

    Article  Google Scholar 

  15. Harris P, Bhanji F, Topps M, Ross S, Lieberman S, Frank JR, et al. Evolving concepts of assessment in a competency-based world. Med Teach. 2017;39(6):603–8.

    Article  Google Scholar 

  16. Brown DR, Warren JB, Hyderi A, Drusin RE, Moeller J, Rosenfeld M, et al. Finding a path to entrustment in undergraduate medical education: a progress report from the AAMC core entrustable professional activities for entering residency entrustment concept group. Acad Med. 2017;92(6):774–9.

    Article  Google Scholar 

  17. Lomis K, Amiel JM, Ryan MS, Esposito K, Green M, Stagnaro-Green A, et al. Implementing an entrustable professional activities framework in undergraduate medical education: early lessons from the AAMC core entrustable professional activities for entering residency pilot. Acad Med. 2017;92(6):765–70.

    Article  Google Scholar 

  18. Chen HC, van den Broek WS, ten Cate O. The case for use of entrustable professional activities in undergraduate medical education. Acad Med. 2015;90(4):431–6.

    Article  Google Scholar 

  19. Englander R, Flynn T, Call S. Core Entrustable Professional Activities for Entering Residency: Faculty and Learners’ Guide, vol. 887. Washington, DC: Association of American Medical Colleges MedEdPORTAL iCollaborative; Resource ID; 2014. p. 2018.

    Google Scholar 

  20. Pittenger AL, Chapman SA, Frail CK, Moon JY, Undeberg MR, JH O. Entrustable professional activities for pharmacy practice. Am J Pharm Educ. 2016;80(4):57.

    Article  Google Scholar 

  21. Ten Cate O, Hoff RG. From case-based to entrustment-based discussions. Clin Teach. 2017;14(6):385–9.

    Article  Google Scholar 

  22. Mohaggegi MA, Vahid Shahi K, SHakeri S, Saburi M, Razavi M, Mohammadi M. Comparision some aspect of quality of MCQs Board Examination 2007-2009. Available from: cgme.behdasht.gov.ir/uploads/264_781_N4.

  23. Ten Cate O. Trust, competence, and the supervisor's role in postgraduate training. BMJ. 2006;333(7571):748–51.

    Article  Google Scholar 

  24. Ten Cate O. Entrustability of professional activities and competency-bases training. Med Educ. 2005;39:1176–7.

    Article  Google Scholar 

  25. Beeson MS, Warrington S, Bradford-Saffles A, Hart D. Entrustable professional activities: making sense of the emergency medicine milestones. J Emerg Med. 2014;47(4):441–52.

    Article  Google Scholar 

  26. Boyce P, Spratt C, Davies M, McEvoy P. Using entrustable professional activities to guide curriculum development in psychiatry training. BMC Med Educ. 2011;11:96.

    Article  Google Scholar 

  27. Schultz K, Griffiths J, Lacasse M. The application of entrustable professional activities to inform competency decisions in a family medicine residency program. Acad Med. 2015;90(7):888–97.

    Article  Google Scholar 

  28. Wisman-Zwarter N, van der Schaaf M, Ten Cate O, Jonker G, van Klei WA, Hoff RG. Transforming the learning outcomes of anaesthesiology training into entrustable professional activities: a Delphi study. Eur J Anaesthesiol. 2016;33(8):559–67.

    Article  Google Scholar 

  29. Wagner JP, Lewis CE, Tillou A, Agopian VG, Quach C, Donahue TR, et al. Use of Entrustable professional activities in the assessment of surgical resident competency. JAMA Surg. 2018;153(4):335–43.

    Article  Google Scholar 

  30. Eliasz KL, Ark TK, Nick MW, Ng GM, Zabar S, Kalet AL. Capturing entrustment: using an end-of-training simulated workplace to assess the entrustment of near-graduating medical students from multiple perspectives. Med Sci Educ. 2018;28(4):739–47.

    Article  Google Scholar 

  31. Dijksterhuis MG, Voorhuis M, Teunissen PW, Schuwirth LW, Ten Cate OT, Braat DD, et al. Assessment of competence and progressive independence in postgraduate clinical training. Med Educ. 2009;43(12):1156–65.

    Article  Google Scholar 

  32. Chen HC, McNamara M, Teherani A, Cate O, O’Sullivan P. Developing entrustable professional activities for entry into clerkship. Acad Med. 2016;91(2):247–55.

    Article  Google Scholar 

  33. Murray KE, Lane JL, Carraccio C, Glasgow T, Long M, West DC, et al. Crossing the gap: using competency-based assessment to determine whether learners are ready for the undergraduate-to-graduate transition. Acad Med. 2019;94(3):338–45.

    Article  Google Scholar 

  34. Englander R, Flynn T, Call S, Carraccio C, Cleary L, Fulton TB, et al. Toward defining the foundation of the MD degree: core entrustable professional activities for entering residency. Acad Med. 2016;91(10):1352–8.

    Article  Google Scholar 

  35. Touchie C, AJO B. Canada: Association of Faculties of Medicine of Canada. Entrustable professional activities for the transition from medical school to residency; 2016.

    Google Scholar 

  36. ten Cate O, Graafmans L, Posthumus I, Welink L, van Dijk M. The EPA-based Utrecht undergraduate clinical curriculum: Development and implementation. Med Teach. 2018;40(5):506–13.

    Article  Google Scholar 

  37. Holzhausen Y, Maaz A, Renz A, Bosch J, Peters H. Development of Entrustable professional activities for entry into residency at the Charite Berlin. GMS J Med Educ. 2019;36(1):Doc5.

    Google Scholar 

  38. Hauer KE, Soni K, Cornett P, Kohlwes J, Hollander H, Ranji SR, et al. Developing entrustable professional activities as the basis for assessment of competence in an internal medicine residency: a feasibility study. J Gen Intern Med. 2013;28(8):1110–4.

    Article  Google Scholar 

  39. ten Cate O, Chen HC, Hoff RG, Peters H, Bok H, van der Schaaf M. Curriculum development for the workplace using entrustable professional activities (EPAs): AMEE guide no. 99. Med Teach. 2015;37(11):983–1002.

    Article  Google Scholar 

  40. ten Cate O, Young JQ. The patient handover as an entrustable professional activity: adding meaning in teaching and practice BMJ Qual Saf. 2012;21(Suppl 1):i9-i12.

  41. Education ACfGM. The internal medicine milestone project. 2015.

    Google Scholar 

  42. Holmboe ES, Edgar L, SJC H. IL: Accreditation Council for Graduate Medical Education. The milestones guidebook; 2016.

    Google Scholar 

  43. Andolsek K, Padmore J, Hauer K, Holmboe EJC. IL: Accreditation Council for Graduate Medical Education: Clinical competency committees: a guidebook for programs; 2015.

  44. Monzavi SM, Dadpour B, Shahraki K, Nemati M. Internal medicine residency program in Iran: exclusive features and an international comparison. Future Med Educ J. 2017;7(3):24–8.

  45. Isfahan Internal Medicine curriculum (Persian). Available from: http://med.mui.ac.ir/?q=dakheli/dakheli.

  46. Massey O. A proposed model for the analysis and interpretation of focus groups in evaluation research. Eval Program Plann. 2011;34(1):21–8.

    Article  Google Scholar 

  47. Caverzagie KJ, Cooney TG, Hemmer PA, Berkowitz L. The development of entrustable professional activities for internal medicine residency training: a report from the education redesign committee of the Alliance for academic internal medicine. Acad Med. 2015;90(4):479–84.

    Article  Google Scholar 

  48. Hauer KE, Kohlwes J, Cornett P, Hollander H, Ten Cate O, Ranji SR, et al. Identifying entrustable professional activities in internal medicine training. J Grad Med Educ. 2013;5(1):54–9.

    Article  Google Scholar 

  49. Pugh D, Cavalcanti RB, Halman S, Ma IW, Mylopoulos M, Shanks D, et al. Using the entrustable professional activities framework in the assessment of procedural skills. J Grad Med Educ. 2017;9(2):209–14.

    Article  Google Scholar 

  50. Taylor DR, Park YS, Smith CA, Karpinski J, Coke W, Tekian A. Creating Entrustable professional activities to assess internal medicine residents in training: a mixed-methods approach. Ann Intern Med. 2018;168(10):724–9.

    Article  Google Scholar 

  51. O'Dowd E, Lydon S, O'Connor P, Madden C, Byrne D. A systematic review of 7 years of research on entrustable professional activities in graduate medical education, 2011-2018. Med Educ. 2019;53(3):234–49.

    Article  Google Scholar 

  52. Carraccio C, Englander R, Gilhooly J, Mink R, Hofkosh D, Barone MA, et al. Building a framework of entrustable professional activities, supported by competencies and milestones, to bridge the educational continuum. Acad Med. 2017;92(3):324–30.

    Article  Google Scholar 

  53. Deitte LA, Gordon LL, Zimmerman RD, Stern EJ, McLoud TC, Diaz-Marchan PJ, et al. Entrustable Professional Activities:: Ten Things Radiologists Do. Acad Radiol. 2016;23(3):374–81.

    Article  Google Scholar 

  54. Kwan J, Crampton R, Mogensen LL, Weaver R, van der Vleuten CP, Hu WC. Bridging the gap: a five stage approach for developing specialty-specific entrustable professional activities. BMC Med Educ. 2016;16(1):117.

    Article  Google Scholar 

  55. Chan B, Englander H, Kent K, Desai S, Obley A, Harmon D, et al. Transitioning toward competency: a resident-faculty collaborative approach to developing a transitions of care EPA in an internal medicine residency program. J Grad Med Educ. 2014;6(4):760–4.

    Article  Google Scholar 

  56. Chang A, Bowen JL, Buranosky RA, Frankel RM, Ghosh N, Rosenblum MJ, et al. Transforming primary care training—patient-centered medical home entrustable professional activities for internal medicine residents. J Gen Intern Med. 2013;28(6):801–9.

    Article  Google Scholar 

  57. Fessler HE, Addrizzo-Harris D, Beck JM, Buckley JD, Pastores SM, Piquette CA, et al. Entrustable professional activities and curricular milestones for fellowship training in pulmonary and critical care medicine: report of a multisociety working group. Ches. 2014;146(3):813–34.

    Article  Google Scholar 

  58. Graafland M, Ten Cate O, van Seventer J-P, Schraagen JMC, Schijven MP. Mapping the demand for serious games in postgraduate medical education using the entrustable professional activities framework. Games Health J. 2015;4(5):381–6.

    Article  Google Scholar 

  59. Peters H, Holzhausen Y, Boscardin C, ten Cate O, Chen HC. Twelve tips for the implementation of EPAs for assessment and entrustment decisions. Med Teach. 2017;39(8):802–7.

    Article  Google Scholar 

  60. Mink RB, Schwartz A, Herman BE, Turner DA, Curran ML, Myers A, et al. Validity of level of supervision scales for assessing pediatric fellows on the common pediatric subspecialty entrustable professional activities. Acad Med. 2018;93(2):283–91.

    Article  Google Scholar 

  61. Meade LB, Suddarth KH, Jones RR, Zaas AK, Albanese T, Yamazaki K, et al. Patients, nurses, and physicians working together to develop a discharge entrustable professional activity assessment tool. Acad Med. 2016;91(10):1388–91.

    Article  Google Scholar 

Download references

Acknowledgements

Authors wish to thank all faculty members and residents who helped in this research. Also authors appreciate educational administrators of Isfahan University of Medical Sciences for their valuable cooperation.

Funding

This study is performed as a part of PhD Dissertation and had no funding.

Author information

Authors and Affiliations

  1. Department of Medical Education, School of Medicine, Tehran University of Medical Sciences, Tehran, Iran

    Mostafa Dehghani Poudeh

  2. Department of E-learning in Medical Education, Virtual School, Center for Excellence in E-learning in Medical Education, Tehran University of Medical Sciences, Tehran, Iran

    Aeen Mohammadi & Rita Mojtahedzadeh

  3. Department of Medical Education, Isfahan University of Medical Sciences, Isfahan, Iran

    Nikoo Yamani

Authors
  1. Mostafa Dehghani Poudeh
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Aeen Mohammadi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Rita Mojtahedzadeh
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Nikoo Yamani
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

MDP Study Concept, Data Collection, analysis and interpretation, Paper writing and approval, AM Study Concept, Data Collection, analysis and interpretation, Lead Author on paper, Paper review and approval. RM study Concept, Data interpretation, approval final paper. NY Study Concept, Data Collection, Paper review and approval.

Corresponding author

Correspondence to Aeen Mohammadi.

Ethics declarations

Ethics approval and consent to participate

We, authors confirm that all methods were carried out in accordance with Declaration of Helsinki guidelines and regulations. This project is approved by the Ethics Committee of Tehran University of Medical Sciences (Ethics code no: IR.TUMS.MEDICINE.REC.1399.1047) Informed verbal consent to participate was obtained from all project contributors. Verbal Consent obtained from the participants is accepted by the Ethics Committee of Tehran University of Medical Sciences.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Dehghani Poudeh, M., Mohammadi, A., Mojtahedzadeh, R. et al. Entrustability levels of general internal medicine residents. BMC Med Educ 21, 185 (2021). https://doi.org/10.1186/s12909-021-02624-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12909-021-02624-9

Keywords

BMC Medical Education

ISSN: 1472-6920

Contact us