- Research
- Open access
- Published:
Inconsistently reporting post-licensure EPA specifications in different clinical professions hampers fidelity and practice translation: a scoping review
BMC Medical Education volume 23, Article number: 372 (2023)
Abstract
Background
Entrustable Professional Activities (EPAs) are defined units of professional practice entrusted to professionals once they have attained the specific competencies required to complete the end-to-end task. They provide a contemporary framework for capturing real-world clinical skillsets and integrating clinical education with practice. Our scoping review question was: how are post-licensure EPAs reported in peer reviewed literature, in different clinical professions?
Method
We followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews (PRISMA-ScR) checklist, Arksey and O’Malley and Joanna Briggs Institute (JBI) methodology. Searching ten electronic databases returned 1622 articles, with 173 articles included. Data extracted included demographics, EPA discipline, titles and further specifications.
Results
All articles were published between 2007–2021 across sixteen country contexts. The majority were from North America (n = 162, 73%) describing medical sub-specialty EPAs (n = 126, 94%). There were comparably few EPA frameworks reported in clinical professions other than medicine (n = 11, 6%). Many articles reported only EPA titles without further explanation and limited content validation. The majority did not include information about the EPA design process. Few EPAs and frameworks were reported according to all the recommended EPA attributes. There was unclear distinction between specialty-specific EPAs and those that could be useful across disciplines.
Discussion
Our review highlights the large volume of EPAs reported in post-licensure medicine, including the volume disparity compared to other clinical professions. Basing our enquiry upon existing guidelines for EPA attributes and features, our experience in conducting the review and our primary finding demonstrated heterogeneity of EPA reporting according to these specifications. To promote EPA fidelity, and quality appraisal, and to reduce interpretation subjectivity, we advocate: diligently reporting EPA attributes and features; including reference or citation to EPA design and content validity information; and considering distinguishing EPAs as specialty-specific or transdisciplinary.
Conclusion
A large volume of post-licensure EPAs were identified in medicine relative to other clinical professions. EPA specifications were absent or variously reported in the literature, risking ambiguous interpretation. The authors recommend that future EPAs are reported with reference to established and evolving construct recommendations, which is integral to concept fidelity and translation to practice and education.
Background
Clinical skills can be characterised as the practical and interpersonal skills required by health professionals to engage in and deliver a clinical healthcare service. Clinical skills may contain examination, practical procedures, communication and management skills with components of "how to", why, and the reasoning of what the outcomes might mean [1]. Individual clinical competencies refer to the performance of a specific learnable skill, often contextualized within a more broadly designated role or domain [2]. Benchmarking of individual clinical competencies is well described for pre-licensure entry-to-practice health professions including dentistry, medicine, paramedicine, pharmacy, physiotherapy, podiatry and psychology [3] and post-entry-to-residency medical specialties [4].
Entrustable Professional Activities (EPAs) are well-defined units of professional practice that can be entrusted to a professional once they have attained and can contextually link the competencies required to complete the end-to-end task [5]. They offer a framework for observing and demonstrating the translation of competencies into real-world clinical practice or work units [6, 7]. They are increasingly recognized as better representing contextualized performance of clinical skills in practice than assessing piecemeal clinical skills or granular competencies [8].
Several recent investigations and scoping reviews have described the use of EPAs in entry-to-practice health professional education [9,10,11,12,13]. These EPAs aim to capture and assess the clinical skills required for proficient, independent clinical practice upon initial licensure and entry-to-practice as a health professional, with key intentions to align clinical skill performance with expectations and learner assessment [9]. These EPAs represent entry-to-practice clinical skills, typically acquired in pre-licensure education.
Differentially, post-licensure clinical practice as a qualified clinician requires development and assessment of increasingly complex and specialist clinical skills. These skills are typically developed in post-licensure professional education. This includes managing unexpected challenges, higher order thinking, navigating uncertainty and making decisions in challenging situations at the “trusted” apex of Miller’s pyramid [14,15,16]. Post-licensure professional education and practice can be differentiated (from entry-to-practice level) by the advancing integration of a complex body of knowledge, including specialized knowledge and independent critical analysis, with complex information synthesis aligned to originality of circumstances and challenges [14].
A systematic review by O’Dowd and colleagues [17] and an updated scoping review by Liu and colleagues [18] synthesized work on the use of EPAs in postgraduate medicine. Our review sought to extend the context and focus on EPAs in different clinical professions, including any subsequent publications. By definition EPAs are discipline-specific and the viability of collaborative interprofessional EPAs is contentious [19], although the concept and value of transdisciplinary EPAs has been recently recognised [20]. Further, some authors have questioned the validity of EPAs, particularly where they are insufficiently designed or described according to the ten Cate et al. [21] criteria[22]. This review does not examine or challenge these perspectives, rather it explores the landscape of how existing EPAs are reported in the context of different clinical professions including and beyond medicine. This is relevant to inform discipline-specific education, interprofessional health education and opportunities to progress the field of post-licensure and transdisciplinary EPAs.
Method
Identifying the research question
We took a broad view to answer our research question: how are post-licensure EPAs reported in peer reviewed literature, in different clinical professions? Understanding the current perspective and landscape of EPAs representing post-licensure clinical practice is necessary to advance the future direction of post-licensure professional clinical education and practice frameworks. This scoping review extends on the current perspective of how EPAs are used in (i) pre-licensure healthcare and (ii) medicine only.
To address recognized conventions, nuance and diversity of common clinical and education language, we defined the following terms of reference central to our enquiry:
-
EPA: A well-defined and conceptualized work unit of professional practice which requires contextualized integration of multiple competencies to proficiently complete [5].
-
Clinical competency: A defined granular ability or specific learnable skill required for safe and proficient clinical practice matched to the context [5, 8, 15].
-
Post-licensure professional clinical practice: Representing the common-language term of reference for practice as a qualified clinician, after completion of the initial entry-to-practice qualification. (The timing of unrestricted medical licensure is not standardised nationally or internationally [23]. The CanMEDS framework groups seven roles of competent physicians and provides an internationally relevant model of practice for all clinical health professions [24]. Eligibility for medical licensure begins at the CanMEDS stage of “Entry to Residency” [25]. We therefore defined post-licensure professional practice as that which follows an entry-to practice medical degree, with residency at the starting point.)
-
Discipline-specific clinical skills: Technical, procedural and/or cognitive skills which are defined by the discipline-specific complex body of knowledge, including specialist knowledge.
-
Interpersonal clinical roles: These are reflective of CanMEDS intrinsic roles [25] and include thought patterns, behaviours and growth mindset that transcend disciplines to define a good clinician [20, 26].
A preliminary search of the Cochrane Library, JBI Evidence Synthesis, MEDLINE and Open Science Framework did not identify any current or underway systematic or scoping reviews relating to post-licensure EPAs. Our preliminary search indicated a current perspective of existing EPA recommendations with terminology nuances and piecemeal application, therefore scoping review methodology was appropriate to discover and appraise the overall body of available literature. Guided by Thomas and colleagues’ recommended approach [27] we synthesized and represented the literature numerically and thematically. We adopted the subjectivist epistemological perspective advocated by Thomas and colleagues [28].
We followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews (PRISMA-ScR) checklist [29], Arksey and O’Malley [30] and Joanna Briggs Institute (JBI) methodology [31] with additional refinements aligned with Levac and colleagues [32]. We prospectively registered the final protocol with Open Science Framework Registries on November 24, 2021 [33].
Identifying relevant articles
Detailed inclusion and exclusion criteria for our review are contained in Table 1. Included articles reported EPAs in the context of post-licensure clinical practice and involve direct human patient interaction. We included all article types. Articles relating to entry-to-practice, pre-licensure or not entailing direct patient interaction were excluded. Unlike previous reviews [17, 18], we did not narrow our inclusion to medicine or non-medicine disciplines.
Information sources and selection of evidence
Our research team and author panel were constructed to contribute scholarship and experience across interprofessional research, clinical education and clinical practice to generate varied relevant perspectives [34] to our enquiry, interpretation and recommendations. Our systematic search strategy was developed in consultation with a senior librarian (VB) (See Supplementary Table 1 – MEDLINE search strategy). Eight databases were searched from inception on September 16 2021 without restrictions to language or publication status: Ovid MEDLINE, CINAHL (EBSCOhost) Embase (OVID); SPORTDiscus; PsychInfo, (Education Research Complete (ERIC), Evidence Based Medicine Reviews (EBMR) (including Cochrane) and Joanna Briggs Institute’s Database of Systematic Reviews and Implementation Reports. Two gray literature databases MedNar and OpenGray were subsequently searched from inception to September 21 2021. Reference lists of included articles were hand-searched for additional peer review literature sources.
All articles were imported and managed in Covidence [35]. Two of five independent reviewers (SM, TE, NLS, MM, JL) reviewed articles at each of the two stages of study selection against the predefined criteria (see Table 1 – Inclusion and exclusion criteria). Firstly, titles/abstract were screened with all conflicts included in the next stage of full text review, where a more accurate assessment of concept and context was undertaken. Secondly, at the full text review stage we encountered great variety in how articles defined or described EPAs, presenting challenges in discerning the reported concept and/or context of the EPA. Any uncertainty or discrepancies between reviewers were resolved through discussion and consensus between the two conflicted reviewers.
Data charting process and data items
A data charting form was prospectively developed and piloted to capture study design, country, discipline context, EPAs attributes, any further specifications and alignment to professional competency standards (see Supplementary file – Data charting template). Data were charted in Covidence [35] exported to Microsoft Excel (2016) and cross checked. All reviewers iteratively discussed and updated the data charting form as further themes emerged.
Approach to results synthesis
Article demographics were summarized using descriptive statistics. To identify what post-licensure EPAs were reported and elucidate their nature, we extracted all EPAs in articles which were identified and referred to by the authors as “EPAs”. It was evident from the screening and data charting process that many articles referred to an EPA but reporting of any further specifications was absent or highly variable. We therefore engaged both thematic and narrative synthesis in an iterative approach to synthesize how EPAs were reported. We learned similar lessons to Thomas and colleagues [28] who reflect on the necessary subjectivist stance to define and organize the literature around clinical concepts with inherent multiple perspectives.
We took a stratified step-wise approach to synthesize how EPAs were reported according to the ten Cate 2005 attributes [5]. To feasibly manage the reported EPA volume, we limited our analysis to a selective sample of the first reported EPA in articles where more than one EPA was identified.
Based on charted data and reported themes, we mapped the first reported EPA in each article to the 8 specified concept attributes [5] which were published previous to all articles in our review.
EPA validity judgements were beyond the scope of this review, and heterogeneous EPA reporting rendered the otherwise relevant EPA quality assessment tools EQual [36] or QUEPA [37] tools unfeasible.
Undertaking a further thematic narrative synthesis, we explored whether translation of EPAs to practice could be feasible based on reported attributes and other details. This was based on the Tekian [22] perspective that reported EPAs may not be constructed according to the ten Cate attributes [5]. Since often only the EPA title was reported, we piloted and used Mulder’s [38] sentence-completing approach to understand whether EPAs could be interpretable from the title. E.g. Does it make sense when the EPA title is prefaced with "Can you perform…" and "Can you envisage the actual start and end of task?".
We also sought to synthesize a perspective on whether the first-reported EPA represented profession-specific skills or could have transdisciplinary relevance.
Results
After duplicates were removed, our search identified 1622 articles and 173 articles were included in our final review. Figure 1 represents the PRISMA flow detailing our process of evidence identification and selection. Supplementary Table 2 contains a table and reference list of all included articles (n = 173) in this review.
Adopting the approach of Eva [34], herein we take a pragmatic and meaningful approach to present our critical narrative synthesis outcomes in the context of advancing the current perspective of post-licensure EPAs. Our findings are supported by, but not reproducing what is already known and represented by our large number of included articles (n = 173). All included article characteristics and demographics and reference list are reported with detailed tabulation in Supplementary Table 2 – Included article characteristics and reference list.
Article characteristics
There is a growing trend to report post-licensure clinical practice expectations using the EPA concept. Publications were between 2007–2021 and proportionally in most recent years, including more than half in 2019–2021 (n = 82, 53%). Post-licensure EPAs are well reported in the North American context, and in the medical discipline. They are also reported by a range of countries and different disciplines world-wide. In total, 16 countries and 4 different multi-national collaborates had published EPAs, with the majority in North America (n = 126, 73%), specifically United States (n = 100, 58%) and Canada (n = 26, 15%). Article characteristics are summarised in Table 2. EPA reporting in medicine was overwhelmingly represented (n = 162, 94%), further differentiated into 40 medical sub-specialties. Non-medical professions represented were nursing (n = 6, 3%), pharmacy (n = 2, 1%), dentistry (n = 1, 1%), physiotherapy (n = 1, 1%) and respiratory therapy (n = 1, 1%). Article distribution according to clinical profession and medical specialty context is shown in Table 3.
Reporting of EPAs according to the ten Cate attributes
Table 4 shows reporting of EPA attributes and details according to the 8 specified ten Cate attributes [5].
All EPAs were reported to represent essential work confined to trained and qualified health professionals. Most reported content validation with specific alignment to discipline-recognized professional association standards (n = 130, 75%). Half of the articles further reported further specifications, for example discrete clinical skills required to perform the EPA or milestones to be acquired within EPAs (n = 86, 50%). The most infrequently reported attribute was any form of EPA construct evaluation or fit-for-purpose testing (n = 32, 18%).
Narrative synthesis of EPA reporting
Our critical narrative synthesis of reported attributes arrived at four themes relating to how EPAs are reported:
-
(i)
Many articles reported only EPA titles without further explanation.
Half the articles reported no further detail beyond EPA title(s) (n = 87, 50%). This precludes any validity judgement of EPA concept based on reporting of title alone, which was nevertheless beyond the scope of this review. We interpreted that half of reported EPAs had title wording where an end-to-end task could be envisaged (n = 84, 49%).
-
(ii)
Many articles did not include information about the EPA design process.
Just over half the articles (n = 92, 53%) reported on the EPA design process, specifically involving educators (n = 1, 1%), clinicians (n = 5, 3%) or a collaborative team of educators and clinicians (n = 85, 49%). Half (n = 86, 50%) of the articles reported further EPA specifications, such as discrete clinical skills required to perform the EPA. Our review was unable to differentiate between EPAs which were briefly reported versus insufficiently constructed according to the ten Cate attributes [5].
-
(iii)
Few EPAs and frameworks were reported according to all or most ten Cate[5] recommended EPA attributes
While all EPAs were reported according to several essential attributes through the inclusion criteria of this review, the proportion decreased when reported attributes were aggregated. Very few articles reported all the following details: alignment to professional competencies and standards, sub-competencies or milestones and evaluation or assessment (n = 10, 6%).
-
(iv)
Limited attribute reporting precludes distinction between profession-specific EPAs and EPAs which could have transdisciplinary relevance
Most articles reported EPAs requiring discipline-specific qualifications (n = 138, 80%). The majority of EPAs also represented work-units requiring performance of a combination of procedural and interpersonal skills (n = 146, 84%). Our review did not discover any articles reporting EPAs as transdisciplinary.
Discussion
This scoping review addressed our initial inquiry purpose to explore how post-licensure EPAs are reported in peer reviewed literature, in different clinical professions. We identified a large, heterogeneous and evolving body of literature which extends upon previous scoping reviews describing the increasing utilization of EPAs in pre-licensure (entry-to-practice) healthcare or medicine only [6, 9]. Further to themes identified in the results, here we discuss the current landscape of post-licensure EPAs and how they are reported. We embrace Eva’s [34] intention to advance the perspective by advocating application to practice of well-established knowledge, highlighting the disparity in EPA volume in medicine compared to other clinical disciplines and synthesizing recommendations to overcome the identified problem of heterogeneous reporting. Importantly, we based our enquiry upon existing EPA guidelines and specifications [5, 21, 39]. Indeed our experience in conducting the review and primary finding was the insufficiency and heterogeneity in how post-licensure EPAs are reported in relation to these.
EPA concept and reporting specifications
Our scoping review offers a pragmatic perspective including problems evident in the literature and reporting of current post-licensure EPAs. Our review encountered and navigated challenges, inconsistencies and non-specific EPA terminology, which is consistent with other contemporary perspectives around EPA concept conflation and viability [19, 40, 41]. Our review does not redress the nuance of language or conflicting terminology relating to existing EPAs, rather we emphasise that this was also evident in our review. This gave rise to methodological challenges and highlighted the need for nuanced interpretation of EPAs according to the intended purpose and context. Accordingly, we emphasize the limiting impacts of such necessary subjective EPA interpretation, which also has implications for transparent application for other EPA consumers in practice and education. Subsequent to our review, Hennus and colleagues [40] also acknowledge mixed logic and rationale for EPA development and design, including significant existence of “non-EPAs” which are not constructed in a way which makes them suitable for entrustment decisions.
It was beyond the scope of this review to make validity judgments of EPAs based on only reported attributes and details, moreover when often the title alone was reported. It is not feasible to judge EPA construct and validity from the reporting if EPAs are reported without the full specifications. Nevertheless, it is pertinent to differentiate whether any critical insufficiency lies within the EPA construct or in reporting, also recognizing that either will impact fidelity and translation to practice.
Our review demonstrates that many post-licensure EPAs are not reported according to contemporary construct recommendations, and demonstrates the problematic concerns and inconsistencies highlighted in existing literature.
How post-licensure EPAs are reported
This is the first review focused on contextualizing the volume and reporting of post-licensure EPAs including both medical and non-medicine clinical professions. In a rapidly evolving field, our review captured a large volume of EPAs reported in medicine, proportionally well established in North America but also utilized by a range of nations worldwide. Specifically, these work-units were to be entrusted during and/or at end-of-training medical specialization fellowships, aligned with and beyond the CanMEDS transition to discipline stage towards advanced expertise [25]. Other healthcare disciplines with published post-licensure EPAs were nursing, pharmacy, dentistry, physiotherapy and respiratory therapy.
Discovering the volume of post-licensure medical EPAs alongside the relative few available in other healthcare professions extends on the perspective offered by previous reviews by O’Dowd et al. [17] and Lui et al. [18] from several perspectives. Our broader search and inclusion lens, substantiated with our finding that often only the EPA title was reported (without further specifications or attributes), demonstrates that the breadth and depth of existing EPAs is more extensive than revealed in previous reviews. We found that most EPAs are not reported with sufficient further specifications to support fidelity or translation to practice based on reporting. We speculate that insufficiently reported EPAs may not have met the inclusion criteria for exploration or analysis in previous reviews.
Another important point of difference to these previous reviews was our aim to identify any potentially transdisciplinary EPAs. Although EPAs are conventionally discipline-specific rather than interprofessional [19], the concept and value of transdisciplinary EPAs has been recognized subsequent to this review [20]. The majority of articles in our review reported EPAs requiring a combination of procedural and interpersonal skills, some of which could plausibly be relevant to clinicians in different professions or across disciplines. However, without reporting of full EPA specifications, any judgement of transdisciplinary relevance based on reporting risks being misguided.
In the context of other evidence our findings support the widely reported perspective of rapidly expanding EPA reporting for the primary purpose of aligning clinical skill education and practice [6, 9, 39]. Bramley and colleagues’ scoping review of pre-licensure healthcare EPAs similarly described EPAs from the United States, Canada, Europe, Australia and Central America; in different disciplines of medicine, pharmacy, dietetics and physician assistants [9]. Shorey and colleagues’ scoping review reported their eighty included articles describing EPAs in healthcare education were also weighted unequally across geographic regions and lacked high quality evidence [6].
Articles in our review often reported EPAs by title only. Established recommendations for EPA construct include unambiguous titles [5, 16] and common taxonomy [42] to avoid linguistic confusion [43]. That said, contemporary guidelines acknowledge formulating a concise EPA-defining title can present linguistic challenges, compromise EPA breadth and is not essential if other specifications capture the EPA framework clearly [39, 44]. Notwithstanding whether EPAs were designed according to recommended EPA construct principles [5, 39], these further specifications were inconsistently reported.
Placing the importance of all EPA specifications and attributes in perspective, EPAs are intended to represent task-integrated performance of essential clinical skills defined in health professionals' competency standards matrices [5]. This purposeful alignment was reported in half the articles in our review. Some also reported a rigorous, collaborative design process involving both clinicians and educators while often the rigour of design process was unclear. We acknowledge the reporting context can curtail the level of detail presented (e.g. conference abstracts, article focus and word limits).
Despite incomplete reporting of EPA attributes, most EPAs were reported as aligned to relevant benchmarked clinical tasks endorsed by discipline-specific professional associations and/or content validated with alignment to professional competency matrices [21]. This indicates most EPAs are reported as representing the task-integration of validated skills required of post-licensure clinicians.
Implications for practice, policy and recommendations
Our review determined that most EPAs were reported as designed according to professional competency matrices, but without reporting any fit-for-purpose evaluation. Alongside ambiguous task definitions, this risks fidelity in the formation of ad-hoc expectations, and inequitable learning experience and assessment of essential skills. Further, the extent of EPA implementation and evaluation is integral to determining fit-for-purpose [44]. Since so few articles reported EPA evaluation of any kind, how post-licensure EPAs meet their intended purpose of aligning clinical skill education and practice could not be determined from the reporting.
Resolving inconsistency of EPA reporting would facilitate transparent real-world implementation for consumers in clinical education and clinical practice. Advancing popularity and EPA concept dilution led ten Cate & Taylor [39] to further clarify EPA features and structure; and ten Cate & Chen [21] to recommend specific approaches to content-validate EPAs including matrix-map-to-competency frameworks. The nature of literature in our review validates contemporary concerns about diverse EPA descriptions, demonstrating the problems encountered in deciphering EPAs with content dilution and/or when established recommendations are sporadically reported. Our experience substantiates the worth of advancing the practice approach to rigorous EPA reporting towards concept fidelity and validating design integrity.
Advocating, synthesizing and reporting future EPAs according to the current existing recommendations underpins our further three recommendations based on our experience of interpreting how post-licensure EPAs are reported in peer reviewed literature. We discovered a vast number of EPAs representing post-licensure clinical practice in different healthcare disciplines and acknowledge the variety of EPA reporting contexts in our review. To promote EPA fidelity, quality appraisal and reduce subjectivity in consumer interpretation, we assert the proportional value of the following recommendations towards reporting EPA features and attributes:
-
1.
Diligently reporting EPAs with their attributes and features, or directly citing towards the full specifications.
-
2.
Including reference to EPA design and content-validity information.
-
3.
Distinguishing the EPA as profession-specific or transdisciplinary relevant
Previously published recommendations for EPA construct and reporting in the context of our further reporting recommendations are represented in Supplementary file 1.
Limitations of included evidence and the review process
Our review included EPAs referred to as EPAs by article authors in peer-reviewed literature. Some EPAs were reported in several different articles, so our n value represents reporting volume, with some EPAs in duplicate. We grounded a feasible-sized synthesis using the first reported EPA title in each article, so further examples of high-integrity EPAs may have been omitted. It was beyond our resource to consider the large volume of heterogeneous evidence using a consistent Quality Appraisal Tool, which would have been valuable for commenting on the overall rigour of available evidence. Our review included all post-licensure EPAs, without discerning the organization of EPAs along the staged continuum of post-licensure professional training. This review can inform identification of focus points and approach for future work.
Reflexivity statement
Instead of optional additional stakeholder consultation, we drew upon the varied expertise within our research team. We prospectively acknowledged the subjectivity of our scoping review methodology, and further extend this to our critical narrative perspective and interpretation of EPAs. We acknowledge any influence of the wholly physiotherapy-discipline authorship, including any prior assumptions, beliefs and experience as practicing physiotherapists, active researchers and interprofessional education scholars. Reciprocally, we attest our combined and different extensive experiences in these fields qualify us to perform this review, leveraging our combined and different scholarly perspectives to formulate a valid perspective. We attest to the rigorous design and transparent reporting of our work. We developed our conclusions and recommendations with these limitations in mind, advocating the review size enabled us to demonstrate the large heterogenous body of literature and a robust subjective overview of the current evidence base.
Conclusion
EPAs are an established approach to capturing post-licensure clinical skill requirements in different healthcare professions and extensively in medical specialist training. EPAs are typically designed to align clinical skill education and practice according to professional competency standards matrices. In answer to our research question, a large volume of post-licensure EPAs is reported in medicine and very few in other clinical professions. EPA specifications beyond the title were absent or variously reported in the literature, risking ambiguous interpretation of the education and practice expectations. We recommend that future EPAs are reported with reference to established and evolving construct recommendations, which is integral to concept fidelity and translation to practice and education.
Availability of data and materials
All data generated or analysed during this study are included in this published article and its supplementary information files.
Abbreviations
- EPA:
-
Entrustable Professional Activity
References
Michels ME, Evans DE, Blok GA. What is a clinical skill? Searching for order in chaos through a modified Delphi process. Med Teach. 2012;34(8):e573–81.
Ten Cate O, Tobin S, Stokes ML. Bringing competencies closer to day-to-day clinical work through entrustable professional activities. Med J Aust. 2017;206(1):14–6.
AHPRA. Australian Health Professionals Registration Agency (AHPRA) standards. https://www.ahpra.gov.au/Registration/Registration-Standards.aspx. Accessed Nov 2021.
AMC. Australian Medical Council (AMC) Assessment & accreditation of specialist medical programs. https://www.amc.org.au/accreditation-and-recognition/assessment-accreditation-specialist-medical-programs-assessment-accreditation-specialist-medical-programs/. Accessed Nov 2021.
ten Cate O. Entrustability of professional activities and competency-based training. Med Educ. 2005;39(12):1176–7.
Shorey S, Lau TC, Lau ST, Ang E. Entrustable professional activities in health care education: a scoping review. Med Educ. 2019;53(8):766–77.
ten Cate O, Scheele F. Competency-based postgraduate training: can we bridge the gap between theory and clinical practice? Acad Med. 2007;82(6):542–7.
White K, Qualtieri J, Courville EL, Beck RC, Alobeid B, Czuchlewski DR, et al. Entrustable professional activities in hematopathology pathology fellowship training: consensus design and proposal. Acad Pathol. 2021;8:2374289521990823.
Bramley AL, McKenna L. Entrustable professional activities in entry-level health professional education: a scoping review. Med Educ. 2021;55(9):1011–32.
Neumann PB, Radi N, Gerdis TL, Tonkin C, Wright C, Chalmers KJ, et al. Development of a multinational, multidisciplinary competency framework for physiotherapy training in pessary management: an E-Delphi study. Int Urogynecol J. 2022;33(2):253–65.
Ryan MS, Richards A, Perera R, Park YS, Stringer JK, Waterhouse E, et al. Generalizability of the Ottawa Surgical Competency Operating Room Evaluation (O-SCORE) scale to assess medical student performance on core EPAs in the workplace: findings from one institution. Acad Med. 2021.
Soukoulis V, Martindale J, Bray MJ, Bradley E, Gusic ME. The use of EPA assessments in decision-making: Do supervision ratings correlate with other measures of clinical performance? Med Teach. 2021;43(11):1323–9.
Zainuldin R, Tan HY. Development of entrustable professional activities for a physiotherapy undergraduate programme in Singapore. Physiotherapy. 2021;112:64–71.
AQF. Australian Qualifications Framework (AQF) Levels. https://www.aqf.edu.au/aqf-levels. Accessed Nov 2021.
Chesbro SB, Jensen GM, Boissonnault WG. Entrustable professional activities as a framework for continued professional competence: Is now the time? Phys Ther. 2018;98(1):3–7.
Ten Cate O, Carraccio C, Damodaran A, Gofton W, Hamstra SJ, Hart DE, et al. Entrustment decision making: extending Miller’s pyramid. Acad Med. 2021;96(2):199–204.
O’Dowd E, Lydon S, O’Connor P, Madden C, Byrne D. A systematic review of 7 years of research on entrustable professional activities in graduate medical education, 2011–2018. Med Educ. 2019;53(3):234–49.
Liu L, Jiang Z, Qi X, Xie A, Wu H, Cheng H, et al. An update on current EPAs in graduate medical education: a scoping review. Med Educ Online. 2021;26(1):1981198.
Ten Cate O, Pool IA. The viability of interprofessional entrustable professional activities. Adv Health Sci Educ Theory Pract. 2020;25(5):1255–62.
Pool I, Hofstra S, van der Horst M, Ten Cate O. Transdisciplinary entrustable professional activities. Med Teach. 2023:1–6.
Ten Cate O, Chen HC, Hoff RG, Peters H, Bok H, van der Schaaf M. Curriculum development for the workplace using Entrustable Professional Activities (EPAs): AMEE Guide No. 99. Med Teach. 2015;37(11):983–1002.
Tekian A. Are all EPAs really EPAs? Med Teach. 2017;39(3):232–3.
Group ML. Medical Licensure Group. https://medicallicensuregroup.com/when-to-get-medical-license/. Accessed Apr 2023.
Canada RCoPaSo. CanMEDS: Better standards, better physicians, better care. https://www.royalcollege.ca/rcsite/canmeds/canmeds-framework-e#:~:text=CanMEDS%20is%20a%20framework%20that,The%20CanMEDS%20Roles. Accessed Apr 2023.
CanMEDS. CanMEDS Guide: Royal College Canada. https://canmeds.royalcollege.ca/guide. Accessed Apr 2023.
Warm EJ, Kinnear B, Lance S, Schauer DP, Brenner J. What Behaviors Define a good physician? Assessing and communicating about noncognitive skills. Acad Med. 2022;97(2):193–9.
Thomas A, Lubarsky S, Durning SJ, Young ME. Knowledge syntheses in medical education: Demystifying Scoping Reviews. Acad Med. 2017;92(2):161–6.
Thomas A, Lubarsky S, Varpio L, Durning SJ, Young ME. Scoping reviews in health professions education: challenges, considerations and lessons learned about epistemology and methodology. Adv Health Sci Educ Theory Pract. 2020;25(4):989–1002.
Tricco AC, Lillie E, Zarin W, O’Brien KK, Colquhoun H, Levac D, et al. PRISMA extension for Scoping Reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med. 2018;169(7):467–73.
Arksey H, O’Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. 2005;8(1):19–32.
Aromataris EM, Z. JBI Manual for Evidence Synthesis: JBI. https://synthesismanual.jbi.global. https://doi.org/10.46658/JBIMES-20-01. Accessed Nov 2021.
Levac D, Colquhoun H, O’Brien KK. Scoping studies: advancing the methodology. Implement Sci. 2010;5:69.
Moore S, Egerton T, La Scala N, Merolli M, Lees J, Parry S. Entrustable professional activities (EPAs) in post-registration healthcare practice and education: a scoping review protocol. https://osf.io/q5ty8. Accessed Apr 2023.
Eva KW. On the limits of systematicity. Med Educ. 2008;42(9):852–3.
Innovation VH. Covidence systematic review software. Melbourne, Australia2022.
Taylor D, Park YS, Egan R, Chan M-KK, Jolanta;, Touchie CS, Linda; Tekian, Ara. EQual, a Novel Rubric to Evaluate Entrustable Professional Activities for Quality and Structure. Academic Medicine. 2017;92(11S) Association of American Medical Colleges Learn Serve(Lead):Proceedings of the 56th Annual Research in Medical Education Sessions:S110-S7.
Post JA, Wittich CM, Thomas KG, Dupras DM, Halvorsen AJ, Mandrekar JN, et al. Rating the quality of entrustable professional activities: content Validation and associations with the clinical context. J Gen Intern Med. 2016;31(5):518–23.
Mulder H, Ten Cate O, Daalder R, Berkvens J. Building a competency-based workplace curriculum around entrustable professional activities: the case of physician assistant training. Med Teach. 2010;32(10):e453–9.
Ten Cate O, Taylor DR. The recommended description of an entrustable professional activity: AMEE Guide No. 140. Med Teach. 2021;43(10):1106–14.
Hennus MP, van Dam M, Gauthier S, Taylor DR, Ten Cate O. The logic behind entrustable professional activity frameworks: A scoping review of the literature. Med Educ. 2022;56(9):881–91.
Ten Cate O, Schumacher DJ. Entrustable professional activities versus competencies and skills: Exploring why different concepts are often conflated. Adv Health Sci Educ Theory Pract. 2022;27(2):491–9.
Englander R, Cameron T, Ballard AJ, Dodge J, Bull J, Aschenbrener CA. Toward a common taxonomy of competency domains for the health professions and competencies for physicians. Acad Med. 2013;88(8):1088–94.
Lohenry KC, Brenneman A, Goldgar C, Hills KJ, VanderMeulen SP, Lane S, et al. Entrustable Professional Activities: A New Direction for PA Education? J Physician Assist Educ. 2017;28(1):33–40.
Hennus MP, Jarrett JB, Taylor DR, Ten Cate O. Twelve tips to develop entrustable professional activities. Med Teach. 2023:1–7.
Acknowledgements
Vesna Birkic (librarian) is acknowledged for assistance in developing the search strategy.
Authors' information
This work has been previously presented at the Australian Physiotherapy Association (APA) Focus Conference 2022. Title: Entrustable professional activities (EPAs) in post-registration healthcare practice and education: A scoping review. Paper status: Oral presentation. Theme: Education. Date: Saturday Oct 1, 2022.
Funding
Dr. Sonya Moore is a current recipient of the GEM Scott Teaching Fellowship, which funded time for contributors to undertake this review.
Author information
Authors and Affiliations
Contributions
Sonya Moore (SM) was the project lead for conception and design, article screening, analysis and interpretation of data for the work. She drafted the manuscript, prepared the figures and co-ordinated critical revision based on important intellectual content from the authorship group. Thorlene Egerton (TE), Mark Merolli (MM), Jessica Lees (JL) and Nino La Scala (NLS) made substantial contributions to the conception and design of the work, article screening, analysis, interpretation of data and revised the manuscript for critically important intellectual content. Selina Parry (SP) made substantial contributions to the conception and design of the work, approach to analysis and revised the manuscript for critically important intellectual content. All authors gave final approval to the submitted paper and agree to be accountable for all aspects of the work.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
Not applicable.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Moore, S.J., Egerton, T., Merolli, M. et al. Inconsistently reporting post-licensure EPA specifications in different clinical professions hampers fidelity and practice translation: a scoping review. BMC Med Educ 23, 372 (2023). https://doi.org/10.1186/s12909-023-04364-4
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12909-023-04364-4