Using entrustable professional activities to guide curriculum development in psychiatry training
© Boyce et al; licensee BioMed Central Ltd. 2011
Received: 29 July 2011
Accepted: 23 November 2011
Published: 23 November 2011
Clinical activities that trainees can be trusted to perform with minimal or no supervision have been labelled as Entrustable Professional Activities (EPAs). We sought to examine what activities could be entrusted to psychiatry trainees in their first year of specialist training.
We conducted an online survey of Fellows of the Royal Australian and New Zealand College of Psychiatrists (RANZCP).
The majority of respondents considered initiating patients with the common medications, discharging patient suffering from schizophrenia, bipolar disorder or following a crisis admission, conducting risk assessments and managing psychiatric emergencies were activities that trainees could be entrusted with by the end of the first stage of training.
Four activities were identified that trainees should be entrusted with by the end of their first year of training. Each of these activities comprises a set of competencies in each of the CanMEDS roles. When a trainee is unable to satisfactorily perform an EPA, deficits in the underpinning competencies can be a focus for remediation. Further EPAs are being identified in areas of more specialised practice for use within more advanced training.
Over the past 5-10 years there has been a change in which postgraduate specialist training takes place with a move towards competency based curricula rather than the more traditional time-based apprentice approaches of old [1–3]. The Royal Australian and New Zealand College of Psychiatrists (RANZCP), in line with many specialist colleges, is moving to implement a competency based training program. Its current training program is a time-based curriculum with 3 years of basic training and 2 years of advanced training. A summative assessment (comprising a written assessment, an Observed Clinical Interview and an OSCE) takes place at the end of basic training prior to moving into advanced training.
The move to implement a competency-based curriculum has come about for several reasons. First, in line with contemporary educational thinking, we recognise that the outcome of a training program is to produce specialists that demonstrate that they are competent, across a range of roles, in dealing with contemporary medical problems . In order to ensure that the College's training program fulfils its social obligation in producing such specialists, training has to be aligned with this outcome; this can only be adequately achieved through the use of a competency-based program.
Second, within the RANZCP, we had identified issues of concern within the extant training program. The time to complete training was considerably longer than the five years with the mean time to complete training being 7.4 years. This issue is of particular concern when there are considerable workforce shortages along with increasing demand for specialist psychiatrists. Third, we have had a poor pass rate in our summative assessments suggesting that the training program did not prepare the trainees for these assessments. Fourth, there was considerable trainee dissatisfaction, particularly in the tension between service commitments and time spent in training activities. Finally, we recognised that our training program was not adequately equipping trainees for their future work as consultant psychiatrists, suggesting poor alignment in the training program.
The RANZCP will be implementing a competency-based program from 2013, with some pilot studies being carried out in 2012. In moving towards a competency-based program we elected to adopt the CanMEDS framework [5, 6], following an extensive literature review  as the most appropriate framework for our purposes. A dedicated committee of the College's Board of Education was established to oversee the development of the new curriculum. The members of this committee had expertise in various aspects of postgraduate education. It included Directors of Training, supervisors and psychiatrists with expertise in training and assessment. Consumers and carers and a trainee representative were also included within this committee. This committee could be considered as an 'expert' panel overseeing the project. As part of this committee's work, we consulted with international educationalists to gauge their opinions regarding the development of our new program.
As part of the process we held extensive consultations with Directors of Training across Australia and New Zealand. Feedback from these groups was provided to the overseeing committee. Whilst these consultations were not formally established as focus groups, the discussions that took place in them were fed back to the committee effectively fulfilling the role of focus group work.
Our new training program will be in three stages; general adult psychiatry for one year to acquire basic competencies; two years spent acquiring competencies in a range of areas of practice (with mandated rotations in Child and Adolescent psychiatry, Consultation and Liaison psychiatry) and finally the acquisition of advanced competencies in a specific area or areas of practice. A purposeful and rigorous program of Workplace-Based Assessments (WBA) - Case-based Discussions, Mini-CEX, Observed Clinical Activities - and summative assessments will support this program.
While workplace-based assessments are recognised as being reasonably valid assessments of competencies, they are generally designed to assess a specific competency. They do not assess across the range of roles expected of a competent psychiatrist. Assessing competencies in this way runs the risk of 'atomising' them rather than bringing them together. This could end up in the situation where a trainee may have a set of competencies (adequately demonstrated in WBAs) but is unable to integrate them across roles that are necessary to demonstrate competent performance.
WBAs do not adequately assess the actual clinical duties and responsibilities that trainees have. They are often required to deal with emergency clinical situations at times when a supervisor is not available and there are currently no formalised mechanisms of determining what level of responsibility should be accorded to a trainee at different levels of training.
To overcome this problem we plan to introduce the concept of Entrustable Professional Activities (EPA) to give a more wholistic picture of competence and define what a trainee is entrusted to do with differing levels of supervision.
ten Cate has introduced the concept of EPAs [8, 9], as activities, or units of work, that a trainee can be trusted to perform competently. He outlined a set of criteria for these activities: they are essential professional work that can only be carried out by qualified staff, they specify knowledge, skill and attitudes that can be acquired through training, they lead to recognised output of professional labour, can be independently executable within a specific timeframe, they are observable and measurable in process and outcome and lead to a conclusion (done well, or not well). Importantly, they encompass a set of competencies across different roles.
An EPA will enable a supervisor to know when a trainee can be trusted to carry out specific tasks with minimal or no supervision. They can be mapped to the CanMEDS roles and aligned with the learning objectives of a clinical rotation. Entrustment would reflect not only confidence in a trainee being able to competently complete an activity, but also contribute to the trainee being able to recognise when they need additional supervision
In order to determine what would be appropriate activities that could be entrusted within the first stage of our new training program the curriculum committee elected to survey College Fellows (psychiatrists who have successfully completed their training with the RANZCP) to ascertain their opinions regarding the potential value and use of such activities as EPAs and to identify if the proposed activities could be classed as EPAs for the first year of training, when the trainees are in the earliest developmental stage in their trajectory to acquire Fellowship.
All RANZCP Fellows were invited to complete an anonymous online survey which was constructed using SurveyMonkey. The curriculum committee, had previously, through its development work, identified a set of activities that trainees would be expected to carry out in the early stages of training with varying levels of supervision. The committee defined an EPA for the purposes of the survey and included the description in the survey introduction. The identified activities had good 'face validity' as they were determined by expert psychiatrists with extensive experience in psychiatry and postgraduate psychiatry training. Furthermore the face validity was evidenced in that forms of the identified EPAs were already present in the training and assessment program. The survey asked College Fellows to consider whether a trainee should be entrusted with the specific activity by the end of the first stage of training prior to moving on to rotations in specific areas of practice. Fellows were asked to rate whether competence in the proposed areas should be mandatory, very important, somewhat important or of little importance.
The activities that were asked about included initiating various treatments, discharging patients, engaging in family education sessions, conducting risk assessments, admitting patients without supervision, crisis assessments, referring for laboratory investigations, performing neurological examinations and formulating a case.
The survey invited the Fellows to identify other potential EPAs. The survey included an opportunity to collect qualitative data through free text feedback.
The survey was posted on the RANZCP website and an invitation to respond to the survey was sent out in two ways; first, in the College's regular online newsletter (psych-e-bulletin) and then followed up with a group email to all 2736 College Fellows. No further reminders were sent out as in our experience that has not substantially increased the response rate.
Proportion of participants that rated the activity as mandatory prior to progressing to the next stage of training.
Number of responses
Initiating treatment with
Discharging a patient from hospital suffering from
An adjustment disorder
Crisis admission following self-harm
Conduct a family education session for
Admitting a patient without supervision
Conduct a risk assessment
Carry out crisis assessment and handover report to duty consultant
Acute assessment and immediate management of psychiatric emergencies
Perform appropriate lab investigations to exclude medical complications
Perform a neurological exam
Formulate a clinical case
Non-pharmacological management of a patient with personality disorder
Design a biopsychosocial care plan
Complete a discharge summary (without supervision)
Facilitate a follow-up appointment at a community clinic
Consent a patient for ECT
Acute sedation of a patient
Initiate a brief substance misuse intervention
Non-pharmacological management of an anxiety disorder
Pharmacological management of an anxiety disorder
There seemed to be broad agreement that trainees could be entrusted to discharge patients suffering from schizophrenia or bipolar disorder from hospital as well as discharging patients following a crisis admission after an episode of self-harm. However, there was lower endorsement for discharging patients suffering from an adjustment disorder.
There was strong agreement that trainees at this stage in their career could be entrusted to conduct a risk assessment, conduct a crisis assessment with handover and report to the duty consultants, and be involved in the acute assessment and immediate management of psychiatric emergencies. The ratings were lower with regard to performing appropriate laboratory investigations to exclude medical complications and in formulating a case or completing a discharge summary.
The majority of respondents did not consider conducting family education sessions for the major psychiatric illnesses, managing a patient with a personality disorder without the use of medication, performing ECT or the nonpharmacological and pharmacological management of anxiety disorders should be entrusted in the first year of training. Some activities were considered mandatory by over 50% (but less than 70%) of respondents, including admitting a patient without supervision, performing a neurological examination, designing a biopsychosocial care plan and consenting patients ECT.
Respondents identified further activities that they considered could be included as EPAs, however many of the activities they identified were specific competencies or areas of knowledge, rather than clinical activities that could be described as 'entrustable' based on our acceptance of ten Cate's (2007) definition.
While online surveys are now widely used in survey research, there remains considerable debate about the best strategies to assure response rates that will allow one to generalise from the data. Historically, low response rates characterise online surveys conducted by our College; given this, we were satisfied that the available data as 'exploratory data' could justifiably inform our deliberations.
In developing a new curriculum for the RANZCP's training program we have elected to use Entrustable Professional Activities as an overarching assessment of competence. These EPAs provide a content focus for WBA, with assessments for each of the EPAs being undertaken early in a rotation; it is intended that these will inform the development of a learning plan, devised by the supervisor and trainee. Before embarking on this we conducted a survey of College Fellows to ascertain their views about activities that could be 'entrusted' to trainees by the end of the first stage of training prior to moving on to train in specific areas of practice. The activities they endorsed are the same activities that trainees often carry out with minimal or no supervision in their day-to-day clinical work. Activities that required more expertise or would not be expected of trainees in this early stage of training did not gain endorsement. This suggests that there is good understanding of EPAs as we presented the concept, particularly the developmental nature of entrustment among College Fellows who responded to our survey, many of whom are engaged in the supervision and teaching of trainees.
completing a discharge summary;
initiating antipsychotic medication in a patient with schizophrenia;
leading the multidisciplinary team discussion regarding the care of a patient; and
carrying out a diagnostic explanation to a family about a young adult's psychiatric illness.
The decision to recommend four EPAs in the first year of training was a pragmatic one based on the survey responses as outlined above. This is a new concept and we wish to conduct more pilot work testing their acceptability, utility and feasibility. Second, we did not want to overburden trainees and supervisors with too many EPAs and their associated WBAs in the initial implementation of this competency-based training program and risk the process being perceived as too burdensome.
'Initiating medication' EPA and the CanMEDS roles.
The trainee demonstrates the ability to make an accurate diagnosis, has conducted the appropriate assessments, can describe the evidence for the use of the medication, its dosage, interactions and side effects.
Has an appropriate diagnostic assessment been completed?
Is the use of this medication evidence-based?
Are there any contraindications to the use of this medication (significant interactions etc)?
Is the dosing regime correct?
Have appropriate investigations been performed?
What plan is there to assess outcome?
The trainee shows the ability to explain to the patient the benefits and risks of the medication and how it should be taken and addresses the patients questions.
Have the reasons for the use of this medication been explained so that the patient is able to understand?
Have the benefits of the medication been explained?
Have the risks (major side effects) of the medication been explained?
Has the patient been explained about what to do should side effects emerge?
Has the dosing regime been explained so that the patient understands?
Has the need for further investigations been explained?
Have the patient's questions been responded to appropriately?
The trainee ensures that members of the MDT (and GP) are aware of how the medication fits in with the management plan
Has information about the medication been communicated with the MDT?
Has information about the medication been communicated with significant others?
Has the GP been informed?
The trainee has obtained informed consent
Has informed consent been obtained?
Are there any conflicts of interest?
The trainee is able to apply the evidence from clinical practice guidelines
What is the evidence base for the medication?
What process will be used to evaluate outcome?
Can the trainee explain the mechanism of action?
The trainee ensures that the patient is able to access the medication
Has there been a check on whether the patient can access the medication?
Has there been a check on whether the patient can afford the medication?
Has the appropriate authority form been used?
Clear and accurate documentation is completed
Is the documentation in the case note clear and accurate?
Has the medication form (prescription) been completed correctly?
Has the use of health resources been considered?
We are now planning an expanded set of EPAs for specific rotations, such as Child and Adolescent psychiatry, Consultation and Liaison psychiatry, Psychiatry of Old Age, Addiction Psychiatry, Rural Psychiatry and other areas of practice. It is intended that these will become one of the major ways in which competent performance is assessed in the later stages of training.
The survey data as we have described it gives us confidence that there are clear advantages in using EPAs for our training program. The limitations of the survey are restricted to the low response rate, however as an exploratory study and given the RANZCP's history of low response rates to online surveys, we see the data and our analysis as useful in the broader context of this specific curriculum redevelopment.
We believe that the use of EPAs in conjunction with a more transparent outcome-oriented training program informed by CanMEDS, will allow us to better prepare trainees and to give supervisors and others engaged in the training program greater confidence in assessing performance. We anticipate that our pilot studies will assist us in developing a more comprehensive understanding of performance based assessment and the complex nature of learning in the clinical setting of postgraduate medical education. Moreover, it offers new opportunities to develop collaborative research across training programs nationally and internationally as medical education continues to investigate the efficacy of competency-based training models and their impact on both learning and patient safety.
PB is Professor of Psychiatry, Sydney Medical School-Western, University of Sydney and formerly, Chair, Curriculum Improvement Project, Royal Australian and New Zealand College of Psychiatrists. CS is Deputy Director Programs, Higher Education, Northern Melbourne Institute of TAFE and formerly educational advisor, Royal Australian and New Zealand College of Psychiatrists. MD is Education Project Officer, Royal Australian & New Zealand College of Psychiatrists. PM is Director of Advanced Training Child and Adolescent Psychiatry, South Australia.
This work was supported by funding from the Australian Federal Government Department of Health and Aging.
- Harden RM: Trends and the future of postgraduate medical education. Emerg Med J. 2006, 23 (10): 798-802. 10.1136/emj.2005.033738.View ArticleGoogle Scholar
- Beresin E, Mellman L: Competencies in psychiatry: the new outcomes-based approach to medical training and education. Harv Rev Psychiatry. 2002, 10 (3): 185-191. 10.1080/10673220216219.View ArticleGoogle Scholar
- ten Cate O, Scheele F: Competency-based postgraduate training: can we bridge the gap between theory and clinical practice?. Acad Med. 2007, 82 (6): 542-547. 10.1097/ACM.0b013e31805559c7.View ArticleGoogle Scholar
- Epstein RM, Hundert EM: Defining and assessing professional competence. JAMA. 2002, 287 (2): 226-235. 10.1001/jama.287.2.226.View ArticleGoogle Scholar
- Frank JR, Ed: The CanMEDS 2005 physician competency framework. Better standards. Better physicians. Better care. 2005, Ottawa: The Royal College of Physicians and Surgeons of Canada
- Frank JR, Danoff D: The CanMEDS initiative: implementing an outcomes-based framework of physician competencies. Med Teach. 2007, 29 (7): 642-647. 10.1080/01421590701746983.View ArticleGoogle Scholar
- Spratt C, Boyce P, Crawshaw J: Competency-based specialist medical educaion: A literature review in Psychiatry. 2009, Unpublished Internal Discussion Paper, Royal Australian and New Zealand College of Psychiatrists, MelbourneGoogle Scholar
- ten Cate O: Entrustability of professional activities and competency-based training. Med Educ. 2005, 39 (12): 1176-1177. 10.1111/j.1365-2929.2005.02341.x.View ArticleGoogle Scholar
- ten Cate O: Trust, competence, and the supervisor's role in postgraduate training. BMJ. 2006, 333 (7571): 748-751. 10.1136/bmj.38938.407569.94.View ArticleGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6920/11/96/prepub