Skip to main content
Download PDF

Entrustable professional activities for Junior Brazilian Medical Students in community medicine

BMC Medical Education volume 22, Article number: 737 (2022) Cite this article

Abstract

Background

Entrustable professional activities (EPAs) have been defined to promote the workplace participation of undergraduate medical students, generally in the context of high-income countries with a focus on the secondary and tertiary health care sectors. These EPAs have limited applicability to training and health care contexts in low- to middle-income countries that have a focus on primary health care, for instance, the context of community medicine. The purpose of this article is to report the process and results of defining EPAs for undergraduate medical training in a community health care setting.

Methods

A modified Delphi study was performed to develop EPAs for the training of medical students in community medicine during their first and second years of education at the Marília Medical School (FAMEMA), Brazil. The supervision level was operationalized in terms of a student’s ability to perform the EPA autonomously in an effective and safe manner with supervision readily available on request. Panellists (9 physicians and 6 nurses) rated the completeness of the proposed list of EPAs and EPA categories on four-point Likert scales. The threshold for consensus among panellists was a mean content validity index of at least 80%.

Results

Consensus was reached after two Delphi rounds, resulting in 11 EPAs for undergraduate medical education and training in community medicine. These EPAs were organized into three overarching EPA domains: integrality of care for individual health needs in all phases of the life cycle (5 EPAs), integrality of care for family health needs (3 EPAs), and integrality of care for community health needs (3 EPAs). For each EPA, descriptions of the following categories were created: title; specifications and limitations; conditions and implications of the entrustment decision; knowledge, skills, and attitudes; links to competencies; and assessment sources.

Conclusion

The resulting 11 EPAs for training medical students in community medicine expand the application of the EPA framework to both early undergraduate medical education and the context of primary health care. This report can support and guide other medical schools in their attempts to train students in primary health care contexts and to incorporate EPAs into their curricula.

Peer Review reports

Background

The concept of entrustable professional activities (EPAs) is utilized increasingly to operationalize competency-based education. EPAs provide a tangible means of facilitating the participation of medical trainees, including both post- and undergraduate trainees, in the patient care in various health care settings [1,2,3,4,5]. The transferability of previously reported EPAs used for undergraduate medical education appears to be limited, as EPAs have been developed to facilitate the workplace participation of medical students in the context of high-income countries with a focus on the secondary and tertiary health care sectors [6,7,8,9,10,11,12,13,14]. However, both in the literature and in practice, there is a lack of EPAs for training students in the context of low- to middle-income countries with a focus on the primary health care sector. A branch of medicine called community medicine represents one of the main primary health care-focused approaches to the comprehensive care of patients, families and society in many such countries [15,16,17,18]. EPAs for community medicine are likely to facilitate the more tangible operationalization of the health practices involved in community medicine, thereby promoting health care and improving the teaching-learning process for both students and their supervisors [4, 19, 20]. The purpose of this article is to report the process and results of defining EPAs for undergraduate medical training in a community health care setting.

The concept of EPAs was introduced in 2005 by ten Cate as an approach to improving the translation of competency-based medical education into workplace practice [21]. The concept is focused on professional activities as represented by authentic units of clinical work, and these activities are gradually entrusted to medical trainees by supervisors depending on the trainees’ level of competence. EPAs function well as educational outcomes at all stages of medical training. With regard to learning, EPAs synthesize the necessary knowledge, skills and attitudes that must be learned to carry out certain professional activities. With regard to assessment, EPAs simultaneously allow for the evaluation of acquired competencies by observable and measurable means and methods [21,22,23]. The concept of EPAs was first introduced for postgraduate medical training, and an increasing number of programmes worldwide have adopted this approach [24]. More recently, the concept of EPAs has been applied to undergraduate medical education with a focus on defining end-of-undergraduate training outcomes; EPAs used for this purpose are generally referred to as EPAs for entry into residency. To date, the use of EPAs for entry into residency has been reported at the national level for the USA, Canada and Switzerland and at the institutional level for Utrecht, The Netherlands, and Berlin, Germany [6, 7, 21,22,23,24,25,26,27]. Another set of EPAs has been defined for the participation of students in early clerkships [28, 29].

One common element among EPAs reported to be in use for undergraduate medical training is that they focus on patient care at the secondary and tertiary health care levels, that is, on care that is often specialized care and that is provided by specialist and subspecialist professionals, respectively [30, 31].However, primary health care has received less attention. The focus on secondary and tertiary health care reflects the main context of workplace learning and the participation of trainees in the high-income countries in which EPAs have been developed. Accordingly, training takes place primarily in the medical centres of universities, affiliated hospitals or specialized ambulatory clinics featuring intermediate to highly technical and specialized levels of care. Clinical work is focused on care for individual patients and entails the provision of specialized services to diagnose and treat a spectrum of disorders with a medium-to-high level of complexity, which often feature unusually severe, complex or uncommon health problems [23,24,25,26,27].

In contrast, the health care systems of low- to middle-income countries focus on the measures and structures involved in the primary health care sector. In a number of countries, community medicine represents the main modality for implementing primary health care [32,33,34,35,36]. In particular, community medicine is concerned with the promotion of health and the prevention of disease among individuals (including healthy individuals, individuals with diseases, and individuals with disabilities), families and communities. Community medicine aims to provide comprehensive health services, which include preventive, promotive, curative and rehabilitative services throughout the human life cycle, i.e., from childhood to old age. Community medicine encompasses the comprehensive planning and provision of public health services and, when necessary, the management of access to higher-level medical care [36,37,38,39,40]. Furthermore, the workplace participation of medical students at an early stage is common in community medicine [41,42,43]. Given these differences in the context and scope of health care, it may be unsurprising that the previously reported EPAs used in undergraduate medical education appear not to be sufficiently transferable or applicable to the context of training in community medicine [2, 3, 6,7,8,9,10,11,12,13,14, 25, 26]. While community medicine has adopted a competency-based approach to medical education, a shift towards operationalization via the application of EPAs has not yet been carried out [40, 41]. The elaboration of community medicine EPAs for undergraduate medical training would represent a first and important step in this direction. Such EPAs can define tasks for the participation of medical students in a community medicine setting, the scope and breadth of these tasks and the anticipated levels of supervision required. Therefore, community medicine EPAs are better able to operationalize expectations for students and their supervisors, and they can be utilized in curriculum development to refine and improve the alignment of the teaching, learning and assessment of medical students with respect to practice in community medicine.

The aim of this paper is to report the process and results of defining a set of community medicine EPAs for undergraduate medical training. The tasks and content of these EPAs were defined through a systematic, Delphi study-based process [44,45,46]. The EPAs were created based on the competency-based curriculum of a Brazilian state-operated medical school, in which students in their first and second years of education actively participate in the provision of community medicine services in affiliated family health care units [41,42,43, 47].

Methods

Setting

The study was conducted at Marília Medical School (Faculdade de Medicina de Marília - FAMEMA) and 20 affiliated Family Health Strategy (FHS) units located in Marília, a city in the state of São Paulo, Brazil, from February 2019 to October 2019. The study protocol was approved by the Brazilian Ethics and Research Commission, 3.571.405; National Health Commission 466/2012; Operating Number 001/2013. This study focuses on existing workplace placements of FAMEMA students in the field of community medicine.

FAMEMA is a public medical and nursing school. The undergraduate medical programme conducts annual enrolment, takes six years to complete and requires a total of 11.079 h of teaching and practical training [47]. The undergraduate education is followed by postgraduate training in various medical disciplines. The medical curriculum is competence-based and includes defined learning objectives for knowledge, skills, attitudes and competencies throughout all study phases; however, thus far, no EPAs have been established for the programme. In Brazil, FAMEMA is known for its pioneering adoption of the problem-based learning (PBL) approach, which it has employed for more than 24 years [48]. The FAMEMA medical curriculum includes four major longitudinal tracks [47, 49]. 1) In the Pedagogical Support Unit track, which takes place from years 1 to 6 of education, the students take classes in basic and clinical science, communication and information technology. 2) The PBL track, which is called the Systematized Education Unit, involves a total of 69 written cases and takes place from years 1 to 4. 3) The Professional Practice Unit track takes place from years 1 to 6 of education. In years 1 and 2 of this track, students of medicine (a total of 80 students) and nursing (a total of 40 students) learn collaboratively, and half of their study time is allocated to workplace placement in a community medicine setting (representing a primary health care setting) [50,51,52]. During years 3 to 4 of this track, the medical students are assigned to specialized outpatient clinics (representing a secondary health care setting), and in years 5 and 6, the students are assigned to hospitals (representing a tertiary health care setting). Both the outpatient clinics and the hospitals are located in the region of Marília and are affiliated with FAMEMA [53–56]. 4) The Elective Unit track takes place from years 2 to 6 of education and requires students to complete elective internships lasting for 40 days inside or outside the Marília Medical School [50, 51].

The FAMEMA medical programme is in alignment with the Brazilian Unified Health System, which offers free and hierarchical health care at three levels in accordance with the technological complexity involved, i.e., primary, secondary, and tertiary levels of patient care [57]. The government’s actions are intended to serve 100% of the population and primarily focus on primary care (community medicine), which is responsible for promoting good health conditions, preventing disease, treating and controlling the most frequently occurring diseases, promoting health recovery, and/or rehabilitating people. In the Brazilian context, approximately 80% of health demands are met at the level of primary care (community medicine) [57,58,59].

The placement of FAMEMA students in community medicine is determined by FHS units that are distributed across the neighbourhoods of the city of Marília. These community medicine placements have been part of the FAMEMA curriculum since 2003 [47, 50]. As part of these placements in the FHS units, the students engage in activities to provide community medicine under the supervision of the FHS care team and clinical teachers from FAMEMA. These activities involve home visits, follow-up visits and health projects with a focus on health surveillance[44,45,46]. Each FHS provides care to 3,000 to 4,000 community inhabitants (750 to 800 families) that live in the surrounding territory. The health care team of an FHS consists of 8 to 15 members from various disciplines, including nursing, medicine (with postgraduate training in various disciplines), dentistry, as well as agents of community health [46]. The latter term refers to staff who have a secondary school degree and who assist in the health promotion actions performed by the FHS [57,58,59].

The FHS team works in a building with a reception room, medical, nursing, and dental offices, a vaccine room, a pharmacy, a small procedures room, a room for meetings and group care, bathrooms, and a kitchen. However, most activities are performed during visits to the homes of local residents. Thus, part of the team is always away on visits, while the other team members are in the FHS centre. Students complete their FHS placements in groups of 12, which are accompanied by two supervisors (a physician and a nurse, both of whom are teachers at FAMEMA), three times per week for 4 h per visit. In this context, students are integrated into the FHS health team and participate in health care activities for two years. During this period, they perform health care activities to benefit individuals, families and the community.

The supervisor decides which new individual or family a student will see for a home visit and when these visits will occur based on the supervisor’s assessment of the student. During these home visits, the supervisor is accessible in the local area or at the FHS. In addition, she or he accompanies one pair to conduct direct supervision. This student pair generally faces a more complex situation or seems to be more fragile. The other student pairs act without direct in-the-room supervision and can call the supervisor if they experience difficulties to ask for guidance, to ask the supervisor to join the home visit or to have the patient taken to the FHS centre. Each student pair is expected to be able to follow 5 families over the first year in addition to other activities.

Regarding assessment and feedback, the supervisor produces a formative assessment at both the individual and group levels on a daily basis. Each student receives a systematic verbal evaluation when performing health care activities under direct supervision once per week. The frequency of this feedback can be increased if requested by the student or when the supervisor deems it necessary to do so. Every other week, the supervisor evaluates the student´s reflective portfolio. In addition, students engage in discussions with the supervisor regarding all the activities performed by the students,which offers the opportunity for the students to receive new formative assessments and to share the actions they performed with the rest of the FHS team. In addition, a global formative knowledge test is administered once every three months, which includes a remediation plan that is to be followed over subsequent months. The student has two consecutive chances to redo the test (the summative aspect of this knowledge test). Assessment of student performance takes place in the simulation laboratory of FAMEMA at the ends of years 1 and 2 and features the same remediation, number of redos and summative character.

Delphi study process

Our study was conducted by using a modified, 2-round Delphi process featuring interaction between a writing team and a multiprofessional panel of 15 content experts from FAMEMA. The same members participated in both rounds of the process. The goal of the Delphi study was to define a full set of EPAs representing the authentic participation in community medicine of FAMEMA students during their first and second years of education. The breadth and scope of each EPA was elaborated in the form of a seven-category description in accordance with EPA writing guidelines [2, 44,45,46]. The EPAs defined will subsequently be embedded in not yet defined entry into postgraduate medical training EPAs for the FAMEMA context.

Panel selection and writing team

The Delphi panel consisted of purposely selected physicians and nurses from the FAMEMA faculty. The selection criteria included a minimum of ten years of clinical supervision experience, including substantial experience in community medicine and teamwork in the context of the FHS. Another selection criterion was involvement in the continuous curriculum development process at FAMEMA (e.g., individuals who served as course directors or unit coordinators were included). The writing team consisted of the authors of this manuscript (IF, YH and HP), who had combined expertise of the community medicine context at FAMEMA and EPA content elaboration and validation for undergraduate medical education.

Identification and drafting of EPAs for community medicine in undergraduate medical education

The writing team identified potential EPAs for the year 1 and 2 placements in community medicine at FAMEMA and iteratively elaborated the content of each EPA. The content elaboration included the qualitative analysis and synthesis of written documents that served as the basis for the FAMEMA medical programme, in particular with respect to the placement of medical students in the community. These documents included health policies from the Brazilian Ministry of Health and Ministry of Education [57,58,59], the National Curriculum Guidelines (NMCG) [49] and the Medical Pedagogical Project of FAMEMA and its medical course notebooks [47], all of which have been used for undergraduate medical education. This step focused on identifying and incorporating the expected knowledge, skills, attitudes and competencies that are required by medical students in their placement in community medicine. The identification and assignment of the appropriate level of supervision for medical students in community medicine during their first and second years of education was based on the supervision levels that were applicable to undergraduate medical education [1]: level 1 - be present and observe, level 2 - act with direct, proactive supervision, i.e., with a supervisor physically present in the room, and level 3 - act with indirect, reactive supervision, i.e., readily available on request. In this process, the experience of one author (IF) as a supervisor for this community medicine setting was helpful in elaborating the most closely aligned content and FAMEMA’s own construction logic for the community medicine EPAs.

The list and descriptions of EPAs were organized into three thematic overarching EPA domains under the auspices of the notion of “integrality of care”, which is commonly used in the Brazilian context. Here, integrality in health refers to the “fundamental principle of public health systems which guarantees citizens the right to be assisted, from disease prevention to the most difficult treatment of a condition, not excluding any disease, prioritizing activities and preventive care services without prejudice. Integrality implies a healthcare and healthcare management that recognizes the autonomy and cultural and social diversity of individuals and populations”[60].

Questionnaire design and establishment of consensus

The writing team drafted the Delphi study questionnaire, which included the full list of the titles of the proposed EPAs for student participation in community medicine and descriptions of the content of each EPA category. The questionnaire asked the panellists to provide three ratings of the completeness of the description of the EPAs: one rating of the list of EPAs; one rating of the ‘title’, ‘specifications and limitations’, and ‘knowledge, skills and attitude (KSA)’ content sections; and one rating of the ‘conditions and implications of the entrustment decision’. [2]. In each Delphi round, the panellists provided individual ratings in response to statements regarding different EPA aspects on a four-point Likert scale (1 = fully disagree, 2 = partly disagree, 3 = partly agree and 4 = fully agree) as well as narrative comments regarding potential improvements [2]. To ensure that consensus was reached among the panellists, a content validity index (CVI) was derived by calculating the percentage of “partly agree” and “fully agree” ratings (3–4) among all ratings (1–4). The threshold for reaching consensus on each statement in the Delphi study was a mean CVI of all panellist ratings of at least 80% [44]. Each rating item was accompanied by a field for narrative comments. The study questionnaire was designed in Word, and the Word files were distributed to the panellists.

Panel invitation and briefing

In July 2019, researcher IF invited the panellists to two meetings to introduce the Delphi study. IF introduced the panellists to the goal of the planned study, the concept and definition of EPAs, the scope of and procedure involved in a Delphi study and the task assigned to the panellists. This introduction was followed by an interactive discussion. Before starting the Delphi study, all panellists provided written informed consent to participate.

Round 1. The first Delphi round started in July 2019, when the panellists were sent the initial draft of the EPAs for student participation in community medicine as drafted by the writing team. The panellists rated the EPA aspects, provided written comments, and proposed additional EPAs [2, 22]. All panellist responses were received by August 2019. The writing team analysed and summarized both the quantitative ratings and narrative comments. The content and elaboration of the EPAs were adjusted by the writing team via an iterative process. The anonymized results of the first Delphi round were shared with the panellists in September 2019 to allow them to raise questions and discuss them with researcher IF, who represented the writing team.

Round 2. The second round started in September 2019. The panellists received the anonymized, summarized panel rating results alongside the refined EPA content descriptions. Changes to the initial draft were highlighted specifically. Again, the panellists could supplement their ratings with narrative comments [2, 22]. All panellist responses were received by October 2019. The writing team analysed and summarized both the quantitative ratings and narrative comments. No further Delphi rounds were conducted, as the threshold for consensus was reached for all EPAs and ratings.

Finalization of the EPAs and category descriptions

The writing team made final changes to the descriptions of the content of the EPAs for students’ participation in community medicine based on the panel member ratings and comments from Round 2. The EPA categories ‘most relevant domains of competence’ and ‘assessment sources’ were defined by the writing team via an iterative process based on the educational context of FAMEMA. Furthermore, special attention was given to the task of harmonizing the structure, language and wording of the EPA descriptions.

Data analysis

Descriptive statistics were calculated using IBM SPSS Statistics™ software (version 26, 2019). The panellists’ sociodemographic characteristics are expressed in terms of mean and standard deviation. The relative frequency of panellist ratings and the CVIs calculated for each Delphi round are reported.

Results

Panel members and Delphi round response rates

A total of 15 content experts participated in the Delphi procedure, nine of whom were physicians (60%, including five males and four females) and six of whom were nurses (40%, including two males and four females). The mean age of the physicians was 57 ± 12 years, and their mean professional work experience was 27 ± 7 years. The mean age of the nurses was 55 ± 9 years, and their mean professional work experience was 25 ± 7 years of work experience. The response rates for both Delphi rounds were 100% (15 of 15 panellists).

Identification of EPAs for community medicine

The writing team identified a total of 11 EPAs for the engagement of FAMEMA students in community medicine during their first and second years of education. The supervision level at the end of year 2 was operationalized in terms of the student’s ability to act under reactive supervision, i.e., to perform the EPA autonomously in an effective and safe manner with the supervision readily available on request (supervision level 3) [1] in accordance with current practice at the FAMEMA medical school. The panellist ratings of the completeness of the EPA list, expressed in terms of the CVI, were high in both Delphi rounds for the whole panellist group (round 1: 93%; round 2: 95%), with similar rates of approval for the physician (92%, 94%) and nurse subgroups (96%, 96%). The panellists did not propose any additional EPAs regarding the participation of students in community medicine during their first and second years of education. Minor changes were made and incorporated into the EPA titles following the first Delphi round. Table 1 (left) shows the resulting titles of the 11 EPAs resulting from the Delphi procedure, which have been organized into three overarching thematic EPA domains.

Table 1 Titles of the 11 EPAs for students training in community medicine organized in accordance with three overarching EPA domains (left). Mean content validity index (%) indicates the completeness of the combined ‘title’, ‘specifications and limitations’, and ‘knowledge, skills, and attitudes’ category descriptions and the ‘conditions and implications of the entrustment decision’ category description in the first and second Delphi rounds (right). The main results are shown for the whole group of Delphi panellists, while those in parenthesis refer to the physician and nurse subgroups, respectively
Full size table

Content elaboration and validation of EPAs for community medicine

Table 1 (right) depicts the panellist ratings of the content descriptions of the 11 individual EPAs for community medicine, once again for the whole group of panellists as well as for the physician and nurse subgroups. In the first Delphi round, the CVI for the ratings of the whole group of panellists was already high, with no relevant differences in the responses between the physician and nurse subgroups. A total of 57 narrative comments offered proposals for changes and clarifications that were used by the writing team to improve the description of the content of the EPAs. The results of the second Delphi round show a high degree of consensus among the panellists concerning the content of the EPAs regarding the participation of students in community medicine during their first and second years of education.

Resulting EPAs for community medicine

The content elaboration and validation produced two-page descriptions of each EPA. Table 2 presents the full 7-category description of EPA 1.1, ‘First consultation to diagnose the health needs of an individual’, as an example. Table 3 provides an overview of the short summary descriptions of all 11 undergraduate EPAs for community medicine. The full set of all 11 EPAs is provided in the appendix alongside their 7-category descriptions.

Table 2 Description of EPA 1.1. as an example of an undergraduate EPA for community medicine
Full size table
Table 3 Summary descriptions of the 11 undergraduate EPAs for community medicine
Full size table

Discussion

EPAs have been employed to operationalize competency-based medical education by a steadily increasing number of post- and undergraduate medical training programmes [1,2,3,4,5,6]. The present study contributes to this worldwide development by expanding the application of the EPA framework to both the start of undergraduate medical education and the context of community medicine. Using a systematic, Delphi-based approach, this study produced a full 7-category description of a total of 11 EPAs for the training and participation of medical students in community medicine during their first and second years of education. In the following, we discuss the process and results of our study in light of the EPA literature and note the study’s specific features pertaining to the context of community medicine.

With regard to the EPA definition process, we employed a modified Delphi study procedure to identify and elaborate undergraduate EPAs in community medicine [44,45,46]. We purposively chose the Delphi procedure because it allows for the anonymized, nonhierarchical content validation of EPAs and represents an established method of defining EPAs [2, 22]. Two special features of our Delphi study should be emphasized. First, the panel of content experts was selected to be interprofessional in order to reflect the workplace reality of community medicine, in which context medical students are trained and supervised by both physicians and nurses. Other efforts to define undergraduate EPAs have generally involved expert panellists drawn from different medical disciplines but not from other health professions. Second, we combined the ‘title’, ‘specifications and limitations’ and ‘knowledge, skills and attitude’ EPA categories into one item that was rated by the expert panel in the Delphi procedure. We believe that these EPA categories jointly describe the breadth and depth of the relevant EPAs and that this approach allowed valuable time to be saved during the Delphi process, both for the expert panellists and for the writing team. Overall, it required only two Delphi rounds and a few months to reach a consensus regarding the complete description of undergraduate EPAs for community medicine. Several additional factors may have contributed to this efficiency, such as the use of best practice experiences drawn from the literature to guide the process and the establishment of a writing team with expertise both in the definition of EPAs and the content of the envisioned EPAs [2, 8, 22, 27].

With regard to the results of the process, the EPAs defined for the participation of undergraduates in community medicine differ substantially from previously reported EPAs for undergraduate medical education in several ways. First, the proposed undergraduate EPAs for community medicine are embedded in the primary care setting, while previously reported undergraduate EPAs have focused primarily on the secondary-to-tertiary-level health care setting [2, 3, 6,7,8,9,10,11,12,13,14, 25, 26]. This distinction is reflected by the different scopes of the EPAs in each case, with the proposed community medicine EPAs going beyond primary curative approaches to the care of patients by explicitly including health promotion, disease prevention and rehabilitation. Furthermore, the EPAs for community medicine extend beyond the scope of individual care by including care related to families and the community. Second, the proposed EPAs for community medicine are larger in size and less granular, for instance, by including a full patient consultation under indirect supervision. This characteristic of the community medicine EPAs may reflect the fact that the activities of students participating in community medicine involve primarily low-stakes decisions with little immediate risk, decisions which are often related to lifestyle habits, sanitary conditions and basic care for common diseases that are no longer fully verified or reiterated by professionals after students have qualified for level 3 supervision. This focus of community medicine stands in contrast to the high-stakes, high-risk situations that frequently occur in the tertiary health care setting, for which each step of the patient consultation must be double-checked by a supervising physician before the next step can be taken. Therefore, as illustrated by Chen et al., parts of the patient consultation are nested in smaller, separate EPAs, such as ‘gather information from a medically stable patient with a common chief complaint’ or ‘share information about the patient’s care, including diagnosis and management plan, with a patient in no significant physical or emotional distress’ [28]. Third, community medicine allows for unique workplace-based, interprofessional learning experiences, as these EPAs are carried out in pairs of medical and nursing students. Finally, the EPAs for community medicine are intended for students in their first and second years of medical education, thereby encouraging early participation in real patient care, while previously reported undergraduate medical EPAs are mainly intended for students entering residency or during the final phase of undergraduate medical education [28, 37, 38, 59]. A synthesis of the narrative comments made by the Delphi panellists can be found in a complementary publication [61].

The 11 EPAs defined and reported for community medicine in undergraduate medical education have implications regarding the future development of the field. For FAMEMA in Brazil, these EPAs represent a first step toward a new approach to competency-based medical education. The EPAs used in community medicine will be implemented as overarching outcomes during the first two years in undergraduate medical education; i.e., they will be implemented in the teaching, learning and assessment of students and in the context of faculty development for supervisors and teachers in the programme. Subsequently, EPAs will be defined for the following 4 years of the medical undergraduate programme and the following 2 years of the nursing programme; thereafter, EPAs for the postgraduate education and working phases may be formulated. For other medical schools, especially schools that are involved with community medicine in a manner similar to FAMEMA, this report can provide support and stimulate consideration of the development and implementation of EPAs as part of their curricula.

This work faces certain limitations. The undergraduate EPAs for community medicine discussed here represent the results of a consensus among professionals from one medical school and invited content experts. The generalizability of these results to other medical schools and the contexts in which they operate may be limited, and other groups of content experts may come to different results. In the future, the definition of supervision level 3 would need a clarification of how detailed the findings are being checked by the supervisor and how quickly the supervisor can be present in case urgent help is needed. As wells as the interprofessional nature of working of a medical students in a pair with a nursery student needs further exploration and analysis. Furthermore, the students involved in the programme were not included and could have been an additional source for content validation.

Conclusion

This study reports the results of the definition of 11 EPAs for the training of medical students in community medicine employing a systematic, Delphi-based approach. It expands the application of the EPA framework to both early undergraduate medical education and to a primary health care setting. This report aims to support other medical schools with training in the primary health care context in the development of EPAs in their curricula.

Data availability

The dataset used and analysed during this study is available from the corresponding author upon reasonable request. The data cannot be publicly shared based on ethical consideration regarding a potential allocation of data to study participants.

Abbreviations

CBME:

competency-based medical education.

CVI:

content validity index.

EPAs:

entrustable professional activities.

FAMEMA:

Faculdade de Medicina de Marília (Marilia Medical School).

FAPESP:

São Paulo Research Foundation.

FHS:

Family Health Strategy.

HP:

Harm Peters.

HPT:

Health Project in the Territory.

HSP:

Health in School Program.

IF:

Ieda Francischetti.

ITP:

Individual Therapeutic Project.

KSA:

knowledge, skills and attitude.

MPP:

Medical Pedagogical Project.

NMCG:

National Medical Curriculum Guidelines.

PBL:

Problem-based Learning.

UME:

undergraduate medical education.

UPP:

Unit of Professional Practice.

USA:

United States of America.

YH:

Ylva Holzhausen.

References

  1. Ten Cate O, Chen HC, Hoff RG, Peters H, Bok H, van der Schaaf M. Curriculum development for the workplace using Entrustable Professional Activities (EPAs): AMEE Guide No. 99. Med Teach. 2015;37(11):983–1002. doi:https://doi.org/10.3109/0142159X.2015.1060308.

    Article  Google Scholar 

  2. Holzhausen Y, Maaz A, Renz A, Bosch J, Peters H. Development of Entrustable Professional Activities for entry into residency at the Charité Berlin. GMS J Med Educ. 2019 Feb;36(1):Doc 5. doi: https://doi.org/10.3109/0142159X.2015.1060308.

  3. Gutiérrez-Barreto S, Durán-Pérez VD, Flores-Morones F, Esqueda-Nuñez RI, Sánchez-Mojica CA, Hamui-Sutton A. Importance of context in entrustable professional activities on surgical undergraduate medical education. MedEdPublish. 2018;7(2):1–12. doi:https://doi.org/10.15694/mep.2018.0000109.1.

    Google Scholar 

  4. Ten Cate O, Scheele F. Competency-based postgraduate training: can we bridge the gap between theory and clinical practice? Acad Med. 2007;82(6):542–7. doi:https://doi.org/10.1097/ACM.0b013e31805559c7.

    Article  Google Scholar 

  5. Chen HC, van den Broek WE, Ten Cate O. The case for use of Entrustable Professional Activities in undergraduate medical education. Acad Med. 2015;90(4):431–6. doi:https://doi.org/10.1097/ACM.0000000000000586.

    Article  Google Scholar 

  6. Association of Faculties of Medicine of Canada. Entrustable Professional Activities for the transition from medical school to residency. Ottawa: AFMC; 2016.

    Google Scholar 

  7. Obeso V, Brown D, Aiyer M, Barron B, Bull J, Carter T, et al. Toolkits for the 13 core Entrustable Professional Activities for entering residency. Washington (DC): Association of American Medical Colleges; 2017.

    Google Scholar 

  8. Englander R, Flynn T, Call S, Carraccio C, Cleary L, Fulton TB, et al. Toward defining the foundation of the MD degree: core Entrustable Professional Activities for entering residency. Acad Med. 2016 Oct;91(10):1352–8. doi:https://doi.org/10.1097/ACM.0000000000001204.

    Article  Google Scholar 

  9. Favreau MA, Tewksbury L, Lupi C, Cutrer WB, Jokela JA, Yarris LM, et al. Constructing a shared mental model for faculty development for the core entrustable professional activities for entering residency. Acad Med. 2017 Jun;92(6):759–64. doi:https://doi.org/10.1097/ACM.0000000000001511.

    Article  Google Scholar 

  10. Lomis K, Amiel JM, Ryan MS, Esposito K, Green M, Stagnaro-Green A, et al. Implementing an entrustable professional activities framework in undergraduate medical education: early lessons from the AAMC Core Entrustable Professional Activities for Entering Residency Pilot. Acad Med. 2017;92(6):765–70. doi:https://doi.org/10.1097/ACM.0000000000001543.

    Article  Google Scholar 

  11. Touchie C, Boucher A, Allen T, Bhanji F, Chan M-K, Clarizia N, et al. AFMC Entrustable Professional Activities for the Transition from Medical School to Residency. Ottawa: Association of Faculties of Medicine of Canada; 2016.

    Google Scholar 

  12. Michaud PA, Jucker-Kupper P, The Profiles Working Group. The “Profiles” document: a modern revision of the objectives of undergraduate medical studies in Switzerland. Swiss Med Wkly. 2016;146:w14270. doi:https://doi.org/10.4414/smw.2016.14270.

    Google Scholar 

  13. Rosengren B, Möller R, Hellman J, Jood K, Ekstedt M, Särnbland S, et al. [EPA (Entrustable Professional Activities): an international approach to define key tasks that a doctor should be able to perform]. Lakartidningen. 2019 May;116. Swedish.

  14. Royal Australian and New Zealand College of Psychiatrists. 2012 Fellowship Program: EPA Handbook. Melbourne: RANZCP; 2012. https://www.ranzcp.org/epahandbook.aspx. Accessed 31 Jan 2021.

  15. Kishore J. Identifying competencies in community medicine: an explorative study in a medical college in Delhi. Int J Health Care Educ Med Inform. 2016;3(2):4–10.

    Google Scholar 

  16. Raghav R, Kumar D, Bhardwaj P. Determining competencies for the development of curriculum of Community Medicine and Family Medicine for undergraduate medical students. J Contemp Med Educ. 2016;4(2):54–9. doi:https://doi.org/10.5455/jcme.20160324024006.

    Article  Google Scholar 

  17. World Health Organization. The world health report 2008: primary health care: now more than ever. Geneva: WHO; 2008.

    Google Scholar 

  18. World Health Organization. Primary health care: closing the gap between public health and primary care through integration. Geneva: WHO; 2018.

    Google Scholar 

  19. Frank JR, Snell LS, Ten Cate O, Holmboe ES, Carraccio C, Swing SR, et al. Competency-based Medical Education: theory to practice. Med Teach. 2010;32(8):638–45. doi:https://doi.org/10.3109/0142159X.2010.501190.

    Article  Google Scholar 

  20. Francischetti I, Holzhausen Y, Peters H. The time has come for Brazil: translating Competence Based Medical Education into practice by Entrustable Professional Activities (EPAs). Interface (Botucatu). 2020;24:e190455. doi:https://doi.org/10.1590/interface.190455.

    Article  Google Scholar 

  21. Ten Cate O. Entrustability of professional activities and competency-based training. Med Educ. 2005 Dec;39(12):1176–7. doi:https://doi.org/10.1111/j.1365-2929.2005.02341.x.

    Article  Google Scholar 

  22. Ten Cate O. A primer on entrustable professional activities. Korean J Med Educ. 2018 Mar;30(1):1–10. doi:https://doi.org/10.3946/kjme.2018.76.

    Article  Google Scholar 

  23. Ten Cate O. Nuts and bolts of Entrustable Professional Activities. J Grad Med Educ. 2013 Mar;5(1):157–8. doi:https://doi.org/10.4300/JGME-D-12-00380.1.

    Article  Google Scholar 

  24. O’Dowd E, Lydon S, O’Connor P, Madden C, Byrne D. A systematic review of 7 years of research on entrustable professional activities in graduate medical education, 2011–2018. Med Educ. 2019;53(3):234–49. doi:https://doi.org/10.1111/medu.13792.

    Article  Google Scholar 

  25. Meyer EG, Chen HC, Uijtdehaage S, Durning SJ, Maggio LA. Scoping Review of Entrustable Professional Activities in Undergraduate Medical Education. Acad Med. 2019 Jul;94(7):1040–9. doi:https://doi.org/10.1097/ACM.0000000000002735.

    Article  Google Scholar 

  26. Frank JR, Snell L, Sherbino J, editors. CanMEDS 2015 Physician Competency Framework. Ottawa: Royal College of Physicians and Surgeons of Canada; 2015.

    Google Scholar 

  27. Ten Cate O, Graafmans L, Posthumus I, Welink L, van Dijk M. The EPA-based Utrecht undergraduate clinical curriculum: development and implementation. Med Teach. 2018 May;40(5):506–13. doi:https://doi.org/10.1080/0142159X.2018.1435856.

    Article  Google Scholar 

  28. Chen HC, McNamara M, Teherani A, Ten Cate O, O’Sullivan P. Developing Entrustable Professional Activities for entry into clerkship. Acad Med. 2016 Feb;91(2):247–55. doi:https://doi.org/10.1097/ACM.0000000000000988.

    Article  Google Scholar 

  29. Berberat PO, Rotthoff T, Baerwald C, Ehrhardt M, Huenges B, Johannink J, et al. Entrustable Professional Activities in final year undergraduate medical training: advancement of the final year training logbook in Germany. GMS J Med Educ. 2019 Nov;36(6):Doc70. doi:https://doi.org/10.3205/zma001278.

    Google Scholar 

  30. World Health Organization. Health 21: the health for all policy framework for the WHO European Region. Copenhagen: WHO; 1999. (European Health for All Series; 6).

    Google Scholar 

  31. Donev D, Kovacic L, Laaser U. The role and organization of Health Care Systems. In: Burazeri G, Zaletel-Kragelj L, editors. Health: systems, lifestyles, policies. 2nd ed. Lage: Jacobs Verlag; 2013. pp. 3–14.

    Google Scholar 

  32. Chaturverdi SK. Importance of community medicine. Sunnyvale: LinkedIn; 2015. https://www.linkedin.com/pulse/importance-community-medicine-dr-shyam-k-chaturvedi. Accessed 21 Feb 2021.

  33. Muller D, Meah Y, Griffith J, Palermo AG, Kaufman A, Smith KL, Lieberman S. The role of social and community service in medical education: the next 100 years. Acad Med. 2010 Feb;85(2):302–9. doi:https://doi.org/10.1097/ACM.0b013e3181c88434.

    Article  Google Scholar 

  34. Jones R, Higgs R, de Angelis C, Prideaux D. Changing face of medical curricula. Lancet. 2001 Mar;357(9257):699–703. doi:https://doi.org/10.1016/S0140-6736(00)04134-9.

    Article  Google Scholar 

  35. World Health Organization. Primary Health Care. Geneva: WHO; 2019. https://www.who.int/news-room/fact-sheets/detail/primary-health-care. Accessed 21 Feb 2021.

  36. Association of Faculties of Medicine of Canada. Social accountability: a vision for Canadian Medical Schools. Ottawa: AFMC; 2002.

    Google Scholar 

  37. Seyednozadi SM, Shahraki M, Moghaddam MD. The scope of community medicine. RazaviInt J Med. 2018;6(2):e55620. doi:https://doi.org/10.5812/rijm.55620.

    Google Scholar 

  38. Gopalakrishnan S, Kumar G. Community Medicine Teaching and Evaluation: scope of betterment. J Clin Diagn Res. 2015;9(1):JE01–05. doi:https://doi.org/10.7860/JCDR/2015/9873.5362.

    Google Scholar 

  39. World Health Organization. Regional Office for South-East Asia. Teaching of public health in medical schools: report of the Regional Meeting Bangkok, Thailand. New Delhi: WHO; 2009. pp. 8–10.

    Google Scholar 

  40. World Health Organization. Regional Office for South-East Asia. Guidelines for preventive and social medicine/ community medicine/ community health curriculum in the undergraduate medical education. New Delhi: WHO; 2010.

    Google Scholar 

  41. Silva RF, Sá-Chaves I. Reflective training: teachers’ representations regarding the use of a reflective portfolio for physician and nurse training. Interface (Botucatu). 2008;4(se).

  42. Ricardo MP, Marin MJ, Otani MA, Marin MS. Medical student in the family health strategy on the first years of college: perception of graduates. Rev Esc Enferm USP. 2014;48(spe2):178–83. doi:https://doi.org/10.1590/S0080-623420140000800026.

    Article  Google Scholar 

  43. Nonato AC, Kobashikawa KT, Pio DA, Vernasque JR. Apprehension and understanding of the Health Needs concept for students of an active curriculum. RevBrasEduc Méd. 2020;44(2):e070. doi:https://doi.org/10.1590/1981-5271v44.2-20190106.ING.

    Google Scholar 

  44. Lynn MR. Determination and quantification of content validity. Nurs Res. 1986;35(6):382–5.

    Article  Google Scholar 

  45. Alexandre NM, Coluci MZ. Validade de conteúdo nos processos de construção e adaptação de instrumentos de medidas. CiêncSaúdeColetiva. 2011 Jul;16(7):3061–8. doi:https://doi.org/10.1590/S1413-81232011000800006.

  46. Scarparo AF, Laus AM, Azevedo AL, Freitas MR, Gabriel CS, Chaves LD. Reflections on the use of Delphi Technique in research in nursing. Rev Rene. 2012;13(1):242–51.

    Google Scholar 

  47. Faculdade de Medicina de Marília. Projeto pedagógico do curso de medicina. Marília (SP): Famema; 2014. http://www.famema.br/ensino/cursos/docs/PPC%20Medicina.pdf. Accessed 21 Feb 2021.

  48. Santos RA, Nunes MP. Medical education in Brazil. Med Teach. 2019;41(10):1106–11. doi:https://doi.org/10.1080/0142159X.2019.1636955.

    Article  Google Scholar 

  49. Brasil. Ministério da Educação. Resolução CNE/CES nº 3 de junho de 2014. Institui Diretrizes Curriculares Nacionais do Curso de Graduação em Medicina e dá outras providências. DiárioOficial da União, Brasília (DF); 23 jun 2014; Seção 1:8–11.

  50. Faculdade de Medicina de Marília. O currículo da Famema. Marília (SP): Famema; 2012. http://www.famema.br/ensino/cursos/docs/Texto_Curriculo_Medicina_2012.pdf. Accessed 1 Mar 2022.

  51. Faculdade de Medicina de Marília. Unidade Educacional 1: Unidade de Prática Profissional e Unidade Educacional Sistematizada: 1ª série de Medicina e Enfermagem. Marília (SP): Famema; 2019. http://www.famema.br/ensino/cursos/docs/Caderno%20da%201%c2%aa%20s%c3%a9rie%20de%20Medicina%20e%20Enfermagem.pdf. Accessed 1 Mar 2022.

  52. Faculdade de Medicina de Marília. Necessidades de Saúde 2 e Prática Profissional 2: 2ª série dos cursos de Medicina e Enfermagem. Marília (SP): Famema; 2019. http://www.famema.br/ensino/cursos/docs/Caderno%20da%202%c2%aa%20s%c3%a9rie%20de%20Medicina%20e%20Enfermagem.pdf. Accessed 1 Mar 2022.

  53. Faculdade de Medicina de Marília. Necessidades de Saúde 3 e Prática Profissional 3: 3ª série do curso de Medicina. Marília (SP): Famema; 2019. http://www.famema.br/ensino/cursos/docs/Caderno%20da%203%c2%aa%20s%c3%a9rie%20de%20Medicina.pdf. Accessed 1 Mar 2022.

  54. Faculdade de Medicina de Marília. Atenção às necessidades de saúde do indivíduo, família e comunidade, no modelo de vigilância à saúde e Unidade Prática Profissional 4: 4ª série de Medicina. Marília (SP): Famema; 2019. http://www.famema.br/ensino/cursos/docs/Caderno%20da%204%c2%aa%20s%c3%a9rie%20de%20Medicina.pdf. Accessed 1 Mar 2022.

  55. Faculdade de Medicina de Marília. Estágio Integrado, Saúde do Adulto I e Saúde Materno Infantil: 5ª série de Medicina. Marília (SP): Famema; 2019. http://www.famema.br/ensino/cursos/docs/Caderno%20da%205%c2%aa%20s%c3%a9rie%20de%20Medicina.pdf. Accessed 1 Mar 2022.

  56. Faculdade de Medicina de Marília. Estágio Integrado, Saúde do Adulto II e Saúde Materno Infantil II: 6ª série de Medicina. Marília (SP): Famema; 2019. http://www.famema.br/ensino/cursos/docs/Caderno%20da%206%c2%aa%20s%c3%a9rie%20de%20Medicina.pdf. Accessed 1 Mar 2022.

  57. Brasil. Ministério da Saúde. Lei nº 8080 de 19 de setembro de 1990. Dispõe sobre as condições para a promoção, proteção e recuperação da saúde, a organização e o funcionamento dos serviços correspondentes e dá outras providências. DiárioOficial da União, Brasília (DF); 20 set 1990; Seção 1:18068.

  58. Brasil. Ministério da Saúde. HumanizaSUS: documento base para gestores e trabalhadores do SUS. 4a ed. Brasília (DF): Ministério da Saúde; 2008.

  59. Brasil. Ministério da Saúde. Portaria nº 2.436, de 21 de setembro de 2017. Aprova a Política Nacional de Atenção Básica, estabelecendo a revisão de diretrizes para a organização da Atenção Básica, no âmbito do Sistema Único de Saúde (SUS). DiárioOficial da União, Brasília (DF); 22 set 2017; Seção 1:68.

  60. Health Sciences Descriptors. DeCS [Internet]. Integrality in health. São Paulo (SP): BIREME; 2021 [cited 2022 Abr 6]. Available from: https://decs.bvsalud.org/en/ths/resource/?id=55475&filter=ths_termall&q=integrality.

  61. Francischetti I, Moreno JB, Holzhausen Y, Peters H. Entrustable Professional Activities for Community Medicine: integrating medical undergraduate courses and Primary Health Care. Creat Educ. 2020 Feb;11(2):86–104. doi:https://doi.org/10.4236/ce.2020.112007.

    Article  Google Scholar 

Download references

Funding

The study was funded by grant 2018/26011-2, São Paulo Research Foundation (FAPESP).

Researcher IF was financed by this fund. The funding body had no influence on the study design, data collection, analysis, or interpretation, or the preparation of the manuscript.

Open Access funding enabled and organized by Projekt DEAL.

Author information

Authors and Affiliations

  1. Dieter Scheffner Center for Medical Education and Educational Research Charité - Universitätsmedizin Berlin, Dean?s Office of Study Affairs, Campus Charité Mitte, Charitéplatz 1, 10117, Berlin, Germany

    Ieda Francischetti, Ylva Holzhausen & Harm Peters

  2. Marília Medical School (Faculdade de Medicina de Marília - FAMEMA), Marília, São Paulo, Brazil

    Ieda Francischetti

Authors
  1. Ieda Francischetti
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ylva Holzhausen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Harm Peters
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Harm Peters.

Ethics declarations

Ethical approvaland consent to participate

All methods were carried out in accordance with relevant guidelines and regulations. In particular, the data acquisition procedure was approved by the Brazilian Ethics and Research Commission, 3.571.405; National Health Commission 466/2012; Operating Number 001/2013. All Delphi study panellists provided written informed consent to participate.

Consent for publication

No details, images, or videos relating to an individual person are published in this paper.

Competing interests

Author HP is the associate editor of BMC Medical Education. The other authors have no competing interest to declare.

Acknowledgements

The authors want to thank the participants in the Delphi study from Marilia Medical School (FAMEMA), Marília, Brazil.

Authors’ contributions

IF, YH and HP were responsible for the conception and design of the study and questionnaire, data interpretation, and the drafting and revision of the manuscript. IF was responsible for data acquisition and contributed substantially to drafting and revising the manuscript. All authors read and approved the final manuscript.

Notes on contributors

Ieda Francischetti, MD, M.Sc., PhD in Experimental Surgery, is a postdoctoral medical education researcher at the Dieter Scheffner Center for Medical Education, Charité - Universitätsmedizin Berlin, Chief of Staff on Marilia Medical School (FAMEMA), Marília, Brazil. Ylva Holzhausen M.Sc., PhD in Psychology, is a postdoctoral medical education researcher and the team lead of the division educational research at the Dieter Scheffner Center for Medical Education, Dean’s Office of Study Affairs, Charité - Universitätsmedizin Berlin, Germany. Harm Peters, MD, MHPE, is a Professor of Medical Education and Director of the Dieter Scheffner Center for Medical Education, Dean’s Office of Study Affairs, Charité - Universitätsmedizin Berlin, Germany

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary Material 1

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Francischetti, I., Holzhausen, Y. & Peters, H. Entrustable professional activities for Junior Brazilian Medical Students in community medicine. BMC Med Educ 22, 737 (2022). https://doi.org/10.1186/s12909-022-03762-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12909-022-03762-4

Keywords

BMC Medical Education

ISSN: 1472-6920

Contact us