- Research article
- Open Access
Intrinsic roles in the crosshair – strategic analysis of multi-site role implementation with an adapted matrix map approach
BMC Medical Education volume 19, Article number: 237 (2019)
The implementation of competency-based intrinsic roles in undergraduate medical education remains a challenge. Faculties in transition need to be provided with generalizable curricular data in order to facilitate orientation on curricular roles’ representation and to decide on steps of curriculum development. Explicit and implicit representation of objectives and multi-site agreement can be viewed as status indicators for the adoption of roles. Our aim was to develop a pragmatic cross-locational approach to capture roles’ developmental status in an overview and prioritize strategic recommendations.
Based on the mapping data from six German medical faculties, the relationship between explicit and implicit curricular representation of role’ objectives (weighting) and extent of programs’ consent (agreement) was calculated. Data was visualized in a role-specific Matrix Map to analyse roles’ implicit-explicit relation and risk-value potential. The matrix was combined with Roger’s stages of innovation diffusion for differentiated interpretation of the developmental role status.
Entangling multi-site agreement and curricular weighting, the 4-Field-Matrix allows to assess objectives based on their current localization in a quadrant: “Disregard” (lower left) and “Progress” quadrant (upper left) reveal the diffusion period; “Potential” (lower right) and “Emphasis” quadrant (upper right) indicate the adoption period. The role patterns differ in curricular representation, progression and clarity: (1) Scholar: explicit/implicit - scattered across the matrix; most explicit objectives in “Progress”. (2) Health Advocate: explicit – primarily in “Emphasis”; only role in which the explicit representation significantly exceeds the implicit. (3) Collaborator: explicit - mainly “Potential”; implicit - “Progress” or “Emphasis”. (4) Professional: explicit – primarily “Potential” but also “Emphasis”; implicit - “Progress” and “Emphasis”; appears better adopted but scattered in weighting; high hidden curricula. (5) Manager: explicit and implicit - exclusively in “Potential”, without signs of development. Role patterns correspond to evidences from literature. Exemplified with roles, quadrant-specific strategies and measures are suggested. Framework reviewers may gain information for discussion of critical content.
The Matrix Map enables to catch intuitively the status of intrinsic roles’ profiles regarding role pattern, implicit-explicit relation and programs agreement. Thus, interpretation and informed discussions are fostered. Further target-oriented analyses and strategic developments can be conducted to enhance transparency and resource-efficiency.
Worldwide, national frameworks for competency-based medical education (CBME) elaborate the concept of professional roles of the medical doctor as overarching structure, to foster scientifically grounded holistic patientcare. The role concept clarifies the diverse facets of typical medical tasks. Thus, it must be explicitly defined as an integral component in combination with medical content and context. The Medical Expert as the central and integrative role overlaps with competencies that are also described in the six peripheral, so-called “intrinsic roles” : Communicator, Collaborator, Manager, Professional, Health Advocate, and Scholar [1,2,3,4]. The professional role concept is internationally widely accepted by medical teachers who rated its relevance in practice high [5,6,7]. However, even decades after implementation, medical faculties are still challenged to adequately establish these intrinsic roles with explicit transparency in curricula and teaching practice [8, 9]. International studies indicate considerable discrepancies between official well-elaborated frameworks, framework perception and sobering curricular practice from perspectives of teachers, supervisors and students [5, 7, 10,11,12,13,14,15].
This situation gives serious concern to quality management of programs for several reasons: First, intrinsic role transparency has a direct impact on program success. Effective teaching and sustainable learning require clear labelling and explicit integration of appropriate competencies in core medical training to enhance commitment, predictability and common understanding for assessment [16,17,18,19,20]. Second, outside the explicit curriculum, effective learning also takes place in the hidden curriculum (often called informal or implicit). This implicit learning is individual, variable, often unplanned in learning opportunities whenever they may arise in clinical or non-clinical settings [18, 21,22,23]. It has proven relevant too and is most likely supportive, as far as is convergent to the explicit curriculum [18, 22], but it is beyond curricular control. The above findings support a strong demand for greater critical awareness towards the explicit and implicit curricula indicating the status of the roles’ adoption [18, 23]. Cross-locational data promises to provide curriculum developers and quality managers with guidance on the general curricular dissemination of role content and the extent of faculty agreement.
In Germany, a cross-site approach for monitoring curricular development was designed using the example of intrinsic roles. Germany is in an early stage of transforming undergraduate medical education (UME) to CBME. In 2015, the deans of all German medical faculties officially adopted the National Competency-based Learning Objectives for Undergraduate Medical Education (NKLM) in its first version, consenting to review the catalogue until 2020 [24, 25]. Thus, the German situation may serve as an example of how to monitor framework implementation. Faculties in transition need to be continuously provided with (self-) evaluative curricular data . Curriculum mapping promises transparency  but produces large amounts of data with increased complexity. Additional concepts are helpful to strike the best balance between the demands for pragmatism in analyses as well as for adequate accuracy in fine-tuning curricular requirements. Meaningful, generalizable data may facilitate interpretation of curricular roles’ presentation and prioritizing decisions on curriculum development.
In the present study comprehensive mapping data from six faculties were included. Two approaches derived from economics, business administration and social sciences were applied to provide a basis for systematic visualization and interpretation of roles’ curricular depiction: a Matrix Map Method [27,28,29] combined with Rogers’ theoretic model of innovation diffusion . As a qualitative visual tool, an adapted 4-Field-Matrix can display complex relations in a simplified overview. In this Matrix Map the explicit and implicit curricular weighting of the intrinsic roles and the extent of programs’ agreement can be interlaced in a single, compelling image. Thus, the 4-Field-Matrix promises a helpful starting point but provides only a relatively rough picture. Adding the ideas of Rogers theory offers the chance to get more differentiated information from the curricular snapshot displayed in the maps, e.g. regarding phases of progressing role integration. By combining both approaches, the status of role adoption can be diagnosed. On this basis, potentials for future curricular development and strategic decisions can be derived. Furthermore, NKLM reviewers might gain insight in critical parts of catalogue content.Keeping these considerations in mind, the following guiding questions are addressed: How do the implicit and explicit role patterns characterize the status of curricular integration of intrinsic roles? What strategies can be derived from these patterns for curriculum development and catalogue review?
To examine the curricular status quo of the intrinsic roles in a multi-site approach, six German medical faculties (Tuebingen, Freiburg, Ulm, Hannover, Bonn, and Magdeburg) participated in a joint NKLM mapping project [31, 32]. Led by the Competence Centre of University Teaching in Medicine Baden-Wuerttemberg in Tuebingen (CCMD), the mapping was conducted from summer 2016 to spring 2018. The faculties are characterized by structural, organizational and educational differences within the scope of governmental regulations guaranteeing minimum standards for UME. The programs’ general curricular status reveals a huge range of quantity of mandatory courses (98–177 courses per program) due to the heterogeneous granularity of organizational structure (teaching units). The developmental process for NKLM implementation didn’t start from scratch, because most faculties had already integrated special trainings for some competencies beforehand (e.g. communication, scientific-medical skills). In the present study courses covering five years compulsory programs of UME were mapped and analysed. On basis of previous project experiences, mapping of at least 80% of courses was considered as sufficient to ensure a reliable dataset for adequate characterization of intrinsic role patterns. So far, four programs achieved 95–100%.
To ensure standardized data formats and consistent data management, all institutions used the web-based MERlin mapping database as common mapping tool with protected proprietary data spaces. They also applied comparable consented procedures, as described in detail earlier [33, 34]. A short summary is given below. Courses were mapped against the given German competency-based framework NKLM  by selecting pre-set menu options . The present analysis focused exclusively on the mapping data related to the intrinsic roles’ chapters (Chap.): Scholar (Chap. 6), Collaborator (Chap. 8), Health Advocate (Chap. 9), Manager (Chap. 10), and Professional (Chap. 11). The Communicator (Chap. 7) was excluded because of its reduced descriptive granularity, with the role being described only on competency level in the current version of the catalogue and its objectives relocated to other chapters. The following criteria were relevant for this study: (1) Objectives coverage: learning objectives being ticked off in case they were taught; (2) Transparency of teaching: characterized either by the term “explicit” (written in a study-guide, module manual or other course material), or “implicit” (implied, but not documented in writing). The term “mapping citation” referred to any objective taught in a course and ticked off by the mapper. Teaching an objective on one or more occasions in a course corresponded to one citation. For each site-specific program, the following quantitative data were collected from the database: total number of curricular courses and of general role citations, number of explicit and implicit citations for every role and number of related courses.
Data quality control
In support of content validity, the mapping was conducted by 47–80 faculty members per program: individuals from each discipline or department, mostly preceptors with content-related expertise of courses or coordinating and/or supervising medical teachers with educational background. To harmonize the mapping process and data quality, curriculum mappers and local supervisors were trained and consulted by the CCMD individually and continuously. Plausibility controls of mapping data were carried out two-fold, by dean’s office and by responsible senior teachers coordinating departmental teaching. Consistency checks were done by the global administrator from CCMD.
Data processing and visualization
To create a role-specific Matrix Map for illustrating the general curricular status of every intrinsic role, two criterions were selected: first, curricular weighting of the objectives, second, degree of multi-site agreement. The criterions were chosen because of their key relevance for curriculum description and availability of pre-existing usable multi-site mapping data. The process of calculation is described below.
Relative weighting of an objective
For intra- and inter-role comparison, the diversity of program sizes (number of courses) and the NKLM role chapter sizes (number of objectives, see legends of Fig. 2.1–5) were considered. To facilitate inter-role comparability of learning objectives, percentage shares of courses and program’s mapping citations were calculated. The percentage of citations expresses the curricular weighting of an objective, assuming that the more courses display a specific objective, the higher its curricular emphasis. To gain a general picture of curricular role representation, the mean weighting value was calculated for each of the objectives over the six programs. For roughly pointing out high or low weightings, a “general mean” was generated as an inter-role reference line. Multiplication of the above-mentioned average values by the total number of all roles’ objectives resulted in a common mean of 100 for all roles, thus facilitating easy inter-role comparison.
Extent of agreement between programs
To investigate the programs’ agreement, the percent agreement between the weighting values for each objective over the six programs was calculated on base of their average distance to each other. Each resulting value was subtracted from a reference scale with 100 representing full agreement: the lower the average distance between programs’ weightings, the higher the agreement. An inter-role reference line was set at 50 on this scale. Weightings and agreements were determined in the same way for both, the explicit and implicit mapping data.
Qualitative matrix map
To visualize the relationship between the roles’ curricular weighting and the extent of agreement, a 4-Field-Matrix was generated for each role, enabling a systematic analysis of value and risk potentials . Supporting intuitive interpretation, the agreement values were applied to the x-axis and the weighting values to the y-axis. To rank the objectives of a role roughly, ordinal scales in ranges of “high” and “low” were used with the above-mentioned general reference lines as mid marking (midlines). The matrix position of an objective in one of the four quadrants was determined by its coordinates of weighting and agreement. Every objective is documented as a circle and can be identified individually. All role-specific average values of objectives were plotted into the matrix, resulting in two scatterplots (point clouds) per role, one with explicit (filled circle) and one with implicit values (empty circle).
Since this study was focused on transparency patterns of the intrinsic roles in general rather than on details, decisions were made for the benefit of clarity: (1) the very few weightings outpacing the general mean more than twofold, were placed at the top end of the scale not to lose sight of the whole picture; (2) objectives of each intrinsic role were not labelled in the matrices, although they can be identified individually. Only few selected anchor examples were accentuated to visualize the matrix positions of explicit and implicit values of an objective indicating their relation to each other. The criteria used to pick the examples were: role-typical feature, significant differences between explicitness and implicitness if applicable, relevant content, contribution to complete coverage of all quadrants. Their NKLM chapter code numbers and short titles are given to catch the meaning (cp. Table 1).
To facilitate data interpretation in the context of change, the quadrants of the matrix were labelled after an extensive literature research of characteristics and application areas of Matrix Map Methods [27,28,29] and Rogers’ Model of Diffusion . Following Rogers model, further reference lines were integrated from left to right in the matrix to indicate the four normally distributed main stages and adopter categories: (1) Knowledge-building and Persuasion (Innovators and Early Adopters 16%), (2) Decision (Early Majority 34%,) (3) Implementation (Late Majority 34%) and (4) Confirmation (Late Adopters 16%) (cp. Fig. 1). For each quadrant, optional strategic actions were weighed with reference to literature, based on exemplary objectives aiming at lead strategies and measures (cp. Table 3). Quadrant labels and strategic choices were discussed in the project group and adapted to the given situation of framework implementation.
All statistical calculations were conducted using the standard softwareSPSS, Version 25, and Excel, Microsoft Office Version 2010.To test for intra-role differences between explicit and implicit curricular representation, the Related-Samples Wilcoxon Signed Rank Test was used.
For better clarity and comprehensibility, the results are presented in two steps: first, the concept of the adapted Matrix Map Model is explained with its informative value; second, the specific patterns of the intrinsic roles displayed in the given grid are described. Analyses of map characteristics reveal the current role status, which imply different strategic recommendations.
Matrix map model
The 4-Field-Matrix was constructed based on the multi-site mapping data of the intrinsic roles. As result of the methodical discussions, two key dimensions were linked together to form a model: first, curricular weighting of role’s objectives, indicating the amount of representation in courses; and second, extent of programs’ agreement, both ranging from low to high (Fig. 1). According to Rogers (1995) , the left side of the matrix was defined as diffusion period covering the stages from knowledge-building to decision. The midline symbolizes some sort of shakeout of learning objectives between diffusion and adoption. From that point onward a clearly recognizable program consent is achieved. The right side was related to the adoption period including implementation and confirmation until even late adopters participate (maturity and saturation).
The amount of curricular weighting expresses the degree of value given to specific objectives, assuming the higher the course addressing a learning objective the higher its appreciation. The corresponding midline is formed by the average weighting of objectives across all roles (general mean). Given that orienting coordinate cross, the field is divided in four quadrants, as listed in an arc from lower left to lower right: Disregard, Progress, Emphasis and Potential.
The Disregard quadrant (lower left) contains objectives with apparently lower curricular appreciation but also with less consistency between the programs. Here lies content that isn’t paid much attention to until now. This may be because it is newly developed, experimented with or introduced at some sites in small scale. Simultaneously there is content located, that is disregarded for being unworthy of being depicted in UME. For objectives in that quadrant, it is highly uncertain if they will persist, develop, or perish, depending on the number of programs adopting them in future.
The Progress quadrant (upper left) is characterized by objectives showing high curricular presence, but only in some programs representing great diversity of site-specific local views. Thus, there is already high value and attention given to these objectives. Objectives in that field are obviously on the move, but the extent of consolidation appears yet to be undecided.
The prospects are high that these objectives are strengthened by further diffusion. It will be decisive to achieve a critical mass and cross the tipping point (chasm) between persuasion and decision stage in order to reach an early majority and enable larger adoption. Nevertheless, there is a possibility for innovative programs that their example is not followed by the majority; thus, it is an option to build up local profiles as standalone solutions or to give up that position.
Objectives located in the Emphasis quadrant (upper right) are characterized by high curricular weighting and adopted by the majority of programs. This maturity level indicates that this content can be classified as well anchored in UME (implementation stage) until saturation is reached (confirmation stage). Although there is a possibility of over-estimation in weighting, these objectives can be considered as set and are not a matter of priority in curriculum development.
The Potential quadrant (lower right) is characterized by lower curricular weighting but high agreement between sites. Objectives in that quadrant appear to be settled as well, however to limited extent of representation. The localization may have different reasons: objectives may be in the right place, because they are of minor importance or only few courses are necessary to reach the intended outcome, being refined in postgraduate medical education (PME); objectives may also be underestimated by many, because the change in demand was not realized (blind spot), consciously ignored in its importance or acknowledged but not reacted on yet. Similar as in the Disregard field, there is a chance that content located here is misplaced in UME (e.g. handed on for traditional reasons).
Display of role patterns
In the following, the patterns of the roles in the matrix will be described, referring to key aspects of overall positioning, shape, concentration and the relationship between explicit and implicit parts (Fig. 2.1–5). Thereby specific role characteristics are carved out, exemplified by selected representative objectives (anchor examples; cp. Table 1). The varying amounts of learning objectives in the roles were considered but turned out to be neglectable.
Without differing between explicit and implicit, in an overall assessment of scatterplots, most intrinsic roles revealed a quite similar spatial orientation, being condensed primarily in the Progress and Potential quadrants with mainly one-sided low numbers. In case objectives are positioned in the Emphasis or Disregard quadrants, they mostly appear close to the adjacent quadrants.
Regarding the implicit-explicit relation the roles exhibit a more differentiated picture. The general analysis of the intrinsic roles revealed a tendency of implicit citations being higher than the explicit ones, but no significant differences were detected, except for two roles: The Collaborator displays higher implicit than explicit mapping data (z = − 3.657; p < .001), whereas the Health Advocate reveals higher explicit than implicit citations (z = 3.724; p < .001). In this approach the first focus is set on explicit depiction, with the implicit depiction serving as a supportive element for the estimation of factual but potentially hidden values of objectives.
The Scholar’s explicit objectives are broadly scattered across the whole matrix (Fig. 2.1), being clearly the role with the most objectives concentrating in the Progress quadrant. This shows that greater parts of the Scholar role, especially regarding the scientific competencies have started evolving visibly in an increasing number of programs (Fig. 2, Table 1).
Only in that role, some objectives are found in the Progress quadrant in a phase of early diffusion indicating rising attention (knowledge-building and persuasion). This is the case for aspects of lifelong learning. Explicit objectives being in the decisive stage are represented stronger than in any other role. In the adoption period, the number of Scholar’s implicit objectives are predominant compared to the explicit ones, showing higher agreement on implicit parts between sites. This concerns above all elements of teaching positioned explicitly in the Disregard and implicitly in the Potential quadrant. Overall, greater parts of the implicit curriculum reach equally high expression as the explicit with respect to curricular weighting.
In contrast to the Scholar, the Collaborator and the Health Advocate shows more explicit representation of objectives in the adoption period, revealing a higher level of maturity (Fig. 2.2, 2.3). The difference between the role depiction of Health Advocate and Collaborator lies in the extent of explicit curricular weighting opposite to the implicit counterpart showing an inverse relation: The objectives of the Health Advocate are obviously met with high explicit weighting by the majority of programs, still displaying signs of transition (early and late majority). Nevertheless, a greater part of explicit objectives was positioned in the Emphasis quadrant, e.g. regarding sub-competencies (SC) of prevention and individual health care (SC-9.1.1.). The explicit curriculum exceeds the implicit in every aspect. Unlike for the Health Advocate, the Collaborator’s explicit objectives appears clearly lower in weighting, being positioned mainly in the Potential quadrant. This indicates that a larger majority of programs already agreed upon this dimension of curricular representation (e.g. SC-8.2.3: Recognize interprofessional conflicts and actively contribute to solutions). However, in this role, the implicit curriculum exceeds the explicit clearly, reaching up to Progress or Emphasis quadrant. This finding reveals the existence of high but also informal and inapparent esteem for the Collaborator (risk of hidden curriculum).
The Manager role is cumulated exclusively in the Potential quadrant concerning both the explicit and implicit pattern (Fig. 2.4). The Manager is the only role to exhibit very low explicit curricular weightings for a larger set of objectives. Most of the programs obviously share a common view on the current value of the Manager. The role is in a stage of consented curricular implementation indicating a certain level of saturation. Some of its objectives possibly range on the brink to decline. There are currently no distinct signs of development visible.
Visualizing the described intrinsic roles spectrum, the Professional role shows an in-between status (Fig. 2.5). As whole, its explicit curriculum appears to be well-adopted in most programs, with the majority of content at the stage of maturity. However, the explicit objectives are settled primarily on lower level in the Potential quadrant with single high-weighted clusters in the Emphasis and the Progress quadrant. The implicit objectives are dominating in those upper quadrants with higher curricular weighting, e.g. for aspects of self-reflection and self-development (SC-11.3.2). This considerable excess of implicitness in the Progress and Emphasis quadrant signals a high degree of perceived relevance but also of non-transparency.
Originally medical roles were developed with the aim of “explicitly re-framing traditional implicit understandings of physician competence” . But the integration of intrinsic roles into educational reality proved to be problematic. Our multi-site study in German contexts shows that it would be worth to deliberately and cooperatively evaluate the implementation of intrinsic roles from the beginning . In the phase of implementing changed national recommendations, quick and reliable orientation in the field is especially relevant for curriculum planners and framework reviewers alike. Coming to informed decisions that fit the graduate profile, is obviously not a self-running process in role implementation. The relevance of our flexible approach becomes even more obvious, when considering the provisional and theoretical character of frameworks that continuously needs refinement .
Application of the matrix map model in role implementation
Matrix Maps are widely used in economics in different appearances, acting as a guiding tool to categorize and initiate strategic measures . Today adjusted, non-prescriptive matrices are required for practitioners to accompany experimentation and planning processes, as well as to accelerate decisions in an unpredictable and dynamic field. Characteristics of appealing matrix maps are in this context: catchy labelling, performance enhancement (e.g. consented weighting), universal applicability and interpretive space (e.g. combination with other tools) [28, 29].
As shown in this study, the approach is adaptable to needs of UME change by considering knowledge and techniques from areas like curriculum development, change and project management (e.g. identifying critical role parts, prioritizing interventions, and planning curricular revisions) [8, 23, 37].The Matrix Map Method provides a simplified but clear overall insight in the current developmental state of roles by entangling two factors relevant in national programs (curricular weighting, programs’ agreement). Advantages and disadvantages are compactly contrasted in Table 2.
By illustrating different stages of role adoption as well as unveiling the relationship between implicit and explicit data, our methodical approach opens new perspectives on the implementation process of roles. More differentiated quadrant-specific interpretations can be derived for curriculum improvement by considering the implications of the stages of innovation diffusion . Tailored to the quadrant characteristics and needs (described in results), a pre-defined lead strategy is assigned to each matrix quadrant specifically, indicating how to generally deal with the role parts located there by applying adequate measures (Table 3). Thus, reducing a multi-faceted matter in complexity, the conclusive pictures support strategic discussions for site-specific curricular orientation and evaluative catalogue review from a holistic perspective. Since objectives may not all be equally relevant for a compulsory core curriculum at undergraduate level, the overall aim requires to achieve a higher explicit agreement between faculties. This applies regardless of high or low curricular representation. All in all, in the German UME contexts, the steps (analysis, appraisal, strategic decision) are comparable to the original field of application in economics.
Strategic implications of explicit role patterns
In the following, the proposed strategies and measures are discussed based on the analysis of the role patterns. The focus is on the roles’ explicit localization in quadrants. By using a typical role as an example from practice, the characteristic strategy of a defined quadrant is described with reference to literature. Detailed measures for curriculum developers (CurD) as well as catalogue reviewers (CatD) are presented in Table 3. The quadrants are addressed going backwards on the arc of diffusion, starting with established roles in the right quadrants (Potential, Emphasis) to evolving ones in the left ones (Progress, Disregard).
The Manager role is found almost exclusively in the Potential quadrant. The compactness of the role signals stable positioning in this quadrant, in the first place because of the high agreement of faculties. Nevertheless, the positioning of the role indicates the need to evaluate the overall minor curricular representation of all objectives (Evaluation Strategy). Nowadays, managing and leading competencies and key topics such as health economics, healthcare strategy, human resource and process management are demanded to be introduced as an integral part into UME, ideally by addressing these topics at basic competency level to advanced medical students in their clinical years [38, 39]. Thus, objectives in that field recommend an alert awareness for the lower curricular depiction and the environmental development. Further measures might be necessary like emphasizing particular topics regarding e.g. exposure time, level and performance quality, moving objectives to the Progress or Emphasis quadrant. However, if an objective is considered to be misplaced, another option might be re-locating it e.g. to PME. The Potential quadrant should be addressed with medium to high priority.
The Health Advocate displays a picture of agreed moderate to high curricular weightings at many sites. A greater share of its explicit objectives is positioned in the Emphasis quadrant, outweighing their implicit counterparts. This special pattern points out key elements that need lasting consolidation (Assurance Strategy). It may be explained with previous high political pressure and change in regulations in Germany . Internationally, it is commonly consented that integrating advocacy compulsorily in UME is essential [41,42,43]. Thus, numerous curricular interventions were developed recently varying in timing, frequency, and intensity across the undergraduate curriculum . Nevertheless, there is an “ongoing debate about whether physicians have a moral, social and professional responsibility to address health care issues beyond the direct care of their patients” [42, 43]. On this basis, it will be necessary in the next years to evaluate throughout, which elements of the fledgling curricula meet the needs of future physicians best, and in the long run patients and communities . However, for now these obvious must-haves located in that quadrant need to be monitored, and measures to safeguard the reached status quo need to be taken. The Emphasis quadrant is of lower priority for developmental measures.Besides the Health Advocate that shows several high ranked and evolving explicit objectives, a greater part of the Scholar is located in the Progress quadrant. Objectives in that quadrant are in a transitional phase. Faculties’ readiness for change and targeted experimentation determines the diffusion of promising concepts at this early stage (Development Strategy). In Germany, scientific competencies were newly focused as explicit educational needs with the NKLM catalogue [25, 34]. The example (Fig. 2.2) shows that especially the international demand for adequate scientific education and lifelong learning increasingly caught attention of many faculties, following political promotion. Many institutions recently developed curricular interventions, covering some objectives with a higher curricular weighting, although with lower agreement between sites . The main strategic focus for that field is to consciously prioritize and decide on the degree of curricular weighting and external impact, thus moving objectives to the Potential or the Emphasis quadrant. The decision about further development of objectives in that field is primarily depending on local criteria (e.g. urgency, resources, context, local profile). Objectives in that quadrant should be handled with higher priority.
Currently, the Scholar is the only role with explicit objectives being clearly situated in the Disregard Quadrant. In this quadrant, “unbeloved” facets of the intended graduate profile and small-scale interventions are found. These objectives should be in the focus of NKLM review, as informed stay-or-exit decisions on objectives in that quadrant of uncertainty are needed (Decision strategy). The Scholar, consisting of three different dimensions (scientist, learner and teacher), appears as a torn role regarding curricular attention and representation) [3, 7, 45]. While some parts are in progress or well set, especially the explicit integration of teaching aspects (e.g. peer tutoring) in curricula is comparatively underrated or not depicted (enough); even though this aspect might be a helpful add at many stages in the curricula (e.g. reduction of resources, build-up of competencies).
Impact of the implicit-explicit relation of roles
Besides combining the matrix map with the diffusion stages, an additional source of information with argumentative power is provided by integrating implicit patterns in role’s status diagnosis. The extent of implicit and explicit overlap revealed different degrees of matching, indicating salient discrepancies of curricular transparency. Particularly concerning roles like e.g. the Collaborator with implicit patterns clearly exceeding the explicit, a profit can be drawn from this matrix illustration (Fig. 2.4). As sketchily outlined, the implicit pattern concentrates in the Progress quadrant, whereas a greater proportion of the explicit pattern is settled in the Potential quadrant. The visible gap in the Collaborator role, underpinned by the statistical analysis, indicates the existence of a hidden curriculum, potentially undermining the theoretical specifications of the framework. Empirical data from literature support this finding: In line with international postulations , great efforts have been undertaken to emphasize the role’s competencies . At the same time, educational interventions were often hindered by hidden or informal curricula [47, 48].
The Professional role is another role obviously with a higher implicit weighting of objectives signalling non-transparency and informality of teaching (Fig. 2.5). Professionalism is often seen as an invisible competence that is always present in medical education, but not always explicitly addressed . Although there is no consent about the best way to teach professionalism in medicine, all methods that have shown being effective are personalized and primarily implicit: role modelling, mentoring and critical reflection [49,50,51]. With respect to the high relevance in clinical practice, it is important to be aware of the implicit nature of the Professional and to consider the danger of underestimation or blind spots. Teaching and assessment of medical professionalism, notably reflection and feedback as driving forces for competence development, need to be explicitly rooted in UME in main features. Reinforcement and internalization have to be entrusted to the individual when gathering experiences in practice [50, 51].
Therefore, especially roles with higher weighted implicit shares need to be carefully evaluated to recognize the existing implicit values of objectives. This forms the fundament for reliable curricular integration and constructive negotiations about resource allocation in the faculties. Catalogue reviewers need to adapt guidelines for these roles in discussions with the faculties and professional societies. Homogenous role compilation and perception is required to consent the degree of needed explicitness and to refine quadrant-specific strategies. Generally, as discussed for the Professional, the tendency to explicate more of the implicit has to be strengthened and thereby moving objectives to the Emphasis quadrant .
The methodical approach with using mapping data in focused matrix maps is a good basis but has some restrictions. Despite the obvious strengths of the present approach (e.g. multi-site data reference, curricular overview, evidences for informed self-assessment), some further aspects have to be considered. The role patterns are a crosscut in the continuously changing field of UME, flexible re-checking at other points of time are necessary to visualize longitudinal developments. They cannot be taken as hard data and accurate values, describing the curriculum precisely. Over−/underestimations of competency representation cannot be excluded despite mappers’ instruction. Mapping data may be negatively biased among others by lack of knowledge, framework terminology, misperception of intrinsic roles as well as general minor CBME acceptance and an unfavourable status of change in teaching culture [5,6,7, 23]. Because of grown curricular differences of the participating faculties, a mathematical relativization of mapping data is necessary to enable comparability. Although teachers’ perspectives on the explicit and implicit curricular performance of the intrinsic roles are highly relevant, there is still a risk of an unnoticed informal and hidden curriculum. Students’ mapping, as a controlling perspective, is relevant for quality assurance, but is addressed in another project part.
The flexible 4-Field-Matrix, as applied in our study, enables to catch the status of intrinsic roles’ implementation in German UME at a glance. Our findings reveal clear role profiles regarding role pattern, implicit-explicit relation and programs agreement, thus forming a pragmatic and supportive knowledge base for differentiated interpretation. The illustration genuinely fosters informed discussions in both, catalogue revision and local curriculum development. Due to its complex, multi-faceted educational features of intervention, CBME depends heavily on characteristics of local culture and contexts, such as educational resources and traditions, faculty attitudes and institutional readiness for change . Starting from the overview matrix, targeted analyses of mapping data can be performed tailored to institutional needs and goals in priority, scope and depth of detail. Strategically strengthening relevant objectives by framework and curriculum developers may help to build up explicit competency standards – adequate and commonly agreed. In the long run, making more of the implicit explicit enhances curricular transparency and facilitates the development of a teaching culture better fitting to CBME.
Availability of data and materials
The datasets analysed during the current study are not publicly available due to contract agreement. Data are available from the corresponding author in anonymized version upon reasonable request and with permission of the participating medical faculties as third party and owners of their local curricular data.
Competency-based medical education
Competence Centre Medical Didactics (short form of: Competence Centre for University Teaching in Medicine, Baden-Wuerttemberg)
National Competency-based Learning Objectives for Undergraduate Medical Education
Postgraduate medical education
Undergraduate medical education
Sherbino J, Frank JR, Flynn L, Snell L. “Intrinsic roles” rather than “Armour”: renaming the “non-medical expert roles” of the CanMEDS framework to match their intent. Adv Health Sci Educ Theory Pract. 2011;16:695–7. https://doi.org/10.1007/s10459-011-9318-z.
Frank JR, Danoff D. The CanMEDS initiative: implementing an outcomes-based framework of physician competencies. Med Teach. 2007;29(7):642–7. https://doi.org/10.1080/01421590701746983.
Whitehead CR, Austin Z, Hodges BD. Flower power: the armoured expert in the CanMEDS competency framework? Adv Health Sci Educ Theory Pract. 2011;16:681–94.
Frank JR, Snell L, Sherbino J, editors. The draft CanMEDS 2015 physician competency framework – series IV. Ottawa: the Royal College of Physicians and surgeons of Canada; 2015.
Ringsted C, Hansen TL, Davis D, Scherpbier A. Are some of the challenging aspects of the CanMEDS roles valid outside Canada? Med Educ. 2006;40:807–15. https://doi.org/10.1111/j.1365-2929.2006.02525.x.
Warren AE, Allen VM, Bergin F, Hazelton L, Alexiadis-Brown P, Lightfoot K, et al. Understanding, teaching and assessing the elements of the CanMEDS professional role: Canadian program directors’ views. Med Teach. 2014;36:390–402. https://doi.org/10.3109/0142159X.2014.890281.
Griewatz J, Wiechers S, Ben-Karacobanim H, Lammerding-Koeppel M. Medical teachers’ perception of professional roles in the framework of the German National Competence-Based Learning Objectives for undergraduate medical education (NKLM) – a multicenter study. Med Teach. 2016;38:1157–65. https://doi.org/10.3109/0142159X.2016.1170777.
Caverzagie KJ, Nousiainen MT, Ferguson PC, Ten Cate O, Ross S, Harris KA, et al. Overarching challenges to the implementation of competency-based medical education. Med Teach. 2017;39(6):588–93. https://doi.org/10.1080/0142159X.2017.1315075.
Hawkins RE, Welcher CM, Holmboe ES, Kirk LM, Norcini JJ, Simons KB, Skochelak SE. Implementation of competency-based medical education: are we addressing the concerns and challenges? Med Educ. 2015;49(11):1086–102. https://doi.org/10.1111/medu.12831.
Berkenbosch L, Schoenmaker SG, Ahern S, Søjnæs C, Snell L, Scherpbier AJ, Busari JO. Medical residents' perceptions of their competencies and training needs in health care management: an international comparison. BMC Med Educ. 2013;13:25. https://doi.org/10.1186/1472-6920-13-25.
Dijkstra IS, Pols J, Remmelts P, Brand PLP. Preparedness for practice: a systematic cross-specialty evaluation of the alignment between postgraduate medical education and independent practice. Med Teach. 2015;37:153–61. https://doi.org/10.3109/0142159X.2014.929646.
Renting N, Dornan T, Gans ROB, Borleffs JCC, Cohen-Schotanus J, Jaarsma ADC. What supervisors say in their feedback: construction of CanMEDS roles in workplace settings. Adv Health Sci Educ. 2016;21:375–87. https://doi.org/10.1007/s10459-015-9634-9.
Bennett D, McCarthy M, O’Flynn S, Kelly M. In the eye of the beholder: student perspectives on professional roles in practice. Med Educ. 2013;47:397–407. https://doi.org/10.1111/medu.12114.
van Loon KA, Teunissen PW, Driessen EW, Scheele F. The role of generic competencies in the entrustment of professional activities: a Nationwide competency-based curriculum assessed. J Grad Med Educ. 2016;8(4):546–52. https://doi.org/10.4300/JGME-D-15-00321.1.
Renting N, Raat JAN, Dornan T, Wenger-Trayner E, van der Wal MA, Borleffs JCC, et al. Integrated and implicit: how residents learn CanMEDS roles by participating in practice. Med Educ. 2017;51:942–52. https://doi.org/10.1111/medu.13335.
Harris P, Bhanji F, Topps M, Ross S, Lieberman S, Frank JR, et al. Evolving concepts of assessment in a competency-based world. Med Teach. 2017;39(6):603–8. https://doi.org/10.1080/0142159X.2017.1315071.
Cate OT, Scheele F. Competency-based postgraduate training: can we bridge the gap between theory and clinical practice. Acad Med. 2007;82:542–7.
Hafferty FW, O’Donelly JF. The next generation of work on the hidden curriculum. In: Hafferty FW, O’Donnell JF, editors. The hidden curriculum in health professional education. Hanover, NH: Dartmouth College press; 2014. p. 233–64.
Holmboe ES, Sherbino J, Englander R, Snell L, Frank JR, Collaborators ICBME. A call to action: the controversy of and rationale for competency-based medical education. Med Teach. 2017;39(6):574–81. https://doi.org/10.1080/0142159X.2017.1315067.
Kuper A, Veinot P, Leavitt J, Levitt S, Li A, Goguen J, Schreiber M, et al. Epistemology, culture, justice and power: non-bioscientific knowledge for medical training. Med Educ. 2016;51:158–73. https://doi.org/10.1111/medu.13115.
Wear D, Skillicorn J. Hidden in plain sight: the formal, informal, and hidden curricula of a psychiatry clerkship. Acad Med. 2009;84:451–8. https://doi.org/10.1097/ACM.0b013e31819a80b7.
Balmer DF, Hall E, Fink MJ, Richards BF. How do medical students navigate the interplay of explicit curricula, implicit curricula, and extracurricula to learn curricular objectives? Acad Med. 2013;88(8):1135–41. https://doi.org/10.1097/ACM.0b013e31829a6c39.
Ferguson PC, Caverzagie KJ, Nousiainen MT, Snell L, Collaborators ICBME. Changing the culture of medical training: an important step toward the implementation of competency-based medical education. Med Teach. 2017;39(6):599–602. https://doi.org/10.1080/0142159X.2017.1315079.
Fischer MR, Bauer D, Mohn K, NKLM-Projektgruppe. Finally finished! National competence based catalogues of learning objectives for undergraduate medical education (NKLM) and dental education (NKLZ) ready for trial. GMS J Med Educ. 2015;32:Doc35. https://doi.org/10.3205/zma000977.
Nationaler Kompetenzbasierter Lernzielkatalog Medizin [National Competency-based Learning Objective Catalogue] (NKLM). 2015. Berlin: MFT Medizinischer Fakultaetentag der Bundesrepublik Deutschland. [accessed 31 Aug 2018]. http://www.nklm.de.
Harden RM. AMEE guide no. 21: curriculum mapping: a tool for transparent and authentic teaching and learning. Med Teach. 2001;23:123–37. https://doi.org/10.1080/01421590120036547.
Madsen DØ. Not dead yet: the rise, fall and persistence of the BCG matrix. Problems and Perspectives Management. 2017;15(1):19–34. https://doi.org/10.21511/ppm.15(1).2017.02.
Day GS. Diagnosing the product portfolio. J Mark. 1977:29–38.
Reeves M, Moose S, Venema T. BCG classics revisited. The growth share matrix. BCG perspectives. 2014. Boston Consulting Group.
Rogers EM.: Diffusion of innovations. 4. Edition. Free Press, New York NY, 1995.
Lammerding-Koeppel M, Giesler M, Gornostayeva M, Narciss E, Wosnik A, Zipfel S, et al. Monitoring and analysis of the change process in curriculum mapping compared to the National Competency-based Learning Objective Catalogue for undergraduate medical education (NKLM) at four medical faculties. Part I: conducive resources and structures. GMS J Med Educ. 2017;34(1):Doc7. https://doi.org/10.3205/zma001084.
Lammerding-Koeppel M, Giesler M, Gornostayeva M, Narciss E, Wosnik A, Zipfel S, et al. Monitoring and analysis of the change process in curriculum mapping compared to the National Competency-based Learning Objective Catalogue for undergraduate medical education (NKLM) at four medical faculties. Part II: key factors for motivating the faculty during the process. GMS J Med Educ. 2017;34(1):Doc6. https://doi.org/10.3205/zma001083.
Fritze O, Lammerding-Koeppel M, Boeker M, Narciss E, Wosnik A, Zipfel S, Griewatz J. Boosting competence-orientation in undergraduate medical education - a web-based tool linking curricular mapping and visual analytics. Med Teach. 2018;30:1–11. https://doi.org/10.1080/0142159X.2018.1487047.
Lammerding-Koeppel M, Fritze O, Giesler M, Narciss E, Steffens S, Wosnik A, Griewatz J. Benchmarking for research-related competencies – a curricular mapping approach at medical faculties in Germany. Med Teach. 2018;40(2):164–73. https://doi.org/10.1080/0142159X.2017.1395403.
Gruppen L, Frank JR, Lockyer J, Ross S, Bould MD, Harris P, et al. Toward a research agenda for competency-based medical education. Med Teach. 2017 Jun;39(6):623–30. https://doi.org/10.1080/0142159X.2017.1315065.
Ellaway R. CanMEDS is a theory. Adv Health Sci Educ Theory Pract. 2016;21(5):915–7. https://doi.org/10.1007/s10459-016-9724-3.
Nousiainen MT, Caverzagie KJ, Ferguson PC, Frank JR, Collaborators ICBME. Implementing competency-based medical education: what changes in curricular structure and processes are needed? Med Teach. 2017;39(6):594–8. https://doi.org/10.1080/0142159X.2017.1315077.
Fuerstenberg S, Harendza S. Differences between medical student and faculty perceptions of the competencies needed for the first year of residency. BMC Med Educ. 2017;17(1):198. https://doi.org/10.1186/s12909-017-1036-7.
Sonsale A, Bharamgoudar R. Equipping future doctors: incorporating management and leadership into medical curriculums in the United Kingdom. Perspect Med Educ. 2017;6:71–5. https://doi.org/10.1007/s40037-017-0327-3.
Medical Licensing Regulations for Physicians. Approbationsordnung für Ärzte (ÄAppO) vom 27. Juni 2002 Bundesgesetzbl. 2002;1(44):2405–35.
Frenk J, Chen L, Bhutta ZA, Cohen J, Crisp N, Evans T, et al. Health professionals for a new century: transforming education to strengthen health systems in an interdependent world. Lancet. 2010;376:1923–58. https://doi.org/10.1016/S0140-6736(10)61854-5.
Soklaridis S, Bernard C, Ferguson G, Andermann L, Fefergrad M, Fung K, et al. Understanding health advocacy in family medicine and psychiatry curricula and practice: a qualitative study. PLoS One. 2018;13(5):e0197590. https://doi.org/10.1371/journal.pone.0197590.
Luft LAM. The essential role of physician as advocate: how and why we pass it on. CMEJ. 2017;8(3):e109–e116 2017.
Flynn L, Verma S. Fundamental components of a curriculum for residents in health advocacy. Med Teach. 2008;30(7):e178–83. https://doi.org/10.1080/01421590802139757.
Hautz SC, Hautz WE, Keller N, Feufel MA, Spies C. The scholar role in the National Competence Based Catalogues of Learning Objectives for Undergraduate Medical Education (NKLM) compared to other international frameworks. Ger Med Sci. 2015;13:Doc20. https://doi.org/10.3205/000224.
Berger E, Chan MK, Kuper A, Albert M, Jenkins D, Harrison M, Harris I. The CanMEDS role of collaborator: how is it taught and assessed according to faculty and residents? Paediatr Child Health. 2012;17(10):557–60.
Thistlethwaite J. Hidden amongst us. The language of Inter- and Outerprofessional Identity and Collaboration. In: Hafferty FW, O’Donnell JF, editors. The hidden curriculum in health professional education. Hanover, NH: Dartmouth College press; 2014. p. 158–68.
Reeves S, Fletcher S, McLoughlin C, Yim A, Patel KD. Interprofessional online learning for primary healthcare: findings from a scoping review. BMJ Open. 2017;7(8):e016872. https://doi.org/10.1136/bmjopen-2017-016872.
Passi V, Johnson N. The impact of positive doctor role modeling. Med Teach. 2016;38(11):1139–45. https://doi.org/10.3109/0142159X.2016.1170780.
Birden H, Glass N, Wilson I, Harrison M, Usherwood T, Nass D. Defining professionalism in medical education: a systematic review. Med Teach. 2014;36(1):47–61. https://doi.org/10.3109/0142159X.2014.850154.
Cruess RL, Cruess SR, Boudreau JD, Snell L, Steinert Y. Reframing medical education to support professional identity formation. Acad Med. 2014;89(11):1446–51. https://doi.org/10.1097/ACM.000000000000042.
Sternszus R, Cruess SR. Learning from role modelling: making the implicit explicit. Comment Lancet. 2016;387:1257–8. https://doi.org/10.1016/S0140-6736(16)00381-0.
The authors thank Amir Yousef, Miriam Rothdiener and Olaf Fritze from the CCMD for support in data processing and discussions, Hadiye Ben-Karacobanim for manuscript review, and all users of the MERlin-mapping database for their energetic participation in the mapping process.
The joint MERlin-Project (Phase I: 2012–2016, Phase II: 2017–2020) is funded by the Federal Ministry of Education and Research of Germany (reference numbers: 01PL12011A, 01PL17011A). The joint project of the Medical Faculties of Baden-Wuerttemberg includes Freiburg, Heidelberg, Mannheim, Tuebingen, Ulm. It is focused on medical education research within a cooperative, state-wide teaching network regarding competency-based education and assessment. The Tuebingen mapping project is one of the subprojects in which external institutions may participate at their own charge.
Ethics approval and consent to participate
Consent for publication
Consent for publication is not applicable for this study. The usage of data was approved in all participating medical faculties by the Deans’ Office and/or local authorized persons.
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Griewatz, J., Lammerding-Koeppel, M. Intrinsic roles in the crosshair – strategic analysis of multi-site role implementation with an adapted matrix map approach. BMC Med Educ 19, 237 (2019). https://doi.org/10.1186/s12909-019-1628-5
- Undergraduate medical education
- Competence orientation
- CBME framework
- Intrinsic roles
- Implicit-explicit relation
- Curricular transparency
- Curriculum development
- Curriculum mapping
- Matrix map method