Skip to main content

Virtual patients reflecting the clinical reality of primary care – a useful tool to improve cultural competence

Abstract

Background

Virtual patients are educational tools that may be described as case-based interactive computer simulations of clinical scenarios. In terms of learning outcomes, improved clinical reasoning skills and knowledge acquisition have been shown. For further exploring the role of virtual patients in medical education, a greater focus on context-specific cases, combined with suitable educational activities, has been suggested. A knowledge gap has been identified in cultural competence in primary care. As primary care physicians are often the main medical providers for patients with refugee backgrounds, they would probably benefit from improved training focusing on how to apply cultural competence in everyday work. Using virtual patient cases, as a complement to clinical training, may be one way forward. The aim of this study was therefore to explore a learner perspective on the educational use of a virtual patient system designed to contribute to training in cultural competence in a primary care context.

Methods

Three virtual patient cases portraying patients with refugee backgrounds were developed. The cases addressed various issues and symptoms common in primary care consultations, while also incorporating intercultural aspects. The system also provided the informants with individualized feedback. Primary care physicians and medical students were invited to test the cases and participate in an interview about their experience. Data was analyzed using qualitative content analysis.

Results

The analysis generated the theme Virtual patients might help improve cultural competence in physicians and medical students by complementing knowledge gained through the informal curriculum. Informants at different educational levels found it suitable as a tool for introducing the topic and for reflecting on one’s own consultations. It could also compensate for the predominant informal manner of learning cultural competence, described by the informants.

Conclusions

Virtual patients could be useful for gaining cultural competence in a primary care context. Advantages that could benefit learners at both pre- and post-graduate levels are decreased dependence on the informal curriculum and being presented with an illustrative way of how cultural competence may be applied in the consultation.

Peer Review reports

Background

Intercultural consultations, which by definition involve communication across cultures, are often perceived by both physicians and patients as challenging [1,2,3,4,5,6]. Communicational and cultural issues may also provide obstacles to health care on equal terms [1,2,3,4,5,6,7,8]. A group particularly at risk of being negatively affected by health disparities is patients with refugee backgrounds [7, 8]. Since the primary care physician (PCP) is often the initial point of contact and the main health provider for these patients, increased cultural competence is needed [9,10,11].

This identified need for improved competence in intercultural health care is not new, but there is still discussion on how to attain this [12,13,14]. Cultural competence is often defined as ‘a set of congruent behaviors, attitudes, and policies that come together in a system, agency, or among professionals that enables effective work in cross-cultural situations’ [15]. One main goal is to improve equity and thereby reduce disparities in health care [16, 17]. Cultural competence is a complex concept and despite the ongoing debate on its appropriateness in medical education and health care, it is to date probably the most established concept, and will therefore be used in this article [9, 14, 18]. Cultural competence is often a part of the informal curriculum in post-graduate education in primary care; with learning taking place experientially in the workplace and formal learning activities being scarce [9, 19,20,21]. Meanwhile, studies have indicated that resident physicians often perceive intercultural consultations as challenging, due to lack of both confidence and skills [22,23,24], and there has been an increased demand for education in cultural competence [16, 25]. Various teaching methods have been applied [9, 25] and the use of virtual learning environments, including virtual patients (VPs), has shown some promise [26,27,28,29,30,31,32].

Virtual patients (VPs) are educational tools used in medical education since the 1990s [33,34,35]. They are often described as “case-based interactive computer simulations of clinical scenarios” [33]. Their use in medical education is underpinned by experiential learning theory, with its theoretical model of action and reflection [36]. They have been used on pre- and postgraduate levels, using various educational set-ups (including problem-based learning), and in different areas of medical education, including cultural competence training, in both primary care and psychiatry [32, 37, 38].

The positive effect of VPs as learning activities on learning outcomes, such as knowledge and clinical reasoning, compared with no intervention, has already been established [26, 39, 40]. Compared to more passive forms of educational methods, learners may also benefit, especially if the intended learning objective is focused on clinical reasoning [35]. However, the quality of evidence is under discussion [35]. Media comparative research has been criticized for not contributing to the field of digital health education, as many confounding factors often invalidate control groups [41, 42]. Moreover, a shift in focus, from viewing VPs as software tools, to exploring their use as part of an educational activity, has been advocated [43, 44]. Exploring the possibility of making VPs more context-specific, in order to meet the needs of various medical specialties, has also been suggested [43]. Relevant aspects in a primary care context could, for example, be an emphasis on social determinants of health, or diagnostic reasoning of PCPs when dealing with multimorbidity or intercultural aspects [43, 45, 46]. Therefore, the present aim was to explore a learner perspective on the educational use of a VP system designed to contribute to cultural competence training in a primary care context.

Methods

We chose a qualitative approach as this is an appropriate method for exploring views and experiences in a relatively unexplored area of research [47].

Study design

Designing the VP system

The VP system used is called BSA-sim and is a further development of earlier VP systems, such as Web-SP from Karolinska Institutet and Stockholm University [30,31,32].

We developed three cases depicting patients with refugee backgrounds and diagnoses, and/or symptoms, commonly addressed in primary care, such as diabetes, musculoskeletal pain, and fatigue (Fig. 1).

Fig. 1
figure 1

Screenshot showing the layout of the medical history session with one of the virtual patients. The screenshot displays instructions, examples of questions, and the subheadings of the history session

In addition to reflecting issues that may arise in intercultural consultations (irrespective of culture), such as language, communication problems, and different views on health and disease, the cases were also designed to illustrate the complexity of the clinical reality facing PCPs. One example of this complexity would be the ability to consider several diagnoses simultaneously and deal with uncertainty, as patients often present with diverse and sometimes vague symptoms.

When working with the VPs, the user was able to take a medical and social history using pre-formulated questions, structured on three levels, with follow-up questions displayed stepwise. The idea was to reflect, as far as possible, the gradual unfolding of information of a real consultation. Many questions were formulated for each case, some “appropriate” and some less so, so the user had to decide which ones to use. The answers from the VP were presented through video clips. The user could also choose among various physical exam procedures, as well as lab and imaging tests. Upon completing the initial encounter, the user was asked to synthesize the information gathered into a free text-based preliminary assessment, and then to make suggestions for a treatment plan.

In addition to interacting with the VP during history-taking, the user was given individualized and automated feedback from the VP, and from a so-called virtual specialist, at the end of each case. This feedback was based on the questions the user had chosen to ask. Each question generated a positive or a negative score, in different feedback categories, in the system. Two different pre-recorded videos with feedback from the VPs were made for each category: a positive and a negative. For example, the positive feedback given from one of the VPs on the category “migration history” states: “You seemed interested in my background and even though I didn’t feel I could tell you everything today, I felt that you had an interest in me as a person” (author’s translation), while the negative feedback on the same category was: “I thought you would ask me a bit more about my background, I think that would have been of importance to address my problems” (author’s translation). Depending on the summarized score, the user was presented with a more or less “contented” VP, reflecting for example the capability of trust-building. The feedback from the virtual specialist was based on the same scoring system, but was in written form, and focused more on clinical aspects, making suggestions for improvement if needed. The underlying scoring system was not visible to the user.

Setting and informants

The main rationale for choosing primary care as our setting, was that it is a key element in the Swedish health care system in providing medical care for refugees, covering both somatic and psychiatric spectra [48].

Twelve informants volunteered to participate: eight medical students, three residents, and one specialist in family medicine. Mean years’ work as a PCP were five (range: 4–8). One student was in the eleventh, and final, medical school semester. The other seven were in their fifth semester. There were five women and seven men. The mean estimated time spent on each case was 21 min (range:10–60).

The initial sampling purposively aimed for residents in family medicine, since we believed they, still in training, could make a more valid assessment of the VP as an educational tool. However, specialists wanting to participate were not refused. There were no exclusion criteria. As the interviews indicated that medical students could benefit as well, students on primary care rotation were included at a later stage of the research. Within the respective groups, convenience sampling was applied, since this was deemed the most feasible way to recruit informants [49]. The informants were contacted though three different channels: they were e-mailed through the center for resident education in primary care in Stockholm, invitations were posted on an internet forum for PCPs, and given verbally at various seminars for residents and medical students. Those interested were given further written information and the possibility to ask questions prior to the interview. When written informed consent had been obtained, the informants were given a personal log-in to the VP system, which they could access from a place of their choice. If necessary, they could access the cases repeatedly.

Using the information power model [50], we estimated that 10–15 informants would suffice. This was evaluated throughout the research process, and recruitment was halted when the sample included was deemed to hold sufficient information power (a concept which has been suggested as an alternative to saturation) [50].

Data collection

A semi-structured interview guide was developed by the research team (Additional file 1). Questions included experiences of working with the VP system, suggestions for improvements and implementation, and accounts of how cultural competence had been addressed so far in their medical education. Phone interviews were then conducted individually by ER. The interviews lasted between 14 and 25 min (mean 17). They were audio-recorded and transcribed verbatim by ER.

One focus group interview was conducted for trustworthiness, where the relevance of the results was confirmed through member-checking [47]. No concepts were changed. This interview took place on campus. It lasted for 43 min and included five additional residents who, after they had had the same VP encounter, were asked to discuss the same topics as the original informants. ER conducted the interview with SE as observer. The informants were also invited to comment on the results. Field notes were made after the interviews and the focus group discussion.

Data analysis

Data from the interviews was analyzed manually using qualitative content analysis [47]. However, codes and categories were sorted and stored in the NVIVO software. The transcripts were independently read, and coded, by ER and SE, who then compared notes. A few minor differences were reconciled through discussion. Codes were then sorted into preliminary categories by ER. The emerging coding tree was reviewed and discussed among the authors. An overarching theme was obtained through consensus. Throughout the process, we moved from a manifest to a more latent content analysis, in accordance with the method [47]. This allows for interpretation on a more abstract level, while ensuring that the higher-level coding reflected actual data [47]. The analysis was performed in Swedish, being the native language of the research team.

Ethics

All informants were given verbal and written information on the purpose of the study. Confidentiality was emphasized, as was the right to decline or withdraw at any time without giving reasons. Written informed consent was obtained from all informants. There was no financial reimbursement. Transcripts were anonymized prior to analysis. The virtual patients were portrayed by actors and health care staff with refugee backgrounds, volunteering to participate, thus no patients were at risk. The COREQ guidelines were adhered to (Additional file 2). The study was approved by the Regional Ethical Review Board in Stockholm (2015/1228–31/5, 2016–2308-32 and 2020–01486).

Results

The analysis generated eight sub-categories, which were sorted into four main categories, generating one common theme: Virtual patients might help improve cultural competence in physicians and medical students by complementing knowledge gained through the informal curriculum.

Training with a VP system, reflecting the clinical reality of primary care, might be useful for physicians and medical students in improving their cultural competence. A complement to what is taught within the informal curriculum, the VP system offers an opportunity to achieve a uniform base for further knowledge.

Categories and sub-categories

  1. 1.

    Cultural competence is currently obtained via the informal curriculum - VPs constitute a possible complement

    1. a.

      Cultural competence is not perceived as prioritized in the formal curriculum

    2. b.

      Training with VPs could compensate for varying preconditions in the clinic

Intercultural issues raised by the VP cases were matters the informants felt had not been prioritized in their medical education. “I’ve no recollection that we focused on patients with immigrant backgrounds. [It’s] not something I’ve met during my training, more than that I know they exist, so to speak.” (Student informant 8). Formal learning activities addressing these issues had been scarce if present at all. One exception was learning to work with interpreters, which some could recall had been included in their curriculum. Otherwise, experience-based learning was described as a common way of gaining knowledge in this field. Some informants addressed concerns regarding their dependence on local factors, such as, supervisors’ interest and knowledge, and the sociocultural context of their primary care center. The VP cases could be a way of bridging existing preconditions.” [It’s] good from an educational point of view that […]loads of students […]can do the same case and gain differing experience, but the same information’s there anyway [… ], it would have been unreasonable for 100 doctors to meet the same patient.” (Student informant11).

  1. 2.

    The VP-system allows for different levels of pre-existing knowledge

    1. a.

      VPs might be useful on various educational levels as several aspects of learning are offered

    2. b.

      User strategies can vary

When discussing possible knowledge gained from the VP system, the informants highlighted various learning aspects, maybe partly reflecting their level of medical education. For example, residents mentioned the opportunity for reflection. “During resident training it’s more of a reflection on how I normally do things [ … ]and you can’t really see this during medical training [ …], then it’s more about gaining knowledge of these issues for example. But here it’s more how one delves deeper into how one works; I think this is a good thing and very valuable during resident training.” (Physician informant 3). Students, on the other hand, appreciated other aspects, such as the possibility to practice writing a preliminary assessment of the case. In general, residents felt it would probably be beneficial to introduce VP cases earlier in the education process: medical students could, for example, prepare for future patient contact through training with VPs. On the other hand, some students expressed that having more medical knowledge might help one focus more on the intercultural aspects. Strategies for working with the cases varied, some describing an approach mirroring what they would do in real life, while others applied a freer approach. The latter involved, for example, clicking on every question available, just to see the response. Another example was to ask the VP questions they normally would avoid, feeling that it was okay to make mistakes and not having to perform.

  1. 3.

    Appreciated features of the VP system were authenticity and interactivity

    1. a.

      Realistic case-content reflects the complexity of primary care

    2. b.

      The possibility to interact with the VP offers a different way of learning

The learners highlighted two features of the VPs as particularly useful: the authenticity and the interactivity. The content of the VP cases was described as realistic. Residents working with patients with refugee backgrounds on a regular basis, confirmed that issues incorporated in the VP cases, reflected those they met in everyday practice.” I think you can learn a lot from this and since I often work with patients with refugee backgrounds, I recognize loads of this and have, sort of, got the knack of taking a history and, kind of, moving on.” (Physician informant 9). Students especially appreciated how the VP system could create a case-based context for gaining intercultural competence.”It’s easy to say that in some cultures they do things like this or like that, but I think it’s an extremely good way of getting examples of this in context.” (Student informant 10). In addition to the intercultural aspects, the VPs authentically illustrated the complexity of family medicine in general; medical and social issues are often intertwined, and there is often more than one way to approach a problem.“That there isn’t a genuine clinical answer, that’s the reality, its seldom like ‘yes, now we know what it is, now you can go home.”(Physician informant 1).

The interactive part of the VP system was also appreciated by the informants, with the feedback from the VPs being emphasized as especially important for retaining knowledge. The informants described how being addressed directly and verbally by the VP, even though through pre-recorded videos, could evoke an emotional response which they believed could facilitate learning. “Now at any rate I have before my eyes the face of [the VP] who said [ …], and it sticks in my mind in a different way I think.” (Student informant 11).

  1. 4.

    There is room for improvement, but the VP system seems relevant in learning cultural competence

    1. a.

      The VP system could, with some adjustments, be a useful addition to cultural competence training

    2. b.

      Combining the VP system with a discussion-based learning activity might enhance knowledge retention

In general, the informants found VPs suitable for future cultural competence training in a primary care context. However, to optimize learning, suggestions for improvements to the VP system were made. These focused mainly on the history-taking section, where a more authentic feel to the interaction was wanted. For example, some felt they wanted to validate the patient to a greater extent than the program allowed for. “You want to be able to say ‘I realize it’s hard for you and things like that.” (Student informant 5). Some informants also wished for a possibility to formulate text freely. Others, however, expressed that they found the pre-formulated questions useful, as they viewed them as suggestions for what to ask. There was also disagreement among the informants on whether the feedback they received from the patient was “fair”, given their performance.

Pedagogical methods to facilitate intercultural learning from the VP system were discussed, but the data was not conclusive. As the cases gave rise to numerous thoughts and questions, there was a general wish to be able to discuss them further, either with other students or in a teacher-led seminar. Some also suggested that using the VP system should be mandatory, instead of a voluntary add-on.” If it’s voluntary it’s easy to skip it, I’m afraid … ‘yes but I’ve got a test I must study for’ and then you don’t do it properly. But if you have it in a group, in a seminar, it’s much better.” (Student informant 4).

Discussion

Statement of principal findings

The study sought to explore a learner perspective on the educational use of a virtual patient (VP) system, designed to contribute to cultural competence training, in a primary care context. Our findings show that the informants, both on pre- and post-graduate levels, found it useful as a complement to clinical training. The VP system was found suitable as an introduction to intercultural consultations, as well as for stimulating reflection. User strategies and learning points varied among the informants, maybe partly due to their different educational levels. In general, the importance of authenticity and the possibility to interact with the VP, were highlighted as features likely to enhance learning. The informants’ views on future educational contexts where the VP system could be useful, pointed, in general, towards some form of discussion-based learning activity.

Findings in relation to previous work

Our VP system may contribute to cultural competence training in a primary care context, as the informants described cultural competence as an area of knowledge often taught informally, and in general they felt it had been somewhat neglected during medical training. The residents could not clearly recall whether cultural competence had been taught during medical school; likewise, the students interviewed felt that it was not an area prioritized in their current curriculum. This tallies with previous studies, indicating that residents in family medicine learn cultural competence through the informal curriculum [9, 19]. Although most medical schools today include the topic in the formal curriculum, it is often taught cursorily and students have difficulties applying what they have been taught [18, 51]. Informal learning is not in itself negative, but the learner risks becoming over-reliant on “ad hoc” learning, having to rely on patient encounters as triggers for learning [20]. Previous VP studies have highlighted the possibility of using VPs to ensure that diagnoses common in the population, but not frequent at, for example, highly-specialized teaching hospitals, are covered; this is also in line with trying to avoid being over-reliant on “ad hoc” learning [52]. In terms of gaining cultural competence in primary care, triggers for learning may or may not occur depending on, for example, the socioeconomic context of the area the health care center serves. Introducing VPs might be one way of compensating for this, both by ensuring that educational material covering core issues is available for all, and by in offering opportunities for more organized learning activities in the clinic. An additional benefit might be improved knowledge retention, since learning taking place through some form of planned activity is better than reactive learning, where knowledge is considered at best a by-product of the task in hand [53, 54].

Using VPs as complementary learning tools to what is taught within the informal curriculum, such as cultural competence, requires VP systems to meet educational needs on different levels. Satisfyingly, our VP system was in general perceived as useful, regardless of the level of prior knowledge. Some residents described how working with the VPs became a trigger for reflection on, for example, cultural differences and one’s own behavior in intercultural consultations – an important component of being able to work in a culturally competent manner. Being reminded of issues regularly occurring in the clinic, but seldom reflected on, has also previously been highlighted as an advantage of VP training [28]. Both residents and students thought VPs could be useful for introducing the topic in medical school before clinical rotations. Other learning points were also emphasized by the students, for example, training basic skills, such as, writing a preliminary assessment of the case. This finding illustrates how the use of VPs not necessarily follows only the designer’s intention, but instead, is likely to be more diverse.

Thus, what is gained from the VP system might vary with the user’s educational level, even though there was agreement that authenticity and interactivity were crucial elements for awakening and maintaining an interest in the cases, and consequently for gaining knowledge. This tallies with previous research, highlighting the importance of relevance and authenticity in evoking engagement and promoting learning [55, 56]. Several factors contributing to the authenticity of VPs have been identified, such as the type of case, realistic dialog, and acting [26]. Our informants emphasized the importance of the content of the case in creating a feeling of authenticity and relevance, rather than e.g. the quality of the acting or the interface. Ambiguity and uncertainty are feelings often present in primary care consultations [57, 58]; accordingly, these were elements we tried to incorporate into the VP system to increase authenticity. This was also noted and appreciated, primarily by the residents, likely a reflection of their greater clinical experience. Some informants saw cultural competence as an abstract concept and appreciated the relatively realistic framework the VP system provided to illustrate why it is important, and how to apply it, in their everyday work. We have not seen this finding discussed to any extent in other VP studies, but it is, nonetheless, a possible significant advantage.

The possibility to interact with the VP is also likely to contribute to a feeling of authenticity. Even though the informants wished for a more realistic interaction in the history-taking section, they appreciated the patient feedback as an opportunity to share an unfiltered patient perspective, something they did not get in real-life consultations. Interestingly the views on whether the feedback was ‘fair’ differed. This did not seem to be a product of educational level, as perceived fairness versus unfairness was found among both residents and students. Instead the following three aspects seem more plausible to consider. First, the various perceptions might reflect variations in the ability to evaluate one’s own knowledge or skills. Secondly, the variation in the estimated time spent on the cases might matter, since choosing questions more carefully is likely to generate a more favorable score. Finally, the programming of the scoring system might also play a part: if for example some questions are given too much weight, this could result in unfair feedback. However, one might expect a sense of “unfairness” to be more pervading, were that the case. To clarify whether this is an area for improvement in our VP system, further exploration is required. For future improvement, considering a stepwise feedback-system may also be of interest. In general, making greater use of the possibilities of taking the patient perspective into account, is an interesting area for future VP studies, this has also been suggested previously [55].

Future studies are also required of what pedagogical methods to use to facilitate learning cultural competence from VPs, taking contextual factors into account. Exploring the validity and reliability of the VPs in a structured manner would also be of interest. Other areas to consider for future use of VPs would be medical professionalism and dealing with uncertainty, which today, in primary care, just like cultural competence, seem to be taught largely through the informal curriculum [19].

Limitations

We considered the main limitation of the study to be the use of convenience sampling, even though it is a common method of sampling in qualitative studies. To increase credibility, we tried to ensure a representative sample, with high information power, by including both students and physicians, with varying experience of intercultural consultations. The result of the analysis was confirmed through member-checking, which also contributed to the credibility. Conducting the interviews by phone is not optimal, but given the limited amount of time available, this was deemed the most feasible option.

The interviews were performed by ER, who was also involved in developing the VP system. Although this was not conveyed in detail to the informants, they were informed that ER was part of the research team. Thus, the position of the interviewer could have been a factor hindering the informants from speaking freely about negative aspects of the system out of social desirability. At the same time, we presumed that using an external interviewer, without deeper knowledge of the VP system, would likely generate less rich data. Instead we chose to encourage the informants to criticize the system, emphasizing that it would help us improve it.

As for transferability, it is for the reader to evaluate. However, we suggest that although the study was set in a Swedish context, the results are likely to be transferable to similar VP systems, being evaluated in comparable primary care settings. Including cultural competence in the informal curriculum is not exclusive to Sweden and the wish for increased knowledge in the area is also widespread.

Conclusions

VPs could be a suitable tool for cultural competence training in a primary care context, one advantage being decreased reliance on what ‘happens to be taught’ within the informal curriculum. The flexibility of the VP system seems to allow learners to use it for different purposes, depending on prior knowledge, which permits possible implementation on various educational levels. While increased cultural competence in health care has been called for, students and physicians alike sometimes find it abstract and consequently difficult to implement. Concretizing the concept through training with VPs might be one way forward.

Availability of data and materials

Transcripts of the interviews analyzed are not publicly available due to the risk of compromising individual privacy, but data is available from the corresponding author on reasonable request. The questionnaire used is submitted as an additional file.

Abbreviations

PCP:

Primary care physician

VP:

Virtual patient

References

  1. Rocque R, Leanza Y. A systematic review of Patients’ experiences in communicating with primary care physicians: intercultural encounters and a balance between vulnerability and integrity. PLoS One. 2015;10(10):e0139577. https://doi.org/10.1371/journal.pone.0139577.

    Article  Google Scholar 

  2. Jensen NK, Norredam M, Priebe S, Krasnik A. How do general practitioners experience providing care to refugees with mental health problems? A qualitative study from Denmark. BMC Fam Pract. 2013;14(1):17. https://doi.org/10.1186/1471-2296-14-17.

    Article  Google Scholar 

  3. Kai J, Beavan J, Faull C, Dodson L, Gill P, Beighton A. Professional uncertainty and disempowerment responding to ethnic diversity in health care: a qualitative study. PLoS Med. 2007;4(11):e323. https://doi.org/10.1371/journal.pmed.0040323.

    Article  Google Scholar 

  4. Papic O, Malak Z, Rosenberg E. Survey of family physicians’ perspectives on management of immigrant patients: attitudes, barriers, strategies, and training needs. Patient Educ Couns. 2012;86(2):205–9. https://doi.org/10.1016/j.pec.2011.05.015.

    Article  Google Scholar 

  5. Priebe S, Sandhu S, Dias S, Gaddini A, Greacen T, Ioannidis E, et al. Good practice in health care for migrants: views and experiences of care professionals in 16 European countries. BMC Public Health. 2011;11(1):187. https://doi.org/10.1186/1471-2458-11-187.

    Article  Google Scholar 

  6. Rothlind E, Fors U, Salminen H, Wandell P, Ekblad S. Circling the undefined-a grounded theory study of intercultural consultations in Swedish primary care. PLoS One. 2018;13(8):e0203383. https://doi.org/10.1371/journal.pone.0203383.

    Article  Google Scholar 

  7. Next step towards more equity in health in Sweden: SOU2017:47 The Swedish Commission for Equity in Health [Internet]. [cited: 2017 Dec 12]. Available from: http://www.regeringen.se/rattsdokument/statens-offentliga-utredningar/2017/06/sou-201747.

  8. Official Report of the Swedish Government. On Equal Health: SOU2016:55 The Swedish Commission for Equity in Health [Internet]. Available from: http://www.regeringen.se/rattsdokument/statens-offentliga-utredningar/2016/08/det-handlar-om-jamlik-halsa-sou-201655/. [cited 2019 July 1].

  9. Watt K, Abbott P, Reath J. Developing cultural competence in general practitioners: an integrative review of the literature. BMC Fam Pract. 2016;17(1):158. https://doi.org/10.1186/s12875-016-0560-6.

    Article  Google Scholar 

  10. The National Board of Health and Welfare. Healthcare and dentalcare for asylumseekers and newly arrived: Final Report, October 2016 [In Swedish]. Stockholm: The National Board of Health and Welfare; 2016.

    Google Scholar 

  11. Silove D, Ventevogel P, Rees S. The contemporary refugee crisis: an overview of mental health challenges. World psychiatry. 2017;16(2):130–9. https://doi.org/10.1002/wps.20438.

    Article  Google Scholar 

  12. Leininger MM. Transcultural nursing: concepts, theories, and practices. New York: Wiley Medical; 1978.

    Google Scholar 

  13. Horvat L, Horey D, Romios P, Kis Rigo J. Cultural competence education for health professionals. Cochrane Database Syst Rev. 2014(5):CD009405. https://doi.org/10.1002/14651858.CD009405.pub2.

  14. Alizadeh S, Chavan M. Cultural competence dimensions and outcomes: a systematic review of the literature. Health Soc Care Community. 2016;24(6):e117–e30. https://doi.org/10.1111/hsc.12293.

    Article  Google Scholar 

  15. Cross TL. Towards a culturally competent system of care: a monograph on effective Services for Minority Children who are Severely Emotionally Disturbed; 1989.

    Google Scholar 

  16. Betancourt JR. Cultural competence and medical education: many names, many perspectives, one goal. Acad Med. 2006;81(6):499–501. https://doi.org/10.1097/01.ACM.0000225211.77088.cb.

    Article  Google Scholar 

  17. Saha S, Beach MC, Cooper LA. Patient centeredness, cultural competence and healthcare quality. J Natl Med Assoc. 2008;100(11):1275–85. https://doi.org/10.1016/S0027-9684(15)31505-4.

    Article  Google Scholar 

  18. Deliz JR, Fears FF, Jones KE, Tobat J, Char D, Ross WR. Cultural competency interventions during medical school: a scoping review and narrative synthesis. J Gen Intern Med. 2020;35(2):568–77. https://doi.org/10.1007/s11606-019-05417-5.

    Article  Google Scholar 

  19. Rothlind E, Fors U, Salminen H, Wandell P, Ekblad S. The informal curriculum of family medicine - what does it entail and how is it taught to residents? A systematic review. BMC Fam Pract. 2020;21(1):49. https://doi.org/10.1186/s12875-020-01120-1.

    Article  Google Scholar 

  20. Doja A, Bould MD, Clarkin C, Eady K, Sutherland S, Writer H. The hidden and informal curriculum across the continuum of training: a cross-sectional qualitative study(). Med Teach. 2016;38(4):410–8. https://doi.org/10.3109/0142159X.2015.1073241.

    Article  Google Scholar 

  21. Hafferty FW. Beyond curriculum reform: confronting medicine's hidden curriculum. Acad Med. 1998;73(4):403–7. https://doi.org/10.1097/00001888-199804000-00013.

    Article  Google Scholar 

  22. Park ER, Betancourt JR, Kim MK, Maina AW, Blumenthal D, Weissman JS. Mixed messages: residents’ experiences learning cross-cultural care. Acad Med. 2005;80(9):874–80. https://doi.org/10.1097/00001888-200509000-00019.

    Article  Google Scholar 

  23. Weissman JS, Betancourt J, Campbell EG, Park ER, Kim M, Clarridge B, et al. Resident physicians’ preparedness to provide cross-cultural care. Jama. 2005;294(9):1058–67. https://doi.org/10.1001/jama.294.9.1058.

    Article  Google Scholar 

  24. Pieper HO, MacFarlane A. “I’m worried about what I missed”: GP registrars’ views on learning needs to deliver effective healthcare to ethnically and culturally diverse patient populations. Educ Health (Abingdon, England). 2011;24(1):494.

    Google Scholar 

  25. Dogra N, Bhatti F, Ertubey C, Kelly M, Rowlands A, Singh D, et al. Teaching diversity to medical undergraduates: curriculum development, delivery and assessment. AMEE GUIDE no. 103. Med Teach. 2016;38(4):323–37. https://doi.org/10.3109/0142159X.2015.1105944.

    Article  Google Scholar 

  26. Cook DA, Erwin PJ, Triola MM. Computerized virtual patients in health professions education: a systematic review and meta-analysis. Acad Med. 2010;85(10):1589–602. https://doi.org/10.1097/ACM.0b013e3181edfe13.

    Article  Google Scholar 

  27. Ekblad S, Mollica RF, Fors U, Pantziaras I, Lavelle J. Educational potential of a virtual patient system for caring for traumatized patients in primary care. BMC Med Educ. 2013;13(1):110. https://doi.org/10.1186/1472-6920-13-110.

    Article  Google Scholar 

  28. Hawthorne K, Prout H, Kinnersley P, Houston H. Evaluation of different delivery modes of an interactive e-learning programme for teaching cultural diversity. Patient Educ Couns. 2009;74(1):5–11. https://doi.org/10.1016/j.pec.2008.07.056.

    Article  Google Scholar 

  29. Smith BD, Silk K. Cultural competence clinic: an online, interactive, simulation for working effectively with Arab American Muslim patients. Acad Psychiatry. 2011;35(5):312–6. https://doi.org/10.1176/appi.ap.35.5.312.

    Article  Google Scholar 

  30. Pantziaras I. Virtual patients as an innovative educational tool in transcultural psychiatry [Elektronisk resurs]. Stockholm: Karolinska Institutet; 2015.

    Google Scholar 

  31. Pantziaras I, Fors U, Ekblad S. Training with virtual patients in transcultural psychiatry: do the learners actually learn? J Med Internet Res. 2015;17(2):e46. https://doi.org/10.2196/jmir.3497.

    Article  Google Scholar 

  32. Pantziaras I, Fors U, Ekblad S. Innovative training with virtual patients in transcultural psychiatry: the impact on resident psychiatrists’ confidence. PLoS One. 2015;10(3):e0119754. https://doi.org/10.1371/journal.pone.0119754.

    Article  Google Scholar 

  33. Ellaway R, Poulton T, Fors U, McGee JB, Albright S. Building a virtual patient commons. Med Teach. 2008;30(2):170–4. https://doi.org/10.1080/01421590701874074.

    Article  Google Scholar 

  34. Consorti F, Mancuso R, Nocioni M, Piccolo A. Efficacy of virtual patients in medical education: a meta-analysis of randomized studies. Comput Educ. 2012;59(3):1001–8. https://doi.org/10.1016/j.compedu.2012.04.017.

    Article  Google Scholar 

  35. Kononowicz AA, Woodham LA, Edelbring S, Stathakarou N, Davies D, Saxena N, et al. Virtual patient simulations in health professions education: systematic review and meta-analysis by the digital health education collaboration. J Med Internet Res. 2019;21(7):e14676. https://doi.org/10.2196/14676.

    Article  Google Scholar 

  36. Yardley S, Teunissen PW, Dornan T. Experiential learning: AMEE guide no. 63. Med Teach. 2012;34(2):e102–15. https://doi.org/10.3109/0142159X.2012.650741.

    Article  Google Scholar 

  37. Fors UG, Muntean V, Botezatu M, Zary N. Cross-cultural use and development of virtual patients. Med Teach. 2009;31(8):732–8. https://doi.org/10.1080/01421590903124724.

    Article  Google Scholar 

  38. Mollica R, Lavelle J, Fors U, Ekblad S. Using the Virtual Patient to Improve the Primary Care of Traumatized Refugees. J Med Educ. 2017;16(1):2–16.

    Google Scholar 

  39. Botezatu M, Hult H, Tessma MK, Fors U. Virtual patient simulation: knowledge gain or knowledge loss? Med Teach. 2010;32(7):562–8. https://doi.org/10.3109/01421590903514630.

    Article  Google Scholar 

  40. Botezatu M, Hult H, Tessma MK, Fors UG. Virtual patient simulation for learning and assessment: superior results in comparison with regular course exams. Med Teach. 2010;32(10):845–50. https://doi.org/10.3109/01421591003695287.

    Article  Google Scholar 

  41. Friedman CP. The research we should be doing. Acad Med. 1994;69(6):455–7. https://doi.org/10.1097/00001888-199406000-00005.

    Article  Google Scholar 

  42. Cook DA. The research we still are not doing: an agenda for the study of computer-based learning. Acad Med. 2005;80(6):541–8. https://doi.org/10.1097/00001888-200506000-00005.

    Article  Google Scholar 

  43. Ellaway RH. Virtual patients as activities: exploring the research implications of an activity theoretical stance. Perspect Med Educ. 2014;3(4):266–77. https://doi.org/10.1007/s40037-014-0134-z.

    Article  Google Scholar 

  44. Ellaway RH, Davies D. Design for learning: deconstructing virtual patient activities. Med Teach. 2011;33(4):303–10. https://doi.org/10.3109/0142159X.2011.550969.

    Article  Google Scholar 

  45. Adams EC, Rodgers CJ, Harrington R, Young MD, Sieber VK. How we created virtual patient cases for primary care-based learning. Med Teach. 2011;33(4):273–8. https://doi.org/10.3109/0142159X.2011.544796.

    Article  Google Scholar 

  46. Roberts JH. Supporting GP trainees to practice medicine in a culturally complex world. Educ Primary Care. 2019:1–2.

  47. Graneheim UH, Lundman B. Qualitative content analysis in nursing research: concepts, procedures and measures to achieve trustworthiness. Nurse Educ Today. 2004;24(2):105–12. https://doi.org/10.1016/j.nedt.2003.10.001.

    Article  Google Scholar 

  48. Anell A, Glenngard AH, Merkur S. Sweden health system review. Health Syst Transit. 2012;14(5):1–159.

    Google Scholar 

  49. Moser A, Korstjens I. Series: practical guidance to qualitative research. Part 3: sampling, data collection and analysis. Eur J Gen Pract. 2018;24(1):9–18. https://doi.org/10.1080/13814788.2017.1375091.

    Article  Google Scholar 

  50. Malterud K, Siersma VD, Guassora AD. Sample size in qualitative interview studies: guided by information power. Qual Health Res. 2016;26(13):1753–60. https://doi.org/10.1177/1049732315617444.

    Article  Google Scholar 

  51. Brottman MR, Char DM, Hattori RA, Heeb R, Taff SD. Toward cultural competency in health care: a scoping review of the diversity and inclusion education literature. Acad Med. 2020;95(5):803–13.

  52. Berman N, Fall LH, Smith S, Levine DA, Maloney CG, Potts M, et al. Integration strategies for using virtual patients in clinical clerkships. Acad Med. 2009;84(7):942–9. https://doi.org/10.1097/ACM.0b013e3181a8c668.

    Article  Google Scholar 

  53. Eraut M. Non-formal learning and tacit knowledge in professional work. Br J Educ Psychol. 2000;70(Pt 1):113–36. https://doi.org/10.1348/000709900158001.

    Article  Google Scholar 

  54. Tynjälä P. Perspectives into learning at the workplace. Educ Res Rev. 2008;3(2):130–54. https://doi.org/10.1016/j.edurev.2007.12.001.

    Article  Google Scholar 

  55. Hege I, Kononowicz AA, Tolks D, Edelbring S, Kuehlmeyer K. A qualitative analysis of virtual patient descriptions in healthcare education based on a systematic literature review. BMC Med Educ. 2016;16(1):146. https://doi.org/10.1186/s12909-016-0655-8.

    Article  Google Scholar 

  56. Salminen H, Zary N, Bjorklund K, Toth-Pal E, Leanderson C. Virtual patients in primary care: developing a reusable model that fosters reflective practice and clinical reasoning. J Med Internet Res. 2014;16(1):e3. https://doi.org/10.2196/jmir.2616.

    Article  Google Scholar 

  57. Alam R, Cheraghi-Sohi S, Panagioti M, Esmail A, Campbell S, Panagopoulou E. Managing diagnostic uncertainty in primary care: a systematic critical review. BMC Fam Pract. 2017;18(1):79. https://doi.org/10.1186/s12875-017-0650-0.

    Article  Google Scholar 

  58. Cooke G, Tapley A, Holliday E, Morgan S, Henderson K, Ball J, et al. Responses to clinical uncertainty in Australian general practice trainees: a cross-sectional analysis. Med Educ. 2017;51(12):1277–88. https://doi.org/10.1111/medu.13408.

    Article  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

This work was supported by FORTE under grant number 2014–0853 and by Stockholm County Council (Region Stockholm) and Karolinska Institutet under grant number 20130186. Open Access funding provided by Karolinska Institute.

Author information

Authors and Affiliations

Authors

Contributions

ER, UF, HS, PW and SE discussed the scope and design of the study. ER, UF and SE cooperated on developing the virtual patients with the input from HS and PW. ER conducted and transcribed the interviews. ER and SE analyzed the data, while the coding tree was discussed with the other co-authors. ER wrote the initial manuscript and revised it according to each co-author’s suggestions. All authors approved the final version of the manuscript submitted.

Corresponding author

Correspondence to Erica Rothlind.

Ethics declarations

Ethics approval and consent to participate

The study was approved by the Regional Ethical Review Board in Stockholm (2015/1228–31/5, 2016–2308-32 and 2020–01486). Written informed consent was obtained from all informants.

Consent for publication

Consent for publication of the image in Fig. 1 was obtained from the person portraying the VP. Regarding the informants it was not applicable as the quotations included are anonymized.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

The interview guide developed by the research team.

Additional file 2.

COREQ checklist.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Rothlind, E., Fors, U., Salminen, H. et al. Virtual patients reflecting the clinical reality of primary care – a useful tool to improve cultural competence. BMC Med Educ 21, 270 (2021). https://doi.org/10.1186/s12909-021-02701-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12909-021-02701-z

Keywords