Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Impact of game jam learning about cultural safety in Colombian medical education: a randomised controlled trial

BMC Medical Education volume 21, Article number: 132 (2021) Cite this article

Abstract

Background

Cultural safety, whereby health professionals respect and promote the cultural identity of patients, could reduce intercultural tensions that hinder patient access to effective health services in Colombia. Game jams are participatory events to create educational games, a potentially engaging learning environment for Millennial medical students. We set out to determine whether medical student participation in a game jam on cultural safety is more effective than more conventional education in changing self-reported intended patient-oriented behavior and confidence in transcultural skills.

Methods

We conducted a parallel-group, two-arm randomized controlled trial with 1:1 allocation. Colombian medical students and medical interns at University of La Sabana participated in the trial. The intervention was a game jam to create an educational game on cultural safety, and the reference was a standard lesson plus an interactive workshop on cultural safety. Both sessions lasted eight hours. Stratified randomization allocated the participants to the intervention and control groups, with masked allocation until commencement.

Results

531 students completed the baseline survey, 347 completed the survey immediately after the intervention, and 336 completed the survey after 6 months. After the intervention, game jam participants did not have better intentions of culturally safe behaviour than did participants in the reference group (difference in means: 0.08 95% CI − 0.05 to 0.23); both groups had an improvement in this outcome. Multivariate analysis adjusted by clusters confirmed that game jam learning was associated with higher transcultural self-efficacy immediately after the intervention (wt OR 2.03 cl adj 95% CI 1.25–3.30).

Conclusions

Game jam learning improved cultural safety intentions of Colombian medical students to a similar degree as did a carefully designed lecture and interactive workshop. The game jam was also associated with positive change in participant transcultural self-efficacy. We encourage further research to explore the impact of cultural safety training on patient-related outcomes. Our experience could inform initiatives to introduce cultural safety training in other multicultural settings.

Trial registration

Registered on ISRCTN registry on July 18th 2019. Registration number: ISRCTN14261595.

Peer Review reports

Background

In Colombia, more than 40% of the population turn to traditional and cultural health practices, [1] but public and private institutions promote health services grounded in the Western biomedical model. Medical students are not trained to acknowledge and address intercultural tensions that arise in clinical practice. These tensions hinder patient access to effective health services, [2, 3] especially for those who use traditional health practices [4]. Cultural safety training of Colombian health professionals could address intercultural tensions, thus improving the access of patients from non-dominant cultures to health services.

Cultural safety is “a space that is spiritually, socially, emotionally and physically safe for people; where there is no assault, challenge or denial of their identity, of who they are, and what they need.”(p213, [5]) Irihapeti Ramsden, a Maori nurse, developed the concept to bridge the cultural divide between the Maori people and official health services in New Zealand [6]. A concept analysis of cultural safety [7] identified three foundations: equal partnership, active participation of patients from non-dominant cultures, and protection of cultural identity and well-being.

Cultural safety has gained attention because it offers a more respectful way to approach culture than cultural competence, the current standard approach [8]. Unlike cultural competence, cultural safety invites patients from non-dominant cultures to co-design and evaluate culturally safe health care [7, 9]. This participation in health care design also differentiates cultural safety from cultural humility, [10] another popular approach to cultural diversity in health care.

Observational studies suggest that cultural safety training may enhance respect for and acceptance of traditional and cultural health practices. It may also improve the relationships between health professionals and patients from non-dominant cultures, promote changes in knowledge, attitudes, self-confidence and behavior of health professionals, and lead to healthier outcomes [11]. There is a recognised lack of rigour in cultural safety assessment, however, and a need for formal randomised controlled trials (RCT) to evaluate cultural safety education [12].

Cultural safety is a well-established concept in New Zealand and Australia, but Canadian researchers and educators have only recently called for implementing cultural safety in healthcare practice [13]. There is little research on how best to apply this approach in medical education, [14] and on how health professionals can gain cultural safety skills [15]. There is also a pressing need to expand cultural safety initiatives to other culturally diverse settings, such as Latin American countries, and in non-Indigenous populations [7].

Cultural safety education of medical students is challenging. Contemporary medical training is overloaded, with little space to introduce new subjects. Educators might find cultural safety complicated to teach and medical students might perceive it to be dull or even unnecessary [16]. Going beyond simple knowledge acquisition, the educational experience of cultural safety must be transformative if it is to impact behavior [12]. Millennial students have novel ways of learning that include technology, creativity, and amusement [17, 18]. Game jams offer an engaging learning environment for this generation. Game jams are participatory events for attendees to create games in a time-constrained environment, typically 48 h [19]. The experience fosters learning through interacting with others, [20] an essential aspect of transformative learning [21]. Game jams have a positive impact on the performance of computing students, [19, 20] personal, interpersonal, and STEAM (science, technology, engineering, arts, and mathematics) skills, and game development skills [22].

The educational dimension of game jams is promising, but this research is still in its infancy [22]. To the best of our knowledge, the current literature reflects no game jam learning initiative with medical students, and no RCT has explored cultural safety in medical education. Our primary aim was thus to determine whether medical student participation in a game jam on cultural safety is more effective than a standard lesson in changing self-reported intended patient-oriented behavior. The secondary objective was to determine the impact of game jam learning on student confidence in their general transcultural skills.

Methods

Trial design

A parallel-group, two-arm RCT with 1:1 allocation compared game jam participation with a standard lesson plus an interactive workshop on cultural safety. The RCT addressed the question: Among medical students and interns from University of La Sabana, compared with a standard lesson plus a workshop on cultural safety, does game jam participation result in improved student and intern self-reported intended behavior, and confidence in transcultural skills?

We followed the CONSORT 2010 updated guidelines for reporting parallel group randomised trials [23] (Additional file 1: CONSORT 2010 checklist of the study). We registered our study on ISRCTN registry on July 18th, 2019 (registration number: ISRCTN14261595, [24]} and published the protocol of our study prior to completion of recruitment [25] (Additional file 2).

Study setting and participants

La Sabana, in Chia municipality near Bogota, is a private university with 8926 undergraduate students. In July 2019, there were 956 medical students and 256 medical interns (N = 1212) enrolled in the Faculty of Medicine [26]. In Colombia, medical interns are undergraduate medical trainees who have completed their basic medical training and are undertaking one to 2 years of supervised medical practice in teaching hospitals. The inclusion criteria for this trial were being a medical student or medical intern at any level of training and giving written informed consent. The exclusion criteria were being underage or not wanting to take part in the study.

Interventions

The trial intervention was a game jam to create a low-tech prototype of an educational game promoting cultural safety in medical education. Groups of five or six students or medical interns took part in a six-step game jam comprising: (a) preliminary lecture session (one hour); (b) opening ceremony; (c) game building (four hours); (d) game testing (one hour); (e) game refining (30 min); and (f) closing (one-and-a-half-hours).

Shortly before the intervention began, our academic partners at the University of La Sabana requested an interactive workshop, to foster problem-based and communicative learning, for the control group, rather than just a standard lesson. The reference group thus received a different intervention, beginning with a one-and-a-half-hour lecture on cultural safety. After the PowerPoint-based lesson, a six-hour interactive workshop focused on selected cultural safety readings. Groups of five or six students or medical interns followed a study guide based on the lecture and the readings, creating posters to display their responses to other students. The activity duration was the same (eight hours) in the game jam and reference groups.

Because during game jams participants typically devote most of their time to creating games, the game jam lecture was slightly shorter than the reference group lecture. Both lectures reflected a cultural safety curriculum previously co-designed with traditional medicine users, medical students, and cultural safety experts. A protocol of the study to co-design the curriculum is available, [27] and the results will be reported soon. To develop the curriculum, stakeholders responded to semi-structured questionnaires, and participated in focus groups and deliberative dialogue groups. A member-checking strategy shared the co-designed curriculum with the stakeholders, who modified and approved the final version. The curriculum has five learning objectives: (a) culturally unsafe practices: acknowledge the intercultural tensions in health care and its consequences; (b) cultural awareness: examine their own attitudes, beliefs, and values, and how they shape their professional practice; (c) cultural humility: listen and learn from their patients’ traditional practices; (d) cultural competence: describe and compare current pedagogical approaches to address cultural diversity in healthcare and their limitations; and (e) cultural safety: discuss with patients to agree on their treatment. We assessed acceptability of an early version of the curriculum in our pilot RCT, which will be reported soon.

A Colombian MD with a Master of Science in Epidemiology, 6 years of teaching experience, and 9 years of intercultural research experience led the intervention group activities. A Colombian MD with a Master of Public Health, 18 years of teaching experience and 20 years of intercultural research experience, led the reference group activities.

Outcomes

To the best of our knowledge, there are no validated research instruments to measure cultural safety outcomes in medical trainees. Cultural safety training should go beyond mere knowledge acquisition to promote behavioral changes. The primary outcome of the trial was the students’ self-reported intention to change their patient-related behavior. This was measured by the response to the statement: I will never be open to include my patients’ cultural beliefs and practices in the health decision-making process. It corresponded to the Intention to Change intermediate outcome of the CASCADA model of planned behavior, [28] which has been successfully used to explore dengue prevention behavior [29]. We assessed the students’ intended behavior instead of actual practice or action, which would have required follow-up of clinical practice over several years. Our primary concern was the sustained intention to change measured 6 months post-intervention.

A supplementary analysis using transitive closure [30] examined the primary outcome in the context of the CASCADA results chain of Conscious knowledge, Attitude, Subjective norm, Intention to Change, Agency, and Discussion related to cultural safety. The questions used to assess each component of the CASCADA model are available (Additional file 3).

Several authors state that cultural safety is preceded by generic cultural knowledge and skills. Brascoupé, for example, points out that cultural competence provides a foundation for cultural safety [31]. Ramsden sees cultural safety training as a dynamic process moving from cultural awareness to cultural sensitivity to cultural safety [3]. Following this rationale, our secondary outcome was students’ confidence in their general transcultural skills (transcultural self-efficacy).

We assessed our primary and secondary outcomes at baseline, immediately following the teaching session, and 6 months post-intervention. The 37-item instrument included three parts. The first part (11 items) explored sociodemographic characteristics. The second part (19 items) was based on the validated Likert-type Transcultural Self–Efficacy Tool — Multidisciplinary Healthcare Provider version (TSET–MHP) [32]. The third part (cultural safety), was a seven-item Likert-type local questionnaire based on our CASCADA variables and tested for validity and reliability in our pilot RCT. Participants responded to questions using mobile devices and SurveyMonkey.

Sample size

Using the pwr package in R, [33] we estimated that a group size of 199 participants in the game jam group and 199 participants in the control group (sample size = 398) could detect an effect size of 0.25, with a two-sided alpha = 0.05 and a power = 0.8. Our pilot RCT found an effect size (Cohen’s d) of 0.25 between intervention and control arms after the teaching session. Because we observed considerable contamination between intervention and control groups in the pilot, 0.25 was a conservative estimate of effect size.

Recruitment and randomisation

We contacted medical students and medical interns via email, using mailing lists from the University of La Sabana, to invite them to participate. We stratified randomization by student intended patient-oriented behavior at baseline to address a possible imbalance in cultural safety awareness between the intervention and control groups before the intervention. The results of the baseline survey stratified medical students into groups with low and high scores for cultural safety. Computerized randomization allocated the students equally (1:1) to intervention or control arms. The first author generated the allocation sequence, enrolled participants, and assigned them to intervention or control group.

Blinding is nearly impossible in education research RCTs, but participants were not aware of the allocation sequence or their group allocation until the start of the intervention. They only knew the auditorium they had to attend on the day of the intervention. Twenty facilitators prevented students from switching allocation status.

Data analysis

We used an intention-to-treat approach for the primary and secondary analysis. The primary analysis used a t-test to assess the effect of the intervention on the primary outcome 6 months after the intervention. Additionally, probabilistic transitive closure explored the influence of the CASCADA results chain on the primary outcome. This approach, developed by Andersson and colleagues, [30] estimated the net influence of each element of the results chain on each other element, and the penultimate outcome, which was Discussion [34].

The secondary analysis focused on the secondary outcome of transcultural self-efficacy. A paired t-test assessed within-group comparisons (baseline and post-intervention I and II) and a simple t-test assessed between-group comparisons (treated versus control post-intervention) of the students’ confidence (transcultural self-efficacy) in their general transcultural skills. Additionally, a simple t-test compared the mean difference in the mean between the baseline and the third timepoint between the intervention and control groups.

For statistically significant differences in the between-group comparisons, we conducted a multivariate analysis to adjust for baseline variables. These included sex, place of birth and residence, subsistence farmers in the family, socioeconomic level, traditional medicine use by the family or the participant, medicinal plants planted at home, level of training, age, and clustering (work group during the intervention or control activities).

The multivariate analysis relied on the Mantel-Haenszel approach adjusted for cluster. We repeated the analysis using generalized estimating equations (GEE) to cross-check our results. The Lamothe cluster-adjusted Mantel-Haenszel is a non-parametric approach that is simple to compute and does not require any assumptions for binomial data [35, 36]. GEE is not intended to model between-cluster variation but focuses on the within cluster similarity of the residuals [36, 37].

Sensitivity and subgroup analyses using the Lamothe cluster-adjusted Mantel-Haenszel procedure explored the effect of game jam learning on transcultural self-efficacy within different groups (such as those using or not using traditional medicine at baseline). All statistical tests were two-sided at the 0.05 level of significance. The Bonferroni method [38] adjusted the level of significance for the number of tests used to assess the primary and secondary outcomes. To determine the number of tests used, we considered the type of test (simple or paired) and outcome (primary or secondary).

Ethics

This study embraced the bioethical principles proposed by the Council for International Organizations of Medical Sciences, [39] the Declaration of Helsinki, [40] the guidelines on conducting research in class from the University of Alberta, [41] and the Tri-Council Policy Statement [42].

The Institutional Review Board of the McGill’s Faculty of Medicine (approval number A05-B37-17B) and the Sub-committee for Research of the Faculty of Medicine at University of La Sabana (approval number 445) provided ethical clearance for the study. All participants signed written informed consent before proceeding with any research activity.

Results

Some 531 students completed the baseline survey and were randomised; 347 students completed the second timepoint assessment, and 336 students completed the third timepoint assessment (Fig. 1). Of the 195 participants who were lost to follow-up, most completed the baseline survey and were randomised, but could not attend the study activities because of scheduling clashes. Additional file 4 is an attrition diagram [43] demonstrating the retention of participants over time.

Fig. 1
figure 1

CONSORT flow diagram of the RCT

Full size image

The intervention and control groups were similar for all baseline sociodemographic characteristics (Table 1). Some 85.4% (229/268) and 78.7% (207/263) of the students’ families had used traditional medicine in the intervention and control group, respectively; this difference was marginally statistically significant. 61.2% (164/268) and 54.4% (143/263) of the participants had used traditional medicine in the intervention and control group (Table 1). This difference was not statistically significant at the 5% level.

Table 1 Baseline sociodemographic characteristics of the participants of the study
Full size table

Game jam participants did not have better intended culturally safe behaviour than did participants in the lesson and interactive workshop (difference in means: 0.08, 95% CI − 0.05 to 0.23). Game jam learning was superior to the more conventional learning in terms of transcultural self-efficacy immediately after the intervention (difference in means: 0.12, 95% CI 0.02 to 0.2), but not 6 months after the intervention (difference in means: 0.6, 95% CI − 0.06 to 0.11) (Table 2). We did not detect a statistically significant difference in the mean change between the baseline and the third timepoint between the intervention and control groups.

Table 2 Difference in the means of primary and secondary outcomes between intervention groups
Full size table

Probabilistic transitive closure of the CASCADA results chain showed good progression to the last outcome (Discussion) with no blocks in the game jam and control groups (net influence of 13.75 and 13.34 respectively). The baseline values favoured the control group (net influence of 5.12 in the intervention arm and 9.7 in the control arm). The change from baseline to the 6 month assessment was larger in the intervention group.

The game jam and standard lesson plus workshop both had positive and similar effects on the primary and secondary outcomes (Table 3). We used the Bonferroni correction to adjust the alpha level of the simple and paired t-test exploring differences in the primary and secondary outcomes. All non-adjusted significant associations remained significant after adjustment.

Table 3 Difference in primary and secondary outcomes within intervention groups
Full size table

The multivariate analysis using the Mantel-Haenszel approach adjusted by clusters confirmed that game jam learning and traditional medicine use reported by students was associated with higher transcultural self-efficacy immediately after the intervention (wt OR 2.03 cl adj 95% CI 1.25–3.30 and wt OR 1.98 cl adj 95% CI 1.11–2.84, respectively). GEE confirmed that game jam learning was associated with higher transcultural self-efficacy immediately after the intervention (adj OR = 2.09 95% CI 1.22–3.60).

Although not statistically significant at the 5% level, sensitivity analysis suggested a stronger effect of game jam learning on transcultural self-efficacy among students who were male, born and living in Bogota, with no subsistence farmers in the family, and from a higher socioeconomic level (Fig. 2).

Fig. 2
figure 2

Game jam learning effect on transcultural self-efficacy according to subgroup

Full size image

Discussion

Separately, both the game jam and the lesson plus interactive workshop had positive impacts on the primary and secondary outcomes. Both groups received training on the same key elements of cultural safety based on a rigorous curriculum that Colombian stakeholders co-created through a sequential-consensual qualitative study [27]. Notwithstanding the original hypothesis, our study provides evidence of the effectiveness of cultural safety training based on our co-designed curriculum.

In this trial, game jam learning changed cultural safety intention, but it was not superior to more conventional learning approaches. We are aware of several potential explanations for this. First, contamination is a well-known concern of parallel-group RCTs in education and could have influenced the results of the primary outcome comparison. During the 6 months before the third timepoint, individuals who received the intervention could have leaked information about their experience in the game jam, influencing results in the control group. This would have reduced the measured impact of the intervention, making it more difficult to find a significant difference between the groups [44]. Second, a Hawthorne effect, triggered by awareness of observation and assessment, [45] could have influenced both the intervention and control group participants, thus decreasing the opportunity to detect a significant difference between the groups. Third, in designing the study we used the World Health Organization estimate that 40% of Colombians seek care in traditional and cultural health practices [1]. In the pre-intervention baseline, however, we found more than twice that proportion came from families that used traditional medicine (Table 1). This was associated with quite high initial levels of intended culturally safe behavior and reduced the potential for improvement after the intervention.

Fourth, and probably most important, the academic partners at the University of La Sabana requested an interactive complementary activity for the control group in the form of a workshop, to foster problem-based and communicative learning, two of the main elements of transformative learning [46]. This turned the “control” into an intervention in its own right. A professor with substantial intercultural experience led the control group activities, resulting in an unusually strong learning experience in the control group.

We believe the game jam learning would show a bigger impact if contrasted with a standard lesson on the subject without components of transformative learning. Medical education studies often use no control group and, when they use one, control participants receive no training on the subject of interest [47]. Cook summarized four meta-analyses [48,49,50,51] with over 750 studies comparing various forms of education against no intervention. Almost all these studies favoured the training group for outcomes of knowledge, skills, and behaviours, [47] confirming that an “educational placebo-controlled trial has very limited value.” [52] Similar to clinical research, where placebo-controlled research is often unethical, recent trends in medical education research advocate for comparative effectiveness, where control groups receive active interventions [53]. Despite such a study being harder to design and conduct, in our trial we opted to assess comparative effectiveness. Studies using this approach require much larger sample sizes than placebo-controlled trials since the expected effect size is reduced [47]. The effective sample size for our analysis of the primary outcome was smaller than the calculated sample size.

Our multivariate analysis confirmed that game jam learning was associated with higher transcultural self-efficacy immediately after the intervention. A recent game jam promoted self-discovery, reflections on identity, and support for the cultural identity of the Sami people in Finland [54]. Ramsden suggested that cultural safety is a continuum rather than a fixed state, with prior steps such as cultural awareness and cultural sensitivity [55]. Our co-designed curriculum, which informed the intervention and control learning activities, also included prior steps before cultural safety, such as cultural risk, awareness, humility, and competence. These prior steps might be more easily identified by the TSET, which detects changes in knowledge, attitudes, and skills of cultural competence [56]. As opposed to the section of the questionnaire that explored changes in the primary outcome of cultural safety intention, the TSET is a widely validated and used research instrument, [57] which could have facilitated detecting a significant effect on the secondary outcome of transcultural self-efficacy.

Limitations

Reproducibility of educational interventions is hard to ensure due to the well-known “teacher effect”, with results of teaching interventions depending on the abilities and skills of individual instructors [58]. We followed recommendations to maximize the reproducibility and generalisability of our intervention, [59] like describing the intervention in detail to allow reproducibility and scrutiny in the future and providing the background of the instructors involved in the study activities. We recognize the experience of the reference group instructor influenced results in this group, effectively reducing the difference between this group and the game jam group.

We did not achieve and retain our intended sample size of 398 trainees, and this reduced the power of the study to detect differences, especially at the second and third timepoints. Future medical education RCTs should use more robust logistical methods to ensure the desired sample size is achieved and retained.

There is merit in using patient-related outcomes such as evaluations of care received, health outcomes, and health behaviors to assess the effect of cultural safety interventions [60]. Given the time available for the study and the complexity of assessing patient-related outcomes in medical student education, we used education-related outcomes based on a theory of planned behavior. We included a qualitative understanding through the Most Significant Change evaluation (to be reported separately). Future cultural safety training initiatives should include patient-related outcomes to determine the impact of the interventions directly on the patients and their communities.

Finally, our findings are specific to the Colombian cultural context. In other settings, where traditional health practices are not widespread, it might be necessary to provide cultural safety training based on other cultural characteristics. For example, there are cultural safety experiences reported in Canada with Amish and Low German Mennonites [61].

Conclusion

Game jam learning improved cultural safety intentions of Colombian medical students to a similar degree as did a carefully designed lecture and workshop. The game jam was also associated with positive change in participant transcultural self-efficacy. Potential contamination and a strong control learning activity with an experienced instructor and elements of transformative learning likely precluded the detection of a significant difference in the primary outcome.

This is the first published RCT of cultural safety in medical education and one of few attempts to apply cultural safety to non-Indigenous yet culturally rich settings. Our research yielded key lessons applicable to other multicultural countries requiring cultural safety training in medical education. We encourage further research to explore the impact of cultural safety training on population health, ideally using patient-related outcomes and designs that are less prone to contamination, such as cluster RCTs.

Protocol: The protocol of this RCT was accepted for publication before completion of recruitment [25].

Availability of data and materials

The datasets used and/or analysed during the current study will be available from the corresponding author on reasonable request.

Abbreviations

STEAM:

Science, technology, engineering, arts, and mathematics

RCT:

Randomised Controlled Trial

CONSORT:

Consolidated Standards of Reporting Trials

CASCADA:

Conscious knowledge, Attitudes, Subjective norms, Change intention, sense of Agency, socialization/Discussion, and behavior change/Action

TSET–MHP:

Transcultural Self–Efficacy Tool — Multidisciplinary Healthcare Provider version

SD:

Standard Deviation

GEE:

Generalized estimating equation

References

  1. World Health Organization. WHO Traditional Medicine Strategy 2002–2005; 2002. p. 1–74. https://apps.who.int/medicinedocs/en/d/Js2297e/. Accessed 3 Aug 2020

    Google Scholar 

  2. Parra L, Pacheco AM. Monologue or intercultural dialogue between medical systems? An educational challenge for medical sciences. Rev Cienc Salud. 2006;4:1–12.

    Google Scholar 

  3. Institute of Medicine (U.S.). Committee on Understanding and Eliminating Racial and Ethnic Disparities in Health Care. Unequal treatment. Washington, DC: National Academies Press; 2003.

    Google Scholar 

  4. Bernal R, Cárdenas M. Race and ethnic inequality in health and health Care in Colombia. In: Giuffrida A, editor. Racial and ethnic disparities in health in Latin America and the Caribbean. Washington DC: Inter-American Development Bank; 2007. p. 23–64.

    Google Scholar 

  5. Williams R. Cultural safety - what does it mean for our work practice? Aust N Z J Public Health. 1999;23:213–4.

    Article  Google Scholar 

  6. Hill P. Whanau Kawa Whakaruruhau. Cultural safety hui of Whanau Kawa Whakaruruhau, Apumoana Marae, Rotorua. Palmerston North: PSI Solutions; 1991.

    Google Scholar 

  7. Blanchet Garneau A, Pepin J. La sécurité culturelle : une analyse du concept. Rech Soins Infirm; 2012. p. N° 111–22.

    Google Scholar 

  8. Kirmayer LJ. Rethinking cultural competence. Transcult Psychiatry. 2012;49:149–64.

    Article  Google Scholar 

  9. Maar MA, Beaudin V, Yeates K, Boesch L, Liu P, Madjedi K, et al. Wise practices for cultural safety in electronic Health Research and clinical trials with indigenous people: secondary analysis of a randomized clinical trial. J Med Internet Res. 2019;21:e14203.

    Article  Google Scholar 

  10. Greene-Moton E, Minkler M. Cultural competence or cultural humility? Moving beyond the debate. Health Promot Pract. 2020;21:142–5.

    Article  Google Scholar 

  11. Kurtz DLM, Janke R, Vinek J, Wells T, Hutchinson P, Froste A. Health sciences cultural safety education in Australia, Canada, New Zealand, and the United States: a literature review. Int J Med Educ. 2018;9:271–85.

    Article  Google Scholar 

  12. Medel S. The impact of indigenous cultural-safety Education programs: a literature review. Burnaby: Simon Fraser University; 2019.

  13. Vogel L. Residency programs grapple with new indigenous cultural safety training requirement. Can Med Assoc J. 2018;190:E778–9.

    Article  Google Scholar 

  14. Guerra O, Kurtz D. Building collaboration: a scoping review of cultural competency and safety Education and training for healthcare students and professionals in Canada. Teach Learn Med. 2017;29:129–42.

    Article  Google Scholar 

  15. Thackrah RD, Thompson SC. Applying a midwifery Lens to indigenous health care delivery: the contribution of campus learning and rural placements to effecting systemic change. Can J Nurs Res. 2018;50:179–88.

    Article  Google Scholar 

  16. Dykes DC, White AA. Culturally competent care pedagogy: what works? Clin Orthop Relat Res. 2011;469:1813–6.

    Article  Google Scholar 

  17. Eckleberry-Hunt J, Tucciarone J. The challenges and opportunities of teaching “generation Y”. J Grad Med Educ. 2011;3:458–61.

    Article  Google Scholar 

  18. Hawala-Druy S, Hill MH. Interdisciplinary: cultural competency and culturally congruent education for millennials in health professions. Nurse Educ Today. 2012;32:772–8.

    Article  Google Scholar 

  19. Preston JA, Chastine J, O’Donnell C, Tseng T, MacIntyre B. Game Jams. Int J Game-Based Learn. 2012;2:51–70.

    Article  Google Scholar 

  20. Fowler A, Ni X (Sherry), Preston J. The Pedagogical Potential of Game Jams. In: Proceedings of the 19th Annual SIG Conference on Information Technology Education - SIGITE ‘18. New York: ACM Press; 2018. p. 112–6.

    Chapter  Google Scholar 

  21. Mezirow J. Transformative learning: theory to practice. New Dir Adult Contin Educ. 1997;1997:5–12.

    Article  Google Scholar 

  22. Meriläinen M, Aurava R, Kultima A, Stenros J. Game jams for learning and teaching. Int J Game-Based Learn. 2020;10:54–71.

    Article  Google Scholar 

  23. Schulz KF, Altman DG, Moher D. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. PLoS Med. 2010;7:e1000251.

    Article  Google Scholar 

  24. Pimentel J, Cockcroft A, Andersson N. Game-based learning for cultural safety training of Colombian medical students: a randomized controlled trial. ISRCTN14261595; 2019. https://doi.org/10.1186/ISRCTN14261595.

    Book  Google Scholar 

  25. Pimentel J, Cockcroft A, Andersson N. Impact of co-designed game learning on cultural safety in Colombian medical Education: protocol for a randomized controlled trial. JMIR Res Protoc. 2020;9:e17297.

    Article  Google Scholar 

  26. La Sabana University. The University in Figures. 2018. https://www.unisabana.edu.co/nosotros/la-sabana-en-cifras/. Accessed 1 Apr 2020.

    Google Scholar 

  27. Pimentel J, Zuluaga G, Isaza A, Molina A, Cockcroft A, Andersson N. Curriculum Co-design for Cultural Safety Training of Medical Students in Colombia: Protocol for a Qualitative Study. In: Costa AP, Reis LP, Moreira A, editors. Computer Supported Qualitative Research. Cham: Springer, Cham; 2019. p. 102–9.

    Chapter  Google Scholar 

  28. Andersson N. Building the community voice into planning: 25 years of methods development in social audit. BMC Health Serv Res. 2011;11(Suppl 2):S1.

    Article  Google Scholar 

  29. Andersson N. Community-led trials: intervention co-design in a cluster randomised controlled trial. BMC Public Health. 2017;17:397.

    Article  Google Scholar 

  30. Andersson N, Beauchamp M, Nava-Aguilera E, Paredes-Solís S, Šajna M. The women made it work: fuzzy transitive closure of the results chain in a dengue prevention trial in Mexico. BMC Public Health. 2017;17(Suppl 1):408.

    Article  Google Scholar 

  31. Brascoupe S, Waters C. Cultural safety: exploring the applicability of the concept of cultural safety to Aboriginal health and community wellness. J Aborig Heal. 2009;5:6–41.

    Google Scholar 

  32. Gozu A, Beach MC, Price EG, Gary TL, Robinson K, Palacio A, et al. Self-administered instruments to measure cultural competence of health professionals: a systematic review. Teach Learn Med. 2007;19:180–90.

    Article  Google Scholar 

  33. Institute for Digital Research & Education - UCLA. Power Analysis for Two-group Independent sample t-test | R Data Analysis Examples. 2020. https://stats.idre.ucla.edu/r/dae/power-analysis-for-two-group-independent-sample-t-test/. Accessed 3 Mar 2020.

    Google Scholar 

  34. Niesink P, Poulin K, Šajna M. Computing transitive closure of bipolar weighted digraphs. Discret Appl Math. 2013;161:217–43.

    Article  Google Scholar 

  35. Yanagawa T, Fujii Y, Mastuoka J. Generalized mantel-Haenszel procedures for 2 × J tables. Environ Health Perspect. 1994;102(suppl 8):57–60.

    Article  Google Scholar 

  36. Andersson N, Lamothe G. Clustering and meso-level variables in cross-sectional surveys: an example of food aid during the Bosnian crisis. BMC Health Serv Res. 2011;11:S15.

    Article  Google Scholar 

  37. Hanley JA. Statistical analysis of correlated data using generalized estimating equations: an orientation. Am J Epidemiol. 2003;157:364–75.

    Article  Google Scholar 

  38. Bender R, Lange S. Adjusting for multiple testing—when and how? J Clin Epidemiol. 2001;54:343–9.

    Article  Google Scholar 

  39. Council for International Organizations of Medical Sciences. International Ethical Guidelines for Biomedical Research Involving Human Subjects. 2002.

    Google Scholar 

  40. World Medical Association. World Medical Association Declaration of Helsinki. JAMA. 2013;310:2191.

    Article  Google Scholar 

  41. University of Alberta. Guidelines on conducting research in class (Students as participants). 2012. http://www.reo.ualberta.ca/en/Human-Research-Ethics/Students-and-Research/~/media/reo/Human-Ethics-Files/Forms-Files/Guidelines_on_inclass_research_students_as_participants__2012_Sept.pdf. Accessed 14 Aug 2017.

    Google Scholar 

  42. Canadian Institutes of Health Research, Natural Sciences and Engineering Research Council of Canada, Social Sciences and Humanities Research Council of Canada. Tri-Council Policy Statement: Ethical conduct for research involving humans. Med Res Council Canada. 2014:1–10 http://www.pre.ethics.gc.ca/pdf/eng/tcps2-2014/TCPS_2_FINAL_Web.pdf. Accessed 1 Apr 2020.

  43. Eysenbach G. CONSORT-EHEALTH: improving and standardizing evaluation reports of web-based and Mobile health interventions. J Med Internet Res. 2011;13:e126.

    Article  Google Scholar 

  44. Torgerson DJ, Torgerson CJ. Designing randomised trials in health, Education and the social sciences : an introduction. New York: Palgrave Macmillan; 2008.

    Book  Google Scholar 

  45. Sedgwick P, Greenwood N. Understanding the Hawthorne effect. BMJ. 2015;351:h4672.

    Article  Google Scholar 

  46. Taylor EW. An update of transformative learning theory: a critical review of the empirical research (1999–2005). Int J Lifelong Educ. 2007;26:173–91.

    Article  Google Scholar 

  47. Cook DA. If you teach them, they will learn: why medical education needs comparative effectiveness research. Adv Heal Sci Educ. 2012;17:305–10.

    Article  Google Scholar 

  48. Cook DA, Erwin PJ, Triola MM. Computerized virtual patients in health professions Education: a systematic review and meta-analysis. Acad Med. 2010;85:1589–602.

    Article  Google Scholar 

  49. Cook DA, Levinson AJ, Garside S, Dupras DM, Erwin PJ, Montori VM. Internet-based learning in the health professions: a meta-analysis. JAMA. 2008;300:1181.

    Article  Google Scholar 

  50. Cook DA, Hatala R, Brydges R, Zendejas B, Szostek JH, Wang AT, et al. Technology-enhanced simulation for health professions Education: a systematic review and meta-analysis. JAMA. 2011;306:978–88.

  51. McGaghie WC, Issenberg SB, Cohen ER, Barsuk JH, Wayne DB. Does simulation-based medical Education with deliberate practice yield better results than traditional clinical Education? A meta-analytic comparative review of the evidence. Acad Med. 2011;86:706–11.

    Article  Google Scholar 

  52. Education A in HS. Standards for an Acceptable Manuscript. 2020. https://www.springer.com/journal/10459/submission-guidelines. Accessed 25 Aug 2020.

    Google Scholar 

  53. Ellis P, Baker C, Hanger M. Research on the comparative effectiveness of medical treatments: issues and options for an expanded Federal Role. Congressional Budget Office, Congress of the United States. 2007. https://www.cbo.gov/publication/41655. Accessed 25 Aug 2020.

    Google Scholar 

  54. Laiti O, Harrer S, Uusiautti S, Kultima A. Sustaining intangible heritage through video game storytelling - the case of the Sami Game Jam. Int J Herit Stud. 2020;27(3):1–16.

  55. Ramsden IM. Cultural Safety and Nursing Education in Aotearoa and Te Wai Pounamu. Nursing. 2002:223 https://www.nzno.org.nz/Portals/0/Files/Documents/Services/Library/2002 RAMSDEN I Cultural Safety_Full.pdf. Accessed 1 Apr 2020.

  56. Jeffreys MR. Preceded by: Jeffreys MR. Tools for Assessment and Evaluation. In: Teaching cultural competence in nursing and health care : inquiry, action, and innovation. 3rd ed. New York: Springer Publishing Company; 2015. p. 89–194.

  57. Basalan I, Temel AB, Chen J, Fridline M, Grund FJ, Halter M, et al. Transcultural Self-Efficacy Tool (TSET). In: Jeffreys M, editor. Teaching Cultural Competence in Nursing and Health Care. ProQuest Ebook Central; 2015. p. 91–194.

    Google Scholar 

  58. Ross S, Loke YK. Do educational interventions improve prescribing by medical students and junior doctors? A systematic review. Br J Clin Pharmacol. 2009;67:662–70.

    Article  Google Scholar 

  59. Education Group. Guidelines for evaluating papers on educational interventions. BMJ. 1999;318:1265–7.

    Article  Google Scholar 

  60. Horvat L, Horey D, Romios P, Kis-Rigo J. Cultural competence education for health professionals. Cochrane Database Syst Rev. 2014;CD009405:1–100.

    Google Scholar 

  61. Blanchet Garneau A, Farrar H, Fan H, Kulig J. Applying cultural safety beyond indigenous contexts: insights from health research with Amish and low German Mennonites. Nurs Inq. 2018;25:e12204.

    Article  Google Scholar 

Download references

Acknowledgements

Cassandra Laurie helped proofread the final version of the manuscript and supported its write-up. The students and professors from the Faculty of Medicine at University of La Sabana supported the study. Drs. Alvaro Romero, Yahira Guzman, Camilo Correal, Francisco Lamus, Erwin Hernández, Nohora Angulo, Patricia Jara, Claudia Mora, Sandra Toro, Diana Díaz, Álvaro Domínguez, Marcos Castillo, Rodrigo Cuevas, and Carolina Aponte allowed the medical students and interns to attend the activities of the RCT and supported the research activities. Olga Briceño, Daniela Castellanos, and Rossmary Quinche supported the logistical aspects of the research activities. Germán Zuluaga, Andrés Isaza, Andrés Cañón, Iván Sarmiento, and Camilo Correal provided methodological advice on cultural safety and medical education.

Funding

This study was financed by two travel awards awarded to the first author by McGill University: the Norman Bethune Award for Global Health and the Graduate Mobility Award. The first author is supported by the CEIBA Foundation (Colombia) and the Fonds de recherche du Québec – Santé (Canada). This did not influence the design, execution, or publication of the study.

Author information

Authors and Affiliations

  1. CIET-PRAM, Department of Family Medicine, McGill University, 5858 Chemin de la Côte-des-Neiges 3rd Floor, Suite 300, Montreal, Quebec, H3S 1Z1, Canada

    Juan Pimentel, Anne Cockcroft & Neil Andersson

  2. Facultad de Medicina, Universidad de La Sabana, Campus Universitario puente del común, Chía, Colombia, CP, 250001

    Juan Pimentel

  3. Escuela de Medicina y Ciencias de la Salud, Universidad del Rosario, Carrera 24 # 63, C 69, Bogotá, Colombia

    Juan Pimentel

  4. Centro de Investigación de Enfermedades Tropicales (CIET), Universidad Autónoma de Guerrero, Calle Pino s/n Colonia El Roble, 39640, Acapulco, Guerrero, Mexico

    Anne Cockcroft & Neil Andersson

Authors
  1. Juan Pimentel
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Anne Cockcroft
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Neil Andersson
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

This study is part of the PhD work of JP. NA is the supervisor and AC is the co-supervisor of JP. NA and AC advised on the development of the study. JP led the study design and coordinated the fieldwork. JP drafted this paper, and all authors contributed to it. All authors read and approved the final manuscript.

Authors’ information

Juan Pimentel is an MD with an MSc in Epidemiology. Currently, he is a lecturer in Family Medicine and Public Health at University of La Sabana, a researcher at the Research Group on Traditional Health Systems (Del Rosario University, Colombia), and the head of Medical Education at the Center of Intercultural Medical Studies (Colombian NGO). He is now pursuing a Ph.D. in Family Medicine to foster cultural safety in research and clinical practice through transformative learning in medical education.

Corresponding author

Correspondence to Juan Pimentel.

Ethics declarations

Ethics approval and consent to participate

This study was approved by the Institutional Review Board of the McGill’s Faculty of Medicine (approval number A05-B37-17B) and by the Sub-committee for Research of the Faculty of Medicine at University of La Sabana (approval number 445). Our study embraced the bioethical principles proposed by the Council for International Organizations of Medical Sciences, the Declaration of Helsinki, the guidelines on conducting research in class from the University of Alberta, and the Tri-Council Policy Statement. All participants signed written informed consent before proceeding with any research activity.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

CONSORT checklist of information to include when reporting an RCT– filled CONSORT checklist.

Additional file 2.

Impact of Co-Designed Game Learning on Cultural Safety in Colombian Medical Education: Protocol for a Randomized Controlled Trial - Protocol of our study published in the Journal of Medical Internet Research – Research protocols.

Additional file 3.

Questions used to assess each component of the CASCADA model – questions used in the quantitative questionnaire.

Additional file 4.

Attrition diagram of the study - attrition diagram of the study.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Pimentel, J., Cockcroft, A. & Andersson, N. Impact of game jam learning about cultural safety in Colombian medical education: a randomised controlled trial. BMC Med Educ 21, 132 (2021). https://doi.org/10.1186/s12909-021-02545-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12909-021-02545-7

Keywords

BMC Medical Education

ISSN: 1472-6920

Contact us