Skip to main content
Download PDF

Reflecting on gamified learning in medical education: a systematic literature review grounded in the Structure of Observed Learning Outcomes (SOLO) taxonomy 2012—2022

BMC Medical Education volume 24, Article number: 20 (2024) Cite this article

A Correction to this article was published on 01 February 2024

This article has been updated

Abstract

Background

The acquisition of in-depth medical knowledge, skills, and competencies is of utmost importance when training future medical professionals. This systematic literature review delves into the empirical connection between gamified learning in medical education and the Structure of Observed Learning Outcomes (SOLO) taxonomy.

Methods

Following PRISMA guidelines, a systematic literature review was conducted in seven databases to identify empirical studies related to gamification and medical education. The literature search was limited to peer-reviewed articles published between January 2012 and December 2022. Articles focusing on games or learning technologies in a broader sense as well as research focusing on nursing or pharmacy education were excluded.

Results

Upon reviewing 23 qualified empirical studies that applied gamified learning strategies in medical education, 18 (78%) studies are associated with the second lowest level (uni-structural) of the SOLO taxonomy. The mid-level (multi-structural) learning outcomes are associated with three (13%) of the reviewed studies. There are five (22%) studies focusing on the second highest (relational) level of the SOLO. Only one study (4%) is associated with the highest SOLO level (extended-abstract). Finally, three (13%) studies were identified with multiple levels of the SOLO. In addition to the SOLO levels, the review found six (26%) studies emphasizing motivational and engagement support of gamified learning strategies in facilitating intended learning outcome attainment. A total of three (13%) studies, across three SOLO levels, suggested that gamified learning strategies can improve students’ soft skills in medical education programs.

Conclusion

These findings collectively emphasize the need for future research and development to design gamified learning experiences capable of fostering higher SOLO taxonomy attainment in medical education. Moreover, there is potential to extend the SOLO framework to encompass motivational and affective learning outcomes, providing a comprehensive understanding of the impact of gamified learning on medical students.

Peer Review reports

Background

Rationale

The overarching goal of medical education is to equip students with the ability to perform in their future profession [1]. The acquisition of in-depth medical knowledge, skills, and competencies is of utmost importance when training future medical professionals. Future health professionals should be able to correctly diagnose patients, make informed decisions about suggested treatments, and communicate these medical procedures to patients [2,3,4]. In addition, competencies in clinical reasoning [5] and awareness of the need for the global health workforce [6] are included in recent systematic literature review studies. Although defining medical education is beyond the scope of this study, it is important to recognize the collective nature of medical education grounded in many educational assumptions, inlcuding experiential learning, reflective learning, competency-based learning, problem-based learning, structured assessments, and the use of technologies to enhance learning outcomes [7].

Systematic reviews on the efficacy of health professional and medical education have offered diverse perspectives on the potential effects of various educational and learning interventions. We identified four needs to justify the need for the present study. First, there is a need for theoretically grounded research in the health profession and medical education. Eskander et al. reviewed 18 studies on the impact of wellness interventions for resident physicians and suggested the need to reference education theories for future program development in similar areas for optimal educational outcomes [8]. In the context of graduate medical education. In a review of 132 studies, Song and colleagues proposed research design changes to employ a theoretical framework to guide ophthalmology education research [9]. Second, there is a need for systematic and guided approaches to better understand the quality of health professional and medical education. De Leeuw and colleagues reviewed 418 publications that evaluated postgraduate medical e-learning [10]. Their review implies the need for a consistent, validated, and guided evaluation approach to help medical educators understand the complexity of e-learning in graduate medical education. Vasquez and colleagues reviewed 24 studies on the effects of skill-based programs on reducing physician burnout [11]. Additional future research using randomized controlled trials was suggested in their review. Under the influence of the COVID-19 pandemic, Wilcha reviewed 34 studies that focused on the effectiveness of virtual medical teaching [12]. This review identified several factors that impact the quality of virtual medical teaching, including reduced learner engagement and the absence of necessary learning assessments due to technological limitations.

Third, interest in educational and instructional strategies for health professional and medical education is heterogeneous because they serve a wide range of potential educational outcomes. Aldriwesh et al. proposed a global interprofessional education approach to better meet the need of a global health workforce based on a review of 16 peer-reviewed studies [6]. Grounded in 21 studies, the effect of teaching methods on evidence-based practice is inconclusive [13] because of the lack of homogenous approaches in assessing intended learning outcomes (knowledge, skills, attitudes, and behaviors). Fourth, there is a need to better understand the gamification of learning in health and medical education. A short online gamified learning activity could be helpful in supporting learners’ confidence in health professional training when face-to-face interactions are infeasible [14]. In a randomized experimental study to compare the efficacies of various learning activities (i.e., e-module, e-modules + cases, and e-modules + cases represented by high-fidelity simulation games), gamified learning reportedly engaged learners cognitively more than the case group [15]. Upon identifying 49 studies to review, Vermeir et al. confirmed the effects of gamification on learner motivation and engagement during cognitive training [16]. Scott and colleagues indicate the importance of allowing students to practice complex tasks in realistic situations to adequately prepare them for the challenges of the medical profession [4]. Further, Middeke et al. suggest that gamified educational methods allow students to improve their clinical reasoning skills [3]. The positive clinical effects of gamification have also been reported in multiple recent review studies in the context of rehabilitation or physical training [17,18,19]. The systematic literature review by van Gaalen et al. on the gamification of health professional education captures the rationale for the present study to be the best [20]. Based on 44 studies, their review suggests an emerging need to delineate the conceptual, pedagogical, and empirical alignment between the features of gamification and their effects on intended learning outcomes. To address the above four needs with a parsimonious and homogeneous literature review approach grounded in education theories, this present study reviews the recent literature on the gamification of health professions and medical education in achieving specific cognitive learning outcomes.

Selection of learning outcome framework

The overarching goal of medical education is to equip students with the ability to perform their future professions [1, 21]. This suggests that the acquisition of in-depth medical knowledge, skills, and competencies is of utmost importance when training future health and medical professionals. Future health professionals should be able to correctly diagnose patients, make informed decisions about suggested treatments, and communicate these medical procedures to patients [2,3,4]. Although medical education involves a range of learning outcomes [22] ranging from the pure acquisition and retention of knowledge [23] to the ability to correctly perform and communicate in high-pressure situations [24], effective clinical performance must first be supported by the acquisition of factual knowledge, knowledge application, and clinical reasoning skills [1, 21, 23, 25]. Therefore, cognitive reasoning is the primary learning outcome, which leads to the adoption of The Structure of Observed Learning Outcomes (SOLO) taxonomy [26] for this review.

The SOLO taxonomy, derived from observed assessments, is primarily focuses on the cognitive learning outcomes associated with various subject matters [26]. More importantly, by comparison with Bloom’s Taxonomy [27], SOLO taxonomy is situated in learners’ developmental “modes of learning” grounded in Piaget’s scholarship on cognitive development (i.e., sensorimotor, iconic, concrete symbolic, formal, and post-formal) [28] and the cyclic process for learners to attain certain mode of cognitive development [28]. In other words, Bloom’s Taxonomy provides clear and concrete learning outcomes as goals for developing effective learning objectives, while SOLO taxonomy helps educators consider learners’ internal cognitive developmental processes when designing intended educational interventions. The SOLO taxonomy includes five cyclic levels of progressively arranged learning outcomes within each mode of learning [28,29,30]:

  • Pre-structural is pre-learning, in which learners use irrelevant and unorganized data with no effects in solving problems. This level concerns learners’ ignorance and lack of usable knowledge.

  • Uni-structural is when learners use only one piece of relevant data to solve problems. These results may be inconsistent. This level can lead to learners' ability to recall, memorize, or define knowledge.

  • Multi-structural is when learners use multiple data pieces to solve problems without integrative relationships among them. The problem-solving results remain inconsistent. This level refers to learners’ ability to gather, combine, and list concrete knowledge facts.

  • Relational refers to when learners use all available data points, with an understanding of the relationships among them, to form an applicable problem-solving system with consistent results. This level deals with learners’ abilities to analyze, compare, relate, and explain.

  • Extended Abstract is when learners make connections with data, information, and relationships beyond the initial problem-solving context to enable the transfer of learning and performance from one situation to another. This level develops learners’ ability to reflect, hypothesize, or theorize.

The second and third levels are focused on the quantity of knowledge that learners can internalize and retrieve. The final two levels of the SOLO taxonomy relate to learners’ abilities to work with abstraction [31]. All levels articulate the cyclic nature of cognitive learning outcomes in order to achieve certain modes of learning. Learners can be in multiple SOLO levels simultaneously [28, 29] while attending to both surface and deep learning approaches [32,33,34].

The SOLO taxonomy has been applied to align medical and dental education learning outcomes with respective learning or instructional strategies. Pandey and Zimitat applied SOLO taxonomy to understand the learning of human anatomy among first-year medical students (n = 97) and found that learners’ SOLO ratings correlated positively with their deep learning scores based on a version of the Study Process Questionnaire (r = 0.24, p < 0.01) and positively with learners’ final grades (r = 0.61, p < 0.01) [33]. To optimize the cognitive alignment between study materials and learners’ abilities to internalize knowledge on anatomy, D’Antoni et al. analyzed the primary learning outcomes of studying human anatomy against the SOLO taxonomy from the perspective of cognitive information processing [35]. Given the information-heavy nature of the subject matter, the authors suggested that learners avoid rote learning strategies (i.e., highlighting information from the study materials and rereading the study materials). Both learning strategies are categorized as early levels of SOLO taxonomy with limited effects on the development of long-term memory. Instead, learners should self-test their retrieval of intended knowledge (i.e., practice testing) [35]p159 and distribute their learning and testing over time to facilitate information internalization (i.e., distributed practice) [35]p161. Both strategies are focused on efficient cognitive learning with the purpose of passing pertinent cognitive tests on human anatomy. Reid and colleagues designed a collection of assessments based on the SOLO taxonomy for 3rd-year medical students, which includes multiple-choice questions, short-response questions, structured case study narratives, and peer assessment [34]. Upon completing the assessments, the learners completed the Approaches to Study Skills Inventory for Students for their surface or deep learning strategies. The results demonstrated positive correlations between higher levels of SOLO-based assessment and higher deep learning scores. Svensäter and Rohlin also applied the SOLO taxonomy to develop a formative and summative assessment model for dental students [30]. They reported the feasibility of SOLO taxonomy levels for guiding assessment development. Regardless of subject matter, learning outcomes should guide the selection and deployment of corresponding teaching and instructional strategies to ensure the attainment of intended learning objectives [36]. Learning outcomes should be the primary reference point for all educational and instructional events. Not just assessments.

Gamified learning for learning outcome attainment

Recent reviews of the achievement of learning outcomes in medical education have found a lack of learning transfer among medical students [37, 38]. Scott and colleagues indicated the importance of allowing students to practice complex tasks in realistic situations to adequately prepare them for the challenges of the medical profession [4]. Across subject matter areas, gamified learning, as an instructional strategy that incorporates gameplaying elements into intended learning processes [39], has been applied to facilitate knowledge transfer and scaffold the attainment of complex cognitive learning outcomes [40, 41]. Beyond cognitive learning outcomes, Huang et al. validated empirical relationships between features of gamified learning and learners’ motivation to learn blood types among undergraduate students [42]. In health sciences education, McKenzie compared the impact of a face-to-face teaching event with a short online game-informed learning (GIL) activity and revealed the positive effects of GIL on learners’ perceived confidence, interest level, and clarity of intended learning [14]. Middeke et al. suggested that gamified educational methods allow students to improve their clinical reasoning skill set [3]. Nevertheless, through a systematic review of the effects of gamification in health professions education, Gentry et al. called for further reviews grounded in theoretical perspectives [43].

Objectives

The study, through reviewing the literature on gamified learning and its targeted learning outcomes in medical education grounded in the SOLO taxonomy from 2012 to 2022, empirically associates gamified learning and the SOLO taxonomy in the context of medical education. The scope of medical education for this study includes all undegradaute, gradaute, and continuous medical education programs that train healthcare professionals in a diverse clinical settings [7]. The findings of this study can inform the adoption of gamified learning strategies to help medical students attain cognitive learning outcomes grounded in the SOLO taxonomy.

Methods

This study followed the PRISMA systematic literature review process as outlined by Page et al. [44]. See Fig. 1 for the entire search, selection, and review process.

Fig. 1
figure 1

Identification and selection of articles (Adapted from [44] p5)

Full size image

Search strategy

The research team systematically searched for publications on gamification in medical education. Using multiple databases allowed us to maximize the available data and consider the relevant literature. Consequently, a literature search was conducted using EBSCO (Academic Search Ultimate, CINAHL, ERIC), SCOPUS, PsycINFO, Cochrane Library, and PubMed. The databases were selected for the following reasons: (1) they are highly cited databases in English; (2) Academic Search Ultimate, CINAHL, ERIC, PsycINFO, and SCOPUS are large, multidisciplinary databases, whereas PubMed offers access to more than 35 million citations in the field of life sciences and biomedicine [45], and the Cochrane Library focuses on medicine and other healthcare specialties. This allowed the research team to maximize the available literature and provide a comprehensive overview of the research on medical education and gamification. We used the following two strings of keywords across all seven databases to identify literature of interest: (1) “medical education” AND “innovation” AND “gamification”, and (2) “medical education” AND “gamification.” The literature search was limited to peer-reviewed journal articles published between January 2012 and December 2022.

Inclusion criteria

The research team included peer-reviewed journal articles published in English on gamification and intended learning outcomes in medical education. Medical education was defined as the training provided during medical school or residency programs. Consequently, literature was included if it specifically focused on the use of gamification in the title, abstract, or keywords, and discussed SOLO learning outcomes in medical education. We only included empirical journal articles, including qualitative and quantitative studies, to meet the objective of systematic reviews by synthesizing research evidence grounded in specific frameworks [46].

Exclusion criteria

We excluded articles that only describe games or the use of learning technologies in a broader sense to keep the scope of the search process focused on gamification. We also excluded articles that did not discuss learning outcomes following the SOLO taxonomy. Additionally, we excluded research focusing on nursing or pharmacy education as well as all conceptual and systematic review articles. The research team excluded articles published before January 2012 and after December 2022 as well as articles published in languages other than English.

Study selection

After retrieving the search results from the seven databases, duplicates and irrelevant studies such as conference papers and articles in languages other than English were removed. Abstracts of the remaining articles were screened for preliminary eligibility. In cases of uncertainty, the articles were reviewed in full to determine eligibility according to the inclusion criteria. To strengthen the reliability and validity of the selection process, all the articles were reviewed by at least two members of the research team.

Data extraction process

The aim of this study is to review the literature on learning outcomes and gamification in medical education in the context of the SOLO taxonomy. Consequently, we extracted data related to gamification and learning outcomes from all reviewed empirical studies. Specifically, the research team first collected data consistent with the keywords relevant to gamified learning and the SOLO taxonomy. Second, the research team reviewed the research questions, results, and discussions in the selected publications.

Certainty assessment

The research team discussed and addressed any challenges or uncertainties arising during the article selection and data extraction process as a form of triangulation. This further strengthened the validity and reliability of our review findings by ascertaining the consensus of the review results among all research team members.

Results

The search process yielded a total of 52 publications on EBSCO (Academic Search Ultimate), 23 publications on EBSCO (CINAHL), 8 publications on EBSCO (ERIC), 30 publications on PsycINFO, 169 publications on SCOPUS, 17 publications on Cochrane Library, and 134 publications on PubMed. After removing duplicates and irrelevant studies, 76 publications were selected for screening of preliminary eligibility. Any potential uncertainties in meeting the inclusion criteria were resolved through consensus development among all research team members. Only 23 articles fully met the selection criteria and were included in the study. Figure 1 provides an overview of the study-selection process.

Application of the SOLO taxonomy

A total of 23 studies described learning outcomes that fall into the SOLO taxonomy. Additionally, three studies were coded with multiple levels of the SOLO taxonomy. In 18 (78%) of the reviewed studies, gamified learning for medical education was designed at a uni-structural level of learning outcomes (see Table 1). In these studies, effective knowledge acquisition within a given time is emphasized in medical education, and gamified methods were applied to motivate learners in this context. For example, [47] developed a gamified web platform to study its impacts on students’ obtaining knowledge about pain neurophysiology and their satisfaction. The gamified methods in this study included providing individual learning paths and quizzes. Two valid questionnaires were used to measure the learners’ knowledge gains. The findings suggest that the gamified platform is effective for both knowledge gain and reducing misconceptions. Multi-structural level learning outcomes were found in three (13%) of the reviewed studies. In addition, three studies (13%) [48,49,50] identified two or more learning outcomes categorized at the Uni-structural level of the SOLO taxonomy.

Table 1 SOLO taxonomy learning outcomes of reviewed studies
Full size table

In five (22%) of the reviewed studies learning outcomes were found at the “Relation” level of the SOLO taxonomy. Gamified learning strategies allow learners not only to attain knowledge, but also to apply knowledge to solve problems. Keywords that illustrate the Relation level in these articles include “understand”, “argue”, “apply”, “master skills”, and “explain”. One study [68] reported that a gamified learning strategy was applied to the technology-enhanced lessons to enhance students’ ability for critical thinking, connecting concepts, and practical application. Applying theories to practice was ranked as the highest learning outcome by students.

Extended-abstract level was found in only one (4%) of the reviewed studies. Hudnall and Kopecky discussed the Extended-abstract level to include empathy as a learning outcome [69]. Specifically, empathy has been considered as a cognitive learning outcome [70]. The study suggested that gamified learning could improve students’ intention to convey empathy, show understanding, and respect emotional expressions.

Learning outcomes facilitated by motivational and engagement support of gamified learning strategies

It should be noted that six (26%) studies across two SOLO taxonomy levels (Uni-structural and Relational) emphasized improving learners’ engagement with the learning process, their motivation to participate, and their positive self-efficacy through game-based strategies to achieve intended learning outcomes. See Table 2. These factors were measured through learners’ perceptions of gamified learning strategies using self-report questionnaires and post-test scores. The most facilitated learning outcome (four out of six) by supporting learners’ engagement and motivation was the Uni-structural stage. This result suggests an increased need to consider motivational factors in facilitating learning outcome attainment at the Uni-structural level since memorizing, recalling, and defining knowledge might be considered an unappealing learning process by students.

Table 2 Studies in which motivation and engagement were considered
Full size table

Discussion

The reported systematic literature review extends previous inquiries into understanding the effect of gamification on the attainment of learning outcomes in the context of medical education [14, 15, 20]. The findings of this study, to a large extent, augment prior research on medical or health science education on four fronts. First, the present study connects the SOLO taxonomy with gamified learning in medical education. The study finds that the current literature investigating gamified learning in medical education from the SOLO taxonomy perspective lacks empirical inquiries. Since medical education emphasizes the attainment of cognitive learning outcomes in the early years of medical school training, the SOLO taxonomy could provide theoretical and practical instructional guidance to devise comparative or evaluative studies on gamified learning in medical training. Second, within the scope of the SOLO taxonomy, the review suggests opportunities to adopt gamified learning strategies to help medical students attain advanced levels of SOLO learning outcomes according to intended subject matter and levels of medical training. The reviewed studies were primarily focused on the lowest SOLO learning outcome level (18 out of 23, 78%), which could have limited the effects of gamified learning strategies on scaffolding motivating, engaging, immersive, and complex learning processes. Third, similar to prior literature (e.g., [15]), motivational support for gamified learning was identified in the reviewed studies. While motivational support is not the primary learning outcome, it plays a critical role in scaffolding learning outcome attainment at low SOLO taxonomy levels. Finally, combining the SOLO taxonomy’s emphasis on cognitive learning outcomes, gamified learning strategies, and motivational support mentioned in the reviewed studies, our findings offer a preliminary indication in the context of medical education on the empirical relationship between cognitive processing and motivational processing in gamified learning environments [42].

In addition to cognitive learning outcome attainment grounded in SOLO taxonomy and the potential motivational effects of gamified learning, improving soft skills (e.g., communication, team building, collaboration) was identified as an auxiliary learning outcome of gamified learning strategies in reviewed studies. See Table 3. Improving soft skills was found in three out of 23 (13%) reviewed studies across three levels of SOLO taxonomy (Uni-structural, Multi-structural, and Extended abstract). Vuillaume et al. addressed that applying the Escape Room to medical education made students work successfully together and build strong teamwork which is a necessary skill in real medical work environments [65]. In another study [57], the gaming software “Kahoot” was used to teach a histology class to understand its impacts on students’ knowledge gains, learning, and enjoyment. Kahoot consists of multiple-choice quizzes and was tested in five different groups. These groups were different based on the number of times students received Kahoot, whether they received it pre- or post-instruction, and whether students worked on the Kahoot individually or collectively. Findings from this study suggest that not only were the Kahoot gamification features significantly effective for gaining knowledge by recalling the contents, but also pointed out students’ inclination toward team or group gaming over individual gaming. The survey results showed that students who worked in groups received higher scores, and students would like to assess their knowledge gains based on a team approach. The authors indicated that Kahoot was effective in encouraging students’ team-based learning and improving team-based logical skills, which are important for students’ future medical professions.

Table 3 Studies in which improving soft skills was supported by gamified learning strategies
Full size table

Limitations of the study

This present study used multiple highly cited academic publication databases published in English. Nevertheless, the research team recognizes the limitation of not utilizing additional databases as part of the literature sampling frame owing to various definitions associated with gamified learning (e.g., game-based learning, serious games) [20]. The findings of the study are also limited by the research team’s collective interpretations of the mentioned learning outcomes in the reviewed studies, as sometimes such terms were not explicitly presented in the publications. Third, while the SOLO taxonomy is grounded in empirical observations on teaching in various contexts, it lacks well-defined attributes to quantitatively determine which SOLO level(s) the cognitive learning outcome should be. After reviewing the literature and triangulating our analyses, the research team determined the SOLO level(s) of the reviewed studies collectively and qualitatively. Fourth, the research team did not judge the quality or level of the gamified learning during the review process. The alignment with or deviation from the commonly accepted instructional practices of gamified learning in medical education could limit the implications of this study's findings. Finally, the study excluded all publications in 2023 since the publications were ongoing when the study was concluded in late 2023.

Conclusion

This systematic literature review connects the SOLO taxonomy for cognitive learning outcomes and gamified learning in the context of medical education. The research team reviewed 23 empirical studies qualitatively. The majority of the reviewed studies applied gamified learning for lower levels of SOLO taxonomy learning outcomes, which suggests future research potential to design and implement gamified learning for higher SOLO taxonomy levels for medical education. Motivational support and soft skill development were also considered in the reviewed studies as potential effects of gamified learning on medical education. This emerging trend could inspire future inquiries into exploring gamified learning’s support beyond the scope of cognitive learning outcomes in medical education, including affective and motivational learning.

Availability of data and materials

All reviewed articles reported in this systematic literature review are listed in the References section for readers to access.

Change history

References

  1. Song HS, Kalet AL, Plass JL. Interplay of prior knowledge, self-regulation and motivation in complex multimedia learning environments. J Comput Assist Learn. 2016;32(1):31–50.

    Article  Google Scholar 

  2. Dhar P, Rocks T, Samarasinghe RM, Stephenson G, Smith C. Augmented reality in medical education: students’ experiences and learning outcomes. Med Educ Online. 2021;26(1):1953953.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Middeke A, Anders S, Schuelper M, Raupach T, Schuelper N. Training of clinical reasoning with a serious game versus small-group problem-based learning: a prospective study. PLoS ONE. 2018;13(9):e0203851.

    Article  PubMed  PubMed Central  Google Scholar 

  4. Scott A, Sudlow M, Shaw E, Fisher J. Medical education, simulation and uncertainty. Clin Teach. 2020;17(5):497–502.

    Article  PubMed  Google Scholar 

  5. Plackett R, Kassianos AP, Mylan S, Kambouri M, Raine R, Sheringham J. The effectiveness of using virtual patient educational tools to improve medical students’ clinical reasoning skills: a systematic review. BMC Med Educ. 2022;22(1):365.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Aldriwesh MG, Alyousif SM, Alharbi NS. Undergraduate-level teaching and learning approaches for interprofessional education in the health professions: a systematic review. BMC Med Educ. 2022;22:1–4.

    Article  Google Scholar 

  7. Swanwick T. Understanding medical education: Evidence, theory, and practice. 2018;3:1–6.

  8. Eskander J, Rajaguru PP, Greenberg PB. Evaluating wellness interventions for resident physicians: a systematic review. J Grad Med Educ. 2021;13(1):58–69.

    Article  PubMed  Google Scholar 

  9. Song SL, Yu ZZ, Pavlech L, Scott IU, Greenberg PB. Theoretical frameworks in medical education: using a systematic review of ophthalmology education research to create a theory of change model. J Grad Med Educ. 2022;14(5):568–82.

    Article  PubMed  PubMed Central  Google Scholar 

  10. De Leeuw R, De Soet A, Van Der Horst S, Walsh K, Westerman M, Scheele F. How we evaluate postgraduate medical e-learning: systematic review. JMIR Med Educ. 2019;5(1):e13128.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Vasquez TS, Close J, Bylund CL. Skills-Based programs used to reduce physician burnout in graduate medical education: a systematic review. J Grad Med Educ. 2021;13(4):471–89.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Wilcha RJ. Effectiveness of virtual medical teaching during the COVID-19 crisis: systematic review. JMIR Medical Education. 2020;6(2):e20963.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Howard B, Diug B, Ilic D. Methods of teaching evidence-based practice: a systematic review. BMC Med Educ. 2022;22(1):1–26.

    Article  Google Scholar 

  14. McKenzie K. A comparison of the effectiveness of a game informed online learning activity and face to face teaching in increasing knowledge about managing aggression in health settings. Adv Health Sci Educ. 2013;18(5):917–27.

    Article  Google Scholar 

  15. Dankbaar ME, Alsma J, Jansen EE, van Merrienboer JJ, van Saase JL, Schuit SC. An experimental study on the effects of a simulation game on students’ clinical cognitive skills and motivation. Adv Health Sci Educ. 2016;21:505–21.

    Article  Google Scholar 

  16. Vermeir JF, White MJ, Johnson D, Crombez G, Van Ryckeghem DM. The effects of gamification on computerized cognitive training: systematic review and meta-analysis. JMIR Serious Games. 2020;8(3):e18644.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Simmich J, Deacon AJ, Russell TG. Active video games for rehabilitation in respiratory conditions: systematic review and meta-analysis. JMIR Serious Games. 2019;7(1):e10116.

    Article  PubMed  PubMed Central  Google Scholar 

  18. Vieira C, da Silva Pais-Vieira CF, Novais J, Perrotta A. Serious game design and clinical improvement in physical rehabilitation: systematic review. JMIR Serious Games. 2021;9(3):e20066.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Vinolo-Gil MJ, Casado-Fernández E, Perez-Cabezas V, Gonzalez-Medina G, Martín-Vega FJ, Martín-Valero R. Effects of the combination of music therapy and physiotherapy in the improvement of motor function in cerebral palsy: a challenge for research. Children. 2021;8(10):868.

    Article  PubMed  PubMed Central  Google Scholar 

  20. van Gaalen AE, Brouwer J, Schönrock-Adema J, Bouwkamp-Timmer T, Jaarsma AD, Georgiadis JR. Gamification of health professions education: a systematic review. Adv Health Sci Educ. 2021;26(2):683–711.

    Article  Google Scholar 

  21. Stańdo J, Mokwa-Tarnowska I, Roszak M. Analysis of learning outcomes in medical education with the use of fuzzy logic. Stud Log Gramm Rhetor. 2021;66(3):609–16.

    Article  Google Scholar 

  22. Lee J, Kim H, Kim KH, Jung D, Jowsey T, Webster CS. Effective virtual patient simulators for medical communication training: a systematic review. Med Educ. 2020;54(9):786–95.

    Article  PubMed  Google Scholar 

  23. Seer M, Kampsen C, Becker T, Hobert S, Anders S, Raupach T. Use of digital teaching resources and predictors of medical student performance during the pandemic: a prospective study. PLoS ONE. 2022;17(5):e0268331.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  24. O’Keefe M, Henderson A, Chick R. Defining a set of common interprofessional learning competencies for health profession students. Med Teach. 2017;39(5):463–8.

    Article  PubMed  Google Scholar 

  25. Abdull Mutalib AA, Md. Akim A, Jaafar MH. A systematic review of health sciences students’ online learning during the COVID-19 pandemic. BMC Med Educ. 2022;22(1):524.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Biggs J, Collis K. Towards a model of school-based curriculum development and assessment using the SOLO taxonomy. Aust J Educ. 1989;33(2):151–63.

    Article  Google Scholar 

  27. Forehand M. Bloom’s taxonomy: Original and revised. Emerg Perspect Learn Teeach Technol. 2005;8:41–4.

  28. Pegg, J. Structure of the observed learning outcome (SOLO) model. In: Encyclopedia of Mathematics Education. Springer. 2018. https://doi.org/10.1007/978-3-319-77487-9_182-4. Accessed 9 Oct 2023.

  29. Newton G, Martin E. Blooming, SOLO taxonomy, and phenomenography as assessment strategies in undergraduate science education. J Coll Sci Teach. 2013;43(2):78–90.

    Article  Google Scholar 

  30. Svensäter G, Rohlin M. Assessment model blending formative and summative assessments using the SOLO taxonomy. Eur J Dent Educ. 2023;27(1):149–57.

    Article  PubMed  Google Scholar 

  31. Potter MK, Kustra E. A primer on learning outcomes and the SOLO taxonomy. Course Design for Constructive Alignment,(Winter 2012). 2012:1–22.

  32. Hazel E, Prosser M, Trigwell K. Variation in learning orchestration in university biology courses. Int J Sci Educ. 2002;24(7):737–51.

    Article  Google Scholar 

  33. Pandey P, Zimitat C. Medical students’ learning of anatomy: memorisation, understanding and visualisation. Med Educ. 2007;41(1):7–14.

    Article  PubMed  Google Scholar 

  34. Reid WA, Duvall E, Evans P. Relationship between assessment results and approaches to learning and studying in year two medical students. Med Educ. 2007;41(8):754–62.

    Article  PubMed  Google Scholar 

  35. D’Antoni AV, Mtui EP, Loukas M, Tubbs RS, Zipp GP, Dunlosky J. An evidence-based approach to learning clinical anatomy: a guide for medical students, educators, and administrators. Clin Anat. 2019;32(1):156–63.

    Article  PubMed  Google Scholar 

  36. Branch RM, Dousay TA. Survey of instructional development models. Association for Educational Communications and Technology (AECT); 2015.

  37. Raupach T, Brown J, Anders S, Hasenfuss G, Harendza S. Summative assessments are more powerful drivers of student learning than resource intensive teaching formats. BMC Med. 2013;11:1.

    Article  Google Scholar 

  38. Sockalingam S, Tan A, Hawa R, Pollex H, Abbey S, Hodges BD. Interprofessional education for delirium care: a systematic review. J Interprof Care. 2014;28(4):345–51.

    Article  PubMed  Google Scholar 

  39. Deterding, S., Khaled, R., Nacke L.E.,Dixon, D. Gamification: Toward a definition. Proceedings of the CHI 2011 Gamification Workshop; 2011 May 7–12; Vancouver, BC, Canada.

  40. Mayer RE. Computer games in education. Annu Rev Psychol. 2019;70:531–49.

    Article  PubMed  Google Scholar 

  41. Mayer RE. Cognitive foundations of game-based learning. In: Plass JL, Mayer RE, Homer BD, editors. Handbook of game-based learning. Cambridge, MA: The MIT Press; 2020. p. 83–110.

    Google Scholar 

  42. Huang WD, Johnson TE, Han SH. Impact of online instructional game features on college students’ perceived motivational support and cognitive investment: a structural equation modeling study. The Internet and Higher Education. 2013;17:58–68.

    Article  Google Scholar 

  43. Gentry SV, Gauthier A, L’Estrade Ehrstrom B, Wortley D, Lilienthal A, Tudor Car L, Dauwels-Okutsu S, Nikolaou CK, Zary N, Campbell J, Car J. Serious gaming and gamification education in health professions: systematic review. J Med Internet Res. 2019;21(3):e12994.

    Article  PubMed  PubMed Central  Google Scholar 

  44. Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, Shamseer L, Tetzlaff JM, Akl EA, Brennan SE, Chou R. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. Int J Surg. 2021;88:105906.

    Article  PubMed  Google Scholar 

  45. PubMed. Homepage. https://pubmed.ncbi.nlm.nih.gov/. 2023. Accessed 23 Aug 2023.

  46. Grant MJ, Booth A. A typology of reviews: an analysis of 14 review types and associated methodologies. Health Info Libr J. 2009;26(2):91–108.

    Article  PubMed  Google Scholar 

  47. Valenzuela-Pascual F, Pàmies-Fabra J, García-Martínez E, Martínez-Navarro O, Climent-Sanz C, Gea-Sánchez M, Virgili-Gomà J, Rubí-Carnacea F, Garcia-Escudero M, Blanco-Blanco J. Use of a gamified website to increase pain neurophysiology knowledge and improve satisfaction and motivation among students studying for a degree in physiotherapy: a quasi-experimental study. BMC Med Educ. 2022;22(1):389.

    Article  PubMed  PubMed Central  Google Scholar 

  48. dos Reis Lívero FA, da Silva GR, Amaral EC, de Souza AN, Baretta IP, Diegues ME, Arpini E, Lovato EC. Playfulness in the classroom: gamification favor the learning of pharmacology. Educ Inf Technol. 2021;26(2):2125–41.

    Article  Google Scholar 

  49. Scaffidi MA, Khan R, Walsh CM, Pearl M, Winger K, Kalaichandran R, Lin P, Grover SC. Protocol for a randomised trial evaluating the effect of applying gamification to simulation-based endoscopy training. BMJ Open. 2019;9(2):e024134.

    Article  PubMed  PubMed Central  Google Scholar 

  50. Schlögl M, Roller-Wirnsberger RE, Hernes SS, Perkisas S, Bakken MS, Miot S, Balci C, Dani M, Pajulammi H, Piaggi P, Drenth-van Maanen C. Teaching geriatric medicine through gamification: a tool for enhancing postgraduate education in geriatric medicine. Aging Clinical and Experimental Research. 2021:1–9.

  51. Agudelo-Londono S, Gorbanev I, Delgadillo V, Munoz O, Cortes A, González RA, Pomares-Quimbaya A. Development and evaluation of a serious game for teaching ICD-10 diagnosis coding to medical students. Games Health J. 2019;8(5):349–56.

    Article  PubMed  Google Scholar 

  52. Alexander D, Thrasher M, Hughley B, Woodworth BA, Carroll W, Willig JH, Cho DY. Gamification as a tool for resident education in otolaryngology: a pilot study. Laryngoscope. 2019;129(2):358–61.

    Article  PubMed  Google Scholar 

  53. Aynsley SA, Nathawat K, Crawford RM. Evaluating student perceptions of using a game-based approach to aid learning: braincept. Higher Education Pedagogies. 2018;3(1):478–89.

    Article  Google Scholar 

  54. Azhari NN, Abdul Manaf R, Ng SW, Shakeeb Arsalaan Bajunid SF, Mohd Gobil AR, Saad WZ, Amin Nordin S. Gamification, a successful method to foster leptospirosis knowledge among university students: a pilot study. Int J Environ Res Public Health. 2019;16(12):2108.

    Article  PubMed  PubMed Central  Google Scholar 

  55. Dakroub AH, Weinberger JJ, Levine DL. Gamification for the win in internal medicine residency: a longitudinal, innovative, team-based, gamified approach to internal medicine board-review. Cureus. 2022;14(3):e22822.

    PubMed  PubMed Central  Google Scholar 

  56. Faysal LR, Yasmin R, Zaman A, Khan RA. Effectiveness of medical escape room on learning of undergraduate medical students in comparison with case-based learning in teaching of clinical dermatology. Rawal Med J. 2022;47(1):187.

    Google Scholar 

  57. Felszeghy S, Pasonen-Seppänen S, Koskela A, Nieminen P, Härkönen K, Paldanius KM, Gabbouj S, Ketola K, Hiltunen M, Lundin M, Haapaniemi T. Using online game-based platforms to improve student performance and engagement in histology teaching. BMC Med Educ. 2019;19:1–1.

    Article  Google Scholar 

  58. Guérard-Poirier N, Beniey M, Meloche-Dumas L, Lebel-Guay F, Misheva B, Abbas M, Dhane M, Elraheb M, Dubrowski A, Patocskai E. An educational network for surgical education supported by gamification elements: protocol for a randomized controlled trial. JMIR Res Protoc. 2020;9(12):e21273.

    Article  PubMed  PubMed Central  Google Scholar 

  59. Javed K, Rafique S, Azhar T. Impact of gamification on education prime time. Pakistan J Medical Health Sci. 2022;16(03):18.

    Article  Google Scholar 

  60. Lee LA, Wang SL, Chao YP, Tsai MS, Hsin LJ, Kang CJ, Fu CH, Chao WC, Huang CG, Li HY, Chuang CK. Mobile technology in E-learning for undergraduate medical education on emergent otorhinolaryngology–head and neck surgery disorders: pilot randomized controlled trial. JMIR Med Educ. 2018;4(1):e9237.

    Article  Google Scholar 

  61. Nevin CR, Westfall AO, Rodriguez JM, Dempsey DM, Cherrington A, Roy B, Patel M, Willig JH. Gamification as a tool for enhancing graduate medical education. Postgrad Med J. 2014;90(1070):685–93.

    Article  PubMed  Google Scholar 

  62. Snyder E, Hartig JR. Gamification of board review: a residency curricular innovation. Med Educ. 2013;5(47):524–5.

    Article  Google Scholar 

  63. Tsopra R, Courtine M, Sedki K, Eap D, Cabal M, Cohen S, Bouchaud O, Mechaï F, Lamy JB. AntibioGame®: A serious game for teaching medical students about antibiotic use. Int J Med Informatics. 2020;136:104074.

    Article  Google Scholar 

  64. Van Nuland SE, Roach VA, Wilson TD, Belliveau DJ. Head to head: the role of academic competition in undergraduate anatomical education. Anat Sci Educ. 2015;8(5):404–12.

    Article  PubMed  Google Scholar 

  65. Vuillaume LA, Laudren G, Bosio A, Thévenot P, Pelaccia T, Chauvin A. A didactic escape game for emergency medicine aimed at learning to work as a team and making diagnoses: methodology for game development. JMIR Serious Games. 2021;9(3):e27291.

    Article  Google Scholar 

  66. Ali MF, Nadeem N, Khalid F, Anwar NM, Nabie G, Docherty C. SonoGames: sounds of the right kind introducing gamification into radiology training. BMC Res Notes. 2021;14:1–7.

    Article  Google Scholar 

  67. Devlin S, Guan J, Reichstadt J, Sladek E, Gupta R. The university of california san diego geriatrics escape room: a didactic innovation. J Am Geriatr Soc. 2021;69(1):E1–3.

    Article  PubMed  Google Scholar 

  68. Pettit RK, McCoy L, Kinney M, Schwartz FN. Student perceptions of gamified audience response system interactions in large group lectures and via lecture capture technology. BMC Med Educ. 2015;15:1–5.

    Article  Google Scholar 

  69. Hudnall JA, Kopecky KE. The empathy project: a skills-development game: innovations in empathy development. J Pain Symptom Manage. 2020;60(1):164–9.

    Article  PubMed  Google Scholar 

  70. Huang WD, Tettegah SY. Cognitive load and empathy in serious games: A conceptual framework. In: Gamification for human factors integration: Social, education, and psychological issues. Hershey, PA: IGI Global. 2014; p. 17–30.

Download references

Acknowledgements

All contributors are recognized by the authorships.

Funding

The study was not funded by any funding agencies.

Author information

Authors and Affiliations

  1. Biomedical and Translational Science, Carle-Illinois College of Medicine; Education Policy, Organization, and Leadership, College of Education, University of Illinois Urbana-Champaign, Champaign, IL, USA

    Wenhao David Huang

  2. Education Policy, Organization, and Leadership College of Education, University of Illinois Urbana-Champaign, Champaign, IL, USA

    Viktoria Loid & Jung Sun Sung

Authors
  1. Wenhao David Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Viktoria Loid
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jung Sun Sung
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

WH designed the theoretical and empirical frameworks of the study and lead the review analysis of selected studies. VL performed the initial literature search and review under the supervision of WH. JS performed subsequent literature review in collaboration with VL and under the supervision of WH. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Wenhao David Huang.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Huang, W.D., Loid, V. & Sung, J.S. Reflecting on gamified learning in medical education: a systematic literature review grounded in the Structure of Observed Learning Outcomes (SOLO) taxonomy 2012—2022. BMC Med Educ 24, 20 (2024). https://doi.org/10.1186/s12909-023-04955-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12909-023-04955-1

Keywords

BMC Medical Education

ISSN: 1472-6920

Contact us