Skip to main content

Advertisement

We’d like to understand how you use our websites in order to improve them. Register your interest.
Download PDF

Using Kahoot! as a formative assessment tool in medical education: a phenomenological study

BMC Medical Education volume 19, Article number: 230 (2019) Cite this article

Abstract

Background

Gamification is an increasingly common phenomenon in education. It is a technique to facilitate formative assessment and to promote student learning. It has been shown to be more effective than traditional methods. This phenomenological study was conducted to explore the advantages of gamification through the use of the Kahoot! platform for formative assessment in medical education.

Methods

This study employed a phenomenological design. Five focus groups were conducted with medical students who had participated in several Kahoot! sessions.

Results

Thirty-six categories and nine sub-themes emerged from the focus group discussions. They were grouped into three themes: attractive learning tool, learning guidance and source of motivation.

Conclusions

The results suggest that Kahoot! sessions motivate students to study, to determine the subject matter that needs to be studied and to be aware of what they have learned. Thus, the platform is a promising tool for formative assessment in medical education.

Peer Review reports

Background

Assessment refers to a judgment about the performance of learners on the basis of specific weighted set goals [1]. There are two types of assessment: summative and formative. Summative assessment occurs after instruction and requires that judgments be made about the learning that has occurred. Formative assessment is designed specifically for providing feedback on performance to improve and to accelerate learning [1]. Formative assessment, the assessment of learning, is increasingly being emphasized in academia. It should be seen as an important element in the facilitation of the learning process [3, 4]. Formative assessment is most effective when it is embedded in the teaching and learning activities to facilitate the provision of ongoing timely, specific and actionable feedback to learners [2]. Therefore, formative assessment should be designed to improve students’ understanding of the subject matter.

Formative assessment can be performed in many ways, including paper-and-pencil tests or online quizzes [3]. The fourth industrial evolution has given rise to new methods. Online platforms, such as Kahoot!, Quizziz, Quizlet and Socrative, that apply game-based learning theories have become more common in education. The platforms are widely used as formative assessment tools to promote student learning [4].

Studies have demonstrated the benefits of game-based learning over traditional methods [5, 6]. Game-based learning has been shown to result in significantly improved student performance [6] because of the promotion of learning [7]. Game-based learning increases student motivation [6, 8], increases engagement [9, 10] and provides effective feedback [11].

Kahoot!, a real-time platform for game-based learning, is a free formative assessment tool that has been widely used in education. It has been reported to have more than 30 million users worldwide [12]. Kahoot! allows teachers to create four different types of game-based which are quizzes, surveys, jumbles and discussions in which the participants compete against one another. The top scorers for each question are revealed, and the overall winner(s) is/are displayed on a scoreboard at the end of the session [13].

At the Universiti Sains Malaysia (USM) School of Medical Sciences, formative assessment has been conducted via the e-learning quiz platform eQuiz. The platform has been used to provide feedback to students. The use of eQuiz is not compulsory, and the scores do not contribute to the summative assessments of the students. The data that were previously captured by the learning management system indicate that more than 50% of the students did not participate in the formative assessment activities. To overcome this issue, Kahoot! was introduced as an additional formative assessment tool.

In the USM School of Medical Sciences, courses are grouped into sequences. Two formative assessment sessions are allocated for each course. The questions to be accessed through Kahoot! are first constructed by the lecturers who are involved in the courses, which span disciplines, such as anatomy, physiology and biochemistry. The questions are submitted to the course coordinators before being converted to the Kahoot! quiz format (Fig. 1). Approximately 120–150 students play the Kahoot! ‘game’ in a typical session. The sessions are conducted by the course coordinators, who are assisted by the e-learning committee members. Each session comprises 20–25 questions. The top three Kahoot! winners get special prizes and medals, and their photographs are displayed on a dedicated frame labelled ‘Kahoot!ers of the Month’ outside their lecture halls.

Fig. 1
figure1

Kahoot! session flow

Full size image

A quantitative study was conducted to evaluate the students’ perceptions of a Kahoot! session [4]. Kahoot! was found to motivate students and to make learning enjoyable. This qualitative study was conducted to gain an in-depth understanding of the influence of Kahoot! on student learning. Therefore, the current study addressed the benefits of using Kahoot! as a formative assessment tool in medical education.

Methods

Research design, setting and sample

The current qualitative study employed a phenomenological design in which purposive sampling was used [5]. Focus group discussions (FGDs) were conducted to explore the medical students’ experiences in the Kahoot! sessions in the USM School of Medical Sciences. The participants were pre-clinical USM medical students who had participated in at least three Kahoot! sessions. Maximal variation sampling was performed to select the participants on the basis of age, gender and ethnicity. The saturation concept was used to estimate the sample size [6]. The participants were invited through a problem-based learning (PBL) group. They were briefed on the study background, protocol and consent form. They were also informed that their identities would be kept anonymous and that they could withdraw from the study at any time. Only the students who gave consent were enrolled in the study. The times and locations of the FGDs were arranged according to the students’ convenience.

Data collection and analysis

The FGDs were conducted by researchers with expertise in qualitative methods. Bracketing was employed throughout the data collection and analysis [7]. To standardize the data, a four-part interview protocol was developed. It comprised the introduction, trigger questions, probing questions and conclusion (Additional file 1: Appendix A). Each session began with an introduction that explained the ground rules and the FGD process. The sessions began with the open-ended statement: ‘In my experience, the Kahoot! sessions are….’ Researcher bracketing allowed the participants to describe their experiences without contamination by the interviewer [7]. The FGDs were audio recorded and transcribed verbatim. Data collection was stopped once saturation was achieved [8]. Field notes were taken during the interviews. Each FGD lasted approximately 30–45 min. After the first FGD was completed, the data were analysed by the use of ATLAS.ti 7 software. The three steps in the procedure were (i) managing the data, (ii) understanding the data and (iii) interpreting the data.

Managing the data

The first step was the verbatim transcriptions of the audio recording of the interview. Each transcript was labelled with a specific code, e.g. FGD [1] 01/06/18. The ‘ [1]’ indicates that this was the first FGD, and ‘01/06/18’ refers to the date of the interview (1st June 2018).

Understanding the data

Each sentence of the verbatim text was read very carefully to discern the concepts, ideas and terminology that related to the research objectives. The relevant information was selected on the basis of the research objectives. All of the researchers were involved in this step.

Interpretation of the data

This step was executed simultaneously with the second step. The data were coded by the use of thematic analysis [9]. ATLAS.ti 7 software was used for this process [10]. From the verbatim texts, the initial codes were generated; next were the categories, subthemes and themes. Thematic maps generated from the software were reviewed to discern the relationships among the themes. To ensure the credibility, transferability, confirmability and dependability of the data, several measures were taken to enhance the validity of the findings. Table 1 summarizes the trustworthiness criteria that were applied to ensure the rigour of the qualitative research findings [11].

Table 1 Trustworthiness criteria ensure the trustworthiness of qualitative findings in this study
Full size table

Results

Participants’ profiles

A total of 36 students participated in five FGDs in which saturation point was reached during the third session. However, the fourth and fifth FGDs were conducted to confirm the saturation point was indeed reached. The complete demographic profiles of the participants are presented in Table 2.

Table 2 Demographic profiles of the participants
Full size table

Advantages of Kahoot!

Thirty-six categories and nine subthemes emerged from the FGDs. The subthemes were grouped into three themes: 1) attractive learning tool, 2) source of motivation and 3) learning guidance.

Theme 1: attractive learning tool

The participants perceived Kahoot! as a user-friendly platform that makes learning more enjoyable. They also indicated that it promotes active learning (Table 3). The participants found Kahoot! to be more mobile-friendly than eQuiz. In addition, they indicated that the Kahoot! sessions encouraged participation because of the rewards given to the winners at the end of each session. Although participation was not compulsory, the students in the study, all of whom had used this formative assessment tool, stated that ‘all students get involved’ with the activity.

Table 3 Theme 1– Attractive learning tool
Full size table

The participants mentioned that the gamification features in Kahoot! promoted fun learning. They perceived it ‘as a game, sort of entertainment’ ([P21] FGD [3] 04/01/18). The platform was also perceived as challenging and capable of stimulating learning through the use of audio-visual stimuli. The students enjoyed the large group activities because they could compare their performance with that of their peers in real time.

The Kahoot! sessions were perceived as being different and more interesting than the quizzes in the e-learning portal. This finding was supported by the fact that the participants stated that Kahoot! was more interactive, thereby requiring the keener focus and active participation of the students.

Theme 2: source of motivation

The participants considered the Kahoot! sessions motivational (Table 4). The sessions promoted continual learning, review and deep learning. After participating in multiple Kahoot! sessions, the participants stated that the platform would help them to improve their academic performance. The Kahoot! sessions increased their motivation through competition, which increased their self-confidence and stimulated their participation in more sessions. Interestingly, the failure to answer questions correctly was not demotivating. One participant stated, ‘It will trigger you to work more’ ([P15] FGD [1] 01/06/18). The participants also perceived the Kahoot! sessions as satisfying and gratifying: ‘When our names are displayed on the screen, we feel very proud, especially when we are in the top three. Our names are also displayed on the frame’ (FGD [4] 03/02/18).

Table 4 Theme 2 – Source of motivation
Full size table

Theme 3: learning guidance

The participants believed that the Kahoot! sessions provided learning guidance. They stated that the Kahoot! sessions offered opportunities for feedback, self-reflection and self-assessment. The sessions helped them to increase their understanding of the subject matter and prepare for examinations; thus, their studying was more focused (Table 5). The Kahoot! platform was perceived as an effective tool for assessment and feedback. Furthermore, the sessions encouraged the students to study harder. A participant mentioned the ‘need to study more’ ([P20] FGD [3] 04/01/18). The real-time response in Kahoot! made it interactive; thus, the students received instant feedback that allowed them to know which questions they had answered correctly.

Table 5 Theme 3 – Learning guidance
Full size table

The participants stated that the Kahoot! sessions provided guidance on the content to be learned and that it encouraged self-reflection. The feature of displaying the top scorers in real time provided ‘benchmark peers’, and this helped the low academic achievers to seek necessary support from their peers and lecturers. The Kahoot! sessions also tested their understanding of the material, thus helping them to improve their academic performance.

Regarding examination preparation, a unique feature of the platform is that besides giving correct answers, the speed of response is also important for the students to score more points during Kahoot! sessions. The participants mentioned that this feature trained them to think fast not only for examinations but also for their lives as future medical practitioners. Early exposure to multiple-choice questions (MCQs) and thus the examination was another advantage of the Kahoot! sessions.

The students needed to prioritise the topics to be studied. They indicated that after completing several Kahoot! sessions, they had a clearer idea of the important topics to be studied in deep. A participant said, ‘We can see which topics are important … which topics are less important’ ([P21] FGD [3] 04/01/18).

Discussion

Good formative assessments strengthen the students’ capacity to regulate their own performance. Nicol and Macfarlane-Dick [12] identified seven principles of good feedback practices. Good feedback practices 1) help to define good performance, 2) facilitate self-reflection; 3) deliver high-quality information to students about their learning, 4) encourage teacher and peer dialogue, 5) promote positive motivational beliefs and self-esteem, 6) close the gap between current and desired performance and 7) provide instructors with information that can be used to shape their teaching. Regarding formative assessment, the study showed that the students perceived the Kahoot! sessions as an effective feedback tool. It is an attractive learning tool that is a source of motivation and guidance for student learning.

Attractive learning tool

Kahoot! was perceived as being more user-friendly than eQuiz. This finding was similar to that of a previous previous study [4]. The students can benefit from formative assessment by downloading the Kahoot! application, which is available free in the Play Store (for Google’s Android operating system) and the App Store (for Apple’s iOS operating system). They can participate in the sessions with just a single tap. In contrast, participation in eQuiz involves more steps, such as browsing the e-learning portal, logging in with their user names and passwords and searching for their courses. The multiple steps might explain the students’ preference for Kahoot! as a formative assessment tool.

This study shows that student engagement in formative assessment was higher with Kahoot! than with eQuiz. This was consistent with the previous findings that fewer than 50% of students used eQuiz. After the change to Kahoot!, more than 90% participated in the formative assessment activities. An effective tool for gamifying learning, Kahoot! possesses all seven elements of the persuasive architecture of gamification (Fig. 2; [ [13]. It sets goals, offers challenges and provides feedback. It also provides reinforcement, facilitates learners’ comparisons of their own and their peers’ progress, enables social connectivity and creates a fun learning environment. Learning with Kahoot! was perceived as fun mainly because of the gamification features and the audio-visual stimuli. The platform was also perceived as providing challenging activities, such as games for large groups for which the results are available in real time. A Kahoot! session is different from and more interesting than an eQuiz session. Furthermore, Kahoot!‘s interactive features promote active learning through increased engagement.

Fig. 2
figure2

Elements of persuasive architecture of gamification

Full size image

Trumpower and Sarwar [14] asserted that user-friendliness is crucial for effective formative assessment. The specificity and accuracy of a platform are of no value if the users (students and teachers) cannot understand how to use it [15]. The current study has demonstrated that Kahoot! is user-friendly; however, a strong internet connection and the appropriate devices must be available before and during the session. For a session to be successful, the faculty members should also be familiar with the platform. However, Kahoot! has some limitations. It is suitable for multiple-choice rather than essay questions.

Medical training is considered to be intense and demanding; therefore, medical students are predisposed to psychological distress [16]. Previous studies have found the worldwide prevalence of psychological distress among medical students to be 21–56% [16]. A fun learning environment has been shown to reduce psychological distress [17]. In addition to having positive effects on education, gamification creates a fun and entertaining environment [18]. The current study shows that the Kahoot! platform is effective at changing a stressful environment into a joyous one. This finding is consistent with that of a previous quantitative study in which students perceived Kahoot! sessions as fun [4]. However, institutions that wish to adopt Kahoot! for fun learning should note that the sessions should be properly planned to ensure that the students achieve the intended outcomes and avoid the excessive fun that could create disastrous teaching environment and lead to negative consequences [19].

Sources of motivation

Formative assessment can have a significant effect on student motivation and achievement [20] if it is designed to stimulate the extrinsic aspects of student motivation [21]. Kahoot! has been shown to be an external factor in facilitating continual learning, which could improve academic performance. Its competitive environment is key [22]. Another interesting aspect that has been demonstrated in the current study is the sense of satisfaction experienced by the students. Thus, Kahoot! indirectly engenders positive feelings in students regarding their academic progress [23].

Learning guidance

As has been demonstrated in this study, formative assessment is most effective through the ‘catalytic effect’ of specific and actionable feedback to learners [2]. The sessions encouraged the participants to reflect on their strengths and weaknesses. Furthermore, unlike other formative assessment approaches, Kahoot! allows teachers to provide instant feedback. The session allows teachers to interact with their students and to clarify material related to the questions. In addition to facilitating teacher feedback, the sessions also promote self-assessment. An ‘assessment for learning’ tool [24], the Kahoot! session indirectly prepares students for summative assessment by highlighting the important topics to be reviewed. In sum, Kahoot! sessions serve as an assessment of learning.

Other advantges of Kahoot!

Kahoot! offers several other advantages. The platform: 1) is free; 2) uses multiple formats, i.e. quizzes, discussion questions or surveys; 3) is user-friendly; 4) facilitates participation through an automatically generated game pin; 5) is compatible with smartphones, tablets and computers; 6) has music and colourful illustrations that generate excitement; and 7) has a flexible and adjustable response time based on question complexity. In addition, instructors can download, review and save the students’ results to analyse student performance [4]. Therefore, it is recommended that medical schools use this free platform as a formative assessment tool to promote learning. Kahoot! can be incorporated into teaching and learning sessions, such as lectures, tutorials and problem-based learning activities, for effective formative feedback.

Limitations of the study

This qualitative study was conducted in a single institution; therefore, caution should be observed in extending the findings to other populations. The study found that students perceived Kahoot! as a useful tool for formative assessment. They indicated that participation in Kahoot! sessions can improve their academic performance. However, further study is need to determine the effects of Kahoot! on academic performance.

Conclusions

Kahoot! is an innovative formative assessment tool. This study suggests that Kahoot! sessions motivate students to study, focus on the important concepts and reflect on what they have learned. Therefore, this platform holds promise for facilitating formative assessment in medical education. Health professions educators are therefore encouraged to incorporate Kahoot! into their teaching and learning activities particularly for formative assessment.

Availability of data and materials

The datasets used and analysed during the current study are available from the corresponding author upon a reasonable request.

Abbreviations

FGD:

Focus group discussion

MCQs:

Multiple-choice questions

PBL:

Problem-based learning

USM:

Universiti Sains Malaysia

References

  1. 1.

    Sadler DR. Formative assessment: revisiting the territory. Assessment in education: principles, policy & practice. 1998;5(1):77–84.

  2. 2.

    Norcini J, Anderson B, Bollela V, Burch V, Costa MJ, Duvivier R, et al. Criteria for good assessment: consensus statement and recommendations from the Ottawa 2010 conference. Medical teacher. 2011;33(3):206–14.

  3. 3.

    Blanco M, Ginovart M. On how moodle quizzes can contribute to the formative e-assessment of first-year engineering students in mathematics courses. RUSC, Universities and Knowledge Society Journal. 2012;9(1):354–70.

  4. 4.

    Ismail MA-A, Mohammad JA-M. Kahoot: a promising tool for formative assessment in medical education. Education in Medicine Journal. 2017;9(2).

  5. 5.

    Groenewald T. A phenomenological research design illustrated. Int J Qual Methods. 2004;3(1):42–55.

  6. 6.

    Marshall MN. Sampling for qualitative research. Fam Pract. 1996;13(6):522–6.

  7. 7.

    Langdridge D. Phenomenological psychology: theory, research and method: Pearson education; 2007.

  8. 8.

    Maxwell JA. Designing a qualitative study. The SAGE handbook of applied social research methods, vol. 2; 2008. p. 214–53.

  9. 9.

    Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3(2):77–101.

  10. 10.

    Yeh CJ, Inman AG. Qualitative data analysis and interpretation in counseling psychology: strategies for best practices. Couns Psychol. 2007;35(3):369–403.

  11. 11.

    Guba EG. Criteria for assessing the trustworthiness of naturalistic inquiries. Educ Technol Res Dev. 1981;29(2):75–91.

  12. 12.

    Nicol DJ, Macfarlane-Dick D. Formative assessment and self-regulated learning: a model and seven principles of good feedback practice. Stud High Educ. 2006;31(2):199–218.

  13. 13.

    Cugelman B. Gamification: what it is and why it matters to digital health behavior change developers. JMIR Serious Games. 2013;1(1).

  14. 14.

    Trumpower DL, Sarwar GS. Formative structural assessment: using concept maps as assessment for learning. In: Proceding of fourth Int conference on concept mapping; 2010. p. 132–6.

  15. 15.

    Wiggins G. Seven keys to effective feedback 2012. 2012;70(1):11–6.

  16. 16.

    Yusoff MSB, Yee LY, Wei LH, Siong TC, Meng LH, Bin LX, et al. A study on stress, stressors and coping strategies among Malaysian medical students. International Journal of Students' Research. 2011;1(2).

  17. 17.

    Fun PM. Play and games: what makes games engaging. Digital game-based learning, vol. 5; 2001. p. 1–05.

  18. 18.

    Bellotti F, Kapralos B, Lee K, Moreno-Ger P, Berta R. Assessment in and of serious games: an overview. Advances in Human-Computer Interaction. 2013;2013:1.

  19. 19.

    Baid H, Lambert N. Enjoyable learning: the role of humour, games, and fun activities in nursing and midwifery education. Nurse Educ Today. 2010;30(6):548–52.

  20. 20.

    Cauley KM, McMillan JH. Formative assessment techniques to support student motivation and achievement. The Clearing House: A Journal of Educational Strategies, Issues and Ideas. 2010;83(1):1–6.

  21. 21.

    Weurlander M, Söderberg M, Scheja M, Hult H, Wernerson A. Exploring formative assessment as a tool for learning: students’ experiences of different methods of formative assessment. Assess Eval High Educ. 2012;37(6):747–60.

  22. 22.

    Regueras LM, Verdu E, Muñoz MF, Perez MA, de Castro JP, Verdú MJ. Effects of competitive e-learning tools on higher education students: a case study. IEEE Trans Educ. 2009;52(2):279–85.

  23. 23.

    Keller J. Development and use of the ARCS model of motivational design (Report No. IR 014 039). Enschede, Netherlands: Twente Univ of Technology(ERIC Document Reproduction Service No ED 313 001). 1983.

  24. 24.

    Schuwirth LW, Van der Vleuten CP. Programmatic assessment: from assessment of learning to assessment for learning. Medical teacher. 2011;33(6):478–85.

Download references

Acknowledgements

The authors thank the USM School of Medical Sciences for its support. They are very grateful to Associate Professor Dr. Muhamad Saiful Bahri Yusoff, the head of the Department of Medical Education, for his continuous support. The authors sincerely thank the students who voluntarily participated in the study.

Ethical approval and consent to participate

This study was conducted with permission from the USM School of Medical Sciences as a part of its program evaluation. Ethical approval was granted by the Human Research Ethics Committee at the Universiti Sains Malaysia. The approval code is USM/JEPeM/18020.

Funding

This study was fully funded by the University Sains Malaysia (USM) short-term grant (304/PPSP/61313161). The grant covered all the costs related to the study. These included honoraria to all the participants, as allowed by the ethics committee. Other study-related activities funded by the grant include the publication costs.

Author information

Affiliations

  1. Department of Medical Education, School of Medical Sciences, Universiti Sains Malaysia, Health Campus, Kota Bharu, Malaysia
    • Muhd Al-Aarifin Ismail
    • , Anisa Ahmad
    • , Jamilah Al-Muhammady Mohammad
    • , Nik Mohd Rizal Mohd Fakri
    • , Mohd Zarawi Mat Nor
    •  & Mohamad Najib Mat Pa
Authors
  1. Muhd Al-Aarifin Ismail
    View author publications
    You can also search for this author in
  2. Anisa Ahmad
    View author publications
    You can also search for this author in
  3. Jamilah Al-Muhammady Mohammad
    View author publications
    You can also search for this author in
  4. Nik Mohd Rizal Mohd Fakri
    View author publications
    You can also search for this author in
  5. Mohd Zarawi Mat Nor
    View author publications
    You can also search for this author in
  6. Mohamad Najib Mat Pa
    View author publications
    You can also search for this author in

Contributions

MAAI, the main author, made significant contributions to the research design, data collection and interpretation, and writing of the manuscript. MZMN and AA, who have expertise in qualitative research, were involved in the research design and the collection and interpretation of the data. NMRMF contributed to the collection and interpretation of the data and the writing of the manuscript. AA, JAMM and MNMP contributed significantly to the writing of the manuscript. All of the authors have critically reviewed and approved the final draft and are responsible for the content of the manuscript.

Corresponding author

Correspondence to Muhd Al-Aarifin Ismail.

Ethics declarations

Consent for publication

Before the FGDs were conducted, written consent was received. The consent form was approved by the ethical committee. All of the participants were more than 16 years old; therefore, parental consent was not required.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional file

Additional file 1:

Appendix A. Focus Group Discussion Protocol. (DOCX 18 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Ismail, M.A., Ahmad, A., Mohammad, J.A. et al. Using Kahoot! as a formative assessment tool in medical education: a phenomenological study. BMC Med Educ 19, 230 (2019). https://doi.org/10.1186/s12909-019-1658-z

Download citation

Keywords

  • Formative assessment
  • Kahoot!
  • Gamification
  • Medical students
  • Fun learning
  • Game-based learning

BMC Medical Education

ISSN: 1472-6920

Contact us