Skip to main content
  • Research article
  • Open access
  • Published:

Phone-based audience response system as an adjunct in orthodontic teaching of undergraduate dental students: a cross-over randomised controlled trial

Abstract

Background

The advent of electronic teaching facilities improves tutor-student communication. This study aims to explore the effectiveness of Phone-Based Audience Response System (PB-ARS), as an adjunctive pedagogy tool to enhance the retention of orthodontic information by dental students; and to explore the students’ perception of PB-ARS.

Methods

This cross-over clustered randomised control trial included 34 males who were in the final year of their undergraduate dental training. Participants were allocated to one of two event groups (G1 and G2) using computer-generated randomisation. Both groups simultaneously attended two different traditional lectures (L 1 and L2) a week apart. During L1, PB-ARS was used as an adjunct to conventional presentation to teach G1 participants, (PB-ARS group) while G2’s participants acted as a control group (CG), and were taught using a traditional presentation. In the second week (L2), the interventions were crossed-over. Participants from both groups completed pre- and post-lecture multiple-choice questionnaires (MCQ) to assess their short-term retention of information. Their performance in the final MCQ exam (10 weeks following L2) was tracked to assess the long-term retention of the information. Participants also completed post-lecture questionnaires to evaluate their perceptions.

Results

Twenty-nine and 31 participants from the CG and PB-ARS group completed this trial, respectively. Although 87.5% of students in the PB-ARS group showed an improvement in their immediate post-lecture scores compared with 79.3% for the CG, it was statistically insignificant (p = 0.465). Similarly, the intervention showed an insignificant effect on the long-term retention of the knowledge (p = 0.560).

There was a mildly but favourable attitude of students towards the use of PB-ARS. However, the difference in the overall level of satisfaction between both groups was statistically insignificant (p = 0.183).

Conclusion

PB-ARS has a minimal and insignificant effect on the short- and long-term retention of orthodontic knowledge by male undergraduate dental students. PB-ARS was the preferred adjunct tool to conventional classroom teaching. Due to the limitations of this trial, a long-term randomised controlled trial with a larger sample size is recommended.

Peer Review reports

Background

Undergraduate teaching has always been regarded as the core foundation in the development and maturation of undergraduate students. Lecturing and learning are synonymous; hence, the underlying principles governing the appropriate teaching approaches are mainly aimed at encouraging student-tutor communication, enabling consistent feedback, and establishing an interactive teaching model [1, 2] . Other crucial pedagogical elements in any given course are to promote deep learning, though most post-secondary educational courses rely on traditional teacher-centered and passive student participation approaches [3]. Evidence shows that didactic lectures require a high level of motivation and concentration, yet yield low retention of knowledge, this being approximately 5–50% of the taught subject [4]. On the other hand, interactive adult teaching enhances deep, self-directed and reflective learning. Similarly, active question-based education stimulates and enhances learning more than didactic lectures [5].

An audience response system (ARS) is an electronic device introduced to be of value in teaching and education in parallel, as it transforms traditional didactic lectures into a more interactive learning process [6]. An ARS was first used for education in 1991 by Rice University to teach statistics [7]. The implementation of electronic wireless interactive technology has gradually stepped into the educational paradigm, acting as a novel pathway towards a more developed student-learning process, thus promoting self-directed learning. ARS, also called personal response systems or clickers, act as interactive tools allowing students to share their knowledge instantly, by voting electronically on an on-screen or on-handset set of questions.

The ARS can be hard-wired or wireless. Wireless ARS can either be a specific handset-based ARS connected via radio or internet to a master handset controller, or personal smartphone-based ARS using web poll, short message service (SMS) or direct wireless connection through smartphone applications. Most ARS allow the running of multiple-choice questions [8]. However, the recently introduced ARS provide an additional option of running open-ended and dichotomous questions using either text or multimedia-based (pictures or video) questions.

Recently developed ARS allow instant evaluation of students’ responses against their peers to confirm whether there is a need for further elaboration of the primary vital points, thus, assisting tutors to redesign the delivery of learning materials [9, 10]. Furthermore, students’ responses can be sent anonymously. This allows the students to answer in a non-threatening environment, eliminating the main barrier of active participation, which is embarrassment [11]. An example of the ARS is the Poll Everywhere which is a smartphone application that has a feature enabling the administrator to launch open-ended and dichotomous questions, using either text or multimedia-based (pictures) materials, and then collects and analyses the answers from the users (students) instantly.

A trial based in England showed that ARS could have a positive influence on students’ concentration levels, resulting in a subsequent improvement in the retention of orthodontic knowledge when implemented in small group seminars [8]. Another study showed that ARS promote interactions during orthodontic lectures, but with little effect on short-term information recall [12]. The same research also showed that students preferred using the ARS while attending lectures and seminars, since they found it easier to understand, interact, and later, participate [12]. As a result, it is expected that the retention of knowledge would be better than traditional teaching methods. An additional application of the phone-based ARS (PB-ARS) in the current COVID-19 pandemic, is the versatility in engaging students during distant online teaching, building interactivity in the virtual classroom, and possibly compensating for the lack of face-face interaction. Studies concluded that the use of ARS in virtual teaching during the COVID-19 era, effectively improved the delivery of the teaching material and enhanced the interactivity of the learners [13,14,15]. Another group of researchers reported similar findings when they used PB-ARS in teaching chemistry during the COVID-19 period. Although those reports at best represent expert opinions which lack the robustness of other research design, they pave the way for the potential use of PB-ARS in remote teaching [16].

On the other hand, there are generic obstacles in the uses of ARS, such as subscription rate, maintenance, training, troubleshooting and technical support. Also, it seems that there is conflicting evidence regarding the effectiveness of ARS. Robson and colleagues found that the benefits of the ARS are insignificant; nevertheless, there was a small improvement in knowledge gained by the ARS group compared with the control group [12]. Hence, it is essential to reach a consensus regarding the effectiveness of ARS in orthodontic pedagogy.

The aim of this cross-over randomised controlled trial (RCT) was (1) to investigate the effectiveness of PB-ARS using text- and multimedia-based questions on the retention of information by male undergraduate dental trainees; (2) to explore the students’ perception and acceptance of PB-ARS. The null hypothesis stated that there is no difference in terms of knowledge retention and students’ perceptions when PB-ARS is used as an adjunct to didactic orthodontic teaching of undergraduate dental students.

Methods

Funding, ethical considerations and registration

This trial was self-funded and approved by the local committee of research at the College of Dentistry at Prince Sattam Bin Abdulaziz University (PSAU) (1439–03-001). The trial was registered with ClinicalTrials.gov Protocol Registration and Results System (NCT04336813), however, the protocol was not published. The authors declare that there is no financial interest or conflict of interest in this trial.

Study design

The trial was designed as a cross-over clustered randomised control trial (each group was a cluster).

Setting and consent

The study was commenced at the College of Dentistry, PSAU in Alkharj City in Saudi Arabia. Written consent was obtained from all participants before starting the trial.

Participants

The eligibility criteria included undergraduate students in the fourth year of their dental training with no prior orthodontic education. Students who were registered in the course for the second time were excluded to lessen the bias associated with increased knowledge. The cohort of the trial involved 34 undergraduate dental students.

Randomisation

Participants were allocated to one of the two even groups using computer-generated randomisation. Participants in the control group (CG) were taught through the conventional model using PowerPoint presentation. Participants in the intervention arm used Phone-Based Audience Response System (PB-ARS group) as an adjunct during the PowerPoint presentation. The sequence of random allocation was concealed from the researchers who recruited the participants. Each group consisted of 17 male students.

Intervention

Lectures

Simultaneously, CG and PB-ARS groups attended two lectures, the first lecture (L1) titled “Management of Class III Malocclusion” while the second lecture (L2) was titled “Management of Open Bite and Cross-bite”. L1 and L2 were delivered at the main campus of PSAU College of Dentistry. L1 and L2 were delivered identically in all aspects, including:

  • the presentation platform (PowerPoint, Microsoft Corp, Redmond, WA),

  • the lecturer (both L1 and L2 were given by the same registered specialist orthodontist (F.A.), and

  • the duration of the lectures which was 60 min.

Learning outcomes of the delivered lectures were based on learning objectives and outcomes as specified by the National Commission for Academic Accreditation and Assessment in Saudi Arabia.

Before L1, students were instructed to register with the PB-ARS and to download its application (Poll Everywhere, San Francisco, California, USA, https://www.polleverywhere.com). Extra smartphones were accessible to students who did not have smartphones during the lectures. Students were blinded from their allocations until the beginning of L1.

Before the L1 and L2, both groups completed a validated multiple-choice question (MCQs) formative assessment. During L1, the participants in the PB-ARS group had access to an interactive poll of new questions regarding the taught topic, via their smartphones. The participants in the PB-ARS group were allowed to read the questions and answer them. Participants in the CG were blinded from those questions. To assess the improvement in the students’ performance, at the end of L1, both groups again completed the pre-lecture MCQs test. A similar protocol was undertaken during L2 a week later, except that the groups were crossed-over. Hence, the group which had PB-ARS integrated during L1 were blinded from the poll of questions during L2, and vice versa. At the end of L1 and L2, participants in the PB-ARS and CG groups answered a set of questions regarding their experience with the lecture.

Formative MCQs exam

MCQ formative tests consisted of 20 questions related to the topics taught during L1 and L2. The maximum achievable score was 20. To reduce the carry-over effect, the PB-ARS questions during the lectures were different from the MCQ formative written exam sheet. Two authors piloted the bank of questions to ensure its content validity and reliability. Content validity was tested using test matrix and expert judgment. The reliability test was estimated using inter-rater reliability. A correlation of more than 0.7 was considered acceptable.

Summative exam

Both groups attended their final written summative exams 10 weeks after L2. The final exam was in MCQ format. The summative written exams covered questions from all dental and medical subjects taught during the second semester in the fourth year of undergraduate dental training at the College of Dentistry, PSAU. The summative written exam included five randomly selected questions relevant to the orthodontic subjects taught in L1 and L2. The written exam questions were identical for all students and delivered under controlled exam conditions. The summative written exam scores specific to L1 and L2 questions were traced and collected using an Excel spreadsheet by an independent tutor to reduce reporting bias. The maximum achievable score for the five questions relevant to the subjects taught in L1 and L2 was 5.

Students’ perception

At the end of L1 and L2, participants of the CG completed a set of questionnaires regarding their experience with the lecture. Similarly, participants of PB-ARS group completed another set of questionnaires (add1). The questionnaire of the CG consisted of 9 questions that assessed understanding of the topic of the lecture, possibility of participation in the lecture, interaction with the tutor, and total level of satisfaction. The questionnaire of the intervention group (PB-ARS) included an additional 4 questions specific to PB-ARS that aimed to assess the perception of using PB-ARS as an adjunct to conventional teaching. To enhance the validity and reliability of the questionnaire, the original English version of the questionnaires, adopted from a previous study with close similarity to our assessed cohorts, was also used in our study [8]. Additionally, the questionnaire was distributed between the authors to reduce ambiguity and modify confusing questions, if deemed necessary. Each question was answered using a 0–10 scale. The response of the students was categorised into five categories. The 5 categories of responses were: strongly disagree (score 0–1), disagree (score 2–4), neutral (score 5), agree (score 6–8) and strongly agree (score 9–10).

Analysis of the results

Students’ responses and scores were exported into an Excel spreadsheet. Students who failed to attend the summative exam and decided to take the “resit” exam were excluded from this trial to reduce the effect of time as a confounding factor. An intention to treat [17] analysis was adopted to deal with dropouts and missing data of non-compliant participants. Data was analysed by a blinded statistician using SPSS 22. Pre- and post-lecture formative assessment scores were analysed and compared using cross-over analysis with the Mann–Whitney U test, while a t-test was used to analyse summative exam scores.

Results

The entire cohort of fourth-year undergraduate dental students (34 students, aged 23.27 years ±0.86) were enrolled in this cross-over randomised trial. During L1, three students were absent (one from the PB-ARS group and two from the CG). During L2, the trial’s arms were crossed over, and three students were absent, all from the CG. In L1, only 31 students attended, 16 students were allocated to the PB-ARS group while the rest were allocated to the CG. In L2, 31 students attended the lecture, 17 students were allocated to the PB-ARS group and 14 students were allocated to the CG. On average, the percentage of students’ attendance of the L1 and L2 were similar.

In total after L1 and L2, 33 students from the PB-ARS group and 29 students from the CG completed the formative exam. Thirty students from the PB-ARS group and 29 students from the CG completed the perception’s questionnaire. Figure 1 shows the CONSORT flow diagram of the study.

Fig. 1
figure 1

CONSORT Flow Diagram of the trial

Questionnaires

The results of both questionnaires are displayed in Tables 1 and 2. In both groups, the majority of the participants agreed that the lectures were understandable (86.6% for PB-ARS group; 83% for CG) and felt that they enjoyed the presented topics (83.3% for PB-ARS group; 83% for CG). Students in both groups felt they were capable of participating in the active discussion during the lectures (83.3% for PB-ARS group; 83% for CG), and agreed that they were more receptive to questioning during the lectures, in particular when PB-ARS was implemented (76.7%% for PB-ARS group compared to 72% for CG). Participants of the PB-ARS group reported a higher level of concentration compared with those in the CG, 80 and 66% respectively.

Table 1 Students responses in the PB-ARS
Table 2 Students responses in the CG

The majority of participants (70%) were satisfied and preferred (76.7%) the use of PB-ARS (Poll Everywhere mobile app) during the lecture. Participants reported that they were more likely to prepare for future lectures if PB-ARS was to be used (83.3%). In terms of the overall satisfaction levels, there was a statistically insignificant difference between the two groups (90% for PB-ARS group; 83% for CG; median and mode questionnaire score for both groups = 4, p = 0.183).

Retention of knowledge

Analysis of the students’ performance during the formative exam was carried out to assess short-term recall of knowledge. Twenty-nine students from the CG arm and 31 students from the intervention arm (PB-ARS group) undertook the pre-lecture and post-lecture MCQ formative assessments. 87.5% of students in the PB-ARS group showed improvement in their scores after the intervention, compared with 79.3% in the CG. The means of the pre-lecture exam score (the maximum achievable score was 20) for the CG and the PB-ARS groups were (6.4, SD 3) and (7.2, SD 2.25) respectively. The mean of the post-lecture exam score (the maximum achievable score was 20) was (8.89, SD 3.86) for the CG and (10, SD 2.74) for the PB-ARS group. Nevertheless, there was no statistically significant difference between the groups (mean difference (MD) = 2.63, confidence interval 1.74–3.52, p = 0.465).

Analysis of the students’ performance during the summative exam was carried out to assess long-term retention of knowledge. The mean for the summative exam score (the maximum achievable score was 5) was (2.87, SD1.51) for the CG and (3.06, SD 1.49) for the PB-ARS group; the mean difference was statistically insignificant (MD 0.194, 95% CI (− 0.467) -0.854, p = 0.560).

Discussion

Recently, several reports have explored the effectiveness of ARS in medical teaching and education. A recent meta-analysis found that the use of ARS technology in learning had positive effects on both cognitive and non-cognitive learning outcomes [18]. However, few of the conducted trials have studied ARS application for undergraduate dental teaching programs, in particular in the field of orthodontics [19, 20]. The material of the discipline of orthodontics is considered to have a relatively high level of speciality, and consequently is considered to be out of the scope of practice of general dentists. Therefore, it has always been a dilemma for dental faculties and tutors to effectively measure their students’ essential understanding of orthodontic knowledge and principles [21].

Orthodontics as a taught subject at PSAU starts in the fourth year of the Bachelor of Dental Science (B.D.S.) degree. Thus, the choice was made to select this cohort of students who had no previous exposure to orthodontic material. The entire class was included in the study. This ensured no selection bias since all the assessed participants had the same level of dental knowledge.

One tutor (F.A.) delivered both taught lectures (L1, L2), 1 week apart, and the groups were then crossed-over. This further reduced bias and enhanced the blinded cross-over protocol. Both groups had a formative written exam following each lecture, to assess the short-term retention of information, and a final summative written exam, 10 weeks later, to evaluate the long-term recall of the knowledge.

The null hypothesis of our trial was accepted. The results showed that the majority of the participants in both groups rated the lectures as enjoyable, interesting, and found it easy to understand the taught topic. This finding was in line with those reported in the literature [5, 8, 12, 17, 22]. Besides these findings, the participants in the intervention group reported higher levels of concentration, probably due to the need for active participation during the lecture. Students responded positively towards upcoming lectures in which PB-ARS was planned to be used. This might represent the effectiveness of PB-ARS in building interest in the subject material, though the difference in the overall rating was statistically insignificant. This was in agreement with previous studies [12]. A study has shown that PB-ARS provides the students with a safe teaching environment due to the anonymity of the users [23]. Other studies have reported that the use of clickers in the classroom improved students’ attention during the lectures [24, 25]. Nevertheless, a previous study conducted in 2006 found that while the implementation of ARS might encounter difficulty in lecture preparation, the ARS fostered student participation [26].

Still, it is crucial to note that the use of smartphones as PB-ARS might have some disadvantages which could limit the feasibility within the classroom. For instance, smartphones might create a source of student distraction and demand internet access. In addition, faculty members might need further training on the use of this fast-developing modern technology. To lower the probability for biased results, participation in this study was not compulsory. No students were compelled to complete the questionnaire and participants were allowed to leave the lecture hall at their will.

In our trial, the formative and summative exam scores of the participants from the PB-ARS group improved marginally compared with those of the control group. This is different from previously reported findings [27, 28]. Stowell and Nelson reported a noticeable, but statistically insignificant improvement in student learning curves [29]. Moreover, students’ attendance in our trial was almost identical in both arms of the study, unlike the previous study [30]. This could be because students involved in this study had been informed that they were participating in a research project, which might have increased the level of interest and alertness during both lectures (Hawthorne effect).

Limitations of the study

Although the sample included all undergraduate students in their fourth year of dental training, retrospective sample size calculations showed that our study was underpowered. Robson and colleagues have suggested conducting a parallel multi-centre research study, including several dental schools, to increase the sample size to include a minimum of 74 students per group [12]. Nevertheless, undesirable effects such as lack of standardisation of lecture delivery would then need to be accounted for.

Another point to consider when interpreting the results of our study is the “carry-over effect”, as the effect of the intervention may not have dissipated when crossing over the groups. This might have contaminated students’ experiences, and had an effect on their responses, despite the fact that the taught topics were different in the presented lectures. A further long-term parallel-arm randomised controlled trial with a larger sample size is required to evaluate the effectiveness of using PB-ARS in teaching orthodontics to dental undergraduate students.

In addition, in our trial, it was not possible to include female undergraduate students since the trial was undertaken at a gender-specific dental school. That might have prevented the evaluation of gender as a variable while analysing students’ attitudes toward PB-ARS [31]. Previous studies have reported insignificant differences among both genders [31,32,33].

Conclusions

The PB-ARS with text- and multimedia-based questions has no significant effect on the short- and long-term retention of orthodontic knowledge by the undergraduate dental students. However, PB-ARS is perceived positively by students, and it might be a useful adjunctive interactive educational tool. A further long-term parallel-arm randomised controlled trial with a larger sample size is required.

Availability of data and materials

Data and material are available at the orthodontic department in the College of Dentistry, Prince Sattam Bin Abdulaziz University/Alkharj/ Saudi Arabia.

Abbreviations

ARS:

Audience response system/s

SMS:

Short message service

RCT:

Randomised controlled trial

PB-ARS:

Phone-based ARS

MCQs:

Multiple-choice questions

L1:

Lecture 1

L2:

Lecture 2

References

  1. Chickering AW, Gamson ZF. Seven principles for good practice in undergraduate education. AAHE Bull. 1987;3:7.

    Google Scholar 

  2. Chickering AW, Gamson ZF. Development and adaptations of the seven principles for good practice in undergraduate education. New Dir Teach Learn. 1999;75:81.

    Google Scholar 

  3. Johnson JT. Creating learner-centered classrooms: use of an audience response system in pediatric dentistry education. J Dent Educ. 2005;69(3):378–81.

    Article  Google Scholar 

  4. McCahan C. Improving CNA education with a game show. Geriatr Nurs. 2002;23(4):200–2.

    Article  Google Scholar 

  5. Copeland HL, Longworth DL, Hewson MG, Stoller JK. Successful lecturing. J Gen Intern Med. 2000;15(6):366–71.

    Article  Google Scholar 

  6. Miller RG, Ashar BH, Getz KJ. Evaluation of an audience response system for the continuing education of health professionals. J Contin Educ Health Prof. 2003;23(2):109–15.

    Article  Google Scholar 

  7. Lane DM, Atlas RS. The networked classroom. In: Computers and Psychology, vol. 1996. York UK; 1996.

  8. Dhaliwal HK, Allen M, Kang J, Bates C, Hodge T. The effect of using an audience response system on learning, motivation and information retention in the orthodontic teaching of undergraduate dental students: a cross-over trial. J Orthod. 2015;42(2):123–35.

    Article  Google Scholar 

  9. Caldwell JE. Clickers in the large classroom: current research and best-practice tips. CBE Life Sci Educ. 2007;6(1):9–20.

    Article  Google Scholar 

  10. Kaleta R, Joosten T. Student response systems. Res Bull. 2007;10(1):1–12.

    Google Scholar 

  11. Holmes RG, Blalock JS, Parker MH, Haywood VB. Student accuracy and evaluation of a computer-based audience response system. J Dent Educ. 2006;70(12):1355–61.

    Article  Google Scholar 

  12. Robson N, Popat H, Richmond S, Farnell DJJ. Effectiveness of an audience response system on orthodontic knowledge retention of undergraduate dental students–a randomised control trial. J Orthod. 2015;42(4):307–14.

    Article  Google Scholar 

  13. Schwartz AM, Wilson JM, Boden SD, Moore TJ Jr, Bradbury TL Jr, Fletcher ND. Managing resident workforce and education during the COVID-19 pandemic: evolving strategies and lessons learned. JBJS Open Access. 2020;5(2):e0045.

    Article  Google Scholar 

  14. Srinivasan DK. Medical students’ perceptions and an anatomy Teacher's personal experience using an e-learning platform for tutorials during the Covid-19 crisis. Anat Sci Educ. 2020.

  15. Darras KE, Spouge RJ, de Bruin ABH, Sedlic A, Hague C, Forster BB. Undergraduate radiology education during the COVID-19 pandemic: a review of teaching and learning strategies. Can Assoc Radiol J. 2020;0846537120944821.

  16. Tan HR, Chng WH, Chonardo C, Ng MTT, Fung FM. How chemists achieve active learning online during the COVID-19 pandemic: using the Community of Inquiry (CoI) framework to support remote teaching. J Chem Educ. 2020;97(9):2512–8.

    Article  Google Scholar 

  17. Medina MS, Medina PJ, Wanzer DS, Wilson JE, Er N, Britton ML. Use of an audience response system (ARS) in a dual-campus classroom environment. Am J Pharm Educ. 2008;72(2).

  18. Hunsu NJ, Adesope O, Bayly DJ. A meta-analysis of the effects of audience response systems (clicker-based technologies) on cognition and affect. Comput Educ. 2016;94:102–19.

    Article  Google Scholar 

  19. Uhari M, Renko M, Soini H. Experiences of using an interactive audience response system in lectures. BMC Med Educ. 2003;3(1):12.

    Article  Google Scholar 

  20. Pileggi R, O’Neill PN. Team-based learning using an audience response system: an innovative method of teaching diagnosis to undergraduate dental students. J Dent Educ. 2008;72(10):1182–8.

    Article  Google Scholar 

  21. Honey J, Lynch CD, Burke FM, Gilmour ASM. Ready for practice? A study of confidence levels of final year dental students at Cardiff University and University College Cork. Eur J Dent Educ. 2011;15(2):98–103.

    Article  Google Scholar 

  22. Fies C, Marshall J. Classroom response systems: a review of the literature. J Sci Educ Technol. 2006;15(1):101–9.

    Article  Google Scholar 

  23. Patterson B, Kilpatrick J, Woebkenberg E. Evidence for teaching practice: the impact of clickers in a large classroom environment. Nurse Educ Today. 2010;30(7):603–7.

    Article  Google Scholar 

  24. Stevens NT, McDermott H, Boland F, Pawlikowska T, Humphreys H. A comparative study: do "clickers" increase student engagement in multidisciplinary clinical microbiology teaching? BMC Med Educ. 2017;17(1):70.

    Article  Google Scholar 

  25. Latessa R, Mouw D. Use of an audience response system to augment interactive learning. Fam Med. 2005;37(1):12–4.

    Google Scholar 

  26. Duggan PM, Palmer E, Devitt P. Electronic voting to encourage interactive lectures: a randomised trial. BMC Med Educ. 2007;7:25.

    Article  Google Scholar 

  27. Elashvili A, Denehy GE, Dawson DV, Cunningham MA. Evaluation of an audience response system in a preclinical operative dentistry course. J Dent Educ. 2008;72(11):1296–303.

    Article  Google Scholar 

  28. Hatun Ataş A, Delialioğlu Ö. A question–answer system for mobile devices in lecture-based instruction: a qualitative analysis of student engagement and learning. Interact Learn Environ. 2018;26(1):75–90.

    Article  Google Scholar 

  29. Stowell JR, Nelson JM. Benefits of electronic audience response systems on student participation, learning, and emotion. Teach Psychol. 2007;34(4):253–8.

    Article  Google Scholar 

  30. Kay RH, LeSage A. Examining the benefits and challenges of using audience response systems: a review of the literature. Comput Educ. 2009;53(3):819–27.

    Article  Google Scholar 

  31. Kay R, Knaack L, Petrarca D. Exploring teachers perceptions of web-based learning tools. Interdiscip J E-learn Learn Objects. 2009;5(1):27–50.

    Google Scholar 

  32. Whitley BE Jr. Gender differences in computer-related attitudes and behavior: a meta-analysis. Comput Hum Behav. 1997;13(1):1–22.

    Article  Google Scholar 

  33. Hargittai E, Shafer S. Differences in actual and perceived online skills: the role of gender. Soc Sci Q. 2006;87(2):432–48.

    Article  Google Scholar 

Download references

Acknowledgements

Not Applicable.

Funding

This study was self-funded.

Author information

Authors and Affiliations

Authors

Contributions

FA and MA designed the study. FA collected the subject data. KA, BE, AA, LA, MW and MA analysed, interpreted and contributed to the writing of the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Lubna Al-Muzian.

Ethics declarations

Ethics approval and consent to participate

The trial was registered with ClinicalTrials.gov Protocol Registration and Results System (NCT04336813) on 7th April 2020, retrospectively registered (\) and the protocol was not published before. Consent was obtained from all participants.

Consent for publication

Written consent for publication was obtained from each participant.

Competing interests

The authors declare that there is no financial interest or conflict of interest in this trial.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1:

Appendix 1 Questionnaire for students.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Alharbi, F., Alazmi, K.F., El Momani, B.R. et al. Phone-based audience response system as an adjunct in orthodontic teaching of undergraduate dental students: a cross-over randomised controlled trial. BMC Med Educ 20, 435 (2020). https://doi.org/10.1186/s12909-020-02363-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12909-020-02363-3

Keywords