Live demonstration versus procedural video: a comparison of two methods for teaching an orthodontic laboratory procedure

Abstract

Background

To measure the effectiveness of procedural video compared to live demonstration in transferring skills for fabricating orthodontic Adam’s Clasp.

Materials and Methods

Forty-nine fourth-year undergraduate male dental students were randomly assigned to two groups. The students in group A (n = 26) attended a live demonstration performed by one faculty, while students in group B (n = 23) watched a procedural video. Both the procedural video and live demonstration described identical steps involved in fabricating the Adam’s Clasp. Students in both groups were asked to fabricate an Adam’s Clasp in addition to completing a questionnaire, to measure their perceptions and satisfaction with the two teaching methods and lab exercise. Blind assessment was performed by one faculty for both groups.

Results

The mean students’ scores in the fabrication of the Adam’s clasp were 6.69 and 6.78 for the live demonstration (group A) and the procedural video (group B), respectively. No significant difference was detected between the two groups (P = 0.864). Statistically significant difference was found in the mean response between the two groups for statement 6 on the questionnaire, “The steps in the teaching method were presented in a clear fashion and were easy to understand”. A higher mean response for group B was found compared to group A (P = 0.049). No significant differences were found between the two groups for the other statements (P > 0.05).

Conclusion

Procedural video is equally as effective as a live demonstration. Both methods should be considered in teaching undergraduate orthodontic courses in order to improve the learning experience and to match different learning preferences of students.

Background

Live demonstration to a group of students is a useful teaching tool in undergraduate orthodontic courses for dental students. Live demonstrations increase students’ confidence, improve communication skills, and provide better understanding of procedures than didactic teaching [1]. However, some factors have been shown to decrease their effectiveness such as shortage in faculty, small faculty to students’ ratio, difficulty in visualisation of the demonstration by students, and time constraints.

Recently, video demonstration or procedural video has been integrated into preclinical laboratory dental teaching [2, 3]. Procedural video can provide a valued teaching tool that allows better visualisation of laboratory steps, offer media-rich audio and visual stimulation covering a wider spectrum of the learning styles or preferences [4], allows students to review technical procedures before, during, or after the laboratory sessions, and overcomes shortage of faculty.

Several studies have investigated the efficacy of procedural video and live demonstration for teaching clinical and laboratory skills. Rosa et al. [5] found that visual methodologies is appropriate to develop and support students’ learning experiences. Mirkarimi et al. [6] found that both videotaped and live demonstrations were equally effective and can be used in combination or as an alternative for each other in teaching how to apply fissure sealant. In addition, Mir et al. [7] reported that videotaped demonstrations can be as effective as live demonstrations in transmitting clinical knowledge and skills to medical students. Packer et al. [2] tested the effectiveness of videotaped demonstrations as opposed to live demonstrations for the teaching of removable partial denture procedures. They concluded that both teaching methods developed a similar level of understanding of the principles behind the exercise, although students preferred the live demonstrations. Further, live demonstration enhances communication skills and increases student confidence [1]. However, teacher dependency of students, inadequate field of view, and non-repeatability of sessions are the main problems with this type of demonstration [8]. This study attempts to address the question of whether procedural video is more efficacious in the teaching of preclinical fabricate of orthodontic Adam’s Clasp on permanent molar tooth compared to traditional live demonstration, Hence the objective of this study was to measure the efficacy of procedural video compared to live demonstration in transferring skills to fourth-year undergraduate dental students during laboratory session and assess the students’ perceptions of the two methods used.

Method

The current study was conducted at the College of Dentistry, King Saud University, Riyadh, Saudi Arabia. The study was reviewed ethically and approved by the Research Centre at the College of Dentistry (CDRC) at King Saud University (research project # FR 0148).

Forty-nine fourth-year male undergraduate dental students, who had not been exposed to any practical exercise on orthodontic wire bending, participated in this study. They were randomly assigned to two groups based on their serial number. The students in group A (n = 26) attended live demonstration performed by one faculty while students in group B (n = 23) watched a 12-minute procedural video on the projector. Both the live demonstration and the procedural video described identical steps involved in fabricating the Adam’s Clasp. Both groups were requested to fabricate an Adam’s Clasp on the maxillary permanent right first molar using duplicated orthodontic study models of the same patient. At the end of exercise, one blinded faculty member performed the assessment of the Adam’s Clasp for both groups according to pre-specified criteria (Table 1). The passing grade for this exercise was six out of ten which indicated that the student comprehended the minimum about the fabrication of the Adam’s clasp.

Table 1 Assessment criteria for the lab exercise

An 8-item questionnaire was developed for the purpose of this study in order to measure the students ‘perception towards the two teaching methods and lab exercise by using a Likert scale with five response options (1 = strongly disagree, 2 = disagree, 3 = uncertain, 4 = agree, and 5 = strongly agree). The questionnaire was pre-tested on 15 fifth year students who were not part of this study and the questions were modified accordingly. Statements in the questionnaire were designed to measure the students ‘level of stress during the exercise, their ability to fabricate Adam’s Clasp exercise, and their satisfaction with the teaching method that they have received. The students completed the survey at the end of the exercise and the results were collected anonymously on SurveyMonkey (www.surveymonkey.com).

Statistical analysis was conducted using the Statistical Package for Social Sciences (Version 16.0; SPSS Inc., Chicago, IL, USA). Mean differences between the groups in the lab exercise scores were assessed using independent samples t-test. An alpha of 0.05 was used as the level of significance.

Results

Tables 2, 3 shows the mean scores obtained by each group in the lab exercise. The mean students’ scores for live demonstration (group A) and procedural video (group B) were 6.6 and 6.7, respectively. No significant difference was detected between the two groups (P > 0.05).

Table 2 Mean scores obtained by students of both groups in the blind assessment of the lab exercise

Table 3 Mean scores obtained by students of both groups in the blind assessment of the lab exercise

Among the 49 students, 42 students (22 students from group A and 20 students from group B) completed the questionnaire. This represents a response rate of 85.7 %. Table 4 shows a comparison between groups’ responses to the questionnaire. Independent samples t-test indicated statistically significant differences in the mean response between the two groups for statement 6 on the questionnaire, “The steps in the teaching method were presented in a clear fashion and were easy to understand”. A higher mean response for group B was found compared to group A (P = 0.049). No significant differences were found between the two groups for the other statements (P > 0.05).

Table 4 Students’ perception of the live demonstration and procedural video methods

Discussion

New technology has broadened the teaching methods available for learners. Several studies [5–7] have tested the procedural video approach to educate dental students and has been shown to be as effective as live demonstration. Therefore, the current study was undertaken to assess the procedural video demonstration in comparison to the live demonstration to overcome some of the common problems faced during traditional teaching methods which include but are not limited to; short laboratory time, and shortage of teaching faculty which makes ideal student to instructor ratio not possible.

The evaluation of students’ performance on fabrication of Adam’s clasp in both groups was done by one assessor because in every lab exercise the students are evaluated by one faculty member for fair distribution of the grades and consistent evaluation. The evaluation of both groups showed no significant difference, which indicates a similar level of understanding gained by both groups. This finding is similar to what Packer et al. [2] found when comparing between videotaped and live demonstration for teaching removable partial denture procedures. In the current study, the mean students’ scores for live demonstration (group A) and procedural video (group B) were 6.69 and 6.78, respectively. These low scores may be due to the lack of previous exposure to any practical exercise on Adam’s clasp fabrication. The results also showed that there was no significant difference in the level of stress between the two groups. This finding is in line with those obtained by Rosa et al. [5], Mirkarimi et al. [6] and Mir et al. [7].

Approximately 59 % from the live demonstration group and 40 % from the procedural video group preferred the teaching method they received. However, 35 % of the students from the procedural video group did not prefer their teaching method compared to only 18.18 % from the live demonstration group. This preference for live demonstration has been observed in similar studies by Bazyk et al [9] and Packer et al. [1]. The students in Bazyk et al. study [9] believed that the live demonstration gave them the opportunity to ask questions and interact with the instructor. Further, Packer et al. [1] found that live demonstration increases student confidence, improves communication skills, and provides better understanding of procedures. On the other hand, the results in the current study revealed a significant difference in mean response between the two groups for statement 6 on the questionnaire, which measures the clearness and ease of understanding for the steps in the teaching methods. A higher mean response for procedural video group was found compared to live demonstration group (P = 0.049). The procedural video provides better visualisation of laboratory steps and allows students to review technical procedures before, during, or after the laboratory sessions. This is in line with Aragon and Zibrowski study [10] in which students in the clinic, who were given a copy of a video, reported that they can see better on video versus a demonstration with everyone crowding around, and that the procedure can be reviewed at any time.

One limitation of this study is the lack of female participants. Female students go to a different female campus and are being taught by different faculty, which made their enrolment logistically difficult.

The students in this study were reluctant to replace live demonstration with procedural videos. This might be because they are accustomed to attending traditional live demonstration. Sharing the results of the studies that compare the effectiveness and reliability between videotaped and live demonstration with students may reassure them and gain their confidence about procedural videos.

Conclusion

Carefully designed and developed procedural video is equally as effective as a live demonstration. Each method has its own advantages and limitations, therefore both methods should be considered in teaching undergraduate orthodontic courses in order to improve learning experiences and to match different learning preferences of students.