Skip to main content
Download PDF
  • Research article
  • Open access
  • Published:

Digital learning designs in physiotherapy education: a systematic review and meta-analysis

BMC Medical Education volume 21, Article number: 48 (2021) Cite this article

Abstract

Background

Digital learning designs have the potential to support teaching and learning within higher education. However, the research on digital learning designs within physiotherapy education is limited. This study aims to identify and investigate the effectiveness of digital learning designs in physiotherapy education.

Methods

The study was designed as a systematic review and meta-analysis of randomized and non-randomized trials. A search of eight databases on digital learning designs and technology was conducted. Study selection, methodology and quality assessment were performed independently by three reviewers. The included studies were mapped according to the types of digital interventions and studies. For similar interventions, the learning effects were calculated using meta-analyses.

Results

Altogether, 22 studies were included in the review (17 randomized controlled trials and five cohort studies). A blended learning design was used in 21 studies, a flipped classroom model in five and a distance learning design in one. Altogether, 10 of the 22 articles were included in meta-analyses, which showed statistically significant effects for flipped classrooms on knowledge acquisition (standardized mean difference [SMD]: 0.41; 95% confidence interval [CI]: 0.20, 0.62), for interactive websites or applications (apps) on practical skills (SMD: 1.07; 95% CI: 0.71,1.43) and for students self-produced videos on a practical skill in a cervical spine scenario (SMD: 0.49; 95% CI: 0.06, 0.93). Overall, the effects indicated that blended learning designs are equally as or more effective than traditional classroom teaching to achieve learning outcomes. Distance learning showed no significant differences compared to traditional classroom teaching.

Conclusions

The current findings from physiotherapy education indicate that digital learning designs in the form of blended learning and distance learning were equally or more effective compared to traditional teaching. The meta-analyses revealed significant effects on student learning in favour of the interventions using flipped classrooms, interactive websites/apps and students self-produced videos. However, these results must be confirmed in larger controlled trials. Further, research should investigate how digital learning designs can facilitate students’ learning of practical skills and behaviour, learning retention and approaches to studying as well as references for teaching and learning in digital learning environments.

Peer Review reports

Background

During the past decade, digital learning designs have been increasingly used in teaching practices in higher education. UNESCO [1] emphasizes that digital learning can transform teaching practises, improve the quality and enhance the sustainability of higher education. A digital learning design has been described as a didactic plan that integrates digital learning technology to support students’ learning processes and to achieve constructive alignment between learning outcomes, teaching and learning activities and feedback and assessment methods [2]. The designs can fully or partly integrate digital learning tools and resources (e.g., video lectures or video tutorials) and have the potential to move traditional teaching out of the classroom and to facilitate active learning in the classroom [3]. The various designs provide opportunities to improve self-regulating abilities, facilitate active learning and make the learning process more transparent [4].

Digital learning designs encompass various technologies such as virtual reality, podcasts, apps, serious/educational games, 360° video and animations. These technologies can be directly implemented in the learning activities or combined with other planned learning activities. Because no conceptual framework for digital learning designs exists, similar digital learning designs are often mentioned using different terminology. Digital learning designs can be divided into blended learning (e.g., flipped classrooms) and distance learning (e.g., fully e-learning courses). The main difference is that blended learning combines online and face-to-face teaching and often combine both synchronous learning (real-time, in-person or online) and asynchronous learning (flexible time, online), whereas distance learning is used as a synonym for fully online learning. In distance learning, teaching and learning is facilitated by a web-based system to connect learners, resources and teachers; and it can be completely asynchronous (flexible regarding when the student is online) [5].

There is conflicting evidence of the effectiveness of the different digital learning designs used in physiotherapy and other health professions education. A systematic review on the effects of the flipped classroom approach for the education of health profession students did not reveal compelling evidence for the effectiveness of the method for improving academic outcomes compared to traditional teaching [6]. In contrast, a meta-analysis on the effectiveness of flipped classrooms in health professions education concluded that this approach yields a significant improvement in student learning compared with traditional teaching methods [7]. Another systematic review on blended learning in health professions showed that it has the potential to improve clinical competence among health students and to be more effective than or at least as effective as non-blended learning for knowledge acquisition [8]. In contrast, a systematic review and meta-analysis of the effectiveness of computer-assisted instruction (CAI) to teach physical examination in health science education found no consistent benefit of using this method [9].

Graduation from a physiotherapy programme qualifies the graduate for practice as an independent and autonomous professional [10]. The physiotherapy curriculum is characterized by a combination of theory, skills training and practice [11]. Until now, digital learning designs in physiotherapy education have been criticised for not being grounded in a theoretical learning perspective [12]. A systematic review on online technology use (e.g., websites and discussion boards) in physiotherapy education concluded that these technologies enhanced practical skills performance, knowledge acquisition and the development of critical and reflective thinking [13]. Another systematic review on the role of computer-assisted learning in physiotherapy education, concluded that it was largely under-researched compared to other health professions education [14]. To our knowledge, no recent review on digital learning designs in physiotherapy education have been conducted. The aim of this systematic review is to identify and investigate the effectiveness of various digital learning designs in physiotherapy education.

Methods

This systematic review was carried out according to the Preferred Reporting Items for Systematic reviews and Meta-Analysis guidelines [15]. The protocol of the systematic review was registered in the international prospective register of systematic reviews (PROSPERO; https://www.crd.york.ac.uk/prospero) with registration number CRD42019134917.

We included randomized controlled trials (RCTs) and cohort studies that reported baseline and post-treatment measures and for both study groups and that met the following criteria: (a) a study population of physiotherapy students in a physiotherapy education programme (bachelor’s/undergraduate, masters/ entry level, Doctor of Physical Therapy [DPT] or Doctor of Philosophy [PhD]); (b) assessed the learning outcomes of a digital learning design (e.g., flipped classroom); (c) compared the outcomes to traditional classroom teaching; and (d) reported on students’ final grades and self-reported learning outcomes (e.g., students’ perceptions, motivation, attendance, commitment, engagement and satisfaction with the learning design). We included only studies with summative assessments for the final exam to measure knowledge, skills or affective learning outcomes (e.g., values, attitudes and behaviours) [16]. The exclusion criteria were studies where less than half of the study population were physiotherapy students, that were aimed to train graduated physiotherapists for work life (e.g., courses and seminars that did not provide credits), where the use of digital learning technology was not part of an explicit learning strategy and in languages other than English or Scandinavian.

Search strategy

Two information specialists (MWG, EK) searched Medline, Cinahl, Education Resources Information Center, Education Source, Scopus, Teacher Reference Center, Embase and Cochrane Central. The publication period was limited to 1 January 2010 to 28 August 2020. Because there are limited uses of learning designs in physiotherapy education before 2010, we chose to limit the search to articles published since 2010. Examples of search terms were ‘assisted instruction/education’, ‘distance educational, technology/webcasts/information, technology/multimedia/computer, user training/world wide web, applications/computer simulation’, ‘blended’, ‘e-learning’, ‘m-learning’, ‘web-based’, ‘virtual’, ‘streaming’, ‘interactive’, ‘hybrid’, ‘gaming’, ‘massive open online course’, ‘flipped’ and ‘simulation’. The complete search strategy is shown in Additional File 1.

Selection of articles and data extraction

Three reviewers (N.BØ, H.TM, Y.R) independently screened the titles and abstracts from the literature search according to the selection criteria using the Rayyan website/app as a screening tool [17]. The full text of the relevant articles was assessed independently by these reviewers. The full-text articles that met the inclusion criteria were included in the review. Disagreement on selection of articles was solved by discussion until a consensus was reached.

The following data were extracted from the included studies by the first author (N.BØ) and cross-checked by the other two reviewers (H.TM and Y.R): authors of the study, publication year, country, study design, characteristics of the population (e.g., level of education), characteristics of the interventions (blended or distance learning designs), comparison to traditional classroom teaching and outcomes (e.g., grades and method of assessment). The final decision on the articles included was made via a discussion meeting attended by all authors.

Risk of bias assessment

We assessed the risk of bias for the included RCTs and cohort studies using Cochrane’s risk of bias tool [18]. The risk of bias assessment was conducted by three reviewers (N.BØ, H.TM, Y.R) independently. Bias was assessed as high, low or unclear for the five domains: selection, performance, attrition, reporting and other potential threats to validity [18].

Data analysis

Due to the multiple terms used for digital learning designs, an overview of some of the most used terms are included in Table 1.

Table 1 Overview of commonly used digital learning design concepts
Full size table

First, the included articles were categorized according to the study design. Thereafter, the descriptions of the learning designs, the digital learning technologies used, and the learning outcomes were considered to pool the results in the meta-analyses based on their similarities. We calculated mean differences for pooling similar continuous outcomes (e.g., students’ satisfaction with the learning design reported on a Likert scale of 1–5), and we used standardized mean differences (SMDs) when the included studies used different scales for the same outcome. For all outcomes, we reported the associated 95% confidence intervals (CIs). Double-data entries were performed. The meta-analysis was based on a random effects model, as we expected heterogeneity across the included studies. Studies that reported similar populations, interventions and outcomes were pooled in the meta-analyses. For studies that were too heterogeneous for pooling, we present the results narratively.

Results

Altogether, we included 22 studies (Fig. 1) with a total of 2186 participants (study range: n = 16–176). The studies included students at the bachelor’s/undergraduates (n = 17), master’s/ entry level (n = 1) and DPT programme level (n = 4). Of the included studies, five were from Australia [25,26,27,28,29], five from Spain [30,31,32,33,34], three from Brazil [35,36,37], one from Denmark [38] and eight from the USA [39,40,41,42,43,44,45,46]. Seventeen of the studies had a RCT design [25, 27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42], and five were cohorts [26, 43,44,45,46].

Fig. 1
figure 1

PRISMA flow chart of the records and study selection process

Full size image

All the studies were published between 2010 and 2020. A detailed overview of the included studies is shown in Table 2. For the 10 studies that were similar in terms of design, population, interventions and outcomes, we conducted meta-analyses using RevMan 5.3 software (Cochrane Community worldwide) [27, 28, 30,31,32,33,34, 44,45,46]. Twelve studies were too heterogeneous and were not included in the meta-analyses [25, 26, 29, 35,36,37,38,39,40,41,42,43]. They are described and summarized narratively in the text and Table 2.

Table 2 Characteristics of the included studies: randomized controlled trials (RCTs) and cohort studies
Full size table

Description of interventions

All the included studies compared digital learning designs to traditional classroom teaching. The duration of exposure to the digital learning designs ranged from 10 h to two semesters. In the blended learning designs, 21 studies used different digital learning technology and software—such as interactive websites/apps, multimodal online environments (e.g., videos, animations and figures), recorded videos/lectures/tutorials, simulation learning videos with virtual cases/scenarios, video clips (video podcasting) and educational videogames—to present and facilitate the learning materials and to assess the learning outcomes on practical skills and/or knowledge acquisition [25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40, 42,43,44,45,46].

Only one study used the distance learning design [41]. In this study, an interactive course website (i.e. CAI) was used to facilitate learning. Students had unlimited access to the course website. All the course content and learning activities were facilitated as asynchronous learning, and there was no face-to-face teaching.

The pre-class and in-class digital activities integrated different learning activities in the blended learning and distance learning designs. These learning activities were facilitated asynchronously (flexible time and distance) and/or synchronously (in real time; either distanced or in a classroom or laboratory). The four blended learning design studies that utilized flipped classrooms expected the students to be prepared by completing pre-class activities (asynchronous online learning) before in-class teaching [43,44,45,46]. Examples of pre-class activities were pre-recorded lessons and different tasks to achieve knowledge acquisition by listening, reading and/or observation. None of these studies described pre-class collaborative learning activities using digital learning tools or digital learning resources, but rather facilitated different collaborative learning in-class activities (e.g., group questions and case discussions, polling software and quiz discussions).

In the other blended learning designs, in-class activities required students to listen to or observe the teacher/tutor as well as conduct observations in the classroom and/or practice (i.e. in a laboratory or clinical immersion setting). For clinical immersion, the simulation learning activities [25] included time-outs, rewinds, debriefing and reflection sessions with a clinical educator. Another study with a blended learning design involved an e-learning classroom of storage material [35]. The intervention was a sequence of traditional/e-learning/traditional classroom designs and e-learning/traditional/e-learning designs. For more information on the characteristics of the included studies, see Table 2.

Risk of bias assessment

We determined that the overall risk of bias was higher for the cohort studies [26, 43,44,45,46] than the RCTs [25, 27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42], (Fig. 2). The cohort’s studies had a high risk of selection bias and attrition bias. Additionally, domains such as blinding and selective reporting were poorly described in the cohort’s, and therefore the risk was unclear.

Fig. 2
figure 2

Risk of bias summary: review authors’ judgements about each risk of bias item for each included study

Full size image

The RCTs [25, 27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42], had a low or unclear risk of bias in the domains of performance bias, detection bias and reporting bias (Fig. 2). It was not possible to blind the students to the digital learning design interventions. Therefore, we assessed the domain of performance bias as unclear.

Effects of blended learning designs using flipped classroom on knowledge acquisition

We conducted a meta-analysis of the effects of flipped classrooms compared to traditional classroom teaching on knowledge acquisition graded using multiple-choice questions (MCQs). See Additional File 2, Table 2 for more details. Three cohort studies were included in this meta-analysis for a total of 364 students [44,45,46]. The meta-analysis showed a SMD of 0.41 (95% CI: 0.20, 0.62; Fig. 3). This result was statistically significant and implied that students who participated in a flipped classroom earned higher grades/scores on the MCQs than students who were enrolled in a traditional classroom (Fig. 3).

Fig. 3
figure 3

Flipped classroom as blended learning designs on knowledge acquisition assessed by MCQ

Full size image

Effects of additional study using flipped classroom

Another study using flipped classroom interventions could not be included in the meta-analysis because of poor reporting of effect estimates [43]. This study included 148 students, and the result showed high correlation with similar performance between all classes.

Effects of blended learning designs using interactive websites/apps on knowledge acquisition

We pooled four studies (n = 279 students) that used interactive websites/apps in their blended digital learning designs and compared them to traditional classroom teaching on knowledge acquisition assessed by MCQs [30, 32,33,34]. The meta-analysis showed a SMD of 0.51 (95% CI: − 0.80, 1.82; with an I2 of 96%, Fig. 4). This result showed no statistically significant difference between blended learning and traditional classroom teaching on knowledge acquisition.

Fig. 4
figure 4

Blended learning designs using interactive websites/apps on knowledge acquisition assessed by MCQ

Full size image

Effects of blended learning designs using interactive website/app on practical skills

Three studies used the same interactive website/app (Ecofisio) to teach practical skills, which were assessed by objective structured clinical evaluation (OSCE) [30,31,32]. These studies included 137 students in total. The meta-analysis showed a SMD of 1.07 (95% CI: 0.71, 1.43; Fig. 5) and a statistically significant difference in favour of the blended learning design.

Fig. 5
figure 5

Blended learning designs using interactive website/app on practical skills assessed by OSCE

Full size image

The effects of additional studies in blended learning designs using mobile applications

Another blended learning study with 110 students also investigated the effect of the same interactive website/app on practical skills assessed by OSCE [34]. While the results indicated significant differences for all components assessed using OSCE, the results were poorly reported and thus could not be pooled with the others in the meta-analysis. Additionally, another study was not included in this meta-analysis due to use of a different mobile application [39]. This application included videos and written content but was not interactive, and the study tested a different outcome, a practical exam. This study included 20 students distributed in three groups: the control group (demonstration only), the mobile application and demonstration group and the mobile application only group. The primary competency—the ability to perform and explain clinical skills—was highest among the demonstration plus app group followed by the demonstration only group and finally the app only group. This was consistent with the results of the above meta-analysis regarding the effect of the interactive website/app on practical skills.

Effects of blended learning designs using self-produced videos on practical skills

Two studies (n = 84 students) assessed self-produced videos on OSCE [27, 28]. These interventions also included pre-recorded video tutorials with demonstrations of the skill. The outcomes were tested for practical skills in a cervical spine scenario (Fig. 6) and a vestibular implant scenario (Fig. 7).

Fig. 6
figure 6

Blended learning designs using self-produced videos on a practical skill in a cervical spine scenario assessed by OSCE

Full size image
Fig. 7
figure 7

Blended learning designs using self-produced videos on a practical skill in a vestibular implant scenario assessed by OSCE

Full size image

The meta-analysis for a practical skill in the cervical spine scenario showed a SMD of 0.49 (95% CI 0.06, 0.93 Fig. 6). There was a statistically significant difference between the groups’ final exam scores for the cervical spine scenario.

The meta-analysis for a practical skill in the vestibular implant scenario showed a SMD of − 0.36 (95% CI: − 0.79, 0.08; Fig. 7). No significant differences were observed between the blended learning design and traditional classroom teaching for the vestibular implant scenario.

The effects of additional blended learning designs using other video formats and outcome

Three blended learning design studies using video formats were not included in the above meta-analysis [25, 26, 42]. This was due to their use of different interventions or outcomes compared to the studies that were included in that meta-analysis. For example, one study with 33 students investigated the effect of using video clips on practical exam scores [42]. The results showed no statistically significant difference compared to traditional classroom teaching. This was in line with the results of the meta-analysis regarding the effects of self-produced videos for a practical skill in the vestibular implant scenario.

Another study with 461 students incorporated online video clips (video podcasting) and asynchronous online discussion forums and tested their effects on practical and written exam scores [26]. This study showed statistically significant differences in scores in using the online video clips and online discussion forums compared to traditional classroom teaching. This was in line with the results of the meta-analysis regarding the effects of self-produced videos for a practical skill in the cervical spine scenario.

Finally, a study of 349 students investigated the effect of simulated learning environment videos on practical exam scores [25]. This single-blinded, multi-institutional RCT study showed no significant improvement in student competency. This result is consistent with the previous meta-analysis regarding meta-analysis on blended learning designs using self-produced videos for a practical skill in the vestibular implant scenario.

Effects of blended learning designs on students’ perceptions of learning

Two studies assessed students’ perceptions of learning using an interactive website/app [30, 31]. We focused on the item ‘I was able to apply what I learned’. These studies included 83 students and used a Likert scale of 1–5 (1 = strongly disagree, 5 = strongly agree). The meta-analysis showed a SMD of 0.47 (95% CI: − 0.12, 1.06; Fig. 8), but the results was not statistically significant.

Fig. 8
figure 8

Students’ learning perceptions; Item: “I was able to apply what I learned”

Full size image

The effects additional blended learning designs on students’ learning perceptions

Thirteen studies that were not included in that meta-analysis assessed students’ perceptions of blended learning designs using various evaluation items [25, 26, 28, 29, 32,33,34,35,36, 38, 42, 43]. See Additional File 2, Table 2. One study showed higher satisfaction levels in the intervention group (interactive website/app) for the item ‘I believe that training was applicable’ [34].

Another study assessed the effects of remote-online case-based learning (CBL) [29] on students’ self-assessed perception of learning for each examinable objective using a 3-point scale with the options of ‘superficial’, ‘moderate’ and ‘in depth’. For the item ‘I felt I was able to achieve all objectives given the method of CBL delivery’, 12 out of 19 participants in the intervention group disagreed with the statement.

Overall, for seven of the 13 studies [26, 28, 32, 33, 36, 43] that were not included in the meta-analysis on students’ perceptions of learning, statistically significant results and higher perceptions of learning were found in the intervention groups. The results from all the studies that evaluated students’ perceptions of learning are available in Additional File 2, Table 2.

The effects of additional interventions using blended learning designs

Six of the blended design studies [29, 35,36,37,38, 40] used different digital learning technologies and/or outcomes from the studies included in the meta-analyses [27, 28, 30,31,32,33,34, 44,45,46]. See Additional File 2, Table 2. Of the blended learning designs, one study used a multimodal online environment (videos, animations and figures) and was assessed by a knowledge test [37]. The study included 16 students, and the outcome was theoretical knowledge acquisition. The results showed a significant improvement in acquisition among the students who participated in the multimodal online environment compared to the students in the control group.

A second blended learning design study used e-lectures, and a knowledge test to assess the effect on theoretical acquisition [35]. This study included 72 students. The results showed significant improvement in theoretical acquisition among the students who viewed the e-lectures compared to those who observed traditional classroom teaching.

A third blended learning design study used an educational video game, and students’ resulting theoretical acquisition was assessed by a knowledge test [36]. This study included 71 students, and the results showed that the educational video game was able to improve performance on the specific knowledge test.

A fourth blended learning design study used 360° video as the e-learning tool, and the outcome, theoretical acquisition, was assessed by MCQ [38]. This study included 81 students. The findings indicated that there was no significant difference between 360° video and traditional teaching.

A fifth blended learning design study used virtual patient simulation [40]. The outcomes were theoretical acquisition and practical skills and were assessed by MCQ. This study included 53 students. The researchers found no significant differences between the Health Science Reasoning Test scores based on the method of instruction.

Finally, a sixth blended learning design study with 38 students used web conferencing remote-online CBL [29]. The outcome, theoretical knowledge acquisition, was assessed by MCQ. Of the 15 examinable learning objectives, eight were significant in favour of the control group, suggesting a greater perceived depth of learning for the students in the control group.

The effects of additional intervention using distance learning design on knowledge acquisition

One study assessed the effects of a distance learning design using a course website (CAI) as an intervention [41]. This study included 33 students. The results showed no significant differences between the groups for baseline knowledge; see Additional File 2, Table 2.

Discussion

The aim of this systematic review was to identify and investigate the effectiveness of digital learning designs in physiotherapy education. The main findings are that all except one included study (21 out of 22) applied a blended learning design. Out of these 21 studies, 19 studies showed equal or statistically significant differences in favour of blended learning compared to traditional classroom teaching.

Among the blended learning designs, flipped classroom was the most frequently identified approach. Notably, in terms of effectiveness, the meta-analysis showed a statistically significant improvement in learning outcomes for the flipped classroom designs [44,45,46]. These findings are in line with another systematic review of 12 studies that showed significant improvement in students’ self-directed learning skills in nursing education [47]. In contrast, findings in a review of 24 studies in health professions education concluded with no clear evidence that the flipped classroom produced better academic outcomes [6]. The pedagogical opportunities offered by the flipped classroom model have the potential to motivate and engage students in pre-class learning activities, enhance self-regulative abilities among students and improve the flexibility and transparency of the learning process [48]. Further, in-class activities require active students and enhanced opportunity to apply new content to a prior knowledge to solve problems and may led to higher order thinking. Another opportunity is to receive feedback from peers and teachers in real time [49]. Thus, these pedagogical possibilities can lead us to conclude that the flipped classroom model is promising in terms of enhancing students’ learning outcomes [48].

The effect estimates of using an interactive website/app on practical skills showed statistically significant benefits of the interactive website/app [30,31,32]. This is supported by another systematic review that included 29 studies, which indicated that mobile learning is as effective as or possibly more effective than traditional learning [50]. There are several possible explanations for the results of our meta-analysis on the use of interactive websites/apps on practical skills [30,31,32]. Interactive websites/apps are flexible, accessible and transparency and allow students to observe how to perform practical skills and to acquire theoretical knowledge. In general, research also shows that the use of mobile learning technology in higher education courses increases enjoyment, attention and learning [51].

It has been claimed that implementation of mobile learning is a challenging endeavor and some of the most demanding aspects of mobile learning ‘are the links between and the need to facilitate different sustainable pedagogical and learning strategies by integration, support, interactive use and appropriate choice of tools’ [4] (p.32). Mobile leaning is promoted when the applications focus on students’ newly acquired knowledge and skills [49]. In the three studies in this meta-analysis, students in the intervention group were given free access to the interactive website/app immediately after the traditional classroom teaching was finished [30,31,32], which may explain their effectiveness. Another explanation for the significant differences between the interactive websites/apps and traditional learning resources is that the interactive design of the mobile learning activities were in line with the learning outcomes and type of assessment method [52]. Further, interactive websites/apps can support and facilitate ‘authentic learning (tasks related to the learning outcomes), situated learning (takes place in the surroundings applicable to the learning) and facilitate context-aware learning (history and the environment) due to its affordances, accessibility, portability, and educational benefits’ [53] (p. 2).

The behaviourist learning approach with teachers acting as content deliverers is often used in mobile learning designs in higher education [4]. From a critical perspective, apps must be integrated into the learning system for different learning materials (e.g., books and articles), and the content, learning activities and technology must be designed in such a way that the activities (interactive) and technology complement each other, which will support students to achieve the learning outcomes [4].

One meta-analysis showed statistically significant improvement of self-produced videos compared to traditional classroom teaching on a practical skill in a cervical spine scenario [27, 28]. Due to few included participants this result needs to be confirmed in a larger meta-analysis. Combining practical classroom teaching and students self-produced video performing practical skills, might promote higher skills acquisition, compared to practical classroom teaching alone. An explanation of this effect is the ability to connect knowledge that has being transferred to practical implications and student’s performance. This is in line with mobile learning when the applications focus on students’ newly acquired knowledge and skills [49]. Using self-produced videos as a supplement to the practical classroom teaching also give the teacher/tutors/supervisors an opportunity to provide students with feedback on their clinical performance. Further, self-produced videos give the ability for peer-to-peer learning by sharing and discussion the results in the self-produced videos and the possibility to self-reflections in the process of developing professional clinical skills.

Thirteen studies that were not included in this meta-analysis also assessed students’ perceptions of blended learning designs using different evaluation items [25, 26, 28, 29, 32,33,34,35,36, 38, 42, 43]. Of these 13 studies, 7 studies showed that students had a positive experience and significantly higher perceptions of learning with the blended learning designs [26, 28, 32,33,34, 36, 43]. An explanation for this is that the blended learning design has the potential to facilitate and support students’ self-directed learning, independence, intrinsic motivation and responsibility [53]. Another explanation is that these blended learning designs probably had a planned didactic learning design that integrated digital learning technology and had a constructive alignment approach. Thanks to these characteristics, the blended and distance learning designs that were not included in the meta-analyses overall seemed to improve students’ academic performances (e.g. grades) or at least as equally effective as traditional classroom teaching. These findings are in line with other studies demonstrating increased student involvement, engagement, communication, critical discussions, and student–teacher contact [13, 54]. However, there is a criticism to technology optimism promoted by Fossland and Ramberg [55] ongoing that there is an uncritical belief that the use of technology leads to learning in itself. In line with this criticism Lillejord et al. [4] stated that how digital tools are implemented and used pedagogically, rather than the technology itself, is what affects students’ learning outcomes.

The present review had similarities with a systematic review from 2015 by Mącznik et al. on online technology use in physiotherapy teaching and findings in both reviews indicate that digital learning designs offer benefits for teaching and learning in physiotherapy education [13]. There are, however, some differences that should be noted: first, the present review exclusively investigated the effectiveness of digital learning designs, while the review by Mącznik et al. additionally investigated users’ perception [13]. Due to this, only studies with summative assessments for the final exam, was included in our review. Second, the present review had a broader approach and included all types of digital learning designs, not only online technologies. In addition, it is worth noting that the present review includes a number of recent studies, thus presenting an up-to-date picture of the digital learning designs.

Strengths and limitations

This systematic review has two main strengths. First, two of the authors (N.BØ, Y.R), together with two information specialists at the Oslo Metropolitan University (M.WG, E.K), developed a rigorous and comprehensive search strategy on digital learning technology in learning design. Second, we were able to synthesise the studies and conduct meta-analyses even though the included studies had different interventions, small sample sizes and varied effects sizes.

However, this review has some limitations. First, several of the included studies had weak study designs (single cohorts), underreported statistical methods and educational intervention details or used non-validated outcome measurement methods (e.g., MCQs and self-report questionnaires). It was also difficult to accurately assess the risk of bias for some of the included studies due to poorly reported studies. Only one of the included studies had a long-term (two-semester) follow-up to assess learning retention. Finally, the included studies used various conceptions of blended and distance learning designs. This generated an unclear terminology and made it difficult to compare designs and synthesize the results.

Recommendations

More robust studies, such as experimental designs, are needed for this topic. Additionally, future studies need to incorporate control variables and statistical methods for reporting the results, especially those using flipped classroom designs. More in-depth and follow-up research studies assessing learning retention, students’ approaches to learning and studying in a digital learning environment would also be beneficial. Furthermore, scholars should investigate the experiences and attitudes of teachers towards developing and implementing digital learning designs in physiotherapy education.

Conclusions

This systematic review identified blended learning and distance learning designs in physiotherapy education. The results indicated that blended learning designs tend to be either equally or more effective as traditional classroom teaching in physiotherapy education in terms of knowledge- and practical skills acquisition. In contrast, the results for the one distance learning design demonstrated equally results compared to traditional classroom teaching.

The meta-analyses revealed significant effects on student learning in favour of the interventions using flipped classrooms, interactive websites/apps and students self-produced videos. However, these results need to be confirmed in larger controlled trials. Additionally, the generalization of this finding is limited to the physiotherapy population studied in this review. This review highlights the need for improvements in future studies’ methodological designs.

Availability of data and materials

The datasets used and/or analysed for this study are available from the corresponding author upon reasonable request.

Abbreviations

CAI:

Computer-assisted instruction

App:

Mobile application

CI:

Confidence interval

RCT:

Randomized controlled trial

SMD:

Standardized mean difference

MCQ:

Multiple-choice question

OSCE:

Objective structured clinical evaluation

CBL:

Case-based learning

DPT:

Doctor of Physical Therapy

PhD:

Doctor of Philosophy

References

  1. UNESCO. Digital higher education. https://en.unesco.org/themes/higher-education/digital Accessed 1 November 2020.

  2. Biggs J, Tang C. Teaching For Quality Learning At University Teaching for Quality Learning at University. In: Society for Research into Higher Education. 4th ed; 2011.

    Google Scholar 

  3. Prince M. Does Active Learning Work? A Review of the Research. J Eng Educ. 2004;93(3):223–31.

    Article  Google Scholar 

  4. Lillejord S, Børte K, Nesje K, Ruud E. Learning and teaching with technology in higher education – a systematic review. In: Knowledge Centre for Education. Oslo; 2018. www.kunnskapssenter.no Available from https://www.forskningsradet.no/om-forskningsradet/publikasjoner/2018/learning-and-teaching-with-technology-in-higher-education/.

  5. Simonson M, Smaldino S, Albright M, Zvacek S. Teaching and learning at a distance. Distance: Foundations of Distance Education 5th Edition ed; 2006.

    Google Scholar 

  6. Evans L, Vanden Bosch ML, Harrington S, Schoofs N, Coviak C. Flipping the Classroom in Health Care Higher Education: A Systematic Review. Nurse Educ. 2019;44(2):74–8. https://doi.org/10.1097/NNE.0000000000000554 PMID: 30015680.

    Article  Google Scholar 

  7. HEW H, K.F., LO, C.K. Flipped classroom improves student learning in health professions education: a meta-analysis. BMC Med Educ. 2018;18:38. https://doi.org/10.1186/s12909-018-1144-z.

    Article  Google Scholar 

  8. Rowe M, Frantz J, Bozalek V. The role of blended learning in the clinical education of healthcare students: a systematic review. Med Teach. 2012;34(4):e216–21.

    Article  Google Scholar 

  9. Tomesko J, Touger-Decker R, Dreker M, Zelig R, Parrott JS. The Effectiveness of Computer-Assisted Instruction to Teach Physical Examination to Students and Trainees in the Health Sciences Professions: A Systematic Review and Meta-Analysis. J Med Educ Curric Dev. 2017;4:1–11, 2382120517720428.

    Google Scholar 

  10. The World Confederation for Physical Therapy (WCPT) World phsyiotheraphy 2020 https://www.wcpt.org/node Accessed 5 October 2020.

  11. Physical therapy WCPT. WCPT guideline for physical therapist professional entry level education 2011 https://world.physio/guideline/entry-level-education Accessed 5 October 2020.

  12. Unge J, Lundh P, Gummesson C, Amnér G. Learning spaces for health sciences – what is the role of e-learning in physiotherapy and occupational therapy education? A literature review. Phys Ther Rev. 2018;23(1):50–60.

    Article  Google Scholar 

  13. Mącznik AK, Ribeiro DC, Baxter GD. Online technology use in physiotherapy teaching and learning: a systematic review of effectiveness and users' perceptions. BMC Med Educ. 2015;15:160. https://doi.org/10.1186/s12909-015-0429-8 PMID: 26415677; PMCID: PMC4587774.

    Article  Google Scholar 

  14. Veneri D. The role and effectiveness of computer-assisted learning in physical therapy education: A systematic review. Physiother Theory Pract. 2011;27(4):287–98.

    Article  Google Scholar 

  15. Shamseer L, Moher D, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015: elaboration and explanation. BMJ. 2015;349:g7647.

    Article  Google Scholar 

  16. Shephard K. Higher education for sustainability: seeking affective learning outcomes. Int J Sustain High Educ. 2008;9(1):87–98.

    Article  Google Scholar 

  17. Ouzzani M, Hammady H, Fedorowicz Z, et al. Rayyan—a web and mobile app for systematic reviews. Syst Rev. 2016;5:210. https://doi.org/10.1186/s13643-016-0384-4.

    Article  Google Scholar 

  18. Higgins JPT, Altman DG, Gøtzsche PC, Jüni P, Moher D, Oxman AD, et al. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. BMJ. 2011;343:d5928.

    Article  Google Scholar 

  19. Garrison DR, Kanuka H. Blended learning: Uncovering its transformative potential in higher education. Int Higher Educ. 2004;7(2):95–105.

    Google Scholar 

  20. Moore MG, Kearsley G. Distance education: A systems view. Wadsworth: Publisher; 1996. p. 290.

    Google Scholar 

  21. Abeysekera L, Dawson P. Motivation and cognitive load in the flipped classroom: definition, rationale and a call for research. High Educ Res Dev. 2014;34(1):1–14.

    Article  Google Scholar 

  22. Sharples M, Taylor J, Vavoula G. A Theory of Learning for the Mobile Age. In: Andrews R, Haythornthwaite C, editors. The Sage Handbook of Elearning Research: Sage publications; 2006. p. 221–47.

    Google Scholar 

  23. Kaplan AM, Haenlein M. Higher education and the digital revolution: About MOOCs, SPOCs, social media, and the Cookie Monster. Bus Horiz. 2016;59(4):441–50.

    Article  Google Scholar 

  24. McAuley A, Stewart B, Siemens G, Cormier D. The MOOC model for digital practice; 2010.

    Google Scholar 

  25. Blackstock FC, Watson KM, Morris NR, Jones A, Wright A, McMeeken JM, et al. Simulation can contribute a part of cardiorespiratory physiotherapy clinical education: two randomized trials. Simul. 2013;8(1):32–42.

    Google Scholar 

  26. Green RA, Whitburn LY. Impact of introduction of blended learning in gross anatomy on student outcomes. Anat Sci Educ. 2016;9(5):422–30. https://doi.org/10.1002/ase.1602 Epub 2016 Mar 1. PMID: 26929149.

    Article  Google Scholar 

  27. Maloney S, Storr M, Paynter S, Morgan P, Ilic D. Investigating the Efficacy of Practical Skill Teaching: A Pilot-Study Comparing Three Educational Methods. Adv Health Sci Educ. 2013;18(1):71–80.

    Article  Google Scholar 

  28. Maloney S, Storr M, Morgan P, Ilic D. The effect of student self-video of performance on clinical skill competency: a randomised controlled trial. Adv Health Sci Educ Theory Pract. 2013;18(1):81–9. https://doi.org/10.1007/s10459-012-9356-1 Epub 2012 Feb 22. PMID: 22354337.

    Article  Google Scholar 

  29. Nicklen P, Keating JL, Paynter S, Storr M, Maloney S. Remote-online case-based learning: A comparison of remote-online and face-to-face, case-based learning - a randomized controlled trial. Educ Health. 2016;29(3):195–202.

    Google Scholar 

  30. Arroyo-Morales M, Cantarero-Villanueva I, Fernandez-Lao C, Guirao-Pineyro M, Castro-Martin E, Diaz-Rodriguez L. A blended learning approach to palpation and ultrasound imaging skills through supplementation of traditional classroom teaching with an e-learning package. Man Ther. 2012;17(5):474–8.

    Article  Google Scholar 

  31. Cantarero-Villanueva I, Fernandez-Lao C, Galiano-Castillo N, Castro-Martin E, Diaz-Rodriguez L, Arroyo-Morales M. Evaluation of e-learning as an adjunctive method for the acquisition of skills in bony landmark palpation and muscular ultrasound examination in the lumbopelvic region: a controlled study. J Manip Physiol Ther. 2012;35(9):727–34.

    Article  Google Scholar 

  32. Fernández-Lao C, Cantarero-Villanueva I, Galiano-Castillo N, Caro-Morán E, Díaz-Rodríguez L, Arroyo-Morales M. The effectiveness of a mobile application for the development of palpation and ultrasound imaging skills to supplement the traditional learning of physiotherapy students. BMC Med Educ. 2016;16(1):274. Published 2016 Oct 19. https://doi.org/10.1186/s12909-016-0775-1.

    Article  Google Scholar 

  33. JMjgcue N, Jiménez JJ, Osuna-Pérez MC. Development and evaluation of a 3D mobile application for learning manual therapy in the physiotherapy laboratory. Comput Educ. 2013;69:96–108.

    Article  Google Scholar 

  34. Lozano-Lozano M, Galiano-Castillo N, Fernández-Lao C, Postigo-Martin P, Álvarez-Salvago F, Arroyo-Morales M, et al. The Ecofisio Mobile App for Assessment and Diagnosis Using Ultrasound Imaging for Undergraduate Health Science Students: Multicenter Randomized Controlled Trial. J Med Internet Res. 2020;22(3):e16258. https://doi.org/10.2196/16258.

  35. da Costa Vieira RA, Lopes AH, Sarri AJ, Benedetti ZC, de Oliveira CZ. Oncology E-Learning for Undergraduate. A Prospective Randomized Controlled Trial. J Cancer Educ. 2017;32(2):344–51.

    Article  Google Scholar 

  36. Rocha ACB, Pereira JLB, Soares CFT, Barbosa P, da Silva AC, de Moraes AM, et al. The effects of a video game on student performance in the knowledge test in the discipline "professional practice and ethics in physiotherapy" from the university of brasilia. Etd Educacao Tematica Digital. 2017;19(2):570–81.

    Article  Google Scholar 

  37. Silva CC, Toledo SL, Silveira PS, Carvalho CR. Evaluation of a multimedia online tool for teaching bronchial hygiene to physical therapy students. Rev Bras Fis. 2012;16(1):68–73.

    Article  Google Scholar 

  38. Ulrich F, Helms NH, Frandsen UP, Rafn AV. Learning effectiveness of 360° video: experiences from a controlled experiment in healthcare education. Interact Learn Environ. 2019:1–14. https://doi.org/10.1080/10494820.2019.1579234.

  39. Bartlett AS, Smith N. The Effect of a Cardiovascular and Pulmonary Mobile Application on Student Learning of Assessment Skills: A Pilot Study. Cardiopulm Phys Ther J. 2020;31(2):66–73.

    Article  Google Scholar 

  40. Huhn K, McGinnis PQ, Wainwright S, Deutsch JEA. Comparison of 2 Case Delivery Methods: Virtual and Live. J Phys Ther Educ. 2013;27(3):41–8.

    Article  Google Scholar 

  41. Hyland MR, Pinto-Zipp G, Olson V, Lichtman SW. A Comparative Analysis of Computer-Assisted Instruction and Traditional Lecture Instruction for Administration and Management Topics in Physical Therapy Education. J College Teach Learn. 2010;7(7):1–14.

    Google Scholar 

  42. Moore WA, Smith AR. Effects of video podcasting on psychomotor and cognitive performance, attitudes and study behaviour of student physical therapists. Innov Educ Teach Int. 2012;49(4):401–14. https://doi.org/10.1080/14703297.2012.728876.

    Article  Google Scholar 

  43. Covill L, Cook J. Comparison of Academic Performance in Traditional and Flipped Classrooms and Students' Attitudes of the Flipped Experience. J Allied Health. 2019;48(1):e1–7.

    Google Scholar 

  44. Day LJ. A gross anatomy flipped classroom effects performance, retention, and higher-level thinking in lower performing students. Anat Sci Educ. 2018;11(6):565–74.

    Article  Google Scholar 

  45. Deprey SM. Outcomes of Flipped Classroom Instruction in an Entry-Level Physical Therapy Course. J Phys Ther Educ. 2018;32(3):289–94.

    Article  Google Scholar 

  46. Murray L, McCallum C, Petrosino C. Flipping the Classroom Experience: A Comparison of Online Learning to Traditional Lecture. J Phys Ther Educ. 2014;28(3):35–41.

    Article  Google Scholar 

  47. Liu Y, Li Y, Lei M, Liu P, Theobald J, Meng L, Liu T, Zhang C, Jin C. Effectiveness of the flipped classroom on the development of self-directed learning in nursing education: a meta-analysis. Front Nurs. 2018;5(4):317–29. https://doi.org/10.1515/fon-2018-0032.

    Article  Google Scholar 

  48. Låg T, Sæle RG. Does the Flipped Classroom Improve Student Learning and Satisfaction? A Systematic Review and Meta-Analysis. AERA Open. 2019. https://doi.org/10.1177/2332858419870489.

  49. Merrill MD. First principles of instruction. ETR&D. 2002;50:43–59. https://doi.org/10.1007/BF02505024.

    Article  Google Scholar 

  50. Dunleavy G, Nikolaou CK, Nifakos S, Atun R, GCY L, Tudor Car L. Mobile Digital Education for Health Professions: Systematic Review and Meta-Analysis by the Digital Health Education Collaboration. J Med Internet Res. 2019;21(2):e12937. https://doi.org/10.2196/12937 PMID: 30747711; PMCID: PMC6390189.

    Article  Google Scholar 

  51. Merayo N, Ruíz I, Debrán J, Aguado JC, de Miguel I, Durán RJ, et al. AIM-Mobile Learning Platform to enhance the teaching-learning process using smartphones. Comput Appl Eng Educ. 2018;26(5):1753–68.

    Article  Google Scholar 

  52. Biggs J. Enhancing teaching through constructive alignment. High Educ. 1996;32(3):347–64.

    Article  Google Scholar 

  53. Jeno LM, Dettweiler U, Grytnes J-A. The effects of a goal-framing and need-supportive app on undergraduates' intentions, effort, and achievement in mobile science learning. Comp Educ. 2020;159:104022.

    Article  Google Scholar 

  54. Damşa C, De Lange, T, Elken M, Esterhazy R, Fossland, T, Frølich, N.et al. Quality in Norwegian Higher Education A review of research on aspects affecting student learning. 2015. Available from: https://www.nifu.no/publications/1288405/ Accessed 10 May 2020.

    Google Scholar 

  55. Fossland TR, Kirsti RyeI. Kvalitetskjeden i høyere utdanning – en guide for digital kompetanse og undervisningskvalitet. SBN 978–82–91308-57-9 Norgesuniversitetets skriftserie (1/2016) [Internet]. 2016. Available from: https://diku.no/rapporter/kvalitetskjeden-i-hoeyere-utdanning.

Download references

Acknowledgments

The authors thank information specialists Ms. Malene Wøhlk Gundersen (MWG) and Ms. Elisabeth Karlsen (EK) at OsloMet, who performed the literature searches; Professor Kjell Sverre Pettersen at OsloMet, who contributed to the initial idea and planning phase; and Assistant Professor Camilla Foss at OsloMet, who contributed with comments and feedback on the content during the final phase. The authors also thank the participants of the research group Professional Knowledge, Qualifying for Professions and Coping with the Tasks of Professional Life at OsloMet for their valuable feedback and constructive comments on an earlier version of this manuscript.

Funding

The authors declare that they received no funding for the research. This work was part of a PhD project funded by the Program for Research on Digitalization and Learning in Education at the Faculty of Health Sciences at OsloMet.

Author information

Authors and Affiliations

  1. Department of Physiotherapy, Oslo Metropolitan University, Post Box 4. St. Olavsplass, 0130, Oslo, Norway

    Nina Bjerketveit Ødegaard, Tone Dahl-Michelsen & Yngve Røe

  2. Department of Nursing and Health Promotion, Oslo Metropolitan University, Post Box 4. St. Olavsplass, 0130, Oslo, Norway

    Hilde Tinderholt Myrhaug

Authors
  1. Nina Bjerketveit Ødegaard
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hilde Tinderholt Myrhaug
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Tone Dahl-Michelsen
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yngve Røe
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

NBØ and YR designed the study, collected and analysed the data, designed the methodology and wrote the article. HMT contributed to the study design, data collection and analysis and to designing and writing the methodology chapter. TDM contributed to the study design, the final analysis and writing the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Nina Bjerketveit Ødegaard.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ødegaard, N.B., Myrhaug, H.T., Dahl-Michelsen, T. et al. Digital learning designs in physiotherapy education: a systematic review and meta-analysis. BMC Med Educ 21, 48 (2021). https://doi.org/10.1186/s12909-020-02483-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12909-020-02483-w

Keywords

BMC Medical Education

ISSN: 1472-6920

Contact us