This article has Open Peer Review reports available.
Evaluation of an adaptive virtual laboratory environment using Western Blotting for diagnosis of disease
© Polly et al.; licensee BioMed Central Ltd. 2014
Received: 13 May 2014
Accepted: 23 September 2014
Published: 20 October 2014
Providing large numbers of undergraduate students in scientific disciplines with engaging, authentic laboratory experiences is important, but challenging. Virtual laboratories (vLABs) are a potential means to enable interactive learning experiences. A vLAB focusing on Western Blotting was developed and implemented in a 3rd year undergraduate Pathology course for science students to facilitate learning of technical molecular laboratory skills that are linked to development of diagnostic skills. Such skills are important for undergraduates in building a conceptual understanding of translation of laboratory techniques to changes in human biology due to disease.
The Western Blotting vLAB was developed and deployed using the Adaptive eLearning Platform (AeLP) developed by Smart Sparrow (https://www.smartsparrow.com/). The vLAB was evaluated to assess students' perceptions of their laboratory skills relevant to the diagnosis of Muscular Dystrophy. A blended learning rotation model was applied in which wet laboratory and vLAB environments for Western Blotting were both delivered to three consecutive cohorts of 3rd year science undergraduates undertaking a Muscle Diseases practical class. Evaluation questionnaires were administered at the completion of the practical classes.
Students indicated in online questionnaires that the Western Blotting vLAB was at least equivalent to the real lab in their perceived development of concepts, laboratory skills and diagnosis of disease.
vLABs have great potential for improving students’ development of diagnostic skills. Further studies are required to determine the impact of vLABs on student learning.
Providing large numbers of undergraduate students in scientific disciplines with engaging, authentic laboratory experiences is important to promote inquiry-based, conceptual learning , but challenging in terms of resourcing . Constraints in a real lab (wet-lab) setting include limited and out-dated laboratory equipment, unavailable materials and difficulties in demonstrating techniques due to large class sizes resulting in student crowding . These resourcing issues have implications for cost, health and safety as well as efficacy of teaching and learning. Such issues have affected the Muscle Diseases practical class within Musculoskeletal Diseases, an undergraduate Pathology course for 3rd year Science students at UNSW Australia. Student enrolments in the Musculoskeletal Diseases course have risen markedly over the past 5 years. This has made it logistically very difficult to teach technical and diagnostic laboratory elements and the use of protein analysis apparatus (Western Blotting) in that practical class. Such technical skills are linked to conceptual frameworks that underpin the diagnosis of muscular dystrophy. Furthermore, the use of Western Blotting apparatus in a real lab setting is time-consuming and cumbersome and tends to detract from the diagnostic aspect of the practical class .
Moreover, the focus of the labs is on acquiring technical and diagnostic skills, and the cognitive load imposed by learning to use real lab apparatus is possibly redundant to that goal . This is not to say that the lab equipment is redundant overall, but creates extraneous load when trying to acquire diagnostic skills, as the focus of attention may be on mastering the technical aspects of the apparatus instead of understanding the protein expression patterns that underlie the diagnosis of muscular dystrophy. Hence, the concern was that learners may be distracted by focussing on equipment use in wet labs, rather than learning important concepts such as disease diagnosis in muscular dystrophy. Therefore, one potential benefit of virtual laboratories (vLABs) is that they allow for the separation of mastery of technical equipment from the acquisition of diagnostic skills. Another clear advantage of vLABs is the potential cost savings on consumables and laboratory demonstrators. In this context, vLABs are a potential means to enable cost-effective, safe and efficient, interactive learning experiences .
We opted to employ a vLAB format to overcome constraints with the real laboratory experience and to enable students to focus on difficult concepts more effectively, such as the threshold concept that underpins how changes in protein expression result in manifestation of disease at the gross anatomical level [4, 7]. Threshold concepts are those key concepts that transform thinking irreversibly but are often difficult to understand and acquire. Once acquired they may even seem simple and self-evident . vLABs have already been trialed successfully within an Engineering context to improve the teaching of Mechanical Engineering threshold concepts . Using well guided instructional techniques such as those described previously , vLABs also have the potential to reduce complexity  by providing increased opportunities for remediation and practice, as well as guided feedback . They also allow for increased exposure and practice with threshold concepts. The Adaptive eLearning Platform (AeLP) [13, 14] can be used to develop vLABs that are adaptively sequenced to meet students’ individual learning needs, provide adaptive feedback to students on misconceptions, as well as tracking students’ interactions within the virtual environment. The key advantage of using the AeLP to create the Western Blotting vLAB was retention of pedagogical control over the laboratory environment and ‘in-the-moment’ feedback or adaptation to student interactions with the Western Blotting vLAB. Thus, there is emerging evidence that virtual laboratory environments are useful for learning threshold concepts. The AeLP is an innovative way of teaching such concepyts by providing adaptive feedback to students and addressing their needs as they progress through the vLAB.
We are not aware of any previous reports of evaluative data regarding the use of vLABs for Western Blotting, or similar molecular diagnostic techniques. To investigate whether such vLABs are acceptable and effective for learning, we developed a vLAB to demonstrate the process of analysing protein expression by muscle cells, which is a necessary step in the real-world diagnosis of muscular dystrophy and implemented it in a blended learning teaching environment. Hence, the focus of the Western Blotting vLAB was to teach principles of sodium-dodecyl-sulfate polyacrylamide gel electrophoresis (SDS-PAGE) and Western Blotting of dystrophin protein to analyse altered protein expression patterns in patients with disease.
Our anecdotal observations from earlier versions of the Muscle Diseases practical class that used the real lab alone, showed that students needed more guidance in the area of diagnosis of disease using laboratory techniques. This is important, as students need to understand that the quality of how laboratory techniques are performed can impact on the quality of the generated results and therefore outcomes of disease diagnosis. The aims of implementing the vLAB in this study were to: 1) improve students’ understanding of how differences in molecular signatures or altered protein expression patterns could be linked to microscopic or macroscopic changes in diseases such as muscular dystrophy; and 2) evaluate whether students perceived the vLAB as being more or less useful than the real lab in teaching concepts and skills related to Western Blotting.
Development of the Western Blotting vLAB
There were two key development considerations: 1. the broader lesson had to be developed in view of the Muscle Diseases Practical and overall PATH3207 Musculoskeletal Diseases course learning objectives and 2. the Western Blotting vLAB had to be designed to achieve integration with the lesson about the molecular basis of muscular dystrophy whilst keeping it generic enough to be reusable in slightly varying contexts, i.e. teaching of Western Blotting for the purposes of technical skills only. The Software Development Life Cycle (SDLC) method is described a series of phases providing a model for software development and management of the Western Blotting vLAB (Additional file 1).
Western Blotting vLAB design
The Western Blotting vLAB was designed as a flexible, integrated formative experience which combined introductory information, tasks with associated questions and various embedded media such as short videos to enhance student learning. Deployment flexibility entailed the ability to publish the practical lesson for students in-class. This was the original intent, but the capacity is also available to deploy the vLAB for preparation and/or revision purposes. A range of key criteria were utilised in the design of the Western Blotting vLAB, based on best practice in eLearning [12, 15, 16] (Additional file 2).
VLAB interface, environment and navigation
The introductory screens included learning objectives, instructions and videos (Figures 1 and 2) to quickly orientate the learner to the technical aspects of Western Blotting in the context of diagnosing muscular dystrophy. Continual functions included forward and back options, and a return to main menu button on each screen (Figure 1). Embedded video links facilitated demonstration of technically more challenging aspects of the lab so that learning bottlenecks could be overcome via modelling, thus enabling students to progress through the vLAB in a timely manner (Figure 2). These elements were inserted in order to support student use of the equipment in the vLAB and also had the effect of diversifying the mode of presentation to maintain student engagement. This design approach facilitated students’ control of their learning as well as providing additional information on a specific concept, e.g. explaining the significance of a particular technical parameter such as loading the samples correctly into the SDS-PAGE gel lanes. Moreover, videos or animations of tasks involving hand motor skills have been found to lead to increased learning when compared to static images [17, 18].
Feedback and interactive features
In the context of laboratory experiments, interactivity and feedback are core features in promoting learning. Immediate feedback is vital for the learning process of technical and diagnostic skills and for correcting mistakes and misconceptions [12, 15, 19, 20]. Throughout the vLAB, students need to interact with the laboratory environment and with the concepts related to interpreting the results. This is achieved by utilising a variety of question formats (e.g. multiple choice, drop-down lists) with immediate feedback following students’ submission of responses (Figure 3). Additionally, some screens did not permit progress unless the laboratory task was attempted and feedback received. In some instances, the screen was reset after feedback was received. This was intended to ensure that students engaged with the content at their own pace, rather than clicking through the laboratory environment without engaging with the technical and theoretical aspects of the laboratory. Self-paced, guided learning has been shown to improve learning . The diagnosis of muscular dystrophy and related technical issues were addressed in the ‘Results’ section of the vLAB (Figure 3A, B, C). A series of multiple choice questions with drop-down menus shown in Figure 3A were provided to the students with adaptive feedback appropriate to students’ choices. As laboratory data showing various outcomes from each Western Blot were revealed on each successive screen, formative assessment questions and relevant feedback were presented regarding the diagnostic implications of protein expression patterns (Figure 3C).
Deployment and evaluation
In 2011, we documented student user experience and engagement using questionnaires and in class observations of the vLAB use by students for the purposes of implementing improvements in subsequent deployments. Student feedback and technical observations from the first deployment in 2011 were taken into account before the second deployment in 2012. The third deployment in 2013 had no additional changes from 2012.
We designed a questionnaire addressing the technical and diagnostic skills covered by the vLAB. These questionnaires were provided electronically to all students upon completion of the practical class. The questionnaire provided in Additional file 3, used a combination of 3 point (eg. ‘Yes, Not sure, No’), 4 point (‘no it did not - > yes’) and 5-point Likert scale questions to enable students to report their perceived understanding, confidence and learning of technical and diagnostic skills in the vLAB and the real lab environments. This study was approved by the UNSW Human Research Ethics Committee (UNSW Ethics no. HC13004).
Mann–Whitney U tests were used to compare the distribution of ordinal questionnaire data between groups in each year. A p value of <0.05 was considered significant.
“It was good to apply the skills to why we were doing it and how it is used for actual diseases”; “Allowed me to see the band patterns of different muscle diseases”; and “Mistakes in the virtual lab can be addressed sooner than the wet lab. This saves time overall”.
“The virtual lab broke down each section and explained it in more details so by the time you got to the wet lab you understood what was happening”; and “It helped me understand which steps I made silly mistakes in”.
The vLAB was equivalent to the real lab regarding students' perceptions of its utility in aiding their understanding of Western Blotting (Figure 5).
“It was fun to do it in a ‘hands on’ way so we understand the importance of each step”; and "The demonstrations explained the reason for each step and how to theoretically perform the method”.
“Could re-watch the videos which were clearly explained by the demonstrator”;
“Can make mistakes but still reach appropriate outcomes as we have the chance to re-do”;
“The virtual lab explained each step better with the videos”;
“Interactive learning experience, mimics exactly how a lab is. Great.” and “The opportunity to 'practice', without the pressure of wasting actual materials”.
“Learnt that gel casting protein transfer and loading can all influence the migration of a protein within developed gel and the expression of a given protein i.e. darkness of the band”; and
“Allowed me to see the band patterns of different muscle diseases”.
“It was better than the real life version”; and “Gave more confidence on how to do it hands on”.
“Too hard to follow and too crowded to see and have a chance to have a go in the short two hour lab”.
Learning of research technical skills by students
“I didn't have to be afraid to mess up (in) preparing the gel”; and “More practical hands on learning to help incorporate the techniques more effectively into long term memory”.
With regard to the real lab, typical student comments included:
“Allows some experience but not the full one”; and “didn't see the full picture of what technical skills are involved”.
Studies regarding the effectiveness of eLearning versus face-to-face teaching have been conducted in a wide variety of contexts . Reasons for improved learning outcomes include guided instructional formats with customised feedback, increased exposure to threshold concepts , increased student interactivity, increased student opportunities for practice, customised remediation and revision, as well as the potential to reduce redundancy and split attention both of which can lead to cognitive overload . Use of the AeLP has been shown to lead to more effective student learning in many contexts already [9, 15, 23, 24]. To our knowledge, this is the first study of an eLearning intervention utilising a Western Blotting virtual laboratory.
Quantitative and qualitative data obtained from questionnaires indicate that the vLAB improved student perceptions of some aspects of their learning of Western Blotting, and was at least equivalent to the real lab in all aspects evaluated. The efficacy of the vLAB might have been in part due to the provision of an individualised Western Blotting laboratory experience, in contrast with provision of a focussed, yet limited real lab environment within the same practical class . The overarching conceptual framework and technical environment provided by the vLAB appeared to provide a more comprehensive learner experience, whereby students felt better prepared for the real lab experience upon completion of the vLAB.
Students rated the Western Blotting vLAB favourably for interpreting Western Blotting for diagnosis of disease, compared with the real lab in 2011. The vLAB and real lab had equivalent effects on interpreting Western Blotting data for diagnosis of disease in 2012 and 2013. It could be that the novelty of the vLAB approach was responsible for the perceived benefits in the 2011 cohort.
Diagnostic skills are key in underpinning learning of concepts related to the molecular basis of muscular dystrophy. Student feedback demonstrated that they enjoyed being able to use the vLAB to prepare for real lab ‘hands on experience’ and generally enjoyed the interactivity and immediate feedback that the vLAB provided at each step. These data indicate that the vLAB has the capacity to facilitate learning of concepts at least as well as the real lab, according to students' perceptions. This was achieved without requiring extra resourcing or a significant extra investment of student time as judged by the time taken to achieve the learning objectives within the two-hour practical class. This suggests that the design of the vLAB provided students with a time-efficient learning experience.
This vLAB allowed students to learn concepts and techniques via dovetailing ‘real or wet’ and ‘virtual’ laboratories [4, 20, 25]. It has been shown previously that Science students have a greater understanding of best practice and diagnostic outcomes when learning by doing [24, 26]. The technical aspect of the practical class on muscle diseases was therefore important for understanding protein expression status in patients with muscular dystrophy. Students appeared to have a perceived improvement in some aspects of understanding following engagement with the Western Blotting vLAB, particularly the application of knowledge to diagnose changes in protein expression that underlie muscular dystrophy. It might be that exposing students to the vLAB allowed students to focus on the acquisition of diagnostic skills, separate from learning the technical skills of how to physically use equipment in a real lab.
The high level of interactivity and feedback provided by the vLAB, in comparison with the real lab, might have contributed to improved efficacy of delivery of diagnostic content to support learning of laboratory based concepts. This effect has been demonstrated in previous successful eLearning interventions [16, 23, 27]. Multiple studies have found that targeted eLearning environments which embed technical aspects within an overarching conceptual framework, are generally more effective than generic online texts and simulations [4, 14, 19, 28]. When considering implementation of eLearning for undergraduate students, interactivity and feedback are important for both student engagement and learning impact [12, 16, 29, 30].
The present study focuses on student perceptions, rather than objective assessment of diagnostic skills. Further studies are needed to determine whether exposure to vLABs results in equivalent skill development compared to real labs.
This is the first study to report use and evaluation of an interactive virtual laboratory environment using Western Blotting in Pathology. The vLAB was perceived by students to be at least as helpful for learning as the real lab. It is envisioned that the Western Blotting vLAB could be adapted for a range of learning activities across a range of learners, undergraduate and graduate, in which a deeper understanding of protein expression patterns is required. The concepts relating to the creation of vLABs are likely to be generalisable to other domains as well. We believe that this study has important implications for the design of future vLABS to support learning of laboratory technical and diagnostic skills. Further studies of vLABs are required to elucidate the impact of vLABs on students' learning.
This study has received University of NSW Human Ethics Approval, Ethics no. HC13004.
- Bernhard J: Insightful learning in the laboratory: Some experiences from ten years of designing and using conceptual labs. Eur J Eng Educ. 2010, 35 (3): 271-287. 10.1080/03043791003739759.View ArticleGoogle Scholar
- Ray S, Koshy NR, Reddy PJ, Srivastava S: Virtual Labs in proteomics: New E-learning tools. J Proteomics. 2012, 75 (9): 2515-2525. 10.1016/j.jprot.2012.03.014.View ArticleGoogle Scholar
- Dobrzañski L, Honysz R: Materials science virtual laboratory as an example of the computer aid in materials engineering. Journal of Achievements in Materials and Manufacturing Engineering. 2007, 24 (2): 219-222.Google Scholar
- Carnevale D: The Virtual Lab Experiment. The Chronicle of Higher Education Section: Information Technology. 2003, 49 (21): A30.Google Scholar
- Chandler P, Sweller J: Cognitive Load Theory and the Format of Instruction. Cogn Instr. 1991, 8 (4): 293-332. 10.1207/s1532690xci0804_2.View ArticleGoogle Scholar
- Waldrop MM: The Virtual Lab. Nature. 2013, 499: 268-271. 10.1038/499268a.View ArticleGoogle Scholar
- Doherty I, Blake A, Cooper P: Developing ICT and e-learning capacity in a medical and health sciences faculty. ICT: Providing choices for learners and learning Proceedings ascilite Singapore 2007. 2007, 219-222. http://www.ascilite.org.au/conferences/singapore07/procs/doherty-poster.pdf.Google Scholar
- Meyer JH, Land R: Threshold concepts and troublesome knowledge (2): Epistemological considerations and a conceptual framework for teaching and learning. High Educ. 2005, 49: 373-388. 10.1007/s10734-004-6779-5.View ArticleGoogle Scholar
- Khawaja M, Prusty G, Ford R, Marcus N, Russell C: Can More become Less? Effects of an Intensive Assessment Environment on Students’ Learning Performance. Eur J Eng Educ. 2013, 38 (6): 631-651. 10.1080/03043797.2013.834295. in pressView ArticleGoogle Scholar
- Wong A, Leahy W, Marcus N, Sweller J: Cognitive load theory, the transient information effect and e-learning. Learn Instr. 2012, 22 (6): 449-457. 10.1016/j.learninstruc.2012.05.004.View ArticleGoogle Scholar
- Marcus N, Cooper M, Sweller J: Understanding instructions. J Educ Psychol. 1996, 88 (1): 49-63.View ArticleGoogle Scholar
- Marcus N, Ben-Naim D, Bain M: Instructional Support for Teachers and Guided Feedback for Students in an Adaptive eLearning Environment. Eighth International Conference on Information Technology: New Generations, IEE Computer Society. 2011, 626-631.Google Scholar
- Ben-Naim D, Bain M, Marcus N: A User-Driven and Data-Driven Approach for Supporting Teachers in Reflection and Adaptation of Adaptive Tutorials. International Working Group on Educational Data Mining, International Conference on Educational Data Mining (EDM). 2009, 21-30.Google Scholar
- Ben-Naim D, Marcus N, Bain M: Proceedings of the 1st International Workshop on Intelligent Support for Exploratory Environments (part of ECTEL 2008). Visualization and analysis of student interactions in an exploratory learning environment. 2008Google Scholar
- Morgulis Y, Kumar R, Lindeman R, Velan G: Impact on learning of an e-learning module on leukaemia: a randomised controlled trial. BMC Med Educ. 2012, 12 (1): 36-10.1186/1472-6920-12-36.View ArticleGoogle Scholar
- Cook D, Levinson A, Garside S, Dupras D, Erwin P, Montori V: Instructional design variations in internet-based learning for health professions education: a systematic review and meta-analysis. Acad Med. 2010, 85: 909-922. 10.1097/ACM.0b013e3181d6c319.View ArticleGoogle Scholar
- Wong A, Marcus N, Ayres P, Smith L, Cooper GA, Paas F, Sweller J: Instructional animations can be superior to statics when learning human motor skills. Comput Hum Behav. 2009, 25 (2): 339-347. 10.1016/j.chb.2008.12.012.View ArticleGoogle Scholar
- Ayres P, Marcus N, Chan C, Qian N: Learning Hand Manipulative Tasks: When Instructional Animations are Superior to Equivalent Static Representations. Computers in Human Behaviour. 2009, 25 (2): 348-353. 10.1016/j.chb.2008.12.013.View ArticleGoogle Scholar
- Clark R, Mayer R: E-learning and the Science of Instruction. 2011, San Francisco: JosseyBass Pfeiffer, 3View ArticleGoogle Scholar
- Dantas AM, Kemm RE: A blended approach to active learning in a physiology laboratory-based subject facilitated by an e-learning component. Adv Physiol Educ. 2008, 32 (1): 65-75. 10.1152/advan.00006.2007.View ArticleGoogle Scholar
- Kirschner PA, Sweller J, Clark RE: Why Minimal Guidance During Instruction Does Not Work: An Analysis of the Failure of Constructivist, Discovery, Problem-Based, Experiential, and Inquiry-Based Teaching. Educ Psychol. 2006, 41 (2): 75-86. 10.1207/s15326985ep4102_1.View ArticleGoogle Scholar
- Sweller J, Ayres P, Kalyuga S: Chapter 9 The Split Attention Effect pp 111-128 and Chapter 11 The Redundancy Effect. Cognitive Load Theory, Part IV. 2011, 141-154.View ArticleGoogle Scholar
- Velan G, Lattimore M, Lindeman R, Kumar R: A web-based module onlymphoma for senior medical students: benefits for learning. JIAMSE. 2010, 20: 32-40.Google Scholar
- Velan G, Ben-Naim D, Kumar R, Bain M, Kan B, Marcus N: Adaptive Tutorials Using Virtual Slides to Enhance Learning of Microscopic Morphology. World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education 2009. Edited by: Bastiaens T, Dron J, Xin C. 2009, Vancouver, Canada: AACE, 759-763.Google Scholar
- Carbonaro M, King S, Taylor E, Satzinger F, Snart F, Drummond J: Integration of e-learning technologies in an interprofessional health science course. Med Teach. 2008, 30 (1): 25-33. 10.1080/01421590701753450.View ArticleGoogle Scholar
- McGaghie WC, Issenberg SB, Petrusa ER, Scalese RJ: A critical review of simulation-based medical education research: 2003–2009. Med Educ. 2010, 44 (1): 50-63. 10.1111/j.1365-2923.2009.03547.x.View ArticleGoogle Scholar
- Cook D, Levinson A, Garside S, Dupras D, Erwin P, Montori V: Internet-based learning in the health professions. JAMA. 2008, 300: 1181-1196. 10.1001/jama.300.10.1181.View ArticleGoogle Scholar
- Paechter M, Maier B, Macher D: Students' expectations of, and experiences in e-learning: their relation to learning achievements and course satisfaction. Comput Educ. 2010, 54: 222-229. 10.1016/j.compedu.2009.08.005.View ArticleGoogle Scholar
- Wong G, Greenhalgh T, Pawson R: Internet-based medical education: a realist review of what works, for whom and in what circumstances. BMC Med Educ. 2010, 10: 12-10.1186/1472-6920-10-12.View ArticleGoogle Scholar
- Patridge M: E-learning: what is it? Where and how do we use it? Is it effective?. Postgrad Med J. 2011, 24: 249-251.Google Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6920/14/222/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.