- Research article
- Open Access
- Open Peer Review
Effects of a case-based interactive e-learning course on knowledge and attitudes about patient safety: a quasi-experimental study with third-year medical students
© The Author(s). 2016
- Received: 4 May 2016
- Accepted: 29 June 2016
- Published: 11 July 2016
Patient safety (PS) is influenced by a set of factors on various levels of the healthcare system. Therefore, a systems-level approach and systems thinking is required to understand and improve PS. The use of e-learning may help to develop a systems thinking approach in medical students, as case studies featuring audiovisual media can be used to visualize systemic relationships in organizations. The goal of this quasi-experimental study was to determine if an e-learning can be utilized to improve systems thinking, knowledge, and attitudes towards PS.
A quasi-experimental, longitudinal within- subjects design was employed. Participants were 321 third-year medical students who received online surveys before and after they participated in an e-learning course on PS. Primary outcome measures where levels of systems thinking and attitudes towards PS. Secondary outcome measures were the improvement of PS specific knowledge through the e-learning course.
Levels of systems thinking showed significant improvement (58.72 vs. 61.27; p < .001) after the e-learning. Student’s attitudes towards patient safety improved in several dimensions: After the course, students rated the influence of fatigue on safety higher (6.23 vs. 6.42, p < .01), considered patient empowerment more important (5.16 vs. 5.93, p < .001) and realized more often that human error is inevitable (5.75 vs. 5.97, p < .05). Knowledge on PS improved from 36.27 % correct answers before to 76.45 % after the e-learning (p < .001).
Our results suggest that e-learning can be used to teach PS. Attitudes towards PS improved on several dimensions. Furthermore, we were able to demonstrate that a specifically designed e-learning program can foster the development of conceptual frameworks such as systems thinking, which facilitates the understanding of complex socio-technical systems within healthcare organisations.
- Patient safety
- Medical education
- Safety culture
Medical errors are a significant cause of morbidity and mortality, even in highly developed healthcare systems [1–4]. Medical errors lead to approximately 100,000 deaths in the USA  and to 18,000 deaths in Germany  annually. Therefore, improving patient safety is a major goal in healthcare systems worldwide . In recent years, several initiatives on national  and international  levels have aimed to design patient safety curricula and to define learning objectives for both under- and postgraduate students [8–10]. Because of the complexity of the construct of patient safety, such curricula often cover a broad spectrum of content, ranging from simple skills to rather complex competencies . Improving patient safety requires systems-level interventions within a healthcare organization [2, 12–15], and it is widely accepted that knowledge alone will not lead to sustainable improvements in patient safety; instead, a holistic approach that includes behavioural and affective interventions is necessary for such improvements . In this regard, educational approaches to patient safety often include conceptual frameworks such as the systems approach . Systems thinking can be considered a meta strategy to improve patient safety, because errors in medicine often have multifactorial causes and must be approached from various levels of the system to be understood [2, 16, 18, 19]. Affective interventions, an essential aspect of patient safety, require a methodical approach that leads to deep reflections on the learner’s norms and values . Action- or discussion—based learning methodologies such as patient simulation accompanied by structured debriefings are frequently deployed to achieve the triad of knowledge, conceptual frameworks and affective objectives . Although such methodologies have proven effective , they remain resource-intensive in terms of money, time and faculty . Digital learning solutions might overcome or at least decrease this problem by reducing required “face time” . Web 2.0 technology allows the development of interactive learning environments that can provide a systematic approach to knowledge acquisition. Following the principles of problem-based-learning (PBL) , case studies, video sequences or specifically designed dilemmas, e-learning modules may trigger reflections of the learner’s values, beliefs and attitudes. In so doing, such modules prepare the learner for future learning processes in face-to-face action-oriented teaching sessions or clinical settings .
ELPAS — eLearning Patient Safety
Although e-learning has become a standard teaching approach in medical education internationally  and is employed for a wide variety of subjects and disciplines [25, 27–29], it is still rarely used to approach patient safety subjects . In Germany, teacher-centred approaches (i.e. lectures) are still widely used although more and more medical schools introduce learner-centred formats such as problem- or team-based learning. The German Council of Science and Humanities promotes this development of student centred learning to foster critical thinking, systems thinking, decision making or communication skills . Against this background we developed an online course on patient safety aligned with the principles of problem-based-learning , and implemented it in the third year of the undergraduate medical curriculum. The mandatory online course was integrated into a more comprehensive curricular module on “health economics, the healthcare system and public health”. Content for the e-learning course was defined based on the WHO patient safety curriculum . Because the course is the first instance where students at our institution are formally taught about issues of patient safety, we decided to focus on general aspects of patient safety, i.e. teamwork , situational awareness [33, 34], and error management [16, 18, 19].
We chose a work process-oriented approach  for both content selection and sequencing to ensure practical relevance of modules. However, we did not only focus on processual knowledge, but rooted the modules in conceptual models, e.g. the big five model of teamwork , the London Protocol  and Endsley’s situational awareness model .
Guided by the principles of problem-based-learning , we developed interactive online learning modules for each of the three subjects (teamwork, error management, situational awareness). Each module starts with an ill structured clinical problem to trigger interest and stimulate elaboration . In the light of the contextual dependency of learning , we chose emergency medicine and anaesthesiology scenarios, as the students enrolled in our e-learning course did simultaneously attend a hands-on course on emergency medicine. Activating prior knowledge acquired in this course facilitates the problem solving process for cases presented in the patient safety online modules. By integrating several educational technologies, each module was designed to foster self-regulated learning, provide resources for problem solving and allow small group collaboration. To foster self-regulated learning, the modules support monitoring strategies  by providing self-assessment tools, quizzes and checklists. Through learning material, videos, podcasts and literature links, each module provides a profound source for problem solving. Such knowledge repositories are not only an important element of PBL, but support self-regulated learning, as they support students’ resource management strategies . Web 2.0 technology integrated in the modules allows synchronous and asynchronous online collaboration through discussion boards, chat rooms and etherpads. Through these educational technologies, students elaborate their learning outcomes, reflect the clinical problems and develop a problem statement in a collaborative learning process. Table 1 provides an overview of the cases used for each module.
In all modules, clinical scenarios and multi-perspective tasks were used to foster systems thinking; however, a specific focus on the effects of systems thinking was placed in the error management module . Video case studies  were used to demonstrate and practice systems-level error analysis  but also to challenge existing values and norms, as those videos showed lethal, but realistic consequences of errors in various parts of the system. The e-learning course was designed to allow asynchronous and location-independent learning via a browser-based online platform (ILIAS Vers. 5.1, General Public Licence). Although the online platform supports responsive designs and the e-learning can be accessed on mobile devices, the course is optimized for use on laptop or desktop computers. As the ILIAS platform is being used throughout the medical curriculum, students are aware of the functionality of the system. Participants were invited to the online platform via e-mail and could access the course by using their student ID and password.
ELPAS is the result of a local initiative to increase students’ awareness to patient safety. The development of the online modules was funded by internal funds of the department. The development of the course including the development of specific learning material (i.e. videos, podcasts, interactive texts etc.) was done without external service providers to keep costs low, all developments were done by one research fellow (RG), for regular reviews of the course we used a team of 4 persons. In total, four months developing time was spent on the course.
Goal and research questions
The major goal of this study was to identify the impact of the described e-learning module dealing with several aspects of patient safety on students’ domain-specific knowledge, awareness and attitudes and systems thinking. Because a relevant subgroup of medical students in Germany already has professional experience in various fields of the healthcare system (e.g. nursing, emergency medical services), a sub-analysis aimed to identify effects of such professional experience on attitudes and knowledge. Finally, because both the learning content of the intervention and the assessment objectives focus on systems-level interdependences in healthcare organizations, we expect correlations between the level of systems thinking and specific objective (knowledge post-test) as well as subjective (ratings of the e-learning course) outcome measures. To understand, whether students perceive the programme as valuable and user-friendly the study includes a satisfaction and usability questionnaire.
A quasi-experimental, longitudinal within-subjects design was employed. Participants were 321 third-year medical students who received online surveys before and after they participated in the mandatory e-learning course on patient safety. The online course was conducted between October 2015 and December 2015. There were no parallel courses in this period that focused on patient safety, nor did students attend clinical clerkships within the study period where issues of patient safety might have been discussed. Students were recruited via email, and we used the survey functionality of a learning management system (ILIAS, Vers. 5.1, general public licence) and student IDs to create a paired dataset, containing pre- and post-test data, as well as outcome results.
Case based approach to ELPAS online modules
Case presented by video: A CPR-team resuscitates a patient, teamwork is not optimal.
Students apply Big-5 model of teamwork to find solutions.
Etherpad to work on the problem analysis collaboratively.
A real case from a critical incident reporting system (CIRS) is reported.
Students use systematic error analysis to identify potential problems.
Case presented by video: A young patient dies during induction of a routine anaesthesia due to can’t ventilate, can’t intubate situation.
Interactive video with integrated quiz.
Students apply situational awareness model to identify causes which led to the accident.
Subscales of the German Attitudes to Patient Safety Questionnaire (GAPSQ). Paired results for pre- and post-test data
Patient safety training received
My training is preparing me to understand the causes of medical errors.
I have a good understanding of patient safety issues as a result of my undergraduate medical training.
My training is preparing me to prevent medical errors.
Error reporting confidence
I would feel comfortable reporting any errors I had made, no matter how serious the outcome had been for the patient.
I would feel comfortable reporting any errors other people had made, no matter how serious the outcome had been for the patient.
Working hours as error cause (fatigue)
Shorter shifts for doctors will reduce medical errors.
By not taking regular breaks during shifts, doctors are at an increased risk of making errors.
The number of hours doctors work increases the likelihood of making medical errors.
Even the most experienced and competent doctors make errors.
Human error is inevitable.
Patient involvement in reducing error
Patients have an important role in preventing medical errors.
Encouraging patients to be more involved in their care can help to reduce the risk of medical errors occurring.
Importance of patient safety in the curriculum
Teaching students about patient safety should be an important priority in medical students training.
Learning about patient safety issues before I qualify will enable me to become a more effective doctor.
The post-test contained the same scales for GAPSQ and STS, as well as four knowledge questions comparable to those on the pre-test. To analyse usability and student satisfaction, the post-test contained the system usability scale , which is widely tested and accepted for reliability and validity . Overall student satisfaction was measured by asking students to rate each module of the course on a 5-point global rating scale (1 = Not satisfied at all; 5 = very satisfied). Prior to data analysis by RG, the dataset was de-identified by a research assistant, and missing data analysis was performed. No item had to be eliminated from the analysis. For statistical analysis (SPSS, Vers. 23, IBM), we used paired t-tests, one-way ANOVA and bivariate correlations. The study is registered with the German Clinical Trials Register, No. DRKS00009762, and the protocol was approved by the Ethics Committee of Freiburg University (reg. no. 59/16). Participants were informed on the aim of the questionnaire and that data would be analysed anonymously.
Three hundred twenty-one students were enrolled in the study; 252 (79 %) participated in the post-test, and complete pre- and post-test data were available for 224 (70 %). The majority (63 %) of the participants were female, and 73 % were between 20 and 24 years old. Most (71 %) of the participants did not have prior experience in the healthcare system; others had experience as nurses (9 %), paramedics (11 %) or other professions including physiotherapy, midwifery and more (9 %).
Knowledge, values and attitudes
The mean initial knowledge level on patient safety was 36.27 % (SD 23.88). After completion of the e-learning program, the knowledge level increased to 76.45 % (SD 22.97; paired t-test, p < 0.001; Cohen’s d = 1.72). Similar changes occurred in students’ attitudes towards patient safety: The largest difference related to the benefits of patient involvement: After the intervention, students were more positive about the value of patient involvement (5.16 [SD 1.16] vs. 5.93 [SD .95] vs., p < 0.001, Cohen’s d = .73). After the intervention, students acknowledged more readily the effect of fatigue on patient safety (6.23 [SD .77] vs. 6.42 [SD .83] vs., p < 0.01, Cohen’s d = .24). Although students were aware before the e-learning course that human error is inevitable (5.75 [SD 1.40]), their ratings increased significantly after the course (5.97 [SD 1.19]; p < 0.05, Cohen’s d = .17). Similarly, students strongly agreed that even the most experienced doctors make errors. But that item also was rated significantly higher after the course (6.62 [SD .61] vs. 6.51 [SD .76]; p < 0.05; Cohen’s d = .16). Before the online course, students expressed only moderate agreement that they receive sufficient patient safety training in their curriculum (4.52, SD 1.16); after the course, they felt slightly better prepared (4.81 [SD 1.08]; p < 0.01; Cohen’s d = .26). The remaining two subscales of the GAPSQ did not show significant pre-post differences. Table 2 summarises all pre- and post-test data for the GAPSQ.
To identify potential differences between those students who had prior healthcare experience and those who did not, we conducted a one-way ANOVA for pre- and post-test data on the GAPSQ variables. In the pre-test data, significant differences emerged on the subscale fatigue (F(4, 267) = 2.43; p < 0.05). Post hoc analysis using the least significant difference (LSD) method revealed that nurses rated effects of fatigue significantly (p < 0.01) higher than did students without medical background. Significant differences were also observed for the statement “Human error is inevitable” in the pre-test data (F(4,283) = 3.07; p < 0.05). Paramedics rated this item significantly lower than did other subgroups (p < 0.05 for LSD analysis). These pre-course differences levelled out after the course: No significant difference between student groups for any subscale of the GAPSQ was found in the post-test data.
Correlation coefficients testing association between systems thinking, specific knowledge and satisfaction with e-learning elements
Specific knowledge (post)
Satisfaction teamwork module
Satisfaction error management module
Satisfaction podcast situation awareness
Systems thinking score (post)
Specific knowledge (post)
Satisfaction teamwork module
Satisfaction error management module
Usability and student satisfaction
Students perceive ELPAS as easy to use, this is reflected in a usability score of 73.4 (SD = 16.23). This is equal to an adjective rating of “good usability” according to Bangor et al.  Students were satisfied with all modules of the e-learning programme: Satisfaction (1=“not satisfied at all”; 5─“very satisfied”) with the modules on teamwork (4.01, SD .82) and error management (4.05, SD .79) was slightly better than with the situational awareness module (3.74, SD .92). Students did appreciate videos and graphics which facilitate understanding of complex relations. Self-assessment quizzes were considered as very helpful. Some students had difficulties using the etherpad technology for small-group collaboration, however all groups presented well-structured solutions to the scenarios.
After completing an e-learning course on different aspects of patient safety, students’ awareness and knowledge regarding these issues increased. Use of e-learning in medical education is growing and shows promising results, especially for complex topics (such as patient safety), where interactive elements can facilitate learning . Despite these merits, e-learning is hardly used for issues of patient safety yet. In a systematic review, Gordan and colleagues  reported on 22 studies measuring the effects of learning interventions on non-technical skills and attitudes towards patient safety. None of these studies used an e-learning intervention. Only recently did McCarthy and colleagues  report effects of an online learning program on patient safety; their results were comparable to ours. Our findings shed more light on the potential merits of e-learning programs in patient safety. Not unexpectedly, and still promising, is the large effect of the program for acquisition of specific knowledge on patient safety. Such specific knowledge includes definitions and rules, which are - according to the five-stage model of skills acquisition  – the foundation for skills acquisition. Although knowledge alone will hardly improve patient safety, it is considered an important basis for such improvement . Our results suggest that through knowledge acquisition, attitudes change as well: Students perceived patients’ contributions to patient safety as much more important after they completed the online course, although the concept of patient involvement  was not even a specific topic of the course. The relatively large effect on the subscale of patient involvement might be a consequence of the systems thinking approach fostered by the online course . Furthermore, since the module error management focused on a multi-perspective analysis of errors, the patient’s perspective was also integrated, which in turn may have focused students’ attention towards patient empowerment. Although we could not demonstrate relevant direct relationships between systems thinking and the attitudes on patient safety in our study, we can prove that there is a moderate association to specific knowledge: These results support the hypothesis that through improved systems thinking, a better understanding of patient safety theory can be achieved [20, 31, 36]. Although some relevant attitudes towards patient safety could be altered through the e-learning course, other dimensions, such as error disclosure and reporting, remained unchanged. Error disclosure per se is a difficult topic for physicians, as both ethical  and medicolegal  consequences are associated with it. Although students involved in this study are not yet responsible for any part of patient care, their willingness to disclose errors was limited initially and did not change after the e-learning course. Other studies show that willingness to disclose errors often decreases with experience [24, 41]. Despite error reporting’s being addressed in the error management module of the course, the module focuses more on systems-level incident analysis than on error disclosure. More emphasis, especially on the legal aspects of error disclosure, may be necessary to alter students’ confidence to report errors. White and colleagues have expressed a similar conclusion in regard to error-disclosure training .
Because students in this study have limited experience in the healthcare system, we expected to see differences in both knowledge and attitudes when comparing novice students and those who have a medical background. Whereas other studies using the GAPSQ could not find any significant differences , in our study, nurses were more aware of the effects of fatigue than were students without prior medical experience. The negative effects of sleep deprivation on patient safety are well documented , and it is likely that nurses had accumulated individual experiences during their work in the hospital setting. A reverse effect was present in the subgroup of paramedics: Their rating of the statement “Human error is inevitable” was significantly lower than the ratings of other subgroups. This large difference (4.87 for paramedics vs. 5.78 for students without prior medical training) may be explained by the focused experience of pre-hospital care providers: Processes in this field are highly standardized and based on written guidelines and procedures . Paramedics, who are accustomed to working with such protocols, may experience them as a helpful way to reduce or overcome human error .
This study measures self-reported attitudes towards patient safety in students who have limited expertise in the medical field. The longitudinal within-subjects design with pre- and post-course evaluation only detects immediate, short-term effects. Repeated measures may be needed to identify retention of learning and/or stabilisation of attitudes. The generalizability of the results is limited because we only included medical students from Freiburg University and the participation at the online course was mandatory. Because of the voluntary nature of students’ participation, selection bias cannot be ruled out because more motivated students are presumably more likely to participate. Furthermore, the study’s design does not allow for a causal interpretation of the relationships found. Longitudinal or intervention studies should be conducted to examine the causality of the proposed relationships.
To our knowledge, this study was the first successful attempt in Germany to integrate a patient safety course early in the clinical phase of the medical curriculum. Our results suggest that e-learning technology and methodology can be used for knowledge acquisition on theoretical aspects of patient safety. In this way, face-to-face interventions that are more resource-intensive can be better targeted for action-based learning methodologies. As the e-learning course enhanced the awareness of patient safety, affective outcomes were also achieved. Attitudes towards patient safety improved on several dimensions. Furthermore, we were able to demonstrate that a specifically designed e-learning program can foster the development of conceptual frameworks such as systems thinking, which facilitates the understanding of complex socio-technical systems within healthcare organisations. On the basis of our results, patient safety education will be reinforced in our curriculum. Complementary to hands-on training in later stages of the curriculum, brief e-learning modules will be integrated longitudinally in the curriculum to serve as learning boosters and to increase retention of learned material.
ELPAS, e-learning patient safety; GAPSQ, german attitudes to patient safety questionnaire; PS, patient safety; STS, Systems Thinking Scale.
The research article processing charge was funded by the Albert Ludwigs University Freiburg in the funding programme Open Access Publishing.
Availability of data and materials
All the data and additional supporting files on which the conclusions of this manuscript rely are available without restrictions by contacting the corresponding author.
The following authors contributed to the development of the educational programme: RG. The following authors contributed to the development of the design of the research project: RG; MK; GF. RG compiled the survey data and undertook the prime role in the analysis. MK contributed to data analysis and interpretation. GF contributed to the educational theoretical foundation. All authors reviewed and revised the manuscript. All authors read and approved the final manuscript.
The authors declare they have no competing interests.
Consent for publication
Ethics approval and consent to participate
The study is registered with the German Clinical Trials Register, No. DRKS00009762, and the protocol was approved by the Ethics Committee of Freiburg University (reg. no. 59/16). Participants were informed on the aim of the questionnaire and that data would be analysed anonymously. Each participant confirmed to participate voluntarily at the study by activating a checkbox in the online questionnaire.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Clancy CM. Ten years after To Err is Human. Am J Med Qual. 2009;24:525–8.View ArticleGoogle Scholar
- Kohn LT, Corrigan J, Donaldson MS. To err is human: Building a safer health system. Washington, D.C.: National Academy Press; 2000 [Quality chasm series].Google Scholar
- Vogus TJ. BMJ QualSaf Published Online First:[ 25.01.16] doi:10.1136/bmjqs-2015-004847
- Zwaan L, Monteiro S, Sherbino J, et al. BMJ Qual Saf PublishedOnline First: [04.05.2016] doi:10.1136/bmjqs-2015-005014
- Klauber J, Beivers A, Augurzky B, Klauber-Geraedts-Friedrich-Wasem. Schwerpunkt: Patientensicherheit: [mit Online-Zugang]. Stuttgart: Schattauer; 2014 [Krankenhaus-Report, vol. 2014].Google Scholar
- WHO. Patient Safety Curriculum Guide. Geneva: WHO; 2011.Google Scholar
- MFT. Nationaler Kompetenzbasierter Lernzielkatalog Medizin. Berlin: Medizinischer Fakultätentag (MFT); 2015.Google Scholar
- Aboumatar HJ, Thompson D, Wu A, Dawson P, Colbert J, Marsteller J, Kent P, Lubomski LH, Paine L, Pronovost P. Development and evaluation of a 3-day patient safety curriculum to advance knowledge, self-efficacy and system thinking among medical students. BMJ Qual Saf. 2012;21:416–22.View ArticleGoogle Scholar
- Farley D, Zheng H, Rousi E, Leotsakos A. Field test of the world health organization multi-professional patient safety curriculum guide. PLoS One. 2015;10:e0138510.View ArticleGoogle Scholar
- Myung SJ, Shin J-S, Kim JH, Roh H, Kim Y, Kim J, Lee S-I, Lee J-H, Kim SW. The patient safety curriculum for undergraduate medical students as a first step toward improving patient safety. J Surg Educ. 2012;69:659–64.View ArticleGoogle Scholar
- Cresswell K, Howe A, Steven A, Smith P, Ashcroft D, Fairhurst K, Bradley F, Magnusson C, McArthur M, Pearson P, Sheikh A. Patient safety in healthcare preregistration educational curricula: multiple case study-based investigations of eight medicine, nursing, pharmacy and physiotherapy university courses. BMJ Qual Saf. 2013;22:843–54.View ArticleGoogle Scholar
- Hanley D, Abele D, Alley AJ, Smith K, Gaden NW, Phoenix Bittner N. Creating a culture of safety through integration of an early warning system. Can J Nurs Adm. 2016;46:63–8.View ArticleGoogle Scholar
- Lehmann CU, Unertl KM, Rioth MJ, Lorenzi NM. Change Management for the Successful Adoption of Clinical Information Systems. In: Finnell JT, Dixon BE, editors. Clinical Informatics Study Guide. Cham: Springer International Publishing; 2016. p. 435–56.View ArticleGoogle Scholar
- Weaver CA, Ball MJ, Kim GR, Kiel JM, editors. Healthcare Information Management Systems. Cham: Springer International Publishing; 2016.Google Scholar
- Wiegmann DA. Understanding Why quality initiatives succeed or fail: a sociotechnical systems perspective. Ann Surg. 2016;263:9–11.View ArticleGoogle Scholar
- Vincent C. Patient safety. 2nd ed. Chichester: Wiley-Blackwell; 2010.View ArticleGoogle Scholar
- Gordon M, Darbyshire D, Baker P. Non-technical skills training to enhance patient safety: a systematic review. Med Educ. 2012;46:1042–54.View ArticleGoogle Scholar
- Reason JT. Human error. Cambridge: Cambridge University Press; 1990.View ArticleGoogle Scholar
- Vincent C, Taylor-Adams S. Systemanalyse Klinischer Zwischenfälle Das London-Protokoll. London, Zürich: Stiftung für Patientensicherheit; 2007.Google Scholar
- Wachter RM. Patient safety at ten: unmistakable progress, troubling gaps. Health Aff. 2010;29:165–73.View ArticleGoogle Scholar
- McGaghie WC, Issenberg SB, Petrusa ER, Scalese RJ. A critical review of simulation-based medical education research: 2003â-2009. Med Educ. 2010;44:50–63.View ArticleGoogle Scholar
- Fernandez R, Parker D, Kalus JS, Miller D, Compton S. Using a human patient simulation mannequin to teach interdisciplinary team skills to pharmacy students. Am J Pharm Educ. 2006;71:51.View ArticleGoogle Scholar
- McLaughlin JE, Roth MT, Glatt DM, Gharkholonarehe N, Davidson CA, Griffin LM, Esserman DA, Mumper RJ. The flipped classroom. Acad Med. 2014;89:236–43.View ArticleGoogle Scholar
- Ellaway R, Masters K. AMEE guide 32: e-learning in medical education part 1: learning, teaching and assessment. Med Teach. 2008;30:455–73.View ArticleGoogle Scholar
- Trelease RB. From chalkboard, slides, and paper to e-learning: How computing technologies have transformed anatomical sciences education. Anat Sci Educ. 2016. doi: 10.1002/ase.1620. [Epub ahead of print].
- George PP, Papachristou N, Belisario JM, Wang W, Wark PA, Cotic Z, Rasmussen K, Sluiter R, Riboli-Sasco E, Tudor Car L, Musulanov EM, Molina JA, Heng BH, Zhang Y, Wheeler EL, Al Shorbaji N, Majeed A, Car J. Online eLearning for undergraduates in health professions: a systematic review of the impact on knowledge, skills, attitudes and satisfaction. J Glob Health. 2014;4:10406.View ArticleGoogle Scholar
- Drummond D, Arnaud C, Thouvenin G, Guedj R, Grimprel E, Duguet A, Suremain N de, Petit A. An innovative pedagogic course combining video and simulation to teach medical students about pediatric cardiopulmonary arrest: a prospective controlled study. Eur J Pediatr. 2016;175:767–74.Google Scholar
- Khasawneh R, Simonsen K, Snowden J, Higgins J, Beck G. The effectiveness of e-learning in pediatric medical student education. Med Educ Online. 2016;21:29516.View ArticleGoogle Scholar
- Succar T, Grigg J, Beaver HA, Lee AG. A systematic review of best practices in teaching ophthalmology to medical students. Surv Ophthalmol. 2016;61:83–94.View ArticleGoogle Scholar
- Tolks D, Schäfer C, Raupach T, Kruse L, Gerhardt-Szép S, Kllauer G, Lemos M, Fischer MR, Eichner B, Sostmann K, Hege I. An introduction to the inverted/flipped classroom model in education and advanced training in medicine and in the healthcare professions. GMS J Med Educ. 2016;33.Google Scholar
- Bate E, Hommes J, Duvivier R, Taylor, David CM. Problem-based learning (PBL): getting the most out of your students - their roles and responsibilities: AMEE Guide No. 84. Med Teach. 2014;36:1–12.View ArticleGoogle Scholar
- Salas E. Is there a “Big five” in teamwork? Small Group Res. 2005;36:555–99.View ArticleGoogle Scholar
- Endsley MR. Toward a theory of situation awareness in dynamic systems. Hum Factors. 1995;37:32–64.View ArticleGoogle Scholar
- Reader TW, Flin R, Mearns K, Cuthbertson BH. Team situation awareness and the anticipation of patient progress during ICU rounds. BMJ Qual Saf. 2011;20:1035–42.View ArticleGoogle Scholar
- Ebner M, Lienhardt C, Rohs M, Meyer I. Microblogs in higher education — a chance to facilitate informal and process-oriented learning? Comput Educ. 2010;55:92–100.View ArticleGoogle Scholar
- SCHMIDT HG. Foundations of problem-based learning: some explanatory notes. Med Educ. 1993;27:422–32.View ArticleGoogle Scholar
- Boekaerts M. Self-regulated learning: where we are today. Int J Educ Res. 1999;31:445–547.View ArticleGoogle Scholar
- Pintrich PR. The role of motivation in promoting and sustaining self-regulated learning. Int J Educ Res. 1999;31:459–70.View ArticleGoogle Scholar
- Reid J, Bromiley M. Clinical human factors: the need to speak up to improve patient safety. Nursing Standard. 2012;26(35):35-40.Google Scholar
- Vincent C, Amalberti R, editors. Safer Healthcare. Cham: Springer International Publishing; 2016.Google Scholar
- Kiesewetter J, Kager M, Lux R, Zwissler B, Fischer MR, Dietz I. German undergraduate medical students’ attitudes and needs regarding medical errors and patient safety – A national survey in Germany. Med Teach. 2014;36(6):505-510.Google Scholar
- Moore SM, Dolansky MA, Singh M, Palmieri P, Alemi F. The Systems Thinking Scale. Cleveland: Case Western Reserve University; 2010.Google Scholar
- Carruthers S, Lawton R, Sandars J, Howe A, Perry M. Attitudes to patient safety amongst medical students and tutors: Developing a reliable and valid measure. Med Teach. 2009;31:e370–6.View ArticleGoogle Scholar
- Brooke J. SUS: A ‘quick and dirty’ usability scale. In: Jordan PW, editor. Usability evaluation in industry. London and Bristol, Pa: Taylor & Francis; 1996. p. 189–94.Google Scholar
- Lewis JR, Sauro J. The Factor Structure of the System Usability Scale. In: Hutchison D, Kanade T, Kittler J, Kleinberg JM, Mattern F, Mitchell JC, Naor M, Nierstrasz O, Pandu Rangan C, Steffen B, Sudan M, Terzopoulos D, Tygar D, Vardi MY, Weikum G, Kurosu M, editors. Human Centered Design. Berlin, Heidelberg: Springer Berlin Heidelberg; 2009. p. 94–103.View ArticleGoogle Scholar
- Field AP. Discovering statistics using IBM SPSS statistics: And sex and drugs and rock ‘n’ roll. 4th edition. Sage, Los Angeles. 2013.Google Scholar
- Bangor A, Kortum P, Miller J. Determining what individual SUS scores mean: adding an adjective rating scale. J Usability Stud. 2009;4:114–23.Google Scholar
- Patey R, Flin R, Cuthbertson BH, MacDonald L, Mearns K, Cleland J, Williams D. Patient safety: helping medical students understand error in healthcare. Qual Saf Health Care. 2007;16:256–9.View ArticleGoogle Scholar
- Awé C, Lin S-J. A patient empowerment model to prevent medication errors. J Med Syst. 2003;27:503–17.View ArticleGoogle Scholar
- Gallagher TH. Patients’ and Physicians’ attitudes regarding the disclosure of medical errors. JAMA. 2003;289:1001.View ArticleGoogle Scholar
- Gallagher TH, Studdert D, Levinson W. Disclosing harmful medical errors to patients. N Engl J Med. 2007;356:2713–9.View ArticleGoogle Scholar
- Gaba DM, Howard SK. Patient safety: fatigue among clinicians and the safety of patients. N Engl J Med. 2002;347:1249–55.View ArticleGoogle Scholar
- Francis, Roland CE, Schmidbauer W, Spies CD, Sörensen M, Bubser F, Kerner T. Standard operating procedures as a tool to improve medical documentation in preclinical emergency medicine. Emerg Med J. 2010;27:350–4.View ArticleGoogle Scholar
- Hakimzada AF, Green RA, Sayan OR, Zhang J, Patel VL. The nature and occurrence of registration errors in the emergency department. Int J Med Inform. 2008;77:169–75.View ArticleGoogle Scholar