- Research article
- Open Access
- Open Peer Review
Survey of e-learning implementation and faculty support strategies in a cluster of mid-European medical schools
- David Alexander Back1, 2,
- Florian Behringer2,
- Tina Harms2,
- Joachim Plener2,
- Kai Sostmann†2Email author and
- Harm Peters†2
© Back et al. 2015
- Received: 5 March 2015
- Accepted: 14 August 2015
- Published: 3 September 2015
The use of electronic learning formats (e-learning) in medical education is reported mainly from individual specialty perspectives. In this study, we analyzed the implementation level of e-learning formats and the institutional support structures and strategies at an institutional level in a cluster of mid-European medical schools.
A 49-item online questionnaire was send to 48 medical schools in Austria, Germany and Switzerland using SurveyMonkey®. Data were collected between February and September of 2013 and analyzed using quantities, statistical and qualitative means.
The response rate was 71 %. All schools had implemented e-learning, but mainly as an optional supplement to the curriculum. E-learning involved a wide range of formats across all disciplines. Online learning platforms were used by 97 % of the schools. Full-time e-learning staff was employed by 50 %, and these had a positive and significant effect on the presence of e-learning in the corresponding medical schools. In addition, 81 % offered training programs and qualifications for their teachers and 76 % awarded performance-oriented benefits, with 17 % giving these for e-learning tasks. Realization of e-learning offers was rewarded by 33 %, with 27 % recognizing this as part of the teaching load. 97 % would use curriculum-compatible e-learning tools produced by other faculties.
While all participating medical schools used e-learning concepts, this survey revealed also a reasonable support by institutional infrastructure and the importance of staff for the implementation level of e-learning offerings. However, data showed some potential for increasing tangible incentives to motivate teachers to engage in further use of e-learning. Furthermore, the use of individual tools and the distribution of e-learning presentations in various disciplines were quite inhomogeneous. The willingness of the medical schools to cooperate should be capitalized for the future, especially concerning the provision of e-learning tools and concepts.
- Medical School
- Learn Management System
- Blended Learning
- Free Text Answer
- Tenure Scheme
In parallel with the technological revolution of the past decades, digitally supported learning tools and formats (e-learning) have become an important component in many medical curricula . An increasing number of e-learning tools has been developed and is now employed in various settings according to the subject and intention of the educational endeavor [2–5]. Today´s medical students have grown up mostly in an already technologically supported learning environment. In general, they positively rate the integration of e-learning [6–9] and e-learning is frequently integrated with face-to-face teaching as blended learning format . The production of e-learning materials is often time-consuming and competes with the more and more compressed work-schedules of medical doctors and their limited time resources . In addition, most teachers need technical and expert support when it comes to the production and implementation of e-learning .
International recommendations state that a faculty-wide use of electronic learning scenarios should be a central part in the strategic development of medical programs . In the literature, there are a number of reports on e-learning in medical education, but mainly from discipline-specific perspectives [2, 4, 9]. Analyses and research on the faculty’s application of e-learning formats and supporting infrastructure in medical schools can only rarely be found . Medical faculties can take hold of a wide range of potential structures and strategies to facilitate and foster the use of e-learning in their medical curricula. These range from the provision of Learning Management Systems (LMS) as internet-based software programs for the delivery and tracking of e-learning across a medical school  authoring tools, up to permanent e-learning staff, qualification programs and training courses for the implementation of e-learning , quality assurance programs for the production and implementation of e-learning [16, 17], funding of e-learning projects and performance-orientated payments or awards [18, 19].
The aim of this study was to systematically analyze the implementation level for e-learning in medical education from a medical school institutional perspective. We took advantage of an existing working group “New Media” within the Gesellschaft für Medizinische Ausbildung (Society for Medical Education) that brings together representatives from medical schools of the three mid-European countries Austria, Germany and Switzerland . In addition to the level of implementation, we analyzed the currently operating institutional support structures and strategies for the provision of e-learning and asked for e-learning issues that should be approached in the near future.
General information about the medical school and provision of e-learning
Information about the infrastructural conditions of e-learning supporting measures
Information about requirements of and incentives for staff in the field of e-learning
The initial questionnaire was validated through a peer review approach online according the pre-test method  during the winter semester 2012/13. Peer reviewers (n = 4) were both faculty staff members responsible for e-learning in their medical school, and members of the Society for Medical Education . The returned comments were collected and the questionnaire adapted accordingly. The local responsible ethical committee of the university was informed about this survey and gave its written consent (Ethikkommission Charité - Universitätsmedizin Berlin, Ethikausschuss 4, Campus Benjamin Franklin, Berlin, Germany). The survey followed the directives of the Helsinki declaration.
The final questionnaire for this study contained a total of 49 items, with 27 closed questions and 22 questions for free text answers (Additional file 1). The questionnaire was delivered to the 48 medical schools in Austria, Switzerland and Germany using the online program SurveyMonkey® (SurveyMonkey, Oregon, USA). Access to the questionnaire was provided by an email link. Through electronic pre-determination of the response options supplied by SurveyMonkey®, users were offered the option of skipping or omitting certain questions. The survey started in February 2013 and after 4 reminders, data collection ended in September 2013. Reminders consisted of reminder emails to the correspondent involved. In cases where an answer was still missing, we tried to contact assistants of the deaneries of student affairs by email. In a last attempt the deanery was called by phone.
Quantitative analysis was undertaken where results of the closed questions (mainly yes/ no) were expressed as percentage of their relative occurrence per item and were calculated by the SurveyMonkey® program. Spearman´s rank-order correlations were applied by using the SPSS® 17.0 statistics software (SPSS Inc., Chicago, USA) in order to analyze potential coherences between the indicated size of a medical school and its financial means or the number of employees for an e-learning department. Additionally, the chi-square test was used to analyze if the presence of e-learning staff predicted the use of any modalities, indicated by the medical schools in the closed questions. Alternatively, the Mann–Whitney U test was performed to analyse the implementation level of e-learning in the existing disciplines at the medical schools, and that of e-learning tools both in general and in dependence of the presence of e-learning staff.
The individual responses to the free text were quantitatively and independently analyzed by two of the authors for repetitive themes and then summarized.
A total of 34 out of the 48 online questionnaires was returned (71 %). After analysis of all data, seven questions for free text answers were excluded due to a low return rate (n ≤ 5) or due to ambiguous responses (Additional file 1). The responses (16 entries) came from e-learning staff (n = 8), dean’s office (n = 4) and quality management, exam coordination, IT and didactics (n = 1 each). The sizes of the various institutions varied from 100–500 students (n = 1), 500–1500 (n = 6), 1500–3000 (n = 19), 3000–6000 (n = 4), up to 6000–9000 students (n = 2). Nine universities voluntarily provided their names (seven German, one Austrian and one Swiss).
General information about e-learning provision at medical schools (n = 34; results are expressed as percentage of total answers per item). The symbol * indicates a significant difference between medical schools with (34.4 %) and without e-learning staff (9.4 %) with a p < 0.01 (chi-square test of independence)
General information about e-learning at the medical schools
Do e-learning tools for the education of students exist at your medical school?
- predominantly mandatory
- predominantly optional
Is there a specific set of recommendations for the application of e-learning by your medical school from the academic board or deanery?
43.8 % *
Do they stipulate the use of a quality assurance code for your e-learning activities?
- If so, are these quality criteria designed to comply with the standards stipulated by the German Medical Association or similar (please see the PDF file attached for details)
Is there a faculty-wide strategy for increasing the scope and quality of e-learning tools over the coming years in your medical school?
Do you take gender criteria into account when developing e-learning activities?
Do you wish more support from relevant discipline societies (GMA/GMDS etc.) and academic institutions or public agencies (DFG/BMBF/State Ministries) for the development of e-learning activities?
Infrastructural information about e-learning provisions at medical schools (n = 34; results are expressed as percentage of total answers per item). The symbol * indicates a significant difference between medical schools with (44.8 %) and without e-learning staff (17.2 %) with a p < 0.01 (chi-square test of independence)
Infrastructural information about the provision of e-learning
Does your medical school offer…
a) … Performance-orientated financial rewards (LOM)?
b) … Specific LOM for teaching?
c) … Is e-learning associated with the award of LOM?
Do you have permanent staff in your medical school who is employed to deal with e-learning (an e-learning team/department)?
Do you offer training or qualification programs for teachers…
a) … that deals directly with the authoring systems of programs in use at your medical school?
b) … on the topic of e-learning (general information)?
c) Would you make use of training programs that have been developed at other universities for the training of your teachers?
Does your medical school use electronic means to carry out summative (mandatory) exams?
Does your medical school also offer e-learning formative exams to students?
Do you reward your teachers in some form for…
a) … the development of e-learning tools/courses?
b) … the implementation of e-learning tools/courses?
Do development and implementation of e-learning tools/courses count towards teaching activities or load?
- If not, is this planned at your medical school for the future?
Would you consider offering e-learning opportunities developed by other medical schools for inclusion in teaching by your medical school, if they fitted into the curriculum?
Are teachers at your medical school encouraged (through instructions, study regulations, etc.) to prepare e-learning tools?
Do you regularly evaluate the opinions, attitudes and experiences of your teachers on the subject of e-learning in your medical school?
Do you regularly evaluate the opinions, attitudes and experiences of your students on the subject of e-learning in your medical school?
62.1 % *
Does your medical school or do your students recognize outstanding e-learning opportunities with awards?
Concerning the impact of the presence of e-learning staff, a significant correlation could be shown for the existence of recommendations for the application of e-learning by a medical school (Table 1). Also, the evaluation of students on the subject of e-learning was performed significantly more often when e-learning staff was present (Table 2). There were also significantly higher implementation levels of the provided total amount of e-learning items (Fig. 1), as well as of the general existence of e-learning offers in the disciplines of medical schools (Fig. 2).
Software programs used for the creation of e-learning contents recording of lectures. The questions were: “What is/are the name/s of the LMS you are using at your medical school?”, “Which programs do you offer your teachers for the development and creation of e-learning contents?”, “Which programs are used alongside those you offer by your teachers on their own initiative (as far as you know of?)”, “If you record lectures—which tools do you use?”
Docendo, Mediabird, Mediasite, Articulate, Lectora
Wondershare (4x), Mediator Authoring Software
Case-based learning systems
CAMPUS (4x), Casus (3x), Inmedea Simulator, Casetrain
Learning management systems
Moodle (14x), Ilias (12x), OLAT (3x), Stud.IP (3x), Blackboard (2x), ALMA WEB (1x), Metacoon (1x), MedPol (1x), ILKUM (1x)
Microsoft Office Products
Word, Excel, PowerPoint, Access
iTunes U, Onyx Mac
Adobe Collection (Acrobat, Photoshop, Premiere, E-Learning Suite, CreativeSuite) (2x), Raptivity, Zoomify Image Viewer, Primal Pictures, Mediscript Online, Camtasia Studio (11x), WebKit
Programs for the recording of lectures
Camtasia Studio (10x), Lecturnity (3x), Adobe (Adobe Connect, Adobe Premiere) (3x), WOWZA Streaming Server, RUBcast, Vilea, LifeSize
Improvement of the infrastructure and implementation in the curriculum (especially blended learning; reinforced mandatory, less optional use)
Creation of a faculty-wide strategy on e-learning
Improvement of personal resources and general financing
Construction of a system for teachers to encourage the creation of e-learning opportunities, as well as improved integration of teachers into e-learning concepts
Intensification of training measures for teachers in e-learning
Increased incorporation of smartphones, tablets and social media
Improvement of e-learning opportunities (portfolio extension, more interactivity and realism, research on benefits of e-learning and new potentials)
Clarification of copyright issues
The survey presented here showed that e-learning has reached a high implantation level in the cluster of analyzed mid-European medical schools. However, the use of single tools and the distribution of e-learning offerings in individual disciplines were seen to be inhomogeneous among the institutions. The results also highlight that there is a potential for improvements regarding motivational incentives for the teaching staff which is dealing with the development and implementation of e-learning scenarios.
Concerning the level of e-learning implementation, it can be stated that all of the addressed schools did use e-learning proposals to some extent. E-learning is also established in its basic use as a means to offer support to classic teaching of face-to-face courses. Among these offers, non-collaborative formats (such as podcasts or lecture recordings) are predominantly used as mandatory supplements. Future developments should consist of an integration of mandatory collaborative e-learning tools as a holistic approach that includes digitally driven assessment-formats as well . In this study, gender issues were taken into account for developing e-learning activities in general by less than half of the participating medical schools. The survey did not go into any details, for instance into the use of gender-neutral language, avoiding gender stereotypes or gender medicine as a topic itself.
Among such methods of teaching, many formats seem to be well-known and widely implemented, while tools that focus on online collaboration are less presented especially as mandatory didactic elements. As there can be found successful usage of these—like that of wiki—in the literature , it can be assumed that their implementation depends both on the familiarity of teachers with the tools as curricular implementation and instructional design of the course .
There was an inhomogeneous representation of e-learning offers for the single medical disciplines in this survey. However, the individual number of medical schools which provided offers was also inhomogeneous for every particular discipline, an observation which has already been reported e.g. for radiology . The presented results suggest that there is a lower level of implementation in smaller disciplines, such as otorhinolaryngology or human genetics. Here, implemented examples of successful projects in small disciplines  can be seen as great potential for sharing successful formats between medical schools in the future.
Regarding infrastructure and staff, all participating medical schools had faculty members as responsible contact persons for e-learning matters. For the technological infrastructure it can be stated that LMS were firmly established, with open source platforms predominantly used by the majority of the participants . It is remarkable that the majority of the medical schools observed here preferred an in-house open source model to outsourcing their LMS. Although the use of open source systems is related to altered in-house costs, this might be acceptable to realize a higher flexibility in customizing the systems to the medical school’s needs . Consequently, it can be assumed that a high proportion of the named e-learning staff capacities are allocated to host the LMS. However, it could also be shown that the existence of e-learning staff is positively correlated with the presence of e-learning offers at a medical school. This stresses the use of employing personnel merely dedicated to managing a medical schools’ e-learning portfolio.
Teachers could make use of different programs for the development of contents in the context of their didactic teaching scenarios, depending on the medical school. The vast majority offer trainings or qualification programs for teachers. That this is important was also postulated by Cook and Triola as well as by Kowalczyk and Copley, who stressed the need for faculty development in the use of current tools and ongoing training in emerging technologies [29, 26].
Alongside existing infrastructural services, motivational incentives will be important to encourage especially clinical teachers to deal with the provision of e-learning offers, as this is often time and resource-intensive . In the study presented here, less than one-third of the participating medical schools rewarded the creation or implementation of e-learning tools/courses, and less than one fifth awarded funds or prizes for tasks undertaken in the field of e-learning. A further problematic aspect was that an evaluation of opinions, attitudes and experiences of teachers who are involved in the development of e-learning seems rarely to be taken into account . Although a small proportion of participating centers recognized the implementation of e-learning activities as an additional achievement when looking at admission to a tenure scheme, a larger number planned to adopt their practices in this field—a promising approach, as already reported in the literature .
Quality assurance protocols for e-learning scenarios  were in place at only a handful of medical schools. As such a standardization is intended to ensure the maintenance of medical standards and the attainment of curricular learning goals , addressing this backlog would help to create certified e-learning tools which could be of use for a larger number of medical schools .
Altogether, the findings of this study can be seen as part of a detailed strategy of most of the medical schools to increase the scope and quality of their e-learning programs in the next years. Future challenges for a wide use and cooperation in e-learning aspects among medical schools can in fact build on the high willingness of the medical schools to use and exchange e-learning offerings of other universities when it comes to the education of students and also the training of teachers themselves. An interesting approach for the future might here be the development of a central—maybe even international—database of e-learning contents for medical schools, where an exchange or common use of data could take place [17, 27]. The majority of the faculties stated that professional societies, academic institutions or ministries should support the development of e-learning activities. Here, an inter-faculty discussion platform supported by these institutions could be helpful to answer many of the questions that the individual medical schools have in the field of e-learning—e.g. copyright or financial issues or the establishment of blended learning concepts.
Limitations of the validity of the present documentation which must be highlighted include the finding that responses were not collected from all of the medical schools addressed. Therefore, the results shown here provide insight into the current status of the field of e-learning but cannot be used for definitive statements. This could also contribute to a bias that potential regulatory differences in curricular uses of e-learning between individual countries and federal states were not captured by this survey. In addition, the option of leaving certain questions blank meant that there was variation in the numbers of answers collected. Also, the faculty positions of the addressees were seen to be inhomogeneous, and this may have influenced their understanding and perceptions as a confounding variable in answering the questions. Finally, the questions used can only provide a brief representation of the different situations in individual disciplines at the various universities.
As this evaluation focused only on the status and e-learning supporting strategies at mid-European medical schools, in future studies the focus of analysis should be expanded to meet the conditions in more countries and regions of the world.
This survey shows that e-learning has gained a firm place in the curricula of those mid-European medical schools addressed. Many institutions have grasped the potential and value of a good infrastructure in this field. However, the distribution and promotion of e-learning is inhomogeneous. Also, teachers’ commitments should be given a better incentive. Aims for the next years should include fostering a network with a constant dialog between the medical schools for addressing common problems, and development of a database with different quality-tested tools that can be accessed on-demand by all schools. This survey should be repeated to document further developments and even extended internationally to compare more countries and to discover potential for future cooperation.
We thank Mrs. Nicole Haberstroh for her technical support in data analysis. We also thank Miss Paula S. Wendler for her support in data collection, especially when it came to contacting the correspondence partners at the universities. Finally, we thank Mrs. Ellis Rea for her support in English editing of the text.
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Ruiz JG, Mintzer MJ, Leipzig RM. The impact of E-learning in medical education. Acad Med. 2006;81:207–12.View ArticleGoogle Scholar
- Xeroulis GJ, Park J, Moulton CA, Reznick RK, Leblanc V, Dubrowski A. Teaching suturing and knot-tying skills to medical students: a randomized controlled study comparing computer-based video instruction and (concurrent and summary) expert feedback. Surgery. 2007;141:442–9.View ArticleGoogle Scholar
- Shantikumar S. From lecture theatre to portable media: students’ perceptions of an enhanced podcast for revision. Med Teach. 2009;31:535–8.View ArticleGoogle Scholar
- Heye T, Kurz P, Eiers M, Kauffmann GW, Schipp A. A radiological case collection with interactive character as a new element in the education of medical students. Rofo. 2008;180:337–44.View ArticleGoogle Scholar
- Ruderich F, Bauch M, Haag M, Heid J, Leven FJ, Singer R, et al. CAMPUS--a flexible, interactive system for web-based, problem-based learning in health care. Stud Health Technol Inform. 2004;107:921–5.Google Scholar
- Gray K, Tobin J. Introducing an online community into a clinical education setting: a pilot study of student and staff engagement and outcomes using blended learning. BMC Med Educ. 2010;10:6.View ArticleGoogle Scholar
- Ridgway PF, Sheikh A, Sweeney KJ, Evoy D, McDermott E, Felle P, et al. Surgical e-learning: validation of multimedia web-based lectures. Med Educ. 2007;41:168–72.View ArticleGoogle Scholar
- Woltering V, Herrler A, Spitzer K, Spreckelsen C. Blended learning positively affects students’ satisfaction and the role of the tutor in the problem-based learning process: results of a mixed-method evaluation. Adv Health Sci Educ Theory Pract. 2009;14:725–38.View ArticleGoogle Scholar
- Back DA, Haberstroh N, Sostmann K, Schmidmaier G, Putzier M, Perka C, et al. High efficacy and students’ satisfaction after voluntary vs mandatory use of an e-learning program in traumatology and orthopedics--a follow-up study. J Surg Educ. 2014;71:353–9.View ArticleGoogle Scholar
- Masie E. Blended learning: The Magic Is in the Mix. In: Rossett A, editor. The ASTD E-Learning Handbook. New York: McGraw-Hill; 2002. p. 58–63.Google Scholar
- Matthes G, Rixen D, Tempka A, Schmidmaier G, Wolfl C, Ottersbach C, et al. Physicians in traumatology. Critically endangered? Results of an inquiry. Unfallchirurg. 2009;112:218–22.View ArticleGoogle Scholar
- Davids MR, Chikte UM, Halperin ML. An efficient approach to improve the usability of e-learning resources: the role of heuristic evaluation. Adv Physiol Ed. 2013;37:242–8.View ArticleGoogle Scholar
- Steinert Y, Mann K, Centeno A, Dolmans D, Spencer J, Gelula M, et al. A systematic review of faculty development initiatives designed to improve teaching effectiveness in medical education: BEME Guide No. 8. Med Teach. 2006;28:497–526.View ArticleGoogle Scholar
- Welk A, Splieth C, Seyer D, Rosin M, Siemer M, Meyer G. German dental faculty attitudes towards computer-assisted simulation systems correlated with personal and professional profiles. Eur J Dent Educ. 2006;10(2):87–95.View ArticleGoogle Scholar
- Barefield AC, Meyer JD. Leadership’s role in support of online academic programs: implementing an administrative support matrix. Perspect Health Inf Manag. 2013;10:1f.Google Scholar
- German Medical Association. Quality criteria eLearning of the German Medical Association - Qualitätskriterien eLearning der Bundesärztekammer. http://www.bundesaerztekammer.de/fileadmin/user_upload/downloads/KritElearningV8.01.pdf. Accessed 11 Nov 2014
- Kim KJ, Han J, Park Ie B, Kee C. Medical education in Korea: the e-learning consortium. Med Teach. 2009;31(9):e397–401.View ArticleGoogle Scholar
- Charité. Quality seal eLearning Charité. http://elearning.charite.de/services/qualitaetssicherung/qualitaetssiegel_elearning/. 2014. Accessed 4 Jan 2014.
- St. Amant L, Fechtig L. ‘Structure, Finances and Human Resources’ Working Group Report. University of Toronto, Faculty of Medicine, eLearning task Force. 2015. http://elearning.innovatingedu.ca/wp-content/uploads/2014/09/Structures-Finances-and-HR-WG-Final-Report.pdf. Accessed 29 May 2015.
- GMA. https://gesellschaft-medizinische-ausbildung.org (2014). Accessed 16 Sep 2014.
- Schnell R, Hill PB, Esser E. Methoden der empirischen Sozialforschung. 9th ed. Munich: Oldenbourg Wissenschaftsverlag; 2011.Google Scholar
- Collins D. Pretesting survey instruments: an overview of cognitive methods. Qual Life Res. 2003;12:229–38.View ArticleGoogle Scholar
- Ellaway R, Masters K. AMEE Guide 32: e-Learning in medical education Part 1: Learning, teaching and assessment. Med Teach. 2008;30:455–73.View ArticleGoogle Scholar
- Rasmussen A, Lewis M, White J. The application of wiki technology in medical education. Med Teach. 2013;35:109–14.View ArticleGoogle Scholar
- De Wever B, Van Winckel M, Valcke M. Discussing patient management online: the impact of roles on knowledge construction for students interning at the paediatric ward. Adv Health Sci Educ Theory Pract. 2008;13:25–42.View ArticleGoogle Scholar
- Kowalczyk N, Copley S. Online course delivery modes and design methods in the radiologic sciences. Radiol Technol. 2013;85:27–36.Google Scholar
- Kolb S, Wengenroth L, Hege I, Praml G, Nowak D, Cantineau J, et al. Case based e-learning in occupational medicine--a European approach. J Occup Environ Med. 2009;51:647–53.View ArticleGoogle Scholar
- Scavo F. Key Advantage of Open Source is Not Cost Savings. 2005. http://www.computereconomics.com/article.cfm?id=1043. Accessed 14 Dec 2014.
- Cook DA, Triola MM. What is the role of e-learning? Looking past the hype. Med Educ. 2014;48:930–7.View ArticleGoogle Scholar
- Choules AP. The use of elearning in medical education: a review of the current situation. Postgrad Med J. 2007;83:212–6.View ArticleGoogle Scholar
- Ruiz JG, Candler CS, Qadri SS, Roos BA. E-learning as evidence of educational scholarship: a survey of chairs of promotion and tenure committees at U.S. medical schools. Acad Med. 2009;84:47–57.View ArticleGoogle Scholar