Survey of e-learning implementation and faculty support strategies in a cluster of mid-European medical schools

In parallel with the technological revolution of the past decades, digitally supported learning tools and formats (e-learning) have become an important component in many medical curricula [1]. An increasing number of e-learning tools has been developed and is now employed in various settings according to the subject and intention of the educational endeavor [2–5]. Today´s medical students have grown up mostly in an already technologically supported learning environment. In general, they positively rate the integration of e-learning [6–9] and e-learning is frequently integrated with face-to-face teaching as blended learning format [10]. The production of e-learning materials is often time-consuming and competes with the more and more compressed work-schedules of medical doctors and their limited time resources [11]. In addition, most teachers need technical and expert support when it comes to the production and implementation of e-learning [12].

International recommendations state that a faculty-wide use of electronic learning scenarios should be a central part in the strategic development of medical programs [13]. In the literature, there are a number of reports on e-learning in medical education, but mainly from discipline-specific perspectives [2, 4, 9]. Analyses and research on the faculty’s application of e-learning formats and supporting infrastructure in medical schools can only rarely be found [14]. Medical faculties can take hold of a wide range of potential structures and strategies to facilitate and foster the use of e-learning in their medical curricula. These range from the provision of Learning Management Systems (LMS) as internet-based software programs for the delivery and tracking of e-learning across a medical school [1] authoring tools, up to permanent e-learning staff, qualification programs and training courses for the implementation of e-learning [15], quality assurance programs for the production and implementation of e-learning [16, 17], funding of e-learning projects and performance-orientated payments or awards [18, 19].

The aim of this study was to systematically analyze the implementation level for e-learning in medical education from a medical school institutional perspective. We took advantage of an existing working group “New Media” within the Gesellschaft für Medizinische Ausbildung (Society for Medical Education) that brings together representatives from medical schools of the three mid-European countries Austria, Germany and Switzerland [20]. In addition to the level of implementation, we analyzed the currently operating institutional support structures and strategies for the provision of e-learning and asked for e-learning issues that should be approached in the near future.

The initial questionnaire was validated through a peer review approach online according the pre-test method [22] during the winter semester 2012/13. Peer reviewers (n = 4) were both faculty staff members responsible for e-learning in their medical school, and members of the Society for Medical Education [20]. The returned comments were collected and the questionnaire adapted accordingly. The local responsible ethical committee of the university was informed about this survey and gave its written consent (Ethikkommission Charité - Universitätsmedizin Berlin, Ethikausschuss 4, Campus Benjamin Franklin, Berlin, Germany). The survey followed the directives of the Helsinki declaration.

The final questionnaire for this study contained a total of 49 items, with 27 closed questions and 22 questions for free text answers (Additional file 1). The questionnaire was delivered to the 48 medical schools in Austria, Switzerland and Germany using the online program SurveyMonkey® (SurveyMonkey, Oregon, USA). Access to the questionnaire was provided by an email link. Through electronic pre-determination of the response options supplied by SurveyMonkey®, users were offered the option of skipping or omitting certain questions. The survey started in February 2013 and after 4 reminders, data collection ended in September 2013. Reminders consisted of reminder emails to the correspondent involved. In cases where an answer was still missing, we tried to contact assistants of the deaneries of student affairs by email. In a last attempt the deanery was called by phone.

Quantitative analysis was undertaken where results of the closed questions (mainly yes/ no) were expressed as percentage of their relative occurrence per item and were calculated by the SurveyMonkey® program. Spearman´s rank-order correlations were applied by using the SPSS® 17.0 statistics software (SPSS Inc., Chicago, USA) in order to analyze potential coherences between the indicated size of a medical school and its financial means or the number of employees for an e-learning department. Additionally, the chi-square test was used to analyze if the presence of e-learning staff predicted the use of any modalities, indicated by the medical schools in the closed questions. Alternatively, the Mann–Whitney U test was performed to analyse the implementation level of e-learning in the existing disciplines at the medical schools, and that of e-learning tools both in general and in dependence of the presence of e-learning staff.

The individual responses to the free text were quantitatively and independently analyzed by two of the authors for repetitive themes and then summarized.

A total of 34 out of the 48 online questionnaires was returned (71 %). After analysis of all data, seven questions for free text answers were excluded due to a low return rate (n ≤ 5) or due to ambiguous responses (Additional file 1). The responses (16 entries) came from e-learning staff (n = 8), dean’s office (n = 4) and quality management, exam coordination, IT and didactics (n = 1 each). The sizes of the various institutions varied from 100–500 students (n = 1), 500–1500 (n = 6), 1500–3000 (n = 19), 3000–6000 (n = 4), up to 6000–9000 students (n = 2). Nine universities voluntarily provided their names (seven German, one Austrian and one Swiss).

General information about the provision of e-learning at the faculty level is given in Table 1. At all medical schools, e-learning was an integrated element in their undergraduate medical education curricula. The majority of e-learning tools are used as optional tools for students’ education. Between 60 and 70 % of the medical schools answering used blended learning formats or computer-based trainings as a mandatory part of their curriculum. While an optional use of discussion forums was indicated by more than 75 %, mandatory integration of this tool was noted by less than 10 %. Figure 1 shows the relative distribution of various e-learning formats with high levels for e-learning as an addition to face-to-face teaching, and low levels for the use of Wikis and Webinars. Figure 2 documents the percentage of e-learning offerings in various disciplines. There were no 100 % or 0 % scores. High scores were found for Anatomy, Internal Medicine and Emergency Medicine, while Chemistry, Human Genetics and Gerontology had relatively low scores.

Question	Yes (%)
General information about e-learning at the medical schools
Do e-learning tools for the education of students exist at your medical school?	100 %
- predominantly mandatory	9.4 %
- predominantly optional	90.6 %
Is there a specific set of recommendations for the application of e-learning by your medical school from the academic board or deanery?	43.8 % *
Do they stipulate the use of a quality assurance code for your e-learning activities?
- If so, are these quality criteria designed to comply with the standards stipulated by the German Medical Association or similar (please see the PDF file attached for details)	48.4 %
	20.0 %
Is there a faculty-wide strategy for increasing the scope and quality of e-learning tools over the coming years in your medical school?	58.1 %
Do you take gender criteria into account when developing e-learning activities?	39.3 %
Do you wish more support from relevant discipline societies (GMA/GMDS etc.) and academic institutions or public agencies (DFG/BMBF/State Ministries) for the development of e-learning activities?	75.9 %

Concerning the impact of the presence of e-learning staff, a significant correlation could be shown for the existence of recommendations for the application of e-learning by a medical school (Table 1). Also, the evaluation of students on the subject of e-learning was performed significantly more often when e-learning staff was present (Table 2). There were also significantly higher implementation levels of the provided total amount of e-learning items (Fig. 1), as well as of the general existence of e-learning offers in the disciplines of medical schools (Fig. 2).

The survey presented here showed that e-learning has reached a high implantation level in the cluster of analyzed mid-European medical schools. However, the use of single tools and the distribution of e-learning offerings in individual disciplines were seen to be inhomogeneous among the institutions. The results also highlight that there is a potential for improvements regarding motivational incentives for the teaching staff which is dealing with the development and implementation of e-learning scenarios.

Concerning the level of e-learning implementation, it can be stated that all of the addressed schools did use e-learning proposals to some extent. E-learning is also established in its basic use as a means to offer support to classic teaching of face-to-face courses. Among these offers, non-collaborative formats (such as podcasts or lecture recordings) are predominantly used as mandatory supplements. Future developments should consist of an integration of mandatory collaborative e-learning tools as a holistic approach that includes digitally driven assessment-formats as well [23]. In this study, gender issues were taken into account for developing e-learning activities in general by less than half of the participating medical schools. The survey did not go into any details, for instance into the use of gender-neutral language, avoiding gender stereotypes or gender medicine as a topic itself.

Among such methods of teaching, many formats seem to be well-known and widely implemented, while tools that focus on online collaboration are less presented especially as mandatory didactic elements. As there can be found successful usage of these—like that of wiki—in the literature [24], it can be assumed that their implementation depends both on the familiarity of teachers with the tools as curricular implementation and instructional design of the course [25].

There was an inhomogeneous representation of e-learning offers for the single medical disciplines in this survey. However, the individual number of medical schools which provided offers was also inhomogeneous for every particular discipline, an observation which has already been reported e.g. for radiology [26]. The presented results suggest that there is a lower level of implementation in smaller disciplines, such as otorhinolaryngology or human genetics. Here, implemented examples of successful projects in small disciplines [27] can be seen as great potential for sharing successful formats between medical schools in the future.

Regarding infrastructure and staff, all participating medical schools had faculty members as responsible contact persons for e-learning matters. For the technological infrastructure it can be stated that LMS were firmly established, with open source platforms predominantly used by the majority of the participants [1]. It is remarkable that the majority of the medical schools observed here preferred an in-house open source model to outsourcing their LMS. Although the use of open source systems is related to altered in-house costs, this might be acceptable to realize a higher flexibility in customizing the systems to the medical school’s needs [28]. Consequently, it can be assumed that a high proportion of the named e-learning staff capacities are allocated to host the LMS. However, it could also be shown that the existence of e-learning staff is positively correlated with the presence of e-learning offers at a medical school. This stresses the use of employing personnel merely dedicated to managing a medical schools’ e-learning portfolio.

Teachers could make use of different programs for the development of contents in the context of their didactic teaching scenarios, depending on the medical school. The vast majority offer trainings or qualification programs for teachers. That this is important was also postulated by Cook and Triola as well as by Kowalczyk and Copley, who stressed the need for faculty development in the use of current tools and ongoing training in emerging technologies [29, 26].

Alongside existing infrastructural services, motivational incentives will be important to encourage especially clinical teachers to deal with the provision of e-learning offers, as this is often time and resource-intensive [30]. In the study presented here, less than one-third of the participating medical schools rewarded the creation or implementation of e-learning tools/courses, and less than one fifth awarded funds or prizes for tasks undertaken in the field of e-learning. A further problematic aspect was that an evaluation of opinions, attitudes and experiences of teachers who are involved in the development of e-learning seems rarely to be taken into account [6]. Although a small proportion of participating centers recognized the implementation of e-learning activities as an additional achievement when looking at admission to a tenure scheme, a larger number planned to adopt their practices in this field—a promising approach, as already reported in the literature [31].

Quality assurance protocols for e-learning scenarios [16] were in place at only a handful of medical schools. As such a standardization is intended to ensure the maintenance of medical standards and the attainment of curricular learning goals [17], addressing this backlog would help to create certified e-learning tools which could be of use for a larger number of medical schools [27].

Altogether, the findings of this study can be seen as part of a detailed strategy of most of the medical schools to increase the scope and quality of their e-learning programs in the next years. Future challenges for a wide use and cooperation in e-learning aspects among medical schools can in fact build on the high willingness of the medical schools to use and exchange e-learning offerings of other universities when it comes to the education of students and also the training of teachers themselves. An interesting approach for the future might here be the development of a central—maybe even international—database of e-learning contents for medical schools, where an exchange or common use of data could take place [17, 27]. The majority of the faculties stated that professional societies, academic institutions or ministries should support the development of e-learning activities. Here, an inter-faculty discussion platform supported by these institutions could be helpful to answer many of the questions that the individual medical schools have in the field of e-learning—e.g. copyright or financial issues or the establishment of blended learning concepts.

Limitations of the validity of the present documentation which must be highlighted include the finding that responses were not collected from all of the medical schools addressed. Therefore, the results shown here provide insight into the current status of the field of e-learning but cannot be used for definitive statements. This could also contribute to a bias that potential regulatory differences in curricular uses of e-learning between individual countries and federal states were not captured by this survey. In addition, the option of leaving certain questions blank meant that there was variation in the numbers of answers collected. Also, the faculty positions of the addressees were seen to be inhomogeneous, and this may have influenced their understanding and perceptions as a confounding variable in answering the questions. Finally, the questions used can only provide a brief representation of the different situations in individual disciplines at the various universities.

As this evaluation focused only on the status and e-learning supporting strategies at mid-European medical schools, in future studies the focus of analysis should be expanded to meet the conditions in more countries and regions of the world.

This survey shows that e-learning has gained a firm place in the curricula of those mid-European medical schools addressed. Many institutions have grasped the potential and value of a good infrastructure in this field. However, the distribution and promotion of e-learning is inhomogeneous. Also, teachers’ commitments should be given a better incentive. Aims for the next years should include fostering a network with a constant dialog between the medical schools for addressing common problems, and development of a database with different quality-tested tools that can be accessed on-demand by all schools. This survey should be repeated to document further developments and even extended internationally to compare more countries and to discover potential for future cooperation.