This article has Open Peer Review reports available.
Content and discontent: a qualitative exploration of obstacles to elearning engagement in medical students
© The Author(s). 2016
Received: 25 March 2016
Accepted: 14 July 2016
Published: 22 July 2016
Elearning is ubiquitous in healthcare professions education. Its equivalence to ‘traditional’ educational delivery methods is well established. There is a research imperative to clarify when and how to use elearning most effectively to mitigate the potential of it becoming merely a ‘disruptive technology.’ Research has begun to broadly identify challenges encountered by elearning users. In this study, we explore in depth the perceived obstacles to elearning engagement amongst medical students. Sensitising concepts of achievement emotions and the cognitive demands of multi-tasking highlight why students’ deeply emotional responses to elearning may be so important in their learning.
This study used focus groups as a data collection tool. A purposeful sample of 31 participated. Iterative data gathering and analysis phases employed a constant comparative approach to generate themes firmly grounded in participant experience.
Key themes that emerged from the data included a sense of injustice, passivity and a feeling of being ‘lost at sea’. The actual content of the elearning resource provided important context.
The identified themes have strong emotional foundations. These responses, interpreted through the lens of achievement emotions, have not previously been described. Appreciation of their importance is of benefit to educators involved in curriculum development or delivery.
Elearning, computer based learning, technology-enhanced learning…. irrespective of fashionable terminology, technology is an intrinsic feature of healthcare professions education . Ellaway’s simple definition of elearning as, “a loosely defined amalgam of information communication technologies (ICTs) used in education, usually but not exclusively mediated in some way through the internet’  remains relevant in a rapidly changing technological environment . Its non-inferiority to ‘traditional’ educational methods has been largely accepted for many years in both healthcare  and wider educational domains . Elearning’s potential for flexibility, scalability, and engaging learners offers a myriad of opportunities for educators [6, 7]. Elearning has perhaps been viewed as a panacea to some of the challenges (such as increasing student numbers and financial costs) of educating the next generation of healthcare professionals, rather than a learning enhancement opportunity.
Opportunities have inherent risk. Research has established that transposing from one medium (traditional taught courses) to a ‘trendy new one’ (a variety of elearning platforms) may be pedagogically deficient . Existing literature also describes broad categories of obstacles to engaging with elearning, largely relating to practical and technical difficulties around access, quality concerns and a lack of support [9–11]. Learner experience, however, remains relatively unexplored.
Pragmatic acceptance of the fact that elearning is ‘part of the current educational landscape’ should direct research efforts to focus on ‘when’ and ‘how’ to use it most effectively [12, 13]. In other words, clarification research is required [6, 14, 15]. Our study addresses this clarification agenda, aiming to shed light on why elearning might be challenging at the level of the learner. We identified a need for a rigorously conducted exploratory study to probe this further. The research question was to explore students’ perceived obstacles to engaging with elearning.
We chose a qualitative approach, given the exploratory nature of our research question. We used a rigorous form of thematic analysis informed by principles of grounded theory . This inductive approach generated a rich understanding, firmly grounded in participant experience. Ethical approval for this study was obtained from the Queen’s University Belfast (QUB) School Joint Research Ethics Committee. The Consolidated Criteria for Reporting Qualitative Research (COREQ) provide a focus for describing our approach and reporting our findings .
Number of Participants
Graduate Entry Students
KM and CT are faculty staff, who had previously conducted digital evaluations regarding student elearning experiences. Familiarisation with these responses provided sensitising concepts for development of an initial topic guide. This was piloted to ensure ease of understanding and designed to allow participants to follow a chronological narrative of their experiences.
HR conducted the focus groups. At the time of data collection she was a postgraduate researcher with no prior relationship with any participant. She had completed an intensive 2 day course on qualitative interviewing techniques prior to study commencement. Although a qualified clinician, participants did not know her in this context nor would they associate her with ‘university authorities’.
We selected focus groups as the data collection tool rather than individual interviews with the aim of explicitly utilising group interaction as part of the method. Focus group interviews were semi-structured. In keeping with principles of grounded theory, the initial topic guide was developed iteratively over the course of data collection, guided by previous participant responses. An example topic guide is available (Additional file 1). By encouraging participants to question each other and exchange anecdotes and experiences, we explored the full range of participant perspectives, and were able to probe more deeply to challenge their expressed views . Focus groups took place in a private but informal space on campus. Sessions ranged in duration from 28 to 38 mn and an observer was present during two of the sessions. Both interviewer and observer made some brief field notes. These, together with HR’s fieldwork notebook enabled reflection on practicalities of conducting the focus groups and provided notes on interactions which were considered in conjunction with the relevant transcripts. Focus groups were audio recorded, anonymised and transcribed by HR.
Recruitment cycles took place at 6 week intervals, with parallel data transcription and analysis as advocated by Corbin and Strauss . This allowed recruitment to continue until data saturation was reached; by this we mean that no new concepts or themes pertaining to perceived obstacles to elearning engagement were being identified in the data. Two members of the research team (HR and KM) independently assessed and agreed on saturation point.
Our analysis aimed to generate key themes firmly grounded in participant experience. Analysis was an inductive process, with no ‘a priori’ theoretical assumptions. Analysis was an immersive process with early analytical thoughts (collated as written ‘memos’) developed from the point of data collection. HR and KM independently and inductively coded the transcript of the first focus group. We refer to a ‘code’ as a label for a section of data relating to a particular idea. NVivo software (version 9 QSR International (UK) Limited) facilitated storage, retrieval and organisation of coded data. HR and KM met after the independent coding of the initial transcript to discuss and agree on a ‘codebook’ to facilitate further analysis. Coding and grouping of codes into categories was an iterative process and further codes were added as data collection progressed. Development of categories into themes was an evolving and non-linear process. Theme derivation, though inevitably influenced by the published literature, always aimed to be grounded in the data. No particular theoretical assumptions sensitised the approach to these data. Data coded within one category was explored and similarities and contradictions searched for among other categories. The process continued until the research team felt that the themes encapsulated the breadth and depth of participant experience. A participant checking exercise was carried out with consenting participants provided with a summary of themes and feedback being invited.
‘Quite daunting wasn’t it? You were just given this massive eh, load of lectures and told, “right, you’re not going to be taught on it, but you’re going to be examined on it, so off you go.”’ (FG1M1)
‘Our consultant used to call it the £3500 [annual tuition fee] DVD’ (FG3M5)
‘I found things very very frustrating, basically like you went into third year and an introductory week of lectures, and they hand you this DVD, give you these placements, and are like, “there you go, go learn what you need for the year.” And then we’ll see you in June and examine you.’ (FG1M3)
‘It’s just I don’t, I mean at the end of the day, when I did my exam, I realised that it was a waste of time, and it annoyed me.’ (FG1F3)
‘I grew to hate it more and more as the year went on, when you realised how vast it was and the things you just didn’t think you needed to know.’ (FG3F4)
‘Sometimes you just wanted to you know, snap [the DVD] in two.’ (FG3F3)
‘The fact that it’s not compulsory for you to go home and do it every night like, you can just leave it and then let it all gather up.’ (FG1M3)
‘Yeah, if you don’t have like lectures and stuff to go to it is very easy to stow away and forget about it.’ (FG2F7)
‘I think just the fact that you can just leave it for ages, and then all that people think you have to do is just watch like ten lectures per night, but I think…no, but like you can’t do that.’ (FG2F2)
‘Like it was just sort of there in the background, so I could tick it off, but…’ (FG2F4)
‘I mean, there is no contact with anyone during the year.’ (FG1M2)
‘It’s quite a solitary thing as well.’ (FG1F3)
‘I’d be on the internet for other things, so it might just be up there in a different window.’ (FG2F 5)
‘A lot of the time you’re just sitting staring at the screen thinking when is this going to end (laughter) looking at the timer and going… (laughter)’ (FG1M2)
Thus passivity goes beyond a lack of compulsion to engage with the material and beyond distractions. There is a sense that the elearning was somehow ‘washing over’ participants. They were aware of and were exposing themselves to the content, but they did not feel actively engaged, constructing themselves as passive recipients. Furthermore, their resentment towards the material at times resulted in active disengagement.
Lost at Sea
‘You were constantly thinking, “I have so much left to do.”’ (FG1M1)
‘It was overwhelming when you had the checklist and you’re looking at all the lectures and you’re like, “oh my goodness, how am I supposed to get through all these?”’ (FG3F3)
‘There was no kind of guidelines as to you should have this much done by such and such a time, or this much done by this but I suppose it’s hard to do that, with people doing different things and different circumstances.’ (FG2M1)
‘Telling us maybe that, that not everything is examinable, that, you know there are specific parts, and to point us to them is probably what would have been to the best advantage.’ (FG1M1)
Variability in length, format and quality (of production and content) of different components of the elearning resource was interpreted as an obstacle by some participants. This contributed further to a feeling of being lost in that they found structuring their learning and allocating study time challenging.
This investigation was part of a larger programme of work, and it should be recognised that there are many different perspectives on elearning. While this study was about identifying problematic issues, we are aware that many students engage positively with elearning.
In recent years students have become accustomed to high fidelity images and production quality through the use of sophisticated gaming and social media platforms. It would be unrealistic for medical schools to attempt to compete in terms of production quality. Indeed, we know broadly that students will accept ‘good enough’ quality. Inaudible sections (such as the speaker ‘drifting off into nothingness’ as related by one of our participants) will, however, inevitably evoke student discontent. A balance needs to be struck with technical and production quality of a realistic but acceptable standard. There are many practical measures that teams can take in terms of considering aesthetic appeal of learning resources . Educators must, however, compete with other resources in terms of quality of content. This must be factually correct and reflect relevant recent developments in order to maintain credibility with students.
We know that today’s students are immersed in a technologically rich environment . Potential distractors are ubiquitous and ‘multitasking’ may well affect learning . There is a need, however, to accept and even embrace such environmental and cultural influences . It is a task for educators to work with this challenge, rather than against it. Student frustration with elearning is multifactorial and may be brought about by a combination of difficulties with learning content and responses to potential distractors. It does, however, necessitate acknowledgement that it constitutes an emotional response to a learning activity.
Published studies of elearning interventions describe obstacles in terms of content of the resources, social isolation and unfamiliarity with the approach [9–11]. In our study, students described strong emotional responses to elearning material. ‘Injustice’ and ‘passivity’ are powerfully emotive words. Our explorative study inductively found that students experienced these strong emotions during their engagement with elearning material, and that in consequence their learning may have been impeded.
In recent years, there has been a resurgence of interest in the role of emotion across the breadth of educational scholarship and specifically within the health sphere . Academic performance is no longer solely conceptualised as a cognitive activity, relatively free from emotional and motivational considerations. Emotion is not easy to define. Artino has written extensively about emotion and its relevance to healthcare professions education [23, 24]. He defines emotion as, ‘an acute, intense, and typically brief psycho-physiological change that results from a response to a meaningful situation in an individual’s environment.’
Emotions influence cognitive resources [22, 25]. In considering why this might be, the concept of achievement emotions becomes important. In 2006 Pekrun describes these as, ‘emotions tied directly to achievement activities or achievement outcomes’ . Achievement activities encompass many tasks encountered by students in the health professions; working to understand a clinical problem, participating in a ward round, or listening to a lecture, which could be in traditional or elearning format. Thus the injustice (encapsulated by the study participants using terms such as ‘hate’ and ‘unfair’) and passivity (‘bored’, ‘frustrated’) directed towards the activity of engaging with an elearning resource are examples of negative achievement emotions. In general, positive achievement emotions, together with associated appraisals of control and value, are thought to exert adaptive effects on learning, such as use of deep processing strategies actively linking new information to existing knowledge . Negative achievement emotions would exert non-adaptive effects such as reverting to the use of superficial processing strategies, for example rote learning of facts .
Participants did indeed describe a checklist driven, rote learning approach to the material. Despite ‘great intentions’ of integrating their elearning ‘theory’ with real clinical encounters, there was evidence that they were not actually utilising such deep learning strategies. Students experienced negative emotional responses to the elearning, which was characterised as a low value resource over which they had little control. Negative emotional responses to educational technology in this setting caused students to adopt maladaptive learning strategies.
Control and value concepts of Pekrun’s achievement emotions framework  offer potentially useful insights that could aid educators. The intrinsic value placed by students on elearning resources could be increased by emphasising relevance to future professional practice. Perceptions of extrinsic worth could be challenged by making explicit links to assessment. Control appraisals relate largely to competence perceptions such as how confident an individual feels about a specific task . Where the students in our study were describing being ‘lost at sea’ in a large and poorly signposted resource, this could be interpreted as low level of individual control. Clearer signposting alongside appropriate and focussed training to develop students’ self-confidence with both elearning technology and a more self-directed approach to learning could ultimately influence academic outcomes in the broadest sense. The fact that students (especially school leavers) are ill prepared for independent learning is widely recognised [28, 29].
Strengths of this study
This study was developed to address a gap in the existing published literature. To the authors’ knowledge, this is the first study designed with the specific focused aim of exploring student obstacles to elearning in a health professions education setting. Results were developed through a highly inductive and reflexive process.
Limitations of this study
This research was contextually situated within one UK institution. Qualitative exploration, though not necessarily generalisable, was felt to be appropriate to our research question. By providing an account of the context of this elearning resource, we believe that findings are relevant and theoretically transferrable to others working in similar contexts within health professions education.
Directions of future research
This study explores student perceived obstacles to elearning. There are other stakeholders involved, from those more focused on the content such as educators, and those more focused on delivery such as developers. Future research could consider exploring their perspectives on obstacles to elearning engagement. Another consideration is that focusing on elearning in isolation is of limited value in today’s technological era. Research focusing on students as independent adult learners, rather than on the technology (which is here to stay and will develop faster than research into it) could be of more practical benefit.
Emotional obstacles described by students in response to elearning offer new insights into engagement challenges in environments rich in digital distractors. Injustice and passivity are negative achievement emotions experienced by students engaging with elearning, which mitigate against intended learning outcomes of the material. This may be a function of the proportion of curricular content represented electronically. Appreciation of the motivating and demotivating factors at play in how students interact with elearning will be of use to curriculum developers, educational technologists and any individuals seeking to enrich their educational offering with technology enhanced delivery.
DVD, digital versatile disk or digital video disk; FG(x)M/F(x), focus group (number) Male/female participant (number); HR/KM/CT, Helen Reid/Kieran McGlade/Clare Thomson; QUB, Queen’s University, Belfast; UK, United Kingdom
The research was supported by the Health and Social Care Board Research and Development Office (Northern Ireland) and the Northern Ireland Medical and Dental Training Agency through General Practice Academic Registrar Training Scheme.
Availability of data and materials
The dataset supporting the conclusions of this article is available in the the Zenodo repository https://zenodo.org/record/48249
HR and KM made substantial contributions to study conception and design, analysis and interpretation of data. CT contributed to contextualisation and interpretation of data.
HR drafted the manuscript and all three authors revised it critically on multiple occasions for intellectual content. All authors read and approved the final manuscript.
HR is a Postgraduate Research Student in the Centre for Medical Education. Her research interests include technology and assessment in health professions education. She practices clinically as a General Practitioner.
CT is an elearning developer within the School of Medicine, Dentistry & Biomedical Sciences. Her focus is on implementing technology within a learning environment to enhance the student experience. Particular interests include lecture flipping, student engagement and online identities.
KM is Senior Lecturer in General Practice and Lead for Technology Enhanced Learning in the undergraduate medical curriculum at Queen’s University, Belfast. He has a long standing interest in health informatics research and in particular the effective application of information technology in both the clinical and educational arenas.
The authors declare that they have no competing interests.
Consent for publication
Ethics approval and consent to participate
Ethical approval for this study was obtained from the Queen’s University Belfast (QUB) School Joint Research Ethics Committee (Ref QUB11/16v2). Research was conducted in accordance with the Declaration of Helsinki. Written consent was obtained from all participants prior to data collection.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Ellaway R, Masters K. AMEE Guide 32: e-Learning in medical education - Part 1: Learning, teaching and assessment. Med Teach. 2008;30(5):455–73.View ArticleGoogle Scholar
- Ellaway R. E-learning: is the revolution over? Med Teach. 2011;33(4):297–302.View ArticleGoogle Scholar
- Cook DA, Triola MM. What is the role of e-learning? Looking past the hype. Med Educ. 2014;48(9):930–7.View ArticleGoogle Scholar
- Cook DA, Levinson AJ, Garside S, Dupras DM, Erwin PJ, Montori VM. Internet-based learning in the health professions: a meta-analysis. JAMA. 2008;300(10):1181–96.View ArticleGoogle Scholar
- Tallent-Runnels MK, Thomas JA, Lan WY, Cooper S, Ahern TC, Shaw SM, Liu X. Teaching courses online: a review of the research. Rev Educ Res. 2006;76(1):93–135.View ArticleGoogle Scholar
- Dankbaar ME, de Jong PG. Technology for learning: how it has changed education. Perspect Med Educ. 2014;3(4):257–9.View ArticleGoogle Scholar
- Clark D. Psychological myths in e-learning. Med Teach. 2002;24(6):598–604.View ArticleGoogle Scholar
- Dror I, Schmidt P, O'connor L. A cognitive perspective on technology enhanced learning in medical training: great opportunities, pitfalls and challenges. Med Teach. 2011;33(4):291–6.View ArticleGoogle Scholar
- Childs S, Blenkinsopp E, Hall A, Walton G. Effective e-learning for health professionals and students--barriers and their solutions. A systematic review of the literature--findings from the HeXL project. Health Info Libr J. 2005;22 Suppl 2:20–32.View ArticleGoogle Scholar
- Docherty A, Sandhu H. Student-perceived barriers and facilitators to e-learning in continuing professional development in primary care. Educ Prim Care. 2006;17(4):343–53.Google Scholar
- Moule P, Ward R, Lockyer L. Nursing and healthcare students’ experiences and use of e-learning in higher education. J Adv Nurs. 2010;66:2785–95.View ArticleGoogle Scholar
- Cook DA. The failure of e-learning research to inform educational practice, and what we can do about it. Med Teach. 2009;31(2):158–62.View ArticleGoogle Scholar
- Ellaway R. Apples and architraves: a descriptive framework for e-learning research. Med Teach. 2010;32(1):95–7.View ArticleGoogle Scholar
- Davies P, Kent G, Laurillard D, Lieben C, Mavrikis M, Noss R, Price S, Pratt D: Royal Society Vision Project : the impact of technological change on STEM education. Royal Society 2013. https://royalsociety.org/~/media/education/policy/vision/reports/ev-6-vision-research-report-20140624.pdf?la=en-GB Accessed 20 Jul 2016.
- Triola MM, Huwendiek S, Levinson AJ, Cook DA. New directions in e-learning research in health professions education: report of two symposia. Med Teach. 2012;34(1):e15–20.View ArticleGoogle Scholar
- Corbin JM, Strauss A. Grounded theory research: procedures, canons, and evaluative criteria. Qual Sociol. 1990;13(1):3–21.View ArticleGoogle Scholar
- Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care. 2007;19(6):349–57.View ArticleGoogle Scholar
- Robson C: Chapter 11. Interviews and Focus Groups. In Real World Research. 3rd edition. Wiley; 2011:278-278-301. http://eu.wiley.com/WileyCDA/WileyTitle/productCd-1118531507.html.
- Roberts DH, Newman LR, Schwartzstein RM. Twelve tips for facilitating Millennials’ learning. Med Teach. 2012;34(4):274–8.View ArticleGoogle Scholar
- Conole G, de Laat M, Dillon T, Darby J. ‘Disruptive technologies’, ‘pedagogical innovation’: What’s new? Findings from an in-depth study of students’ use and perception of technology. Comput Educ. 2008;50(2):511–24.View ArticleGoogle Scholar
- Wood E, Zivcakova L, Gentile P, Archer K, De Pasquale D, Nosko A. Examining the impact of off-task multi-tasking with technology on real-time classroom learning. Comput Educ. 2012;58(1):365–74.View ArticleGoogle Scholar
- McConnell MM, Eva KW. The role of emotion in the learning and transfer of clinical skills and knowledge. Acad Med. 2012;87(10):1316–22.View ArticleGoogle Scholar
- Artino Jr AR. When I say…emotion in medical education. Med Educ. 2013;47(11):1062–3.View ArticleGoogle Scholar
- Artino Jr AR, Durning SJ. It’s time to explore the role of emotion in medical students’ learning. Acad Med. 2011;86(3):275. author reply 275–6.View ArticleGoogle Scholar
- LeBlanc VR, McConnell MM, Monteiro SD. Predictable chaos: a review of the effects of emotions on attention, memory and decision making. Adv Health Sci Educ Theory Pract. 2015;20(1):265–82.View ArticleGoogle Scholar
- Pekrun R. The control-value theory of achievement emotions: assumptions, corollaries, and implications for educational research and practice. Educ Psychol Rev. 2006;18:315–41.View ArticleGoogle Scholar
- Artino Jr AR, Holmboe ES, Durning SJ. Control-value theory: using achievement emotions to improve understanding of motivation, learning, and performance in medical education: AMEE Guide No. 64. Med Teach. 2012;34(3):e148–60.View ArticleGoogle Scholar
- Murtagh L. They give us homework! transition to higher education: the case of initial teacher training. J Furth High Educ. 2010;34(3):405–18.View ArticleGoogle Scholar
- Smith K, Hopkins C. Great expectations: sixth-formers’ perceptions of teaching and learning in degree-level english. Arts and Humanities in Higher Educ. 2005;4(3):304–18.View ArticleGoogle Scholar