We’re sorry, something doesn't seem to be working properly.
Please try refreshing the page. If that doesn't work, please contact support so we can address the problem.
E-learning for self-management support: introducing blended learning for graduate students – a cohort study
BMC Medical Educationvolume 18, Article number: 219 (2018)
E-learning allows delivery of education in many diverse settings and researchers have demonstrated it can be as effective as learning conducted in traditional face-to-face settings. However, there are particular practices and skills needed in the area of providing patient self-management support (SMS), that may not be achievable online. The aim of this study was to compare three approaches in the training of university students regarding the preparation of a Chronic Condition Self-Management Care Plan: 1) traditional face-to-face delivery of SMS training, 2) an e-learning approach and 3) a blended approach (combining e-learning and face-to-face teaching).
Graduate entry physiotherapy students and medical students at Flinders University were recruited. Depending on the cohort, students were either exposed to traditional face-to-face training, e-learning or a blended model. Outcomes were compared between the three groups. We measured adherence to care plan processes in the preparation of an assessment piece using the Flinders Program Chronic Care Self Management tools. A total of 183 care plans were included (102 traditional, 52 blended, 29 e-learning,). All students submitted the Flinders Program Chronic Care Plan for university assessment and these were later assessed for quality by researchers. The submission was also assigned a consumer engagement score and a global competence score as these are integral to successful delivery of SMS and represent the patient perspective.
The blended group performed significantly better than the traditional group in quality use of the Flinders Program tools: Problem and Goals (P < 0.0001). They also performed significantly better in the total care plan score (P < 0.0001) and engagement score (P < 0.0001). There was no significant difference between the groups for the Partners in Health tool.
In this pilot study, the blended learning model was a more effective method for teaching self-management skills than the traditional group, as assessed in the development of a chronic condition self-management care plan. We anticipate that future research with identical groups of students would yield similar results but in the meantime, academics can have confidence that blended learning is at least as effective as traditional learning methods.
Education for medical and allied health students has undergone significant changes. In particular, advances have been made in both technologies available for education and in the ability of students to navigate new technology. The utilisation of such technology can overcome barriers to learning such as geographical isolation and limited specialist training staff, whilst providing a standardization of experience . One of the technologies is e-learning. E-learning is the delivery of education through Information and Communication Technology (ITC) using a wide variety of instructional designs and formats, and includes both synchronous (real time, e.g., videoconferencing) and asynchronous (self-paced) learning. Many things can constitute e-learning, including CD-ROMs, discussion boards, virtual patients and webinars. Central to the definition is the use of the Internet and computer to deliver information and interact with the learner, to partly replace the human instructor. Importantly, e-learning does not rely on a human instructor being present at the time that the student is learning .
There has been much research around the implementation of physical simulations for medical and allied health students with the emergence of digital simulation technologies enabling learners to see, interact and learn in representations of scenarios that were previously impossible . There is a growing body of evidence to suggest that clinical skills acquired in medical simulation laboratory settings transfer directly to improved patient care practices and better patient outcomes [4, 5]. However, there are limited studies on the effectiveness of e-learning outside the area of clinical and procedural skills acquisition, for example, chronic condition self-management support and other contexts that aim to develop the learner’s person-centered care skills [6,7,8,9]. The use of e-learning in such areas may be challenging.
Chronic disease affects many people throughout their lives, and yet they spend less than 1% of their life within the healthcare system with the rest spent living with the realities of chronic disease on a daily basis . Educating and supporting patients’ mastery of self-management skills can lead to significant improvement in health . In self-management, patients are encouraged to partner with health professionals and other supports to assess their healthcare needs and carry out the needed tasks for managing their chronic conditions. Self-management has been defined as ‘the individual’s ability to manage the symptoms, treatment, physical and psychosocial consequences and lifestyle changes inherent in living with a chronic condition’ . It requires patients to have a specific set of skills around ongoing assessment and awareness, goal setting and problem solving [12, 13]. However, it may be difficult for patients to achieve alone and they may benefit from self-management support (SMS) provided by others (e.g., health professionals, family, carers). SMS includes the provision of education and information to improve health literacy, practical support, goal setting and achievement but also includes holistic support from service providers, family and friends.
The provision of SMS by health professionals requires effective training and education, particularly the development of effective communication and person-centered skills to facilitate engagement and behaviour change. Lawn et al. (2017) argue that training provided to these health professionals is best conducted with formats that maximise the uptake of these skills and suggest mediums involving significant experiential learning, practice, critical reflection and feedback would be appropriate . They suggest that while evidence for effectiveness of e-learning is growing, it is unclear which e-learning instructional designs and formats are best for teaching the skills necessary for working with patients with chronic care needs.
Lawn et al., (2017) conducted an integrative review of e-learning in the delivery of SMS training for health professionals. Overall, they found that few of the e-learning approaches reviewed provide the high levels of interactivity, reflection, practice and application required for health professionals to learn SMS . Given that chronic care requires the development of partnerships and person-centred care, they suggest that improved results could be achieved by using a blended model that combines e-learning and face-to-face teaching.
To date, only one study exists that has demonstrated web-based SMS training for health professionals which was both feasible and able to positively support patient self- management. Yank et al., (2013) provided self-management training via four Webinars to 57 primary care residents and providers across the United States. This webinar was given on a weekly basis. Between sessions participants applied the learned techniques to clinical patients. Both participants and residents showed positive results regarding the webinar in their attitude: the residents demonstrated positive changes on all belief questions (P 0.001–0.012), and all participants demonstrated significant increases on confidence questions regarding their ability to support self-management (P < 0.01). However, this study did not look at behavioural changes.
To help address this knowledge gap, the current pilot study aimed to compare traditional, e-learning and blended self-management training programs for future health professionals.
The aim of this study was to compare traditional face-to-face delivery of SMS training with both an e-learning approach and a blended approach in the training of university students regarding the preparation of a Chronic Condition Self-Management Care Plan.
Participants were students in the Flinders University Graduate Entry Medical Program (GEMP) in Adelaide and Darwin (3000 kms from Adelaide) and the Master of Physiotherapy program (MPT) in Adelaide. The participants were all students who had not previously received formal SMS training in their postgraduate courses. Both programs are graduate entry with students coming from a wide variety of backgrounds. All students were in the second year of study, with the GEMP and MPT programs being 4 and 2 years long, respectively and all students studying these courses were included. All groups had completed a clinical placement but the MPT in the blended group were in their final year of study.
This program teaches a structured assessment approach, using processes and tools that explore self-management skills in partnership with patients, leading to the formulation of a self-management care plan (Table 1).
All GEMP students based in Adelaide received the traditional face-to-face delivery method, those based in Darwin received the e-learning delivery and the MPT students received a blended program (Table 2). The material was presented to the students either face-to-face by an academic in a traditional lecture theatre format of 3 h duration or via access to an online module. This online module was either accessed as a group with a supervisor present by the e-learning group, or independently in the blended group. All groups then role-played different scenarios; the GEMP students conducted the role plays in student pairs while the blended MPT group role played with volunteer patients who were able to provide ad-hoc informal feedback, from their experience as patients.
After delivery of the content and completion of a role-playing session, a feedback session was conducted either in a 3 h lecture style format with the academic being present for the traditional and blended groups, or via videoconference with the academic for the e-learning group. This feedback session provided students with the opportunity to reconcile their knowledge of providing SMS. It was an opportunity to address any questions from the students and ensure that the students understood the assessment task. The volunteer patients were not present for this feedback session and the same academic performed the feedback session for all three groups.
For their assessment, students utilized the Flinders model together with a patient.
Students then had to submit the set of Flinders tools used in care planning along with a completed care plan for assessment. For the GEMP students, the care plan was assessed on a non-graded pass or fail basis, whereas for the MPT students it was a graded assessment that included a self-reflection on the Flinders Program process.
Data collection and scoring
Scoring the patient-centered care plan assessed students’ competency in adherence to effective care plan processes. The care plans were graded according to a rubric (Table 3). The grid was determined with external expert input by a team with considerable experience in care plan processes. It was drawn from a framework routinely used to determine competence for students and health professionals undertaking Flinders Program training in Australia and overseas.
All care plans were de-identified and assigned a coding to distinguish the groups. All researchers were blinded to the group of the care plan. A single researcher trained in the correct development of the care plan but not involved in the delivery of the course scored the care plans. Scores were assigned to submitted care plans in each group, which often represented 2 students working in pairs. Scores were assigned for each section (see Table 3); the maximum score for the Partners in Health scale was 2, for the Cue and Response Interview was 16, the Problems and Goals was 34 and Care Plan was 20. Total score was a maximum of 72 points.
Two additional researchers independently graded the care plans for other important features that demonstrated effective care plan processes. One of these researchers (an accredited trainer in the use of the Flinders Program tools and consumer advocate) assigned an engagement score. This engagement score (out of 8) reflected the consumer perspective with 1 representing poor perceived engagement with the patient and 8 representing excellent perceived engagement. The other researcher (also accredited trainer in the use of the Flinders Program tools) assigned a global competence score that reflected the health professional perspective and perceived overall competence of the student (out of 8).
Correlation between outcome measures
We examined the correlation between the scores obtained from the Flinders Care Plan, the engagement score and the global score across the three delivery methods. This was done to determine if there was internal consistency between the three different methods of grading the students’ Care Plans. The correlation matrix shows a highly significant relationship (r = 0.38–0.43, P < 0.0001) between all three scores (Table 4) indicating internal validity in scores assigned for each measure. The rho suggests a weak-moderate correlation, which is expected as each score assesses different attributes of the care planning process.
Statistical analyses were performed using SPSS Statistics version 19 (IBM, Armonk, USA). Since we found that the data displayed approximate normal distributions, it was tenable to use parametric tests (multivariate analysis of variance with the LSD post-hoc test if overall between-subject effects was < 0.001 and Pearson Correlation coefficients). A type 1 error rate of alpha = 0.01 was used in all analyses to test for statistical significance due to multiple testing with the LSD test and reduce the likelihood of type 1 error.
Differences between groups for outcome measures
Between-group analyses were conducted for each of the care plan domains (Table 5). The group that received a blended model of training (group B) had a significantly higher score for Problem and Goals (P < 0.0001), Care Plan (P < 0.0001), Total score (P < 0.0001), and engagement score (P < 0.0001) compared to the traditional face-to-face group (group A). There were no significant differences between the blended (group B) and the e-learning group (group C) across any of the domains. There was a significant difference for engagement score between the traditional face-to-face (group A) and e-learning group (group C) (P = 0.005), with the e-learning group (group C) scoring significantly higher; the other domains were not significantly different.
We report on the first study to compare the effect of traditional face-to-face, e-learning and blended learning in Self-Management Support (SMS) training. SMS requires particular skills surrounding patient-centered care and communication. It was unclear whether the use of online modules would facilitate the development of these particular skills sets, which are traditionally taught face-to-face. Our results, however, have demonstrated that the e-learning module can enable participants’ learning with the advantage that educational programs are not constrained by the need to provide face-to-face teaching for the module delivery.
The findings showed a magnitude of difference between groups in favour of the blended learning group. Blended learning combines online learning components with face-to-face learning and practice. While the experience of developing e-learning was relatively new in the teaching unit, the study results revealed that the program was feasible and enhanced effectiveness.
SMS requires a particular set of skills surrounding communication and being patient centered  and there is limited evidence for the effectiveness of e-learning when teaching person-centered skills. A recent integrative review found that it was unclear whether online modules would be useful in this field . However the results of this study are supported by the findings of a recent large meta-analysis by the United States Department of Education, which concluded that blended learning was significantly more effective than face-to-face or online courses . This review was of education generally, not specifically in the area of SMS but it has applicability. The authors caution that the results do not suggest that online learning is superior as a medium but that the advantages of blended learning that leads to superior learning are due to a combination of elements in the teaching conditions (which likely include additional learning time and materials, as well as opportunities for collaboration).
Constructivist learning principles highlight how students create their own meaning of knowledge  and this is enabled by blended learning where students are more able to self regulate and to have more control of their learning . One of the reasons blended courses are significantly more effective than completely face-to-face or online courses in education generally, is that students feel more prepared for classroom activities due to the greater opportunity to reflect and review the material online . Welch et al. stressed that it was important to include opportunities to practice face-to-face following online training for motivational interviewing . They found that when nurses completed a web-based learning module in preparation for context-based skills training, there was a significant increase in knowledge scores, combined with strong positive attitudes prior to and following the module.
A recent review by Lawn et al., 2017 found that while e-learning has many benefits, complete online delivery of SMS poses some problems with regards to the need to work with patients in training. This review identified the need for practice and application opportunities, plus time for reflection to be built into the learning process. Other studies have found that some chronic conditions require face-to-face delivery to demonstrate and practice SMS skills . The use of a blended approach in this study allowed for learners to access material and process material in their own time, which was then followed up with direct person training. This follows the Knowledge- Process-Practice model proposed by Shaw et al., 2015 to ensure behaviourist and cognitivist requirements of education are met within the content of e-learning materials .
The rurally located GEMP students received their teaching via e-learning. This group was small (n = 29); therefore it is difficult to make extrapolations, however they had a significantly higher engagement score (P = 0.005) compared to the traditional group. Similarly, while not significant at the P = 0.01 level, they scored better in each of the other domains compared to the face-to-face control group. This was not an anticipated result because previous researchers have suggested that e-learning might be a less appropriate teaching medium for learners to acquire complex emotional skills such as those required in SMS. However, active engagement and participation seems to be the key factor for successful learning . It is possible that these students in a rural context, although more isolated, had a more supportive network with particular implications for the development of the care plans.
The majority of studies evaluating the use of the Internet for medical education have also included evaluation on the satisfaction of participants . While this is an important concern as the Internet grows as a medium for education, it is initially necessary to determine if such systems are effective ways to enhance practice. In the current study, we did not measure the students’ satisfaction but examined if implementation of e-learning could be used in the training of students in SMS for successful skill development for improved patient care, with subsequent studies required to determine participant satisfaction.
In the current study, assessment was graded using several scores measuring different aspects of the Flinders Program. These scores looked at adherence to care plan processes for each of the Flinders Program tools and also scores of consumer engagement and global competency. The results for these scores were correlated, showing agreement between the quality of the submitted work and ratings for being patient-centred and demonstrating active engagement with the material. In our study, comparing traditional face-to-face, blended and e-learning in the delivery of content and skills for providing SMS to patients, the students in the blended group demonstrated the greatest ability to provide SMS in chronic care self-management across all scores: care plan development, engagement and global score. Future studies are required, with more identical groups, to determine which aspects of SMS are best taught online and to determine the student opinion on such a teaching format.
Our study has several potential limitations. Firstly, the three groups were not identical in clinical or educational experience. While all students were post-graduate health professional trainees in the second year of their post-graduate qualification, they differed in that the MPT students were in the final year of their qualification and hence were already working at a junior health professional level in their clinical placements while the medical students had only just started clinical placements, with two more years of their degree to be done. Additionally, as postgraduate students, their previous work, life and study experiences were varied and diverse and we did not formally assess the baseline level of participants’ exposure to SMS training to determine if this was significant or not. Secondly, the expectations of assessment tasks were not identical for each group; although the assignment was compulsory for all groups, the MPT group’s assessment was formally graded and inclusive of a self-reflective component, while the other two groups received a non-graded pass, which may have influenced the effort given to the assessment. However, while the care plan was assessed on a pass/fail basis for the medical students, the end of year practical examination (OSCE) included one station based on the Flinders Program, therefore there was still an assessment-based incentive for all students surrounding the learning of SMS, but not the Care Plan assessment piece used for this study. Thirdly, the scoring itself was not externally validated by another assessor but was completed by a single investigator blinded to the cohort; however, two independent trainers provided a global competence score for each care plan (one trainer provided the consumer score and one provided the engagement score) and these scores all correlated. Fourthly, a major limitation with this study is that the blended group had access to the online study modules, therefore were potentially able to spend more time learning the subject. Fifthly, the blended students practised with volunteer patients while the other students practised on each other, which may have resulted in some learning differences. However, all students were required to undertake complement of the Care Plan with an actual patient. Finally, this study did not assess the patient’s perspective of engagement, which is an essential part of the Flinders Program. While a proxy score was assigned by one of the assessors, a score from the actual patients’ interview may have yielded different results.
This pilot study, utilized two different groups of students, to determine if a blended teaching format could be used to implement the delivery of SMS for the skills taught in the Flinders Program of chronic care. The findings suggest that a blended teaching format can be utilized with the confidence that it is at least as effective as the traditional face-to-face medium.
There are a number of recognised resource-based advantages for e-learning such as time and travel costs and classroom-learner-staff availability. However, other advantages, such as the ability to be self-paced and traceable, catering to different learning styles and allowing the learner to review as needed are also of benefit to the learner. A teaching format that allows for reflection and then practice may be a more successful tool than traditional face-to-face teaching in SMS. The delivery of SMS education using a blended approach provided students with the time to reflect on the material as well as opportunities for active engagement and ultimately successful preparation of a care plan utilising the Flinders Program. Studies are also required to determine how the delivery of SMS training affects the patient perspective.
Graduate entry medical program
Information and communication technology
Master of physiotherapy
Partners in health
Specific, measurable, achievable, realistic and timely
Quail M, Brundage SB, Spitalnick J, Allen PJ, Beilby J. Student self-reported communication skills, knowledge and confidence across standardised patient, virtual and traditional clinical learning environments. BMC Med Educ. 2016;16:73.
Cook DA, Levinson AJ, Garside S, Dupras DM, Erwin PJ. Internet-based learning in the health professions: a meta-analysis. JAMA. 2008;300:1181–96.
Makransky G, Bonde MT, Wulff JSG, Wandall J, Hood M, Creed PA, et al. Simulation based virtual learning environment in medical genetics counseling: an example of bridging the gap between theory and practice in medical education. BMC Med Educ. 2016;16:98.
Seymour NE, Gallagher AG, Roman SA, O’Brien MK, Bansal VK, Andersen DK, et al. Virtual reality training improves operating room performance. Ann Surg. 2002;236:458–64.
McGaghie WC, Issenberg SB, Cohen ER, Barsuk JH, Wayne DB. Does simulation-based medical education with deliberate practice yield better results than traditional clinical education? A meta-analytic comparative review of the evidence. Acad. Med. J. Assoc. Am. Med. Coll. 2011;86:706–11.
Ruiz JG, Mintzer MJ, Leipzig RM. The impact of E-learning in medical education. Acad Med J Assoc Am Med Coll. 2006;81:207–12.
Stacey D, Green E, Ballantyne B, Tarasuk J, Skrutkowski M, Carley M, et al. Implementation of symptom protocols for nurses providing telephone-based Cancer symptom management: a comparative case study. Worldviews Evid. Based Nurs. 2016;13:420–31.
Bosnic-Anticevich SZ, Stuart M, Mackson J, Cvetkovski B, Sainsbury E, Armour C, et al. Development and evaluation of an innovative model of inter-professional education focused on asthma medication use. BMC Med Educ. 2014;14:72.
Newton JM, Falkingham L, Clearihan L. Better knowledge, better health: piloting an education intervention in chronic condition self-management support. Aust J Prim Health. 2011;17:4–9.
Yank V, Laurent D, Plant K, Lorig K. Web-based self-management support training for health professionals: a pilot study. Patient Educ Couns. 2013;90:29–37.
Barlow J, Wright C, Sheasby J, Turner A, Hainsworth J. Self-management approaches for people with chronic conditions: a review. Patient Educ Couns. 2002;48:177–87.
Bodenheimer T, Lorig K, Holman H, Grumbach K. Patient self-management of chronic disease in primary care. JAMA. 2002;288:2469–75.
Lorig KR, Ritter P, Stewart AL, Sobel DS, Brown BW, Bandura A, et al. Chronic disease self-management program: 2-year health status and health care utilization outcomes. Med Care. 2001;39:1217–23.
Lawn S, Zhi X, Morello A. An integrative review of e-learning in the delivery of self-management support training for health professionals. BMC Med. Educ. [Internet]. 2017;17:183 [cited 2017 Nov 22] Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5634849/.
Battersby M, Harris M, Smith D, Reed R, Woodman R. A pragmatic randomized controlled trial of the Flinders program of chronic condition management in community health care services. Patient Educ Couns. 2015;98:1367–75.
Battersby M, Harvey P, Mills PD, Kalucy E, Pols RG, Frith PA, et al. SA HealthPlus: a controlled trial of a statewide application of a generic model of chronic illness care. Milbank Q. 2007;85:37–67.
The Flinders Chronic Condition Management Program [Internet]. 2012 [cited 2017 May 1]. Available from: http://www.aachonline.org/dnn/Portals/36/Flinders%20Project/Flinders%20Program%20Information%20Paper_M.pdf
Lawn S, Battersby M, Lindner H, Mathews R, Morris S, Wells L, et al. What skills do primary health care professionals need to provide effective self-management support? Seeking consumer perspectives. Aust. J. Prim. Health. 2009;15:37–44.
Evaluation of Evidence- Based Practices in Online Learning: A Meta-Analysis and Review of Online Learning Studies. [Internet]. U.S. Department of Education; [cited 2017 Oct 1]. Available from: https://www2.ed.gov/rschstat/eval/ tech/evidence-based-practices/finalreport.pdf.
Gillani B, O’Guinn C. Cognitive theories and the design of e-learning environments. In: Hovenga E, Mantas J, editors. Glob. Health Inform. Educ. IOS Press; 2004. p. 143–51.
Varthis S, Anderson OR. Students’ perceptions of a blended learning experience in dental education. Eur. J. Dent. Educ. 2016:n/a–a.
Bradley C, Erice M, Halfer D, Jordan K, Lebaugh D, Opperman C, et al. The impact of a blended learning approach on instructor and learner satisfaction with preceptor education. J Nurses Staff Dev JNSD Off J Natl Nurs Staff Dev Organ. 2007;22(1):164–70. quiz 171-172.
Welch J. Building a foundation for brief motivational interviewing: communication to promote health literacy and behavior change. J Contin Educ Nurs. 2014;45:566–72.
Shaw T, Barnet S, Mcgregor D, Avery J. Using the knowledge, process, practice (KPP) model for driving the design and development of online postgraduate medical education. Med Teach. 2015;37:53–8.
Curran VR, Fleet L. A review of evaluation outcomes of web-based continuing medical education. Med Educ. 2005;39:561–7.
Battersby MW, Ask A, Reece MM, Markwick MJ, Collins JP. The Partners in Health scale: the development and psychometric properties of a generic assessment scale for chronic condition self-management. Aust. J. Prim. Health. 2003;9:41–52.
Availability of data and materials
The datasets generated and analysed during the current study are available from the corresponding author on reasonable request.
Ethics approval and consent to participate
The study was approved by both the Flinders University Social Behavioural Research Ethics Committee (6921) and the Flinders University Research and Evaluation Expert Reference Group (5.15). Ethical approval was provided retrospectively for the both the 2014 and 2015 cohort of medical and physiotherapy students.
On the basis of advice from the Ethics committee and the possible concern raised that the student cohort may feel obliged and/or pressured to participate if their participation was sought prior to completion of assessment we sought retrospective data. We did this by sending the participant information sheet and consent form to all students enrolled in the cohort via their student email once all teaching and assessment was completed to avoid any potential for coercion.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.