- Research article
- Open Access
- Open Peer Review
This article has Open Peer Review reports available.
Using complexity theory to develop a student-directed interprofessional learning activity for 1220 healthcare students
© The Author(s). 2016
Received: 14 April 2016
Accepted: 26 July 2016
Published: 8 August 2016
More and better interprofessional practice is predicated to be necessary to deliver good care to the patients of the future. However, universities struggle to create authentic learning activities that enable students to experience the dynamic interprofessional interactions common in healthcare and that can accommodate large interprofessional student cohorts. We investigated a large-scale mandatory interprofessional learning (IPL) activity for health professional students designed to promote social learning.
A mixed methods research approach determined feasibility, acceptability and the extent to which student IPL outcomes were met. We developed an IPL activity founded in complexity theory to prepare students for future practice by engaging them in a self-directed (self-organised) learning activity with a diverse team, whose assessable products would be emergent creations. Complicated but authentic clinical cases (n = 12) were developed to challenge student teams (n = 5 or 6). Assessment consisted of a written management plan (academically marked) and a five-minute video (peer marked) designed to assess creative collaboration as well as provide evidence of integrated collective knowledge; the cohesive patient-centred management plan.
All students (including the disciplines of diagnostic radiology, exercise physiology, medicine, nursing, occupational therapy, pharmacy, physiotherapy and speech pathology), completed all tasks successfully. Of the 26 % of students who completed the evaluation survey, 70 % agreed or strongly agreed that the IPL activity was worthwhile, and 87 % agreed or strongly agreed that their case study was relevant. Thematic analysis found overarching themes of engagement and collaboration-in-action suggesting that the IPL activity enabled students to achieve the intended learning objectives. Students recognised the contribution of others and described negotiation, collaboration and creation of new collective knowledge after working together on the complicated patient case studies. The novel video assessment was challenging to many students and contextual issues limited engagement for some disciplines.
We demonstrated the feasibility and acceptability of a large scale IPL activity where design of cases, format and assessment tasks was founded in complexity theory. This theoretically based design enabled students to achieve complex IPL outcomes relevant to future practice. Future research could establish the psychometric properties of assessments of student performance in large-scale IPL events.
The importance of collaborative work in delivering quality care to patients or clients is widely accepted. However, there is equivocal evidence as to how health professional students should best be prepared for the challenges of a world in which safe and efficient care is delivered to a population that is aging, has high levels of chronic and complex disease and when technological and scientific advances abound. Future health professional working environments are likely to include more specialization within professions and the development of new kinds of healthcare workers. Practitioners will need to ‘negotiate meaning, resolve epistemological differences, develop shared understanding and communicate … to a broad audience’ . This will take place increasingly often and with people they may not know.
Students need interprofessional learning (IPL) that prepares them for interprofessional practice (IPP). While interprofessional education (IPE) and IPL are used somewhat interchangeably in the literature, we prefer IPL as it emphasizes the active process of learning. We use Freeth et al.’s definition of IPL: ‘learning arising from interaction between members (or students) of two or more professions’ ( p18). In healthcare, ‘teams are most often ad hoc and may change on a weekly, daily, or even hourly basis for any given patient’ ( p67). Thus Edmondson’s concept of ‘teaming’  is highly relevant to IPL. Teaming refers to the behaviours necessary for successful function in dynamic, ad-hoc teams: speaking up, collaboration, experimentation and reflection . Influenced by Bleakley  and considering the contested and highly political discourse on teams and teamwork in healthcare, for this paper, we define teamwork as the process of conscious collaboration.
In preparing students for the workforce, universities have struggled to create and maintain authentic IPL activities that are inclusive for whole cohorts. Separate faculties often make shared work difficult  and sustainability has proven challenging. Resource intensive extra-curricular activities, involving a small proportion of the cohort are common. [8–13] Several groups have responded to the scheduling difficulties of IPL by investment in e-learning. For example, Bournemouth university developed a complicated virtual community with evolving scenarios as triggers for problem based learning activities  but students evaluated the learning activity poorly. Another project educating 2,800 students each year via the use of on-line discussion groups had disappointingly poor results . Some doubt whether the evidence for the benefits of IPL is sufficient to justify the effort of implementation and diversion of discipline specific resources . The practical difficulties of providing IPL have resulted in limited opportunity to develop a strong evidence base [11, 16–22] including lack of attention to relevant educational theory until quite recently [18, 22–24].
Theoretical principles underpinning the educational design
Health professional education has in the past been dominated by a pre-occupation with reliable measurement of the skills of individual students, thus ignoring what ten Cate et al., describe as ‘the kinds of higher-order thinking and acting that constitute competence in demanding work’ . Important parts of the work students will do in the clinical workplace cannot easily be codified and are not an individual enterprise, for example recent enquiry revealing the intensely social nature of infection control practice . Thus, in addition to traditional behavioural and learning theories , a range of other theories from psychology, social science and business have now been promoted for use in IPL. [24, 28] These are diverse, including for instance, the use of role theory to analyze gaps in the IPL literature , activity  and social capital theories . The range available was described in 2009 by Hean et al., as ‘an un-navigable quagmire’ .
For our large scale IPL event complexity theory proved a good fit. We used it as our overarching theoretical basis for both the design of the learning activity and as a framework for evaluation. In education, complexity theory is one of a number of socio-material learning theories which de-emphasise the individual and focus on the dynamic social nature of learning. That is, it develops from and is inseparable with, social and material relationships (the latter pertaining to elements such as environment, artifacts, technologies) [32, 33]. Complexity theory has origins in economics and biology (and further back in the mathematics of chaos) and there are different definitions and elaborations associated with its application in particular fields. It is an approach to studying complex systems which is not linear or reductionist but focuses on the interactions between system components ‘as the foundation from which the properties of a system emerge’  and accepts unpredictability of outcomes. Healthcare itself can be understood as a complex adaptive system at many levels  and complexity theory has special relevance to IPP. This is because of its relationship focus , its emphasis on adaptation and collective learning in teams  and sensitivity to the difficulties of everyday collaborative practice [24, 29]. IPP involves diverse perspectives and requires the construction of 'common ground', conflict negotiation and synthesis [30, 35].
Cooper et al suggest that complexity can enable IPL to ‘escape from the tradition of a linear paradigm for what is essentially a new way of learning’ . There is as yet, scant literature applying complexity theory to design of specific educational interventions in health professional education [37, 38]. The focus has been mainly at course level, not at the level of detail that has been described for instance for game design  and physical education .
‘learning … beyond the sum of the individual professionals’ contributions. … new collective knowledge that not only exceeds their individual understandings but represents knowledge that could not have been predicted in advance of their collaboration’ .
In this research the emergent products are considered to be the students’ collective knowledge, which is articulated in their assessment. Our overarching research aim was to explore the extent to which the IPL activity prepared students for future practice by engaging in a self-directed (self-organised) learning activity founded in diversity (including students from different disciplines, and as always in group work, different abilities) where their assessable products would be emergent creations.
Is it feasible to deliver a large scale (n= > 1000) student-directed case-based IPL learning activity including assessment of emergent products as an embedded component of existing curricula?
To what extent was the IPL activity acceptable to participating students?
What is the evidence that students achieved IPL learning outcomes from the perspective of complexity theory?
Complexity theory based educational design
The educational design was underpinned by the three key components of complexity theory; diversity, self-organization and emergence. First, the principle of diversity was incorporated in two ways, by including a range of disciplines in every team and by case development undertaken with the intention of maximizing display of student diversity. That is, we developed complicated patient cases which required more than simple application of each student’s discipline-specific knowledge. This countered students’ wishes to be competent only in their own profession . It ensured they engaged with IPL because of perceived relevance providing a context for meaningful interaction . Our 12 complicated cases were designed to achieve this (a sample case, terminally ill ‘Jane Murphy’, is provided in Additional file 1).
Second, a social learning process was encouraged to enable students to produce new collective knowledge through self-organisation and negotiation. Students needed to ‘elicit, build on and challenge one another’s ideas’  to create the integrated patient-centered management plan.
Third, the notion of emergent products in complexity theory guided the design of the summative assessment. Students had to submit a one-page evidence based management plan and a five-minute video that illustrated their patient case and their collaborative team-based approach to the patient’s care. Video is a novel assessment modality for health professional students and one that encourages creativity. It is suggested that group educational tasks lend themselves to a complexity based pedagogy if there are practices that promote ‘self-organization, adaptation and creativity’ . Producing a video provides such a practice (including scripting, acting, devising camera angles, creation of visual and sound effects etc.) facilitating novel presentation of case management.
Video Assessment Rubric
Issues faced by the patient and family not evident.
Describes the major issues faced by the patient and family.
Depicts appreciation of depth and/or breadth of issues faced by the patient and family.
Depicts considerable appreciation of depth and breadth of issues faced by the patient and family.
Does not display negotiation, shared goal setting and shared decision making.
Shows limited appreciation of negotiation, shared goal setting and shared decision making.
Shows appreciation of negotiation, shared goal setting and shared decision making.
Sophisticated approach to negotiation, shared goal setting and shared decision making.
Interprofessional management plan in action
Management plan not evident in video.
Video depicts limited evidence of management plan in action.
Video depicts good evidence of management plan in action.
Strong depiction of co-ordinated and well executed interprofessional care.
Effective use of video medium to engage audience
Poor use of video medium.
Appropriate use of video medium.
Highly engaging and memorable.
Abstract Assessment Rubric
Identifies and prioritises issues
Displays minimal awareness of the priority issues for the patient and family.
Superficially identifies the priority issues for the patient and family.
Identifies and justifies the priority issues for the patient and family.
Comprehensively identifies and justifies the priority issues for the patient and family.
Management plan contains specific strategies to address issues
Recommends few specific strategies to address some of the issues.
Recommends specific strategies to address some of the issues.
Recommends specific strategies to address most issues.
Recommends a comprehensive range of specific strategies to address all issues.
Includes evidence for management plan
Minimal evidence for management plan.
Some evidence for management plan.
Solid evidence for management plan.
Comprehensive and up to date evidence for management plan.
Communication of management plan
Management plan is disjointed, poorly organized and poorly written. It appears to be stitched together from various materials.
Management plan is coherent in parts and somewhat organized. Some aspects well written.
Management plan is coherent, clear and well organized. Well written.
Management plan is highly coherent and integrated. Well written.
Global assessment of abstract
Finally, peer marking (of videos produced by other teams) assisted students in developing evaluative judgement of their team performance compared to that of other teams. Green notes that when ‘students review the work of their peers, they invariably reflect back on their own work and consider ways of improving it…[as] before reviewing the work of peers, students will have already spent considerable time producing work in the same domain topic themselves’ .
Logistics for the IPL activity
The IPL activity, which we named the Health Collaboration Challenge (HCC), was conducted at a major metropolitan Australian university, which has over 12 health professional degree programs. There was no prior shared IPL strategy in place, and existing IPL activities were small scale without reliable cohort coverage. Project funding as well as faculty and Unit of Study (UOS) co-ordinator support allowed this activity to be embedded as a mandatory assessed component within the curriculum of a selection of eight degree programs. We were required to negotiate the mandatory assessment grading with each UOS co-ordinator, thus IPL assessment contributed to student assessment as either satisfactory/unsatisfactory or a weighted grade depending on the program specific requirements.
The IPL activity comprised of three major components: 1. A discipline-based face-to-face briefing session followed by individual student pre-work; 2. Central interprofessional learning experience, with a face-to-face briefing session prior to face-to-face team work; 3. Faculty assessment of written management plans and peer assessment of videos.
Understand the contribution of a range of different health professions to meet complex patient care needs
Integrate and prioritise key contributions from different health professions into a patient management plan
Evidence the application of a collaborative approach to problem solving with different health professions for a challenging creative task
Participant disciplines and year of study
Number of students
Cohort and Program
1st year of 4 years G (graduate entry)
3rd year – 3 years UG (undergraduate) & 2nd year - 2 years GEM (Graduate Entry Masters)
4th year – 4 years UG & 2nd year – 2 years GEM
Speech Pathology (SP)a
2nd year – 2 years GEM & 3rd year – 4 years UG
Diagnostic Radiography (DR)a
2nd year – 2 years GEM
Occupational Therapy (OT)a
2nd year – 2 years GEM
3rd year – 4 years UG
Exercise Physiology (EP)a
2nd Year – 2 years GEM
Student teams were provided with a challenging patient case study, which necessitated an interprofessional approach. Case studies were scripted by clinicians and based on real patient cases and then modified by the research team. Discipline experts and UOS co-ordinators reviewed the cases to ensure appropriateness. Cases included in-hospital and community care, all required input from multiple health professions (e.g. Jane Murphy, Additional file 1). There were 12 cases in total with each case being allocated to between 14 and 19 student teams. Students were assigned to teams of 5-6 members, making 208 teams. All teams had at least one medical, nursing and pharmacy student together with combinations of other health disciplines.
The individual on-line pre-work required students to read their case study and consider disciplinary aspects relevant to the case. This was provided via the Learning Management System (LMS) (Blackboard) one week prior to the face-to-face event (together with a team number and a list of team members).
For the central IPL experience we brought together approximately 400 students on three different days (September 2015) in a large sporting stadium (approximately 1280 m2). To manage the timetabling incompatibility across disciplines, a single day was cleared in the schedules of all students to create this opportunity. Some disciplines were spread across all three days, while other disciplines (e.g. exercise physiology and diagnostic radiology) all attended on a single day. Day allocations were made to suit each UOS and enable a good mix of disciplines in every team.
Upon arrival, students were directed into the tiered stadium seating and a 10-min briefing by members of the research team was used to encourage students to participate genuinely and to provide an opportunity for questions to be answered. Students then gathered in their teams at labelled areas through the stadium and were given a package of four team-building problem-solving exercises (written and geometric puzzles). After completion (approximately 20 mins), teams submitted their answers to a staff member along with a registration sheet recording attendance.
The third component of the IPL activity required students, as individuals, to peer mark two videos from two teams who had completed the same case. This was to be completed within 42 h of release of the peers’ videos and was coordinated using the LMS.
The management plans were marked separately by the five academic members of the research team who were blinded to the student team videos. Approximately four weeks after completing the IPL activity, each team was emailed their results: their average score (max score = 4) for each of the four video assessment rubric criteria, a global result for their abstract (poor/satisfactory/good/excellent) and a paragraph of generic feedback (dealing with specific clinical and teamwork issues that the students had handled well or neglected etc.) from the abstract marker for each patient case.
Students were invited formally to participate in research, including access to their assessment data. They were able to opt out, as standard, and many did not complete the post-event evaluation. Research question 1 (feasibility) was addressed by collecting a record of student attendance at the stadium briefing; assessment completion rate; number of late assessment submissions; and number and type of technical issues experienced by students and e-learning staff. It was also addressed through a researcher-designed post-learning activity survey which contained close-ended questions adapted from The University’s course evaluation survey and additional items specific to the IPL activity. We also included three open ended free text questions: ‘What aspect/s of your team's patient case study worked well? What aspect/s of the patient case study did your team find challenging? Is there anything else you would like to tell us?’. The SurveyMonkeyTM link to the questionnaire was provided to students in the results dissemination email. Research question 2 (acceptability) was also addressed by this questionnaire and research question 3 (specific IPL learning outcomes) assessed through the student performance as reflected by their assessment marks (for the video and abstract) and via analysis of their free text evaluation comments.
A mixed methods approach  was used to answer our specific research questions. This approach enabled us to develop a more complete understanding of our research questions and to examine processes along with outcomes . Student attendance rates and student assessment completion data were analysed descriptively. A log of technical issues was collated. Descriptive statistics were computed for the post-HCC evaluation questionnaire using SPSS StatisticsTM (version 22). Data were assessed for normality using the Kolmogorov-Smirnov test. Kruskal-Wallis H test was used to determine if differences existed in the evaluation questions between student health professional groups (health science, medicine, nursing and pharmacy). When significance was found, post hoc pairwise comparisons were analysed using Mann-Whitney test and corrected for using Bonferroni method. Alpha was set at 5 %.
Qualitative free text data from the questionnaire was analysed thematically . Two researchers experienced in qualitative research (CJ and GN) undertook the initial analysis. De-identified text data was read independently by both researchers to familiarize themselves with the data. Each researcher assigned codes to the free text independently to reflect units of meaning and codes were grouped and collapsed into larger codes. At this stage complexity theory was not used to guide the coding, which was inductive in nature, although the authors were familiar with this theory. Next, the researchers met to compare and contrast coding, clarify and negotiate variations in coding and understandings. A third researcher (CR) independently assessed thematic clustering. At a further meeting the authors discussed the value of using complexity theory as the conceptual framework for this paper, and subsequently developed a thematic framework informed by complexity theory over further meetings. This framework was applied to the dataset by CJ and GN to establish trustworthiness, and checked for new and emerging issues of importance that would extend the analysis. An Excel spreadsheet (MicrosoftTM) was used to manage data.
Of the 1220 students who participated in the HCC, 328 (26.24 %) chose to complete the program evaluation survey with 605 free text comments being submitted.
Was this large scale IPL activity feasible?
All 1220 students successfully completed all required components of the IPL activity, including video and management plan submission and peer video assessment. Only one student failed to attend without making contact. This student was followed up and attended the Saturday supplementary event (to accommodate students who were ill, had family or religious observance on their allocated day etc.). Less than a dozen teams had issues uploading their video. Some had not followed the instructions provided and some did not have access to a wired internet connection at the time they tried to submit. Only three teams submitted after the submission deadline, but only by two hours.
Elements required for successful and sustainable IPL curriculum versus HCC experience
Elements suggested as essential for an IPL program
Analysis of HCC experience
Long term dedicated support and budget .
University grant funded initially; and for a subsequent 1-2 years but HCC relatively low cost because student-directed.
Included- a large scale student-directed exercise enables and requires substantial data collection and analysis.
Faculty development program/training (e.g. in small group IPL facilitation) .
Not needed – a skeleton academic team of five developed and ran the HCC.
Minimum shared scheduling required – a single student day.
Teaching spaces for small group work .
Made available to 45 % of students, most used public campus learning spaces.
The HCC is suitable for mandatory participation
Development of a formal IPL department or organizational home . Secure governance arrangements are a priority.
Will be needed to provide long term support and development
Links between higher education and health .
Minimum links are needed – primarily to source authentic case studies
To what extent was the learning activity acceptable to students?
Overall, the complexity of case studies was appropriate, with the majority of the 328 students who completed the evaluation rating them as neutral (55.8 %) or difficult (28.2 %) (Fig. 1). All videos and abstracts (from the whole cohort - 208 teams) were marked as satisfactory or above.
The majority of the students who completed the evaluation (70 %) agreed or strongly agreed that the HCC was a worthwhile learning activity and 87 % agreed or strongly agreed that their case study was relevant. Use of video as an assessment task was the least positively rated aspect of the HCC, with less than 50 % of respondents agreeing or strongly agreeing that it was useful.
Thematic analysis, of the free text data contributed by the evaluation survey respondents, informed by complexity theory resulted in two overarching themes: student engagement and collaboration-in-action.
Theme 1: engagement with the IPL Activity
Engagement is central to the dynamic social approach to learning that is described by sociomaterial theories [32, 33]. There were barriers and enablers to student engagement. The main engagement subthemes dealt with the complicated case study, the curriculum context, the video task and the dynamic social nature of this novel activity.
Complicated case study
M38 ‘realistic, something that we all will come across in our careers’
SP4 ‘Inclusion of roles and input for each team member which promoted learning about each discipline's background, their responsibilities and rationale for what they would do’
The absence of health professions that were considered key to the case study was mentioned by some. While students were in general, allocated appropriately to cases designed for their disciplines, there were a few deficiencies in team membership and some respondents requested input from social work and psychology students (not participating in HCC).
M7 ‘the case was quite complex, so lent itself well to an interdisciplinary approach’
P39 ‘making each member imperative in working out our case’
Collaboration in student teams thus appeared to be an important precursor to the creation of emergent products, in this case producing the two assessment items as a team.
Impact of the learning context
P52 ‘Recommend weighting of assignment to be equal for all disciplines. This requires all students to try their hardest to achieve more than just a “pass” mark’
SP17 ‘Although it was a stressful day, given that I had a lot of other assessments on at the same time, I really enjoyed it! There were a lot of laughs, and I really enjoyed getting to know how other allied health professionals work in a safe environment. Only until it was over did I realise how much I enjoyed it. I wish I could do it again when it wasn't crunch time at uni!’
P2 ‘I think it would have been better if all the students were at a similar stage in their degree. Whilst pharmacists, nursing and radiography were all in their final year the medical students were only in first year. It would be great to work with medical students who were a little further into their degree.’
M1 ‘I really appreciated the opportunity to meet students from other disciplines, although I felt under-qualified due to the fact that I was in first year whereas the nurses and physio had a very impressive clinical knowledge base and much more experience.’
N7 ‘The medicine students could tone down the sass. Please and thank you.’
P37 ‘The doctors took on their role of managing the bulk of patient care very enthusiastically even though they were not equipped with the skills to do so just yet. This made things very slow going.’
P39 ‘The video aspect allowed us to explore our creativity and my group had a lot of fun in particular when filming our video.’
N48 ‘Making it a video task felt time-consuming, unnecessary and inappropriate for the task …[and] the biggest challenge was troubleshooting software problems and problems with filming devices.’
M26 ‘I want to be honest and say I did not enjoy the video task and neither did my team. The case was good and working together was great, I felt like it was worthwhile doing the abstract and I did learn something. But getting a bunch of predominantly science students to do a creative project like a video is borderline painful.’
P43 ‘Figuring out if we should focus more on creativity and engaging the audience, or the clinical and nitty gritty details to help Jo [their patient case].’
Dynamic social learning
DR2 ‘[I] really enjoyed getting out of the [Health Sciences disciplines] campus and meeting other students of different disciplines - would do it again.’
N74 ‘I wasn't very optimistic about the whole activity in the beginning but by the end of this activity I found that I very much enjoyed this opportunity to work collaboratively with other students. It was quite different from any other group work I have ever done. I believe that I gained more out of this collaborative group work than any other group assignment that I have undertaken.’
Theme 2 – collaboration-in-action
While the first theme encompasses factors that energised student engagement in a dynamic IPL activity, the second theme spot lights student experience of the process of collaboration that was necessary to create their emergent assessment products. Student experience of collaboration-in-action was reflected in subthemes of ‘communication’, ‘negotiation and conflict resolution’ and ‘integration and emergence’.
M64 ‘Our group dynamic was good with each of the disciplines contributing meaningfully. The case was quite complex, meaning a lot of discussion was required.’
N64 ‘We had a good team that worked well, listened to each other and all contributed. We thought holistically and tried to include as much psychosocial and person-centred care as possible.’
Negotiation and conflict resolution
OT14 ‘Areas that could be addressed by multiple professions- this was challenging at first but prompted conversation among team members to explain their reasoning and negotiate the best option for a care plan.’
SP51 ‘Team members were able to identify and resolve professional cross-over issues clearly and efficiently, providing each individual with heightened insights into specific assessment and treatment considerations.’
M52 ‘[Challenges included] working out how to treat Jane, and working out how to work together e.g. one of the students began by telling everyone what to do but we renegotiated those roles to bring forward others' voices in the video.’
SP50 ‘The time constraints did not allow my team much time to build rapport and as a result there were some conflicts between members that needed to be resolved during the preparation and planning stages.’
M22 ‘People making their discipline the centre of the management plan, and being unwilling to budge.’
M43 ‘After hours of disagreement, we all decided that we wanted to be able to leave the uni grounds before 6 pm. We sort of banded together to produce the video…. I had a group member who was incredibly disparaging, using words like “that is just stupid and other assorted insults” and refused to listen to any input.’
Integration and emergence
N48 ‘It was useful to understand healthcare from the perspective of other disciplines. It was interesting to see how priorities and treatment of health problems differed between disciplines, especially medicine and nursing.’
P37 ‘It was interesting to hear the perspective the doctors and nurses offered on the patient that I would have otherwise not considered.’
OT2 ‘Discussing as a group and then branching off into each of our expertise to tackle certain points, and then going through it as a team to put everything together.’
SP36 ‘Everyone was able to contribute, and we worked well to synthesise ideas from different disciplines in a way that would still keep the interests of the client as the core focus.’
We have demonstrated the feasibility and acceptability of a mandatory large-scale student-directed interprofessional learning activity (research questions one and two). Low fidelity simulation exercises such as group work to prepare a case management plan have been successful in other settings [48–50]. One university has reported on a single 900 student session of 180 min that included work in small groups . However, tutor requirements can be formidable [48, 52] (e.g. 1:6 tutor-student ratio). At the University of Alberta, 1000 interdisciplinary health students undertake activities guided by 50 trained facilitators, with pairs responsible for a classroom of 50 students (six teams) who work through case scenarios .
Our IPL activity was designed to overcome barriers to scalability and sustainability and provide a prototype for a future university-wide approach to interprofessional activities also suitable for non-health faculties. The student-directed nature and the use of peer-marking reduced resourcing requirements. (Interestingly, the students made no free text comment on their experience of peer marking process). We demonstrated the feasibility of embedding a new activity in multiple disciplinary UOS and within existing teaching workloads (with only a small guiding academic team, but with dedicated funded administrative support). Many elaborate attempts at IPL have produced disappointing returns on the educational investment made and have been difficult to sustain, thus recent evaluation recommendations include prioritisation of description of context . It is also suggested by Fraser and Greenhalgh that attention to process is ‘the distinguishing characteristic of productive non-linear learning’ . Hence we have provided detailed description of both process and context together with an analysis against curriculum elements suggested as essential for IPL by others (and this was favorable).
This learning activity was demonstrated by quantitative and qualitative data to be acceptable to students. Student satisfaction is particularly important in IPL as it has been suggested that ‘early experiences … may even cause harm if students believe they are practising as part of an interprofessional team when in fact the ‘team’ is dysfunctional and the activity lacks the potential benefits students have been promised’ . Student feedback was extremely positive for an activity that was an example of an ‘ad hoc and often heroic initiative to locate IPE within an already crowded curriculum’ .
The statistically significant differences in evaluative responses between student professional groups are intriguing and we can only speculate on reasons. The pharmacy students were most positive. This might reflect their interest in the changing role of pharmacists in providing medication management services  along with the largely uniprofessional and campus-based curriculum pharmacy students had experienced to date; hence their enthusiasm to interact with students from other disciplines. It may also reflect the nature of the cases which all involved challenging, but solvable pharmacy problems (it proved easier to standardise the pharmacy complexity than other case aspects). The differences between medical students’ responses and other disciplines’ may reflect medical student focus on another (barrier) clinical assessment task due the same week and/or the junior level of the medical students compared with other students.
The contextual curriculum issues that limited engagement (assessment variation, timing, junior medical students) are all resolvable. It is not clear whether the novel video task, which challenged students, and was disliked by some, aided engagement and the achievement of IPL outcomes. There was surprisingly little rich comment overall about this novel creative assessment task which had been designed to require collaboration and engender emergence. While there may be ‘a fundamental tension between the engagement and level of achievement which can result from a creative open ended task and the constraints associated with assessment’  some health students were hostile to the request for creativity and the video requirement may not have resulted in increased task engagement.
The anticipated IPL outcomes were demonstrated by the evaluation. The overarching themes of engagement and collaboration-in-action suggest that the IPL activity was relevant to preparation for future IPP. Students learnt about the contributions other professions could make and how their priorities varied. Collaboration-in-action was evident as students participated in negotiation and conflict resolution to resolve professional priorities into a patient-centered plan. Learning outcomes b and c both require development of new (emergent) collective knowledge. This was evidenced by the assessable products which were varied and creative (unpublished data) and by student self-report of their experience. Some students were able to provide a clear description of the synthesis that occurred as they worked together to produce their emergent products that addressed the patient’s needs. Our findings thus support the relevance of complexity theory for IPL and add detailed exemplar of a single IPL activity to the existing literature which is more programmatic in focus [37, 38].
The evaluation survey response rate of 26 % was low, probably due to the excessive gap between the completion of the HCC and the request to participate in the survey. Delays in marking the written abstracts, meant it took four weeks from event participation until students received their results and were asked to evaluate the experience. Nevertheless, student numbers overall were large and our range of qualitative comments suggests we captured both negative and positive experiences of the IPL activity.
Attempts to improve or remove the issues that limited engagement (assessment variation, timing, junior medical students) are being made for future iterations of the activity. We also consider that use of a peer feedback tool will incentivise participation. An investigation of students’ video production skills will be undertaken and supplemented by provision of more extensive educational support for video production. We will review the assessment rubrics used for the video and the written management plan to ensure that they promote emergence by adequately valuing diverse thinking (creativity) and evidence of integrated discipline knowledge (a cohesive patient-centred plan). Clear boundaries and ground rules give groups the security to take risks and be creative . Finally, more work needs to be done, by us and others, to develop psychometrically valid and reliable methods of assessment for IPL activities. Without this, it is hard to obtain support for IPL activities to be given appropriate and significant assessment weighting within the UOS of individual disciplines.
Future research aims to study student teams while they are working to understand how and when their interactions most successfully create new collective knowledge. Similar research has been undertaken in another setting, where psychology students videoed student groups making health promotion videos . A written-only task could be provided to some teams and their interactions compared with those of teams undertaking the video task. A reflexive session with participating student groups will then be undertaken and videoed (using the video-reflexive methodology ) so that a rich range of insights are available into successful and unsuccessful collaboration (and the contributions a creative video task makes). This would enable us to better support the IPL collaborative process in future iterations.
We have demonstrated the feasibility and acceptability of a large-scale student-directed case-based IPL activity. Educational design (cases, logistics and assessment tasks) founded in complexity theory (encouraging emergence, diversity and self-organisation) resulted in demonstrable student engagement and collaboration-in action. Our findings provide support for the applicability of complexity theory for developing meaningful IPL activities for health professional students.
DR, diagnostic radiology student; EP, exercise physiology student; HCC, health collaboration challenge; IPE, interprofessional education; IPL, interprofessional learning; IPP –interprofessional practice; LMS, learning management system; M, medical student; N, nursing student; OT, occupational therapy student; P, pharmacy student; PT, physiotherapy student; SP, speech pathology; UOS, unit of study
We’d like to knowledge the support of all participating health professional faculties, the students, the Sydney e-learning team members (Marianna Koulias, Pamela Branas and Leon Huang) and the Deputy Vice Chancellor (Education) Professor Pattinson.
The research was funded by a Sydney University Education Innovation Grant. The funder had no role in the design of the study and collection, analysis, and interpretation of data or in writing.
Availability of data and materials
Data is available on request from the authors.
CJ, GN, CG, TC, CR originated the idea for the interprofessional learning activity, and all, together with SG, developed detailed teaching material, ran the activity and designed the evaluation methods. CJ, GN, CR, CG, TC and SG all performed data analysis. CJ, CG, CR, GN wrote the initial drafts of the manuscript. All authors read, critically appraised, revised and approved the final manuscript.
The authors declare that they have no competing interests.
Consent for publication
Ethics approval and consent to participate
Ethical approval was granted by the Human Research Ethics Committee of the university (Protocol number: 2015/556). Consent was collected electronically prior to the face-to-face event.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Spelt EJ, Biemans HJ, Tobi H, Luning PA, Mulder M. Teaching and learning in interdisciplinary higher education: A systematic review. Educ Psychol Rev. 2009;21(4):365–78.View ArticleGoogle Scholar
- Freeth DS, Hammick M, Reeves S, Koppel I, Barr H. Effective interprofessional education: development, delivery, and evaluation. John Wiley & Sons; 2008Google Scholar
- IOM (Institute of Medicine). Measuring the impact of interprofessional education on collaborative practice and patient outcomes. Washington: The National Academies Press; 2015.Google Scholar
- Edmondson A. Teaming: how organizations learn, innovate, and compete in the knowledge economy. Jossey Bass; 2012Google Scholar
- Lewin S, Reeves S. Enacting ‘team’and ‘teamwork’: Using Goffman’s theory of impression management to illuminate interprofessional practice on hospital wards. Soc Sci Med. 2011;72(10):1595–602.View ArticleGoogle Scholar
- Bleakley A. Working in “teams” in an era of “liquid” healthcare: What is the use of theory? J Interprof Care. 2013;27(1):18–26.View ArticleGoogle Scholar
- Bennett PN, Gum L, Lindeman I, Lawn S, McAllister S, Richards J, Kelton M, Ward H. Faculty perceptions of interprofessional education. Nurse Educ Today. 2011;31(6):571–6.View ArticleGoogle Scholar
- Dunston R, Lee A, Matthews LR, Nisbet G, Pockett R, Thistlethwaite J, et al. Interprofessional health education in Australia: The way forward. Sydney; University of Sydney, University of Technology Sydney, Australian Learning and Teaching Council; 2009.Google Scholar
- Boyce R, Moran M, Nissen L, Chenery H, Brooks P. Interprofessional education in health sciences:the University of Queensland Health Care Team Challenge. MJA. 2009;190(8):433–6.Google Scholar
- Alinier G, Harwood C, Harwood P, Montague S, Huish E, Ruparelia K, Antuofermo M. Immersive clinical simulation in undergraduate health care interprofessional education: knowledge and perceptions. Clin Simul Nursing. 2014;10(4):e205–16.View ArticleGoogle Scholar
- Thistlethwaite J. Interprofessional education: a review of context, learning and the research agenda. Med Educ. 2012;46(1):58–70.View ArticleGoogle Scholar
- Nicol P. Interprofessional Education for Health Professionals in Western Australia: Perspectives and Activity. Sydney: Centre for Research in Learning and Change, Faculty of Arts and Sciences, UTS; 2012Google Scholar
- Hood K, Cant R, Leech M, Baulch J, Gilbee A. Trying on the professional self: nursing students’ perceptions of learning about roles, identity and teamwork in an interprofessional clinical placement. Appl Nurs Res. 2014;27(2):109–14.View ArticleGoogle Scholar
- Hutchings M, Scammell J, Quinney A. Praxis and reflexivity for interprofessional education: towards an inclusive theoretical framework for learning. J Interprof Care. 2013;27(5):358–66.View ArticleGoogle Scholar
- Clouder DL, Goodman S, Bluteau P, Jackson A, Davies B, Merriman L. An investigation of “agreement” in the context of interprofessional discussion online: A “netiquette” of interprofessional learning? J Interprof Care. 2011;25(2):112–8.View ArticleGoogle Scholar
- Reeves S, Tassone M, Parker K, Wagner SJ, Simmons B. Interprofessional education: An overview of key developments in the past three decades. Work. 2012;41(3):233–45.Google Scholar
- Lapkin S, Levett-Jones T, Gilligan C. A systematic review of the effectiveness of interprofessional education in health professional programs. Nurse Educ Today. 2013;33(2):90–102.View ArticleGoogle Scholar
- Gittell JH, Godfrey M, Thistlethwaite J. Interprofessional collaborative practice and relational coordination: Improving healthcare through relationships. J Interprof Care. 2013;27(3):210–3.View ArticleGoogle Scholar
- Thistlethwaite J, Kumar K, Moran M, Saunders R, Carr S. An exploratory review of pre-qualification interprofessional education evaluations. J Interprof Care. 2015;29(4):292–97Google Scholar
- Craddock D, O’Halloran C, McPherson K, Hean S, Hammick M. A top-down approach impedes the use of theory? Interprofessional educational leaders’ approaches to curriculum development and the use of learning theory. J Interprof Care. 2013;27(1):65–72.View ArticleGoogle Scholar
- Reeves S, Perrier L, Goldman J, Freeth D, Zwarenstein M. Interprofessional education: effects on professional practice and healthcare outcomes (update). Cochrane Database Syst Rev. 2013;3:1–47Google Scholar
- Abu-Rish E, Kim S, Choe L, Varpio L, Malik E, White AA, Craddick K, Blondon K, Robins L, Nagasawa P. Current trends in interprofessional education of health sciences students: A literature review. J Interprof Care. 2012;26(6):444–51.View ArticleGoogle Scholar
- Reeves S, Hean S. Why we need theory to help us better understand the nature of interprofessional education, practice and care. J Interprof Care. 2013;27(1):1–3.View ArticleGoogle Scholar
- Barr H. Toward a theoretical framework for interprofessional education. J Interprof Care. 2013;27(1):4–9.View ArticleGoogle Scholar
- ten Cate O, Billett S. Competency‐based medical education: origins, perspectives and potentialities. Med Educ. 2014;48(3):325–32.View ArticleGoogle Scholar
- Iedema R, Hor S-Y, Wyer M, Gilbert GL, Jorm C, Hooker C, O’Sullivan MVN. An innovative approach to strengthening health professionals’ infection control and limiting hospital-acquired infection: video-reflexive ethnography. BMJ Innovations. 2015; bmjinnov-2014-000032Google Scholar
- Hean S, Craddock D, O’Halloran C. Learning theories and interprofessional education: A user’s guide. Learn Health Soc Care. 2009;8(4):250–62.View ArticleGoogle Scholar
- Suter E, Goldman J, Martimianakis T, Chatalalsingh C, DeMatteo DJ, Reeves S. The use of systems and organizational theories in the interprofessional field: Findings from a scoping review. J Interprof Care. 2013;27(1):57–64.View ArticleGoogle Scholar
- Michalec B, Hafferty FW. Role theory and the practice of interprofessional education: A critical appraisal and a call to sociologists. Soc Theory Health. 2015;13(2):180–201.View ArticleGoogle Scholar
- Lingard L, McDougall A, Levstik M, Chandok N, Spafford MM, Schryer C. Representing complexity well: a story about teamwork, with implications for how we teach collaboration. Med Educ. 2012;46(9):869–77.View ArticleGoogle Scholar
- Hean S, O’Halloran C, Craddock D, Hammick M, Pitt R. Testing theory in interprofessional education: Social capital as a case study. J Interprof Care. 2013;27(1):10–7.View ArticleGoogle Scholar
- McMurtry A. Reframing interdisciplinary and interprofessional collaboration through the lens of collective and sociomaterial theories of learning. Issues Interdiscip Stud. 2013;31:75–98.Google Scholar
- McMurtry A, Rohse S, Kilgour KN. Socio‐material perspectives on interprofessional team and collaborative learning. Med Educ. 2016;50(2):169–80.View ArticleGoogle Scholar
- Thompson DS, Fazio X, Kustra E, Patrick L, Stanley D. Scoping review of complexity theory in health services research. BMC Health Serv Res. 2016;16(1):1.View ArticleGoogle Scholar
- Fenwick T. Complexity science and professional learning for collaboration: a critical reconsideration of possibilities and limitations. J Educ Work. 2012;25(1):141–62.View ArticleGoogle Scholar
- Cooper H, Braye S, Geyer R. Complexity and interprofessional education. Learn Health Soc Care. 2004;3(4):179–89.View ArticleGoogle Scholar
- McMurtry A. Complexity, collective learning and the education of interprofessional health teams: Insights from a university-level course. J Interprof Care. 2010;24(3):220–9.View ArticleGoogle Scholar
- Mitchell GJ, Pilkington B, Jonas-Simpson CM, Daiski I, Cross NL, Johnston N, O’Grady CP, Peisachovich EH, Tang SY. Nursing education and complexity pedagogy: Faculty experiences with an e-learning platform. J Nursing Educ Practice. 2016;6(5):60.View ArticleGoogle Scholar
- Fabricatore C, López MX. Complexity-based learning and teaching: a case study in higher education. Innov Educ Teach Int. 2014;51(6):618–30.View ArticleGoogle Scholar
- Jess M, Atencio M, Carse N. Introducing conditions of complexity in the context of Scottish PE. In: Ovens A, Hopper T, Butler J, editors. Complexity Thinking in Physical Education: Reframing Curriculum, Pedagogy and Research. London: Routledge; 2012. p. 27–41.Google Scholar
- Jorm C, Roberts C, Lim R, Roper J, Skinner C, Robertson J, Gentilcore S, Osomanski A. A large-scale mass casualty simulation to develop the non-technical skills medical students require for collaborative teamwork. BMC Med Educ. 2016;16(1):1.View ArticleGoogle Scholar
- Green C. Relative distancing: A grounded theory of how learners negotiate the interprofessional. J Interprof Care. 2013;27(1):34–42.View ArticleGoogle Scholar
- Nisbet G, Jorm C, Gordon C, Chen T. Influencing student attitudes with a student directed interprofessional learning activity. Int J Practice-based Lear Health Soc Care. 2016;4(1):1–15Google Scholar
- Richardson B, Gersh M, Potter N. "Health Care Team Challenge: a versatile model for interprofessional education." MedEdPORTAL Publications 2012;8:9287.Google Scholar
- Newton C, Bainbridge L, Ball V, Baum KD, Bontje P, Boyce RA, Moran M, Richardson B, Tamura Y, Uden D. The Health Care Team Challenge™: Developing an international interprofessional education research collaboration. Nurse Educ Today. 2015;35(1):4–8.View ArticleGoogle Scholar
- Creswell JW, Klassen AC, Plano Clark VL, Smith KC. Best practices for mixed methods research in the health sciences. Bethesda: National Institutes of Health; 2011. p. 2094–103.Google Scholar
- Clark VLP. The adoption and practice of mixed methods: US trends in federally funded health-related research. Qualitative Inquiry. 2010;16(6)428–40Google Scholar
- Williams B, Brown T, McCook F, Boyle M, Palermo C, Molloy A, Lisa MCKenna L, Scholes R, French J, McCall L. A pilot study evaluating an interprofessional education workshop for undergraduate health care students. J Interprof Care. 2011;25:215–7.View ArticleGoogle Scholar
- Judge M, Polifroni E, Maruca A, Hobson M, Leschak A, Zakewicz H. Evaluation of students’ receptiveness and response to an interprofessional learning activity across health care disciplines: An approach toward team development in healthcare. Int J Nursing Sci. 2015Google Scholar
- Turner KM, Chudgar SM, Engle D, Molloy MA, Phillips BC, Stevenson EL, Clay AS. It Takes a Village”: An Interprofessional Patient Safety Experience for Nursing and Medical Students. Medical Sci Educator. 2013;23(3):449–56.View ArticleGoogle Scholar
- Cameron A, Ignjatovic M, Langlois S, Dematteo D, DiProspero L, Wagner S, Reeves S. An interprofessional education session for first-year health science students. Am J Pharm Educ. 2010;73(4):1–7.Google Scholar
- Spencer J, Woodroffe J. Celebrating multidisciplinary practice and learning: three years evaluation of an undergraduate interprofessional rural health education pilot. In: 11th National Rural Health Conference Proceedings: 2011; 13-16 March 2011, Perth, Western Australia. 2011. p. 1–11.Google Scholar
- Reeves S, Boet S, Zierler B, Kitto S. Interprofessional Education and Practice Guide No. 3: Evaluating interprofessional education. J Interprof Care. 2015;29(4):305–12.View ArticleGoogle Scholar
- Fraser SW, Greenhalgh T. Coping with complexity: educating for capability. Br Med J. 2001;323(7316):799.View ArticleGoogle Scholar
- Hoffman S, Rosenfield D, HV Gilbert J, Oandasan I. Student leadership in interprofessional education: benefits, challenges and implications for educators, researchers and policymakers. Med Educ. 2008;42:654–61.View ArticleGoogle Scholar
- Steketee C, Forman D, Dunston R, Yassine T, Matthews LR, Saunders R, Nicol P, Alliex S. Interprofessional health education in Australia: Three research projects informing curriculum renewal and development. Appl Nurs Res. 2014;27(2):115–20.View ArticleGoogle Scholar
- Chen TF, de Almeida Neto AC. Exploring elements of interprofessional collaboration between pharmacists and physicians in medication review. Pharm World Sci. 2007;29(6):574–6.View ArticleGoogle Scholar
- Barwell G, Moore C, Walker R. Marking machinima: A case study in assessing student use of a Web 2.0 technology. Aus J Educ Tech. 2011;27(5):765–80.Google Scholar
- Jensen M, Mattheis A, Johnson B. Using student learning and development outcomes to evaluate a first-year undergraduate group video project. CBE Life Sci Educ. 2012;11(1):68–80.View ArticleGoogle Scholar