- Research article
- Open Access
The impact of a training programme incorporating the conceptual framework of the International Classification of Functioning (ICF) on knowledge and attitudes regarding interprofessional practice in Rwandan health professionals: a cluster randomized control trial
BMC Medical Education volume 21, Article number: 139 (2021)
The first step in improving interprofessional teamwork entails training health professionals (HP) to acknowledge the role and value the contribution of each member of the team. The International Classification of Functioning, Disability and Health (ICF) has been developed by WHO to provide a common language to facilitate communication between HPs.
To determine whether ICF training programme would result in improved knowledge and attitudes regarding interprofessional practice within Rwandan district hospitals.
Design, setting and participants
A cluster randomised, single blinded, control trial design was used to select four district hospitals. Participants included physicians, social workers, physiotherapists, nutritionists, clinical psychologists/mental health nurses.
Health professionals either received one day’s training in interprofessional practice (IPP) based on the ICF (experimental group) as a collaborative framework or a short talk on the topic (control group).
Validated questionnaires were used to explore changes in knowledge and attitudes. Ethical approval was obtained from the relevant authorities.
There were 103 participants in the experimental and 100 in the control group. There was no significant difference between Knowledge and Attitude scales at baseline. Post-intervention the experimental group (mean = 41.3, SD = 9.5) scored significantly higher on the knowledge scale than the control group (mean = 17.7, SD = 4.7 (t = 22.5; p < .001)). The median scores on the Attitude Scale improved in the Experimental group from 77.8 to 91.1%, whereas the median scores of the control remained approximately 80% (Adjusted Z = 10.72p < .001).
The ICF proved to be a useful framework for structuring the training of all HPs in IPP and the training resulted in a significant improvement in knowledge and attitudes regarding IPP. As suggested by the HPs, more training and refresher courses were needed for sustainability and the training should be extended to other hospitals in Rwanda. It is thus recommended that the framework can be used in interprofessional education and practice in Rwanda and possibly in other similar countries.
Name of the registry: Pan African Clinical Trial Registry.
Trial registration number: PACTR201604001185358.
Date of registration: 22/04/2016.
URL of trial registry record: www.pactr.org
The Framework for Action on Interprofessional Education and Collaborative Practice which was established for all countries’ policy makers, health educators and health workers reported that several countries throughout the world are struggling to maintain their health systems and cannot address the problems that are emerging with health care delivery [54, 55]. Problems identified by Frenk et al.  included poor teamwork and the “so-called tribalism of the professions” (amongst others).
It is estimated that a patient, during his/her period of about four days hospital stay can be seen by around 50 different people including medical doctors, nurses, physiotherapists, and others . Apart from duplication of effort, poor collaboration between health care professionals can result in medical errors, lack of critical information and inadequate interpretation of health information, all risks to a patient’s safety . The Lancet Global Independent Commission therefore identified the need for health care reform based on interprofessional and transprofessional education that breaks down professional silos while enhancing collaborative and non-hierarchical relationships in effective teams .
Interprofessional collaboration occurs when health professionals from different disciplines with different backgrounds provide patient care together and work closely with each other and the patient, family and the community to deliver the optimum health care [21, 28, 53]. Smooth collaboration among health care providers may minimise medical errors and eventually improve patient outcomes . A framework of outcome measures for effective teamwork , a systematic review on the effects of interdisciplinary team care interventions on general medical wards , and A Cluster Randomised Control Trial (CRCT) conducted by Borenstein et al.  among an elderly population demonstrated the positive effect of interprofessional communication for better collaborative practice. These include reduced hospitalization time and cost, reduced anticipated admission, better accessibility and improved coordination of care, efficient use of healthcare services, reduced medical errors and improved health outcomes, and great role clarity. Despite the potential benefits and effect of interprofessional communication and collaborative practice, there are also some challenges when professionals from various disciplines work together. These include different goals and priorities among disciplines, misunderstanding of others’ responsibilities and roles, and overlapping of some professions’ roles during care delivery, lack of recognition of each professional’s expertise, resistance to innovation, professional hierarchy, lack of integrative skills, lack of enough time, lack of space, and lack of training programmes [9, 35, 43, 48]. However, a interprofessional framework which should guide communication and collaboration between health care professionals in their clinical settings is therefore needed.
In 2001, the WHO produced the International Classification of Functioning, Disability and Health (ICF), a member of the International Family of Classifications and a sister classification to the universally used International Classification of Disease (ICD). The ICF presents a common and standardised language for the description of health and health-related states . The six interactive components of ICF are structured in two main parts [47, 51]. Part one covers information related to body functioning and disability, while part two deals with contextual factors [51, 54]. Each part also has two components: functioning and disability (body functions and body structures; activities and participation); contextual factors (environmental factors and personal Factors) [51, 54]. The ICF does not present the process of functional limitations as linear and instead posits an interaction between the health condition, functioning and environmental factors, which in many cases may be reciprocal. Body structures reflect anatomical parts of the body (e.g. legs, arms, etc.) and also organs (e.g. heart, brain). On the other hand, body functions reflect physiological functions of the human body (e.g. psychological function, mental function, voluntary movements). Therefore, any problem in body structure or function relates to the impairment [51, 54]. Activities refer to the execution of actions or tasks by an individual. If someone has difficulties in executing the usual tasks or actions such as walking, sitting, eating and washing, he/she will have activity limitation [51, 54]. Participation is involvement in life situations by individuals such as leisure, work, family and community, and school activities. Therefore, if a person encounters problems hindering him/her to be engaged in those activities as usual, he/she has a participation restriction [51, 54]. Environmental factors are physical, psychological and social (psycho-social) environments where a person performs his or her usual activities or lives [1, 51]. The environmental factors can include a variety of areas such as home, work, policies and legislation, family and community, friends, medications and assistive devices. Environmental factors have an impact upon an individual’s functioning as facilitators or barriers . Personal factors imply how a person experiences a particular health condition. These include age, gender, education, profession, social background, individual lifestyle, personal character and coping strategies .
Indeed, the ICF, by its nature, is multifaceted to be used by different health.
Professionals . The ICF also represents a paradigm for approaching health and health care, and demonstrates the need for different health care professionals. Therefore, it encourages health care professionals to consider health issues underlying their scope of practice . In interprofessional practice, the ICF framework contributed a lot to the assessment of complex health conditions that should not be treated by one profession . Based on its nature that tackles different aspects of health, the ICF provides a useful functioning assessment among health care professionals, who basically used the biomedical model of assessment, for identifying all relevant information related to the condition . In this way, the ICF improves communication among health care professionals during patient assessment by providing the universal language and framework for health and functioning [2, 16]. Furthermore, the use of ICF as a tool for interprofessional collaboration improves the quality of the work process through the systematic assessment approach, settings treatment goals and plans . This implies that team work is promoted by using a shared language in the patient management process in either education or practice in the hospital environment [13, 24]. In fact, the ICF was found to be an effective instrument for decision making, collaboration and communication among health professionals from various disciplines due to its common language across the globe .
However, the application of the ICF is as yet somewhat limited among health professionals, especially those who are not part of a rehabilitation team [8, 49]. In addition, there are limited published accounts of including the ICF in the training of health professionals in IPP. (The ICF is premised on the biopsychosocial approach to health care. This is in contrast to health care in many countries, including Rwanda, where the bio-medical approach is the dominant model and lack of collaboration between health care professionals in different disciplines.
The recent study on the impact of a training programme incorporating the ICF framework has suggested the improved behaviour regarding interprofessional practice in Rwandan health professionals demonstrated by quality of medical recording . Various studies demonstrated that change in behaviour may be influenced by the change in knowledge and attitudes [11, 17, 29]. As suggested by the Global Independent Commission, strengthened IPP might well result in improved patient outcome. However, there is little evidence within the African context as to the most effective strategies to strengthen IPP within a hospital setting. The aim of this study was therefore to explore whether the presentation of a day’s workshop on IPP, based on the biopsychosocial model of health care as formulated in the ICF framework, would result in improved attitudes and knowledge of IPP.
The study was carried out in district hospitals in Rwanda. Rwanda has 40 district hospitals covering four provinces plus four district hospitals in Kigali city to make a total of 44 district hospitals . In general, apart from Kigali city, all district hospitals in Rwanda are similar in terms of patients and conditions, services, materials and equipment as well as health care personnel, so the four hospitals from Kigali were excluded from this study. The district hospitals have both inpatient and outpatient services.
The current study is part of a study published recently by Sagahutu et al.  which investigated the impact of a training programme incorporating the conceptual framework of the International Classification of Functioning (ICF) on behaviour regarding interprofessional practice in Rwandan health professionals. Therefore, this study only focused on the impact of the ICF training on the knowledge and attitudes regarding interprofessional practice using pre and post data. A Cluster Randomised Control Trial (CRCT) with single blinding using a pragmatic study design was used in this study to select the district hospitals and allocate either to experimental or control arm. This design is primarily used to avoid contamination between the control and experimental groups when a single setting (such as a ward) is utilised . Four of the 40 district hospitals were randomly allocated to receive a day’s training in interprofessional practice using the ICF (experimental hospitals) or only a short talk (introduction) between one and two hours on the ICF (control hospital) by a blinded research assistant. Pre- and post-measurements of knowledge and attitudes towards IPP were performed at baseline and after training. A two hour face to face meeting was held with the experimental group two months later to receive feedback on the implementation of the workshop recommendations. The entire study adheres to CONSORT guidelines.
The sample targeted all health care workers employed within four randomly selected hospitals including Medical doctors, Physiotherapists, Nurses, Social Workers, Mental Health Nurses/Clinical Psychologists, and Nutritionists. These health care professionals most commonly provide ward service in the district hospitals of Rwanda. The inclusion criteria were licensed full time health professionals, working either in orthopaedic/surgical, medical or paediatric wards, with at least six months of working experience. The primary outcome of this study was the improved knowledge and attitudes regarding the interprofessional collaborative practice among health professionals.
A feasibility study was undertaken and based on these results we anticipated a large effect size on the knowledge and attitudes questionnaires. Using the parameters identified by the pilot study and allowing for cluster sampling and a design effect of 1.5, the effective sample size (ESS) required a 10% sample of the 40 district hospitals (four hospitals) with 64 participants. The ESS is the sample required to reach adequate power, once the design effect has been taken into account. The design effect is a measure of the correlation between subjects in each cluster. The more similar they are with regard to the outcome of interest, the greater the design effect and the smaller the ESS becomes. The design effect, or inflation factor is 1 + (n − 1) p, Where n = the number per cluster and p or rho is the intra-cluster correlation (ICC). Killip and Mahfoud  reports that in human studies values of ICC rho fall between 0.01 and 0.02 and we thus used a rho of .02. Using STATISTICA, we calculated that, in a simple RCT, a sample of 16 would be necessary in each group if we anticipated that the control group would improve their scores in the knowledge questionnaire to 15 and the experimental up to 29 with the SD gained from the pilot study of 11.8 (based on the feasibility study results). The p value (Alpha) was set at .05, and the power (Sigma) at .9.
|Population mean post intervention of control group||15.00|
|Population mean post intervention of experimental group||29.00|
|Population S.D. (Sigma)||11.80|
|Standardized effect (Es)||−1.19|
|Type I error rate (Alpha)||0.05|
|Critical value of t||2.04|
|Actual power for required N||0.90|
|Required N (per group)||16.0|
If we then enter these values into the equation to calculate the ESS, which is N*number of clusters/design effect , we get (16*4)/ (1+ (16–1)*.02) =48. In other words, to be adequately powered, the study would need a total of 64 participants but due to the design effect, the ESS becomes 48. The sample at each hospital was increased to 50 which would thus give an ESS of 100 to ensure adequate power. Two hospitals were randomly allocated to the experimental arm and two other hospitals to the control arm by a blinded research assistant.
Despite the extensive literature and questionnaire search, no standardised questionnaire was found to measure the intended construct in knowledge of health care professionals on interprofessional practice using the ICF framework. A self-designed questionnaire was developed to monitor the knowledge of health workers of interprofessional practice and the ICF. An integrated case study was designed taking into account the role of different professionals in assessment and management of patient. The questionnaire was developed considering each ICF domain under which the participant should indicate the profession to intervene and the probable required intervention. The questionnaire was composed of three parts: Part one consisted of demographic information such as gender, age, profession, ward/department, level of education and years of experience. Part two presented an integrated case study to inform the answers of the 3rd part. Part three included questions relating to the case study. The respondents were requested to identify problems under each of the ICF domains and then to list the professions that should be involved in management of the condition and the possible intervention that they could give. Each of the correct responses was awarded one mark. Apart from the patient conditions, other items of the questionnaire relate to impairment, current activity limitations, activity limitations anticipated on discharge, participation restrictions, positive and negative personal factors, and environmental factors (facilitators and barriers).
The Attitudes questionnaire was based on the Attitudes Towards Health Care Teams (ATHCT) scale modified by Leipzig et al.  into a 21-item tool with three subscales: Attitudes Toward Team Values (11 items), Attitudes Towards Team Efficiency (5 items), and Attitudes Towards Physician’s Shared Role on Team (5items). The 21-item scale was tested in the feasibility study in Rwandan Hospital setting.
The content validity index (CVI) was calculated based on the responses of three experts who were purposively recruited based on their expertise and availability. The content validity index (CVI) was calculated and the internal consistency and effect size were determined. The final versions of the two questionnaires demonstrated excellent overall scale content validity index (S-CVI) (Knowledge questionnaire: S-CVI = .97; Attitudes Scale: S-CVI = .95). The inter-rater reliability was tested, for the knowledge questionnaire, where the intra-class correlation for absolute agreement was .976 (Confidence Intervals (CIs) = .962, .987). The internal consistency for the Attitudes Scale was (Cronbach’s Alpha = .76).
A model of the transfer of training process by Grossman and Salas  adopted from Baldwin and Ford (1988)  was used. The sessions were held within the hospitals’ facilities (work environment) to ensure maximum relevance to daily work. The content of the training programme was based on literature related to best practice in continuing professional development, faculty development and transfer of training. It was also developed based on the experience from Stellenbosch University through the Centre for Health Professions Education. Drawing on the experience of other programmes, different methods were employed such as participatory lectures, practical sessions, and role playing. After training, the post-test measurements on knowledge and attitudes were obtained. The training content and full trial protocol are available from the corresponding author on request. The control hospitals received no formal training during this time, but they were given a basic introduction to the ICF framework in a didactic lecture which took between one to two hours.
Permission to conduct the study was obtained from the relevant institutions and participants. Ethical approval was sought from the University of Cape Town, Faculty of Health Sciences Human Research Ethics Committee (Ref: HREC/REF: 085/205) and the National Health Research Committee (Ref: NHRC/2015/PROT/016) of Rwanda. The Pan-African Clinical Trial Registry number is PACTR201604001185358. Signed informed written consent was obtained from each health professional who participated.
The intervention was novel and we were unsure whether there would be adequate recruitment and compliance with the study. Therefore a feasibility study with 60 health professionals was carried out at a fifth district hospital which is similar to the settings of the hospitals in the main study but not included in the main study. The pilot indicated that the project would be feasible but that the planned duration of the training (two days) was too long. As a result, the programme was shortened to one day. Other suggestions such as focusing more on case studies and real patients’ records were also implemented. The feasibility study also assisted in the determination of sample size.
After obtaining ethical clearance and permission from the hospital superintendents, the researcher had meetings with the medical chief of staff and chief of nurses to plan the intervention. This included selection of participants to be invited, days of training, allocation of participants to different days in order to maintain the clinical work within the hospitals, and the venue and all logistics needed during training. Participants were divided in three groups (group one to be trained on day one, group two on day two, and group three) to accommodate and recruit at least 50 health professionals at each hospital.
Brief content and description of training
The getting to know one another play combined with describing the own professional role and that of another was the first item of the training. In this activity, the participants explored the roles and responsibilities of different professions. Using the case of a diabetic patient, every participant had to pick the profession which was different from his/her profession. In small groups, the participants wrote everything he/she perceived the profession he/she represented could do for that particular case, bearing in mind the possible complications of the case. They were requested not to talk about their own profession or make corrections.
Clearing misconception: in a large group, the participants presented what they perceived to be the role of other professionals in case management. After presenting each professional’s role, the participants from that profession clearly described the role of their profession in managing the given case. Before lunch, the ICF framework was presented as the framework to provide a common language between health care professionals. After lunch, three patient records were randomly selected and three small groups were formed to be given on patient record making sure that there were mixed groups of different professions. They were requested to identify the problems that were addressed in the patient records and probable problems that were not addressed. Each group had time to present. In plenary, based on the discussed patients’ records, the trainer asked the participants: what are the facilitators and barriers to implementing the interprofessional practice in your hospital? How can you use those facilitators for implementation? How can you address those barriers to implementation?
It was arranged in such a way that each discipline was represented in each group. The participant information letters were provided and consent was obtained from participants who agreed to participate. The same activities were done in the control hospitals.
On the day of training, the pre-test knowledge and attitudes measurements were performed prior to the start of the programme. The two hours ICF introduction in the control group was conducted in one session at each hospital during their morning staff meeting.
In order to facilitate analysis, some of the items in the attitudes questionnaire, which were framed in such a way that a negative response (strongly disagree) was the desirable response, were inverted so that strongly desirable responses were all 5 and strongly undesirable responses were all 1. The analysis was performed by IBM SPSS (version21) and STATISTICA (Version 13.2 DELL INC). Descriptive statistics were used to describe the characteristics of the health care professionals and the scores on the different outcome measures. The experimental and control groups were compared at baseline to ensure equivalence between the demographic characteristics of the participants. The Chi-square test was performed to determine whether there was an association between gender, profession, place of work and group (experimental and control). For continuous variables parametric tests, such as the independent t-test and ANOVA, were used to compare the two groups. As the attitudes scale yielded ordinal data, the Mann-Whitney U test was used to establish if the two sets of groups were equivalent before and after training and Kruskal Wallis test was used for rankings of the scores of different professions before and after the intervention. A significance level (α) of 0.05 was used throughout the study. The data were presented graphically in the form of tables, box plots, and graphs.
A total of 203 health professionals participated in pre and post measurement, ranging from 50 to 53 participants in each hospital. The mean age was 35.7 years (SD = 8.29) and there was no difference in age between the two groups (p = .208). There was no association between gender, profession, place of work and group. However, the experimental group had a significantly greater number of years of experience (p = .030). The proportion of medical doctors who were eligible to attend and did so was lowest of all the health professionals, apart from the mental health workers. A slightly greater percentage of the control group personnel attended (91% compared to 88%). (Table 1).
As can be seen below, there was no significant difference in the mean percentage of correct responses for any section in the Knowledge Questionnaire or in the overall mean percentage of correct responses to the scale on the Pre-intervention tests. The sections which scored highest included items related to impairments of body structure and function (50% correct). This was followed by the activity (17%) and negative personal factors (13%) sections.
Post-intervention testing indicated that there was a highly significant difference between the groups in knowledge in all items and in overall score (p < .001). The difference in the mean total scores between the groups was was 23.6% at post measurement with the experimental group showing the greatest improvement. There was also a significant improvement within group performance in both the experimental and the control group. The experimental group improved 29% and the control group improved 5%. (Table 2).
Due to the relatively small numbers in each group, apart from Nursing, the 95% confidence intervals were large and statistical analysis was not undertaken. Physiotherapists scored the highest in all groups, both pre- and post-intervention, followed by medical doctors in the experimental group. The increase in knowledge in the experimental group was evident across all professions post-intervention. Although the control group also improved, the 95% confidence intervals pre- and post-intervention scores overlapped for all professions apart from the Nursing. (Fig. 1).
Pre-intervention knowledge scores show that physiotherapists scored higher than other professionals in both the experimental and control groups.
The correlation between the pre- and post-intervention scores was rho = 0.353 in the experimental group and rho = 0.396 in the control group, both significant at a p < .01 level.
The level of agreement was almost the same between two groups before intervention, but after intervention the level of agreement was higher in experimental compared to the control group. The median scores of the experimental group improved from 77.8 to 91.1%, whereas the median scores of the control group remained approximately 80%. (Table 3).
There was no significant difference in the ranking of the scores on the attitudes scale of two groups prior to training). However, after training the experimental group scored significantly higher (Adjusted Z = 10.72, p < .001). (Table 4).
The interquartile ranges were large and there was no significant difference detected by the Kruskal Wallis ANOVA between the scores of the different professions in either group, either before or after the intervention. However, Figs. 2 and 3 clearly indicate that, whereas the pattern of scoring remained the same in the control group, with medical doctors scoring the highest both pre- and post- test, the pattern changed considerably in the experimental group post-training. Whereas the doctors scores remained similar, the other three professions showed considerable improvement and all scored higher than the doctors on post-testing. (Figs. 2 and 3).
This study provided evidence that a one day training programme can result in a large improvement in both the knowledge regarding the ICF and IP and attitudes towards teamwork within the Rwandan context. To the best of our knowledge, this is the first study on the use of ICF as a theoretical framework to inform interprofessional assessment and management by health care professionals in a hospital setting within a low to middle income country. There are studies, in other countries, that utilised the ICF to inform interprofessional practice in different health conditions, but these were mostly within academic rather than clinical settings [8, 45, 46]. Furthermore, the majority of studies using ICF in interprofessional care were conducted in rehabilitation settings and in high income countries [37, 47, 49]. However, studies involving interprofessional training using ICF as a communicating framework in hospital settings in resource constrained environments are scarce.
The willingness of district hospital staff to participate was encouraging and 91% of eligible health professionals were recruited, with all disciplines included. Several of those not attending were reported anecdotally to be on leave or have other concerns. The approval granted by the local Human Research Ethics Committee and the support of both the central and local health authorities played an essential role in gaining buy-in from the health professionals. Rwanda has a relatively small pool of health professionals and the high recruitment may be a reflection of the influence that authorities have over the decision making of those employed in the public sector and possible peer pressure. There is a strong commitment to improved health care and the rebuilding of the health care system after the genocide [32, 39] and the high recruitment may have been an indication that the Rwandan public health system is ready to embrace interprofessional teamwork as a means to that end. This is a likely explanation as several respondents, in training satisfaction questionnaire, suggested that the training be incorporated into the training of health professionals at all levels.
The respondents were also relatively young (35.7 years, SD = 8.29) as a large number of health care professionals were trained after the 1994 genocide. Unfortunately, a large number of health care professionals trained before the genocide, while others went in exile. Therefore, Rwanda has started to rebuild its health care system after the genocide [32, 39]. It was also observed that, in Rwanda, a number of health professionals upgraded their education level in other fields and changed their careers to something other than medical after some years of practice. Therefore, this explains the young age group of health care professionals working in Rwanda district hospitals. As younger people may be more responsive and open to new ideas ; the age of the participants could also have contributed to the success of the programme.
Although the proportion of medical doctors and mental health workers recruited was the lowest of all professions, at least 50% did participate. This lower rate of recruitment could have been a source of bias as the traditional hierarchical view may have led to resistance to attending sessions led by a physiotherapist. It is more likely that the lower recruitment rate reflects an increased work load (there were only 19 doctors in the four hospitals). In any case, the first step in breaking down the professional silos is to get the different health professionals talking to each other about issues related to interprofessional practice which was achieved in this study.
The sample thus appears to have been representative of health professionals in the selected hospitals. As a similar staffing complement is deployed to most district hospitals, it is likely that the results can be generalised to all district hospitals in Rwanda.
Impact on knowledge
The pre-intervention results indicated a low level of knowledge regarding the ICF and of the holistic management of patients. The participants scored highest with regard to those aspects of patient management which are traditionally included in the examination of patients. These include the health condition (nearly 50% answered this section correctly), followed by functional problems with regard to limitations in activities and personal characteristics which would impact negatively on health. In contrast, those components which are part of a more holistic approach to management, such as activity limitations anticipated after discharge, participation and the impact of environmental factors were poorly understood. The pre-intervention results supported the original contention that health care in district hospitals in Rwanda adhere to the medical model of care, rather than a more holistic biopsychosocial approach.
It is noteworthy but not surprising that physiotherapists scored higher than other professionals. Most Rwandan physiotherapists were trained in the same institution (University of Rwanda) and are more likely to have some ICF knowledge from their education training as this is offered during the physiotherapy programme. Despite having had previous exposure, they still scored 25% or less, which would indicate that more time should be spent on the ICF and interprofessional practice during their basic training. These results do suggest, however, that the introduction to IPP and the ICF should be included in the undergraduate training curricula of health care personnel.
The intervention resulted in an improvement in both groups, but it was significantly larger in the experimental group. This implies that the provision of a lecture and handouts does result in an increase in knowledge, but that the full day training was more effective in bringing about change. These results were not unexpected. As the knowledge levels were low at base-line, there was much room for improvement. The literature also supports the effectiveness of training in improving knowledge of interprofessional practice . Papers that have reported on effective knowledge transfer through training include those by Pless et al.  in their study evaluating the in-service training in using the ICF and ICF-CY and Phillips et al.  who demonstrated immediate improvement in knowledge after training across all questionnaire items; Ericson et al.  on interprofessional training in health care students; Bays et al.  on interprofessional communication in serious diseases; Bain et al. (2014)  on interprofessional training in chronic disease settings; and Zanotti et al.  in on-field training in interprofessional education among medical students. The positive impact of the two-hour ICF introduction intervention supplied to the control group should not be overlooked, as it may be a cost-effective method to introduce the district health teams to the concepts of interprofessional practice and the ICF.
Interprofessional collaboration could be enhanced by strategies like interprofessional ward rounds, education, clubs, and trainings on top . The ICF framework provides a common language for biopsychosocial holistic patient care facilitates effective interprofessional collaboration . By improving knowledge, interprofessional training can improve the collaborative health care team and the quality of care . Furthermore, the improved knowledge after training may result in both a change in attitude and in practice .
Impact on attitudes
The baseline scores of both groups were high before the intervention. Our findings were consistent with several studies which assessed the impact of interprofessional training in improving attitudes, although many were with health care students across disciplines [10, 14, 25, 40].
Although there were no significant differences detected between the scores of the different professions, this may have been as a result of the small sample sizes for some professions and the large inter-quartile ranges. However, it is interesting to note that, based on the plots of the pre- and post-intervention scores for each group, medical doctors scored highest in each group pre-intervention and showed the least improvement post-intervention. A study conducted by Jacobsen and Lindqvist  demonstrated the change in attitude in other professionals similar to our study, but the scores of medical doctors remained almost the same despite a two-week interprofessional training. The intervention appeared to be most effective for other professions and the lack of effect on medical doctors may due to the fact that they had high pre-intervention attitudes scores.
Though the rigorous feasibility study which led to useful amendments to the protocol, the training and the outcome measures was performed prior to the main study, there are some limitations in this study. These include the level of participation among medical doctors and mental health nurses.
A further consideration is that, post-training socially desirable answers might have become apparent Beaulieu, Adrien, Potvin and Dassa  and this could have resulted in bias towards reporting improved attitudes without a genuine change taking place. This is a problem common to many attitudes scales and it was thus necessary to include the monitoring of behaviour change in addition to the knowledge and attitude changes.
In conclusion, the intervention proved to be effective. The use of the ICF as a framework for training health professionals regarding IP resulted in a significant improvement in knowledge and attitudes regarding interprofessional collaborative practice.. This introduction of the ICF as the framework to inform interprofessional assessment and management in Rwanda could result in the adaptation of the biopsychosocial model and a more holistic approach to care. However, “deep” or fundamental improvement in knowledge and attitudes should be reflected in practice. It is proved to be relatively easy to change knowledge and reported attitudes through training intervention. Indeed, the real change should reflect improved behaviour or daily practice and this were examined in a recently published paper by Sagahutu et al. .
It is hoped that the findings of this study may contribute to improving health care delivery in Rwandan district hospitals and health system at large. It is thus recommended that the framework be used to promote interprofessional education in Rwanda and other similar countries. The bio-psycho-social approach to health care, including IPP, should be introduced in the training of health professionals. The ICF appears to be a useful conceptual framework in which to do this. However, there is a need for reinforcing the training over time for sustainability or retention of knowledge and attitudes.
Availability of data and materials
All data generated or analysed during this study are included in this published article [and its supplementary information files].
Attitudes Towards Health Care Teams scale
Content Validity Index
Human Research Ethics Committee National Health Research Committee
International Classification of diseases
International Classification of Functioning, Disability and Health
International Classification of Functioning, Disability and Health-Children and Youth
Pan African Clinical Trial Registry
World Health Organisation
Allan CM, Campbell WN, Guptill CA, Stephenson FF, Campbell KE. A conceptual model for interprofessional education: the international classification of functioning, disability and health (ICF). J Interprofessional Care. 2006;20(3):235–45. https://doi.org/10.1080/13561820600718139.
Bagraith KS, Strong J. The international classification of functioning, disability and health (ICF) can be used to describe multidisciplinary clinical assessments of people with chronic musculoskeletal conditions. Clin Rheumatol. 2013;32(3):383–9. https://doi.org/10.1007/s10067-012-2130-1.
Bain L, Kennedy C, Archibald D, LePage J, Thorne C. A training program designed to improve interprofessional knowledge, skills and attitudes in chronic disease settings. Journal of Interprofessional Care. 2014;28(5):419–25. https://doi.org/10.3109/13561820.2014.898622.
Baldwin TT, Ford JK. Transfer of training: a review and directions for future research. Personnel Psychology. 1988;41:63–105.
Bays AM, Engelberg Ra, Back AL, Ford DW, Downey L, Shannon SE, Doorenbos AZ, Edlund B, Christianson P, Arnold RW, O’Connor K, Kross EK, Reinke LF, Cecere Feemster L, Fryer-Edwards K, Alexander SC, Tulsky Ja, Curtis JR. Interprofessional communication skills training for serious illness: evaluation of a small-group, simulated patient intervention. J Palliat Med. 2014;17(2):159–66. https://doi.org/10.1089/jpm.2013.0318.
Beaulieu M, Adrien A, Potvin L, Dassa C. Stigmatizing attitudes towards people living with HIV / AIDS : validation of a measurement scale. BMC Public Health. 2014;14(1–13):1246. https://doi.org/10.1186/1471-2458-14-1246.
Borenstein JE, Aronow HU, Bolton LB, Dimalanta MI, Chan E, Palmer K, Zhang X, Rosen B, Braunstein GD. Identification and team-based interprofessional management of hospitalized vulnerable older adults. Nurs Outlook. 2016;64(2):137–45. https://doi.org/10.1016/j.outlook.2015.11.014.
Cahill M, O’Donnell M, Warren A, Taylor A, Gowan O. Enhancing interprofessional student practice through a case-based model. J Interprofessional Care. 2013;27(4):333–5. https://doi.org/10.3109/13561820.2013.764514.
Caldwell KA, Atwal A. The problems of interprofessional healthcare practice in hospitals. Br J Nurs. 2003;12(20). https://doi.org/10.12968/bjon.2003.12.20.11844.
Carr S. Examining health professional students’ attitudes on interprofessional education. 2015. http://search.ebscohost.com/login.aspx?direct=true&db=ccm&AN=109828451&site=ehost-live&scope=site.
Creech H. Measuring Knowledge , Attitudes and Behaviours towards Sustainable Development : Two Exploratory Studies operating support from the Government of Attitudes and Behaviours towards Sustainable Development : Two (Vol. 1, Issue January); 2009.
Daniel MO, Rosenstein AH. Professional communication and team collaboration. Pat Safety Quality. 2007;2:271–84.
Dufour SP, Lucy SD. Situating primary health care within the international classification of functioning, disability and health: enabling the Canadian family health team initiative. J Interprofessional Care. 2010;24(6):666–77. https://doi.org/10.3109/13561820903550671.
Ehrke F, Berthold A, Steffens MC. How diversity training can change attitudes: Increasing perceived complexity of superordinate groups to improve intergroup relations. J Exp Soc Psychol. 2014;53:193–206. https://doi.org/10.1016/j.jesp.2014.03.013.
Ericson A, Masiello I, Bolinder G. Interprofessional clinical training for undergraduate students in an emergency department setting. J Interprof Care. 2012;26(4):319–25. https://doi.org/10.3109/13561820.2012.676109.
Escorpizo R, Kostanjsek N, Kennedy C, Nicol MMR, Stucki G, Ustün TB. Harmonizing WHO’s international classification of diseases (ICD) and international classification of functioning, disability and health (ICF): importance and methods to link disease and functioning. BMC Public Health. 2013;13(1):742. https://doi.org/10.1186/1471-2458-13-742.
Fabrigar LR, Petty RE, Smith SM. Understanding knowledge effects on attitude-behavior consistency : The role of relevance , complexity , and amount of knowledge Understanding Knowledge Effects on Attitude – Behavior Consistency : The Role of Relevance , Complexity , and Amount of Knowled. J Personal Soc Psychol. 2006, 2014. https://doi.org/10.1037/0022-35188.8.131.526.
Fewster-Thuente L, Velsor-Friedrich B. Interdisciplinary collaboration for healthcare professionals. Nurs Adm Q. 2008;32(1):40–8. https://doi.org/10.1097/01.NAQ.0000305946.31193.61.
Frenk J, Chen L, Bhutta ZA, Cohen J, Crisp N, Evans T, Fineberg H, Garcia P, Ke Y, Kelley P, Kistnasamy B, Meleis A, Naylor D, Pablos-Mendez A, Reddy S, Scrimshaw S, Sepulveda J, Serwadda D, Zurayk H. Health professionals for a new century: transforming education to strengthen health systems in an interdependent world. Lancet. 2010;376(9756):1923–58. https://doi.org/10.1016/S0140-6736(10)61854-5.
Grossman R, Salas E. The transfer of training : what really matters. Int J Train Develop. 2011;15(2):103–20.
Hall LW, Zierler BK. Interprofessional education and practice guide no. 1; developing faculty to effectively facilitate interprofessional education. J Interprofessional Care. 2014;00(00):1–5. https://doi.org/10.3109/13561820.2014.937483.
Heinen MM, Van Achterberg T, Roodbol G, Frederiks CMA. Applying ICF in nursing practice: classifying elements of nursing diagnoses. Int Nurs Rev. 2005;52(4):304–12. https://doi.org/10.1111/j.1466-7657.2005.00433.x.
Hemming K, Girling AJ, Sitch AJ, Marsh J, Lilford RJ. Sample size calculations for cluster randomised controlled trials with a fixed number of clusters. BMC Med Res Methodol. 2011;11(1):102. https://doi.org/10.1186/1471-2288-11-102.
Hollar D, Hobgood C, Roberts E, Sawning S, Woodyard D, Ferguson A. Using the ICF to develop patient treatment plans and to promote interdisciplinary teamwork. Disability Health J. 2009;2(1):e1. https://doi.org/10.1016/j.dhjo.2008.10.003.
Jacobsen F, Lindqvist S. A two-week stay in an Interprofessional Training Unit changes students’ attitudes to health professionals. J Interprof Care. 2009;23(3):242–50. https://doi.org/10.1080/13561820902739858.
Killip S, Mahfound Z. What Is an intracluster correlation coefficient? Crucial concepts for primary care researchers. Ann Fam Med. 2004;2(3);204–8. https://doi.org/10.1370/afm.141.INTRODUCTION.
Leipzig RM, Hyer K, Ek K, Wallenstein S, Vezina ML, Fairchild S, et al. Attitudes toward working discipline., interdisciplinary healthcare teams: A comparison. J Am Geriatr Soc. 2002;55(6):1141–8.
Mahdizadeh M, Heydari A, Karimi Moonaghi H. Clinical interdisciplinary collaboration models and frameworks from similarities to differences: a systematic review. Global J Health Sci. 2015;7(6):43259. https://doi.org/10.5539/gjhs.v7n6p170.
Michalos, A. C. (2011). Knowledge , Attitudes and Behaviours. Concerning Education for Sustainable Development : Two Exploratory Studies Knowledge , Attitudes and Behaviours. Concerning Education for Sustainable Development : Two Exploratory Studies. Springer Science+Business Media, February. https://doi.org/10.1007/s11205-010-9620-9
Mickan SM. Evaluating the effectiveness of health care teams. Aust Health Rev. 2005;29(2):211. https://doi.org/10.1071/AH050211.
Miller EL, Murray L, Richards L, Zorowitz RD, Bakas T, Clark P, Billinger SA. Comprehensive overview of nursing and interdisciplinary rehabilitation care of the stroke patient: a scientific statement from the American heart association. Stroke. 2010;41(10):2402–48. https://doi.org/10.1161/STR.0b013e3181e7512b.
Ngoga S. Major Health Problems in East Africa Rwanda. International University of Africa Faculty of Medicine and Health Sciences African Medical Students Association. 2013. https://www.scribd.com/document/187041117/AMSA-IUA-Conference-Proceedings-Jan-2013-8-Rwanda.
Pannick S, Davis R, Ashrafian H, Byrne BE, Beveridge I, Athanasiou T, Wachter RM, Sevdalis N. Effects of interdisciplinary team care interventions on general medical wards: a systematic review. JAMA Intern Med. 2015;175(8):1288–98. https://doi.org/10.1001/jamainternmed.2015.2421.
Pare L, Maziade J, Pelletier F, Houle N, Iloko-Fundi M. Training in interprofessional collaboration. Can Fam Phys. 2012;58:e203–9.
Phillips CB, Hall S, Irving M, Clarke D, Currie K, Ford D, Ani C, Bazargan M, Hindman D, Bell D, Rodriguez M, Baker R, Ormel J, Brink W, Koeter M, Giel R, Meer K, Willige G, Lunay B, et al. Impact of interprofessional education about psychological and medical comorbidities on practitioners’ knowledge and collaborative practice: mixed method evaluation of a national program. BMC Health Serv Res. 2016;16(1):465. https://doi.org/10.1186/s12913-016-1720-z.
Pless M, Ibragimova N, Adolfsson M, Björck-Åkesson E, Granlund M. Evaluation of in-service training in using the ICF and ICF version for children and youth. J Rehab Med. 2009;41(6):451–8. https://doi.org/10.2340/16501977-0359.
Rainey L, van Nispen R, van Rens, G. Evaluating rehabilitation goals of visually impaired children in multidisciplinary care according to ICF-CY guidelines. Acta Ophthalmol. 2014;92(7):689–96. https://doi.org/10.1111/aos.12319.
Rentsch HP, Bucher P, Dommen Nyffeler I, Wolf C, Hefti H, Fluri E, Wenger U, Wälti C, Boyer I. The implementation of the “international classification of functioning, disability and health” (ICF) in daily practice of neurorehabilitation: an interdisciplinary project at the Kantonsspital of Lucerne, Switzerland. Disabil Rehabil. 2003;25(8):411–21. https://doi.org/10.1080/0963828031000069717.
REPUBLIC OF RWANDA. INCLUSIVE DIALOGUE ON THE POST 2015 DEVELOPMENT AGENDA –“HELPING TO STRENGTHEN CAPACITIES AND BUILD EFFECTIVE INSTITUTIONS” Rwanda - Country Report October 2014. 2014. http://www.rw.undp.org/content/dam/rwanda/docs/Researchandpublications/Milleniumdevelopmentgoals/UNDP_RW_Post2015RwandaCountryReport_14.pdf2015RwandaCountryReport_14.pdf.
Ruiz MG, Ezer H, Purden M. Interprofessional informa. J Interprof Care. 2013;27(6):489–95. https://doi.org/10.3109/13561820.2013.851070.
Rwanda Ministry of Health. (2013). Ministry of Health (Republic of Rwanda). National Human Resources Information System (HRIS) http://www.moh.gov.rw/fileadmin/templates/policies/Human_Ressource_for_Health_Policy.pdf
Sagahutu JB, Kagwiza J, Cilliers F, Jelsma J. The impact of a training programme incorporating the conceptual framework of the International Classification of Functioning ( ICF) on behaviour regarding interprofessional practice in Rwandan health professionals : A cluster randomized control trial; 2020. p. 1–17. https://doi.org/10.1371/journal.pone.0226247.
Scott CM, Lagendyk L. Overcoming the challenges of interprofessional teams to improve quality of care (issue December); 2013.
Sharma U, Klocke D. Attitudes of nursing staff toward interprofessional in-patient-centered rounding. J Interprof Care. 2014;28(5):475–7. https://doi.org/10.3109/13561820.2014.907558.
Skarakis-Doyle E, Doyle PC. The ICF as a framework for interdisciplinary doctoral education in rehabilitation: implications for speech-language pathology. Int J Speech-Lang Pathol. 2008;10(1):83–91. https://doi.org/10.1080/14417040701771622.
Snyman S, Von Pressentin KB, Clarke M. International classification of functioning , disability and health : catalyst for interprofessional education and collaborative practice. J Interprof Care. 2015;00(00):1–7. https://doi.org/10.3109/13561820.2015.1004041.
Stallinga HA, Roodbol PF, Annema C, Jansen GJ, Wynia K. Functioning assessment vs. conventional medical assessment: a comparative study on health professionals’ clinical decision-making and the fit with patient’s own perspective of health. J Clin Nurs. 2014;23(7–8):1044–54. https://doi.org/10.1111/jocn.12266.
Supper I, Catala O, Lustman M, Chemla C, Bourgueil Y, Letrilliart L. Interprofessional collaboration in primary health care : a review of facilitators and barriers perceived by involved actors. J Public Health. 2017;37(4):716–27. https://doi.org/10.1093/pubmed/fdu102.
Wijayaratne L. Towards team care. J Ceylon Col Phys. 2015;46(1 & 2):2–6.
Woods S. To Identify and explore the benefits of effective training and development for both organisation and employees of retail. 2014. http://esource.dbs.ie/bitstream/handle/10788/2181/ba_woods_s_2014.pdf?sequence=1.
World Health Organisation. International classification of functioning, Disability and Health. 2001. http://psychiatr.ru/download/1313?view=name=CF_18.pdf
World Health Organisation. Towards a Common Language for Functioning , Disability and Health ICF. Geneva: WHO/EIP/GPE?CAS/013; 2002. http://www.who.int/classifications/icf/icfbeginnersguide.pdf
World Health Organisation. Framework for Action on Interprofessional Education & Collaborative Practice. 2010. http://www.who.int/hrh/resources/framework_action/en/
World Health Organisation. How to use ICF:A Practical Manual for using the International Classification of Functioning, Disability and Health (ICF) (Issue October). 2013a.
World Health Organisation. Transforming and scaling up health professionals’ education and training. World Health Organization guidelines. 2013b. Retrieved from https://www.ncbi.nlm.nih.gov/books/NBK298953/pdf/Bookshelf_NBK298953.pdf.
Yamani N, Asgarimoqadam M, Haghani F, Alavijeh AQ. The effect of interprofessional education on interprofessional performance and diabetes care knowledge of health care teams at the level one of health service providing. Adv Biomed Res. 2014;3:153. https://doi.org/10.4103/2277-9175.137861.
Zanotti R, Sartor G, Canova C. Effectiveness of interprofessional education by on-field training for medical students, with a pre-post design. BMC Med Educ. 2015;15(1):121. https://doi.org/10.1186/s12909-015-0409-z.
Stefanus Snyman for assistance in the initial conception of the study.
This study was funded by the Government of Rwanda through Rwanda education Board. The Rwanda Education Board has funded the scholarship and field work of the main author.
Ethics approval and consent to participate
Ethical approval was sought from the University of Cape Town, Faculty of Health Sciences Human Research Ethics Committee (Ref: HREC/REF: 085/205) and the National Health Research Committee (Ref: NHRC/2015/PROT/016) of Rwanda. The Pan-African Clinical Trial Registry number is PACTR201604001185358. Signed informed written consent was obtained from each health professional who participated.
Consent for publication
No individual data like photo or video of any person included in the manuscript. Health professionals participated in this study were informed that the data will be published.
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Sagahutu, J.B., Kagwiza, J., Cilliers, F. et al. The impact of a training programme incorporating the conceptual framework of the International Classification of Functioning (ICF) on knowledge and attitudes regarding interprofessional practice in Rwandan health professionals: a cluster randomized control trial. BMC Med Educ 21, 139 (2021). https://doi.org/10.1186/s12909-021-02537-7
- District hospital