Evidence based practice profiles: Differences among allied health professions
© McEvoy et al; licensee BioMed Central Ltd. 2010
Received: 18 May 2010
Accepted: 12 October 2010
Published: 12 October 2010
Most previous studies of allied health professionals' evidence based practice (EBP) attitudes, knowledge and behaviours have been conducted with profession specific questionnaires of variable psychometric strength. This study compared the self-report EBP profiles of allied health professionals/trainees in an Australian university.
The Evidence-Based Practice Profile (EBP2) questionnaire assessed five domains (Relevance, Terminology, Practice, Confidence, Sympathy) in 918 subjects from five professional disciplines. One and 2-way factorial analysis of variance (ANOVA) and t-tests analysed differences based on prior exposure to EBP, stage of training, professional discipline, age and gender.
There were significant differences between stages of training (p < 0.001) for all domains and between EBP exposure groups for all but one domain (Sympathy). Professional discipline groups differed for Relevance, Terminology, Practice (p < 0.001) and Confidence (p = 0.006). Males scored higher for Confidence (p = 0.002) and females for Sympathy (p = 0.04), older subjects (> 24 years) scored higher for all domains (p < 0.05). Age and exposure affected all domains (p < 0.02). Differences in stages of training largely explained age-related differences in Confidence and Practice (p ≤ 0.001) and exposure-related differences in Confidence, Practice and Sympathy (p ≤ 0.023).
Across five allied health professions, self-report EBP characteristics varied with EBP exposure, across stages of training, with profession and with age.
The provision of training in the five steps of evidence based practice (EBP): ask, acquire, appraise, apply and analyse/adjust, are seen as the key skills required for life-long learning for professional decision-making . While much of the early drive toward incorporating evidence into clinical practice occurred in medicine (evidence- based medicine approach), this concept now extends to allied health and social care professions . While the past focus for EBP has been training of health graduates within the health workplace, more recently the importance of embedding training and evaluation of skills in EBP into undergraduate curricula, has been recognised .
With longer life expectancy, availability of advanced medical care and associated rising health care costs, EBP has been embraced by governments around the world. This provides 'checks and balances' between researchers and clinicians to inform each other in the provision of efficient and effective health care with a flow-on effect into medical and health training institutions. Implementing EBP in curricula is not a matter of choice for universities: it has become a necessity. There are good pedagogical reasons for embedding EBP within curricula with much emphasis on the teaching-research nexus and the need to provide opportunities for research to inform and underpin both the content of what is taught, and the way in which it is taught.
Appropriate training in knowledge, attitudes and skills are the foundation for an EBP approach. While training and assessment of knowledge and skill components of EBP can be achieved in a number of ways, the attitudinal/perceptual component to EBP is less clearly defined. Dawes et al. (2005) have suggested that attitudes towards EBP are 'caught' rather than 'taught', as part of immersion in the professional culture and cannot be entirely directed or dictated by curricula.
There are an abundance of studies concerning allied health professionals' self-reported attitudes, knowledge and behaviours toward EBP. The majority of studies have been conducted within individual professions, such as physiotherapy, occupational therapy, medical radiation and podiatry [3–13]. Studies across health professional disciplines are less common [14–19] and subgroup analysis among professions is rare [16–19]. Rather than the clinical use of EBP, Metcalfe et al. (2001) and Pain et al. (2004) compared discipline groups (speech therapists, occupational therapists and physiotherapists) for the perceived importance of research and for orientation toward research respectively. To date, there appears to be only one study which specifically compared knowledge and use of EBP among practising allied health professionals . Upton and Upton (2006) reported significant differences in knowledge and use of EBP among professions but prior exposure and training in EBP was not explored as an explanatory variable.
Collating information about an individual's behaviours, beliefs and attitudes has been used to construct profiles of individuals in the finance and law enforcement arenas (credit or criminal profiles) . When sufficient numbers of profiles are available, analysis of patterns within the data may predict future behaviours. An individual's 'EBP profile' may be constructed via responses in domains commonly associated with EBP: knowledge, confidence, behaviours and attitudes. The aim of the current study was to explore the influences of a range of characteristics on an individual's EBP profile. While there are many characteristics that may influence an EBP profile, this study prospectively explored the influence on EBP profiles of the primary variables of prior exposure to EBP training, stage of professional training (undergraduate years, post-graduate) and professional allied health disciplines (physiotherapy, occupational therapy, podiatry, medical radiation, human movement) with age and gender explored as secondary variables.
In this study, the primary research question was: Do prior exposure to EBP, stage of training, and professional health discipline, influence the EBP profile? Secondary analysis considered the influence of age and gender.
This cross-sectional, descriptive study recruited academic staff and students at a large Australian university across a number of health sciences disciplines and stages of training, to complete a self-report questionnaire. To enable maximum recruitment the questionnaire was delivered face-to-face (paper-based) to students and was also available in both paper and online versions for completion by staff. Ethical approval for this study was granted by the Human Research Ethics Committee of the University of South Australia.
Recruitment procedures were designed to provide an opportunity for all academic staff and students of five allied health professional disciplines to complete the questionnaire. At the time of the study, there were 120 full and part-time academic staff and 1676 full and part-time undergraduate students in the School of Health Sciences, University of South Australia dispersed across bachelor degree programs in physiotherapy, occupational therapy, podiatry, medical radiation and human movement. These five degree programs included varying exposures to research training (statistics and research methods) and EBP.
The Evidence-Based Practice Profile (EBP2) takes 10-12 minutes to complete and consists of a total of 58 items, each using a 5-point Likert scale, with a further 13 items which address demographic characteristics including age, gender, professional discipline, stage of training (year level for undergraduates or post-graduate) and prior exposure to EBP training. The questionnaire includes five domains (Relevance, Terminology, Confidence, Practice, Sympathy) (McEvoy et al. 2010). Relevance (14 items) refers to the value, emphasis and importance placed on EBP; Terminology (17 items) refers to the understanding of common research terms; Confidence (11 items) refers to the perception of an individual's abilities with EBP skills; Practice (9 items) refers to the use of EBP in clinical situations and Sympathy (7 items) refers to the individual's perception of the compatibility of EBP with professional work. Psychometric testing during the development of the EBP2 confirmed test retest reliability (intraclass correlation coefficients ranging from 0.77 to 0.94), internal consistency (Cronbach's alpha 0.96) and validity (convergent validity Pearson correlation coefficient for domains ranging from r = 0.54-0.80) . Responses to the EBP2 were able to distinguish groups with different levels of prior EBP exposure for three of the five domains of the instrument (Relevance, Terminology and Confidence, ANOVA p < 0.001 to 0.004).
Program directors in five health disciplines (physiotherapy, podiatry, occupational therapy, medical radiation and human movement) were contacted and asked to identify a class in each year level where students could be invited to complete a paper version of the questionnaire. All students were sent an information sheet prior to this class. All academic staff were invited to complete a paper version of the questionnaire at a routine monthly meeting where an inventory of attendance was made. Academics not in attendance were followed up by email and provided with an opportunity to complete the questionnaire by paper or an electronic version. All returned questionnaires remained anonymous with identification codes used for distinguishing staff and programs.
All data management and analysis was undertaken using SPSS Statistics 17.0 (Chicago, IL). Data were entered or imported into SPSS and checked for missing values. While there are a number of mathematical approaches to address missing data, hot deck imputation has been reported amongst those recommended . Missing values were imputed using the "Hot Deck" method where there was completion of at least 75% of the non-demographic items. This involved filling missing data responses with responses determined from the most similar complete records. Where more than 25 percent of the non-demographic items were not complete the record was excluded from further analysis.
Participants were categorised to form subgroups based on exposure to EBP (no exposure, ≤ 20 h, > 20 h), stage of training (1st, 2nd, 3rd/4th combined undergraduate, post-graduate), disciplines (physiotherapy, podiatry, occupational therapy, medical radiation, human movement), age ≤ 24 yrs, > 24 yrs) and gender (female, male). Due to the small number of undergraduate students completing a 4th year of their degree (only in physiotherapy) the 3rd and 4th year groups were combined. For the subgroup analysis of stage of training, graduates and staff subjects were referred to as 'post-graduate'. The age categories aimed to separate subjects currently enrolled or who had previously completed bachelor degrees, with 24 years chosen, as this is the age at which most Australians continuing university studies direct from school (± a chosen deferred year), will have completed an entry level degree.
One-way factorial analysis of variance (ANOVA), t-tests and post hoc tests [Tukey's Honestly Significant Difference (HSD) test] were used to analyse differences among the levels of the primary variables (prior EBP exposure, stage of training, professional discipline) and secondary variables (age and gender) on the EBP domain scores for Relevance, Terminology, Confidence, Practice and Sympathy. Significance was set at p < 0.05. Because there were likely to be strong correlations among age, level of exposure and stage of training, two-way factorial ANOVAs were used where appropriate to explore possible confounding variables. Because of missing cells, it was not possible to perform a three-way ANOVA.
The EBP2 was completed by 933 subjects of which 898 were students from a potential 1676 students enrolled in the included bachelor programs (student response rate 54%). The specific bachelor program was known for 884 of these students. Based on enrolled bachelor students in the discipline programs, this constituted 60% in physiotherapy, 50% in podiatry, 63% in occupational therapy, 71% in medical radiation and 39% in human movement. The questionnaire was completed by 35 of 120 post-graduates (mostly academic staff giving a response rate 29%). There was > 25% of incomplete data for 15 subjects (14 students and one post-graduate) and these records were excluded from any further analysis. In the final dataset of 918 included for analysis, there were 884 students and 34 post-graduates.
Demographic details (age, gender, EBP training, stage of training and discipline groups) of the sample
Number completing item
Mean Age (SD) range
22 (7) 17-59 years
Number completing item
Number completing item
Single lecture (1-3 h)
Weekend course (3-10 h)
Short course (10-20 h0
University course (> 20 h)
Stage of training
Number completing item
3rd year/4th year
Number completing item
Mean (SD) and p values for factorial ANOVA for three EBP training groups (n = 880), for four stages of training (n = 915) and for five discipline groups (n = 887) for Relevance, Terminology, Confidence, Practice and Sympathy.
Domain (max possible score)
Prior exposure to EBP
No training n = 618
≤ 20 h training n = 106
> 20 h training n = 156
Stage of training
1st year n = 236
2nd year n = 300
3rd/4th year n = 345
Post-graduate n = 34
26 (4)ab c
Physiotherapy n = 242
Podiatry n = 44
Occupational Therapy n = 171
Medical Radiation n = 173
Human Movement n = 257
Mean (SD) and p values for independent t-tests for two age groups (n = 724), for gender (n = 898) for the 5 domains (Relevance, Terminology, Confidence, Practice, Sympathy)
Domain (max possible score)
17-24 n = 736
> 24 YRS n = 149
Female n = 645
Male n = 253
While significant differences existed between domain scores for age, exposure and stage of training categories, these differences were potentially confounded by the strong inter-correlations between these three variables. To test this hypothesis, three 2-way ANOVAs were conducted with age and exposure levels, age and stage of training and stage of training and exposure levels as grouping domains.
Significant main effects were evident for age and exposure for all five domains (Relevance: p < 0.001 and p < 0.001 respectively; Terminology: p < 0.001 and p < 0.001; Confidence: p = 0.019 and p < 0.001; Practice: p = 0.005 and p < 0.001; Sympathy: p < 0.001 and p < 0.001).
Significant main effects were evident for age and stage of training for the domains of Relevance (p < 0.001 and p < 0.001 respectively), Terminology (p = 0.025 and p < 0.001), and Sympathy (p = 0.012 and p < 0.001). For Confidence and Practice, there was a significant main effect for stage of training only (p < 0.001), and the main effect for age did not reach statistical significance.
Significant main effects were evident for stage of training and EBP exposure for Relevance (p < 0.001 and p < 0.001 respectively) and Terminology (p < 0.001 and p < 0.001). For Confidence, Practice and Sympathy there was a significant main effect for stage of training (p = 0.023, p < 0.001 and p < 0.001 respectively) but the main effect for EBP exposure did not reach statistical significance.
Strengths and limitations
This is the first study to demonstrate that the self-report EBP profile differs with the degree of prior exposure to formal EBP training and with the stages of training (undergraduate and post-graduate) and differs across allied health professional disciplines. While the best teaching practices and processes for EBP remain unclear, the findings in this study support early and repeated exposure to provide the optimal opportunities for reinforcing an EBP approach. The study was not designed to explore why the differences exist (across stages of training and professions and exposures) or to suggest how EBP should be taught but the findings provide a cross-sectional description of predominantly undergraduate allied health EBP profiles in one Australian university. As they are likely to reflect the culture of this university, at this stage the findings should not be generalised to the EBP culture of health professionals at a national or international level. While providing an insight into the EBP profile of a large school within one university at one point in time there is obviously value in conducting future longitudinal studies, comparative studies and studies incorporating larger non-student populations.
Primary variables, pattern and comparison with previous studies
It is possible that the changes in domain scores could be affected by the time that elapses while taking EBP courses, time while progressing through the years of a university program or just getting older. Notwithstanding the possibility of these secular contributions to the cross-sectional findings, the consistent gradients between age, exposure and stage of training, and the domains of Relevance and Terminology, suggest that EBP training can positively affect these domains. Confidence in the skills of EBP demonstrated fewer differences across stages of training. Upton and Upton (2006) reported similar findings and suggested that the actual skills may not match the perception of abilities. In the current study one can only speculate that confidence levels may mask a lack of awareness of limitations in skills in the early years of training on the one hand, and lack of acknowledgement of advancement in skills in the later years of a program on the other hand, that is, 'the more you know, the more you realise you don't know'.
Different professional 'strengths' were reflected in the current study in higher domain scores for attitudes, knowledge and practice of EBP across professions (occupational therapists reported higher scores for Practice, physiotherapists for Relevance, physiotherapists and podiatrists for Terminology). While the Canadian study by Pain et al (2004) focussed on research rather than EBP, speech therapists placed significantly greater value on research and its use in clinical practice than physiotherapists and occupational therapists. In addition, while physiotherapists were least likely to have undertaken formal research training and had the greatest number of years in practice, this did not translate to any difference in time spent on involvement in research activities (eg grant writing, data collection and analysis, and research presentation) when compared to the other professions . In a United Kingdom study, Upton and Upton (2006), reported significant differences in knowledge and use of EBP between 14 professional disciplines including physiotherapists (n = 98), occupational therapists (n = 86), podiatrists (n = 20) and radiographers (n = 70). Confidence in research skills, and application of these in general, rated more poorly in these four professions when compared to professions such as medical physicists and psychologists. There were no data reported by Upton and Upton (2006) on prior exposure to EBP training.
Secondary variables, pattern and comparison with previous studies
Not unexpectedly, older subjects scored higher than younger subjects for each domain of the EBP2 questionnaire. It is likely that with increasing years, greater potential for both formal and informal exposure to EBP training may have occurred. The findings from the two-way factorial ANOVAs suggested that while age and exposure both affected all factors, age-related differences in Confidence and Practice were largely explained by differences in stages of training, and exposure-related differences in Confidence, Practice and Sympathy were largely explained by differences in stage of training. Stage of training, perhaps because it combines maturity and exposure, may be the key variable. To date, gender differences with respect to EBP have not been reported. Our findings indicated that males were significantly more confident in their EBP knowledge and skills while females were more positive in their attitudes and sympathy to EBP.
While a broad measure of prior exposure to EBP training was included in the EBP2 questionnaire, the main limitations to interpreting the findings stem from the lack of detail concerning the nature of this prior EBP exposure. There were significant differences in the EBP profile for participants who had > 20 hours formal training, differences among stages of training for undergraduate students and differences among disciplines. Within the curriculum for each of the disciplines included in this study, EBP training was included in a variety of modes but there was no consistent curriculum or pedagogical approach. For example, at the time of this study, the physiotherapy degree included a core EBP course within the curriculum while all other professional disciplines disseminated EBP training and philosophy across a number of courses. However, each professional discipline demonstrated high scores in at least one of the EBP domains suggesting that knowledge or attitudinal changes resulted from the EBP training curriculum.
It is tempting to suggest that the higher scores in EBP Relevance and in knowledge of EBP Terminology reflect more effective training for these characteristics in current curricula than the characteristics of Confidence and Practice of EBP. It may also be that Confidence and Practice are not able to be effectively taught within the formal university curriculum and change in these domains is more likely to be influenced by consistent immersion in clinical practice. The impact of professional socialisation on undergraduate students' attitudes and experience is difficult to gauge. In concert with exposure to academics within their respective professions, allied health students undertake clinical practice/field work in a range of settings (hospitals, schools, community centres, health centres) and will come into contact with a large variety of people (clinicians, supervisors, administrators, patients). In these encounters, the attitudes and behaviours of individual staff toward evidence-based practice is likely to be highly variable in terms of empathy, approval and understanding of EBP. This again takes us back to the question: "Is EBP taught or caught?" For Confidence, Practice and Sympathy it appears that both may contribute.
What needs to be done now?
These observed cross-sectional relationships need to be complemented by longitudinal studies to allow for separation of genuine self-report changes from those which may be secular patterns. There is a need also to explore the relationship between the nature of EBP training in the undergraduate curriculum (in relation to the total time spent in formal training, the content, the timing of this training through a program, the format, assessment etc) and the characteristics of a self-report profile (Relevance, Knowledge, Confidence, Practice and Sympathy). Once this is known, intervention studies into the effects of training on EBP profiles can be conducted, and it may be possible to identify areas responsive and unresponsive to formal training.
Growing evidence suggests that EBP is making in-roads into allied health. There is currently little existing literature however on the differences among health professions in terms of their knowledge, attitudes or practice of EBP. This study shows clear cross-sectional differences. Self-report knowledge, attitudes and behaviours vary with exposure, chosen profession, progression through a program and with age but there is no clear indication about which domains may be modified to bring about effective life-long learning in EBP. If the ultimate aim of EBP training is to have all allied health professionals confident, knowledgeable and skilled in the practice of EBP, greater effort needs to be exerted in determining how best to deliver the training, how much training, content, length and positioning of training courses throughout programs of study.
MPM is a Lecturer, School of Health Sciences, University of South Australia and PhD candidate. Her research interests are in education of undergraduate health sciences students, teaching and curricula development and implementation of EBP.
MTW is an Associate Professor, School of Health Sciences, University of South Australia. Her research interests include evidence based practice education with particular reference to educational processes for best research evidence and sensation of breathlessness in chronic pulmonary conditions.
TSO is a Professor of Health Sciences at the University of South Australia. His research interests include the links between time use and health outcomes, mathematical modelling of sports performance, anthropometry and historical trends in fitness, fatness, food intake and sleep of children
The authors would like to thank the program directors, course co-ordinators and subjects from the School of Health Sciences, University of South Australia who have given their time and support to this study. Special thanks to Lynsey Willenberg for her diligence and thoroughness in the co-ordination of the data collection and data entry.
The study was supported for data collection and data entry, by a Teaching and Learning Grant from the University of South Australia.
- Dawes M, Summerskill W, Glasziou P, Cartabellotta A, Martin J, Hopayian K, Porzsolt F, Burls A, Osborne J: Sicily statement on evidence-based practice. BMC Med Educ. 2005, 5 (1).
- Glasziou P, Burls A, Gilbert R: Evidence based medicine and the medical curriculum. The search engine is now as essential as the stethoscope. BMJ. 2008, 337 (27th September): 704-705.Google Scholar
- Bennett S, Tooth L, McKenna K, Rodger S, Strong J, Ziviani J, Mickan S, Gibson L: Perceptions of evidence-based practice: A survey of Australian occupational therapists. Aust Occup Ther J. 2003, 50 (1): 13-22. 10.1046/j.1440-1630.2003.00341.x.View ArticleGoogle Scholar
- Bristow I, Dean T: Attitudes of practitioners towards evidence-based practice - a survey of 2000 podiatrists and chiropodists. Br J Podiatry. 2003, 6 (2): 48-52.Google Scholar
- Connolly BH, Lupinnaci NS, Bush AJ: Changes in attitudes and perceptions about research in physical therapy among professional physical therapist students and new graduates. Phys Ther. 2001, 81 (5): 1127-1134.Google Scholar
- Iles R, Davidson M: Evidence based practice: a survey of physiotherapists' current practice. Physiother Res Int. 2006, 11 (2): 93-103. 10.1002/pri.328.View ArticleGoogle Scholar
- Jette DU, Bacon K, Batty C, Carlson M, Ferland A, Hemingway RD, Hill JC, Ogilvie L, Volk D: Evidence-based practice: beliefs, attitudes, knowledge, and behaviors of physical therapists. Phys Ther. 2003, 83 (9): 786.Google Scholar
- Kamwendo K: What do Swedish physiotherapists feel about research? A survey of perceptions, attitudes, intentions and engagement. Physiother Res Int. 2002, 7 (1): 23-34. 10.1002/pri.238.View ArticleGoogle Scholar
- McKenna K, Bennett S, Dierselhuis Z, Hoffmann T, Tooth L, McCluskey A: Australian occupational therapists' use of an online evidence-based practice database (OTseeker). Health Info Libr J. 2005, 22 (3): 205-214. 10.1111/j.1471-1842.2005.00597.x.View ArticleGoogle Scholar
- McCluskey A: Occupational therapists report a low level of knowledge, skill and involvement in evidence-based practice. Aust Occup Ther J. 2003, 50 (1): 3-12. 10.1046/j.1440-1630.2003.00303.x.View ArticleGoogle Scholar
- Powell CA, Case-Smith J: Information literacy skills of occupational therapy graduates: A survey of learning outcomes. J Med Libr Assoc. 2003, 91 (4): 468-477.Google Scholar
- Salbach NM, Jaglal SB, Korner-Bitensky N, Rappolt S, Davis D: Practitioner and organizational barriers to evidence-based practice of physical therapists for people with stroke. Stroke. 2007, 87: 1284.Google Scholar
- Upton D: Clinical effectiveness: how much do radiographers know about it and what do they think of the concept?. Radiography. 1999, 5 (2): 79-87. 10.1016/S1078-8174(99)90035-4.View ArticleGoogle Scholar
- Caldwell K, Coleman K, Copp G, Bell L, Ghazi F: Preparing for professional practice: how well does professional training equip health and social care practitioners to engage in evidence-based practice?. Nurse Educ Today. 2007, 27 (6): 518-528. 10.1016/j.nedt.2006.08.014.View ArticleGoogle Scholar
- Henderson A, Winch S, Holzhauser K, De Vries S: The motivation of health professionals to explore research evidence in their practice: an intervention study. J Clin Nurs. 2006, 15 (12): 1559-1564. 10.1111/j.1365-2702.2006.01637.x.View ArticleGoogle Scholar
- Taylor R, Reeves B, Mears R, Keast J, Binns S, Ewings P, Khan K: Development and validation of a questionnaire to evaluate the effectiveness of evidence-based practice teaching. Med Educ. 2001, 35 (6): 544-547. 10.1046/j.1365-2923.2001.00916.x.View ArticleGoogle Scholar
- Metcalfe C, Lewin R, Wisher S, Perry S, Bannigan K, Moffett JK: Barriers to implementing the evidence base in four NHS therapies. Physiotherapy. 2001, 87 (8): 433-441. 10.1016/S0031-9406(05)65462-4.View ArticleGoogle Scholar
- Pain K, Magill-Evans J, Darrah J, Hagler P, Warren S: Effects of profession and facility type on research utilization by rehabilitation professionals. J Allied Health. 2004, 33 (1): 3-9.Google Scholar
- Upton D, Upton P: Knowledge and use of Evidence-based practice by Allied Health and Health Science professionals in the United Kingdom. J Allied Health. 2006, 35 (3): 127.Google Scholar
- Turvey BE: Criminal profiling: an introduction to behavioral evidence analysis. 2008, Burlington, MA: Elsevier, 3Google Scholar
- McEvoy MP, Williams MT, Olds TS: Development and psychometric testing of a trans-professional evidence-based practice profile questionnaire. Med Teach. 2010, 32: e373-e380. 10.3109/0142159X.2010.494741.View ArticleGoogle Scholar
- Hawthorne G, Elliott P: Imputing cross-sectional missing data: comparison of common techniques. Aust NZ J Psychiat. 2005, 39 (7): 583-590.View ArticleGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6920/10/69/prepub