Skip to main content
Download PDF

Relationship between clinician-level attributes and implementation outcomes from the Pathways to Comorbidity Care training program

BMC Medical Education volume 22, Article number: 605 (2022) Cite this article

Abstract

Background

The process of determining the best strategy for increasing the uptake of evidence-based practice might be improved through an understanding of relevant clinician-level factors. The Pathways to Comorbidity Care (PCC) training program (Louie E, et al., J Dual Diagnosis 17:304–12, 2021) aimed to facilitate integrated management of comorbid drug and alcohol and mental disorders amongst drug and alcohol clinicians. We hypothesised that uptake of integrated management of comorbidity following the implementation of the PCC program would be associated with clinician-level: (i) demographics (gender, education, experience), (ii) attitudes (evidence-based practice, therapist manuals, counselling self-efficacy), and (iii) organisational readiness to change.

Methods

Twenty clinicians participated in the 9-month PCC training program. Attitudes towards evidence-based practices and psychotherapist manuals, self-efficacy, and organisational readiness to change, along with demographics, were measured at baseline. At follow-up, change in Comorbidity Practice (CoP) scores related to integrated comorbidity management were obtained using a file audit checklist and categorised into high (at least 60% increase in CoP), medium or low (a decrease of − 20% or less in CoP). Clinician-level characteristics were examined across the implementation categories.

Results

There were no significant differences found between implementation groups on sociodemographic variables (p’s > 0.30), attitudes to evidence-based practices, attitudes to therapist manuals, and self-efficacy (p’s > 0.52). The high implementation group demonstrated significantly higher scores on leadership practices aspect of organisational readiness to change relative to the low and medium implementation group ((F(2, 16) = 3.63, p = 0.05; Cohen’s d = .31) but not on the other subscales (p’s > 0.07).

Conclusions

Confidence that leadership will play a positive role in the implementation process may improve effectiveness of comorbidity training programs for drug and alcohol clinicians. On the other hand, contrary to our hypothesis, counselling self-efficacy, evidence-based practice attitudes, attitudes towards therapist manuals, gender, education and experience were not distinguishing factors.

Peer Review reports

Background

There is a growing consensus in the literature regarding the role of evidence-based practice (EBP) implementation in improving public healthcare provision [1,2,3,4,5,6]. These implementation processes are particularly challenging within the human services, where technological innovations are delivered by individuals and organisations operating within complex and multi-level systems of influence [3, 7]. The drug and alcohol treatment setting exemplifies this complexity [8]. While there are many factors that may mediate the process of implementing EBPs in drug and alcohol treatment settings, it is important to consider that individual clinicians have a considerable amount of autonomy regarding the decision to adopt and implement a new EBP [9]. Clinicians asked to adopt EBPs related to comorbid drug and alcohol and mental health disorders, for instance, have been hesitant to treat mental health issues, which may be due to a history of siloed drug and alcohol and mental health services and a lack of mental health training [10]. Research into the effects of provider-level characteristics on implementation outcomes within substance use disorder settings is limited [11]. One approach has been to examine the extent to which these factors influence treatment delivery fidelity of evidence-based interventions following implementation efforts.

From a theoretical perspective, social cognitive theories have been widely used to explain health-related behaviours of individuals [12]. Although very little research had previously applied social cognitive theories to the study of health practitioner behaviour [13], these theories have been more frequently incorporated into implementation research over the past decade (e.g. [14,15,16]), and research evaluating EBP implementation in drug and alcohol settings has often been guided by the assumption that clinician factors have an important relationship to implementation fidelity [17]. Clinician factors most frequently measured in such studies include demographics (e.g. gender, age, experience, education, [18,19,20,21,22,23,24,25,26,27,28,29,30,31,32,33]), knowledge [25, 31, 33] and attitudes [18, 21, 22, 26, 27, 29]). Organisational change theories such as Rogers’ [34] diffusion of innovations theory have also highlighted the importance of clinician perceptions of the capacity of their organisation to support and implement new innovations, and drug and alcohol clinician perceptions of factors related to their organisational context have been evaluated as a possible mediator of implementation fidelity [18].

While clinician demographics have frequently been included in studies investigating factors related to implementation fidelity in drug and alcohol contexts, significant relationships are not often found [17]. Outcomes of studies investigating the relationship between drug and alcohol clinician knowledge and attitudes and implementation fidelity have been mixed. For instance, some studies have demonstrated that clinicians who are prepared for change and who have positive attitudes to EBP are more likely to implement such practices [18, 35,36,37], while others have not found a strong relationship between treatment fidelity and attitudes such as interest, confidence and commitment to EBPs [21, 29, 38]. Clinician perceptions of the organisational climate comprise a distinct set of beliefs found to influence implementation outcomes in drug and alcohol settings [29, 39].

The Pathways to Comorbidity Care (PCC) project evaluated the implementation of a multi-modal training package designed to improve Clinician Practice (identification and treatment), confidence (self-efficacy), knowledge and attitudes to comorbid substance use and mental disorders [40]. The PCC program was designed to upskill clinicians in an evidence-based, integrated management approach to the treatment of comorbidity. An integrated approach suggests that both the substance use and the mental health disorders are treated by the same clinician or within the same service. The PCC training included both didactic (seminar day and website with comorbidity resources) and interactive (clinical champion run group workshops and individual supervision) components. We have previously reported that the training package improved the percentage of clinical files demonstrating identification and management of comorbidity, self-efficacy, and attitudes toward screening and monitoring of comorbidity [41]. Barriers and facilitators of the PCC program have also been reported previously [42]. Specific facilitators of the implementation included characteristics of the intervention (credible source, uncomplicated approach, convincing evidence and quality design), a good consideration of patient needs, factors within the organisation (positive learning environment, leadership engagement), and the use of clinical champions. Mixed results were found with regards to clinician characteristics whereby self-efficacy was a strong facilitator, while specific personal beliefs and attitudes were implementation barriers [42].

Given inconsistencies in the existing literature regarding the role of clinician demographics and attitudes in facilitating implementation, in this study we aimed to examine the relationship between clinician characteristics on EBP implementation in the PCC program through a secondary analysis of data from the main study. We hypothesised that high implementation would be associated with characteristics across two domains: (i) attitudes (positive attitudes to evidence-based practice and therapist manuals, higher counselling self-efficacy), and (ii) more positive perceptions of organisational readiness to change. We also included demographics (higher levels of education, increased experience) in our analysis to explore any possible relationships present in this sample.

Methods

Details of this multi-modal training package have been published previously [43]. Findings reported here are based on a secondary analysis of data obtained in the original study.

Recruitment

The study was approved by the Human Ethics Review Committees of the Sydney Local Health District, South Western Sydney Local Health District, Central Coast Local Health District, Hunter New England Research Ethics and Governance Office which covered two participating services, and Mid North Coast Local Health District (X16-0440 & HREC/16/RPAH/624).

Six outpatient and community drug and alcohol services within the NSW Health system in New South Wales, Australia, participated in the Pathways to Comorbidity Care (PCC) project. Three of the six services participated in the PCC training program and the remaining three formed the control group for the study. Findings reported here only pertain to the PCC training group.

In total, 29 eligible clinicians from the PCC training group returned consent forms. Of the 29 participants initially enrolled in the study, 20 completed the study. Clinicians in the PCC condition completed baseline and follow-up assessments, including an interview related to their participation in the training. All sites provided clinical notes at baseline and follow-up, which were used to assess practice change. Only the baseline assessment and practice change assessment are examined in this study.

Measures

A comprehensive account of assessments has been provided previously [44]. Measures relevant to this study include: the adapted version of the Personnel Data Inventory (an index of demographic and professional information; [39]); the Evidence-Based Practice Attitudes Scale (EBPAS; [45]) which evaluates four aspects of attitude towards evidence based practice (i.e. intuitive appeal, likelihood of adopting if required to, openness to new practices and perceived divergence of practice with evidence-based practice), and has been found to have a moderate to excellent reliability [46]; the Survey of Attitudes to Therapist Manuals (SATM) which addresses experience with treatment manuals, attitudes towards treatment manuals, and beliefs about the content of treatment manuals [47], and has been validated psychometrically using factor analysis and internal consistency [47]; the Addiction Counseling Self-Efficacy Scale (ACSES: [48]) which assesses self-efficacy of treating comorbid drug and alcohol and mental health problems, and factor analyses have supported the validity of the subscales and total score [48]; and the Organizational Readiness for Change Assessment Tool (ORCA: [49]) which measures organisational readiness for implementing practice change in healthcare settings, and is considered a valid and reliable measure [50]. File audits of clinical notes made during the 3 months prior to baseline and follow-up (10 files per clinician) were evaluated using a checklist for Comorbidity Practice (CoP). This checklist assessed four relevant practice themes for presence and quality: screening, assessment, treatment and referral.

Analysis

Participants were divided into low, medium and high implementers based on the degree of change in CoP between baseline and follow-up. CoP scores were derived from file audits of clinical notes (10 per clinician at each time point), which were evaluated using a checklist of important practice themes (screening and monitoring, assessment, treatment and referral) by one researcher and one clinician (clinical supervisor). Previously studies of the PCC program have evaluated Clinical Practice by determining the percentage of total clinical files demonstrating identification and treatment of comorbidity over a set rate. For the current study, we assessed clinical practice change in greater depth by deriving a Comorbidity Practice (CoP) score from the presence and quality of a checklist of integrated comorbidity management themes in clinical files. For each theme, scores ranged from “0” not present, to “1” evidence of practice theme but lacking subsequent details, to “2” a detailed account of the practice theme. Scores for each clinician and set of files were then discussed and an agreement reached in cases where the scores did not align. A total CoP score was calculated by creating a composite of the four themes.

Low, medium and high categories were derived using visual binning, and it was determined that a conservative significance level of p < .01 would be required between groups to ensure that they were distinct. Binning is a statistical process of converting a continuous variable into a discrete form. In this instance, variables were binned according to perentiles. Following binning, 5 categories were identified. The highest only included one participant and was therefore grouped with category 4. Category 2 and 3 did not differ significantly enough and were also combined. The three categories created through this process (low, medium and high) were distinctly different. The low group included participants with CoP scores that had changed by − 20% or less following training, the high group included participants with CoP scores that had changed by 60% or more following training, and the medium group included participants between these extremes. These categories also made sense clinically, since there was a clear distinction between being less likely to practice integrated management techniques, remaining unchanged, and incorporating many more integrated management practices.

Continuous and categorical variables were examined using ANOVAS and Chi square tests respectively to examine differences between high, medium and low implementation groups for baseline CoP scores and across the three domains: demographics (age, sex, education, and professional role); attitudes (evidence-based practice attitudes (EBPAS), attitudes towards therapist manuals (SATM), addiction counselling self-efficacy (ACSES)); and perceptions of organisational readiness to change (organisational readiness to change (ORCA)). Between group differences on these scales were evaluated using effect sizes (Cohen’s d) and 95% confidence intervals. Data were analysed using SPSS 28 for Mac OSX.

Results

Sample characteristics

Implementation change scores were derived from measures of CoP obtained from participants across all 3 PCC sites. The 20 clinicians that participated in the PCC training were grouped according to distinct patterns of change in CoP (N = 4 low implementation, N = 10 medium implementation, N = 6 high implementation). Baseline clinician-level characteristics are displayed in Table 1. The overall mean age was 51.53 (SD ± 8.14) years, 75% were female. Most participants had completed a university degree (60%). The most common professional role was psychologist (45%) and the mean number of years since graduating was 15.46 (SD ± 8.88).

Table 1 Baseline Characteristics of High, Medium and Low Implementers
Full size table

Comorbidity practice implementation scores

CoP scores are presented in Table 2. Across the entire sample, the mean CoP score at baseline was 1.02 (SD ± .83) and 1.25 (SD ± .81) at follow-up, with an overall mean increase of 23% from baseline. There was a 58% increase in assessment of comorbidity at follow-up along with a 35% increase for screening, 18% for treatment and 4% for referral. Differences in baseline CoP scores between the three implementation groups were not significant (X2 (2, N = 18) = 3.32, p = 0.06). The high implementation group demonstrated an increase in CoP of 75% following training, compared with 27% for the medium group and a decrease of 22% in the low group.

Table 2 Comorbidity Practice (CoP) mean scores for High, Medium and Low Implementers
Full size table

Clinician-level factors and association with implementation scores

There were no significant differences between high, medium and low implementation groups regarding gender (X2 (2, N = 19) = 2.38, p = 0.30), education (X2 (4, N = 19) = 2.55, p = 0.57) or occupation (X2 (5, N = 19) = 8.14, p = 0.42) at baseline. Likewise, no differences were found between high, medium and low implementation groups in age or experience (Fs < 0.42). Comparisons between high, medium and low implementation groups on clinician attitudes and perceptions at baseline are presented in Table 3. There were no significant differences between high, medium and low implementation groups on the EBPAS (F(2, 16) = .22, p = 0.81), the SATM positive scale (F(2, 16) = 0.01, p = 0.99) and negative scale (F(2, 16) = 0.08, p = 0.92) or the ACSES (F(2, 16) = 0.69, p = 0.52). Although there was also no significant difference between groups on the total ORCA (F(2, 16) = 2.37, p = 0.13), or on subscales including leadership culture (F(2, 16) = 3.21, p = 0.07), staff culture (F(2, 16) = 0.61, p = 0.56), measurement (F(2, 16) = 1.30, p = 0.30), opinion leaders (F(2, 16) = 0.40, p = 0.68) and resources (F(2, 16) = .08, p = 0.92), there was a significant difference found between groups on the leadership behaviour subscale of the ORCA (F(2, 16) = 3.63, p = 0.05; Cohen’s d = 0.31). A Tukey’ HSD test for multiple comparisons revealed that leadership behaviour was significantly different between high and low implementers (p = 0.05, 95% C.I. = − 14.03, 0.04). There was no significant difference between high and medium (p = 0.09), or medium and low implementation fidelity groups (p = 0.85).

Table 3 Effect Size Comparisons of Baseline Psychometric Variables between High, Medium and Low Clinical Practice Implementers
Full size table

Discussion

Understanding the interrelationships between clinician-level factors and the outcomes of implementation efforts may assist with the development of more effective implementation strategies. The aim of this study was to evaluate the effects of clinician-level characteristics on clinical practice outcomes of the PCC program implementation, which involved clinicians practicing counselling interventions in drug and alcohol outpatient clinics. Our hypotheses related to characteristics across the domains of attitudes and perceptions of organisational readiness to change, and we were interested to see whether clinician demographics were relevant to this sample. The only hypothesis confirmed by the results of this study pertained to the clinician’s perceptions of one aspect of organisational readiness to change.

With regards to clinician demographics, the results of this study were not able to provide any further clarity. Existing research suggests that years of experience [51] and higher levels of education are associated with higher fidelity [18]. However, this relationship between education and fidelity is sometimes no longer present following training [28], and clinicians with lower levels of education have been found to demonstrate greater increases in implementation fidelity following training [19]. It is therefore possible that participating in the PCC training attenuated any differences in clinicians’ comorbidity practice related to prior education.

Likewise, findings from this study did not provide any additional insight into the potential role of clinician attitudes in the uptake of EBPs. Previous research related to salient attitudes has found that low endorsement of disease belief models [18], higher self-efficacy [22, 52] and an increased belief in the efficacy of the intervention [22] have implications for implementation outcomes. Although the relationship between self-efficacy and comorbidity practice was not significant, there was a trend toward significance observed in this small population which would warrant further investigation in a larger sample. In terms of clinican attitudes toward EBP, our findings did not confirm those of previous studies, which have shown that clinicians who are prepared for change and who have positive attitudes to EBP [18, 35,36,37], and treatment manuals [51] are more likely to implement such practices. On the contrary, attitudes of clinicians in this study are more consistent with alternate evidence suggesting that attitudes such as interest, confidence, and commitment to EBPs do not have a strong relationship with treatment fidelity [21, 29, 38]. It is also possible that the EBPAS measure used in this study did not capture aspects of clinician attitudes specific to the drug and alcohol treatment setting, since recent developments in measuring attitudes toward EPBs have demonstrated some utility in enhancing the specificity of such measures (e.g. [53]).

Interestingly, there was a relationship between implementation and leadership behaviour. Amongst the various components of ORC that have been cited in the literature as influencing staff adaptation to new innovations (e.g. positive organisational climate [54], valuing innovation, creative and supportive leadership, and staff attributes [55]), findings from this study also suggest that perceptions of leadership are important. Specifically, clinicians who demonstrated the greatest changes in their comorbidity management practices strongly believed that senior leadership in their organisation effectively managed the continuous improvement of patient care, made the responsibilities of leadership and staff clear, actively promoted team cohesiveness and solved clinical care problems, and enhanced communication between relevant clinical services. This information is particularly helpful for developing implementation strategies, which may benefit from a better understanding of how individual clinicians perceive their leaders. These findings also emphasise the importance of engaging leadership when implementing a new EBP in drug and alcohol services, particularly with regards to the challenging area of comorbid drug and alcohol and mental health disorders.

Some practical suggestions for implementing strategies incorporating these findings might be to conduct a needs assessment prior to developing and implementing a training package, in which clinicians can provide confidential information about their perceptions of leadership. This information can inform leadership engagement and provide clues about possible challenges for particular leaders. The process of engaging leadership might also involve the development of particular strategies for promoting the new innovation such as identifying how it improves patient care, articulating how it will impact staff responsibilities, providing designated time for group workshops focused on supporting the delivery of the new innovation, and networking with other relevant clinical services.

Strengths and Limitations

Firstly, the current findings have limited power due to the small sample size and there is a possibility that the effect size estimation is inflated. However, the broader sample was sourced from diverse geographic locations including a diverse representation of drug and alcohol outpatient clinicians across the Australian public health system. Secondly, the CoP outcome measure was based on the evaluation of clinician files rather than behavioural evaluations of comorbidity practice which may impact on the reliability of the measure. Nevertheless, the study does represent one of few attempts worldwide to evaluate the relationship between clinician-level factors and effectiveness of implementation of comorbidity training in the drug and alcohol field.

Conclusion

These preliminary results suggest that drug and alcohol clinicians’ perceptions of their leaders has an influence on the extent to which they implement changes in their clinical practice following training and highlight the importance of engaging leadership in implementation efforts. In a broader sense, these findings challenge the notion that clinicians are largely responsible for barriers to implementation.

Availability of data and materials

The data that support the findings of this study are available from NSW Health (via Prof Paul Haber) but restrictions apply to the availability of these data, which were used under license for the current study, and so are not publicly available. Data are however available from the authors upon reasonable request and with permission of NSW Health.

Abbreviations

EBP:

Evidence-based Practice

ORC:

Organisational readiness to change

PCC:

Pathways to Comorbidity Care

NSW:

New South Wales

EBPAS:

Evidence-based Practice Attitudes Scale

SATM:

Survey of Attitudes to Therapist Manuals

ORCA:

Organizational Readiness to Change Scale

ACSES:

Addiction Counseling Self-Efficacy Scale

CP:

Comorbidity Practice

References

  1. Aarons GA, Palinkas LA. Implementation of evidence based practice in child welfare: service provider perspectives. Adm Policy Ment Health Ment Health Serv Res. 2007;34:411–9.

    Article  Google Scholar 

  2. Crea TM, et al. Variability in the implementation of team decision making (TDM): scope and compliance with the family to family practice model. Child Youth Serv Rev. 2008;30(11):1221–32.

    Article  Google Scholar 

  3. Fixsen D, et al. Core implementation components. Res Soc Work Pract. 2009;19(5):531.

    Article  Google Scholar 

  4. Greenhalgh T, et al. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82(4):581–629.

    Article  Google Scholar 

  5. Palinkas LA, Aarons GA. A view from the top: executive and management challenges in a statewide implementation of an evidence-based practice to reduce child neglect. Int J Child Health Hum Dev. 2009;2(1):47–55.

    Google Scholar 

  6. Palinkas LA, et al. An ethnographic study of implementation of evidence-based treatments in child mental health: first steps. Psychiatr Serv. 2008;59(7):738–46.

    Article  Google Scholar 

  7. Glisson C, Schoenwald S. The ARC organizational and community intervention strategy for implementing evidence based children’s mental health treatments. Ment Health Serv Res. 2005;7(4):243–59.

    Article  Google Scholar 

  8. McLellan AT, Carise D, Kleber HD. Can the national addiction treatment infrastructure support the public's demand for quality care? J Subst Abus Treat. 2003;25(1):117.

    Google Scholar 

  9. Grol R, et al. Planning and studying improvement in patient care: the use of theoretical perspectives. Milbank Q. 2007;85(1):93–138.

    Article  Google Scholar 

  10. SAMHSA. Facing addiction in America: the surgeon General's report on alcohol, drugs, and health - full report. Rockville: Substance Abuse and Mental Health Services Administration; 2016.

    Google Scholar 

  11. Saunders EC, Kim U, McGovers MP. Substance abuse treatment implementation research. J Subst Abus Treat. 2014;44(1):1–3.

    Google Scholar 

  12. Conner M, Sparks P. Theory of planned behaviour and health behaviour. In: Conner M, Norman P, editors. Predicting health behaviour. Berkshire: Open University Press; 2005. p. 170–222.

    Google Scholar 

  13. Godin G, et al. Healthcare professionals’ intentions and behaviours: a systematic review of studies based on social cognitive theories. Implement Sci. 2008;3.

  14. Tower C, et al. Building collective efficacy to support public health workforce development. J Public Health Manag Pract. 2021;27:55–61.

    Article  Google Scholar 

  15. Spector AY, et al. Implementation of brazil's “family health strategy”: factors associated with community health workers’, nurses’, and physicians’ delivery of drug use services. Int J Drug Policy. 2015;26:509–15.

    Article  Google Scholar 

  16. Durks D, et al. Use of intervention mapping to enhance health care professional practice: a systematic review. Health Educ Behav. 2017;44:524–35.

    Article  Google Scholar 

  17. Louie E, et al. A systematic review of evidence-based practice implementation in drug and alcohol settings: applying the consolidated framework for implementation research framework. Implement Sci. 2021;16.

  18. Baer JS, et al. Agency context and tailored training in technology transfer: a pilot evaluation of motivational interviewing training for community counselors. J Subst Abus Treat. 2009;37:191–202.

    Article  Google Scholar 

  19. Carpenter KM, et al. “Old dogs” and new skills: how clinician characteristics relate to motivational interviewing skills before, during, and after training. J Consult Clin Psychol. 2012;80(4):560–73.

    Article  Google Scholar 

  20. Carroll KM, et al. Motivational interviewing to improve treatment engagement and outcome in individuals seeking treatment for substance abuse: a multisite effectiveness study. Drug Alcohol Depend. 2006;81:301–12.

    Article  Google Scholar 

  21. Decker SE, Martino S. Unintended effects of training on clinicians’ interest, confidence, and commitment in using motivational interviewing. Drug Alcohol Depend. 2013;132(3):681–7.

    Article  Google Scholar 

  22. Gaume J, et al. Influence of counselor characteristics and behaviors on the efficacy of a brief motivational intervention for heavy drinking in young men—a randomized controlled trial. Alcoholism: Clin Exp Res. 2014;38(7):138–47.

    Article  Google Scholar 

  23. Helseth SA, et al. Training community-based treatment providers to implement contingency management for opioid addiction: time to and frequency of adoption. J Subst Abus Treat. 2018;95:26–34.

    Article  Google Scholar 

  24. Johnson KW, et al. Drug abuse treatment training in Peru: a social policy experiment. Eval Rev. 2002;26(5):480–519.

    Article  Google Scholar 

  25. Weingardt KR, Villafranca SW, Levin C. Technology-based training in cognitive behavioral therapy for substance abuse counselors. Subst Abus. 2006;27(3):19–25.

    Article  Google Scholar 

  26. Larson MJ, et al. Randomized trial of web-based training to promote counselor use of CBT skills in client sessions. Subst Abus. 2013;34(2):179–87.

    Article  Google Scholar 

  27. Martino S, et al. Community program therapist adherence and competence in motivational enhancement therapy. Drug Alcohol Depend. 2008;96(1–2):37–48.

    Article  Google Scholar 

  28. Meier A, et al. Adherence and competence in two manual-guided therapies for co-occurring substance use and posttraumatic stress disorders: clinician factors and patient outcomes. Am J Drug Alochol Abuse. 2015;41(6):527–34.

    Google Scholar 

  29. Miller WR, et al. A randomized trial of methods to help clinicians learn motivational interviewing. J Consult Clin Psychol. 2004;72(6):1050–62.

    Article  Google Scholar 

  30. Morgenstern J, et al. Manual-guided cognitive-bahavioral therapy training: a promising method for disseminating empirically supported substance abuse treatments to the practice community. Psychol Addict Behav. 2001;15(2):83–8.

    Article  Google Scholar 

  31. Rawson RA, et al. Dissemination and implementation of cognitive behavioral therapy for stimulant dependence: a randomized trial comparison of three approaches. Subst Abus. 2013;34(2):108–17.

    Article  Google Scholar 

  32. Smith JL, et al. Training substance abuse clinicians in motivational interviewing using live supervision via teleconferencing. J Consult Clin Psychol. 2012;80(3):450–64.

    Article  Google Scholar 

  33. Weingardt KR, et al. A randomized trial comparing two models of web-based training in cognitive behavioral therapy for substance abuse counselors. J Subst Abus Treat. 2009;37(3):219–27.

    Article  Google Scholar 

  34. Rogers EM. Diffusion of innovations. 5th ed. New York: The Free Press; 1995.

    Google Scholar 

  35. Simpson DD. A conceptual framework for transferring resarch to practice. J Subst Abus Treat. 2002;22:171–82.

    Article  Google Scholar 

  36. Liddle HA, et al. Transporting a research-based adolescent drug treatment into practice. J Subst Abus Treat. 2002;22:231–43.

    Article  Google Scholar 

  37. Smith BD, Manfredo IT. Frontline counselors in organizational contexts: a study of treatment practices in community settings. J Subst Abus Treat. 2011;41(2):124–36.

    Article  Google Scholar 

  38. Miller WR, Mount KA. A small study of training in motivational interviewing: does one workshop change clinician and client behaviour? Behav Cogn Psychother. 2001;29:457–71.

    Article  Google Scholar 

  39. Schoenwald SK. Personnel Data Inventory. Charleston: Family Services Research Center Medical University of South Carolina; 1998.

    Google Scholar 

  40. Louie E, Giannopoulos V, Baillie AJ, Uribe Guajardo MG, Byrne S, Deady M, et al. Translating Evidence-Based Practice for Managing Comorbid Substance Use and Mental Illness Using a Multimodal Training Package. J Dual Diagn. 2018;14(2):1–25. https://doi.org/10.1080/15504263.2018.1437496.

  41. Louie E, Morley K, Giannopoulos V, Uribe G, Wood K, Marel KC, et al. Implementation of a multi-modal training program for the management of comorbid mental disorders in drug and alcohol settings: Pathways to Comorbidity Care (PCC). J Dual Diagn. 2021;17(4):304-12. https://doi.org/10.1080/15504263.2021.1984152.

  42. Louie E, et al. Barriers and facilitators to the implementation of the pathways to comorbidity care (PCC) training package for the management of comorbid mental disorders in drug and alcohol settings. Front Health Serv. 2021; In Press.

  43. Louie E, et al. Translating evidence-based practice for managing comorbid substance use and mental illness using a multimodal training package. J Dual Diagnosis. 2018;14(2):111–9.

    Article  Google Scholar 

  44. Louie E, et al. Implementation of a multi-modal training program for the management of comorbid mental disorders in drug and alcohol settings: pathways to comorbidity care (PCC). J Dual Diagnosis. 2021;17(4):304–12.

    Article  Google Scholar 

  45. Aarons GA. Mental health provider attitudes toward adoption of evidence-based practice: the evidence-based practice attitudes scale (EBPAS). Ment Health Serv Res. 2004;6:61–74.

    Article  Google Scholar 

  46. Aarons GA, et al. Psychometric properties and United States national norms of the evidence-based practice attitude scale (EBPAS). Psychol Assess. 2010;22:356–65.

    Article  Google Scholar 

  47. Addis ME, Krasnow AD. A national survey of practicing psychologists’ attitudes toward psychotherapy treatment manuals. J Consult Clin Psychol. 2000;68:331–9.

    Article  Google Scholar 

  48. Murdock TB, Wendler AM, Nilsson JE. Addiction counseling self-efficacy scale (ACSES): development and initial validation. J Subst Abus Treat. 2005;29(1):55–64.

    Article  Google Scholar 

  49. Helfrich C, et al. The organizational readiness to change assessment (ORCA): development of an instrument based on the promoting action on research in health services (PARIHS) framework. Implement Sci. 2009;4.

  50. Holt DT, et al. Are you ready? How health professionals can comprehensively conceptualize readiness for change. J Gen Interal Med. 2010;25(S1):50–5.

    Article  Google Scholar 

  51. Henggeler SW, et al. Statewide adoption and initial implementation of contingency management for substance-abusing adolescents. J Consult Clin Psychol. 2008;76(4):556–67.

    Article  Google Scholar 

  52. Campbell BK, et al. Therapist predictors of treatment delivery fidelity in a community-based trial of 12-step facilitation. Am J Drug Alochol Abuse. 2013;39(5):304–11.

    Article  Google Scholar 

  53. Maessen K, et al. Development and validation of the dutch ebpas-ve and ebpq-ve for nursing assistants and nurses with a vocational education. Worldviews Evid-Based Nurs. 2019;16:371–80.

    Article  Google Scholar 

  54. Simpson DD, Joe GW, Rowan-Szal GA. Linking the elements of change: program and client responses to innovation. J Subst Abus Treat. 2007;34(3):293–301.

    Google Scholar 

  55. Becan JE, Knight DK, Flynn PM. Innovation adoption as facilitated by change-oriented workplace. J Subst Abus Treat. 2012;33:183–92.

    Google Scholar 

Download references

Acknowledgements

This study was supported by a Research Training Program Scholarship (EL) and a NSW Health Translational Research Fellowship (KM).

Funding

This study was supported by NSW Translational Research Grant Scheme funding (PH, KM, AB, MT), NSW Translational Research Fellowship (KM) and a Research Training Progam scholarship (EL).

Author information

Authors and Affiliations

  1. Sydney Medical School, Faculty of Medicine and Health, The University of Sydney, Camperdown, NSW, Australia

    Eva Louie, Katie Wood, Paul S. Haber & Kirsten C. Morley

  2. Edith Collins Centre (Translational Centre in Alcohol, Drugs & Toxicology), Sydney Local Health District & Royal Prince Alfred Hospital, Camperdown, NSW, Australia

    Eva Louie, Vicki Giannopoulos, Paul S. Haber & Kirsten C. Morley

  3. School of Health Sciences, Faculty of Medicine and Health, The University of Sydney, Camperdown, NSW, Australia

    Andrew Baillie

  4. Menzies Centre for Health Policy, Faculty of Medicine and Health, The University of Sydney, Camperdown, NSW, Australia

    Gabriela Uribe

  5. The Matilda Centre for Research in Mental Health and Substance Use, The University of Sydney, Camperdown, NSW, Australia

    Maree Teesson

  6. Addiction Medicine, Central Clinical School, Sydney Medical School, University of Sydney, Camperdown, NSW, 2006, Australia

    Kirsten C. Morley

Authors
  1. Eva Louie
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Vicki Giannopoulos
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Andrew Baillie
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Gabriela Uribe
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Katie Wood
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Maree Teesson
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Paul S. Haber
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Kirsten C. Morley
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

The authors of this study are EL, VG, AB, GU, KW, MT, PH and KM. KM, AB, PH and MT conceptualised, led and designed the main study that this data was derived from. EL conceptualised the paper, led the analysis, interpretation and writing of manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Kirsten C. Morley.

Ethics declarations

Ethics approval and consent to participate

Ethical approval for the study was obtained from the Human Ethics Review Committees of the Sydney Local Health District, South Western Sydney Local Health District, Central Coast Local Health District, Hunter New England Research Ethics and Governance Office which covered two participating services, and Mid North Coast Local Health District (X16-0440 & HREC/16/RPAH/624). Each participant signed a consent form prior to participation in the study. Informed consent was obtained from each participant. All methods were carried out in accordance with the regulations and guidelines of each Local Health District.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Louie, E., Giannopoulos, V., Baillie, A. et al. Relationship between clinician-level attributes and implementation outcomes from the Pathways to Comorbidity Care training program. BMC Med Educ 22, 605 (2022). https://doi.org/10.1186/s12909-022-03671-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12909-022-03671-6

Keywords

BMC Medical Education

ISSN: 1472-6920

Contact us