Family physicians' perceptions of academic detailing: a quantitative and qualitative study
© Allen et al; licensee BioMed Central Ltd. 2007
Received: 06 November 2006
Accepted: 12 October 2007
Published: 12 October 2007
The efficacy of academic detailing in changing physicians' knowledge and practice has been the subject of many primary research publications and systematic reviews. However, there is little written about the features of academic detailing that physicians find valuable or that affect their use of it. The goal of our project was to explore family physicians' (FPs) perceptions of academic detailing and the factors that affect their use of it.
We used 2 methods to collect data, a questionnaire and semi-structured telephone interviews. We mailed questionnaires to all FPs in the Dalhousie Office of Continuing Medical Education database and analyzed responses of non-users and users of academic detailing. After a preliminary analysis of questionnaire data, we conducted semi-structured interviews with 7 FPs who did not use academic detailing and 17 who did use it.
Overall response rate to the questionnaire was 33% (289/869). Response rate of non-users of academic detailing was 15% (60/393), of users was 48% (229/476). The 3 factors that most encouraged use of academic detailing were the topics selected, the evidence-based approach adopted, and the handout material. The 3 factors that most discouraged the use of academic detailing were spending office time doing CME, scheduling time to see the academic detailer, and having CME provided by a non-physician. Users of academic detailing rated it as being more valuable than other forms of CME. Generally, interview data confirmed questionnaire data with the exception that interview informants did not view having CME provided by a non-physician as a barrier. Interview informants mentioned that the evidence-based approach adopted by academic detailing had led them to more critically evaluate information from other CME programs, pharmaceutical representatives, and journal articles, but not advice from specialists.
Users of academic detailing highly value its educational value and tend to view information from other sources more critically because of its evidence-based approach. Non-users are unlikely to adopt academic detailing despite its high educational value because they find using office time for CME too much of a barrier. To reach these physicians with academic detailing messages, we will have to find other CME formats.
Academic detailing or educational outreach is a form of continuing medical education (CME) in which a trained health professional such as a physician or pharmacist visits physicians in their offices to provide evidence-based information. The efficacy of academic detailing in changing physicians' knowledge and practice has been the subject of many primary research publications and systematic reviews. The most recent review found that academic detailing in conjunction with other educational interventions led to a median improvement in physician performance of approximately 6.0%. Several studies have found that physicians rate the educational value of academic detailing highly [2–4].
Despite the number of studies about the efficacy of academic detailing, few have addressed the features of academic detailing that physicians find valuable or that affect their use of it. Habraken et al. found that Belgian physicians highly rated academic detailing visits and approximately 90% of those who used academic detailing wished to use it again. However, they also identified some barriers to participation: the information was not new or could be obtained in other ways, the information was politically coloured and designed to cut expenses, and the educational visits were time-consuming. The goal of our project was to explore family physicians' (FPs) perceptions of academic detailing and the factors that affect their use of it.
The Office of CME at Dalhousie University has had an Academic Detailing Service since 2001. Funded by the provincial Department of Health, the Service is available to all FPs in Nova Scotia (approximately 850 are in practices for which academic detailing is relevant, e.g., in active family practice, not in solely administrative or emergency medicine roles). Three academic detailers, 2 pharmacists and a nurse, present 1 or 2 evidence-based topics per year. Topics are selected by surveying FPs, by scanning the literature for areas of interest, and to complement other provincial health initiatives. We research the evidence for each topic with the help of a drug evaluation pharmacist. A specialist physician and advisory board of 4 FPs ensure that the evidence-based information is clinically relevant. If a physician poses a question that the academic detailer cannot answer during the visit, the academic detailing team finds an answer and faxes the response.
During our detailing session, we present data from clinical trials in absolute as well as relative terms and include event rates of active and placebo groups, absolute risk reduction, and numbers needed to treat with 95% confidence intervals. We believe this approach presents a more accurate estimate of treatment effect than presenting data in only relative terms and there is evidence that the way data is presented affects prescribing decisions [6–8]. During our visits and in our handout material, we explain these terms to physicians. Most visits last about 25 minutes, are with individual physicians, take place during regular working hours, and provide 1 MAINPRO M-1 credit of the College of Family Physicians of Canada.
Handout material left with physicians consists of a booklet of up to 40 pages that provides details of clinical trial evidence. A few pages of summary statements in the front of the booklet summarize the key points of the evidence. We also leave double-sided laminated sheet that contains essential points for ready reference. Examples of handout material are at http://cme.medicine.dal.ca/ADS.htm.
What features of academic detailing
encourage physician participation?
discourage physician participation?
do physicians find valuable?
How can academic detailing be improved to better meet the CME needs of physicians?
What is the value of academic detailing compared to other forms of CME?
This was a mixed-methods study using 2 methods to collect data, a questionnaire and semi-structured telephone interviews. For both methods, we divided our study population into 3 groups of FPs based on their participation: those who had never used academic detailing (used never group), those who had used academic detailing once (used once group), and those who had used academic detailing more than once (used > once group). Nova Scotia FPs in practice, regardless of group, were sent invitations to participate in previous academic detailing sessions. The Research Ethics Board of Dalhousie University approved the project.
Two of the authors involved in the Dalhousie Academic Detailing Service (MA, IF) and two colleagues (see acknowledgements) who have a strong background in educational theory and questionnaire design developed the questionnaire. There is little published information on the factors that encourage and discourage physicians from using academic detailing. Therefore we developed questions to address factors that our experience and informal discussion with physicians indicated may be important. Four physicians from each group tested the questionnaire for face validity.
An introductory letter described features of the Academic Detailing Service. The three-page questionnaire collected demographic and practice information and asked respondents to rate on a five-point Likert scale how much various factors encouraged or discouraged use of academic detailing, and how likely they were to use academic detailing in the future. Open-ended questions asked for suggestions to make academic detailing better meet respondents' learning needs and for general comments. The questionnaires for the 3 groups were identical except for 1 question. The used never group were asked if they had heard about the academic detailing service before receiving the questionnaire while the other 2 groups were asked to rate the value of academic detailing compared to other forms of CME.
In September 2004 we mailed the questionnaire to all FPs in the Dalhousie CME database whom we considered eligible to participate in academic detailing (N = 869). We offered a chance to win two $50 vouchers as an incentive and re-mailed the questionnaire to non-responders 3 weeks after the initial mailing. The questionnaire also asked respondents to indicate if they were interested in being interviewed.
Questionnaire data were analyzed using SPSS version 10.1. We calculated descriptive statistics for data collected in Likert scales, and frequency distributions for non-continuous data. Means and frequency distributions of the study groups were compared using inferential statistics (i.e., analysis of variance and chi-square tests, respectively). We set an alpha level of 0.004 with a Bonferroni correction to adjust for the number of encouraging and discouraging factors being compared.
We planned 10 interviews with each group of physicians and developed the interview questions after a preliminary analysis of the questionnaire data to determine themes for exploration (see Additional file 1 for questions). We randomly selected physicians from questionnaire respondents who expressed interest in being interviewed. We tape recorded and transcribed interviews and mailed the transcriptions to subjects to verify accuracy.
Using a thematic content analysis, the interview data were coded, or broken down, into manageable categories and then examined for the frequency of occurrences of each code. Interview transcripts were analyzed independently by researchers (MA and NO), and reviewed by a third researcher (SF). The coding of the researchers were compared, and in the case of discrepancies, the researchers reviewed and discussed the text until agreement was reached. We used QSR NUD*IST 6 for data management.
We received only 24 questionnaire responses from the used once group, a response rate of 25%. These responses were not significantly different from the used > once group so we combined the 2 for data analysis. Similarly, for interviews we were able to schedule only 5 interviews with the used once group. Their responses were not different from the used > once group and so we combined them for analysis. Therefore, we ended up with 2 groups, those who did use and did not use the academic detailing service (users and non-users respectively).
Questionnaire quantitative results
Response rate to questionnaire
Demographic and practice information of questionnaire respondents
Member of CFPC*
Size of community+
5,000 to 50,000
Number patients seen per week N (SD)
Practice hours per week
1 to 20
21 to 35
36 to 50
Year of graduation
1969 or earlier
1970 to 1979
1980 to 1989
1990 to 1999
2000 to 2004
Ratings on questionnaire to factors that encourage and discourage family physicians' use of academic detailing (using a 5-point Likert scale where 1 = strongly discourage and 5 = strongly encourage)
Mean Rating (SD)
Mean Rating (SD)
Relevance to practice of topic being presented
Usefulness of handout
Effectiveness of academic detailing as a way of learning
Awareness that topic was being presented
Follow up by finding answers to questions
Clinical knowledge of topic being presented
Obtaining CME credits
Scheduling time to see the academic detailer
Having access to CME in other ways
Spending office time doing CME
Having CME provided by a non-physician
For non-users, the factors that most discouraged them from using academic detailing were spending office time doing CME, scheduling office time to see an academic detailer, and having CME provided by a non-physician. The mean rating of each of these domains was less than 3.0 indicating that these factors may actually be a deterrent to participating in academic detailing. For the users, the factors with the lowest ratings were having CME provided by a non-physician, spending office time doing CME, and having access to CME in other ways. The mean rating of each of these domains was approximately 3.0 indicating that these factors were neither encouraging nor discouraging.
For users, the 3 factors that most encouraged the use of academic detailing were the relevance of the topic, the evidence-based approach adopted in academic detailing, and the usefulness of the handout material. For non-users, the most encouraging factors were the evidence-based approach, obtaining CME credits, and having the detailer follow up by answering questions. Mean ratings for most encouraging factors were ≥ 4.3 for the users and 3.9 to 4.0 for the non-users.
Interviews and responses to open ended questions on questionnaire
Forty-one non-users and 88 users made comments to open-ended questions on the questionnaire. We were able to recruit 7 non-users and 17 users for interviews. In reporting qualitative data, we will concentrate on some factors that most discouraged and encouraged physicians from using academic detailing.
This section reports qualitative data from both the interviews and questionnaires. If the source is not specified, it is from the interview participants.
Scheduling and spending office time for CME
"It's better than spending office time seeing commercial detailers or spending evenings so it's not a problem. It's not an onerous imposition."
One user found it less than ideal but still a practical approach to learning considering other demands.
"It is not ideal because it means that we tend to be in a rush, and are often coming from seeing a patient, and maybe haven't had lunch. We tend to cram it into a busy day, which isn't really the best way to learn. But there isn't really much other time. So I don't think it is ideal but I think it is a reasonably practical approach to how much time people have."
On the questionnaire, 6 respondents from the users made comments about difficulty with scheduling while 2 reported no difficulty. Questionnaire and interview data indicated that the preferred times for seeing the academic detailer were in the morning before seeing patients, at noon, and at the end of the day.
CME provided by a non-physician
"I find it offensive having a non-MD presenting this information. Their lack of training in physiology and pathology of diseases makes their input useless."
"Drug company reps may have an undergrad science degree but no medical background. I'm quite happy to get it from a pharmacist. I work with nurses and have no problem."
"As long as they identify their area of expertise. And so far the detailing that we've gotten, I feel confident in the presenters. And I am actually quite impressed that they seem to have quite a good knowledge of the topics."
In interviews, 3 non-users mentioned that selection of relevant topics might lead to them using academic detailing. One suggested that we choose topics that pharmaceutical companies are concentrating on while on the questionnaire 1 respondent suggested we cover topics that were not usually presented in other CME formats. One non-user thought the topics presented to date were appropriate. In response to interview questions about improving the Service or that might lead to more use of it, 10 physicians (2 non-users and 8 users) commented on the importance of relevant topics.
"Academic detailing is making me not want to go to some of the more traditional sit down in a dark room, listen to specialist talk CME. I'm starting to expect more."
"We are reminded every time we go through academic detailing to make sure we question the level of evidence and how studies are done. That approach is very helpful."
"I can discuss things with them (pharmaceutical representatives) and if I have information from the Academic Detailing Service it helps to support my points for discussion."
Academic detailing was less likely to affect physicians' evaluation of advice from specialists because they considered specialists to be well informed of the evidence.
"Most of the specialist reports I see try to include evidence."
"Your handouts were just so wonderful, they summarized everything so well. They're very concise and up to date."
"I have found myself referring to it on several occasions, so I'm glad I have it."
When asked for suggestions to improve the handout material, 6 users had no suggestions because they liked the existing format. Suggestions from other users were to add color and pictures, put them in format for a personal digital assistant, and include patient education material.
Users also indicated they had made practice changes based on information from academic detailers. Examples were ordering spirometry to diagnose chronic obstructive pulmonary disease, more diligent screening for osteoporosis, prescribing alendronate instead of etidronate for osteoporosis, and not prescribing rofecoxib because of concern over adverse cardiovascular effects.
Most information about ways to make the Academic Detailing Service better meet learning needs came from the user group. The most frequent suggestion was to provide the service more often (3 interviews, 8 questionnaire respondents) followed by having group sessions (2 interviews, 6 questionnaire respondents). Most comments expressed satisfaction with the Service. When asked for their general impressions in interviews, all but 1 user made favourable comments about the Service. When asked for suggestions for improvements, 3 interview informants and 49 questionnaire respondents, all from the user group, said they were satisfied with the service as it is.
This study identified several factors that encourage and discourage FPs from using academic detailing. We found few other studies that provide similar information. Janssens conducted interviews with physicians who did and did not use academic detailing and Van Eijk listed some reasons for non-participation in an academic detailing project. Soumerai and Avorn list 8 techniques of effective academic detailing based on information from pharmaceutical representatives and their own experiences.
In our study, spending office time doing CME was the factor that most deterred physicians, a consistent finding from interviews and the questionnaire. In interviews with non-users, physicians who saw the value of academic detailing just did not have time. In contrast, users of academic detailing did not find time to be enough of a barrier to discourage participation. Van Eijk and Janssens both identified lack of time as a barrier to participation in academic detailing[5, 11]. This finding was unexpected since we thought physicians would view office-based CME as being convenient and efficient.
The relevance of the topics detailed was the main encouraging factor for users on the questionnaire and was mentioned by several physicians in interviews as a factor that might lead to use of academic detailing. At the time of our study, the topics we had presented were updates on influenza and pneumococcal vaccine, hormone replacement therapy, osteoarthritis, osteoporosis, and chronic obstructive pulmonary disease. These are quite conventional topics; however, we were able to bring something new to them all. For instance, in the session on chronic obstructive pulmonary disease we pointed out that some recommendations in the Canadian guidelines are based on studies that show statistical significance but not clinical significance based on the scales used for outcomes. There did not appear to be a consensus as to whether we should present topics that are commonly presented in CME programs or that are somewhat unusual.
The handout material we leave with physicians was also mentioned as an encouraging factor. Our handout material is somewhat atypical for an academic detailing program. Soumarai recommends brief, graphic print materials. We do produce such material in our single page laminate, however we also produce an extensive review of the evidence with several summary pages. Information from this study indicates that physicians find such information helpful and refer back to it. In a previous evaluation survey (unpublished data), 75% of 106 respondents found the booklet somewhat or very useful while 65% found the laminate useful. These findings challenge the accepted approach to producing brief academic detailing material.
One of the most interesting findings from our study was the value that FPs place on the evidence-based approach of academic detailing. Previous studies indicate that FPs use evidence-based summaries and guidelines but do not believe that learning the skills of evidence-based medicine is the best way to implement it in practice. Our approach is to do the first three As of evidence-based medicine (Ask the appropriate question, Access the appropriate information, and Appraise the information). We then present our findings to physicians by providing them with information in absolute and relative terms as recommended at a recent meeting of the U.S. National Institutes of Health. We explain these terms to the physicians and let them decide about the final two As (Apply the information as they think appropriate, and Assess the results.) Our goal is similar to that of Habraken et al whose underlying aim was to stimulate a critical attitude in physicians by discussing the results of studies. Habraken et al speculated that physicians could apply this critical attitude to other sources of information such as pharmaceutical representatives. Our results suggest that this is the case and extends to other sources such as CME programs and journal articles. However, they are not necessarily more likely to critically appraise advice from specialists. Since specialists provide most CME there is some inconsistency in this finding and it too requires more study.
In our study, users of academic detailing value it more highly than other CME formats. This is consistent with evaluations we receive on detailing visits which consistently average at least 4.5 on a five-point Likert scale. In addition, users are much more likely than non-users to participate in the program in the future.
The main limitation of this study is the low response rate for the non-user group in both the interviews and the questionnaire. Only 15% of non-users returned the questionnaire, so our findings for this group may not be representative of the overall population of physicians who choose not to use the Service. Also, non-users who were interviewed came from the same group of physicians who returned the questionnaire further limiting the generalizability of data from this group. Unfortunately we do not know how to encourage non-users to participate in this type of research. Additional research is needed to explore perceptions of non-users in greater depth to determine if these findings can be generalized.
Another limitation of this study is that it deals with physicians' perceptions of the Service and their reasons for using or not using it. With the cross sectional design and the measures that we used, it is not possible to discern if their perceptions reflect reality. More objective measures and experimental designs could be used to determine this.
Finally, the interviewer was associated with the department that offers the Service. Although she was not involved with the Service directly, it is possible that her connection with the university department may have influenced physicians' responses during the interviews.
As a result of this study we have made few changes to our Service. We have given large group didactic presentations to try to reach physicians who do not have time to see academic detailers at their offices. Also, we are mailing key points of our academic detailing messages to non-users and giving them an opportunity to receive a list of their patients from the provincial drug insurance plan for whom the points may apply. They can use the list to see if their patients are on appropriate therapy. We are now conducting a study to determine the efficacy of this format. We have maintained our comprehensive evidence-based approach since physicians value it highly and now provide them with a brief peer-reviewed explanation of the differences between relative and absolute terms.
Physicians who use academic detailing rate its educational value highly. Selecting relevant topics appears to be the most important factor in encouraging use of academic detailing but we did not find consensus on what type of topics physicians consider valuable. Other factors encouraging participation are adopting an evidence-based approach and providing useful handout material. In our study, physicians found comprehensive as well as concise handout material useful, a finding that challenges the tenet that handout material should be brief.
The 3 factors that most discouraged the use of academic detailing were spending office time doing CME, scheduling time to see the academic detailer, and having CME provided by a non-physician. Because we found indications that an evidence-based approach can lead to more critical thinking and practice change, it is important to consider other ways to reach non-users who find it inconvenient to spend office time doing CME. The relative merits of having physicians or non-physicians provide academic detailing require further study.
We thank the Drug Evaluation Alliance of Nova Scotia for funding the study and Karen Mann and Joan Sargeant for helping design the survey questionnaire.
- Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, Whitty P, Eccles MP, Matowe L, Shirran L, Wensing M, Dijkstra R, Donaldson C: Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004, 8 (6): 1-72.View Article
- Midlov P, Bondesson A, Eriksson T, Nerbrand C, Hoglund P: Effects of educational outreach visits on prescribing of benzodiazepines and antipsychotic drugs to elderly patients in primary health care in southern Sweden. Fam Pract. 2006, 23: 60-64. 10.1093/fampra/cmi105.View Article
- Ilett KF, Johnson S, Greenhill G, Mullen L, Brockis J, Golledge CL, Reid DB: Modification of general practitioner prescribing of antibiotics by use of a therapeutics adviser (academic detailer). British Journal of Clinical Pharmacology. 2000, 49: 168-73. 10.1046/j.1365-2125.2000.00123.x.View Article
- Habraken H, Janssens I, Soenen K, van Driel M, Lannoy J, Bogaert M: Pilot study on the feasibility and acceptability of academic detailing in general practice. Eur J Clin Pharmacol. 2003, 59: 253-260. 10.1007/s00228-003-0602-6.View Article
- Janssens I, De Meyere M, Habraken H, Soenen K, van Driel M, Christiaens T, Bogaert M: Barriers to academic detailers: a qualitative study in general practice. Eur J Gen Pract. 2005, 11: 59-63.View Article
- Forrow L, Taylor WC, Arnold RM: Absolutely relative: How research results are summarized can affect treatment decisions. Am J Med. 1992, 92: 121-4. 10.1016/0002-9343(92)90100-P.View Article
- Heller RF, Sandars JE, Patterson L, McElduff P: GPs' and physicians' interpretation of risks, benefits and diagnostic test results. Fam Pract. 2004, 21: 155-159. 10.1093/fampra/cmh209.View Article
- Nikolajevic-Sarunac J, Henry DA, O'Connell DL, Robertson J: Effects of information framing on the intentions of family physicians to prescribe long-term hormone replacement therapy. J Gen Intern Med. 1999, 14: 591-598. 10.1046/j.1525-1497.1999.09028.x.View Article
- The College of Family Physicians of Canada: The College of Family Physicians of Canada. 25-10-2006. 11-3-2006.
- Creswell J: Research Design: Qualitative, Quantitative and Mixed Methods Approaches. 2003, London: Sage Publications
- van Eijk ME, Avorn J, Porsius AJ, de Boer A: Reducing prescribing of highly anticholinergic antidepressants for elderly people: randomised trial of group versus individual academic detailing. BMJ. 2001, 322: 654-657. 10.1136/bmj.322.7287.654.View Article
- Soumerai SB, Avorn J: Principles of educational outreach ('academic detailing') to improve clinical decision making. JAMA. 1990, 263: 549-556. 10.1001/jama.263.4.549.View Article
- O'Donnell DE, Aaron S, Bourbeau J, Hernandez P, Marciniuk D, Balter M, Ford G, Gervais A, Goldstein R, Hodder R, Maltais F, Road J: Canadian Thoracic Society recommendations for management of chronic obstructive pulmonary disease–2003. Can Respir J. 2003, 10 (Suppl A): 11A-65A.
- McColl A, Smith H, White P, Field J: General practitioners' perceptions of the route to evidence based medicine: a questionnaire survey. BMJ. 1998, 316: 361-365.View Article
- Del Mar C, Glasziou P, Mayer D: Teaching evidence based medicine. BMJ. 2004, 329: 989-990. 10.1136/bmj.329.7473.989.View Article
- Kramer BS, Wilentz J, Alexander D, Burklow J, Friedman LM, Hodes R, Kirschstein R, Patterson A, Rodgers G, Straus SE: Getting It Right: Being Smarter about Clinical Trials. PLoS Med. 2006, 3: e144-10.1371/journal.pmed.0030144.View Article
- Barratt A, Wyer PC, Hatala R, McGinn T, Dans AL, Keitz S, Moyer V: Tips for learners of evidence-based medicine: 1. Relative risk reduction, absolute risk reduction and number needed to treat. CMAJ. 2004, 171: 353-358.View Article
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6920/7/36/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.