The utilization of appropriate osteoporosis medications improves following a multifaceted educational intervention: the Canadian quality circle project (CQC)
- George Ioannidis1Email author,
- Alexandra Papaioannou1,
- Lehana Thabane2, 3,
- Amiram Gafni2,
- Anthony Hodsman4,
- Brent Kvern5,
- Aleksandra Walsh6,
- Famida Jiwa7 and
- Jonathan D Adachi†1
© Ioannidis et al; licensee BioMed Central Ltd. 2009
Received: 17 April 2009
Accepted: 6 August 2009
Published: 6 August 2009
Osteoporosis is a serious but treatable condition. However, appropriate therapy utilization of the disease remains suboptimal. Thus, the objective of the study was to change physicians' therapy administration behavior in accordance with the Osteoporosis Canada 2002 guidelines.
The Project was a two year cohort study that consisted of five Quality Circle (QC) phases that included: 1) Training & Baseline Data Collection, 2) First Educational Intervention & First Follow-Up Data Collection 3) First Strategy Implementation Session, 4) Final Educational Intervention & Final Follow-up Data Collection, and 5) Final Strategy Implementation Session. A total of 340 family physicians formed 34 QCs and participated in the study. Physicians evaluated a total of 8376, 7354 and 3673 randomly selected patient charts at baseline, follow-up #1 and the final follow-up, respectively. Patients were divided into three groups; the high-risk, low-risk, and low-risk without fracture groups. The generalized estimating equations technique was utilized to model the change over time of whether physicians
The odds of appropriate therapy was 1.29 (95% CI: 1.13, 1.46), and 1.41 (95% CI: 1.20, 1.66) in the high risk group, 1.15 (95% CI: 0.97, 1.36), and 1.16 (95% CI: 0.93, 1.44) in the low risk group, and 1.20 (95% CI: 1.01, 1.43), and 1.23 (95% CI: 0.97, 1.55) in the low risk group without fractures at follow-up #1 and the final follow-up, respectively.
QCs methodology was successful in increasing physicians' appropriate use of osteoporosis medications in accordance with Osteoporosis Canada guidelines.
Osteoporosis, a chronic debilitating disease, is a major clinical concern in postmenopausal women. Nearly any bone can fracture as a result of increased bone fragility. The most frequent sites of osteoporotic fracture take place at the hip, spine and wrist [1–4]. The major complications of fracture include increased mortality, reduced health related quality of life and higher care expenditures [5–14].
While osteoporosis may be a potentially crippling condition, it can be identified early during the course of the disease and effective therapy can be administered. After a patient has been diagnosed with osteoporosis, treatment should be initiated, given that there are many proven and effective modern pharmacological therapies for the prevention and treatment of the disease . However, despite the consequences of osteoporosis, the management of the disease is less than optimal. For example, Papaioannou et al.  evaluated patients re-fracture rates following hip fractures in 527 patients aged 50 years. The frequency of preventative treatments for osteoporosis was low given the risk of re-fracture. None of the patients were given bisphosphonates or hormone therapy and only 18% were given calcium and vitamin D. Furthermore, in a study that obtained data on osteoporosis drug therapy in 112 patients who were diagnosed as having minimal trauma forearm fractures, results indicated that a total of 42 patients (38%) were receiving either hormone replacement therapy or using a bisphosphonate. Moreover, a search conducted from a claims database in 30 states by Freedman et al. identified 1162 women, age 55 years or older who had a distal radial fracture. Of these patients, only 22.9% were treated with at least one of the medications approved for treatment of established osteoporosis . Finally, data from the National Ambulatory Medical Care Survey from 1993 to 1997 were examined for evidence of treatment for osteoporosis or vertebral fracture during visits by women 60 years of age and older to family physicians. Results indicated that appropriate drug therapies including calcium and vitamin D were offered to only 36% of the diagnosed patients .
Given the management care gap and the consequences of osteoporosis, it is important the physicians treat patients with osteoporosis appropriately. To reduce this care gap, the Quality Circle (QC) project, a multifaceted integrated disease management process strategy was developed and implemented (19, 20). The objective of the study was to determine and reduce the care gap in treating patients with osteoporosis. We hypothesize that family physicians' use of appropriate therapy will change in accordance with the Osteoporosis Canada guidelines as a result of their enrollment in quality circles.
The Canadian QC Study has been described elsewhere [19, 20]. Briefly, the project was designed to collect, analyze, and distribute information on physician practices in the diagnosis and treatment of osteoporosis so that the deficiencies in disease management may be recognized and beneficial actions may be developed and put into practice through QCs, a multifaceted osteoporosis educational intervention strategy involving small group meetings.
Family physicians were recruited from seven provinces across Canada. Three groups of physicians were selected and participated in the study. Facilitators were local family physicians recruited to lead the study meetings and were chosen because of their involvement in continuing professional development. Circle members were family physicians selected from specific geographical regions across Canada to form the QCs. A maximum of 15 physicians were enrolled in each QC. An osteoporosis specialist was recruited for each circle. The assignment of the osteoporosis specialist was to guide circle members on complicated clinical matters.
All participating physicians provided written informed consent. Physicians were selected because of their interests in osteoporosis. The study was approved by Health Research Ethics Boards across Canada. The study was sponsored by research grants from the Ontario College of Family Physicians and the Alliance for Better Bone Health (Procter & Gamble Pharmaceuticals Canada Inc. and sanofi-aventis Pharma Inc.).
Overview of Project Phases
The project consisted of five QC phases that included: 1) Training & Baseline Data Collection, 2) First Educational Intervention & First Follow-Up Data Collection 3) First Strategy Implementation Session, 4) Final Educational Intervention & Final Follow-up Data Collection, and 5) Final Strategy Implementation Session . The duration of the study consisted of 2 one year segments.
Our educational intervention consisted of eight key components and consisted of 1) audit and feedback, 2) interactive small group discussions 3) use of opinion leaders, 4) remainders, 5) multiprofessional collaboration with osteoporosis specialists, 6) nominal financial reimbursement to circle members, 7) patient medicated interventions 8) and educational material [19, 20].
The QC educational intervention workshop was created by a committee consisting of members from Osteoporosis Canada, Ontario College of Family physicians, leading physicians and scientists, and industry partners. The 2002 Osteoporosis Canada guidelines were used as the main evidence-based reference for the program. The workshop was administered twice and took 90–120 minutes to complete [19, 20].
Osteoporosis Canada Guideline Recommendations
Appropriate therapy was defined based on the Osteoporosis Canada 2002 guidelines . According to the guidelines, patients should be given osteoporosis therapy if they have at least one of the following criteria: osteopenia (t-score < -1.5) and prior fragility fracture, osteopenia and at least one other major (excluding prior fracture) or two minor risk factors for future fracture, or osteoporosis defined as a bone mineral density t-score of less than -2.5 regardless of risk factor status. Treatment should not be administered if the patient has osteopenia and only one minor or no risk factors for fracture, or has normal bone mineral density or has not had a bone density test regardless of their risk factor status .
Patients & Therapy
Eligible patients were enrolled based on the following criteria: women 55 years of age and older, were known to the clinician, and had at least two appointments in the 24 months before enrollment. The screening methods for choosing eligible patients were carried out by the clinic nurse to circumvent the potential of physician bias. Patient screening was designated for one day each week and was repeated for 8 weeks. At the end of each recruitment day, the clinic nurse used the day's visit schedule to randomly select the medical charts of three or four patients that met the eligibility criteria of the study. A total of 25 different patient charts were chosen for evaluation.
After making the selection, the clinic nurse inserted the patient questionnaire into each patient chart and the physician completed the form to ascertain how they treated osteoporosis. Based on the questionnaire responses, physician profiles were generated that showed how individual physicians treated patients in their own practices. The profiles permitted anonymous comparisons of individual circle member data with their peers in their circle and with all the participating physicians in the project. The physicians' profiles were than compared to the Osteoporosis Canada guidelines.
For the current analysis, patients were divided into three groups. The high risk group was defined as patients with osteoporosis based on a bone mineral density t-score of less than -2.5 regardless of risk factor status, or osteopenia and prior fragility fracture, osteopenia and at least one other major risk factor (excluding prior fracture), or two minor risk factors for future fracture (high risk group definition base on Osteoporosis Canada guidelines). The low risk group was defined as patients with osteopenia and no prior fracture, osteopenia and at most one minor risk factor for fracture, or normal or no bone mineral density measurements regardless of risk factor status (low risk group definition base on Osteoporosis Canada guidelines). Thus, individuals at low risk may have experienced a fracture and still be considered low risk if the patient had normal bone density or did not have a bone density scan. The low risk no fracture group was defined as patients with osteopenia and no prior fracture, osteopenia and at most one minor risk factor for fracture, or normal or no bone mineral density measurements regardless of risk factor status (excluding patients with fracture).
The treatments that were evaluated in the current study included alendronate, calcitonin, etidronate, hormone replacement therapy, parathyroid hormone (PTH), raloxifene, or risedronate. To avoid the use of hormone replacement therapy for other conductions we excluded all patients on this therapy if they had a history of significant vasomotor symptoms.
For our primary analysis, the generalized estimating equations  technique utilizing an exchangeable correlation structure was used to model the change in the appropriate use of osteoporosis therapies over time (baseline, 1st follow-up, and final follow-up). The generalized estimating equations method was performed to factor in the clustered or correlated nature of the data given that individuals treated by the same family physician will be managed similarly (clustered variable is the physician). For each model, the patient is the unit of analysis and the family physician is the unit of inference. Odds ratios (OR) and corresponding 95% confidence intervals (CI) are calculated. Goodness-of-fit of each model was determined by the technique created by Horton et al. .
The change in the appropriate use of osteoporosis therapies over time was evaluated in the high risk group, the low risk group and the low risk group without prior fractures. For the high risk group, the administration of any of the above listed therapies was defined as appropriate. If treatment was not provided, it was considered inappropriate. For the low risk group, no treatment was deemed appropriate, whereas the administration of therapy was inappropriate. Thus, the outcome was a binary variable (1 = appropriate use, 0 = inappropriate) and the primary independent variable was time (baseline, follow-up #1, and final follow-up). In addition, results were adjusted for the patient's age (≤65/> 65 years), prior fracture status at the hip, spine or wrist (yes/no), family history of fragility fracture (yes/no), early menopause (yes/no), other major risk factors for fracture (yes/no), and two or more minor risk factors for fracture (yes/no).
To assess the robustness of the results produced by the generalized estimating equations analyses (our primary analysis), a random coefficient (mixed effects model) and standard logistic regression analyses were conducted . All statistical analyses were performed using the SAS/STAT (version 9.1; SAS Institute Inc., Cary, North Carolina, USA) software package running on Windows XP Professional. The criterion for statistical significance was set at α = 0.05.
Patient characteristics at baseline, Follow-up #1 and Final Follow-up.
Prior hip fracture
Prior wrist fracture
Prior spine fracture
5.8 (486 (8365)
High risk patients
Appropriate Therapy Administration: Generalized Estimating Equations
The use of appropriate therapy in the High risk, Low risk and Low risk without fractures group at baseline, Follow-up #1 and Follow-up #2*
High risk group
Low risk group
Low risk group without fractures
Appropriate therapy during the study determined by the Generalized estimating equations, Random coefficient, and Logistic regression analyses.*
Generalized estimating equations¶
Random coefficient analysis¶
Logistic regression analysis¶
Low risk without fracture
Appropriate Therapy Administration: Random Coefficient and Logistic Regression Analyses
Results from the random coefficient reveal similar findings to the generalized estimating equations analysis for all three groups (Table 3). However, the logistic regression analysis had a greater number of significant results. In contrast to both the generalized estimating equations and random coefficient analysis, where no significant results were found, findings from the logistic regression analysis indicated that appropriate therapy was significantly given more often during follow-up # 1 for low risk patients and during the final follow-up for low risk patients without fracture.
To guide physicians in treating the disease, Osteoporosis Canada has developed and circulated the 2002 Clinical Practice Guidelines for the Management of the disease . Nonetheless, even with guidelines, it has been demonstrated that a care gap exist in managing patients in everyday clinical settings [16–18, 24, 25].
There are several potential reasons as to why osteoporosis is under-treated. For instance, family physicians may have a tendency to overlook the impact of osteoporosis given that individuals with osteoporosis are no symptoms (other than fracture), and may instead focus on other conditions they consider more severe. Physicians may lack confidence regarding the management of osteoporosis and thus are not able to provided appropriate treatment strategies, they may not be aware or may not understand the Osteoporosis Canada's management guidelines for osteoporosis that outline treatment options, or they may be discouraged by low patient adherence to their medications possibly due to poor patient education and as a consequence prescribe less often.
Given this care gap, and the availability of effective osteoporosis therapies, our study was designed to improve patient care. Following the educational interventions that included the distribution and discussion of educational materials related to the 2002 OC guidelines, the evaluation of physician profiles, an educational workshop, and facilitators led small group discussions that identify barriers to the management of osteoporosis and strategies to improve patient care, family physicians demonstrated greater odds of administering osteoporosis therapy appropriately over a two year period. The appropriate use of therapy was observed in both high and low risk patients, which revealed that physicians did not just prescribe more therapy in general, but reduced their osteoporosis prescriptions in low risk patients.
There were differences in the use of appropriate therapy between the two low risk groups (appropriate therapy increase significantly in the low risk group with no fractures and remained unchanged in the low risk group). This finding is interesting and may indicate that physicians are more willing to treat patients with fractures regardless of their bone density measurements (i.e. normal or no bone density measurement) in spite of the guidelines recommendations.
To compare the results produced by the generalized estimating equations analyses (our primary analysis), a random coefficient (mixed effects model) and standard logistic regression analyses were conducted. For the generalized estimating equations analysis, a correction is made for the within-physician correlations between the repeated measurements by assuming a working correlation structure. For the current study, the correlation between individual physicians and their patients were 0.11, 0.10, and 0.09 for the high risk, the low risk, and the low risk group without fractures, respectively. The generalized estimating equations method is robust to an assigned correlation structure; such that if a correlation structure is misspecify the analysis will still obtain consistent parameter estimates . The random coefficient analysis, deals with within-physician correlations by allowing different coefficients to be random. The logistic regression analysis does not take into account the correlation and treats the data as independent [21, 23].
Both the logistic and random coefficient analysis confirmed our finding with the generalized estimating equations analysis. However, conclusions drawn from the results of these methods should be viewed in the context of the models. The main concern with ordinary logistic regression is that the analysis does not take into account the within subject correlation of the physicians resulting from repeated measures. As a consequence, while the parameter estimates from the logistic regression analyses are similar to the other models, the standard errors of the estimates are generally smaller resulting in smaller confidence intervals and p-values. As a consequence, logistic analysis revealed more significant results for both the low risk and low risk without fracture groups as compared with the generalized estimating equations and random coefficient analyses.
Furthermore, it is important to realize that the regression coefficients calculated with generalized estimating equations method are population averaged. The regression coefficients calculated with random coefficient analysis can be seen as subject specific [21, 23]. As a result, these two model types have different targets of inference. Given that we performed a trial concerned with changes in the mean responses over time in the study population and we were not interested in individual physician change over time, the generalized estimating equations technique is a more appropriate analysis as compared with the random coefficient method.
There are other methods available for analyzing clustered data including unweighted linear regression analysis or robust standard errors . In general, analyses may be performed using individual-level data or aggregated at the cluster level. Analyses at the aggregated level are conducted using data derived from summary statistics for each cluster.
Given the large number of methods available and the fact that results may differ among techniques, it is important that investigators specify the primary data analysis in advance. However, while simulation studies show that generalizing estimating equations have the greatest statistical power among several commonly used methods for analyzing binary clustered data, there are no guidelines that evaluated what method is the most appropriate; therefore, individual investigators will have to make judgments as to which analysis to conduct [26, 27].
This national study has several important strengths. For example, the project selected a large number of family physicians from across the country who examined over 19000 patients' charts from their own practices, which will improve the generalizability of our findings. Furthermore, the patient chart audits were chosen at random and did not depend on physicians self-reports, which may mirror physicians' attitudes about their practice but not reflect the true practice. Because single-component interventions have not consistently been found to transform behavior [28–30], the QC project combined various methodologies into one multifaceted intervention, which may be more useful [31, 32]. In addition, physicians' behavior change observed in our study was long lasting, given that the project was conducted over a two year period.
Nonetheless, our study has some limitations. All patients examined in the project were postmenopausal women and as a consequence, the relationship between appropriate management over time may be different in premenopausal women or male patients. Furthermore, given that physician recruitment was based on the clinician's interest in women's health and osteoporosis, these members may have more knowledge in treating the disease prior to enrollment. Also, because only physicians who were interested and willing to commit to the second year of the project completed the final follow-up data collection, a lower sample of physicians reduce the power of the study to detect change over that time period. Moreover, a randomized control trial of physicians is necessary to determine the precise mechanism that the educational intervention had on physicians' behavior. Finally, it is important to consider that Osteoporosis Canada practice guidelines were developed and distributed to provide clinicians with a summary of the best evidence from clinical trials to help physicians make health care decisions regarding osteoporosis; however, clinical judgment and the patient's preference, will determine if therapy is initiated. As such, 100% compliance to the guidelines is not reasonable.
In conclusion, it is vital that physicians do not prescribe medications to low risk patients and treat individuals who are at high risk for developing fractures given that several treatments have been shown to prevent fractures. The QC technique is an effective knowledge translation approach that increases family physicians' utilization of appropriate therapy in accordance with the Osteoporosis Canada 2002 guidelines. As a result of appropriate care, patients' health outcomes should improve by reducing the risk of future fractures.
The project is sponsored by unrestricted research grants from the Ontario College of Family Physicians and the Alliance for Better Bone Health (Procter & Gamble Pharmaceuticals Canada Inc. and sanofi-aventis Pharma Inc.). George Ioannidis was supported by the CIHR Strategic Training Program in Skeletal Health Research grant.
- Jones G, Nguyen T, Sambrook PN, Kelly PJ, Gibert C, Eisman JA: Symptomatic fracture incidence in elderly men and women: The Dubbo osteoporosis epidemiologic study (DOES). Osteoporos Int. 1994, 4: 277-282. 10.1007/BF01623352.View ArticleGoogle Scholar
- Kannue P, Niemi S, Parkkari J, Palvanen M, Vuori I, Jarvinen M: Hip fractures in Finland between 1970 and 1997 and predictions for the future. Lancet. 1999, 353: 802-805. 10.1016/S0140-6736(98)04235-4.View ArticleGoogle Scholar
- Adachi JD, Ioannidis G, Pickard L, Berger C, Prior JC, Joseph L: The association between osteoporotic fractures and health-related quality of life as measured by the Health Utilities Index in the Canadian Multicentre Osteoporosis Study (CaMos). Osteoporos Int. 2003, 14: 895-904. 10.1007/s00198-003-1483-3.View ArticleGoogle Scholar
- Lips P: Epidemiology and predictors of fractures associated with osteoporosis. Am J Med. 1997, 103: 3S-11S. 10.1016/S0002-9343(97)90021-8.View ArticleGoogle Scholar
- Cauley JA, Thompson DE, Ensrud KC, Scott JC, Black D: Risk of mortality following clinical fractures. Osteoporos Int. 2000, 11: 556-561. 10.1007/s001980070075.View ArticleGoogle Scholar
- Leidig G, Minne HW, Sauer P, Wüster C, Wüster J, Lojen M: A study of complaints and their relationship to vertebral destruction in patients with osteoporosis. Bone and Miner. 1990, 8: 217-229. 10.1016/0169-6009(90)90107-Q.View ArticleGoogle Scholar
- Greendale GA, Barrett-Connor E, Ingles S, Haile R: Late physical and functional effects of osteoporotic fractures in women: the Rancho Bernardo study. J Am Geriatr Soc. 1995, 43: 955-961.View ArticleGoogle Scholar
- Jensen GF, Bagger J: Long-term social prognosis after hip fracture. Acta Orthop Scand. 1982, 53: 97-101.View ArticleGoogle Scholar
- Lyles KW, Gold DT, Shipp KM, Pieper CF, Martinez S, Mulhausen PL: Association of osteoporotic vertebral compression fractures with impaired functional status. Am J Med. 1993, 94: 595-601. 10.1016/0002-9343(93)90210-G.View ArticleGoogle Scholar
- Adachi JD, Ioannidis G, Olszynski WP, Brown JP, Hanley DA, Sebaldt RJ: The impact of incident vertebral and non-vertebral fractures on health related quality of life in postmenopausal women. BMC Musculoskeletal Disorders. 2002, 3: 11-10.1186/1471-2474-3-11.View ArticleGoogle Scholar
- de Bruijn HP: Functional treatment of Colles fracture. Acta Orthop Scand. 1987, 223 (Suppl): 1-95.View ArticleGoogle Scholar
- Kaukonen JP, Karaharju EO, Porras M, Lüthje P, Jakobsson A: Functional recovery after fractures of the distal forearm: analysis of radiographic and other factors affecting the outcome. Ann Chir Gynaecol. 1988, 77: 27-31.Google Scholar
- Goeree R, O'Brien B, Pettitt D, Cuddy L, Ferraz M, Adachi J: An assessment of the burden of illness due to osteoporosis in Canada. J Soc Obstet Gynaecol Can. 1996, 18: 15-14.Google Scholar
- Wiktorowicz ME, Goeree R, Papaioannou A, Adachi JD: Economic implications of hip fracture: Health services use, institutional care and cost in Canada. Osteoporos Int. 2001, 12: 271-278. 10.1007/s001980170116.View ArticleGoogle Scholar
- Brown JP, Josse RG, for the scientific advisory council of the osteoporosis society of Canada: 2002 Clinical practice guidelines for the diagnosis and management of osteoporosis in Canada. Can Med Assoc J. 2002, 167: S1-S34.Google Scholar
- Papaioannou A, Wiktorowicz M, Adachi JD, Goeree MA, Papadimitropoulos E, Bédard M, et al: Mortality, independence, in living and re-fracture, one year following hip fracture in Canadians. J Soc Obstet Gynaecol Can. 2000, 22: 591-597.Google Scholar
- Freedman KB, Kaplan FS, Bilker WB, Strom BL, Lowe RA: Treatment of osteoporosis: Are physicians missing an opportunity?. J Bone Joint Surg Am. 2000, 82: 1063-1070.Google Scholar
- Gehlbach SH, Fournier M, Bigelow C: Recognition of osteoporosis by primary care physicians. Am J Public Health. 2002, 92: 271-273. 10.2105/AJPH.92.2.271.View ArticleGoogle Scholar
- Ioannidis G, Papaioannou A, Thabane L, Gafni A, Hodsman A, Kvern B, Johnstone D, Plumley N, Baldwin A, Doupe M, Katz A, Salach L, Adachi JD: Canadian quality circle pilot project in osteoporosis. Rationale, methods, and feasibility. Can Fam Physician. 2007, 53: 1694-1700.Google Scholar
- Ioannidis G, Thabane L, Gafni A, Hodsman A, Kvern B, Johnstone D, Plumley N, Salach L, Jiwa F, Adachi JD, Papaioannou A: Optimizing care in osteoporosis: The Canadian quality circle project. BMC Musculoskeletal Disorders. 2008, 9: 130-10.1186/1471-2474-9-130.View ArticleGoogle Scholar
- Liang KY, Zeger SL: Longitudinal data analysis using generalized linear models. Biometrika. 1986, 73: 13-22. 10.1093/biomet/73.1.13.View ArticleGoogle Scholar
- Horton NJ, Bebchuk JD, Jones CL, Lipsitz SR, Catalano PJ, Zahner GE, Fitzmaurice GM: Goodness-of-fit for GEE: an example with mental health service utilization. Statist Med. 1999, 18: 213-222. 10.1002/(SICI)1097-0258(19990130)18:2<213::AID-SIM999>3.0.CO;2-E.View ArticleGoogle Scholar
- Fitzmaurice GM, Laird NM, Ware JH: Applied longitudinal analysis. 2004, John Wiley & Sons, Inc., Hoboken, New JerseyGoogle Scholar
- Khan SA, de Geus C, Holroyd B, Russell AS: Osteoporosis follow-up after wrist fractures following minor trauma. Arch Intern Med. 2001, 161: 1309-1312. 10.1001/archinte.161.10.1309.View ArticleGoogle Scholar
- Juby AG, De Geus-Wenceslau CM: Evaluation of osteoporosis treatment in seniors after hip fracture. Osteoporos Int. 2002, 13: 205-210. 10.1007/s001980200015.View ArticleGoogle Scholar
- Peters TJ, Richards SH, Bankhead CR, Ades AE, Sterne JA: Comparison of methods for analyzing cluster randomized trials: an example involving a factorial design. Int J Epidemiol. 2003, 32: 840-846. 10.1093/ije/dyg228.View ArticleGoogle Scholar
- Austin P: A comparison of the statistical power of different methods for the analysis of cluster randomization trials with binary outcomes. Stat Med. 2006, 26: 3550-3565. 10.1002/sim.2813.View ArticleGoogle Scholar
- Grol R, Grimshaw J: From best evidence to best practice: effective implementation of change in patients' care. Lancet. 2003, 362: 1225-1230. 10.1016/S0140-6736(03)14546-1.View ArticleGoogle Scholar
- Majumdar SR, Soumerai SB: Why most interventions to improve physician prescribing do not seem to work. Can Med Assoc J. 2003, 169: 30-31.Google Scholar
- Grimshaw JM, Shirran L, Thomas R, Mowatt G, Fraser C, Bero L, Grilli R, Harvey E, Oxman A, O'Brien MA: Changing provider behavior: an overview of systematic reviews of interventions. Med Care. 2001, 39: 112-145. 10.1097/00005650-200108002-00002.View ArticleGoogle Scholar
- Hulscher ME, Wensing M, Grol RP, van der Weijden T, van Weel C: Interventions to improve the delivery of preventive services in primary care. Am J Public Health. 1999, 89: 37-46. 10.2105/AJPH.89.5.737.View ArticleGoogle Scholar
- Solomon DH, Hashimoto H, Daltroy L, Liang MH: Techniques to improve physicians' use of diagnostic tests. JAMA. 1998, 280: 2020-2027. 10.1001/jama.280.23.2020.View ArticleGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6920/9/54/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.