What are the learning outcomes of a short postgraduate training course in dermatology for primary care doctors?
© Lam et al; licensee BioMed Central Ltd. 2011
Received: 22 October 2010
Accepted: 16 May 2011
Published: 16 May 2011
There are increasing expectations on primary care doctors to shoulder a bigger share of care for patients with common dermatological problems in the community. This study examined the learning outcomes of a short postgraduate course in dermatology for primary care doctors.
A self-reported questionnaire developed by the research team was sent to the Course graduates. A retrospective design was adopted to compare their clinical practice characteristics before and after the Course. Differences in the ratings were analysed using the nonparametric Wilcoxon signed rank test to evaluate the effectiveness of the Course in various aspects.
Sixty-nine graduates replied with a response rate of 42.9% (69/161). Most were confident of diagnosing (91.2%) and managing (88.4%) common dermatological problems after the Course, compared to 61.8% and 58.0% respectively before the Course. Most had also modified their approach and increased their attention to patients with dermatological problems. The number of patients with dermatological problems seen by the graduates per day showed significant increase after the Course, while the average percentage of referrals to dermatologists dropped from 31.9% to 23.5%. The proportion of graduates interested in following up patients with chronic dermatological problems increased from 60.3% to 77.9%.
Graduates of the Course reported improved confidence, attitudes and skills in treating common dermatological problems. They also reported to handle more patients with common dermatological problems in their practice and refer fewer patients.
Keywordscontinuing medical education dermatology learning outcomes postgraduate training primary care doctors
Studies show that 8-15% of primary care consultations involve a dermatological problem [1–3]. There are increasing expectations on primary care doctors to shoulder a bigger share of care for patients with common dermatological problems in the community [4, 5]. However, some primary care doctors were inadequately trained to meet these expectations [6, 7]. Studies indicated that undergraduate training in dermatology is insufficient in many countries [8, 9], and the need for vocational training and continuing medical education in dermatology has been emphasized [10–13].
In recent years, there is a global trend to improve the quality of primary care doctors in terms of their medical knowledge and practice through postgraduate studies [14, 15]. Studies showed that primary care doctors exhibited improvements in clinical practices, patient care and lifelong learning interest after completing postgraduate courses [16, 17]. There is however little information available in the literature on the possible effect of postgraduate training on improving the skills and confidence of primary care doctors in the care of patients with common dermatological problems as well as the rate of referrals to dermatologists [18, 19].
The study topics of the training programme
Management approach to eczema/dermatitis
Acne and rosacea
Psoriasis and other scaling eruptions
Diagnostic algorithms for common dermatoses
Common cutaneous infections
Common facial dermatoses
Allergy and urticaria
Geriatric skin disorders
Paediatric skin diseases
Common scalp, hair and nail disorders
Sexually transmissible diseases
Skin and systemic diseases
Common dermatological therapy
Benign and malignant skin tumours
Practical guide in skin surgery
Over 190 doctors, with the great majority being primary care doctors, have been trained in this Course since 2007. It was expected that the Course would have significant impact on these doctors, including improvements in clinical skills, attitude, confidence, and changes in number of patients handled in relation to dermatological problems and referral rates. Our study aimed to investigate and report these changes.
A self-reported questionnaire for the Course graduates was developed based on the review of relevant literature and comments from research team members. Likert scale questions and open-ended questions were included to obtain both quantitative and qualitative data. A retrospective design was adopted to compare the clinical practice characteristics of the graduates before and after the Course. The questionnaire was pilot-tested in July 2008 and finalized the following month. A lucky draw (three prizes of US$60 book coupon each) was carried out amongst all those who had completed and returned their questionnaires as an incentive measure. Ethics approval was obtained from the local Institutional Review Board.
Copies of the questionnaire, each enclosed with an invitation letter and a pre-paid return envelope, were sent to all graduates of CCCD of year 2007. The questionnaire itself was anonymous but coded with a reference number to identify the respondent for the lucky draw and for subsequent rounds of reminders. The code was known to a research assistant only and not available to members of the research team. A total of 163 questionnaires were sent to the CCCD graduates in August 2008 i.e. at least 8 months after completing the Course to avoid premature comments from fresh graduates. Non-respondents were sent up to two reminders between September and December 2008. To improve the response rate, doctors who had not responded were contacted by telephone after the first reminder.
Quantitative analysis was carried out using the statistical software SPSS version 17.0. The measurements were mainly made in ordinal scale, statistical inference via the nonparametric Wilcoxon signed rank test was used to determine if there were significant changes in the median of the differences in the responses before and after taking the Course. A negative value in the median of the differences was an indication that the respondents tended more on the agreed side or a higher number reported after taking the Course. In our study, there were various items to be tested. Improvements (increase) were assumed in cases regarding confidence and attitude, while a change in referrals rates (either increase or decrease) was expected. Two-sided tests were used throughout this study whenever appropriate. A p-value < 0.05 was considered statistically significant. In the sequel, we shall simply quote only the p-values and draw conclusions instead of going through the description of testing the null hypothesis that the median is zero indicating no change in the responses after taking the Course. The description in each case would emphasize on the pattern of the differences when the null hypothesis is rejected. Furthermore, the Kappa statistics and the Bowker's test of symmetry were used to measure the degree of agreement and test for symmetry between the responses before and after the Course. Small values of Kappa and p-value based on the Bowker's test are associated with significant changes in the responses before and after taking the Course.
The qualitative responses were analyzed with a thematic approach and grouped into common themes independently by one of the authors, TPL and a research assistant who were both experienced in qualitative research. The consistency between the two entries was checked.
Out of the 163 questionnaires sent to the graduates, 2 postal addresses were invalid. We received 69 replies after three rounds of invitation, with a response rate of 42.9% (69/161). Of the respondents, 65.7% were male and 34.3% female, 66.2% were in private service and 33.8% were in public service. Majority (82.5%) of the respondents were primary care doctors working in the community, and the remaining few were working in the specialties of internal medicine and paediatrics within the hospital setting. The mean (SD) years after graduation from medical school was 17.3 (10.70).
The Main Learning Outcomes
Learning outcomes of the Course (in descending order of combined frequencies of Likert scales 3 and 4)
As a result of the course,
I have paid more attention to patients with
I have increased my confidence in distinguishing
different types of dermatological problems
I have modified my approach to patients with
I have increased my interest in lifelong learning
through additional training
I have increased my interest in pursuing
other postgraduate studies
My career opportunities have enhanced
Comparison of Reported Clinical Practice Before and After Taking the Course
Reported changes in referrals and engagement in the care of patients with dermatological problems
Percentage of patients with dermatological
problems being referred to dermatologist* (n = 60)
0 - 10
11 - 20
21 - 30
Z = 4.547, p < 0.001
31 - 40
41 - 50
Of all the referrals to dermatologist, percentage of
patients being referred at first consultation* (n = 60)
1 - 20
21 - 40
Z = 3.905, p < 0.001
41 - 60
61 - 80
81 - 100
Number of patients with dermatological problems
seen per week (n = 67)
0 - 5
6 - 10
11 - 15
Z = -3.771, p < 0.001
16 - 20
Changes in confidence and attitude in the care of patients with dermatological problems
I am confident of diagnosing patients with
common dermatological problems (e.g. eczema,
allergy, drug eruptions, cutaneous infections)
(n = 68)
Z = -5.444, p < 0.001
I am confident of managing common
dermatological problems (n = 69)
Z = -4.545, p < 0.001
I am confident of diagnosing malignant skin
tumours (n = 68)
Z = -4.508, p < 0.001
I am interested in following up patients with
chronic dermatological problems (n = 68)
Z = -3.962, p < 0.001
The average percentage of patients with dermatological problems being referred to dermatologists reported by the respondents had dropped significantly from 31.9% before the course to 23.5% after completing the Course. Most patients were not referred at first consultation. Of all the referrals to dermatologists, the reported average percentage of patients being referred at first consultation decreased from 34.1% to 24.6%. Besides, the number of patients with dermatological problems seen by the respondents per day showed a significant increment after taking the Course.
A cross tabulation of the pre- and post-Course responses regarding confidence in diagnosing and managing patients with common dermatological problems
I am confident of diagnosing patients
with common dermatological
I am confident of managing common
Graduates were also asked if they were interested in following up chronic dermatological problems. The combined percentage of "agree" and "strongly agree" increased from 60.3% to 77.9% after taking the Course.
"Learn the updated management protocol/methods on common dermatological problems."
"It helps me to differentiate common dermatological illness, and not to miss important signs and symptoms."
"Increase confidence in common diagnoses, know more clearly my limitations."
"Realise how much more knowledge I should learn."
"I now realise that undergraduate dermatology training was "no" training."
"Develop more interest in Dermatology."
"Difficult to convince patient to have skin scrapping for investigation."
"To persuade patient to do further investigations is difficult, because most of the laboratory fee is expensive."
"I'm still not confident of skin biopsies."
We know of very few medical schools around the world that have developed similar postgraduate training programme to improve the dermatological knowledge and skills of primary care doctors. Less than one third of primary care doctors in the UK were reported to have received any postgraduate training in dermatology . Our Course is the result of close collaboration between dermatologists and family physicians which has produced encouraging outcomes. The proportion of respondents being confident of diagnosing and managing common dermatological problems such as eczema, allergy, drug eruptions, cutaneous infections increased from about 60% to 90% after taking the Course.
Before taking the Course, the respondents would refer on average 31.9% of their patients with dermatological problems to dermatologists, which was slightly lower than the 37.5% reported in a US study . The average referral percentage dropped significantly to 23.5% after taking the Course. Besides, there was an increase in the percentage of graduates being interested in following up patients with chronic dermatological problems. These results showed that our graduates were more ready to look after patients with common dermatological problems. This enhances the gate-keeping function of reducing unnecessary referrals to specialist dermatological services, especially in the public sector. These specialist dermatology clinics will also benefit from being able to concentrate their service to those difficult and complex cases requiring specialist care . It is a win-win outcome for all parties concerned.
In recent years, the importance of early diagnosis of malignant skin tumour in primary care is emphasized . Our study found that the proportion of graduates being confident of diagnosing malignant skin tumours increased from 45.5% to 72.1% after taking the Course. These changes suggest that our graduates are likely to be more effective in looking after patients with malignant skin tumours. These are in line with the findings by Westerhoff et al that Australian primary care doctors benefited from a training course in melanoma diagnosis using skin surface microscopy .
The improvements in knowledge and skills of primary care doctors towards dermatology are also important for the training of future doctors. Medical students are getting increasing curriculum time in primary care setting in many medical schools, where they can be potentially exposed to a wide variety of dermatological problems . These learning opportunities can only be fully utilized if their primary care teachers are also competent in the field of dermatology.
This study has certain limitations. The self-reported questionnaire survey has attained a response rate of 42.9%, which though is not particularly high for this kind of study, but is already much better than most other surveys among doctors in Hong Kong [23–25]. It is possible that the respondents consist of a higher proportion of graduates who benefited relatively more (or less) from the Course. Moreover, the findings of this study came from doctors in the same healthcare system in Hong Kong which is a unique mix of private and public practice. Their educational and clinical needs may be different from doctors working in other countries. Despite that, the experience that we have gained from the present study should be useful to postgraduate medical educators in other countries in meeting the demand of healthcare services for patients with dermatological problems.
The self-reported data from the graduates show that the Course is effective in improving their confidence and attitudes in looking after patients with common dermatological problems. There are significant changes in the reported practice characteristics of the graduates before and after taking the Course, including increased number of patients handled in relation to dermatological problems as well as decreased percentage of patients being referred.
Certificate Course in Clinical Dermatology
This study was funded by Committee on Research and Conference Grants of The University of Hong Kong [grant number 200807176094]. The authors would like to thank all those graduates of the Certificate Course in Clinical Dermatology of The University of Hong Kong for completing the questionnaire.
- Britt H, Miller GC, Charles J, Henderson J, Bayram C, Pan Y, Valenti L, Harrison C, Fahridin S, O'Halloran J: General practice activity in Australia, 2008-09. General practice series no. 25. Cat. no. GEP 25. 2009, Canberra: AIHWGoogle Scholar
- Lowell BA, Froelich CW, Federman DG, Kirsner RS: Dermatology in primary care: Prevalence and patient disposition. J Am Acad Dermatol. 2001, 45: 250-5. 10.1067/mjd.2001.114598.View ArticleGoogle Scholar
- Awadalla F, Rosenbaum DA, Camacho F, Fleischer AB, Feldman SR: Dermatologic disease in family medicine. Fam Med. 2008, 40: 507-11.Google Scholar
- Department of Health: Guidance and Competencies for the Provision of Services using GPs with Special Interests (GPwSIs) - Dermatology and Skin Surgery. 2007, London: DoH, accessed 26 May 2010, [http://www.pcc.nhs.uk/uploads/pwsis/gpwsis_dermatology.pdf]Google Scholar
- Kerr OA, Tidman MJ, Walker JJ, Aldridge RD, Benton EC: The profile of dermatological problems in primary care. Clin Exp Dermatol. 2009, 35: 380-383.View ArticleGoogle Scholar
- Feldman SR, Fleischer AB, Chen JG: The gatekeeper model is inefficient for the delivery of dermatologic services. J Am Acad Dermatol. 1999, 40: 426-32. 10.1016/S0190-9622(99)70492-5.View ArticleGoogle Scholar
- Chen SC, Pennie ML, Kolm P, Warshaw EM, Weisberg EL, Brown KM, Ming ME, Weintraub WS: Diagnosing and managing cutaneous pigmented lesions: primary care physicians versus dermatologists. J Gen Intern Med. 2006, 21: 678-82. 10.1111/j.1525-1497.2006.00462.x.View ArticleGoogle Scholar
- McCleskey PE, Gilson RT, DeVillez RL: Medical Student Core Curriculum in Dermatology Survey. J Am Acad Dermatol. 2009, 61: 30-5e4. 10.1016/j.jaad.2008.10.066.View ArticleGoogle Scholar
- Davies E, Burge S: Audit of dermatological content of U.K. undergraduate curricula. Br J Dermatol. 2009, 160: 999-1005. 10.1111/j.1365-2133.2009.09056.x.View ArticleGoogle Scholar
- Moreno G, Tran H, Chia AL, Lim A, Shumack S: Prospective study to assess general practitioners' dermatological diagnostic skills in a referral setting. Australas J Dermatol. 2007, 48: 77-82. 10.1111/j.1440-0960.2007.00340.x.View ArticleGoogle Scholar
- Harlow ED, Burton JL: What do general practitioners want from a dermatology department?. Br J Dermatol. 1996, 134: 313-8. 10.1111/j.1365-2133.1996.tb07620.x.View ArticleGoogle Scholar
- Hussain W, Hafiji J, Stanley AG, Khan KM: Dermatology and junior doctors: an evaluation of education, perceptions and self-assessed competencies. Br J Dermatol. 2008, 159: 505-6. 10.1111/j.1365-2133.2008.08654.x.View ArticleGoogle Scholar
- Ozcan A, Senol M, Karaca S, Kalayci B: The evaluation of dermatologic education in the postgraduate period. Med Teach. 2006, 28: 391-2.View ArticleGoogle Scholar
- Esmaily HM, Savage C, Vahidi R, Amini A, Zarrintan MH, Wahlstrom R: Identifying outcome-based indicators and developing a curriculum for a continuing medical education programme on rational prescribing using a modified Delphi process. BMC Med Educ. 2008, 8: 33-10.1186/1472-6920-8-33.View ArticleGoogle Scholar
- Lam TP, Lam KF, Tse EY: Why do primary care doctors undertake postgraduate diploma studies in a mixed private/public Asian setting?. Postgrad Med J. 2006, 82: 400-3. 10.1136/pgmj.2005.042077.View ArticleGoogle Scholar
- Illing J, Taylor GB, O'Halloran C: Can a postgraduate course for general practitioners deliver perceived benefit for learners, patients and the NHS?: a qualitative study. Med Teach. 2002, 24: 67-70. 10.1080/00034980120103513.View ArticleGoogle Scholar
- Taanila A, Larivaara P, Korpio A, Kalliokoski R: Evaluation of a family-oriented continuing medical education course for general practitioners. Med Educ. 2002, 36: 248-57. 10.1046/j.1365-2923.2002.01144.x.View ArticleGoogle Scholar
- Carli P, De Giorgi V, Crocetti E, Caldini L, Ressel C, Giannotti B: Diagnostic and referral accuracy of family doctors in melanoma screening: effect of a short formal training. Eur J Cancer Prev. 2005, 14: 51-5. 10.1097/00008469-200502000-00007.View ArticleGoogle Scholar
- Raasch BA, Hays R, Buettner PG: An educational intervention to improve diagnosis and management of suspicious skin lesions. J Contin Educ Health Prof. 2000, 20: 39-51. 10.1002/chp.1340200108.View ArticleGoogle Scholar
- Tan E, Levell NJ, Garioch JJ: The effect of a dermatology restricted-referral list upon the volume of referrals. Clin Exp Dermatol. 2007, 32: 114-5.Google Scholar
- National Health and Medical Research Council: Clinical practice guidelines: the management of cutaneous melanoma. 1999, Canberra: Australian Cancer NetworkGoogle Scholar
- Westerhoff K, McCarthy WH, Menzies SW: Increase in the sensitivity for melanoma diagnosis by primary care physicians using skin surface microscopy. Br J Dermatol. 2000, 143: 1016-20. 10.1046/j.1365-2133.2000.03836.x.View ArticleGoogle Scholar
- The Harvard Team: Special Report #4 - Hong Kong Private Practice Survey. Harvard Report. 1998Google Scholar
- The Hong Kong Medical Association: Report of Doctors' Fees Survey 2006. 2010, [http://www.hkma.org/english/newsroom/newsroom.htm]Google Scholar
- Leung GM, Ho LM, Chan MF, Johnston JM, Wong FK: The effects of cash and lottery incentives on mailed surveys to physicians: a randomized trial. J Clin Epidemiol. 2002, 55: 801-7. 10.1016/S0895-4356(02)00442-0.View ArticleGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6920/11/20/prepub