Identification of core competencies for primary care of allergy patients using a modified Delphi technique
© Wallengren; licensee BioMed Central Ltd. 2011
Received: 6 August 2010
Accepted: 4 April 2011
Published: 4 April 2011
The majority of allergy patients who seek medical advice are seen in primary care. In-service training of professionals in general practice is needed in order to increase knowledge among primary care clinicians about allergy. Therefore it is important to establish a consensus about what primary care professionals should be able to do, and what the public can expect. We sought to identify core competencies for good practice amongst primary care providers with respect to diagnosis and therapy of allergic diseases and to outline learning objectives for a postgraduate training programme in this field.
The study involved three rounds, involving a total of 43 expert panellists. In the first round, a panel was asked to indicate competencies (knowledge, diagnostics, therapy and communication) necessary for primary care providers. The second and third rounds were answered by primary care physicians (26) and nurses (10). A Likert scale 1-4 was applied in the second round and two choices ("agree"/"disagree") in the third round, with a criterion of 75% being adopted.
The second round included 80 competencies and the third 50. The third round selected a consensus of 46 competencies defining nine learning outcomes for in-service medical training.
The competencies in the field of allergy recommended in this study may serve as a reference of what can be expected from primary care providers.
Asthma, urticaria, atopic dermatitis, and allergic rhinitis are common diseases that impact the patient's quality of life and need for training and support. The number of allergy specialists varies in different parts of the world, and the majority of patients who seek medical advice are seen in primary care. Continuity of care is often easier to provide in general practice. Primary care has also been shown to be more cost-effective compared to hospital care . There is, however, a great diversity in knowledge and tools for the management of this patient group in different settings and there is need for in-service training of professionals in order to provide guideline-driven and evidence-based health care. Recently, a few guidelines focused on management of allergy patients in primary care have been produced. So far, there are only guidelines for patients with respiratory allergy [2, 3]. These guidelines are based on systemic reviews and expert opinions. The goal is that well trained primary care teams will be able to follow the guidelines. At many primary care units, allergy patients are treated by physicians and nurses with special expertise in asthma/COPD. These nurses have in-depth training in asthma and respiratory allergy. However, there may be gaps concerning manifestations of allergic diseases in other organs like skin or gastrointestinal tract. Therefore it is important to establish a consensus of what primary care professionals are able to do for all categories of patients with allergic diseases, and what the public can expect. As dermatologist, the author of the present study wanted to focus on a broad spectrum of allergic diseases, not only on the respiratory manifestations.
Competencies in primary care necessary for the management of allergy patients may be evaluated by different means. The most common approach is brainstorming or nominal group technique - structured face-to-face consensus meeting of specialists and general practitioners. A disadvantage of meetings is that some panel members can be inhibited by stronger individuals who dominate the group. Another approach for reaching consensus is a voting system at larger meetings . The statements on which voting is carried out are prepared by the panel members but consensus is based on the vote. A pitfall here may be that the participants, although interested in the subject, do not always have extensive experience unless there are special criteria for voting.
A common approach for reaching consensus is the Delphi technique that has been employed for determining training needs and curriculum content of various medical undergraduate programmes as well as in-service professional training and health research [5–8]. In this procedure, the expert opinions are collected independently and anonymously using a postal system or e-mail . Experts are invited to suggest competencies, without being aware of the identity of the other respondents. The suggestions are incorporated into a questionnaire that is sent to the panel participants who then complete the questionnaire anonymously in several rounds. As a part of the process, the responses are fed back in summarised form to the participants and the number of competencies is successively cut down by omitting statements that gained less then 25% agreement until consensus is reached. A recent report shows how a national Canadian paediatric trauma curriculum has been developed using the Delphi process. This curriculum was created from scratch by four experts who developed aims, objectives and skill sets through three rounds to reach consensus. The draft was later evaluated by 11 site coordinators and a final curriculum was established .
We sought to make recommendations towards core competencies in the field of allergy for primary care units. The reached consensus was then used to recommend learning objectives for postgraduate training. A modified Delphi technique was chosen for this project in order to obtain views from practitioners from across the country, giving each contributor equal weighting. As the primary care of allergy patients is often handled by a team, it was considered important to include nurses in the study.
Selection of panel members
The panel, recruited from the whole of Sweden, was invited to suggest what they considered important competencies in the primary care setting for investigation and treatment of allergy patients. Specialists in allergology (3), clinical immunology (3), dermatology (3), otolaryngology (3) and paediatric allergy (3) who are often engaged as lecturers in national training programmes in asthma and allergy and consensus meetings were contacted by e-mail. The reason for such selection was that specialists would be able to identify common practice gaps in their special fields of interest. However, only the professionals actually involved in primary care can see the reality for allergy patients among other patients treated at the unit. Therefore, the second and third rounds were performed by general practitioners and primary care nurses. The inclusion criteria for general practitioners with special interest in allergy (15) and primary care nurses with special expertise in asthma/COPD (5) were: professional experience exceeding five years and participation in educational programmes in the field of allergy. The final rating of the competencies was left to the doctors (39) and nurses (8) from primary care with special interest in allergy.
This study employs a modified Delphi methodology, keeping the core principle of elucidating most important issues by peeling off less important ones through several rounds. We were, however, not able to employ the same panel in all rounds of the investigation due to dropout as the respondents felt that participation was too time-consuming.
The Delphi technique was carried out in three rounds. The aim of the first round was to list the competencies for good practice for primary care providers with respect to the diagnosis and therapy of allergic diseases. The first round took place in November and December 2008. The panellists were addressed with an open question, "What competencies in a primary care setting are desired for management of allergy patients?" and were asked to respond in their own words. The invitation was sent to 15 general practitioners, 5 asthma/COPD nurses and 15 secondary care physicians.
In the first questionnaire a mean score was calculated for all competencies listed. A minimum of 3.25 on the Likert scale was mandatory in order to qualify for inclusion in the second questionnaire in the third round. The cut-off point of 3.25 was an arbitrary decision as it corresponds to 75% of answers scoring 2 to 4 points (desirable - necessary). In the final round an agreement of 75% of the panel answers was necessary for inclusion of a competency in the final list, which was then regarded as consensus.
Formulating the objectives of a training programme
A synthesis of core competencies into domains was used to specify the objectives of a training course to obtain the desired skills. In the present study, expected learning outcomes have been used to define the objectives for an educational programme . The list of outcomes was supposed to serve as a framework for the organisation of learning resources and was to be used as an overview of the curriculum.
Classification of the Delphi participants
Category of expert
Primary care physician
Primary care nurse
Secondary care physician
The first round of the investigation
Fifteen experts participated in listing the competencies: five general practitioners with special interest in allergy, one nurse with special expertise in asthma/COPD, three allergologists, one clinical immunologist, two dermatologists, two otolaryngologists and one paediatrician. One reminder e-mail was sent, and the response rate was 43%. Most participants came up with more than 10 suggestions for competences, although some generated just a few. Totally, the panel group came up with 80 different statements that were then categorised into four domains: knowledge (35), diagnostics (17), treatment (12) and communication (15). A few competencies occurred in more than one domain.
The second round of the investigation
A questionnaire, comprising the data from the first round, was sent to 32 participants and was answered by twelve general practitioners (7 male, 5 female) and five nurses (all female) with special expertise in asthma/COPD. One reminder e-mail was sent and the response rate was 59%. The doctors worked approximately 1.3 hours a week (range 0.5-2 hours) with allergy patients and their mean professional experience was 17 years (range 6-28 y). The nurses worked approximately 7 hours a week (range 5-12 hours) with allergy patients and their mean professional experience was 15 years (range 7-20 y).
Summary and priority of the items concerning knowledge or training in the second round that did not qualify for the third round
Statements with scores 2.3-2.5
Principles of elimination diets
Understanding of the difficulties in interpreting IgE and prick test reactions in children
Investigation of latex allergy
Occupational contact allergy
Statements with scores 2.6-2.8
The significance of specific IgE for the clinical symptoms of allergy
Occupational asthma and rhinitis
Occupational risks facing atopics
Different types of endogenous eczema
Mechanisms of pruritus
Indications for ASIT
Mechanisms of anosmia
Statements with scores 2.9-3.1
Understanding terms like sensitisation, atopy, type I and type IV allergy
Indication for and interpretation of specific IgE
Common food allergens in children and adults, hidden allergens
Indications for adrenaline autoinjector in children
Investigation of urticaria and pruritus
Trigger factors of chronic urticaria and eczema in children and adults
Signs of contact eczema and indications for patch test
Nurse with academic education in asthma at the unit
The consensus for the core knowledge and skills for primary care of allergy patients
Manifestations of allergy to pollen, mites and pets
Cross-reactions to birch and mugwort, oral allergic syndrome
Trigger factors of acute urticaria/angioedema
Definition of anaphylaxis
Anaphylaxis from food, bee/wasp and drugs
Indications for prescription of adrenaline autoinjector
Intolerance vs allergy
What is included in different panels of allergens
Basic mechanisms of infectious asthma and COPD
Basic mechanisms of allergic and non-allergic rhinitis and organic disorders in the nose and sinus
Acute and chronic infectious disorders in the nose and sinus
Mechanisms of urticaria
Drug reactions: immediate and delayed
Basic mechanisms of common drugs for inflammatory disorders in airways and in skin
Different pharmacological treatment options (including the ones prescribed by specialists)
When to consider referral to a specialist
Not to advise avoidance of food due to occurrence of specific IgE in children without referral to a paediatric department
History, including seasonal allergies, cross-allergies; best with a questionnaire
Examination of eyes, nose and skin
Basic investigation of obstructive pulmonary disease
Basic investigation of rhinitis
Basic investigation of type 1 and type 2 allergy
Indications of specific IgE
Reading of spirometry and PEF curve
Recognition of signs of contact allergy and referral to a dermatologist
Treatment of allergic rhinoconjunctivitis (antihistamine, nasal corticosteroid and eye drops)
Treatment of non-allergic disorders such as idiopathic or vasomotor rhinitis
Treatment and prevention of allergic acute asthma
Treatment of allergic acute asthma in children
Dealing with an acute severe allergic reaction
Treatment of anaphylaxis
Treatment of atopic eczema; moisturisers, topical steroids with adequate potency and avoidance of systemic steroids
Treatment of urticaria with non-sedating antihistamines
Treatment of itch
Offering sufficient time to examine history
Showing interest, commitment and empathy
Writing careful referral for specific IgE
Explaining to the patient in a simple way what allergy is and its consequences
Giving basic advice about treatment of eczema and rhino-conjunctivitis
Instructing the patient how to use adrenaline autoinjector
Attending training courses as a team (doctor and nurse) to ensure patient receives consistent information
Cooperating with colleagues and other staff categories
Establishing regular cooperation with a specialist at the hospital
The third round of the investigation
A questionnaire, generated by the data from the second round, was sent to the 32 original participants from primary care and to a further seven general practitioners with special interest in allergy. This questionnaire was answered by 14 doctors (8 males, 6 females) and five nurses (one male, four female). No reminder letter was sent and the response rate was 48%.
The doctors worked approximately 2.4 hours a week (range 1-6 hours) with allergy patients and their mean professional experience was 15 years (range 5-23 y). The nurses worked approximately 6.2 hours a week (range 2-12 hours) with allergy patients and their mean professional experience was 16 years (range 8-24 y). Only three experts participated in both questionnaires.
In this third round, only one statement (trigger factors of angioedema) was regarded as unnecessary by 25% of the respondents. All other competencies reached consensus. These competencies within the four domains are shown in Table 3.
Specification of learning outcomes
Desired learning outcomes for in-service medical training in allergy for primary care settings
After the course the participants will be able to
Explain the mechanisms and manifestations of atopy, allergy, intolerance and autoimmunity and interpret the laboratory data
Examine the patient and investigate, treat and control asthma
Investigate and treat allergic and non-allergic reactions to food and drugs with special reference to principles for provocation
Diagnose and treat anaphylaxis
Investigate and treat allergic and non-allergic rhinitis and rhino-conjunctivitis
Investigate and treat different forms of urticaria and eczema with special reference to allergic and non-allergic mechanisms
Communicate with the patients about the risk factors, prevention strategies and treatment options with respect to the status
Identify criteria for referral to specialists, with special reference to paediatricians
Organise a team for continuing promotion of innovations in the care of allergy patients
The Delphi technique to reach consensus among experts, using iteration of statements through several rounds, promotes reflection to arrive at the best possible solution. In the present study, only a few respondents participated in more than one round.
No secondary care physicians were asked to participate in the second and third rounds of this study as they were assumed to have insufficient knowledge about the facilities of primary care units. According to a questionnaire in 2000, 42% of the primary care units in the county of Stockholm employed general practitioners with special interest in asthma, and 58% employed asthma and COPD nurses (Kihlström A, personal communication). Naturally, the slight variation in the populations of the panel members in all three rounds is a limitation of this study and disqualifies it from being a pure Delphi study. It also highlights the main difficulty of this technique, namely the response rate. In the present study, the response rates in the second and third rounds were 59% and 48% respectively. Although some respondents were very enthusiastic about the project, especially those who accepted the invitation to the first round, some admitted that they lacked time to participate in projects like this. Probably the response rate could be increased if reminder letters were sent to non-responders .
The anonymous answers in the second and third rounds may guarantee honest opinions, but this anonymous way of collecting answers made it impossible to know who had actually responded.
The strength is the large number of participants from across the country, representing different geographical regions. In spite of the relatively low response rate (48-59%) it is assumed that we have obtained a balanced view. The structure of primary care, the distance to the nearest hospital, regional guidelines and in-service professional training vary in different parts of Sweden. This consensus includes possible regional differences as the participants were recruited from most regions of Sweden.
Normally in a Delphi study, the rounds should continue until all participants agree [9, 12]. In the third round some competencies did not achieve full agreement. However, according to the Oxford Dictionary 1984, consensus is defined as "an agreement in opinion; a majority view" and 75% can thus be accepted as majority.
According to this study, most patients with moderate symptoms of asthma, food allergy, rhinitis, urticaria and atopic eczema can be treated in primary care settings. A referral to a paediatrician was recommended for children with food allergy and occurrence of specific IgE.
The general practitioner with special interest in asthma and allergy is responsible for diagnosis, treatment and follow up. A very important task is maintaining continuity and education of the patients on avoidance of allergens. The doctor and the nurse normally share this task and it was suggested that both should participate in the same in-service professional training in order to ensure consistency of information given to patients. One of the requirements suggested in the first round that did not make it to the third was academic education of nurses. In this study, all participating nurses had at least ten weeks of university education in the field of asthma and COPD. It may be expected that such education may result in better information to patients. Successful training of patients gives better understanding, compliance and safety, and results in fewer visits and admission to hospital . Local knowledge of the environment at primary care units may also contribute to identifying important risk factors. Allergy-prevention programmes have been shown to reduce the prevalence of atopic symptoms in infancy .
Asthma and allergy nurses are normally responsible for spirometry and allergy testing. Prick tests are performed at some primary care units, and this is especially important where the secondary care institution is far away. A common view is, however, that frequent prick testing is required to maintain the high standard of the procedure, which is why many primary care providers do not perform it.
Spirometry is often performed in primary care units . A "spirometry licensure", central education of key nurses at the primary care units, is now under discussion in Sweden in order to guarantee standard quality throughout the country. A primary care unit that treats children should have the competency to perform spirometry and interpret its results in this group according to the present survey.
In the future, increasing demands for quality assurance can require a licensure for primary care providers to treat allergic diseases. In the present study, expected learning outcomes have been used to define the objectives for an educational programme. Examination of primary care providers can also be used as a quality assurance. It seems that attendees of such a programme should have no difficulties in following guidelines on the management of asthma and allergic rhinitis [2, 3]. The suggested competences and recommended learning objectives may set stage for a better implementation of guidelines; present and future, and for recognition of gaps in allergy management .
According to the present study, the training programme should be organised as a trans-professional course for physicians and nurses and include several practical elements. The importance of teamwork stressed by the panel suggests such a collaborative approach. Inter-professional education, defined as "occasions when members (or students) of two or more professions learn with, from and about one another to improve collaboration and the quality of care," has attracted increasing interest . Such a coordinated educational programme for primary care providers in the field of allergy may also involve allergologists, clinical immunologists, dermatologists, otolaryngologists and paediatricians. It may constitute a good platform for better communication within the team of care providers, promoting better care of the patients.
The most significant findings of the present study were importance of communication with the patients and special caution regarding children with allergy. Consequently, referral to a paediatrician was recommended for children with food allergy and occurrence of specific IgE. In addition to medical guidelines, training programmes should deal with communication skills. A trans-professional training programme was suggested in order to give the whole team the same recommendations, which would promote consistent information to the patients. It is possible that that this last reflection would have been captured by other means than the Delphi method and that the participation of nurses has contributed to give it the importance it deserves. Core competencies for good practice amongst primary care providers may constitute a reference for primary care of allergy patients and can be used for accreditation of primary care units.
The panel members are gratefully acknowledged. Thanks to Tommy Höögh and his colleagues for recruiting the experts from primary care, and to Prof. Gudrun Edgren for suggesting the design of this study and for helpful comments. The study was supported by The Swedish Asthma and Allergy Foundation.
- Raddish M, Horn SD, Sharkey PD: Continuity of care: is it cost effective?. Am J Manag Care. 1999, 5: 727-734.Google Scholar
- Levy ML, Thomas M, Small I, Pearce L, Pinnock H, Stephenson P: Summary of the 2008 BTS/SIGN British Guideline on the management of asthma. Prim Care Respir J. 2009, 18 (Suppl 1): S1-16.View ArticleGoogle Scholar
- Costa DJ, Bousquet PJ, Ryan D, Price D, Demoly P, Brozek J, Schünemann HJ, Bousquet J: Guidelines for allergic rhinitis need to be used in primary care. Prim Care Respir J. 2009, 18: 250-257. 10.4104/pcrj.2009.00028.View ArticleGoogle Scholar
- Zuberbier T, Bindslev-Jensen C, Canonica W, Grattan CE, Greaves MW, Henz BM, et al: EAACI/GA2LEN/EDF. EAACI/GA2LEN/EDF guideline: management of urticaria. Allergy. 2006, 61: 321-331. 10.1111/j.1398-9995.2005.00962.x.View ArticleGoogle Scholar
- Syme-Grant J, Stewart C, Ker J: How we developed a core curriculum in clinical skills. Med Teach. 2005, 27: 103-106. 10.1080/01421590500046403.View ArticleGoogle Scholar
- Bion JF, Barrett H: Development of core competencies for an international training programme in intensive care medicine. CoBaTrICE Collaboration. Intensive Care Med. 2006, 32: 1371-1383. 10.1007/s00134-006-0102-0.View ArticleGoogle Scholar
- Mucklow JC: Continuing Medical Education in Clinical Pharmacology and Therapeutics: report of a questionnaire survey. Br J Clin Pharmacol. 2001, 52: 9-16. 10.1046/j.0306-5251.2001.01412.x.View ArticleGoogle Scholar
- Kilroy DA, Mooney JS: Determination of required pharmacological knowledge for clinical practice in emergency medicine using a modified Delphi technique. Emerg Med J. 2007, 24: 645-647. 10.1136/emj.2007.050633.View ArticleGoogle Scholar
- Keeney S, Hasson F, McKenna HP: A critical review of the Delphi technique as a research methodology for nursing. Int J Nurs Stud. 2005, 38: 195-200. 10.1016/S0020-7489(00)00044-4.View ArticleGoogle Scholar
- Valani RA, Yanchar N, Grant V, Hancock BJ: The development of a national pediatric trauma curriculum. Med Teach. 2010, 32: e115-119. 10.3109/01421590903398240.View ArticleGoogle Scholar
- Harden RM, Crosby JR, Davis MH, Fredman M: AMEE guide No. 14: Outcome-based education: Part 5 - From competency to meta-competency: a model for the specification of learning outcomes. Med Teacher. 1999, 21: 546-552. 10.1080/01421599978951.View ArticleGoogle Scholar
- Keeney S, Hasson F, McKenna H: Consulting the oracle: ten lessons from using the Delphi technique in nursing research. J Adv Nurs. 2006, 53: 205-212. 10.1111/j.1365-2648.2006.03716.x.View ArticleGoogle Scholar
- Halken S, Høst A, Hansen LG, Osterballe O: Effect of an allergy prevention programme on incidence of atopic symptoms in infancy. A prospective study of 159 "high-risk" infants. Allergy. 1992, 47: 545-553. 10.1111/j.1398-9995.1992.tb00680.x.View ArticleGoogle Scholar
- Derom E, van Weel C, Liistro G, Buffels J, Schermer T, Lammers E, et al: Primary care spirometry. Eur Respir J. 2008, 31: 197-203. 10.1183/09031936.00066607.View ArticleGoogle Scholar
- Levy ML: Allergic rhinitis and rhinosinusitis in primary care: record-keeping, guidelines and implementation. Prim Care Respir J. 2011, pii: RHI-051-11.Google Scholar
- Hammick M, Freeth D, Koppel I, Reeves S, Barr H: A best evidence systematic review of interprofessional education: BEME Guide no. 9. Med Teach. 2007, 29: 735-751. 10.1080/01421590701682576.View ArticleGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6920/11/12/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.