Barriers and attitudes influencing non-engagement in a peer feedback model to inform evidence for GP appraisal
© Curnock et al; licensee BioMed Central Ltd. 2012
Received: 7 October 2011
Accepted: 23 March 2012
Published: 23 March 2012
The UK general practitioner (GP) appraisal system is deemed to be an inadequate source of performance evidence to inform a future medical revalidation process. A long-running voluntary model of external peer review in the west of Scotland provides feedback by trained peers on the standard of GP colleagues' core appraisal activities and may 'add value' in strengthening the robustness of the current system in support of revalidation. A significant minority of GPs has participated in the peer feedback model, but a clear majority has yet to engage with it. We aimed to explore the views of non-participants to identify barriers to engagement and attitudes to external peer review as a means to inform the current appraisal system.
We conducted semi-structured interviews with a sample of west of Scotland GPs who had yet to participate in the peer review model. A thematic analysis of the interview transcriptions was conducted using a constant comparative approach.
13 GPs were interviewed of whom nine were males. Four core themes were identified in relation to the perceived and experienced 'value' placed on the topics discussed and their relevance to routine clinical practice and professional appraisal: 1. Value of the appraisal improvement activity. 2. Value of external peer review. 3. Value of the external peer review model and host organisation and 4. Attitudes to external peer review.
GPs in this study questioned the 'value' of participation in the external peer review model and the national appraisal system over the standard of internal feedback received from immediate work colleagues. There was a limited understanding of the concept, context and purpose of external peer review and some distrust of the host educational provider. Future engagement with the model by these GPs is likely to be influenced by policy to improve the standard of appraisal and contractual related activities, rather than a self-directed recognition of learning needs.
Since 2003, general practitioners (GPs) in the United Kingdom (UK) have been contractually obliged to engage in a peer appraisal of their professional practice . This involves an externally nominated peer colleague (appraiser) reviewing specific aspects of an individual GP's (appraisee) professional practice on an annual basis. Feedback to aid professional development is provided in a 'non-judgemental' and formative manner. The appraisal interview remains a confidential interaction between the appraiser and appraisee, unless issues arise during discussions that give cause for serious concerns about the well-being of the doctor or patients.
There is an expectation that the combined evidence from five consecutive annual appraisals would substantially inform a proposed UK system of revalidation for all medical practitioners . However, a recent White Paper  has declared that this is no longer a viable option because the existing appraisal process is thought to lack the robustness, objectivity and clarity which are necessary to support a high stakes revalidation system. Additionally, the evidence for the effectiveness of this form of peer appraisal in improving individual learning and the quality of patient care remains inconclusive .
It is now clear that appraisal will have to move from mere engagement to a demonstration of both learning for the doctor and impact on patient care. By necessity, therefore, the process must become more transparent and objective . Peer review and feedback either by the appraiser or through other external 'quality control' mechanisms is likely to become more prominent in deciding on whether the evidence supplied for appraisal is of a sufficient standard to inform revalidation.
One suggested method of addressing these criticisms is through the external verification of specific aspects of a GP's work. In the west of Scotland medical deanery, a peer feedback model [6, 7] has been established for over a decade and has been proposed as one method to 'add value' to the current Scottish GP appraisal system. The underlying principles of the model are based on an adaptation of cognitive continuum theory , which has been described in related published work 6. GPs in the deanery are currently able to voluntarily submit evidence of three core appraisal activities (clinical audit, significant event analysis (SEA) and consultation technique via videotaped consultations) for external review by trained peer colleagues. A small financial cost is levied for this service. This type of approach may be of a much wider interest and potential value beyond the regional deanery. Details of the educational purpose, method and theoretical origins underpinning this specific peer feedback model have been published previously [6, 7, 9].
It is proposed that this peer feedback model may help to resolve the 'appraisal dilemma' by providing some objective evidence of professional development and performance activities which are necessary to strengthen the existing model in support of revalidation [6, 7]. Furthermore, it would present an opportunity to review whether the activities undertaken by the GP are of a desired educational standard and, where necessary, allow for informed feedback to improve the quality of the submitted work.
The empirical evidence underpinning the acceptability, feasibility and educational impact of the peer feedback model is moderate and growing steadily [9–17]. However, although a significant proportion of GPs has voluntarily participated in some aspect of the model, a clear majority in the deanery has yet to do so. It is unclear why many choose to forgo this potentially valuable learning opportunity, while others are prepared to voluntarily engage. In order to further strengthen engagement with the peer feedback model, we aimed to explore the views of GPs who had not yet participated. We were specifically interested to identify potential barriers to engagement in the per feedback model (beyond the financial cost) and ascertain attitudes to the concept of external peer review in the current context of appraisal and planned revalidation.
The research was qualitative in design. Semi-structured, in-depth interviews with individuals were used to explore understanding, knowledge, attitudes and practicalities of engaging in and receiving external peer feedback. Initial exploratory interviews with six GPs were conducted by LP in 2009. The themes emerging from these interviews formed the basis of the topic guide for the interviews held in 2010. These interview data were not included in this study as too much time had elapsed and the interviewer had taken up another research position. An iterative study design  was employed in order to allow emerging themes to be explored with greater depth in subsequent interviews. Adopting this reflexive approach reduces the risk of making unwarranted assumptions about perspectives on peer feedback in the sample.
Setting, sample and sampling procedure
Study inclusion criteria, variables and rationale
Rationale for inclusion
Female or male
The GP workplace is often and conveniently sub-divided into common groupings because these may contain individuals with differing perspectives. The study attempted to reflect this in part by ensuring that the viewpoints of individual GPs from each of the 3 different groups were adequately represented.
Postgraduate training practice status
Training or non-training status
Type of GP position held
Other (e.g. Salaried GP)$
Interviews were conducted by EC at a venue chosen by each participant. A semi-structured prompt guide was used to steer discussion on the following areas: understanding of peer review and feedback; exposure to peer feedback activities; factors affecting participation in peer feedback (perceptions of barriers and facilitators). Interviews lasted 45 minutes on average, ranging from 30 to 60 minutes. The interviews were audio-recorded with permission, transcribed and anonymised. Formation of theory based on the emerging themes was explored in more depth with subsequent participants until saturation was achieved. The interviewer reflected on her perspectives of each interview and made contemporaneous notes in a comments sheet. This was shared and discussed with research colleagues in order to deepen the understanding of the topic and stimulate further thinking.
Each interview recording was listened to thoroughly to check for inaccuracies in transcription. Thematic analysis of the interview transcriptions was conducted by a constant comparative approach . Sections of meaningful text were identified within each interview independently by two researchers. The sections of text were coded; codes were then compared with each other looking for similarities, differences and general patterns to form categories, which were then compared across interview transcripts to identify themes. The categorisation changed several times during this process. Particular attention was paid to negative cases (cases inconsistent with the emerging analysis), which were used to clarify themes during analysis discussion sessions.
The study proposal was pre-screened by NHS Lothian MREC 'A' committee for research ethical approval but was judged to be service evaluation.
Characteristics of Study Participants: Personal, Professional & Educational (n = 13)
1. Personal characteristics
2. Professional characteristics
2.1 GP position
2.2 Geographical location
2.3 Years qualified as doctor
Range = 5-35 years
Mean = 21 years
2.4 Membership of 'The Partnership' (regional continuing professional development scheme)
2.5 Practice list size (number of patients)
2000 to 5999
6000 to 10000
3. Educational characteristics
3.1 Involvement in Training
Value of the improvement activity (i.e. audit, SEA, consultation technique)
Value of external peer review
Value of the peer feedback model
Attitudes to external peer review (including appraisal)
Summary of key barriers and attitudes by theme
• Value of the improvement activity (i.e. audit, SEA, consultation technique)
• Relevance of activity to professional practice and every day work
• Activities are generally helpful, but not to all participants specifically
• Some believe their own improvement methods are sufficient
• Value of external peer review
• Variation in understanding and purpose of peer review
• More challenging than internal review by close colleagues
• Viewed as more 'formal' and 'selection and control'
• Standard and validity of work enhanced
• Informed internal colleagues' views just as valid
• Value of the peer feedback model
• Constrained by defined, structured formats
• Perceived as overly formal and additional work
• Other peer review options available
• Formalisation seen positively with regard to link with appraisal and regulation
• Attitudes to external peer review (including appraisal)
• Distrust and suspicion of host organisation
• Face-to-face peer feedback more valuable
• Lack of awareness of model
• Practical barriers to engagement
Value of the improvement activity
"Audit I am sure does improve systems, does raise the standards of personal practice but maybe not as, not as imminently as looking at a significant event or looking at yourself doing a consultation. Those are far more in your face, you know far more personal; they are far more likely to bring around a change in practice or a reflection about what you are doing" (GP2)
"They are some easily measurable things... they are measurable but I don't know that that necessarily reflects good practice" (GP1)
"It is highly unlikely at this stage that I am massively going to change my approach or change my style of operating which has clearly worked reasonably okay up to now" (GP4)
Value of external peer review
It was recognised that GPs can be exposed to many different models or styles of external peer review often without a full realisation that they are doing so. For some this was revealed in a limited and possibly conflicting understanding of the context, meaning and purpose underpinning peer review as an educational construct. For example, several GPs understood peer review to relate primarily to 'multi-source feedback' for which they displayed strongly negative feelings. Although this was not wholly accurate it nevertheless led to a biased perception of what 'peer review' entailed for them.
There was recognition amongst many participants that the possibility of external review of their professional activities by peers would be more 'challenging' than 'internal' review from GP partners or associates. For many this was thought to be clearly beneficial as it would enhance the validity of their work because it was perceived to be more objective and formalised - particularly if the peer reviewer was not known to the GP. In addition, it may offer a demonstration to any interested external authorities, or even their own patients, that their professional performance was of a sufficient standard.
"...the person who would be more detached, could look at the situation more objectively that is probably a good point also, again they wouldn't be biased by knowing you, probably more objective and that would probably be the best advantage I think really" (GP7)
"One of our partners is a CHCP [Community Health Care Partnership] chairman so he is usually ahead of changes in the game, we have got two appraisers... our Practice Manager is a QOF [Quality & Outcomes Framework] visitor... so we have lots of people who are on the ball learning things you know from the point of view of our practice" (GP4).
Value of the peer feedback model
"...the disadvantage of external feedback would have, it wouldn't it would only have what it saw on paper whereas internally the people can have a feel for what you are doing and how you are doing it, so its finer details but it is also sort of the 'wishy-washy' more difficult to define aspect of what you have done and how you have done it, only internal people would be able to pick up on." (GP12)
"At our meetings in the surgery alone there is probably about thirty or forty folk at it... so it's a pretty good appraisal in itself... within the practice I think there is enough people that we get pretty good feedback" (GP10)
"I cannot be bothered with all that extra bits because I don't need it... and well God ok, that I haven't looked at everything but I just haven't sat down and written it all bit by bit... but people will argue, 'well if you don't do it properly it is just sloppy, la la la la', fine, I don't need the formalization anymore thank you very much" (GP9)
"I daresay one of the benefits value wise will be strengthening my appraisal and revalidation folder in terms of ticking all the right boxes there" (GP6)
Attitudes to external peer review (including appraisal)
"I ended up having to do a second audit [for summative assessment during GP training] having failed one on almost a technicality. I think that may have put me off the process...I didn't really go through a positive feedback process" (GP4)
"Big Brother... I don't see it as helpful at all, I don't see anything that suggests from anything that I have been involved in to suggest that they are actually trying to help..." (GP6)
"...it certainly would be useful to know that that somebody was working in General Practice and not maybe somebody who was you know in a ivory tower as an academic GP you know, and wasn't you know and didn't have their feet on the ground sort of thing" (GP10)
"...but I think verbal feedback is useful, without verbal feedback (the written report) I think it would be worse because I think with verbal there is interaction, any misunderstandings could be rectified then" (GP9)
"...the difficulty with them [video-taped consultations] is I suppose the timing and the amount of work required..." (GP3)
"it is not my practice, I am there as an employee, hired locum for that session, and so obviously before I think before I would be sending it off I would need to clear that with the Partners and other people involved before I sent it out to an external source" (GP1)
"...so far I have had three appraisers, and if that is what an external person offers thank you - good night...the last guy was slightly better, the first two were a waste of space... so that has not encouraged outside support" (GP7)
This small study represents the first steps in trying to determine why GPs may forgo potentially important learning opportunities that could strengthen their portfolio of evidence for professional appraisal. Preparedness by GPs in this study to participate in the external peer feedback model to enhance appraisal activities involves three interlinked themes: the value to the practitioner of the improvement activity itself; the perceived benefits of external review and feedback; and the professional esteem in which the provider of the peer review is held. The themes represent a hierarchy whereby ultimate participation depends on acceptance of the value of the first or subsequent theme. These 'conditions of value' are modified by the participants' attitudes to the national appraisal system, the educational model of external peer review under study and the status of the host organisation.
Findings in context
The finding that GPs must first of all value the improvement activity offered as part of the peer review process is consistent with aspects of adult educational theory which suggests that learners often undertake activities that they conceive as being of personal interest and highly relevant to their daily professional practice .
The evidence base for the perceived value of the three core appraisal improvement activities outlined in terms of impact on professional practice and patient care remains moderate [21–23]. However, two of three activities (SEA and clinical audit) are proposed as key elements of enhanced GP appraisal and revalidation which implies that regulatory authorities place a high value on their role as important indicators of professionalism and performance [24, 25]. Some study participants are clearly sceptical about the effectiveness of such activities and the 'opportunity-cost' of participation, which is of potential concern. However research on the peer review system has highlighted variation in knowledge, attitudes and abilities, while also demonstrating the often critical importance of these activities to making healthcare safer, improving professional performance and enhancing the quality of services [10–14].
Some participants also appear confused about what constitutes 'peer review' which may be understandable given the variety of related initiatives described in the literature, many of which would struggle to truly reflect any mainstream definitions of 'peer review' . For example, some GPs associated peer review only with 'multi-source feedback', which involves a range of colleagues not all of who are 'peers'. Paradoxically these GPs are highly likely to be exposed to a multitude of external peer review activities such as prescribing reviews, training practice accreditation visits, contractual verification visits and annual GP appraisal - but did not associate these professional obligations with the concept of 'peer review'. The importance of understanding the terminology goes beyond 'semantics' given the professional role of revalidation and appraisal, and also the advent of the peer review of prescribing patterns and specialist referrals recently introduced into general medical service contracts .
External peer review was seen by some as having the potential to enhance the validity of their professional practice, which is consistent with findings from those GPs who have actually taken part in the educational models offered to participants, including GP appraisers [6, 9, 10]. Conversely, others did not see the value or thought it limited, which reflects previous findings for external peer review through the Scottish GP appraisal system .
Some participants felt external peer review has little to offer over internal feedback from immediate work colleagues in strengthening appraisal evidence. This may represent a 'cognitive dissonance' , whereby conflicting ideas about the purpose and value of peer review are held simultaneously. Equally, for some, where internal review mechanisms are thought to be robust (either because of work colleagues' special interests, outside appointments or the variety of feedback options offered) external review may indeed be of limited benefit, although this will remain speculative without evidence to the contrary. We should acknowledge that these internal colleagues (as well as GP appraisers), although potentially informed, are not 'trained' to review and feedback on the standard of clinical audits, significant event analyses or consultation performance.
We know that many practitioners submit their audits and SEA reports for external peer review only for confirmation that this submission evidence for appraisal will be judged by trained colleagues to be of a satisfactory standard or otherwise . It is possible that if one member of the GP team has demonstrated a perceived competence in a particular area then the value of external review for others may be diminished if both a 'benchmark' and local guidance are already available within the practice.
It is unsurprising that the host organisation which manages the peer feedback model is in itself a barrier to engagement. Research suggests that professionals, where possible, may seek to avoid submissions to, or contacts with, administrative bodies which have a governance or regulatory remit over them [9, 10]. Previous experience of dealing with the organisation may have led to reluctance to engage voluntarily with it, particularly if that experience was negative (e.g. refusal of training practice accreditation or a poor GP appraisal encounter). This distrust by some about potentially exposing elements of their professionalism via the peer feedback model is interesting as previous research about hosting a hypothetical reporting system for patient safety incidents found that this organisation was the option overwhelmingly preferred by GPs compared with other national healthcare bodies listed .
For some participants, the role of GP appraisal is seen as enforcing unnecessary bureaucracy into an already busy job with little or no educational gain . To try and enhance appraisal with more 'peer judgments' is, for these GPs, even less appealing. Additionally there may be an underlying resentment to participate in and provide evidence for appraisal, which may be seen by them as a slight on the professionalism of GPs individually and as a group [9, 10]. This contrasts with previous research which suggests that GPs are acutely aware of the need for appraisal to evolve in support of revalidation in order to ensure and maintain the confidence of patients and doctors .
A recent literature review suggested that peer review  is a common element of performance assessment and is sometimes "...the only mechanism to judge the professional practice of others working in the same field...because the peer regularly performs similar work and possesses the relevant expertise to evaluate it". A fundamental irony is that the GP reviewers who are part of the peer feedback model described are the ones who have undergone the training to gain the 'expertise' necessary to 'evaluate' and 'judge' the elements of 'professional practice' that are under scrutiny from an appraisal (and regulatory) perspective - rather than the GP appraisers themselves. Study participants were largely aware of this but were still reluctant to engage with the model because of a combination of professional matters, pragmatic issues and attitudinal beliefs that all questioned the 'value' in exposing aspects of their professionalism on an independent, external and verifiable basis. The corollary is that it is unknowable if these aspects of professionalism are indeed exposed to some form of internal review by work colleagues or are subject to self-assessment, which recent evidence suggests is of limited value .
Strengths and limitations of the study
Study strengths included interviews being undertaken with GPs at a range of career stages, working in different practice contexts (training & non-training), holding different status positions (principals, sessional and salaried doctors) with a mix of experience and roles outside of general practice, all of which is reflective of working arrangements in this setting. The interviewer (EC) was a doctor at an early stage in her career. This was perceived to have been an advantage particularly with the older GPs who may not view her to be part of the educational establishment. The interviewer strived to maintain an open attitude to the data; collaboration with a second researcher at the data analysis stage helped in this respect.
Limitations included the small number of study participants and their voluntary status which may have skewed the group towards those that already had a prior interest in the subject. Although we took great care to stratify potential GP recruits depending on the type of position they held, ultimately of those who were able to attend the interviews the great majority were GP principals. The interviews allowed in-depth discussion with individuals; although saturation was reached it is possible a bigger study would provide further insights than those gained here. The sample size also limited the ability to judge where most GPs sit along the process i.e. which of the judgements on value are most critical to most GPs. A reticence to share openly was perceived amongst younger GPs, who may have more closely identified the interviewer with the organisation which hosts the peer feedback model and is responsible for delivering most aspects of education and training in the region. The use of a semi-structured interview guide may have resulted in topics being missed, however an iterative approach to the content of the interview guide throughout the period of interviewing and analysis helped reduce this limitation.
The study identified a range of important barriers and attitudes influencing non-engagement in the peer feedback model. How engagement with the model is increased from this 'non-engager' group is highly likely to be influenced by the decisions of local and national policy-makers, rather than a self-directed recognition of learning need by these GPs or a targeted 'promotional-push' by the host organisation. Future engagement levels will be dependent on how seriously decision-makers wish to 'add value' to the appraisal process or, for example, in quality assuring the standard of significant event analyses undertaken as part of the general medical services contract with health authorities (which contains a financial inducement for this element). There are, however, potential feasibility challenges (e.g. peer reviewer training and funding support) to be overcome if the peer feedback model is to be implemented on a wider scale. At present there appears to be a lack of potential alternatives other than this approach or the status quo.
We offer sincere thanks to the west of Scotland GPs who volunteered to be interviewed for this study. We also thank NHS Education for Scotland for providing funding for the study.
- Scottish Executive, NHS Education for Scotland, RCGP (Scotland) &BMA (Scotland): GP appraisal scheme: a brief guide. 2003, Edinburgh: Scottish ExecutiveGoogle Scholar
- General Medical Council: A licence to practise and revalidation. 2003, London: GMCGoogle Scholar
- Secretary of State for Health: Trust, assurance and safety--the regulation of health professionals in the 21st century. White Paper presented to Parliament by the Secretary of State for Health by Command of Her Majesty. 2007, London: The Stationery OfficeGoogle Scholar
- Coltart I, Cameron N, McKinstry B, Blaney D: What do doctors really think about the relevance and impact of GP appraisal 3 years on? A survey of Scottish GPs. Br J Gen Pract. 2008, 58 (547): 82-87. 10.3399/bjgp08X264036.View ArticleGoogle Scholar
- Department of Health: Good doctors, safer patients: proposals to strengthen the system to assure and improve the performance of doctors and to protect the safety of patients. A report by the Chief Medical Officer. 2006, London: Department of HealthGoogle Scholar
- Bowie P, Cameron N, Staples I, McMillan R, McKay J, Lough M: Verifying appraisal evidence using feedback from trained peers: views and experiences of Scottish GP appraisers. Br J Gen Pract. 2009, 59: 484-489. 10.3399/bjgp09X453521.View ArticleGoogle Scholar
- Murie J, McCrae J, Bowie P: The peer review pilot project: a potential system to support GP appraisal in NHS Scotland. Educ Prim Care. 2009, 20: 34-40.View ArticleGoogle Scholar
- Hammond KR: Towards increasing competence of thought in public policy formation. Judgement and decision in public policy formation. Edited by: Hammond KR. 1978, Boulder, CO: Westview Press, 11-32.Google Scholar
- Bowie P, McKay J, Dalgetty E, Lough M: A qualitative study of why general practitioners may participate in significant event analysis and educational peer review. Qual Saf Health Care. 2005, 14: 185-189. 10.1136/qshc.2004.010983.View ArticleGoogle Scholar
- McKay J, Pope L, Bowie P, Lough M: External feedback in general practice: A focus group study of trained peer reviewers of significant event analyses. J Eval Clin Pract. 2009, 15: 142-147. 10.1111/j.1365-2753.2008.00969.x.View ArticleGoogle Scholar
- McKay J, Shepherd A, Bowie P, Lough M: Acceptability and educational impact of a peer feedback model for significant event analysis. Med Educ. 2008, 42: 1210-1217. 10.1111/j.1365-2923.2008.03235.x.View ArticleGoogle Scholar
- Cameron N, McMillan R: Enhancing communication skills by peer review of consultation videos. Educ Prim Care. 2006, 17 (1): 40-48.View ArticleGoogle Scholar
- McMillan R, Cameron N: Factors influencing the submission of videotaped consultations by general practitioners for peer review and educational feedback. Qual Prim Care. 2006, 14 (2): 85-89.Google Scholar
- Bowie P, Cooke S, Lo P, McKay J, Lough M: The assessment of criterion audit cycles by external peer review - when is an audit not an audit?. J Eval Clin Pract. 2007, 13 (3): 352-357. 10.1111/j.1365-2753.2006.00704.x.View ArticleGoogle Scholar
- McKay J, Murphy D, Bowie P, Schmidt M, Lough M, Eva K: Development and testing of an assessment instrument for the formative peer review of significant event analyses. Qual Saf Health Care. 2007, 16: 150-153. 10.1136/qshc.2006.020750.View ArticleGoogle Scholar
- McKay J, Bowie P, Lough M: Variations in the ability of general medical practitioners in applying two methods of clinical audit: a five-year study of assessment by peer review. J Eval Clin Pract. 2006, 12 (6): 622-629. 10.1111/j.1365-2753.2005.00630.x.View ArticleGoogle Scholar
- Shepherd A, McKay J, Bowie P: Training the trainer in general practice: the perceived value of independent peer feedback for learning activities. Educ Prim Care. 2010, 21 (8): 368-375.View ArticleGoogle Scholar
- Ploeg J: Identifying the best research design to fit the question. Part 2: qualitative designs. Evid Based Nurs. 1999, 2: 36-37. 10.1136/ebn.2.2.36.View ArticleGoogle Scholar
- Patton MQ: Qualitative Evaluation and Research Methods. 1990, Thousand Oaks, CA: Sage PublicationsGoogle Scholar
- Speck M: Best practice in professional development for sustained educational change. ERS Spectrum. 1996, 33-41.Google Scholar
- Scott SI: What are the most effective strategies for improving quality and safety of health care?. Intern Med J. 2009, 39: 389-4000. 10.1111/j.1445-5994.2008.01798.x.View ArticleGoogle Scholar
- Davis D, O'Brien MA, Freemantle N, Wolf FM, Mazmanian P, Taylor-Vaisey A: Impact of formal continuing medical education: do conferences, workshops, rounds, and other traditional continuing education activities change physician behavior or health care outcomes?. J Am Med Assoc. 1999, 282: 867-874. 10.1001/jama.282.9.867.View ArticleGoogle Scholar
- Bowie P, Pope L, Lough M: A review of the current evidence base for significant event analysis. J Eval Clin Pract. 2008, 14 (4): 520-536. 10.1111/j.1365-2753.2007.00908.x.View ArticleGoogle Scholar
- NHS Modernisation Agency: Defining the evidence for revalidation--supporting the Royal College of General Practitioners. Collation of views from the NHS Clinical Governance Support Team Expert Group. NHS. 2004Google Scholar
- General Medical Council: Good Medical Practice. 2006, London: GMCGoogle Scholar
- Peer review of health care professionals: a systematic review of the literautre. Prepared for the Australian Commission on the Safety & Quality in Health Care (June 2009). [accessed 6th October 2011], [http://www.safetyandquality.gov.au/internet/safety/publishing.nsf/Content/com-pubs_cred-con/$File/25738-LitReview.pdf]
- Quality and Outcomes Framework guidance for GMS contract 2011/12 (April 2011). [accessed 6th October 2011], [http://www.nhsemployers.org/SiteCollectionDocuments/QOFguidanceGMScontract_2011_12_FL%2013042011.pdf]
- Festinger L: A Theory of Cognitive Dissonance. 1957, Stanford, CA: Stanford University PressGoogle Scholar
- McKay J, Bowie P, Murray L, Lough M: Levels of agreement on the grading, analysis and reporting of significant events by general practitioners: a cross sectional study. Qual Saf Health Care. 2008, 17: 339-345. 10.1136/qshc.2007.024323.View ArticleGoogle Scholar
- Finlay K, McLaren S: Does appraisal enhance learning, improve practice and encourage continuing professional development? A survey of general practitioners' experiences of appraisal. Qual Prim Care. 2009, 17 (6): 387-395.Google Scholar
- Coltart A, Bagnall G, Evans A, Allbutt Haig A, Iling J, McKinstry B: Best evidence in medical education (BEME). A systematic review of the literature on the effectiveness of self assessment in clinical education. [accessed 6th October 2011), [http://www2.warwick.ac.uk/fac/med/beme/reviews/published/]
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6920/12/15/prepub