- Research article
- Open Access
- Open Peer Review
Disciplinary boundaries and integrating care: using Q-methodology to understand trainee views on being a good doctor
BMC Medical Education volume 19, Article number: 59 (2019)
Rising numbers of patients with multiple-conditions and complex care needs mean that it is increasingly important for doctors from different specialty areas to work together, alongside other members of the multi-disciplinary team, to provide patient centred care. However, intra-professional boundaries and silos within the medical profession may challenge holistic approaches to patient care.
We used Q methodology to examine how postgraduate trainees (n = 38) on a range of different specialty programmes in England and Wales could be grouped based on their rankings of 40 statements about ‘being a good doctor’. Themes covered in the Q-set include: generalism (breadth) and specialism (depth), interdisciplinarity and multidisciplinary team working, patient-centredness, and managing complex care needs.
A by-person factor analysis enabled us to map distinct perspectives within our participant group (P-set). Despite high levels of overall commonality, three groups of trainees emerged, each with a clear perspective on being a good doctor. We describe the first group as ‘generalists’: team-players with a collegial and patient-centred approach to their role. The second group of ‘general specialists’ aspired to be specialists but with a generalist and patient-centred approach to care within their specialty area. Both these two groups can be contrasted to those in the third ‘specialist’ group, who had a more singular focus on how their specialty can help the patient.
Whilst distinct, the priorities and values of trainees in this study share some important aspects. The results of our Q-sort analysis suggest that it may be helpful to understand the relationship between generalism and specialism as less of a dichotomy and more of a continuum that transcends primary and secondary care settings. A nuanced understanding of trainee views on being a good doctor, across different specialties, may help us to bridge gaps and foster interdisciplinary working.
This paper investigates medical trainees’ views on what ‘being a good doctor’ means in the context of calls for a more generalist approach to caring for patients with complex health needs. Rising numbers of patients with multiple-conditions and complex care needs [1,2,3] challenge current structures of healthcare organisation when discipline-based specialisation no longer suits their care needs . In particular, ageing populations are driving this change and are shifting conventional demands on health services [4, 5]. Doctors have highlighted concerns about lack of continuity and uncertainty about who has overall responsibility for the care of patients with complex care needs . It has become increasingly important for doctors from different specialty areas to work together, alongside other members of the multi-disciplinary team, to provide patient-centred care [6,7,8,9,10,11]. The World Health Organisation called for an integrated approach to manage the complex needs of the ageing population  and different approaches to care are being tried . The United States (US) employs the term ‘hospitalist’ to describe a generalist physician responsible for patients throughout their hospital stay [4, 11]. Physicians working in Acute Medical Units (AMUs) in the United Kingdom (UK) provide rapid multidisciplinary medical assessment . However, an agreed interpretation of generalism in hospital settings has yet to be established . A 2011 report on Modern Medical Generalism, commissioned by the Royal College of General Practitioners and the Health Foundation (UK), warns against a simplistic definition of generalists as providing ‘first-contact’ care, adding that there is more to medical generalism than good practice: ‘although the generic attributes associated with good professional practice are an intrinsic part of generalism, the generalist has specific clinical qualities that go significantly beyond this’.  There has been a similar debate within nursing about the relative status of generalists and specialists, with NHS Scotland advocating that specialist nursing to be viewed as being located at ‘one pole of the “specialist generalist” continuum’, and indicating a linguistic shift away from associating ‘specialism’ with ‘seniority’ amongst medical staff . However, our previous research indicates that traditional disciplinary structures within medicine (with the conventional split of generalist practitioners in the primary care or community setting, and specialists based in hospitals) can undermine and complicate trainee generalists’ developing sense of professional identity . In this context, what it means to be a ‘good’ (or even ‘ideal’) doctor , in the context of an increasing emphasis on hospital-based generalists that threatens to disrupt traditional (and perhaps outdated) hierarchies of specialism, is a question of growing international concern.
In the UK, The Shape of Training Review  identified the need to train ‘specialist generalists’ who can offer a more holistic approach to patient care. Broad Based Training (BBT) introduced by Health Education England (HEE) and The Academy of Medical Royal Colleges (AoMRC), was specifically designed to address the generalist agenda . This two-year programme follows the two-year postgraduate foundation training, and provides six-month placements in four specialties (paediatrics, general practice, core medicine, and psychiatry), at the point where postgraduate trainees would normally be entering conventional specialty training. Upon completion, BBT trainees enter onto the second year of specialty training in their chosen specialty. BBT thus extends the overall length of training by one year. By exposing trainees to a breadth of different medical settings and encounters, and by incorporating training techniques specifically intended to foster cross-disciplinary working, BBT aims to develop practitioners adept at managing complex, patient-focussed care and specialty integration.
International literature focused on patient perspectives reveals the high importance patients attach to interpersonal qualities (such as communication skills and a caring attitude) over doctors’ knowledge and skills which attracts less emphasis [16,17,18,19]. Literature from the Australia  and the United States  focused on medical student opinions also reveals the importance of softer skills (such as empathy or compassion) but in addition gives emphasis to cognitive, clinical and performative skills . Such research amongst patients and students has revealed commonalities and difference of opinion. Research to date suggests that qualities desirable in a doctor include both cognitive and non-cognitive qualities such as integrity, empathy and good people skills. There are also indications that views vary between patients, students and doctors and, over time. Less is known about how views vary between specialty groups. We do not yet know if the professional identity associated with training in some specialties emphasises certain qualities over others or on what challenges generalism poses to existing models of professional identity. This worthy of further research. Clearly the need for a different kind of doctor has implications for training and for subsequent careers guidance and specialty choice. However, what also deserves attention is the challenge from intra-professional boundaries within the medical profession that a more holistic approach to patient care may face [22,23,24,25]. A better understanding of the views and perspectives of medical trainees from different specialty areas may help to identify how to bridge disciplinary gaps and foster interdisciplinary work [14, 26].
Using Q-methodology , we compare medical trainees’ views on what ‘being a good doctor’ means in the context of calls for a more generalist approach to meet increasingly complex patient care needs [5,6,7,8]. Specifically, we draw on data collected from postgraduate post-foundation trainees from a range of different medical training programmes in England and Wales, including both conventional specialty training programmes in a variety of medical disciplines, and a ‘broad-based’ programme aimed at fostering generalism and interdisciplinary working. This comparative approach enables us to identify similarities and differences in trainee dispositions according to both onward specialty choice and mode of training (conventional specialised or non-conventional generalised). Research ethical approval was obtained from Cardiff University (02/10/13). Participation was voluntary, informed consent was gained, and participants are anonymised. None of the authors have any competing interests.
The research presented here is part of a larger mixed-methods longitudinal study of the BBT programme that was introduced in England in 2013 by the AoMRC and funded by HEE.
The first cohort of BBT trainees (n = 42 at outset) were recruited across seven different regions (Local Education and Training Boards – LETBs) in England. Despite successfully recruiting two further cohorts and expanding the scope of the programme to most regions in England in 2015, the decision was made to cease further recruitment in 2016 , and the future of the programme remains unclear. Nevertheless, recent pilots in Wales and Northern Ireland and discussions in Scotland indicate that interest in the generalist agenda shows no sign of dissipating . Our research, commissioned by AoMRC and funded by HEE, studies BBT and explores whether it better prepares trainees for onward specialty training and the changing landscape of healthcare delivery. In addition to collecting questionnaire and focus group data at regular intervals , we have used Q-methodology to examine trainee perceptions of their future role and ‘being a good doctor’.
Q methodology allows for the systematic collection of individuals relative opinions towards a phenomena, and is becoming increasingly popular within a range of applied and health related disciplines. Participants are asked to rank a set of statements (or items) relative to one another into a grid according to a scale (e.g. in our study ‘most agree’ to ‘most disagree’), which usually takes the shape of a quasi-normal distribution. Collected together, these completed grids are subject to a dimension reduction technique, sometimes referred to as ‘inverted factor analysis’ . This analysis groups those with similar sorting patterns, indicating similar viewpoints, together. This approach is distinct from most other statistical techniques in which demographic factors, such as gender or age, are employed as controls or used as a basis to sort participants into groups. As Bang and Montgomery  (p.346) put it: ‘the aim of Q is to utilize subjectiver views, opinions, and perception to capture general responses to a phenomena’.
The Q-set is a set of statements that the participants sort in order to best represent their perspective. The set aims to capture many (if not all) possible responses to our question of interest: ‘what does it mean to be a good doctor?’. After creating a ‘long-list’, informed by both a review of the literature and focus group data from our wider project , members of the research team independently selected a short-list of representative statements, and met to agree a 40 item Q-set. This set was piloted with a separate group of medical trainees (n = 11), and two statements were subsequently replaced to make the final Q-set. Themes covered in the Q-set include: generalism (breadth) and specialism (depth), interdisciplinarity and multidisciplinary, team working, patient-centredness, and managing complex care needs (for a full list of statements see the first column of Table 4).
Study participants and data collection procedures
Data were collected from BBT trainees at a national meeting in London (May 2015) and from additional groups of BBT and ‘conventional’ trainees at various regional learning events (April–August 2015). We report Q-sort data from postgraduate trainees (n = 38) from a range of different specialty programmes on either the BBT (n = 16) or conventional specialty training programmes (n = 22) (see Table 1). This sample size was deemed appropriate following an adaptation of Kline’s  advice for ‘traditional’ factor analysis, alongside Stainton Rogers’  advice for Q studies. All participants from the BBT programme were in the second year of their programme and were preparing for the transition into their chosen onward specialty (general practice n = 8, paediatrics n = 5, medicine n = 2, psychiatry n = 1). Those in our ‘conventional’ group were already focussing solely on their career specialty but had different levels of experience/seniority. We initially sought participants on conventional training courses in one of the four BBT specialty areas, but later decided to include trainees in different hospital-based specialty areas (including general surgery, oncology and gastroenterology) to increase our sample size and maximise potential variability .
Participants were asked to first sort the statements into three piles to represent whether they agreed, disagreed or were unsure/neutral that the statement represented a good doctor in terms of their future career. As well as enabling the participants to gain some familiarity with each statement, the number of statements in each pile was recorded in order for the researchers to understand participants’ overall level of agreeability towards the statements. Participants were then directed to distribute each pile of statements onto the Q-sort grid along a continuum from most disagree to most agree. As is common in Q-sort studies, our grid had a forced, quasi-normal distribution (see Fig. 1). The placement of individual statements on this grid creates an overall sorting pattern unique to the participant. This pattern can then be examined holistically in relation to other participants’ sorting patterns. Once the Q-sorting process was complete and recorded, participants filled out a post-sort questionnaire that invited comment on their sorting choices.
The completed Q-sorts from all participants were analysed using PQMethod 2.35 . The software allows inverted or by-person factor analysis to be conducted, which identifies similarities (or shared variance) between the sorting patterns of respondents. Various extraction and rotation techniques are possible, we chose to follow traditional Q methodology studies (such as those by Stephenson  and, latterly, Brown ) and use centroid extraction. Rotation allows for the factors to become more easily interpretable and is commonly used in almost all dimension reduction analyses. In this case, a varimax rotation was used. This process of rotation, identification and extraction generates a number of factors – grouping participants with similar responses together. Following best practice, we only considered factor groupings, or ‘solutions’ with Eigenvalues > 1, and with at least two statistically significant participant Q-sorts loaded onto each factor . This left us with five viable solutions comprising of two to six factors. The research team then had some analytical discretion when deciding which ‘solution’ or number of factor groups, best represents the data. Following the maxim that the most appropriate solution is that which offers a ‘simple solution’  - describing the structure of the data whilst simultaneously providing a readily interpretable substantive solution – the team agreed that a three-factor solution met all these criteria and offered the most explanatory power.
From the factor arrays (see Table 4), we compiled a ‘sorting pattern’ for each group, highlighting the statements ranked higher or lower than each of the other groups (not including tied rankings). Those statements identified by PQMethod as consensus statements were not included in these lists (except when they have been placed in the ‘top’ or ‘bottom’ position) as it has been established that they do not differentiate the groups from one another. Members of the research team used these contrasting sorting patterns , in conjunction with the overall factor arrays and participants’ post-sort questionnaire responses, to interpret participants’ collective subjective viewpoints on what ‘being a good doctor’ means . This holistic approach to interpretation is common in Q methodology, with results of the factor analysis often aided by theory and/or cultural knowledge .
Overall commonality, differentiating statements, and agreeability
Firstly, it is notable that there is a high degree of commonality across all three groups (inter-correlated across the board at 0.67). This means that whilst some statements were placed differently by those in different factor groups, almost half (n = 18) were positioned in a very similar fashion by all participants regardless of their factor grouping (consensus statements are italicised in Table 4). These statements might therefore be regarded as universal across the participant groups. For example all participants ranked ‘having excellent communication skills’ and ‘acting with compassion’ very highly. These priorities were reflected in participants’ post-sort comments:
A doctor without compassion has no place in the medical profession! (Conv.37)
Communication is key to ensuring patient understanding and helping them to take charge of their own health (BBT.14)
Without the ability to communicate why a decision has been reached patients may be confused and angry (Conv.27)
At the opposite end of the scale all participants ranked ‘having the final say in the multidisciplinary team’ lowest (most disagree) and also ranked ‘having a particular mindset’ and focussing exclusively on my specialty at an early stage in my training’ relatively low:
The whole point of the multidisciplinary team is collaborative working and no member should have a louder voice than another. (Conv.24)
Early training should have a general approach as most patients have multiple issues alongside their specialty specific ones (Conv.29)
Having a fixed mind-set can lead to missing information/poor care (Conv.23)
The overall level of commonality in our P-set means that there was only one statistically significant distinguishing statement. The statement ‘mastering specific skills’ distinguishes group A from all other group (A = -3, B = + 2, C = + 2). This means that individuals in group A ranked this statement significantly lower than those in the other two factor groups.
On average, participants tended to ‘agree’ with over half of the statements, suggesting high overall agreeability. This is helpful when interpreting the Q-sorts because it indicates that items placed towards the left-hand side of the sorting grid may not indicate that participants have ‘disagreed’ with them, just that they agree with them less than all of the statements further to the right of the grid. BBT trainees had a slightly higher average agreeability rating (27.0) compared to those on conventional programmes (23.7), indicating that BBT trainees tended to agree with more statements overall.
Three factor groups
Despite high levels of overall commonality, three groups of trainees emerged, each with a distinct perspective on being a good doctor. The distinctiveness of the factors is made apparent in the following, which explores the subtle but important differences in voice and opinion within the overall participant group. The three factor groups are examined in turn, using characterising statements taken from the factor arrays, along with explanations from the post-sort questionnaires. The characteristics of those loading onto the groups are also raised where salient to interpretation but are not tested for statistical difference between factors given the probabilistic assignment of loadings. The names given to the factors reflect the generalist-specialist continuum which emerged from the holistic, substantive interpretation process.
Group a: Generalists
This group gave highest priority to ‘having excellent communication skills’ and a ‘breadth of medical knowledge’. They also emphasized ‘understanding the community to which my patients belong’, ‘orchestrating care for patients with multiple conditions’ and ‘making appropriate referrals’. These priorities were reflected in comments made in their post-sort questionnaires:
Being a GP (eventually) I envisage needing a wide range of knowledge in various specialties as patients will be consulting me about so many things (BBT.03)
It is important to be able to adapt communication styles to the needs of the patient and make them feel at ease during the consultation (BBT.08)
They gave lowest priority to ‘being an expert’ and ‘having the final say in the multidisciplinary team’. The overall positioning of statements of those in this group, coupled with their post-sort questionnaire comments led us to interpret them as generalists and team-players with a collegial and patient-centred approach to their role. This orientation to medicine was particularly popular amongst those on conventional GP training programmes and those opting to follow GP pathways post-BBT:
I believe being a good GP entails well-rounded, emotionally-balanced individuals; involved in holistic care for their patients; with a keen sense of their role and responsibility in the healthcare system (BBT.12)
GPs should be holistic practitioners who care about their patients’ mental and physical health and are aware of the effects that social problems can have on health. They should understand the communities they work in (Conv.36)
Of participants with significantly loading Q-sorts, this group (n = 8) contains all of those aspiring to be GPs from both BBT and conventional GP training (n = 6, 100%), and 22% of trainees on conventional training pathways in medicine (n = 2). A higher proportion of those on the BBT programme (50% of BBT trainees with significantly loading Q-sorts) are in this group, compared with 21% of trainees on conventional programmes. It also represents 33% of male participants and 28% of female participants.
Group B: General-specialists
This group focussed on ‘paying attention to the overall wellbeing of individuals’ and ‘having excellent communication skills’. Whilst they prioritised ‘having a depth of medical knowledge’, they also wanted to understand the ‘links between specialties’:
It is important not to ignore other aspects of patient care to focus entirely on a specialty (Conv.27)
Focussing on wellbeing rather than just treating disease gives more holistic care and wider benefits (BBT.02)
They ranked ‘reaching consultant status’ and ‘being well remunerated’ lower than those in other groups. The overall configuration of this group alongside their post-sort questionnaires suggest that they aspire to be specialists but with a generalist and patient-centred approach to care within their specialty area:
Being a good doctor means having a great deal of expertise in a specialist area, taking the patient as the centre of care but remaining open to new ideas and recognising the importance of other specialties and health professionals contributing to patient care (Conv.27)
This orientation to medical care was seen to resonate with those pursuing a career in Paediatrics:
A specialist in children but a generalist with a holistic outlook to coordinate complex cases with lots of MDT and inter-specialty working (Conv.38)
Of participants with significantly loading Q-sorts, this group (n = 12) includes all those pursuing a career in paediatrics (on both conventional and BBT training), and five from the nine (55%) participants in conventional training in medicine (including gastroenterology and those with an interest in oncology and elderly care as sub-specialties). Three BBT trainees (38% of those with significantly loading Q-sorts) are in this group, compared with almost half 47% of trainees on conventional programmes. Thirty-three percent of male participants and 50% of female participants with significantly loading Q-sorts are in this group.
Group C: Specialists
This group placed ‘having a good work-life balance’ and ‘acting with compassion’ as their highest priorities. They focussed on how their specialty could help the patient, constantly challenge themselves, and to be respected by others.
I really value time spent outside of work, and want work and life to complement each other rather than be imbalanced (B.05)
They placed less emphasis on making appropriate referrals, paying attention to the overall wellbeing and emotional aspects of patients’ experiences, and orchestrating care for multiple conditions. Our analysis of this group suggests that they aspire to being highly specialised and progressing in their own medical career. These priorities are summed up in these participants’ responses to the post-sort question ‘what is your overall view on what being a good doctor means?’ which focus on individual competence and dynamism:
Competent, able, knowledgeable (Conv.20)
Good level of knowledge and practical ability. Able to react competently to rapidly changing acute situations (Conv.35)
Of the participants with significantly loading Q-sorts, this group (n = 7) includes just one BBT trainee (pursuing onward training in medicine), and six trainees on conventional training programmes (32% of those with significantly loading Q-sorts). Two of the nine (22%) trainees pursuing careers in medicine (including gastroenterology) can be found in this group, along with the only psychiatry trainee, and four of the six (66%) trainees in other hospital-based specialties (not including medicine, paediatrics or psychiatry). One third of male participants and 22% of female participants with significantly loading Q-sorts are in this group.
Group A, labelled by us as ‘generalists’ seem to be most aligned to the generalist agenda outlined by Greenaway  amongst others. It is interesting that a higher proportion of BBT trainees than those on conventional training courses fall into this category. This group is dominated by those aspiring to be GPs in the primary care setting, but also those training in core medicine who are likely to be hospital-based. The second group of ‘general-specialists’ (group B), was dominated by those aspiring to be paediatricians, suggesting that those in secondary care focussing on a patient group (e.g. children/the elderly) may have more generalist outlooks than those focussing on a particular body part or system. Both these two groups can be contrasted to those in the third ‘specialist’ group (C), who seem to have a more singular focus on how their specialty can help the patient. Members of this group from ‘other specialties’ include general surgery, neurology and histopathology.
Do trainee perspectives vary according to specialty?
For those participants following the novel BBT programme, each group appears to represent a particular specialty area: of those significantly loading onto a factor, all those aspiring to be GPs can be found in group A, all those aspiring to be paediatricians are located in group B and the one trainee in group C is pursuing an onward career in medicine. This suggests that these trainees’ onward career specialty aspirations distinguish them from one another. However, it is important to note that two thirds (n = 6) of those BBT trainees who did not load significantly onto a single factor (n = 8) were confounded between groups A and B, suggesting that the overwhelming majority of BBT trainees self-identify as generalists or general specialists (as opposed to specialists).
The picture is less clear, however, for those on conventional specialty training programmes. On the one hand, following the pattern of the BBT trainees, all those training to be GPs can be found in group A and all those training to be paediatricians can be found in group B. However, on the other, those pursuing a career in Medicine (broadly defined) can be found across all three groups, and those in ‘other’ hospital-based specialties not including medicine, paediatrics, and psychiatry are located in groups B and C. This may be due to variation in sub-specialty roles within some broad specialty areas and could be a reflection of the wider sampling of those on conventional pathways compared to the BBT group.
Do trainee perspectives vary according to gender?
Of those with significantly loading Q-sorts, males are spread evenly between the three groups, whilst half of female participants fall into group B, with 28 and 22% in groups A and C respectively. This is perhaps unsurprising given that group B includes all of those participants with significant loadings pursuing careers in Paediatrics and it has been shown that women make up over two-thirds of Paediatric trainees in England .
Do disciplinary boundaries mask underlying commonalities?
We have noted the high levels of overall commonality between participants’ Q-sort configurations, indicating that trainees across different specialty areas share similar views on a number of key issues. These data therefore suggest that inter-disciplinary boundaries and the assumption that those in different medical specialty areas think and act differently, may mask underlying commonalities and universal values held by trainees and shared understandings about what ‘being a good doctor’ means across interdisciplinary divides.
Limitations and future directions
Whilst the correlations that form part of the inverted factor analysis characteristic of Q-sort analysis mean that the numbers of participants required is typically few than the number of statements (here 40) , it is regrettable that we were not able to include more BBT trainees, or those specialising in Psychiatry in our sample. Another potential sampling issue is that our participants came from different stages in their postgraduate training specialties. However, rather than trying to control for differences such as this, proponents of Q-methodology encourage sampling for maximum diversity in order that the by-person factor analysis reveals which demographic or other characteristics are pertinent to understanding the grouping of individual Q-sorts. We did not find stage of training to be an important factor in our analysis of our three groups. Another potential limitation of studies using Q-methodology is that the concourse or Q-set can never be exhaustive and a balance must be achieved between overall number of statements and the manageability of the task. By piloting our Q-set and asking participants to indicate if they would add any statements in their post-sort questionnaire we have sought to minimise the impact of this limitation.
Building on this exploratory study of trainee’ doctors perspectives in relation to key debates on generalism and specialism, more research into both the similarities and differences in outlook of doctors in different disciplines is needed in order to appreciate more fully the relationship between inter- and intra- professional identities . Indeed, by casting our net of participants widely, our analysis may have obscured subtler differences within disciplinary groups. A fruitful avenue for further research may be, therefore, to explore perspectives according to stage of training, gender, and within specialist groupings.
There is growing international recognition of the potential for integrated care and enhanced medical generalism [6,7,8, 10,11,12] to alleviate the challenges presented by ageing populations and the associated rise in complex care needs and co- and multi-morbidities [1,2,3, 7,8,9]. This project demonstrates the potential for Q-methodology to address research questions relating to the perspectives and subjectivities of healthcare professionals in a systematic and ‘qualiquantological’  manner. The results of our Q-sort analysis suggest that it may be helpful to understand the relationship between generalism and specialism as less of a dichotomy and more of a continuum that transcends primary and secondary care settings. This will have implications for medical education and training. A nuanced understanding of trainee views on being a good doctor, across different specialties, may help us to bridge gaps and foster interdisciplinary working.
Acute Medical Unit
Academy of Medical Royal Colleges
Broad Based Training
Health Education England
Wait S, Harding E. The state of ageing and health in Europe. UK: international longevity Centre; 2006.
World Health Organisation. Global Health and aging. Washington: World Health Organisation; 2011.
van Oostrom SH, et al. Multimorbidity and comorbidity in the Dutch population–data from general practices. BMC Public Health. 2012;12(1):715.
Vera A, Kunz L. Process-based organisation design and hospital efficiency. Health Care Manag Rev. 2007;32(1):55–65.
KPMG International. Something to Teach, Something to Learn: Global Perspectives on Healthcare. KPMG international, 2013. Available at: https://home.kpmg/xx/en/home/insights/2013/04/something-to-teach-something-to-learn.html. Accessed Jan 2019.
Ham C, Dixon A, Brooke B. Transforming the delivery of health and social care: the case for fundamental change. London: The Kings Fund; 2012.
Greenaway D, et al. Shape of Training: Securing the Future of Excellent Patient Care. London: shape of Training; 2013.
Royal College of Physicians; Royal College of General Practitioners; Royal College of Paediatrics and Child Health. Teams without Walls: Working together will improve patient care. London: Royal College of Physicians, 2008.
Barnett K, et al. Epidemiology of multimorbidity and implications for health care, research, and medical education: a cross-sectional study. Lancet. 2012;380:37–43.
Imrie K, Weston W and Kennedy M. Generalism in postgraduate medical education. Members of the FMEC PG Consortium, 2011.
Wachter RM, Bell D. Renaissance of hospital generalists. BMJ. 2012;344:e652.
RCGP and Health Foundation. Guiding Patients Through Complexity: Modern Medical Generalism. Report of an independent Commission for the Royal College of general practitioners and the Health Foundation, 2011.
NHS Scotland. Advanced Nurs Pract Toolkit, 2012. Available online: http://www.advancedpractice.scot.nhs.uk/. Accessed 2 May 2018.
Muddiman E, Bullock A, Pugsley L, MacDonald J, Allery L, Webb K. Black sheep in the herd’: raising questions about the role and status of generalist doctors with reference to the BBT programme in England. Health Serv Manag Res. 2016;29(4):124–31.
O’Brien BC, Hirsh D, Krupat E, Batt J, Hansen LA, Poncelet AN, Ogur B, Hauer KE. Learners, performers, caregivers and team players: descriptions of the ideal medical student in longitudinal integrated and block clerkships. Medical Teacher. 2016;38(3):297–305.
Walsh S, Arnold B, Pickwell-Smith B, Summers B. What kind of doctor would you like me to be? Clinical Teacher. 2016;13(2):98–101.
Mechanic D, Meyer S. Concepts of trust among patients with serious illness. Soc Sci Med. 2000;51(5):657–68.
Haron Y, Tran D. Patients perceptions of what makes a good doctor and nurse in an Israeli mental health hospital. Issues in Mental Health Nursing. 2014;35(9):672–9.
Johansson H, Eklund M. Patients’ opinion on what constitutes good psychiatric care. Scand J Caring Sci. 2003;17(4):339–46.
Hurwitz S, Kelly B, Powis D, Smyth R, Lewin T. The desirable qualities of future doctors: a study of medical student perceptions. Medical Teacher. 2013;35(7):e1332-e9.
Elam C, Rudy D. Medical school matriculants' perceptions of physician competencies and qualities. Acad Med. 2000;75(5):511–2.
Liberati EG, Gorli M, Scaratti G. Invisible walls within multidisciplinary teams: disciplinary boundaries and their effects on integrated care. Soc Sci Med. 2016;150:31–9.
Naccarella L. Generalism workforce planning. Definitional, pragmatic and transformational issues Australian Family Physician 2014;43(1):69–72.
Nancarrow SA, Borthwick AM. Dynamic professional boundaries in the healthcare workforce. Sociol Health Illn. 2005;27(7):897–919.
Lewin S, Reeves S. Enacting ‘team’ and ‘teamwork’: using Goffman’s theory of impression management to illuminate interprofessional practice on hospital wards. Soc Sci Med. 2011;72(10):1595–602.
Monrouxe L. Theoretical insights into the nature and nurture of professional identities. In: Cruess RL, Cruess SR, Steinert Y, editors. Teaching medical professionalism. 2nd ed. Cambridge: Cambridge University Press; 2016. p. 37–53.
Watts S, Stenner P. Doing Q methodology. London: Sage; 2012.
Health Education England. Important announcement about broad based training. In: NHS; 2015. Available at: http://www.severndeanery.nhs.uk/about-us/broad-based-training-programme/. Accessed Nov 2015.
Limb M. Scrapped generalist training programme was working well, review concludes. BMJ. 2016; Available at: https://www.bmj.com/content/358/bmj.j3260. Accessed July 2017.
Muddiman E, Bullock AD, MacDonald J, et al. ‘It’s surprising how differently they treat you’: a qualitative analysis of trainee reflections on a new programme for generalist doctors. BMJ Open. 2016;6:e011239. https://doi.org/10.1136/bmjopen-2016-011239. Available here: https://bmjopen.bmj.com/content/6/9/e011239.share.
Kline P. An easy guide to factor analysis. London: Routledge; 1994.
Stainton Rogers R. Q methodology. In: Smith JA, Harré R, van Langenhove L, editors. Rethinking Methods in Psychology. London: Sage; 1995. p. 178–92.
PQMethod 2.35. Available at http://schmolck.org/qmethod/. Accessed 12 May 2015.
Stephenson W. The study of behavior; Q-technique and its methodology. Chicago: University of Chicago Press; 1953.
Brown SR. On the raking of averages: variance and factor analyses compared. Operant Subjectivity. 1999;22(3):31–7.
Thurstone LL. Multiple-factor analysis. Chicago: University of Chicago Press; 1947.
Cross RM. Exploring attitudes: the case for Q methodology. Health Educ Res. 2005;20(2):206–13.
Stainton Rogers R, Stenner P, Gleessen K, Stainton Rogers W. Social psychology: a critical agenda. Cambridge: Polity Press; 1995.
Stainton Rogers R. Q methodology. In: Smith JA, Harre R, Van Longenhove I, editors. rethinking methods in psychology. London: Sage; 1995. p. 178–93.
RCPCH. State of Child Health: The Paediatric Workforce. 2017. Available at: https://www.rcpch.ac.uk/sites/default/files/2018-03/2015_rcpch_state_of_child_health_the_paediatric_workforce_v1.1.pdf. Accessed Feb 2019.
Stenner P, Stainton-Rogers R. Q methodology and qualiquantology: the example of discriminating between emotions. In: Todd Z, Nerlich B, McKeown S, Clarke DD, editors. Mixing methods in psychology: the integration of qualitative and quantitative methods in theory and practice. New York: Psychology Press; 2004.
We gratefully acknowledge the funding from Health Education England (HEE) and the Academy of Royal Medical Colleges (AoMRC) in commissioning our evaluation of the Broad-Based Training programme. Without this award we would not have been able to undertake the important study upon which this paper draws. We extend our gratitude to all participants who gave freely of their time.
This research was commissioned by the Academy of Royal Medical Colleges and funded by Health Education England. The funding body played no role in the design of the study, the collection, analysis or interpretation of data, or the writing of this manuscript.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
Ethics approval and consent to participate
This study received ethical approval from Cardiff University Postgraduate Medical and Dental Education Ethics Committee (02/10/13). Written consent was obtained from all participants.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.