Transitions in general practice training: quantifying epidemiological variation in trainees’ experiences and clinical behaviours

Abstract

Background

General Practice training in Australia is delivered through the apprenticeship model. General Practice supervisors support trainees transitioning from hospital-based work towards competent independent community-based practice. The timing and manner in which support should be provided is still not well understood. This study aimed to establish the variation in clinical and educational experiences and behaviours, and location, of general practice trainees’ consultations by stage of their vocational training. It was hypothesised that change is greater in earlier stages of training.

Methods

A cross-sectional analysis of data (2010–2018) from the Registrar Clinical Encounters in Training (ReCEnT) study, an ongoing cohort study of Australian GP registrars’ in-consultation clinical and educational experience and behaviours. Multinomial logistic regression assessed the association of demographic, educational, and clinical factors in different stages of training. The outcome factor was the training term.

Results

Two thousand four hundred sixteen registrars contributed data for 321,414 patient consultations. For several important variables (seeing patients with chronic disease; new patients; seeking in-consultation information or assistance; ordering pathology and imaging; and working in a small or regional practice), odds ratios were considerably greater for comparisons of Term 1 and 3, relative to comparisons of Term 2 and 3.

Conclusion

Differences experienced in demographic, clinical and educational factors are significantly more pronounced earlier in registrars’ training. This finding has educational and training implications with respect to resource allocation, trainee supervision and curriculum design. Sociocultural learning theory enables an understanding of the impact of transitions on, and how to support, general practice trainees and supervisors.

Background

General practice (family medicine) is a specialty which allows healthcare systems to produce high quality, equitable and efficient care [1]. Inherent in general practice is the management of a high proportion of undifferentiated illnesses and the inevitable uncertainty that permeates decision-making [2]. Internationally, various training programs exist to prepare trainees for the change from hospital-based work to general practice work and learning [3]. Successfully navigating this change is important to reduce negative consequences including burnout and intolerance of clinical uncertainty [4].

Australian general practice specialist vocational training (hereafter, ‘GP training’), like many medical vocational training programs, is based on the clinical apprenticeship-like model. Registrars (trainees) work independently alongside experienced general practitioner (GP) supervisors [5]. This model provides exposure to a wide-ranging set of patient demographics and clinical presentations. After graduating from medical school, GP registrars will complete a minimum of 24 months of hospital-based training, 18 months of general practice placements and 6 further months of extended skills training (which may be undertaken in general practice or in hospital-based training). There are shared experiences between Australian GP training and post-graduate medical specialist training programs internationally [6].

The transition from medical student to junior doctor entails individuals coping with new responsibilities, tasks and expectancies [7, 8]. This can initiate a period of rapid personal development with development of robust coping strategies [9], but can also leave practitioners prone to burnout [10]. A similarly momentous transition occurs between hospital-based work and general practice training, where registrars are required to adopt a high level of independence within an apprenticeship model of working, with similar risks for adverse outcomes [11]. What is not well-understood is the rate and impact of the transition that occurs within general practice training and beyond this in independent practice.

Differences in clinical and learning behaviour between early and later stages of GP training have previously been found in cross-sectional analyses for various outcomes including the management of chronic disease [12]; information-seeking by trainees [13]; use of resources and information within a consultation [14]; generation of learning goals [15]; anxiety due to clinical uncertainty [2]; location (rurality) of practice [16]; and use of pathology ordering [17]. In identifying these differences, a better understanding is generated of how the individual skills that comprise clinical competence in independent practice change with progression through training. Previous research has not systematically assessed exactly when these differences occur during training. These aforementioned factors in clinical experience and behaviours have not previously been synthesised in a single analysis by stage of training. Understanding the timing of these changes and where transitions are most keenly experienced has important general practice workforce, training, and educational implications. It would help optimise educational resource allocation and trainee and supervisor support. These findings could be applied to other training programs with an apprenticeship-like model of training.

In this exploratory epidemiological study, we sought to establish variation in clinical and learning content, and location, of trainee consultations by stage (training term) of training. We hypothesised, given previous individual findings using training term as an independent factor, that changes in demographic, clinical and educational variables would be greatest earlier in training.

Methods

This analysis was conducted within the Registrar Clinical Encounters in Training (ReCEnT) project.

ReCEnT

ReCEnT is an ongoing cohort study of GP registrars’ in-consultation clinical and educational experience and behaviours. It was conducted in five training organizations in five Australian states from 2010 to 2015, and in three training organizations in three states and a territory from 2016 (following a major reorganization of the national GP training program). The study participants are Australian College of Rural and Remote Medicine and Royal Australian College of General Practitioners registrars in general practice training terms.

Registrars complete data collection, once in each of three six-month (full-time equivalent) training terms, as a routine component of their training program [18, 19]. They may also provide consent for their data to be used for research purposes.

Data collection includes registrars’ demographic data, and practice characteristics. Details of 60 consecutive clinical consultations per term via a paper-based case report form are recorded. Only office-based consultations are recorded. The consultation data includes patient demographics, diagnoses and problems managed, investigations, management and educational training aspects. The detailed methodology is presented elsewhere [18].

Outcome

The outcome factor was stage of registrar training (Term 1, 2, or 3).

Independent variables

Independent variables related to the registrar, practice, patient, consultation, and outcomes of the consultation. See Table 2 for individual independent variables included in analyses.

Statistical analysis

A cross-sectional analysis of 18 rounds of data (2010 – 2018) from the longitudinal ReCEnT study, was conducted at the level of registrar-round and at the level of the consultation. The proportion of registrar-rounds and consultations at each training stage were calculated with 95% confidence intervals adjusted for repeated measures within registrars.

Descriptive statistics included frequencies with percent for categorical variables and mean with standard deviation for continuous variables. The frequencies of categorical variables were compared between outcome categories using Chi-squared tests for all variables, except when Fisher’s exact test was used (due to an expected count less than 5 in 25% or more cells). For continuous variables, means were compared using a t-test.

Multinomial logistic regression was used within the generalised estimating equations (GEE) framework to account for repeated measures within registrars. The reference category of the nominal outcome was specified as Term 3 for all analyses.

Univariate analyses were conducted on each covariate, with the outcome. Covariates with a univariate p-value < 0.20 were considered for inclusion in the multiple regression model.

Once the model with all significant covariates was fitted, model reduction was assessed. Covariates which were no longer significant (at p < 0.2) in the multivariable model were tested for removal from the model. If removal of the covariate did not substantively change the resulting model, it was removed from the final model.

The regressions modelled the log-odds that registrars were in Term 1 or Term 2, compared to Term 3, as a function of independent variables.

To investigate the research question regarding how registrars’ clinical behaviours, educational experience and training location differed by stage of training, four regression models were built, to sequentially assess associations of different variable types with the outcome.

In the first model, the differences in registrars and their training practice over stages of training were assessed, by including practice and registrar independent variables in the regression model. Analysis was at the level of registrar-round.

The second model examined patient differences across registrar training stages, by including all the above variables, together with patient variables in the regression model. Analysis was at the consultation level.

Similarly, to examine consultation and consultation-outcome differences across training stages, the above processes were repeated in third and fourth regression models, both analysed at the consultation level.

The rationale for this sequential approach was that we sought to establish associations of registrars’ practice location with training term (model 1) adjusted for registrar and practice factors, but not for patient or consultation variables which are not relevant to practice location allocation. Similarly, we sought to establish patient associations with registrar term (model 2) adjusted for registrar and practice factors, but not for consultation or consultation-outcome which are not relevant to the registrar ‘seeing’/being consulted by the patient. Similar logic applied for models 3 and 4.

Effects were expressed as odds ratios (ORs) with 95% CI. Significance was declared at the conventional 0.05 level, with the magnitude and precision of effect estimates also used to interpret results. Analyses were programmed using STATA 14.0 and SAS V9.4.

Ethics approval

University of Newcastle Human Research Ethics Committee, Reference H-2009–0323.

Results

Data collection included 18 rounds of ReCEnT data collection (2010–2018), including 2416 registrars (response rate 94.9%), 5798 registrar-rounds, and 321,414 registrar-patient consultations. Registrar and practice characteristics are presented in Table 1.

Table 1 Characteristics of participating registrars and their practice

Term 1 registrars contributed 39.6% [95% CI: 39.1–40.1] of registrars-rounds (n = 2294); Term 2 registrars 36.2% [95% CI: 35.8–36.6] (n = 2100); and Term 3 24.2% (95%CI 23.6–24.8] (n = 1,404]. The corresponding percentages for patient consultations were for Term 1, 40.3% (95%CI: 39.8–40.9] (n = 129,578); Term 2, 35.9% (95% CI: 35.4–36.3] (n = 115,314); and Term 3, 23.8% (95%CI: 23.2–24.5] (n = 76,522).

Characteristics associated with stage of training are presented in Table 2, with univariate and multivariable regression models presented in Table 3.

Table 2 Characteristics associated with stage of training

Table 3 Associations of registrars’ term of training from univariate and multivariable logistic regression

Results show considerable differences in multiple variables across training, particularly between Term 1 and Term 3.

While we have not directly compared differences between Term 1 and Term 2 with differences between Term 2 and Term 3, a consideration of the overall pattern of multivariable results (effect size, p-values, direction of effect) suggests that much of the change in independent variables between early (Term 1) and later (Term 3) training and practice occurs early in training (between Terms 1 and 2).

There were several independent variables for which there were significant differences between Term 1 and Term 3, but for which the differences between Term 2 and Term 3 were of smaller effect, not reaching statistical significance, and with the direction of the association being reversed. These included registrars working in small practices (Term 1 vs Term 3 OR 1.22, Term 2 vs. Term 3 OR 0.94 (p = 0.007 and 0.39, respectively); registrars seeing patients that were new to them (OR 1.48 and OR 0.96 (p < 0.001 & 0.13); and ordering pathology (OR 0.89 and OR 1.00 (p < 0.001 & 0.94). For registrars seeing patients new to their practice, a similar pattern exists, though both comparisons reached statistical significance (OR 1.34 vs. OR 0.90 (p < 0.001 and 0.003).

For some other variables, there were differences between Terms 1 and 3, but not between Terms 2 and 3, with the values of the respective ORs suggesting much of the difference between Term 1 and 3 occurred between Term 1 and Term 2: for example, registrars working in inner regional compared to major city practice (OR 1.30 and OR 1.09 (p = 0.004 and 0.30), and registrars ordering imaging (OR 0.94 and OR 0.99, p = 0.006 and 0.75). Registrars in later terms saw significantly more patients with chronic disease, with much of this difference seeming to be between Terms 1 and 2 (OR 0.88 and OR 0.96, p < 0.001 and 0.011). Similarly, much of the decrease in registrars’ in-consultation seeking of information or assistance seemed to occur between Terms 1 and 2 (OR 2.04 vs. OR 1.35 p < 0.001 and < 0.001).

There was a lesser number of independent variables for which most difference appeared to exist between Terms 2 and 3: registrars working part-time, and the registrar organizing patient follow-up.

Discussion

Summary of the main findings

We found differences between Terms 1 and 3 in a range of independent variables, spanning various aspects of registrars’ practice. This suggests considerable change in the context and content of their practice as registrars progress through training. These differences were more pronounced, that is, changes were more likely to occur earlier rather than later in training. Differences were apparent especially for working in small and regional practices, and for seeing patients who were new to both registrar and the practice. Differences in seeking in-consultation information or advice, and in pathology and imaging ordering also appeared to be greater in early- than in later-training, as was exposure to chronic disease care.

Though our analyses were cross-sectional and do not document change in individual registrars’ experiences, they nevertheless strongly suggest transitions in registrar training experience are greater earlier in training. This data provides statistical insight into the magnitude and speed of transitions experienced in postgraduate training. Our research demonstrates that rapid change affecting several areas of GP registrars’ training experiences occurs earlier rather than later in training. This is evidence in support of our hypothesis that changes in demographic, clinical and educational variables are greatest earlier in training.

Context of findings in relation to previous research

Whilst expected, change and transition have traditionally been seen as adverse periods. The management of transitions and change have featured heavily in medical educational theory and curriculum design. Traditionally, changes and transitions were viewed as problematic stages in training [10], with recommendations to alter curriculum design to align with training for the next stage, rather than addressing the transition. More recently, transitions are increasingly being viewed as learning opportunities instead of threats [20].

The transition from medical student to junior doctor, and from hospital-based work to general practice training and the attendant demands of rapid professional development, skills acquisition and tolerance of uncertainty could also be seen as entailing positive aspects. Much previous research has focused on the risk of adverse outcomes and burnout in these periods of change [2, 10, 21]. The transition into general practice training occurs in the context of GP registrars adopting a high level of independence within a new working environment and style of practice where they are expected to manage undifferentiated and complex, often chronic disease presentations [22, 23]. Experiencing a rapid change from hospital-based work to ‘the wild safari’ of GP registrar work and learning [3] can be seen as a form of ‘immersion’ into a new environment. This concept has proven effective in simulation teaching [24] and exposing medical students to work as a junior doctor [25]. Our findings, explored also in previous research [15], demonstrate that GP registrars generate less self-directed learning goals as they progress through training as seen in the differences between Terms 1 and 3 and between terms 2 and 3 (OR 1.83 and OR 1.36, p < 0.001 and < 0.001). This suggests that, despite the rapid transitions experienced in training, registrars develop more confidence in their clinical knowledge and practice, with less perceived need for further reflection and self-directed learning.

Conversely, rapid transitions could exacerbate negative consequences including the potential burnout associated with managing, and making decisions for [2], a high proportion of undifferentiated illnesses in general practice, especially where there is a high intolerance of clinical uncertainty [4]. Our findings show that ‘structural’ changes in training (practice size and rurality of location) are occurring concurrently with this professional and educational ‘immersion’. This may potentially amplify any consequences of this transition period, negative or otherwise, and needs to be considered when navigating this change.

A pedagogical perspective is helpful in providing a framework to consider how both personal and contextual factors influence responses to change. Using existing sociocultural educational theory helps conceptualise and clarify our findings of change and transition in an apprenticeship-like model of general practice training. This allows for a focus on how individuals can be better supported through transitions, rather than only on why this change occurs.

Transitions and a sociocultural view of general practice training

The psychologist Lev Vygotsky describes the ‘zone of proximal development’ (ZPD) as the distance between actual and potential developmental levels. This gap in development is traversed through problem solving under the guidance of more capable peers and, ‘the more knowledgeable other’[26], in this example, the GP supervisor. The ZPD can be further differentiated into objective and subjective components [27]. The objective ZPD, applied to the apprenticeship training model, encompasses systemic functions that exist independent of the registrar, including the practices they are allocated to work in, the role of regional training organisations, the GP training curricula, and working with supervisors. The subjective ZPD describes individual capabilities in navigating change, such as resilience. This framework helps us understand how individual registrar-specific qualities and organisational components interact and influence registrars’ adaptation to new learning environments. Underpinning this in an apprenticeship-like model of training is the relationship between trainees and supervisors. Understanding the formation of this supervisory relationship [28], is essential for reducing role uncertainty and facilitating task-mastery and confidence [29].

Our findings of more rapid transitions earlier in training may be a consequence of the apprenticeship-like model of training in Australia [30]. The geographically-dispersed, more heterogeneous Australian model may facilitate the front-loaded ‘structural’ changes (such as size and rurality of practice), which comprise components of the objective ZPD, noted earlier in training. Proactive and comprehensive management of the objective ZPD would likely positively impact trainees’ experiences of transitions.

By contrast elsewhere, for example in the North American system, training is administered via state- or university-based programs with closer supervision of trainees in academic family medicine practices [6]. Patient contact and training arrangements are standardised and managed by university departments, signifying closer management of the objective ZPD for trainees.

The theory of proximal development references the instructional concepts of ‘scaffolding’ and ‘apprenticeship’ wherein more knowledgeable others, GP supervisors, help trainees formulate illness scripts and develop clinical reasoning. Our research demonstrates that the increased rate of transitions experienced earlier in training coincide with medical trainees forming more clinical questions and seeking further advice. This suggests that supervisor-led scaffolding and support is required earlier in registrar training in order to facilitate the potential of individual trainees to navigate and learn from the transitional experience, rather than be overwhelmed by it.

In the Australian GP training environment, supervisors need to be expert in providing patient care ‘by proxy’ and giving registrars support [5]. Australian GP supervisors are supported in their role by Regional Training Organisations [31]. Our findings of trainees experiencing greater clinical change earlier in training identifies the need for increased supervisor support of registrars at this time of maximal transition [32]. It may be that current emphasis on early support for registrars should be pursued even more strongly. This increased clinical support would need to be underpinned by adequate, standardised supervisor training [33], professional development and remuneration [34]. International studies have shown the need and successes of earlier support and intervention for GP trainees [35, 36].

Using established sociocultural educational theory to examine the impact of educational and behavioural changes in an apprenticeship-like model of training demonstrates where resource allocation and educational support is required, earlier in training, in order to help trainees navigate the transition to competent, independent practice.

Conclusions

The precise impact of the quantitatively-demonstrated rapid changes early in general practice training and associated steep learning curve for trainees across a range of educational, clinical and demographic factors requires further exploration. Rapid transitions within an apprenticeship-like model of training could exacerbate already-existing impact of uncertainty in general practice and may contribute to physician burnout [2]. Pairing educational insights from established sociocultural theories of learning with our observations provides a framework for mitigating the potential negative impact of transitions. GP supervisors and training organisations, comprising the objective ZPD, need to provide trainees with additional early support. This support would help to flatten the shape of the early learning curve. Without this support, burnout and attrition rates from training programs could increase [37]. Implementing such measures may however increase demands on GP supervisors and the current apprenticeship-like Australian model of GP training.

Further research

Further research should focus on the specific impacts that the now-identified steep learning curve has on GP trainees, supervisors, patient care and the health workforce. It remains to be explored whether particular groups of trainees are affected differently, including those training in more rural and remote areas [38] and international medical graduates training in Australia [39].