This article has Open Peer Review reports available.
The learning environment of paediatric interns in South Africa
© The Author(s). 2017
Received: 24 January 2017
Accepted: 20 November 2017
Published: 29 November 2017
South African (SA) paediatric interns (recently qualified medical graduates) work in a high disease burdened and resource deficient environment for two years, prior to independent practice. Perceptions of this learning environment (LE) influences their approaches to training as well as the outcomes of this period of development. Obstacles to creating a supportive LE and supervisor interaction affects the quality of this training. Measuring perceptions of the LE with validated instruments can help inform improvements in learning during this crucial period of medical education.
The aims of this study was to determine the psychometric qualities of the Postgraduate Hospital Educational Environment Measure (PHEEM) amongst paediatric interns across four hospital complexes in South Africa and to measure the LE as perceived by both interns and their supervisors. Construct validity was tested using factor analysis and internal consistency was measured with Cronbach’s alpha.
A total of 209 interns and 60 supervisors (69% intern response rate) responded to the questionnaire. The PHEEM was found to be very reliable with an overall Cronbach’s alpha of 0.943 and 0.874 for intern and supervisors respectively. Factor analysis using a 3-factor solution accounted for 42% of the variance with the teaching subscale having the best fit compared with the other sub-scales of the original tool. Most interns perceived the learning environment as being more positive than negative however, their perceptions differed significantly from that of their supervisors. Poor infrastructural support from institutions, excessive workloads and inadequate supervision were factors preventing optimal training of paediatric interns.
The SA version of the PHEEM tool used was found to be a reliable and valid instrument for use in interns amongst high disease burdened contexts. Various obstacles to creating an ideal learning environment for paediatric interns were identified to be in need of urgent review. Key differences in perceptions of an ideal learning environment between interns and their supervisors need to be fully explored as these may result in sub-optimal supervision and mentoring.
The South African (SA) medical internship program occurs in an environment of high neonatal, infant and child mortality reflecting the multiple disease burdens of HIV/AIDS and Tuberculosis within the poor socio-economic context of sub-Saharan Africa [1–4]. High patient to doctor ratios and challenges with the provision of quality medical education, confound this context for the newly qualified intern [5–7]. Studies of intern training in South Africa reflects high levels of stress  and burnout [9–11]. It is in this environment that there is a need to effectively train medical practitioners to care for children.
The learning environment (LE) has been defined as a ‘set of factors that describe a learners’ experience within an organization’ . It has been seen to consist of three parts. The first part entails a physical component which encompasses the provision of food, shelter and comfort, which has been described as being under ‘external regulation’. The second part entails an emotional component including aspects of support, feedback as well as the extent of harassment, which is viewed as a ‘beneficial affective climate’. The third part, an intellectual component, refers to evidence based practice, learning with patients, structured education and instilling motivation which encompasses the ‘learning content and coaching’ [13, 14]. The LE influences trainee’s approaches to learning and the quality of their learning outcomes [15, 16]. Satisfaction with the LE plays a critical role in the success of trainees future achievements [17, 18]. The Postgraduate Hospital Educational Environment Measure (PHEEM) is a well-recognized instrument to assess the learning environment of postgraduate medicine . It has been used internationally, in hospital settings and among interns to assess the learning environments in post-graduate medicine [12, 20–26]. The PHEEM has been shown to have the ability to identify strengths and weaknesses in the LE and scores have a significant negative correlation with burnout levels of those assessed . Structural and cultural differences that exist in the high disease burdened environment of SA may affect the reliability and validity of a tool developed in a very different context. In order for the PHEEM to be used in the SA context it’s psychometric qualities needs to be assessed.
Understanding the learning environment of an educational program is fundamental to managing educational development and change . It is also important to measure the perceptions of the LE amongst both paediatric interns and their supervisors, as both can have very differing perceptions of an ideal LE [17, 28]. This added insight will improve evaluations of the LE. By monitoring and evaluating perceptions of the learning environment, improvements can be made to the quality of training in an informed way.
Determine the reliability and validity of the Postgraduate Hospital Educational Environment Measure (PHEEM) as a useful tool to measure the learning environment of interns in SA; and
Assess the learning environment of interns doing paediatrics in a SA setting and to compare the perceptions of the learning environment between interns and their supervisors.
The study was a cross-sectional cohort study.
The SA internship program encompasses a 24-month training period in various specialties including 4 months in paediatrics. Internship in SA is the responsibility of the national government through provincial departments of health using the platform of regional hospitals in each province. The Health Professionals Council of South Africa (HPCSA) is the professional regulatory body is responsible for the oversight and accreditation of curricula, supervisors and the regional hospitals where interns train. Supervisors are usually specialists employed by the regional hospitals and residents working with these specialists. Many supervisors have an affiliation to a medical university however the university structures do not have a formal responsibility in internship training .
In order to assess the LE in a high disease burdened context, four major regional hospital complexes in Durban and Pietermaritzburg, in KwaZulu-Natal (KZN) Province, SA were chosen. These hospitals account for 76% of all intern training in SA’s second most populous province where the HIV/TB disease burdens are amongst the highest in the country . Across these four hospital complexes there were 89 senior (specialists) and junior (residents) supervisors who were responsible for the training, mentoring and assessment of interns during the paediatric rotation .
Each of the 40 items on the PHEEM questionnaire is scored on a 5-point Likert scale (1 = strongly disagree to 5 = strongly agree). Three subscales related to teaching, role autonomy and social support were proposed by the original developers of the instrument following qualitative and quantitative methods of research .
Minor changes to accommodate differences in terminology and for use in South Africa and in a paediatrics specialty were made to the original instrument , and it was then piloted with a group of interns at one intern complex and senior intern supervisors across the province in a focus group in order to ensure face validity. The same modified questionnaire used for interns was adapted to use with supervisors to facilitate comparisons across these groups. Additional file 1: Appendix A and Additional file 2: Appendix B reflect the outcomes of this process.
Ethical approval for the study was obtained from the University of KwaZulu-Natal Biomedical Research Ethics Committee and permission granted from the various institutions as well as the Health Research and Knowledge Management Subcomponent of the Department of Health in the province of KZN.
The PHEEM questionnaire was group administered by the primary author to interns on site at each of the hospitals in December 2015. All interns and intern supervisors were informed of the study and invited to participate. Written consent was required for participation. Participants were informed of their rights and could withdraw at any stage. The supervisors completed the questionnaire individually (i.e. a self-administered format). This was done within the same time–period used to survey the interns at each hospital. The questionnaire took approximately 15 min to complete.
The total sample size needed to be representative of the general intern pool in the province as well as greater than 100 for the factor analysis for a 40–item instrument . The achieved sample sizes of 209 interns and 60 supervisors corresponded to a power of 92% when comparing PHEEM scores between two groups using an independent samples t–test for the detection of a medium effect size (Cohen’s d = 0.5) with 80% power at the 5% significance level. Sample size calculations were carried out in G*Power .
In order to validate the use of the PHEEM in our setting we studied the psychometric characteristics and internal consistency of the version used in our study. To investigate the internal structure of the PHEEM, especially the construct validity of the original three subscales, we applied factor analysis with varix (orthogonal) rotation to determine the underlying dimensions in the data. The Kaser-Gutmann Eigenvalue criterion of > 1; the Cattell criterion of accepting factors above point of inflexion on the scree plot, and the proportion of the total variance explained (60%) were used to determine the number of underlying factors. Factor loadings above 0.4 were interpreted. Cronbach’s alpha coefficient was used to assess reliability and internal consistency.
Descriptive statistics were calculated of the overall score and that of the three subscales. Continuous variables were summarized by the mean with standard deviation and median with interquartile ranges. The overall PHEEM scale and sub-scale scores were calculated for each participant. Where there was missing data, means were computed based on data for available items, provided this did not exceed 20% of the items. The overall score was computed as the average of all 40 items.
Each item on the PHEEM questionnaire was compared between the interns and the supervisors treating the scores as a continuous measure and comparisons made using the student t–test provided the data met the assumptions for this test. The strength of the associations was measured by the Cohen’s d for parametric tests. As examining the means of the responses may fail to highlight extent of problems elicited especially the perceptions of interns and supervisors on individual items e.g. perceptions of racism, gender bias or a ‘blame culture’ we further categorized each item as ‘strongly disagree’ or ‘other’, in order to determine the extent of difference in these items between interns and supervisors. Data analysis was carried out using SAS Version 9.4 for Windows. The 5% significance level was used throughout (p-values < 0.05 indicating significant results).
Females comprised 55% of the intern sample and all participants were aged 23–37 (mean 26.2, standard deviation 2.6). The response rate of the supervisors was 67% (60/89). The supervisors were 61% female and consisted of 50% senior supervisors (mean age 43 years) and 50% junior supervisors with a mean age of 29 years.
With the PHEEM instrument having 40 items in its inventory the scree plot inflexion point is considered an acceptable way to establish the number of factors . The solutions with large number of factors had many factors with fewer than three items with loadings > 0.5.
A one–factor solution was evaluated and 33% of total variance could be explained by this solution. The three–factor solution had all factors having at least three items each with a loading of > 4. Four items had loadings that were < 0.4. Factor one included the majority of items originally allocated to the teaching subscale (13 out of 21 items). The rest of the items came from the original role autonomy subscale (6 out of 21) and from the social support sub-scale (2 out of 21). The items allocated to factor two belonged to the perceptions of teaching subscale (4 out of 11), social support (2 out of 11) and the largest number from the perceptions of role autonomy (5 out of 11). The third factor included items from the original role autonomy (2 out of 7) and social support subscales (5 out of 7).
PHEEM scores with Cronbach’s alpha results for Intern and Supervisor groups
The means, standard deviations, Cronbach’s alpha and p-values for the overall and subscale PHEEM scores for interns and their supervisors
Interns n = 209
Supervisors n = 60
Overall PHEEM score
Role autonomy subscale
Social Support Subscale
Comparison of intern and supervisor perceptions of the learning environment
Subsequent analysis was based on the original subscales and not those from the factor analysis. The means and the standard deviations were calculated for each item and their overall and subscale means were compared.
There was a significant difference in the overall scores between the interns and the supervisors with the supervisors perceiving the learning environment more positively. The means of the interns sub-scores for the perceptions of teaching and autonomy was significantly lower than their supervisors.
Ranking of key items where interns and supervisors significantly differ in perceptions
Key items where the differences between interns and supervisors was significanta (based on % Interns who disagree b with PHEEM item statement “highest to lowest”)
% Disagree: interns
% Disagree: supervisors
My hours on duty including my overtime hours conform with the Labour laws of South Africa
There is a no-blame culture in paediatric internship
My workload is this job is fine
I get regular feedback from seniors
There is racism in this job
I have to perform inappropriate tasks
I had good clinical supervision at all times
I have the opportunity to provide continuity of care
There is access to an educational programme relevant to my needs
There is gender discrimination in this job
My clinical teachers promote an atmosphere of mutual respect
I am bleeped(called) inappropriately in paediatrics
The key items accounting for differences between interns and supervisors in the Teaching sub-scale related to lack of feedback from seniors, clinical supervision, and access to appropriate educational programmes.
The key items accounting for differences between interns and supervisors in the Autonomy sub-scale related to perceptions of overtime hours done, amount of workload, performing inappropriate tasks, lack of continuity of care, and lack of mutual respect. The key items accounting for differences between interns and supervisors in the Social Support sub-scale related to lack of a ‘no-blame’ culture, presence of racism and gender discrimination.
The PHEEM instrument was validated within a high disease burdened context in SA with significant differences being noted in how interns and their supervisors perceived the LE in this context. The interns sampled adequately reflected their distribution across various hospitals and the response rate was in keeping with similar surveys that utilized PHEEM elsewhere [22, 23, 26].
The modified PHEEM used established a good internal consistency as reflected by a high Cronbach’s alpha value. The overall reliability was good particularly for the teaching subscale across both intern and supervisors’ surveys and the high value was similar to that found in other studies [28, 34]. The high Cronbach’s alpha however suggests that one underlying construct seen as the ‘overall educational environment’ is being reliably measured using the modified PHEEM in this setting [17, 22].
When comparing the factor analysis performed to the existing scales of the original instrument, the correspondence was not a clear fit. The teaching subscale performed much better than the other two scales. Whilst there was less of a clear fit with the original role autonomy and social support sub-scales, the second factor dealt mainly with the contractual and governance aspects of internship, orientation, contracts on work hours, type of tasks and responsibility. This seemed to corroborate with the original role autonomy scale of the original instrument. The third factor related loosely for support of the intern indicated by items relating to accommodation, safety, career advice, and support of ‘at risk’ interns. This factor can be seen to corroborate with the original subscale on social support. Some studies indicate the uni-dimensionality of the PHEEM scale [17, 34, 35] whilst others support its multi-dimensionality [22, 28]. In a demographically divergent intern group in SA, across different hospitals, the PHEEM did not clearly perform as a multidimensional tool. Further enquiry into how these individual characteristics of interns may affect differing perceptions of the LE and the use of the PHEEM is needed in the SA context.
The use of the PHEEM tool with the three original subscales has been noted to be convenient for summarising and comparing results [22, 28]. Using the interpretation proposed by the developers of the original PHEEM, interns across the four sampled hospital complexes perceived the LE in paediatrics as more positive than negative however with ‘room for improvement’ being noted . This finding is similar to evaluations conducted internationally [22, 26, 28, 33, 36–38]. This finding also resonates with various studies in other provinces in SA, indicating reasonable adequacy in how internship prepares interns for later practice with significant challenges still being noted [39–42].
Issues to be addressed
The three major challenges noted included issues related to infrastructure and institutional management; work-load issues and issues relating to the quality of supervision. Institutional infrastructural challenges for interns related mainly to poor catering and accommodation. Whilst international PHEEM evaluations from well-resourced countries highlighted similar issues with catering and accommodation [36, 43], in the SA context this challenge in institutional management has been associated with the overall poor governance of public hospitals. This issue has been shown to greatly add to demotivation among interns [44, 45].
Over a third of the intern respondents indicated that they felt the workload, working hours and type of tasks as excessive or inappropriate for interns in paediatrics. An excessive workload and work hours posed major challenges to SA interns and has been shown to infringe on labor laws . Excessive work hours and workload are well documented as major contributors of high levels of stress and burnout in junior doctors in SA [8–10]. Adherence to existing legislative frameworks need to be applied urgently to ensure that excessive work hours do not compromise the safety, health and occupational functioning of interns or patients. Oversight by accreditation bodies is required to ensure that these frameworks are adhered to. The third cause for concern in the teaching and learning environment is related to the adequacy of mentoring and supervision during internship. More than a quarter of interns indicated the presence of a ‘blame culture’ in paediatrics and insufficient feedback especially for ‘at risk’ interns. A lack of dedicated education time, inadequate guidance and career advice was also noted. An additional concern, noted by nearly a quarter of interns, related to a perceived culture of racism and gender discrimination in the LE. This is of significance noting the rapid changes in the demographic composition of SA’s newly qualified interns.
Of further concern however was the differences in perceptions on many of these issues between interns and supervisors. The significant differences found between the overall PHEEM and subscales scores relating to teaching and role autonomy between interns and their supervisors clearly points to this mismatch.
While supervisors recognize deficiencies in infrastructural challenges that concur with intern’s perceptions, aspects related to teaching and working, seem to differ. A clear understanding of roles and responsibilities needs to be identified and consensus must be developed between interns and supervisors related to working and learning. This process needs to commence at orientation programs and through the training period for both interns and supervisors. It is likely that perceptions of supervision are influenced by the experiences of busy, inadequately trained and poorly motivated supervisors . The disconnect between interns and their supervisors reflect sub-optimal supervision with poor communication, inadequate mentoring with lack of quality assessment practices being in place. Our findings corroborate that of various other studies on internship in SA which call into question the quality and quantity of direct supervision and on-going assessment by adequately trained staff [47, 48]. Improving supervision and assessment has been noted to be a major factor that can improve internship in S.A . These issues of’ work versus learning and the attitude of supervisors and their expected roles as ‘evaluators and coaches’ have been highlighted as the major tensions of internship . In SA this underlying tension must also be contextualized in the rapidly changing demography of recently qualified medical students in comparison with the supervisor cohort and this need to be examined further as a potential reason for this schism . Discrepancies between the supervisors’ and interns’ perceptions of the learning environment could also be explained by the difference concerning the views of trainers and trainees of the ideal training environment [17, 28]. Understanding the expectations of interns in achieving expected competencies and the role of assessment towards these ends, needs to be defined and evaluated in the SA context. The discrepant perceptions among supervisors and interns of the same LE indicates a need to improve our understanding of the ‘community of practice’ (COP) within the internship setting . Further research and more qualitative insight into this ‘community of practice’ during internship will likely improve our understanding and is required especially in high disease burdened and resource constrained contexts.
The dissemination of regular evaluations of the LE using validated, standardized tools such as the PHEEM, to the accrediting bodies (HPCSA), health departments and directly to intern supervisors to ensure informed feedback can occur can serve as a means monitoring, comparing and improving the training of interns across hospitals and disciplines.
While the PHEEM was developed mainly to assess the educational environment of postgraduate students in hospital settings that is especially residents, various authors have reported on its use with interns [22–26]. It is unlikely that the factor structure would differ substantially between interns and postgraduates given the similarity of the workplace .
The interns were sampled only in one province and the study was not replicated in other provinces to compare how a moderate or inadequate supply of resources impacted on the LE. We are however confident that the KZN province closely represents the South African situation with its high disease burden and resource poor regional public hospitals.
The intern response rate was 69% and could have been higher if further sampling occurred with interns who were on leave or had to attend to on call duties at the time of the survey.
Our assessment focused only on the domain of paediatrics but it did so across different hospital complexes and across two cities in KZN. Significant differences in the educational environment between different specialties and hospitals have been noted possibly indicating the importance of the general climate at the training hospital and the internal climate within each department as having a significant effect on the quality of the educational environment .
This study demonstrated that the PHEEM had good internal consistency and thus serves as a valid tool to assess the learning environment of interns in a high disease-burdened context like KZN, SA.
While paediatric interns in KZN perceived the learning environment as satisfactory, significant obstacles were observed in the development of an ideal learning environment. Poor infrastructural support at institutional level, excessive patient loads, excessive work hours and sub-optimal supervisor interaction for mentoring and ongoing assessment impacted on the notion of an ideal learning environment. These factors have been implicated as major contributors for high stress and burnout among interns in SA and need to be urgently reviewed. The significant differences observed in the perceptions of the learning environment between interns and their supervisor’s requires further insight into this relationship.
The authors would like to express their gratitude to the interns and intern supervisors in KwaZulu–Natal hospitals who participated in this study, Dr. Petra Gaylard (DMSA) for assistance with the statistical analyses and Mrs. Leora Sewnarain for assistance with typesetting and formatting.
MEPI Funding: This publication was made possible by grant number: R24TW008863 from the Office of the U.S. Global AIDS Coordinator and the U. S. Department of Health and Human Services, National Institutes of Health (NIH OAR and NIH ORWH). “Its contents are solely the responsibility of the authors and do not necessarily represent the official views of the government”.
Availability of data and materials
The datasets used and analysed during the current study are available from the corresponding author on reasonable request.
KLN was responsible for study design, data collection, data analysis and drafting the manuscript. JVW was responsible for supervision of the entire work, study design and manuscript review. MA was responsible for supervision of the entire work and manuscript review. All authors read and approved the final manuscript.
Dr. KL Naidoo is a Paediatrician involved with the training of undergraduate students, medical interns, and postgraduate registrars. His research interests include Paediatric HIV disease as well as work-based learning of Paediatric doctors.
Dr. J Van Wyk has a PhD in Education and is involved with developing pedagogical capacity among health professions faculty. Her research interests relate to advancing health professions education in the sub-Saharan African region.
Professor M Adhikari, Emeritus Professor Paediatrics is currently the Advisor to the Postgraduate Office in the school of Clinical Medicine UKZN.
Ethics approval and consent to participate
The Biomedical Research Ethics Committee (BREC) of the University of KwaZulu Natal approved the research (BE177/15).
All participants provided written, informed consent to participate in this study.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Chopra M, Daviaud E, Pattinson R, Fonn S, Lawn J. Saving the lives of South Africa’s mothers, babies, and children: can the health system deliver? Lancet. 2009;374:835–46. Available from: https://doi.org/10.1016/s0140-6736(09)61123-5 View ArticleGoogle Scholar
- World Health Organisation. Transformative scale up of health professional education. An effort to increase the numbers of health professionals and to strengthen their impact on population health. 2009. http://www.who.int/hrh/resources/transformative_education/en/. Accessed 05 Jan 2017.
- Kerber KJ, Lawn JE, Johnson LF, Mahy M, Dorrington RE, Phillips H, et al. South African child deaths 1990–2011. AIDS [Internet]. Ovid Technologies (Wolters Kluwer Health). 2013;27(16):2637–2648. Available from: https://doi.org/10.1097/01.aids.0000432987.53271.40 .
- Pattinson RC. Saving babies 2010–2011: eighth report on perinatal care in South Africa. Pretoria: Tshepesa Press; 2013. Available from:https://www.ppip.co.za/wp-content/uploads/Saving-Babies-2010-2011.pdf. Accessed on 05 Jan 2017Google Scholar
- Frenk J, Chen L, Bhutta ZA, Cohen J, Crisp N, Evans T, et al. Health professionals for a new century: transforming education to strengthen health systems in an interdependent world. Lancet [Internet]. Elsevier BV. 2010;376(9756):1923–1958. Available from: https://doi.org/10.1016/s0140-6736(10)61854-5 .
- Greysen SR, Dovlo D, Olapade-Olaopa EO, Jacobs M, Sewankambo N, Mullan F. Medical education in sub-Saharan Africa: a literature review. Med Educ [Internet]. Wiley-Blackwell; 2011;45(10):973–986. Available from: https://doi.org/10.1111/j.1365-2923.2011.04039.x .
- Mullan F, Frehywot S, Omaswa F, Buch E, Chen C, Greysen SR, et al. Medical schools in sub-Saharan Africa. Lancet [Internet]. Elsevier BV. 2011;377(9771):1113–1121. Available from: https://doi.org/10.1016/s0140-6736(10)61961-7 .
- Sun GR, Saloojee H, Jansen van Rensburg M, Manning D. Stress during internship at three Johannesburg hospitals. SAMJ. 2008;98:33–5.Google Scholar
- Stodel JM, Stewart-Smith A. The influence of burnout on skills retention of junior doctors at Red Cross War Memorial Children’s Hospital: A case study. S Afr Med J [Internet]. Health and Medical Publishing Group. 2011;101(2):115. Available from: https://doi.org/10.7196/samj.4431 .
- Bateman C. System burning out our doctors – study. S Afr Med J [Internet]. Health and Medical Publishing Group. 2012;102(7):593. Available from: https://doi.org/10.7196/samj.6040 .
- Rossouw L, Seedat S, Emsley R, Suliman S, Hagemeister D. The prevalence of burnout and depression in medical doctors working in the Cape Town Metropolitan Municipality community healthcare clinics and district hospitals of the Provincial Government of the Western Cape: a cross-sectional study. South Afr Fam Pract [Internet]. Informa UK Limited. 2013;55(6):567–73. Available from: https://doi.org/10.1080/20786204.2013.10874418
- Wall D, Clapham M, Riquelme A, Vieira J, Cartmill R, Aspegren K, et al. Is PHEEM a multi-dimensional instrument? An international perspective. Med Teach [Internet]. Informa UK Limited. 2009;31(11):e521–e527. Available from: https://doi.org/10.3109/01421590903095528
- Mohanna K, Cottrell E, Wall D, Chambers R. Teaching made easy. A manual for health professionals. 1st ed. Boca Raton: CRC Press; 2016.Google Scholar
- Schönrock-Adema J, Heijne-Penninga M, van Hell EA, Cohen-Schotanus J. Necessary steps in factor analysis: Enhancing validation studies of educational instruments. The PHEEM applied to clerks as an example. Med Teach [Internet]. Informa UK Limited. 2009;31(6):e226–e232. Available from: https://doi.org/10.1080/01421590802516756 .
- Hutchinson L. ABC of learning and teaching: educational environment. BMJ [Internet]. BMJ; 2003;326(7393):810–812. Available from: https://doi.org/10.1136/bmj.326.7393.810 .
- Könings KD, Brand-Gruwel S, Merriënboer JJG. Towards more powerful learning environments through combining the perspectives of designers, teachers, and students. Br J Educ Psychol [Internet]. Wiley-Blackwell. 2005;75(4):645–660. Available from: https://doi.org/10.1348/000709905x43616 .
- Boor K, Scheele F, van der Vleuten CPM, Scherpbier AJJA, Teunissen PW, Sijtsma K. Psychometric properties of an instrument to measure the clinical learning environment. Med Educ [Internet]. Wiley-Blackwell. 2007;41(1):92–99. Available from: https://doi.org/10.1111/j.1365-2929.2006.02651.x .
- Tokuda Y, Goto E, Otaki J, Jacobs J, Omata F, Shapiro M, et al. Educational environment of university and non-university hospitals in Japan. Int J Med Educ [Internet]. International Journal of Medical Education; 2010;1:10–14. Available from: https://doi.org/10.5116/ijme.4ba1.4034 .
- Roff S, McAleer S, Skinner A. Development and validation of an instrument to measure the postgraduate clinical learning and teaching educational environment for hospital-based junior doctors in the UK. Med Teach [Internet]. Informa UK Limited. 2005;27(4):326–31. Available from: https://doi.org/10.1080/01421590500150874 .
- Soemantri D, Herrera C, Riquelme A. Measuring the educational environment in health professions studies: A systematic review. Med Teach [Internet]. Informa UK Limited. 2010;32(12):947–52. Available from: https://doi.org/10.3109/01421591003686229 .
- Chan CYW, Sum MY, Lim WS, Chew NWM, Samarasekera DD, Sim K. Adoption and correlates of Postgraduate Hospital Educational Environment Measure (PHEEM) in the evaluation of learning environments – A systematic review*. Med Teach [Internet]. Informa UK Limited. 2016;38(12):1248–55. Available from: https://doi.org/10.1080/0142159x.2016.1210108
- Aspegren K, Bastholt L, Bested KM, Bonnesen T, Ejlersen E, Fog I, et al. Validation of the PHEEM instrument in a Danish hospital setting. Med Teach [Internet]. Informa UK Limited. 2007;29(5):504–6. Available from: https://doi.org/10.1080/01421590701477357 .
- Riquelme A, Herrera C, Aranis C, Oporto J, Padilla O. Psychometric analyses and internal consistency of the PHEEM questionnaire to measure the clinical learning environment in the clerkship of a Medical School in Chile. Med Teach [Internet]. Informa UK Limited. 2009;31(6):e221–e225. Available from: https://doi.org/10.1080/01421590902866226.
- Algaidi SA. Assessment of Educational Environment for Interns Using Postgraduate Hospital Educational Environment Measure (PHEEM) “Arabic abstracts”. J Taibah Univ Med Sci [Internet]. Elsevier BV. 2010;5(1):A1. Available from: https://doi.org/10.1016/s1658-3612(10)70126-8 .
- Gough J, Bullen M, Donath S. PHEEM “Downunder”. Med Teach [Internet]. Informa UK Limited. 2010;32(2):161–3. Available from: https://doi.org/10.3109/01421590903509036 .
- Flaherty GT, Connolly R, O’Brien T. Measurement of the Postgraduate Educational Environment of Junior Doctors Training in Medicine at an Irish University Teaching Hospital. Ir J Med Sci [Internet]. Springer Nature; 2015;185(3):565–571. Available from: https://doi.org/10.1007/s11845-015-1303-8 .
- Genn JM. AMEE Medical Education Guide No. 23 (Part 1): Curriculum, environment, climate, quality and change in medical education–a unifying perspective. Med Teach [Internet]. Informa UK Limited. 2001;23(4):337–44. Available from: https://doi.org/10.1080/01421590120063330
- Clapham M, Wall D, Batchelor A. Educational environment in intensive care medicine—use of Postgraduate Hospital Educational Environment Measure (PHEEM). Med Teach [Internet]. Informa UK Limited. 2007;29(6):e184–e191. Available from: https://doi.org/10.1080/01421590701288580 .
- Medical and Dental Professions Board, Health Professions Council of South Africa, Handbook on Internship Training. Guidelines for interns, accredited facilities and health authorities. Pretoria: HPCSA, 2016. Available from: http://www.hpcsa-blogs.co.za/wp-content/uploads/2017/04/2017-IN-Handbook-Part-I-and-II.pdf Accessed on 19 Sep 2017.
- Mckerrow N. Intern statistics from Chief Provincial Paediatrician, KwaZulu-Natal Department of Health [online]. E-mail to Dr Kimesh Naidoo (firstname.lastname@example.org ) Oct 2015 [cited 19 Sep 2017].Google Scholar
- Hair JF. Multivariate data analysis with readings. Englewood cliff. 1st ed. Boston, MA: Butterworth Heinemann; 2000. p. 167–82.Google Scholar
- Faul F, Erdfelder E, Lang A-G, Buchner A. G*power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods [Internet]. Springer Nature; 2007;39(2):175–191. Available from: https://doi.org/10.3758/bf03193146 .
- Lucas M, Samarage D. Trainees’ perception of the clinical learning environment in the postgraduate training programme in paediatrics. Sri Lanka J Child Health [Internet]. Sri Lanka Journals Online (JOL). 2008;37(3). Available from: https://doi.org/10.4038/sljch.v37i3.105 .
- Koutsogiannou P, Dimoliatis IDK, Mavridis D, Bellos S, Karathanos V, Jelastopulu E. Validation of the Postgraduate Hospital Educational Environment Measure (PHEEM) in a sample of 731 Greek residents. BMC Res Notes [Internet]. Springer Nature. 2015;8(1). Available from: https://doi.org/10.1186/s13104-015-1720-9
- Vieira JE. The postgraduate hospital educational environment measure (PHEEM) questionnaire identifies quality of instruction as a key factor predicting academic achievement. Clinics [Internet]. FapUNIFESP (SciELO). 2008;63(6). Available from: https://doi.org/10.1590/s1807-59322008000600006 .
- Pinnock R, Reed P, Wright M. The learning environment of paediatric trainees in New Zealand. J Paediatr Child Health [Internet]. Wiley-Blackwell; 2009;45(9):529–534. Available from: https://doi.org/10.1111/j.1440-1754.2009.01553.x .
- Jalili M, Mortaz Hejri S, Ghalandari M, Moradi-Lakeh M, Mirzazadeh A, Roff S. Validating modified PHEEM questionnaire for measuring educational environment in academic emergency departments. Arch Iran Med. 2014 17(5):372-377. doi:0141705/AIM.0012.Google Scholar
- Hashim R, Qamar K, Zuhra FT, Ali S. Postgraduate students’ perception of educational environment at army medical college, Rawalpindi: assessment by PHEEM (post graduate education environment measure). PAFMJ. 2015;65(3):405–9.Google Scholar
- Jaschinski J, De Villiers M. Factors influencing the development of practical skills of interns working in regional hospitals of the Western Cape province of South Africa. South Afr Fam Pract [Internet]. Informa UK Limited. 2008;50(1):70–70d. Available from: https://doi.org/10.1080/20786204.2008.10873676 .
- Burch V, Van Heerden B. Are community service doctors equipped to address priority health needs in South Africa? S Afr Med J [Internet]. Health and Medical Publishing Group. 2013;103(12):905. Available from: https://doi.org/10.7196/samj.7198.
- Nkabinde TC, Ross A, Reid S, Nkwanyana NM. Internship training adequately prepares south African medical graduates for community service – with exceptions. S Afr Med J [Internet]. Health and Medical Publishing Group; 2013;103(12):930. Available from: https://doi.org/10.7196/samj.6702 .
- Blitz J, Kok N, Van Heerden B, Van Schalkwyk S. PIQUE-ing an interest in curriculum renewal. Afr J Health Prof Educ 6(1):23-27. Available from: doi:https://doi.org/10.7196/AJHPE.318.
- Al-Asnag MA, Jan MMS. Influence of the clinical rotation on intern attitudes toward pediatrics. Clin Pediatr [Internet]. SAGE Publications. 2002;41(7):509–14. Available from: https://doi.org/10.1177/000992280204100708 .
- Tumbo J, Sein NN. Determinants of effective medical intern training at a training hospital in north West Province, South Africa. Afr J Health Prof Educ [Internet]. Health and Medical Publishing Group. 2012;4(1). Available from: https://doi.org/10.7196/ajhpe.100.
- Ibeziako O, Chabikuli O, Olorunju S. Hospital reform and staff morale in South Africa: a case study of Dr Yusuf Dadoo hospital. South Afr Fam Pract [Internet]. Informa UK Limited. 2013;55(2):180–5. Available from: https://doi.org/10.1080/20786204.2013.10874330 .
- Erasmus N. Slaves of the state – medical internship and community service in South Africa. S Afr Med J [Internet]. Health and Medical Publishing Group. 2012;102(8):655. Available from: https://doi.org/10.7196/samj.5987.
- Bola S, Trollip E, Parkinson F. The state of south African internships: a national survey against HPCSA guidelines. S Afr Med J [Internet]. Health and Medical Publishing Group. 2015;105(7):535. Available from: https://doi.org/10.7196/samjnew.7923 .
- Lamacraft G, Kenny P, Diedericks B, Joubert G. Training and experience of doctors administering obstetric anaesthesia in the free state level 1 and 2 hospitals. South Afr J Anaesth Analg [Internet]. Informa UK Limited. 2008;14(2):13–7. Available from: https://doi.org/10.1080/22201173.2008.10872540 .
- Deketelaere A, Kelchtermans G, Struyf E, De Leyn P. Disentangling clinical learning experiences: an exploratory study on the dynamic tensions in internship. Med Educ [Internet]. Wiley-Blackwell. 2006;40(9):908–915. Available from: https://doi.org/10.1111/j.1365-2929.2006.02551.x.
- Van der Merwe LJ, Van Zyl GJ, St Clair Gibson A, Viljoen M, Iputo JE, Mammen M, et al. South African medical schools: current state of selection criteria and medical students’ demographic profile. S Afr Med J [Internet]. Health and Medical Publishing Group; 2015;106(1):76. Available from: https://doi.org/10.7196/samj.2016.v106i1.9913 .
- Lave J, Wenger E. Legitimate Peripheral Participation in Communities of Practice. Situated Learn [Internet]. Cambridge University Press; 89–118. Available from: https://doi.org/10.1017/cbo9780511815355.006