The national portfolio of learning for postgraduate family medicine training in South Africa: experiences of registrars and supervisors in clinical practice
© Jenkins et al.; licensee BioMed Central Ltd. 2013
Received: 17 April 2013
Accepted: 31 October 2013
Published: 8 November 2013
In South Africa the submission of a portfolio of learning has become a national requirement for assessment of family medicine training. A national portfolio has been developed, validated and implemented. The aim of this study was to explore registrars’ and supervisors’ experience regarding the portfolio’s educational impact, acceptability, and perceived usefulness for assessment of competence.
Semi-structured interviews were conducted with 17 purposively selected registrars and supervisors from all eight South African training programmes.
The portfolio primarily had an educational impact through making explicit the expectations of registrars and supervisors in the workplace. This impact was tempered by a lack of engagement in the process by registrars and supervisors who also lacked essential skills in reflection, feedback and assessment. The acceptability of the portfolio was limited by service delivery demands, incongruence between the clinical context and educational requirements, design of the logbook and easy availability of the associated tools. The use of the portfolio for formative assessment was strongly supported and appreciated, but was not always happening and in some cases registrars had even organised peer assessment. Respondents were unclear as to how the portfolio would be used for summative assessment.
The learning portfolio had a significant educational impact in shaping work-place based supervision and training and providing formative assessment. Its acceptability and usefulness as a learning tool should increase over time as supervisors and registrars become more competent in its use. There is a need to clarify how it will be used in summative assessment.
KeywordsPortfolio Family medicine Postgraduate Adult learning Work-based Supervision Service pressure
South Africa has seen major advances in healthcare to address its quadruple burden of disease; namely HIV and tuberculosis; non-communicable chronic diseases; injury and violence; and maternal, neonatal and child health . The national plan for re-engineering primary health care (PHC) emphasizes the central role of the family physician as a clinical leader in the district health team. The planned national health insurance scheme needs a massive scaling up of the numbers of doctors [2, 3]. South Africa was short of 80 000 health care professionals in 2008 . The challenge of training and keeping sufficient numbers of competent doctors in all 52 health districts is influenced by multiple factors, including career choices, job satisfaction, career advancement, work conditions, and educational opportunities [4, 5]. The importance of social accountability requires that education and training of health professionals must be aligned with the health needs of the country . The national human resource policy aims for 900 family physicians by 2020, which will require a doubling of the number of registrars in training from 2014 .
While workplace-based assessment (WPBA) has been discussed in educational policy in South Africa for the last 20 years, most postgraduate programmes still examine their registrars away from the PHC and district context, usually in simulated environments at the university [12, 13]. Worldwide, the growing interest in quality improvement and increasing demands for social accountability have shifted the focus of assessment from the university to the work place [14–16]. WPBA typically involves the use of tools for direct observation of patient encounters or procedures, 360-degrees peer review, and significant event analysis [14, 17].
Portfolio-based learning as part of registrar’s WPBA encapsulates many aspects of competency-based assessment and has been introduced in many countries and disciplines in the last 20 years . We can define the portfolio as “a collection of material made by a professional that records and reflects on key events and processes in that professional’s career” . Many purposes for keeping a portfolio exist, which must be made explicit to both the registrars and their supervisors [18, 20]. Depending on the purpose, the portfolio’s content could range from a logbook-type enumeration of skills performed to a personal journal with evidence of deep reflection. It could be for personal or professional development, for curriculum requirements or to satisfy external agencies, such as the College of Family Physicians.
The portfolio needs to go beyond being just a collection of achievements and demonstrate reflective understanding of how and why these achievements contributed to personal and professional growth. In other words, reflective learning, as part of lifelong learning, embedded in everyday professional practice, is an integral part of the portfolio [21, 22]. Attaining this deeper level of reflection on learning is not supported by the pedagogic framework of teacher-centred (as opposed to learner-centred) education people grew up with, or by the service delivery workload which squeezes out time to reflect in- or on-action . The process of reflection itself requires engagement in critical self-awareness, with skills needed in mindful practice [24, 25]. Therefore the creation of an ideal portfolio constitutes a shift in one’s educational paradigm, which must be achieved in addition to understanding the portfolio requirements. For this type of learning to happen as part of the process of keeping a portfolio, the registrar needs support from a skilled supervisor, who understands reflective learning .
Since the 1970s adult learning, or andragogy, introduced the concepts of self-directed learning, accumulated experience as a resource for learning, and problem-based, real world learning . Experiential learning describes how registrars learn from having a particular experience, reflecting on that experience, developing abstract conceptualisations and then testing these in a new situation . Facilitating such experiential learning should be an extension of everyday life, and as valid as other forms of learning . This form of deep learning, as opposed to lecture style didactic surface learning, assumes intrinsically motivated registrars, actively involved in their own learning, exploring their thinking in learning conversations with supervisors and others [28–30].
Effectively manage him/herself, his/her team and his/her practice, in any sector, with visionary leadership and self-awareness, in order to ensure the provision of high-quality, evidence-based care
Evaluate and manage patients with both undifferentiated and more specific problems cost-effectively according to the bio-psycho-social approach
Facilitate the health and quality of life of the family and community
Facilitate the learning of others regarding the discipline of family medicine, primary health care, and other health-related matters
Conduct all aspects of health care in an ethical and professional manner
Introduction and purpose of the portfolio
Learning outcomes expected
Learning plans, reflections on rotations and supervisor reports
Direct observations of consultations, procedures, and teaching events
Emergency medicine training certification
Additional courses and conferences
The portfolio grade can count towards the university’s assessment of clinical family medicine in the Masters programme.
A satisfactory completed portfolio over three years is mandatory for the national College exit examinations.
It encourages the registrars to regularly reflect on and document their learning, prompts the learning process, and through changed behaviour leads to better patient care, and a habit of lifelong learning and reflection.
The portfolio was recently introduced at a national level in South Africa, and still fits like “new shoes” which must be worn in [37, 38]. While much has been written on using portfolios in postgraduate training and assessment, the practical use of portfolios, particularly in South Africa, is still not well understood. The aim of this study was to explore the views of registrars and supervisors regarding the portfolio’s educational impact, acceptability, and perceived usefulness for assessment of competence.
This was a prospective, descriptive study, using qualitative semi-structured interviews with key informants.
The study was carried out in compliance with the Helsinki Declaration and approved by the Health Research Ethics Committee of the University of Stellenbosch, with reference number N09/10/258.
The eight medical schools in South Africa each have a postgraduate family medicine training programme, offered at a Master’s level (MMed), over 4 years. Various combinations of clinical rotations exist in PHC, district hospitals, and specialist departments in regional hospitals. The registrars work under direct supervision of either family physician consultants or specialists in the regional hospitals. Supervisors and most programme managers also do clinical work. With the recognition of the specialty of Family Medicine in 2007, the College of Family Physicians has introduced a unitary exit examination for family medicine training in the country. A satisfactory portfolio of learning over three years is required for their Fellowship of the College of Family Physicians [FCFP (SA)]. National consensus was reached in 2010 on the content and construct validity of the portfolio and a draft national portfolio implemented . After a national survey to obtain feedback on the portfolio it was further refined and the final portfolio is now the standard in all eight programmes [36, 39].
Researchers’ relationship to the topic
Taking a reflexive stance, we need to give a brief explanation of how the researchers are positioned contextually in relation to this research . The first author (LJ) has been working in clinical practice for 20 years. He is a family physician supervisor of registrars in training and the training complex co-ordinator for the George training complex under Stellenbosch University. He is therefore immersed in the everyday issues of clinical work, training, learning, and assessment of registrars. The second author (BM) is currently the Head of the Division of Family Medicine and Primary Care at Stellenbosch University and is responsible for the final approval of portfolios for entry to the FCFP (SA) national exam. He previously developed the postgraduate training programme at Stellenbosch University and the previous logbook, aspects of which were incorporated into the portfolio. He has a strong background in qualitative research and has published extensively in this area [41–45]. Until recently he was a full time family physician working and teaching in clinical practice in South Africa. The third author (AD), from Belgium, brings an external European perspective to the study and helped to make explicit the differences between clinical learning and assessment in the South African context versus the European context. He has extensive experience in using portfolios in the workplace and is an academic and practicing family physician. He is also familiar with the local context through his involvement over several years in a project to develop family medicine education in South Africa that was funded by the Flanders Interuniversity Council [46, 47]. This is the third article, in a series looking at the development of the family medicine learning portfolio in South Africa, by all three authors.
Study population and sampling
Family physician supervisor
Telephonic in-depth interviews lasting 30-60 minutes were conducted by the principal investigator. We used an interview guide (see supplementary files) to conduct the interviews and the topics to be explored were selected from the literature review and our own previous survey of registrars’ and supervisors’ experiences . The interviews were digitally recorded and the interviewer made field notes during the interviews. The opening question was, “How are you experiencing the portfolio in your context?” In line with the study objectives the three main issues that were explored included how the portfolio contributed to learning, how its practical use could be improved, and how it could be used in assessment of competence. From these, the purpose of the portfolio, experience of its use in clinical learning, balance of work and learning, personal development, formative versus summative assessment, supervisor meetings, practicalities of secure academic time, use of portfolio tools, and ways of ensuring regular entries and progress, were discussed.
We used ATLAS.ti version 6.2.27 software and the 'framework analysis’ approach described by Ritchie and Spencer . 'Framework analysis’ is an analytical process which involves five distinct yet highly interconnected stages. These stages are: familiarization; identifying a thematic index; coding; charting; mapping and interpretation. Familiarisation with the data involved reading the transcripts in their entirety several times and checking against the audio tapes, as well as reading the field notes taken during the interviews. During this process codes began to emerge and led to the development of a thematic index. The thematic index was deductively structured according to the objectives of the study, but the codes within this structure emerged inductively from the data. Following this all the transcripts were coded according to the thematic index. The fourth stage created charts that collated together all the data on each of the three objectives. Data for supervisors and registrars was charted separately. These charts were then used for interpretation of the data in terms of the range and strength of different viewpoints and possible associations between them [48–50].
Respondent validation was enabled by giving feedback on the provisional analysis to registrars and supervisors in subsequent workshops, which involved groups of between 30 and 40 registrars and supervisors at all eight universities. During these workshops participants had the opportunity to confirm, clarify or modify the interpretation of the results. Furthermore we also presented our work to the heads of departments and programme managers, some of whom are supervisors themselves, at the eight universities.
The results are presented according to the three objectives for the study that explored the portfolio’s educational impact, acceptability and use in assessment.
Portfolio as a learning tool
“…So the registrar gets to a rotation, and then they are supposed to do the learning plan. That I think is incredibly useful, because they put what they know about the topic, what they want to learn, and how they’re going to learn it. Then I meet with them again at the middle of the rotation, and when we look at the learning plan, which they often haven’t actually done, but often they have and discussed it with the site facilitator, then we look at the reflection…” (Supervisor)
“We discuss some of the patients that come out of the portfolio, or the situations that comes from it…it becomes part of the afternoon’s discussion, because these are difficult patients, difficult scenarios. So that’s why sometimes the portfolio translates into a learning tool, which I don’t think is just documentation and evidence type tool, but also actually a learning tool.” (Supervisor)
“It becomes a learning tool, making learning (and work) easier, for example discussing difficult patient scenarios in an educational meeting.” (Supervisor)
Registrars’ personal engagement with their learning
“The portfolio is not “another project” to be handed in. Ownership sits with the registrar. It is their learning journey, their journal to keep. It should not be in the possession of faculty. It should show how the registrar is learning and developing to become the person he or she wants to be.” (Supervisor)
“…A mental note, yes. I do make lots of mental notes. We are supposed to submit our portfolios at the end of the month. It’s not up to date, because… I don’t know, I can’t blame anyone for that. I think it’s just me meaning to do that, and then you’re just tired and you forget. Then later on, maybe when it’s going to be your mid-block assessment, the mid-block, then you quickly write it up, and remember what you meant to write there. So I don’t think that one is a problem with the portfolio more than just me not being organised and on top of it…” (Registrar)
“…the people learn an incredible amount. When you talk to them you can hear this very clearly, you know it, but they don’t catch it” (Supervisor)
“Actually we are almost testing something else. It is almost something more than the portfolio. It is a person’s discipline and planning skills…” (Supervisor)
“I battle to get a reflection from them, in the portfolio. Where we do get a reflection, is during the learning conversation, but otherwise, I battle to get anything meaningful from them, that is documented in the portfolio. When you talk to (the registrars), you realize that they have actually reflected on this, but it is not structured, and they have not even realized that they have been reflecting…” (Supervisor)
“…then he said now he needs to rewrite this. Then I said no, you should not rewrite this. This is the proof of what we learnt together today, and if you hand this in like this, anyone looking at this will see there was a thorough discussion, writing and learning took place. He went and rewrote it, everything he learnt, on a clean sheet of paper, and this is not really what we want, I think…” (Supervisor)
“…yes, and the Calgary-Cambridge communication model, what is great is that I can ask someone in the clinic to quickly sit in and listen…just take this marking sheet in the portfolio and just give me a score, or even just a global score, of what you think of my consultation skills. Or you can record your own consultations, which are what I have done a few times now, and then go over them again at home and rate myself in the portfolio…” (Registrar)
“…It would have been nice to actually train under them, under family physicians who will actually apply the management that is expected of us in an everyday, on an everyday basis to patients that you have. But we don’t have models…”(Registrar)
“…so it was literally a month where it was quite a struggle to see a consultant, let alone to now get them to sit down and listen to you tell them about a patient…” (Registrar)
“…I’m enjoying surgery now because I’m with someone who really enjoys teaching, and even if you belong to his team, he doesn’t mind if you want to learn other skills. So, I suppose it depends on who you are with…” (Registrar)
The portfolio was acting as a catalyst to “…force a meeting with the supervisor…”. This was due to the requirement for reports from the supervisor, their signatures to verify entries and recording of direct observations. Registrars found the need for signatures negative. While ownership of learning and portfolio completion rests with the registrar, a theme of shared accountability with the supervisor emerged. This clearly indicated that unless the supervisor was held accountable for their role as clinical trainer in terms of regular direct observations and educational meetings, the culture of prioritising service delivery continued to overshadow learning.
Overwhelming service demands
“…we do tough work here and survival. A lot of the time they’re in survival mode, and I think that’s why Kleinman, Arthur Kleinman, he said the worst people to learn from are registrars because they’re in survival mode…” (Supervisor)
“…It’s all about service, it’s all about the number of patients you’ve seen, and filling in of forms and things like that. For instance, we are being taught assessment, we are being taught the principles of medicine, ethics and that kind of thing. We are being taught things that we are unable to actually execute when you are expected to see 40 patients, and as inexperienced as I am. So I wouldn’t be able to spend the time as I am expected to spend with a patient and in that small space of time, I must have done all those things and seen 40 patients…”(Registrar)
“…It depends on the department you are in. In theory it works because you are able to get there and say these are the outcomes, these are the things that you need when you are there. But you don’t find the same enthusiasm in all the departments, if you know what I mean. What happens is that in some departments you are seen as another workforce. As long as the department is run. As long as you do the ward work, as long as you are in theatre, that kind of thing. Do you understand what I mean? Even if your needs are not really met…” (Registrar)
“we have now always on the second Tuesday afternoon created a session, or an opportunity, a routine, that the registrar and his supervisor can meet for an hour to discuss the learning process, to talk about learning, and I think this is meaningful.” (Supervisor)
Stressful work-learn dichotomy
“…but the clinical modules that we’re busy with, we don’t necessarily come home and study that every day. We kind of come home and have to do online stuff if you’ve got an assignment due this week…” (Registrar)
“the consultation module was really very nice…you learn so much more about how to communicate with a patient, how to exchange information…I can really say that I apply it much more in my day to day working environment. Ethics was also great to do (as a module), because I had no idea about ethics. But it feels to me that it was something I had to do because it was not part of my learning plan. I think this is where it will stay…” (Registrar)
“…The log book is actually incredibly limited, but I say that’s just the core. Write down everything that you actually do, and when you go to a job and you say I’ve got a special interest in anaesthetics, show them all the more complicated anaesthetic procedures you’ve done…” (Supervisor)
Having learning tools at hand
“…it may even be, in the long run, a formative process to the other specialities. ..Exactly, exactly. You know, and we did have feedback saying gee, that really made me think of something different. That really did help, that really was helpful. So obs and gynae, I think, have been quite good with that.…” (Registrar)
“…it is also valid that you just submit your work. This is already a big step, because it provides evidence for what has been done. But the next step is to decide on the quality of that evidence…” (Supervisor)
“…it gives us a chance to touch base both with me and the site coordinator or the specialist. So it’s like three people looking at where we’re going. What’s the current situation and what’s happening.”(Supervisor)
“So that’s the mid-block assessment, and then I ask the supervisors to do an observed - no, what’s it called - a continual assessment. Often they haven’t done one up till then, but then that gives them a chance to give the registrar feedback.” (Supervisor)
“And then you might make any changes to the plan, and then at the end of the block I see them again, and then we do an exam using the observed consultation, one or two consultations. Psychiatry we only do one, but it’s 45 minutes, and another continuous assessment from the consultants.” (Supervisor)
“…The one I have had was quite helpful because it kind of forces you to look at how you were before you came to the department and how far you have come, and what more do you still have to learn. So in paediatrics for me it was very helpful, very, very helpful. I think generally it is the few who take time to do it…” (Registrar)
“We have planned to actually try and do it amongst ourselves, because we know what is expected. We know what’s expected of us in terms of holistic approach to a patient, …..so you actually just know about them during the exam, your end of block exam. It then ends up being something that you fake for them…Like if I’m on first call for instance, that is what we’ve decided on doing. If I am first call and I’m free and I can come to the clinic, so we mark each other. So there it’s the same mark sheet that is used for our exams, and then we just randomly pick a patient and then I will be the examiner and then my other colleague is my examiner as well. So that’s a habit, because at the usual clinics where we are, you don’t even get all these assessments. I don’t know, it’s the old ways that everyone is doing, and no one is supervising you…” (Registrar)
The tension between summative and formative assessment was well recognized by most participants. Considering the purpose of the portfolio, they felt that we need to develop summative assessment indicators that assess the formative aspects captured in the registrar’s portfolio of learning.
Registrars found the portfolio useful to plan and organize their learning. While the portfolio at this stage is mostly a collection of learning activities, its educational impact could be enhanced through increasing the registrar’s awareness of learning opportunities and their ability to reflect on these experiences. The portfolio has made the challenges of introducing competency-based adult learning more visible and made explicit the need for a supportive learning climate within the clinical environment [37, 51]. Critical to prioritizing learning within the pressurized clinical service was a shared accountability between the registrar and the supervisor, with registrars taking responsibility for their own learning and supervisors providing regular feedback. The need for direct observations and case-based discussions in educational meetings made regular registrar-supervisor meetings obligatory. There was a clear need for supervisors to improve their mentoring skills and for registrars to fully embrace adult learning. Service pressure made it difficult to reflect on work and document learning. Nevertheless, this demanding clinical context in which the portfolio of learning is embedded is very rich in terms of experience and can provide fertile soil from which the habit of lifelong learning can grow . This worldwide challenge is exacerbated in low and middle income countries where human resources are scarcer and workload is very high. Training programmes in this context need to anticipate this and make plans to overcome this challenge to the use of portfolios [52–54].
A review of the educational impact of portfolios concluded that “improved student-tutor relationships” was one of the main benefits, together with increased self-awareness and engagement in reflection . Introducing the portfolio may be an intervention that stimulates a shift in supervisory style from directing to guiding and from counting to reflecting. It may in fact help to create the very learning environment that it is meant to be documenting, becoming itself an agent of change. This educational relationship between the registrar and supervisor within the context of a community of practice is perhaps the most vital and difficult area to navigate . Worldwide, but particularly in low and middle income countries such as South Africa, there are too few effective supervisors who understand their role as trainers and clinical role models and who are recognized and rewarded accordingly. Good doctors do not necessarily have skills in teaching, giving feedback, or assessment . Teaching registrars involves vulnerability, relationship, honesty, trust and kindness . Incentives to encourage and reward mentors could include that mentors are kept “in the know” with developments in medicine and medical teaching, build better relationships with registrars, receive feedback themselves, and meet potential future family physician colleagues .
Within our culture of service delivery, clinicians have an established culture of documenting their clinical reasoning in patient notes. What is also needed is a culture of professional development in which clinicians capture their learning in a clear, concise, continuous way possibly using a portfolio [23, 35, 56, 57]. It was evident that self-management skills that build reflection and develop resilience are much needed for both registrars and supervisors [23, 58, 59].
The paper-based portfolio was accepted, albeit with a call for more electronic tools that are compatible with mobile devices, and eventually an electronic portfolio, similar to examples from more developed countries [35, 60, 61]. Completing a logbook in the portfolio created a particular conflict between the traditional counting of procedures performed and the need to reflect on and learn from one’s performance. Personal organization of learning, self-management and a discipline of regularly updating the portfolio were strongly supported . Observed consultations and procedures were important, but difficult to do in the workplace [52, 62]. Suggestions to make this easier included having learning tools daily at hand, regular portfolio updates, and a central coordinator who collates portfolio entries monthly and gives feedback. Regular face-to-face meetings between registrars and supervisors ensure authenticity of learning with supervisors’ signatures, the absence of which is a disadvantage in pure e-portfolio systems .
While assessment at this stage focusses on completeness, for example the number of direct observations and educational meetings, the next step is to assess the quality of learning.
There was strong support for both an end-of-rotation summative and a mid-rotation formative assessment. The shortage of supervisors has led some registrars to initiate peer-assessment. Within family medicine, as the discipline has become more established, there has been a shift to train and assess more in the district hospitals and PHC, with less exposure to regional hospital departments [4, 11]. Such a shift requires that a culture of training and assessment is initiated, valued and nurtured by both the district health services and universities.
Current forms of assessment encourage registrars to demonstrate their competence, whereas valuable learning is often based on mistakes, errors, problems and less than perfect outcomes [63, 64]. Demonstrating learning also requires evidence of a shift in competency over time from a less than adequate starting point. This has implications for how the summative assessment of the portfolio is constructed. Summative assessment of the portfolio should focus on whether these formative activities have taken place adequately. The supervisor and registrar are best able to determine the quality of learning and progress as documented in the portfolio, while the programme co-ordinator is best able to determine the completeness of all that is required. We can think of this as assessment-in and assessment-on the portfolio, not unlike reflection-in and reflection-on action .
Registrars and supervisors spoke of a 'work-learn’ dichotomy whereby they struggled to integrate the theory of best practice in terms of the consultation, ethics or evidence-based medicine into everyday work. Part of the challenges of work-based assessment is integrating course assignments with work assessment, assessing how doctors actually practice [65, 66]. As assessment drives learning, a grade and formative feedback provide measurement and meaning to work-based learning, encouraging the registrar to develop into a family physician . Indirectly a good portfolio also provides assessment and feedback on the training programme itself in the local context and can be valuable to the programme manager.
Although the use of portfolios for work-based assessment is becoming best practice internationally it needs to be tailored to the contextual realities of low resourced settings where it may be seen as an additional burden for registrars already on the edge of burnout or depression [68–70]. Unlike tertiary health centres, the district health services are not used to the demands of speciality training in South Africa. The portfolio requirements make visible the expectations on registrars and supervisors and brings into focus the need to integrate cultures of service and learning rather than allowing them to be perceived as if they are in opposition [4, 6].
This study sought to understand the experiences and opinions of registrars and supervisors who had used the portfolio in South Africa. We purposefully recruited appropriate participants who would give rich information from across South Africa to get a broad perspective of experience, representing all postgraduate programmes in the country. This meant that because of travelling distances of up to 1400 kilometres we decided on telephonic interviews. We acknowledge that telephonic interviews may have limitations compared to face-to-face interviews, for example periods of silent reflection could be more acceptable in face-to-face interviews. However, because the author was familiar with the context of the training programmes and many of the key people, he was able to engage the respondents easily and encourage them to elaborate on their answers. The interviews also lasted between 30-60 minutes, which was deemed sufficient for thorough exploration of the key topics. The results of the study as with all qualitative research cannot be easily generalised to other populations and the readers will need to decide what findings are transferable to their own context.
Continue with the national portfolio as an acceptable tool to support work-based learning and assessment.
Advocate for a culture of clinical training in the health districts, recognizing the co-benefits of service delivery and clinical learning.
Develop registrars’ and supervisors’ self-awareness and ability to reflect on and learn from their clinical experience in a structured way that can be documented.
Develop electronic tools and move towards an e-portfolio.
Focus on developing the capacity of supervisors to support adult learning in the work place and to formally recognise their role as trainer or mentor.
Allow time for new educational practice to be integrated into the work-place with a shift from traditional pedagogy to adult learning.
Develop an approach to summative assessment of the portfolio. A portfolio assessment tool will be described and evaluated in a future study.
The portfolio primarily had an educational impact through making explicit the expectations of registrars and supervisors in the workplace. This impact was tempered by a lack of engagement in the process by registrars and supervisors who also lacked essential skills in reflection, feedback and assessment. The acceptability of the portfolio was limited by service delivery demands, incongruence between the clinical context and educational requirements, design of the logbook and easy availability of the associated tools. Its acceptability and usefulness as a learning tool should increase over time as supervisors and registrars become more competent in its use. The use of the portfolio for formative assessment was strongly supported and appreciated, but was not always happening and in some cases registrars had even organised peer assessment. There is a need to clarify how it will be used in summative assessment.
Thanks to the 17 key informants, and Ms S. Simpson who transcribed the audiotapes.
- Mayosi BM, Lawn JE, van Niekerk A, Bradshaw D, Abdool Karim SS, Coovadia HM: Health in South Africa: changes and challenges since 2009. Lancet. 2012, 380: 2029-2043. 10.1016/S0140-6736(12)61814-5.View ArticleGoogle Scholar
- Pillay Y, White C, McCormick N: How times have changed-HIV and AIDS in South Africa in 2011. SAMJ: South Afr Med J. 2012, 102 (2): 77-78.Google Scholar
- Bateman C: NHI consensus: fix the existing system or risk failure. SAMJ: South Afr Med J. 2010, 100 (12): 791-793.View ArticleGoogle Scholar
- Burch V, Reid S: Fit for purpose? The appropriate education of health professionals in South Africa. S Afr Med J. 2011, 101 (1): 25-26.View ArticleGoogle Scholar
- Ogunbanjo GA: Global healthcare professional migration: a blessing or a curse?: editorial. SA Fam Pract. 2012, 54 (6): 467.Google Scholar
- Van Heerden B: Effectively addressing the health needs of South Africa’s population: the role of health professions education in the 21st century. S Afr Med J. 2013, 103 (1): 21-22.Google Scholar
- De Maeseneer J: Scaling up family medicine and primary health care in Africa: statement of the primafamed network, Victoria Falls, Zimbabwe. Afr J Prim Health Care Fam Med. 2013, 5 (1): 3.View ArticleGoogle Scholar
- Mash R, Downing R, Moosa S, De Maeseneer J: Exploring the key principles of family medicine in Sub-Saharan Africa: International Delphi consensus process. SA Fam Pract. 2008, 50 (3): 60-65.Google Scholar
- Couper ID, Mash B: Obtaining consensus on core clinical skills for training in family medicine. SA Fam Pract. 2008, 50 (6): 69-73.Google Scholar
- Couper ID, Mash B, Smith S, Schweitzer B: Outcomes for family medicine postgraduate training in South Africa. SA Fam Pract. 2012, 54 (6): 501-506.Google Scholar
- Mash B: Reflections on the development of family medicine in the Western Cape: a 15-year review. SA Fam Pract. 2011, 53 (6): 557-562.Google Scholar
- Kgobe M: The National Qualifications Framework in South Africa and“ out-of-School Youth”: problems and possibilities. Int Rev Educ. 1997, 43 (4): 317-330. 10.1023/A:1003023822453.View ArticleGoogle Scholar
- Young M: Education in retrospect: Policy and implementation since. Educational reform in South Africa (1990-2000): An international perspective. 1990, 17-39.Google Scholar
- Wilkinson JR, Crossley JGM, Wragg A, Mills P, Cowan G, Wade W: Implementing workplace‒based assessment across the medical specialties in the United Kingdom. Med Educ. 2008, 42 (4): 364-373. 10.1111/j.1365-2923.2008.03010.x.View ArticleGoogle Scholar
- Rethans JJ, Norcini J, Barón-Maldonado M, Blackmore D, Jolly B, LaDuca T, Lew S, Page G, Southgate L: The relationship between competence and performance: implications for assessing practice performance. Med Educ. 2002, 36 (10): 901-909. 10.1046/j.1365-2923.2002.01316.x.View ArticleGoogle Scholar
- Norcini JJ: Current perspectives in assessment: the assessment of performance at work. Med Educ. 2005, 39 (9): 880-889. 10.1111/j.1365-2929.2005.02182.x.View ArticleGoogle Scholar
- Norcini JJ, Blank LL, Duffy FD, Fortna GS: The mini-CEX: a method for assessing clinical skills. Ann Intern Med. 2003, 138 (6): 476-481. 10.7326/0003-4819-138-6-200303180-00012.View ArticleGoogle Scholar
- Challis M: AMEE medical education guide No. 11 (revised): portfolio-based learning and assessment in medical education. Med Teach. 1999, 21 (4): 370-386. 10.1080/01421599979310.View ArticleGoogle Scholar
- Hall D: Professional development portfolios for teachers and lecturers. J In-Service Educ. 1992, 18 (2): 81-86. 10.1080/0305763920180203.View ArticleGoogle Scholar
- Van Tartwijk J, Driessen E, Van der Vleuten C, Stokking K: Factors influencing the introduction of portfolios. Qual High Educ. 2007, 13 (1): 69-79. 10.1080/13538320701272813.View ArticleGoogle Scholar
- Koole S, Dornan T, Aper L, Scherpbier A, Valcke M, Cohen-Schotanus J, Derese A: Factors confounding the assessment of reflection: a critical review. BMC Med Educ. 2011, 11 (1): 104-10.1186/1472-6920-11-104.View ArticleGoogle Scholar
- Sandars J: The use of reflection in medical education: AMEE guide no. 44. Med Teach. 2009, 31 (8): 685-695. 10.1080/01421590903050374.View ArticleGoogle Scholar
- Schon DA: The reflective practitioner - How professionals think in action. 1983, United States of America: Basic BooksGoogle Scholar
- Epstein RM, Siegel DJ, Silberman J: Self-monitoring in clinical practice: a challenge for medical educators. J Contin Educ Health Prof. 2008, 28 (1): 5-13. 10.1002/chp.149.View ArticleGoogle Scholar
- Epstein RM: Mindful practice. JAMA. 1999, 282: 833-839. 10.1001/jama.282.9.833.View ArticleGoogle Scholar
- Knowles MSS, Holton EFF, Swanson RAA: The adult learner. 2012, USA: Routledge, 7Google Scholar
- Kolb DA: Experiential learning: Experience as the source of learning and development. 1984, NJ: Prentice-Hall Englewood CliffsGoogle Scholar
- Gibbs G: Learning to effect. Improving the quality of student learning through course design. 1992, 149-165.Google Scholar
- Marton F, Säljö R: Approaches to learning. Ex Lear. 1984, 2: 39-58.Google Scholar
- Trigwell K, Prosser M, Waterhouse F: Relations between teachers’ approaches to teaching and students’ approaches to learning. High Educ. 1999, 37 (1): 57-70. 10.1023/A:1003548313194.View ArticleGoogle Scholar
- Boud D: Reflection: Turning experience into learning. 1985, London: RoutledgeGoogle Scholar
- Van Der Vleuten CPM, Schuwirth LWT: Assessing professional competence: from methods to programmes. Med Educ. 2005, 39 (3): 309-317. 10.1111/j.1365-2929.2005.02094.x.View ArticleGoogle Scholar
- Reilly BM: Inconvenient truths about effective clinical teaching. Lancet. 2007, 370 (9588): 705-711. 10.1016/S0140-6736(07)61347-6.View ArticleGoogle Scholar
- Mash R, Goedhuys J, D’Argent F: Enhancing the educational interaction in family medicine registrar training in the clinical context. SA Fam Pract. 2010, 52 (1): 51-54.Google Scholar
- Deketelaere A, Degryse J, De Munter A, Leyn PD: Twelve tips for successful e-tutoring using electronic portfolios. Med Teach. 2009, 31 (6): 497-501. 10.1080/01421590802572734.View ArticleGoogle Scholar
- The Colleges of Medicine of South Africa. http://www.collegemedsa.ac.za/view_exam.aspx?examid=102. Last accessed 1 November 2013
- Driessen E, van Tartwijk J, van DV, Wass V: Portfolios in medical education: why do they meet with mixed success? A systematic review. Med Educ. 2007, 41 (12): 1224-1233. 10.1111/j.1365-2923.2007.02944.x.View ArticleGoogle Scholar
- Jenkins L, Mash B, Derese A: Development of a portfolio of learning for postgraduate family medicine training in South Africa: a Delphi study. BMC Fam Pract. 2012, 13 (1): 11-10.1186/1471-2296-13-11.View ArticleGoogle Scholar
- Jenkins L, Mash B, Derese A: The national portfolio for postgraduate family medicine training in South Africa: a descriptive study of acceptability, educational impact, and usefulness for assessment. BMC Med Educ. 2013, 13 (1): 101-10.1186/1472-6920-13-101.View ArticleGoogle Scholar
- Pillow W: Confession, catharsis, or cure? Rethinking the uses of reflexivity as methodological power in qualitative research. Int J Qual Stud Educ. 2003, 16 (2): 175-196. 10.1080/0951839032000060635.View ArticleGoogle Scholar
- Mash B, De Villiers M: Community-based training in Family Medicine–a different paradigm. Med Educ. 1999, 33 (10): 725-729. 10.1046/j.1365-2923.1999.00531.x.View ArticleGoogle Scholar
- De Villiers M, Bresick G, Mash B: The value of small group learning: an evaluation of an innovative CPD programme for primary care medical practitioners. Med Educ. 2003, 37 (9): 815-821. 10.1046/j.1365-2923.2003.01595.x.View ArticleGoogle Scholar
- Mash B, Marais D, Van Der Walt S, Van Deventer I, Steyn M, Labadarios D: Assessment of the quality of interaction in distance learning programmes utilizing the Internet or interactive television: perceptions of students and lecturers. Med Teach. 2006, 28 (1): e1-e9. 10.1080/01421590600568439.View ArticleGoogle Scholar
- Mash B, Mayers P, Conradie H, Orayn A, Kuiper M, Marais J: How to manage organisational change and create practice teams: experiences of a South African primary care health centre. Educ Health. 2008, 21 (2): 132.Google Scholar
- Schlemmer A, Mash B: The effects of a language barrier in a South African district hospital. S Afr Med J. 2008, 96 (10): 1084.Google Scholar
- Moosa S: Belgian lessons for FaMEC. South Afr Fam Pract. 2005, 47 (10): 3.View ArticleGoogle Scholar
- Moosa S: FaMEC strategy into the future: editorial. 2005Google Scholar
- Ritchie J, Spencer L: The qualitative researcher’s companion. Qualitative data analysis for applied policy research. 2002, 305-329.Google Scholar
- Miles MB, Huberman AM: Qualitative data analysis: An expanded sourcebook. 1994, USA: SageGoogle Scholar
- Pope C, Ziebland S, Mays N: Qualitative research in health care: analysing qualitative data. BMJ: Br Med J. 2000, 320 (7227): 114-10.1136/bmj.320.7227.114.View ArticleGoogle Scholar
- Driessen E: Are learning portfolios worth the effort? Yes. BMJ. 2008, a513-337Google Scholar
- Holmboe ES, Sherbino J, Long DM, Swing SR, Frank JR: The role of assessment in competency-based medical education. Med Teach. 2010, 32 (8): 676-682. 10.3109/0142159X.2010.500704.View ArticleGoogle Scholar
- Mikkelsen J, Holm H: Contextual learning to improve health care and patient safety. Educ Health. 2007, 20 (3): 124-127.Google Scholar
- Deketelaere A, Kelchtermans G, Struyf E, De Leyn P: Disentangling clinical learning experiences: an exploratory study on the dynamic tensions in internship. Med Educ. 2006, 40 (9): 908-915. 10.1111/j.1365-2929.2006.02551.x.View ArticleGoogle Scholar
- Buckley S, Coleman J, Davison I, Khan K, Zamora J, Malick S, Morley D, Pollard D, Ashcroft T, Popovic C: The educational effects of portfolios on undergraduate student learning: a Best Evidence Medical Education (BEME) systematic review. BEME Guide No. 11. Med Teach. 2010, 31 (4): 340.Google Scholar
- Wenger E: Systems thinker. Communities of practice: Learning as a social system. 1998View ArticleGoogle Scholar
- Rencic J: Twelve tips for teaching expertise in clinical reasoning. Med Teach. 2011, 33 (11): 887-892. 10.3109/0142159X.2011.558142.View ArticleGoogle Scholar
- Warner R, April K: Building personal resilience at work. 2012Google Scholar
- Kline N: Time to think: Cassell Illustrated. 1999Google Scholar
- Hall P, Byszewski A, Sutherland S, Stodel EJ: Developing a sustainable electronic portfolio (ePortfolio) program that fosters reflective practice and incorporates CanMEDS competencies into the undergraduate medical curriculum. Acad Med. 2012, 87 (6): 744-751. 10.1097/ACM.0b013e318253dacd.View ArticleGoogle Scholar
- Hicks T, Russo A, Autrey T, Gardner R, Kabodian A, Edington C: Rethinking the purposes and processes for designing digital portfolios. J Adolesc Adult Literacy. 2007, 50 (6): 450-458. 10.1598/JAAL.50.6.3.View ArticleGoogle Scholar
- Holmboe ES, Hawkins R: Direct observation by faculty. Practical Guide to the Evaluation of Clinical Competence. 2008, Philadelphia, Pa: Mosby-Elsevier, 110-129.Google Scholar
- Ten Cate O: Medical education: trust, competence, and the supervisor’s role in postgraduate training. BMJ. 2006, 333 (7571): 748-751. 10.1136/bmj.38938.407569.94.View ArticleGoogle Scholar
- Ten Cate O: Entrustability of professional activities and competency-bases training. Med Educ. 2005, 39: 1176-1177. 10.1111/j.1365-2929.2005.02341.x.View ArticleGoogle Scholar
- Ten Cate O, Scheele F: Viewpoint: competency-based postgraduate training: can we bridge the gap between theory and clinical practice?. Acad Med. 2007, 82 (6): 542-547. 10.1097/ACM.0b013e31805559c7.View ArticleGoogle Scholar
- Miller A, Archer J: Impact of workplace based assessment on doctors’ education and performance: a systematic review. BMJ: Br Med J. 2010, 341: c5064-10.1136/bmj.c5064.View ArticleGoogle Scholar
- Gawande A: Better: a surgeon’s notes on performance: Profile. 2007Google Scholar
- Rossouw L: The prevalence of burnout and depression among medical doctors working in the Cape Town metropole community health care clinics and district hospitals of the Provincial Government of the Western Cape: a cross-sectional study. Afr J Prim Health Care Fam Med. 2011, 3 (1): abstractGoogle Scholar
- Saedon H, Salleh S, Balakrishnan A, Imray CH, Saedon M: The role of feedback in improving the effectiveness of workplace based assessments: a systematic review. BMC Med Educ. 2012, 12 (1): 25-10.1186/1472-6920-12-25.View ArticleGoogle Scholar
- Ross S, Maclachlan A, Cleland J: Students’ attitudes towards the introduction of a personal and professional development portfolio: potential barriers and facilitators. BMC Med Educ. 2009, 9 (1): 69-10.1186/1472-6920-9-69.View ArticleGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6920/13/149/prepub
This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.