Skip to main content
Download PDF

Evaluating the internalisation of the intrinsic role of health advocacy of student pharmacists in a new integrated Bachelor of Pharmacy curriculum: a mixed-methods study

BMC Medical Education volume 23, Article number: 900 (2023) Cite this article

Abstract

To keep up with the contemporary health landscape, there is an imperative need for healthcare professionals to practise health advocacy through health promotion on the individual, population, and systems levels. In the Academic Year of 2020/2021, the National University of Singapore (NUS) Department of Pharmacy implemented a new spiral curriculum integrating basic, clinical, and systems sciences with one of its aims to deepen students’ health advocacy internalisation and prepare them as future health advocates. A mixed-methods approach was adopted. Questionnaires were disseminated across three time-points to elicit students’ levels of internalisation of health advocacy, which were then categorised into levels, and a Mann–Whitney U test was conducted. In comparison with prematriculation, no significant difference was found after students underwent the first year of the curriculum, while a significant difference was found after students underwent two years of the curriculum. Semi-structured interviews were also conducted after each Academic Year to gain deeper insights into the questionnaire results. Thematic analysis of the interviews revealed that curricular integration in the first year was perceived to be lacking. However, with learnt knowledge constantly reinforced and more experiential learning opportunities incorporated throughout the second year, students found the integrated curriculum beneficial in instilling confidence to practise health advocacy. This study offers insights into the prospects of a spiral integrated curriculum in imparting health advocacy, and may even suggest its potential to be applied to other educational settings. Future follow-up studies can also be conducted on the same study population to evaluate long-term impacts and areas for improvement of the curriculum.

Peer Review reports

Introduction

Health goes beyond healthcare, with most health problems stemming from upstream factors, including housing [1], education and diet [2]. Thus, it has become increasingly imperative to consider upstream social determinants of health together with downstream medical problems [3].

These rapidly evolving public health needs have been paralleled by an expansion of healthcare professionals’ roles to include the practice of health advocacy [4]. This involves promoting the health of individuals or populations, such as advocating for equal healthcare and reviewing health policies and institutional practices to reduce health disparities [5]. Considering its significance in providing holistic healthcare, health advocacy is now a core competency expected of healthcare professionals according to the widely adapted CanMEDS framework [6]. Pharmacists’ frequent interactions with patients render them well-positioned to advocate for health [7]. However, it remains challenging to empower pharmacists to address health disparity [8] as many believe that health advocacy is beyond their scope of practice [9].

To prepare future pharmacists to become health advocates and recognise its value, pharmacy education should holistically encompass medical concepts, clinical experience [10], and health advocacy concepts [11]. However, traditional pharmacy curricula are inadequate [12] as the public health sciences are taught independently in a separate module from the clinical sciences and experiential learning is introduced belatedly [13]. Subsequently, students fail to connect multidisciplinary concepts [14, 15]. and perceive health advocacy as a separate field from their clinical duties.

It is postulated that integrating basic, clinical, and systems sciences [11] in pharmacy curricula cultivates health advocacy by reframing the traditionally separately taught pillars into an interdependent framework [16, 17]. Integrated learning is paramount for students to extend beyond self-awareness of health advocacy, and to practise it on the individual, population, and ultimately, systems levels [18].

At the National University of Singapore (NUS) Department of Pharmacy, the longstanding curriculum was structured as a traditional block curriculum, which taught pharmaceutics, patient care, medicinal chemistry, physiological systems and other modules separately. In the Academic Year of 2020/2021 (AY20/21), the NUS Department of Pharmacy introduced an integrated, spiraled curriculum to transform the undergraduate program based on the CanMEDS framework [6], of which health advocacy is one of the competencies. Essentially, the new curriculum sought to iteratively reinforce intrinsic health advocacy concepts, allowing students to internalise its connection with various sciences. While various educational institutions worldwide have adopted integrated pharmacy curricula [19], there is a lack of evaluation of their impacts and much less on health advocacy outcomes. This study aims to address this gap by evaluating the internalisation of the intrinsic role of health advocacy after pharmacy students underwent the new integrated pharmacy curriculum at NUS.

Methods

Curriculum integration

In AY20/21, the NUS Pharmacy Class of 2024 was placed under the new integrated curriculum. Physiological systems formed the bedrock, and basic, clinical, and systems sciences were taught around it interconnectedly.

Figure 1 shows how health advocacy concepts were integrated into modules and how they spiral in increasing complexity during the first two years of the curriculum.

Fig. 1
figure 1

Health advocacy integration nodes throughout the new Bachelor of Pharmacy curriculum

Full size image

In alignment with the CanMEDS framework [6], the curriculum aimed to train students to prevent and alleviate diseases by addressing social determinants of health, encouraging healthy lifestyle habits and through close health monitoring. These should be conducted for (1) individual patients by establishing partnerships with both patients and their families, and (2) communities by addressing system-level upstream factors of health inequity through improving clinical and institutional practices. The list of competencies can be found in Additional file 1: Appendix 1.

For example, through the PR2156 Integumentary and Ocular Systems (physiological system) module in Year 1, students would become cognisant of exponentially rising healthcare costs due to increasing drug prices (basic sciences) by leveraging on the theme of efficacious yet costly biologics (systems science involving drug cost-effectiveness), which is used for psoriasis treatment (clinical science). In Year 2, the Transtheoretical Model of Change was introduced to explore individual behavioural change (basic science) during the topic of smoking cessation (systems sciences as part of health promotion activities) in asthma exacerbation prevention (clinical science) in PR2154 Respiratory Systems (physiological system).

A spiral integrated approach [20] should enhance health advocacy understanding by (1) incorporating the concept in progressive difficulty, (2) reinforcing it on multiple occasions, (3) demonstrating its relevance to real-life problem-based scenarios, and (4) increasing student interest by showcasing its application across various settings [21, 22].

Experiential learning opportunities were introduced earlier in the revised curriculum. For example, contrary to only participating in Pre-Employment Clinical Training (PECT) in Year 4 previously, students are now attached to outpatient polyclinics and exposed to interdisciplinary teamworking with other healthcare professionals in Year 2. Students were also tasked to write a short critical reflection after each PECT activity to gain meaningful insights into the social determinants of health and into how pharmacists have the potential to take charge and act against health inequity [23]. These were done concurrently during the semester with classes to connect theoretical content with its application in clinical practice.

Data collection

A qualitative, pre-post study design was conducted on the Class of 2024. A mixed-methods approach was conducted using two types of instruments – questionnaires and interviews.

Recruitment of NUS Pharmacy students for the interviews was conducted by a research assistant who has no responsibility in the design and teaching of the pharmacy curriculum. During recruitment in AY20/21 and AY21/22 respectively, an invitation email was sent out to the students to obtain voluntary informed consent to participate in the questionnaires and semi-structured interviews. Students who consented were then provided with the attached participant information sheet and consent form.

Voluntary open-ended questionnaires were disseminated across three timepoints in AY20/21 and AY21/22 (Fig. 2), while voluntary semi-structured interviews were conducted at the end of each Academic Year. The interviews explored specific topics in-depth [24, 25], and aimed to understand students’ experiences and perceptions to rationalise the results obtained from the questionnaires [26].

Fig. 2
figure 2

Instruments in the pre-post study design

Full size image

Pilot testing was not conducted for both data collection methods as the instruments utilised in the study were unambiguous and straightforward in nature. Multiple internal reviews were done to enhance the validity and clarity of the instruments. Furthermore, the participants were also assumed to be highly familiar with the topic of interest since they were directly enrolled in the new spiral integrated curriculum, hence the questions involved in the instruments would be easy for the participants to comprehend and respond to accordingly.

Data collection in AY20/21 – Year 1

The Pre-Year 1 and Post-Year 1 questionnaires were disseminated during AY20/21 Semester 1 before the start of the Academic Year and after their final examinations in Semester 2 respectively. The same questionnaire was used for both tests, posing two questions—one asking what health advocacy means to the students, and one asking them to cite an example of how pharmacists can contribute to health advocacy. The Post-Year 1 interviews consisted of 11 open-ended guiding questions. Both questionnaire and interview guiding questions can be found in Additional file 1: Appendix 2.

Data collection in AY21/22 – Year 2

At the end of AY21/22 Semester 2, the same cohort of students was invited to participate in another questionnaire. Considering the decrease in response rate from the Pre-Year 1 to Post-Year 1 questionnaire, which could be attributed to students’ lack of inclination to participate in school-related activities after examinations, the Post-Year 2 questionnaire was disseminated before their final examinations to increase response rate. This would reduce the risk of non-response bias and preserve data quality.

A different set of questions was used in the Post-Year 2 questionnaire to avoid repetition and thus survey fatigue. These questions aimed to elicit what students thought a pharmacist can do in common, day-to-day scenarios. Question 1 was set in a patient interaction scenario, while Questions 2 and 3 discussed reactions to broader healthcare news on different media platforms. The different question settings provided ample opportunity for students to articulate their thoughts, thereby eliciting the depth of their internalisation of health advocacy.

Similar to the Post-Year 1 interviews, the Post-Year 2 interviews also aimed to determine changes in students’ level of internalisation of health advocacy after undergoing the integrated curriculum, and to recognise their driving factors, if any. The Post-Year 2 interviews consisted of 6 guiding questions. Both questionnaire and interview guiding questions can be found in Additional file 1: Appendix 2.

Evaluation framework for coding questionnaire responses

Based on the concept of critical reasoning from generic questioning [27], if health advocacy was internalised and formed the basis for action, students would be able to incorporate its concepts in their responses. As there are no standardised methods for measurements of critical reasoning [28], the model proposed by Westheimer and Kahne [29] was adapted as a means to evaluate students’ degree of internalisation of health advocacy.

Westheimer and Kahne’s Good Citizenship Model identified three conceptions of a “good citizen” – “Personally Responsible Citizen”, “Participatory Citizen”, and “Justice-Oriented Citizen”. A “Personally Responsible Citizen” would uphold an individualistic sense of responsibility in maintaining oneself as a good citizen. Meanwhile, a “Participatory Citizen” would surpass an individualistic viewpoint and consciously organise and lead community efforts to solve social problems. Superlatively, a “Justice-Oriented Citizen” would critically assess and attempt to solve the social, political and economic root causes of inequity.

These categories were formed by the efforts of various teams of educators and reflected ideals that aligned with the educational aims of practitioners, including educators and curriculum designers [29]. The distinct framing in this educational model renders it a useful analytical tool when adapted in the context of health advocacy to highlight differences in the internalisation of health advocacy.

While the Good Citizenship Model required citizens to be of good character intrinsically to be categorised minimally, not all questionnaire responses assessed in this study displayed a sufficient individualistic responsibility of health advocacy to qualify for the minimal level. Such responses should neither be disregarded during the categorisation process to avoid cherry-picking of responses which would introduce bias, nor should they be qualified as “Personally Responsible” as they are misaligned with its categorical definition and would threaten the validity of the model if they were to be categorised as such. To account for these responses, an additional level of categorisation was conceived – the “Understanding Pharmacist” level.

Questionnaire responses were assessed and categorised into the four levels (Table 1) – Level 1 ‘Understanding Pharmacist’, Level 2 ‘Personally Responsible Pharmacist’, Level 3 ‘Participatory Pharmacist’, and Level 4 ‘Justice-Oriented Pharmacist’. All questionnaire responses were coded using a computer-assisted qualitative data analysis software, NVivo.

Table 1 Evaluation framework for assessing the level of internalisation of health advocacy
Full size table

Interview procedures

Each interview began with general, context-setting questions to initiate conversation about the interviewee’s beliefs. Subsequently, specific core questions revealed how the curriculum led to an improvement in students’ internalisation of health advocacy, or lack thereof [26]. Given the flexibility of semi-structured interviews, follow-up questions could be asked to probe further [24, 30].

All students were interviewed via ZOOM video conferencing, which provided the flexibility to overcome resistance to participate in in-person interviews due to inconvenience and COVID-19 restrictions. Individual interviews rather than focus groups were conducted to understand individual behaviour, experiences, and opinions.

To consolidate the interview responses and identify recurring themes, a thematic analysis was conducted [31] and coded using NVivo.

Data analysis and evaluation process

During the analysis and evaluation process for both questionnaire responses and interview transcripts, the researchers methodically adhered to a structured workflow. The researchers preliminarily familiarised themselves with the questionnaire responses and interview transcripts content. Next, the two researchers coded the data independently. Each researcher categorised the questionnaire responses according to the evaluation framework in Table 1, and conducted the thematic analysis of the interview transcripts by identifying and categorising recurring and prominent themes. The Pre-Year 1 questionnaire, Post-Year 1 questionnaire, and Post-Year 2 questionnaire were treated as separate datasets, and data analysis was conducted distinctly for each dataset. The results were then evaluated together to allow for comparison between the different datasets. Similarly, the Post-Year 1 interview and Post-Year 2 interview were coded distinctly, and a separate thematic analysis was conducted for each dataset before comparing and evaluating the results and trends between both datasets.

Both researchers were final year university students enrolled in NUS Pharmacy, but were completely uninvolved in the new spiral integrated curriculum. Their academic background endowed them with a requisite level of familiarity with the subject matter, including the scientific and technical jargon frequently encountered in the students' questionnaire and interview responses. This unique perspective facilitated the coding process while mitigating potential biases as the researchers approached the analysis objectively due to their lack of direct involvement in the new curriculum under investigation.

Ethical considerations

For all questionnaires and interviews, participants were not approached directly by the researchers and faculty during recruitment. Open invitation to participate was made by a research assistant uninvolved in teaching the pharmacy curriculum. It was emphasised that participation was voluntary and failure to participate would not result in any adverse consequences, nor was it part of any academic assessment. No personal information was requested nor needed. Recorded interview audio clips were transcribed and destroyed no later than two weeks once transcripts were verified as accurate.

All personal data unintentionally revealed in the interview were masked or coded in the transcripts and all research results were de-identified. Responses were coded by two separate researchers and any disagreements were adjudicated by the Principal Investigator.

Approval for the research protocol was granted by the Learning and Analytics Committee on Ethics (LACE) of NUS.

Results

Analysis of coded questionnaire responses

Responses to each question were coded as individual responses. In AY20/21, within the Class of 2024 cohort of 150 students, a total of 215 (72%) responses were obtained for the Pre-Year 1 questionnaire (2 questions), and 126 (42%) responses were obtained for the Post-Year 1 questionnaire. In AY21/22, 383 (85%) responses were obtained for the Post-Year 2 questionnaire (3 questions).

The Mann–Whitney U test was used to compare the distribution of levels across responses between the Pre-Year 1 and Post-Year 1 questionnaires, and between the Pre-Year 1 and Post-Year 2 questionnaires. Results were presented as median (IQR) (Table 2). All comparisons were one-tailed with a significance level of 0.05.

Table 2 Statistical analysis of questionnaire results
Full size table

There was no statistically significant difference between the median levels of health advocacy internalisation (IQR) of the Pre-Year 1 questionnaire and the Post-Year 1 questionnaire [2.0 (2.0–2.0) vs 2.0 (2.0–2.0), p = 0. 44]. In contrast, there was a statistically significant difference between the median levels of health advocacy internalisation (IQR) of the Post-Year 1 questionnaire and the Post-Year 2 questionnaire [2.0 (2.0–2.0) vs 2.0 (2.0–2.0), p < 0.01].

Thematic analysis of Post-Year 1 interviews

Five interviewees participated in the Post-Year 1 interviews, and a thematic analysis conducted revealed their understanding of health advocacy and views on the Year 1 curriculum (Table 3).

Table 3 Thematic analysis of Post-Year 1 interviews
Full size table

Generally, internalisation of health advocacy was lacking among most interviewees, and many felt that curricular integration was not apparent enough. In consideration of this, more was done in the Year 2 curriculum to make the integration between basic, clinical and system sciences clearer, such as making more references to previous learning materials to help students interlink different topics. Furthermore, acknowledging students’ enthusiastic feedback on experiential learning, more opportunities were also incorporated in Year 2 for them to integrate content and skills and translate them into practice.

Thematic analysis of Post-Year 2 interviews

Six students were interviewed after undergoing the Year 2 pharmacy curriculum, and another thematic analysis was conducted (Table 4).

Table 4 Thematic analysis of Post-Year 2 interviews
Full size table

Discussion

The insignificant improvement in students’ level of internalisation of health advocacy after Year 1 can be attributed to the lack of emphasis on health advocacy. During the Post-Year 1 interviews, many suggested that clearer definitions and objectives could be set for health advocacy (Table 3). The implicit nature of health advocacy is a potential barrier in improving its internalisation as students do not perceive it to be as important as clinical and basic sciences [32]. Furthermore, students still regarded it as an isolated concept, failing to establish its connection with basic, clinical, and systems sciences. Generally, while health advocacy could be made more apparent, it should be woven into the curriculum longitudinally to encourage students to formulate its practice into habit [33, 34].

Moreover, many students believed that pharmacists have limited roles in advocating for health beyond individual patient care (Table 3). This is possibly due to the Year 1 curriculum being the beginning of the spiral curriculum, where concepts were taught on an introductory level and more emphasis was placed on building strong conceptual foundations. For instance, the Year 1 curriculum introduced the foundational concepts of healthcare financing and rising healthcare costs (Fig. 1). While these would help students understand the economic backdrop of healthcare, students would have yet to be exposed to how these concepts can be employed on a population and systems level, since these would be taught in subsequent years of the curriculum in increasing complexity. Therefore, the Post-Year 1 findings on the lack of internalisation of health advocacy in students are not necessarily indicative of curricular flaws, and instead, may be an inevitable attribution of the rudimentary yet quintessential beginning point of the spiral curriculum.

Following the Year 2 curriculum, there was an improvement in the internalisation of health advocacy. In line with the spiral curriculum, the Year 2 curriculum reinforced previous concepts and built more complex ideas on them (Table 4). Moreover, integration enabled students to see interrelationships more clearly, improved their retention of information by linking health advocacy concepts taught in Year 1 to specific contexts [35], and subsequently, facilitated their application of such knowledge in actual settings [36]. This may explain the shift from integration being perceived as lacking in the Year 1 curriculum to more apparent in the Year 2 curriculum as reflected in the thematic analysis.

The Post-Year 2 interviews suggested that roleplaying and experiential learning are beneficial in teaching health advocacy (Table 4). They expose students to patients’ multifaceted ideas, concerns, and expectations, humanising patients and spurring students to consider patients’ attitudes with their medical conditions [37]. Moreover, roleplaying and experiential learning are intuitive platforms for students to consolidate information learnt and apply them to real-world scenarios [38, 39]. The Year 2 curriculum introduced these experiential learning opportunities, such as PECT (Table 4). The active community involvement provides an authentic and emotional lens for students to appreciate the impacts of social organisation, socioeconomic factors, health policies, and other factors on patient decisions and health outcomes [23, 40]. Hence, through meaningful reflection on their experiences, students would be more empowered and confident in their abilities to tackle underlying upstream factors of health inequity during their undergraduate journeys and during their professional careers [41,42,43].

The overall improvement in students’ internalisation of health advocacy reflects the effectiveness of spiral integrated curricular designs in instilling health advocacy. This is consistent with cognitive psychology theories that have found that interweaving the teaching of basic sciences with that of clinical sciences sets the context for the knowledge learnt in the formal academic setting [44]. As opposed to the traditional block curriculum, where basic sciences concepts are taught in isolation, the integrated curriculum enables students to organise and connect the fundamental concepts to clinical practice more easily [36, 45]. This also improves the retention of knowledge as it provides opportunities for students to apply their knowledge within a reasonable timeframe [22, 35, 46].

Study limitations

This study has several potential limitations.

Firstly, open-ended questions in the questionnaires relied on students’ abilities to give articulate accounts of their opinions, which might not accurately reflect their underlying attitudes towards health advocacy. Furthermore, the coding process might be subjective as it depended on the researchers’ interpretation of students’ responses. To overcome bias in the assessment process, two researchers independently coded the questionnaire responses and themes recurring in the interview responses. All differences in opinions were adjudicated by the Principal Investigator.

Secondly, interviews were conducted on a voluntary basis, potentially introducing voluntary response bias. There was likely an oversampling of students who were more opinionated about health advocacy and the curriculum, and thus, an overstatement of the effects of the curriculum on the internalisation of health advocacy.

Thirdly, the limited sample size obtained for the interviews and any potential bias introduced as a result of the voluntary nature of the interview recruitment process contributed to a lack of diversity in the data, thus making it difficult to ascertain if data saturation has been reached.

It is acknowledged that the quantitative and qualitative methods used each have their own limitations and biases [47], and their impact on the internal validity of this study may have been accentuated by the lack of a control group. To enhance the validity of the study findings, a mixed methods research design was used. Since the results of the questionnaires and interviews converged and corroborated with each other, the inherent biases of each method were counteracted, thus improving the credibility of the findings in this study [48, 49]. Additionally, the mixed methods research design offered multiple perspectives on the integrated curriculum’s impact on the internalisation of health advocacy, thus producing a comprehensive and holistic understanding of the obtained results [50, 51].

Future directions

While there is a lack of evaluation on whether the participants would go on to actively practise health advocacy during their professional careers, further follow-up evaluative studies can be conducted in the long run on the same cohort of students to investigate this. It is hoped that future studies can identify other crucial elements and areas of improvement in this integrated curriculum, and potentially, guide the implementation of similar integrated curricula in postgraduate pharmacy education, other pharmacy and even other healthcare disciplines educational institutions.

Moreover, taking into account that the experiential learning opportunities in this integrated curriculum are primarily in patient care settings, designers of similar prospective curricula may also partner with social and political institutions to expose students to grassroots organisation and policy making [33]. This potentially enables students to internalise the scope of their roles in health advocacy more comprehensively beyond patient and community care settings.

Conclusion

This paper discussed and evaluated the effectiveness of a spiral integrated undergraduate Pharmacy curriculum on the internalisation of health advocacy in pharmacy students. The improvement in internalisation of health advocacy in the study population suggests promising results of spiral integrated curricular designs which integrate basic, clinical, and system sciences.

Availability of data and materials

All data generated or analysed during this study are included in the supplementary information files of this article.

References

  1. Low LL, Wah W, Ng MJ, Tan SY, Liu N, Lee KH. Housing as a social determinant of health in Singapore and Its association with readmission risk and increased utilization of hospital services. Front Public Health. 2016;4:109. https://doi.org/10.3389/fpubh.2016.00109.

    Article  Google Scholar 

  2. Hertzman C, Frank J, Evans R. Heterogeneities in health status and the determinants of population health. In Evans RG, Barer ML, Marmor TR. (Eds.), Why are some people healthy and others not? The determinants of health populations (1st ed.). Routledge; 1994. p. 67–92. https://doi.org/10.4324/9781315135755.

  3. Gehlert S, Sohmer D, Sacks T, Mininger C, McClintock M, Olopade O. Targeting health disparities: a model linking upstream determinants to downstream interventions. Health Aff. 2008;27(2):339–49.

    Article  Google Scholar 

  4. Kellar J, Deal H, Fitz Patrick B, et al. AFPC educational outcomes 2017. Ottawa: Association of Faculties of Pharmacy of Canada; 2017.

  5. Hubinette M, Dobson S, Scott I, Sherbino J. Health advocacy. Med Teach. 2017;39(2):128–35. https://doi.org/10.1080/0142159X.2017.1245853.

    Article  Google Scholar 

  6. Royal College of Physicians and Surgeons of Canada. Health advocate. CanMEDS Role: Health Advocate: The Royal College of Physicians and Surgeons of Canada. 2015. Retrieved Oct 19, 2022, from https://www.royalcollege.ca/rcsite/canmeds/framework/canmeds-role-health-advocate-e.

  7. Pauling EE, Nguyen TT, Valentino AS, Ducker Coleman M. Using the Pharmacists’ Patient Care Process to address social determinants of health in patients with diabetes. J Am Pharm Assoc. 2022;62(3):685–92. https://doi.org/10.1016/j.japh.2022.01.008.

    Article  Google Scholar 

  8. Williams DR, Costa MV, Odunlami AO, Mohammed SA. Moving upstream: how interventions that address the social determinants of health can improve health and reduce disparities. J Public Health Manag Pract. 2008;14(6):S8-17. https://doi.org/10.1097/01.Phh.0000338382.36695.42.

    Article  Google Scholar 

  9. Ivory K, Bandler L, Hawke C, Armstrong B. A clinical approach to population medicine. Clin Teach. 2013;10(2):94–8. https://doi.org/10.1111/j.1743-498x.2012.00618.x.

    Article  Google Scholar 

  10. Quirk ME, Harden RM. Curriculum planning and development. In: Dent JA, Harden RM, Hunt D, Hodges BD, editors. A practical guide for medical teachers. 5th ed. essay, Elsevier; 2017. p. 4–12.

  11. Gonzalo JD, Haidet P, Papp KK, Wolpaw DR, Moser E, Wittenstein RD, Wolpaw T. Educating for the 21st-century health care system: an interdependent framework of basic, clinical, and systems sciences. Acad Med. 2017;92(1):35–9. https://journals.lww.com/academicmedicine/Fulltext/2017/01000/Educating_for_the_21st_Century_Health_Care_System_.16.aspx.

    Article  Google Scholar 

  12. Harden RM. The integration ladder: a tool for curriculum planning and evaluation. Med Educ. 2000;34(7):551–7. https://doi.org/10.1046/j.1365-2923.2000.00697.x.

    Article  Google Scholar 

  13. Pearson ML, Hubball HT. Curricular integration in pharmacy education. Am J Pharm Educ. 2012;76(10):204. https://doi.org/10.5688/ajpe7610204.

    Article  Google Scholar 

  14. Barzak MY, Ball PA, Ledger R. The rationale and efficacy of problem-based learning and computer assisted learning in pharmaceutical education. Pharm Educ. 2001;1:105–13.

    Article  Google Scholar 

  15. Schwartz A, Elstein A. Clinical reasoning in medicine. 2006.

    Google Scholar 

  16. Armbruster AL, Henson BN, Alsharif NZ. A call to action for a programmatic approach to addressing health disparities and cultural competency in pharmacy education. Am J Pharm Educ. 2022;86(3):8412. https://doi.org/10.5688/ajpe8412.

    Article  Google Scholar 

  17. Hsia SL, Landsfeld A, Lam K, Tuan RL. Implementation and evaluation of a 10-week health equity curriculum for pharmacy students. Am J Pharm Educ. 2021;85(9):8579. https://doi.org/10.5688/ajpe8579.

    Article  Google Scholar 

  18. Keller LO, Strohschein S, Lia-Hoagberg B, Schaffer MA. Population-based public health interventions: practice-based and evidence-supported. Part I Public Health Nursing. 2004;21(5):453–68. https://doi.org/10.1111/j.0737-1209.2004.21509.x.

    Article  Google Scholar 

  19. Koster A, Schalekamp T, Meijerman I. Implementation of Competency-Based Pharmacy Education (CBPE). Pharmacy (Basel). 2017;5(1):10. https://doi.org/10.3390/pharmacy5010010.

    Article  Google Scholar 

  20. Bruner J. The Process of Education. Cambridge, MA: Harvard University Press; 1960.

    Google Scholar 

  21. Harden RM. What is a spiral curriculum? Med Teach. 1999;21(2):141–3. https://doi.org/10.1080/01421599979752.

    Article  Google Scholar 

  22. Husband AK, Todd A, Fulton J. Integrating science and practice in pharmacy curricula. Am J Pharm Educ. 2014;78(3):63. https://doi.org/10.5688/ajpe78363.

    Article  Google Scholar 

  23. Dharamsi S, Richards M, Louie D, Murray D, Berland A, Whitfield M, Scott I. Enhancing medical students’ conceptions of the CanMEDS health advocate role through international service-learning and critical reflection: a phenomenological study. Med Teach. 2010;32(12):977–82. https://doi.org/10.3109/01421590903394579.

    Article  Google Scholar 

  24. Liamputtong P. Handbook of research methods in health social sciences. Springer Singapore; 2019. https://doi.org/10.1007/978-981-10-5251-4.

  25. Silverman D. Doing qualitative research. 5th ed. London: Sage; 2017.

    Google Scholar 

  26. DeJonckheere M, Vaughn LM. Semistructured interviewing in primary care research: a balance of relationship and rigour. Family Medicine and Community Health. 2019;7(2):e000057. https://doi.org/10.1136/fmch-2018-000057.

    Article  Google Scholar 

  27. Sykes AH, Azfar J. Constructing understanding through critical questioning: a comparative study of first year undergraduate and postgraduate writing and communication classes. Asian J Scholarship Teaching Learning. 2019;9(1):59–69.

    Google Scholar 

  28. Moore T. The critical thinking debate: How general are general thinking skills? High Educ Res Dev. 2004;23(1):3–18.

    Article  Google Scholar 

  29. Westheimer, J., & Kahne, J. What kind of citizen? Political choices and educational goals. Encount Theory History Educ. 2008;4. https://doi.org/10.24908/eoe-ese-rse.v4i0.658.

  30. Bryman A. Social Research Methods. 5th ed. London: Oxford University Press; 2016.

    Google Scholar 

  31. Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3(2):77–101. https://doi.org/10.1191/1478088706qp063oa.

    Article  Google Scholar 

  32. Douglas A, Mak D, Bulsara C, Macey D, Samarawickrema I. The teaching and learning of health advocacy in an Australian medical school. Int J Med Educ. 2018;9:26–34. https://doi.org/10.5116/ijme.5a4b.6a15.

    Article  Google Scholar 

  33. McDonald M, Lavelle C, Wen M, Sherbino J, Hulme J. The state of health advocacy training in postgraduate medical education: a scoping review. Med Educ. 2019;53(12):1209–20. https://doi.org/10.1111/medu.13929.

    Article  Google Scholar 

  34. Towle A, Godolphin W, Hubinette M, Macdonald S, Hewitt C. The CanMEDS role of health advocate in postgraduate education at UBC: summary report. 2013.

    Google Scholar 

  35. Rosse C. Integrated versus discipline-oriented instruction in medical education. Acad Med. 1974;49(10):995–8 https://journals.lww.com/academicmedicine/Fulltext/1974/10000/Integrated_versus_discipline_oriented_instruction.14.aspx.

    Article  Google Scholar 

  36. Lam TP, Irwin M, Chow LWC, Chan P. Early introduction of clinical skills teaching in a medical curriculum – factors affecting students’ learning. Med Educ. 2002;36(3):233–40. https://doi.org/10.1046/j.1365-2923.2002.01142.x.

    Article  Google Scholar 

  37. Greenhalgh T, Hurwitz B. Narrative based medicine: why study narrative? BMJ. 1999;318(7175):48–50. https://doi.org/10.1136/bmj.318.7175.48.

    Article  Google Scholar 

  38. Murphy S. Stories are better than lectures at teaching us about health. The Conversation. 2017. Retrieved September 22, 2022, from https://theconversation.com/stories-are-better-than-lectures-at-teaching-us-about-health-71682.

  39. Rodrigo C, Tedla N, Thomas S, Polly P, Herbert C, Velan G, Saunders DN. Using narratives to teach students enrolled in science and medical science bachelor’s degree programs. Med Sci Educ. 2019;29(2):357–61. https://doi.org/10.1007/s40670-019-00698-1.

    Article  Google Scholar 

  40. Fung OW, Ying Y. Twelve tips to center social accountability in undergraduate medical education. Med Teach. 2021:1–7. https://doi.org/10.1080/0142159X.2021.1948983.

  41. Boroumand S, Stein MJ, Jay M, Shen JW, Hirsh M, Dharamsi S. Addressing the health advocate role in medical education. BMC Med Educ. 2020;20(1):28. https://doi.org/10.1186/s12909-020-1938-7.

    Article  Google Scholar 

  42. Cantor JA. Experiential learning in higher education: linking classroom and community. 1995.

    Google Scholar 

  43. Hunt JB, Bonham C, Jones L. Understanding the goals of service learning and community-based medical education: a systematic review. Acad Med. 2011;86(2):246–51. https://doi.org/10.1097/ACM.0b013e3182046481.

    Article  Google Scholar 

  44. Hsia SL, Gruenberg K, Nguyen J, La A, MacDougall C. Student performance outcomes and perceptions in two content areas in conventional versus integrated pharmacy curricula. Am J Pharm Educ. 2023;87(4):ajpe9164. https://doi.org/10.5688/ajpe9164.

    Article  Google Scholar 

  45. Schmidt HG. Problem-based learning: rationale and description. Med Educ. 1983;17(1):11–6. https://doi.org/10.1111/j.1365-2923.1983.tb01086.x.

    Article  Google Scholar 

  46. Brauer DG, Ferguson KJ. The integrated curriculum in medical education: AMEE Guide No. 96. Med Teach. 2015;37(4):312–22. https://doi.org/10.3109/0142159X.2014.970998.

    Article  Google Scholar 

  47. Harris LR, Brown GTL. Mixing interview and questionnaire methods: Practical problems in aligning data. Pract Assess Res Evaluation. 2010;15(1):1. https://doi.org/10.7275/959j-ky83.

    Article  Google Scholar 

  48. Greene JC, Caracelli VJ, Graham WF. Toward a conceptual framework for mixed-method evaluation designs. Educ Eval Policy Anal. 1989;11(3):255–74. https://doi.org/10.3102/01623737011003255.

    Article  Google Scholar 

  49. Greene J, McClintock C. Triangulation in evaluation: design and analysis issues. Eval Rev. 1985;9:523–45. https://doi.org/10.1177/0193841X8500900501.

    Article  Google Scholar 

  50. Andrew S, Halcomb EJ. Mixed method research. In: Borbasi S, Jackson D, editors. Navigating the Maze of Research: enhancing nursing & midwifery practice. 3rd ed. Marrickville: Elsevier; 2012.

    Google Scholar 

  51. Simons L, Lathlean J. Mixed Methods. In: Gerrish K, Lacey A, editors. The research process in nursing. 6th ed. London: Wiley-Blackwell; 2010.

    Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

This work was supported by the National University of Singapore Teaching Enhancement Grant (TEG) AY2020 for SGD$8,000. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Author information

Authors and Affiliations

  1. Department of Pharmacy, National University of Singapore, Singapore, Singapore

    Li Hui, Candice Lau, Jolin Xin Ni Wong, Paul John Gallagher & Leroy Koh

  2. Saw Swee Hock School of Public Health, National University of Singapore, Singapore, Singapore

    Julian Azfar

Authors
  1. Li Hui, Candice Lau
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jolin Xin Ni Wong
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Julian Azfar
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Paul John Gallagher
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Leroy Koh
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

KL conceptualised the study and acted as Principal Investigator for the study and as supervisor to LC and WJ. LC and WJ planned the study design, performed the data collection, analysed and interpreted the data, and were major contributors in writing the manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Li Hui, Candice Lau.

Ethics declarations

Ethics approval and consent to participate

Approval for the research protocol was granted by the Learning and Analytics Committee on Ethics (LACE) of NUS. The LACE reference number for this study is L2020-07–03. All methods were carried out in accordance with relevant guidelines and regulations as follows: National University of Singapore Institutional Review Board (NUS-IRB) guidelines, Personal Data Protection Act of Singapore, Student Data Protection Policy of NUS, Data Protection Policy of NUS, and IT Security Policy of NUS.

During recruitment, an invitation email was sent out to the students to obtain voluntary informed consent to participate in the questionnaires and semi-structured interviews. Students who consented were then provided with the attached participant information sheet and consent form. No personal information was requested nor needed to be provided to the research team beyond the details necessary for scheduling and conducting the interview. Any such details provided by participants were not recorded as research data. Although an audio version of each interview was recorded, the interviews were transcribed as soon as possible and the audio files were destroyed once the transcripts were verified as accurate. This occurred no more than two weeks after the conducted interviews. All personal data revealed in the interviews were masked or coded in the transcripts. The written surveys were completely anonymous as well.

Acknowledgement of the consent terms of the interviews and questionnaires was implied once a student participated in the interviews and questionnaires. Consent statements were also read to each student by the research assistant, and each participant had to verbalize agreement before proceeding with the interview. Suppose a participant changed their mind about participating prior to participating in the interview, they might choose to inform the research assistant at any time and the scheduled interview would be cancelled. As their participation was anonymous, there would be no way for research data to be deleted if a participant decided to withdraw from the research after participating in the interviews or surveys.

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1:

Appendix 1. CanMEDS role: health advocate. Appendix 2. Questionnaire questions.

Additional file 2.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lau, L.H.C., Wong, J.X.N., Azfar, J. et al. Evaluating the internalisation of the intrinsic role of health advocacy of student pharmacists in a new integrated Bachelor of Pharmacy curriculum: a mixed-methods study. BMC Med Educ 23, 900 (2023). https://doi.org/10.1186/s12909-023-04877-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12909-023-04877-y

Keywords

BMC Medical Education

ISSN: 1472-6920

Contact us