- Research article
- Open Access
Enhanced knowledge of spontaneous reporting with structured educational programs in Korean community pharmacists: a cross-sectional study
BMC Medical Education volume 17, Article number: 95 (2017)
While spontaneous reporting (SR) is one of the important public health activities for community pharmacists to guard patients’ safety, very few studies examined educational activities and its effects on knowledge about the SR system in Korea. This study described the association between knowledge of SR and educational activities targeting community pharmacists in Korea.
Self-administered questionnaires were collected between September 1, 2014 and November 25, 2014. The questionnaires addressed sources of SR knowledge (structured educational programs, personal access to educational resources, and information by social network services) and knowledge about the Regional Pharmacovigilance Center designated for community pharmacists, the legal responsibility clause on the serious event reporting, and the reportable items. The association between the knowledge of SR and the educational activities was evaluated using analysis of variance or chi-squared tests.
Overall, 766 questionnaires demonstrated that mean age and length of career in community pharmacies was 45.7 years and 15.9 years, respectively. A structured educational program was used in 63.1% of the participants followed by a personal access to educational resources (56.3%). An educational program offered by the Korean Pharmaceutical Association was the most frequently mentioned program (56.8%), and no regional disparity in the program between the metropolitan and rural areas was observed. Pharmacists who had personal access to educational resources identified SR knowledge contents less correctly than those who used a structured educational program or both (p < 0.01). In general, pharmacists’ knowledge on reportable items was significantly lower with non-prescription drugs, nutritional supplements, and personal hygiene products as compared to their knowledge on prescription drugs, regardless of the type of education (p < 0.01).
Knowledge regarding SR was more likely to increase when a structured educational program was used alone or in combination with other educational methods. Knowledge on reportable items should be reinforced during the continuing education process.
Spontaneous reporting (SR) of adverse drug reactions (ADRs) plays a critical role in identifying drug safety signals and improving quality of patient care by the early detection of new or rare ADRs . The safety information listed in the approved package inserts were mostly based on preapproval studies that included a relatively small number of patients and a short duration of drug exposure . The successful operation of the SR system and utility of the safety signals for policy implementation are important for including safety updates in the package insert, and these activities are heavily dependent on accurate, timely, and vigilant reports made by the reporters.
While improved reporting rates have been published from a few countries [3, 4], a systematic review including 37 studies showed under-reporting rates of higher than 90%; the under-reporting was identified as one of the major hurdles in improving the pharmacovigilance outcomes . With concerted efforts made by the government and healthcare professionals in Korea, increased SR activities have been documented since the establishment of the Korea Institute of Drug Safety and Risk Management (KIDS), the government agency responsible for the improvement of pharmacovigilance and comprehensive management of the Regional Pharmacovigilance Centers (RPVCs) across the country . In addition, more SR cases from community pharmacists were submitted to KIDS after the active involvement of the Korean Pharmaceutical Association (KPA) designated as a RPVC to collect the SR by community pharmacists nationwide in Korea , which could be considered as a successful collaboration between the government and the professional organization representing community pharmacists in Korea. Although the overall reporting rate has increased, there is still room to improve in Korea as the increase was relatively lower than that from other countries, e.g., in the Netherlands, Spain, or Portugal .
Several published studies showed that the knowledge of health care professionals was a major predictive factor for under-reporting in comparison with the personal and professional characteristics of physicians and pharmacists [7,8,9,10]. Educational programs and educational resources have been frequently recommended as the method to increase knowledge of SR [5, 7,8,9, 11]. While strategies like educational programs or various methodologic approaches are needed to improve under-reporting in Korea, very few studies examined educational activities and its effects on knowledge about the SR system and reportable events by education types and resources in Korea [12, 13]. Also, data on SR related educational activities including Korean community pharmacists are extremely limited. Therefore, this study aimed to describe types of educational activities on the SR system and to evaluate the association between knowledge of SR and educational activities targeting community pharmacists.
The survey instrument contained 10 questions on the types of educational activities, the knowledge of SR, and demographic information such as age, gender, length of career in community pharmacy and the location of the pharmacy. The geographic location included 7 metropolitans and 9 provinces representing all administrative districts in Korea. The question about the types of educational activities included multiple selection options; structured and formal educational programs, information leaflet, media such as Internet sites for pharmaceutical news or KIDS homepage, and information by co-worker or social network services. The question about the types of structured and formal educational programs also included multiple selection options; the education by KPA, the education by other professional organization, online education, and entry-level pharmacy program for college students.
In this study, knowledge of SR was measured using a composite score from 3 survey items with each correct answer counting as 1 point: having knowledge on the designation of KPA as one of the Regional Pharmacovigilance Centers to collect ADRs (1 point), knowledge on the legal responsibility clause on the serious event reporting (1 point), and knowledge on the reportable items (1 point). For the knowledge on reportable items, the participants should select all four options including prescription drugs, non-prescription drugs, nutritional supplements, and personal hygiene products to be assigned to 1 point.
Based on the findings from a published study by Irujo and colleagues indicating an 18% difference of knowledge score between two groups with different levels of structured education , a sample size of 720 subjects (240 subjects per group) in three-group analysis was calculated as adequate to detect a 15% frequency difference with 80% power and 5% α-error (Epi Info™ 7.1.5, Centers for Disease Prevention and Control, Atlanta, GA).
A cross-sectional survey study was conducted using a self-administered questionnaire with a nationwide convenience sample of community pharmacists in all 16 administrative districts in Korea. A detailed description of the survey development, subject recruitment, and response rate was described in previous literature . Briefly, the questionnaire using the mixed theoretical model  of the knowledge-attitude-practices model [17, 18] and the theory of satisfaction of needs  was developed. The survey was distributed either online using a pharmacy billing program called the PM2000 that is used by the majority of community pharmacies in Korea or by a paper-based method from two national-level conferences targeting pharmacists who did not prefer the online platform or used a different billing program between September 1, 2014 and November 25, 2014. The study population included pharmacists who reported their knowledge on the presence of SR system in Korea and identified one or more educational activities.
All survey participants provided their written informed consent to participate in this study while ensuring confidentiality to meet our ethical standards. A full ethical review was made for all procedures following the protocol approved by the Institutional Review Board (IRB) of Seoul National University, and the study was approved by the IRB (IRB No. E1410/001–011).
Pharmacists were classified into three groups by types of educational activities: 1) structured education, 2) personally accessed educational resource, or 3) combination. The structured education group consisted with the pharmacists who had knowledge regarding SR through only the structured and formal educational programs. The personally accessed educational resource group consisted of pharmacists who acquired their knowledge regarding SR through the personally accessed educational resources, such as an information leaflet, media, or information by co-worker or social network services. The combination group included pharmacists who received both structured education and utilized educational resources by individual access. The location of community pharmacies was divided into metropolitan area (7 major cities) and rural area (9 provinces) in data analysis representing all 16 administrative districts in Korea.
The demographic and clinical characteristics of the three groups were presented with descriptive statistics, such as mean, standard deviation (SD), frequency, and percentage. The continuous and categorical variables between the three groups were compared using an analysis of variance (ANOVA) test and chi-squared tests, respectively. Statistical differences of demographic variables and pharmacists’ knowledge on the individual items and the scores for the 3 items within each type of educational approach were assessed. Statistical differences of individual educational activities according to the location of the community pharmacy between metropolitan area and rural area were also compared using chi-squared tests. The significance level was set at p < 0.05. For the post hoc analysis, the Bonferroni correction was employed. Data analysis was performed using SPSS version 22.0 (SPSS Inc., Chicago, IL).
From September 1, 2014 to November 25, 2014, a total of 1004 of the 1315 invited community pharmacists participated in this study and the response rate was 76.3% . Two hundred thirty participants answering that they did not know the existence of SR system were excluded. Of all collected 774 questionnaires, the study included 766 questionnaires, i.e., 450 online and 316 for the paper-based survey; eight questionnaires that did not include the source of the knowledge on SR were excluded.
Characteristics of study population
The mean (± SD) age of the study population was 45.7 (± 10.7) years, and females comprised 57.4% of the study population (Table 1). The mean (± SD) career length in community pharmacies was 15.9 (± 10.5) years. For the sources to obtain knowledge regarding SR, structured educational programs were used by 483 pharmacists (63.1%), while personally accessed educational resources were used by 431 pharmacists (56.3%). Education by the KPA (435 pharmacists, 56.8%) was the most frequent in the structured educational programs, and information leaflets (175 pharmacists, 22.8%) were the most prevalent in the personally accessed educational resources.
Characteristics according to types of educational activities
The structured education group, the personally accessed educational resource group, and the combination group comprised 43.7% (335 pharmacists), 37.0% (283 pharmacists), and 19.3% (148 pharmacists) of the population, respectively (Table 2). The mean age and length of career in community pharmacies were significantly higher in the combination group than the resource or education groups (48.1 years vs. 44.4 or 45.0 years for mean age; 18.2 years vs. 15.6 or 15.2 years for career in community phasrmacy; p < 0.05, Table 2). There was no significant difference in gender and location of community pharmacies among the three groups.
While there was no regional difference between metropolitan area and rural area in the proportion of the education by KPA, online, or education from the entry-level pharmacy program or each of the personally accessed educational resources, the proportion of education by other professional organizations was significantly different between the metropolitan and rural areas (12.1% vs. 5.5%, p = 0.003).
Knowledge according to types of educational activities
Comparing the numbers of correctly identified content areas on SR knowledge, knowledge was significantly lower in the personally accessed educational resource group than the other groups (p < 0.01, Fig. 1). Nearly one-fifth (19.3%, 54 pharmacists) of the personally accessed educational resource group had no knowledge, and only 8.6% (24 pharmacists) had correct knowledge regarding all three content areas. In particular, the personally accessed educational resource group showed significantly lower knowledge on the Regional Pharmacovigilance Center-KPA and SR-related laws compared to the other groups (p < 0.05, Table 2).
Considering knowledge on reportable items, knowledge on prescription drugs was similarly high (above 97.0%), and their knowledge was significantly decreased with non-prescription drugs, nutritional supplements, and personal hygiene products as compared to their knowledge on prescription drugs in all groups (p < 0.01, Table 3). When their knowledge was compared between different types of educational activities, knowledge on nonprescription drugs was significantly lower in the personally accessed educational resource group compared with that of the structured education group (76.7% vs. 87.7%, p < 0.001, Table 3).
To the best of our knowledge, this is the first nationwide survey to study the effect of educational activities on knowledge of SR in Korea. While pharmacists’ knowledge was a major determinant in under-reporting and educational activities have increased knowledge of SR [7,8,9], very few studies have evaluated knowledge by the type of educational activities in Korea. Our findings showed that educational resources alone were less associated with knowledge of SR than structured educational programs. Although a recent study corroborated our findings with printed educational materials showing a beneficial, yet small, effect on professional practice outcomes , Bracchi and colleagues demonstrated ADR reports were increased using an educational bulletin linked to education credits in a distance learning program .
Knowledge of SR, in our study, showed a significant relationship with the structured educational program, which consisted of several sessions regarding to the importance and the advantages of ADR reporting, the disadvantages of under-reporting, and the method of SR. This is consistent with published studies including pharmacists and nurses, which have showed that the structured educational intervention improved the lack of knowledge of SR [12, 13]. Findings from our study on no regional disparity in the education by KPA between the metropolitan and rural areas could be partially explained by the administrative strategy of the national-level pharmacy association in closely working with local KPA branches through mandating continuing education (CE) requirements on medication safety and spontaneous reporting.
The CE is a leading educational program for health professionals and offers several influential characteristics of persistency and consistency, which would contribute to the desired educational outcomes [22, 23]. Most U.S. State Boards of Pharmacy mandate 30 or more hours of CE credits for licensure renewal mandating their CE credits on the medical error or safety related to SR . Great Britain, Singapore, and Canada incorporated a revalidation system with optional education regarding ADR reporting [25,26,27]. In Korea, mandatory CE to meet the pharmacist licensure requirements is 6 h per year and education about patient safety including SR is also optional . The Ministry of Health and Welfare, the agency in charge of issuing licensures for health professionals in Korea, have delegated the management of CE for pharmacists to KPA . Considering the advantage of SR education by KPA as an important portal for pharmacovigilance activities, we believe that the drug safety education should be designated as a required CE activity and the yearly required credit of 6 h may not sufficiently cover educational contents on drug safety for practicing pharmacists in Korea.
In our study, the fact that one in five pharmacists (i.e., 19.5%) utilizes media materials as personally accessed educational resources can have important implications. As the access to the Internet became democratized in the global community, enhanced access to more credible drug safety information sites on the Internet can be a potential solution for improving pharmacists’ knowledge . Especially, persistent efforts advancing the health information technology are apparent in Korea such that the Korean Pharmaceutical Information Center has provided a one-click information link to the pharmacy’s billing program used by all community pharmacies under the national health insurance system network.
Findings from our study indicated that regardless of the type of educational activities, the knowledge on reportable items significantly decreased with non-prescription drugs, nutritional supplements, and personal hygiene products as compared to knowledge on prescription drugs. As community pharmacists can serve as the primary healthcare provider in helping patients on self-care with these products [6, 30], knowledge regarding these reportable items is extremely important for community pharmacists, and the suboptimal level of knowledge as demonstrated in our study can be concerning; therefore, strategies to improve knowledge regarding reportable items are needed.
This study has some limitations. First, we relied on voluntary participation and a convenience sample of pharmacists in this survey. This has the potential for selection bias with limited generalizability. However, this study showed good response rate of over 75%, which may allow overcoming the concerns about the limited generalizability. Second, concerning the self-report study, this study has the potential for social desirability bias and recall bias. Third, other types of educational resources that are not explained in the survey can be available. Although our study did not explore resources, we focused on the most prevalently used educational activities in Korea.
In conclusion, the findings from our study show that more than half of community pharmacists obtained SR information through the structured education by KPA, and the education by KPA was not different between the metropolitan and rural areas. Knowledge of SR was more likely to increase in the structured education or the combination of structured education and personally accessed educational resources. As the knowledge of the reportable items on non-prescription drugs, nutritional supplements, and personal hygiene products was lower than their knowledge on prescription drugs, more focused efforts that reinforce the educational contents are needed to improve the drug safety process targeting community pharmacists.
Adverse drug reaction
Analysis of variance
Institutional Review Board
Korea Institute of Drug Safety and Risk Management
Korean Pharmaceutical Association
Regional Pharmacovigilance Center
Regional Pharmacovigilance Center at the Korean Pharmaceutical Association
Keane J, Gershon S, Wise RP, Mirabile-Levens E, Kasznica J, Schwieterman WD, et al. Tuberculosis associated with infliximab, a tumor necrosis factor alpha-neutralizing agent. N Engl J Med. 2001;345:1098–104. doi:10.1056/NEJMoa011110.
Whitstock MT, Pearce CM, Ridout SC, Eckermann EJ. Using clinical trial data and linked administrative health data to reduce the risk of adverse events associated with the uptake of newly released drugs by older Australians: a model process. BMC Public Health. 2011;11:361. doi:10.1186/1471-2458-11-361.
Yu YM, Shin WG, Lee JY, Choi SA, Jo YH, Youn SJ, et al. Patterns of adverse drug reactions 322 in different age groups: analysis of spontaneous reports by community pharmacists. PLoS One. 2015;323(10):e0132916. doi:10.1371/journal.pone.0132916.
van Grootheest K, Olsson S, Couper M, de Jong-van den Berg L. Pharmacist’ role in reporting adverse drug reactions in an international perspective. Pharmacoepidemiol Drug Saf. 2004;13:457–64. doi:10.1002/pds.897.
Hazell L, Shakir SA. Under-reporting of adverse drug reactions: a systematic review. Drug Saf. 2006;29:385–96.
Yu YM, Choi SA, Lee MS, Youn SJ, Kim MH, Choi KH, et al. The clinical characteristics of adverse drug reactions reported from the community pharmacy. Korean J Clin Pharm. 2014;24:154–61.
Khalili H, Mohebbi N, Hendoiee N, Keshtkar AA, Dashti-Khavidaki S. Improvement of knowledge, attitude and perception of healthcare workers about ADR, a pre- and post-clinical pharmacists’ interventional study. BMJ Open. 2012;2:e000367. doi:10.1136/bmjopen-2011-000367.
Perez Garcia M, Figueras A. The lack of knowledge about the voluntary reporting system of adverse drug reactions as a major cause of underreporting: direct survey among health professionals. Pharmacoepidemiol Drug Saf. 2011;20:1295–302. doi:10.1002/pds.2193.
Hasford J, Goettler M, Munter KH, Muller-Oerlinghausen B. Physicians’ knowledge and attitudes regarding the spontaneous reporting system for adverse drug reactions. J Clin Epidemiol. 2002;55:945–50.
Tetteh RA, Nartey ET, Lartey M, Mantel-Teeuwisse AK, Leufkens HG, Nortey PA, et al. Adverse events and adherence to HIV post-exposure prophylaxis: a cohort study at the Korle-Bu Teaching Hospital in Accra, Ghana. BMC Public Health. 2015;15:573. doi:10.1186/s12889-015-1928-6.
Gavaza P, Brown CM, Lawson KA, Rascati KL, Wilson JP, Steinhardt M. Influence of attitudes on pharmacists’ intention to report serious adverse drug events to the Food and Drug Administration. Br J Clin Pharmacol. 2011;72:143–52. doi:10.1111/j.1365-2125.2011.03944.x.
Sarayani A, Naderi-Behdani F, Hadavand N, Javadi M, Farsad F, Hadjibabaie M, et al. A 3-armed randomized controlled trial of nurses’ continuing education meetings on adverse drug reactions. J Contin Educ Heal Prof. 2015;35:123–30. doi:10.1002/chp.21276.
Green CF, Mottram DR, Rowe PH, Pirmohamed M. Attitudes and knowledge of hospital pharmacists to adverse drug reaction reporting. Br J Clin Pharmacol. 2001;51:81–6.
Irujo M, Beitia G, Bes-Rastrollo M, Figueiras A, Hernandez-Diaz S, Lasheras B. Factors that influence under-reporting of suspected adverse drug reactions among community pharmacists in a Spanish region. Drug Saf. 2007;30:1073–82.
Yu YM, Lee E, Koo BS, Jeong KH, Choi KH, Kang LK, et al. Predictive factors of spontaneous reporting of adverse drug reactions among community pharmacists. PLoS One. 2016;11:e0155517. doi:10.1371/journal.pone.0155517.
Herdeiro MT, Polonia J, Gestal-Otero JJ, Figueiras A. Factors that influence spontaneous reporting of adverse drug reactions: a model centralized in the medical professional. J Eval Clin Pract. 2004;10:483–9. doi:10.1111/j.1365-2753.2003.00456.x.
Hong YP, Kwon DW, Kim SJ, Chang SC, Kang MK, Lee EP, et al. Survey of knowledge, attitudes and practices for tuberculosis among general practitioners. Tuber Lung Dis. 1995;76:431–5.
Dewi C, Barclay L, Passey M, Wilson S. Improving knowledge and behaviours related to the cause, transmission and prevention of Tuberculosis and early case detection: a descriptive study of community led Tuberculosis program in Flores, Indonesia. BMC Public Health. 2016;16:740. doi:10.1186/s12889-016-3448-4.
Slotnick HB. How doctors learn: the role of clinical problems across the medical school-to-practice continuum. Acad Med. 1996;71:28–34.
Giguere A, Legare F, Grimshaw J, Turcotte S, Fiander M, Grudniewicz A, et al. Printed educational materials: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2012;10:Cd004398. doi:10.1002/14651858.CD004398.pub3.
Bracchi RC, Houghton J, Woods FJ, Thomas S, Smail SA, Routledge PA. A distance-learning programme in pharmacovigilance linked to educational credits is associated with improved reporting of suspected adverse drug reactions via the UK yellow card scheme. Br J Clin Pharmacol. 2005;60:221–3. doi:10.1111/j.1365-2125.2005.02419.x.
Forsetlund L, Bjorndal A, Rashidian A, Jamtvedt G, O'Brien MA, Wolf F, et al. Continuing education meetings and workshops: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2009;2:Cd003030. doi:10.1002/14651858.CD003030.pub2.
Davis D, O'Brien MA, Freemantle N, Wolf FM, Mazmanian P, Taylor-Vaisey A. Impact of formal continuing medical education: do conferences, workshops, rounds, and other traditional continuing education activities change physician behavior or health care outcomes? JAMA. 1999;282:867–74.
State CE requirements for pharmacists. Medscape. http://www.medscape.org/public/pharmcestaterequirements. Accessed 12 June 2016.
Schafheutle EI, Hassell K, Noyce PR. Ensuring continuing fitness to practice in the pharmacy workforce: Understanding the challenges of revalidation. Res Soc Admin Pharm. 2013;9:199–214. doi:10.1016/j.sapharm.2012.08.007.
Driesen A, Verbeke K, Simoens S, Laekeman G. International trends in lifelong learning for pharmacists. Am J Pharm Educ. 2007;71:10.
Ang HG, Pua YH, Subari NA. Mandatory continuing professional education in pharmacy: the Singapore experience. Int J Clin Pharm. 2013;35:570–6. doi:10.1007/s11096-013-9767-y.
Enforcement Decree of the Pharmaceutical Affairs Act. The Ministry of Health and Welfare. http://www.law.go.kr/lsInfoP.do?lsiSeq=166824&efYd=20150105#0000. Accessed 12 June 2016.
Cook DA, Levinson AJ, Garside S, Dupras DM, Erwin PJ, Montori VM. Internet-based learning in the health professions - A meta-analysis. JAMA. 2008;300:1181–96. doi:10.1001/jama.300.10.1181.
van Grootheest AC, de Jong-van den Berg LT. The role of hospital and community pharmacists in pharmacovigilance. Res Social Adm Pharm. 2005;1:126–33. doi:10.1016/j.sapharm.2004.12.009.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
This work was supported by the Seoul National University Research Grant. This work was supported by Creative-Pioneering Researchers Program through Seoul National University. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
YM Yu conceived the study, collected and analyzed data, and drafted the manuscript. E Lee conceived the study, participated in its design and analytical interpretation, prepared the manuscript, and secured the grant support. Both authors read and approved the final manuscript.
The authors declare that they have no competing interests.
Consent for publication
Ethics approval and consent to participate
The Institutional Review Board of Seoul National University approved this study (IRB No.E1410/001–011). All survey participants provided their written informed consent to participate in this study.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Yu, Y.M., Lee, E. Enhanced knowledge of spontaneous reporting with structured educational programs in Korean community pharmacists: a cross-sectional study. BMC Med Educ 17, 95 (2017). https://doi.org/10.1186/s12909-017-0933-0
- Continuing education
- Spontaneous reporting
- Adverse drug reaction reporting system