Skip to main content
Download PDF

Knowledge, perception, and willingness to provide telepharmacy services among pharmacy students: a multicenter cross-sectional study in Indonesia

BMC Medical Education volume 23, Article number: 800 (2023) Cite this article

Abstract

Introduction

The coronavirus disease 2019 (COVID-19) pandemic accelerated the provision of telepharmacy services. However, little is known about the knowledge, perception, and willingness of pharmacy students as future key players in telepharmacy adoption to provide such a service, particularly in a setting without well-established telepharmacy services before the COVID-19 pandemic.

Objective

With this survey we aimed to assess the level of knowledge, perception, and willingness to provide telepharmacy services and to identify associated factors among pharmacy students in Indonesia.

Methods

We applied a multicenter cross-sectional study design with convenience sampling technique among pharmacy students in three public universities in Bandung City, Surabaya City, and Special Region of Yogyakarta, Indonesia. The knowledge, perception, and willingness to provide telepharmacy services were assessed using an online questionnaire. Ordinal regression analysis was performed to determine factors associated with a high knowledge level, whereas binary logistic regression analyses were performed to determine factors associated with a positive perception of telepharmacy services. Odds ratios (ORs) with 95% confidence intervals (CIs) were reported.

Results

Among 313 respondents, 83.4% were female, and the mean age was 20 years. Although only 13.2% showed a high knowledge level, 66.5% showed a positive perception of telepharmacy services and 97.4% were willing to provide telepharmacy services in the future. An increase in age (OR 1.33; 95% CI 1.14–1.54) and being advance in smartphone usage (OR 5.21; 95% CI 2.03–13.42) are associated with an increased likelihood of having a high knowledge level about telepharmacy services. Male students had a lower likelihood of having a positive perception of telepharmacy services than females (OR 0.46; 95% CI 0.24–0.85).

Conclusion

Despite limited knowledge of telepharmacy, the majority of pharmacy students reported a positive perception and willingness to provide telepharmacy services in their future careers. Therefore, telepharmacy practice models must be included as a subject course in the curriculum, better preparing future pharmacists to perform their roles effectively. Furthermore, student-specific factors such as age and expertise in smartphone usage that associated with knowledge and gender that associated with perception should be considered to facilitate telepharmacy adoption in Indonesia.

Peer Review reports

Introduction

The coronavirus disease 2019 [COVID-19] pandemic has significantly affected the provision of pharmaceutical care [1]. As several movement restrictions have been implemented, the number of patients attending outpatient care had significantly decreased [2]. Therefore, telepharmacy services, an approach for delivering pharmaceutical care through the use of digital health technologies which enabling pharmacists and patients to interact remotely and minimizing patients’ exposure to healthcare settings [3], are recommended as an adaptive method [4, 5]. These changes may not be temporary; thus, both pharmacists and pharmacy students must prepare themselves to provide telepharmacy services to improve the health and wellbeing of patients [6].

Previous studies have reported that outcomes provided by telepharmacy services are relatively similar to those of traditional pharmaceutical care services [7, 8] and can improve patient satisfaction [8,9,10,11]. However, the implementation of telepharmacy services requires a unique set of skills that are currently lacking in pharmacy education [11,12,13,14,15]. Therefore, pharmacists may experience difficulty in integrating clinical skills used for in-person counseling with the virtual environment [11] because existing skills and resources are often set up to support face-to-face counseling. Without sufficient telepharmacy training, pharmacy students were reported to be more successful at providing face-to-face consultation than via telepharmacy [16].

The adoption rate of telepharmacy was reported to be low in many countries [17], particularly in low- and middle-income countries without well-established telepharmacy services even before the COVID-19 pandemic. One of the facilitating factors for the successful adoption of telepharmacy is acceptance [18], by either current or future pharmacists. Therefore, early assessment of pharmacy students’ knowledge and perception is important to measure their acceptance of telepharmacy services. Adequate knowledge and perception can enhance their willingness to provide telepharmacy services in their future careers [19,20,21]. Such information is needed for developing and implementing capacity-building initiatives in pharmacy students. However, to date, no study has assessed the level of knowledge, attitude, and willingness of pharmacy students to provide telepharmacy services in any form in Indonesia, limiting evidence-based policy for its adoption. Therefore, we aimed to assess the level of knowledge, perception, and willingness to provide telepharmacy services and to identify factors associated with a high knowledge level and positive perception of telepharmacy among pharmacy students in Indonesia.

Methods

Study design, population, and setting

We applied a multicenter cross-sectional survey design among pharmacy students in three public universities in Bandung City, Surabaya City, and Special Region of Yogyakarta in Indonesia from August to September 2022. All pharmacy students of these universities were deemed eligible. Pharmacy students who did not live in Indonesia over the last 3 years were excluded.

The study was approved by the Health Research Ethics Committee of Universitas Padjadjaran, Indonesia (no. 614/UN6.KEP/EC/2022). A written informed consent was obtained electronically before proceeding with the survey. This study was reported according to the Strengthening the Reporting of Observational Studies in Epidemiology guidelines for cross-sectional studies [22] (Table S1, Supplementary data).

Data collection

Students registered in a bachelor of pharmacy from all study levels (first to fourth years) were approached online by a convenience sampling technique. The link to the survey and study information outlining the brief description of the study were exclusively administered online using Qualtrics through individual and group chats with the assistance of their respective class representatives. The questionnaire could only be filled once from a single email address to avoid duplicate entries. To ensure anonymity, the names and email addresses of the students were not recorded. The survey took an average of 10 min to complete. The questionnaire consisted of four sections, namely, demographic characteristics, knowledge, perception, and willingness to provide telepharmacy services. Questions about knowledge, perception, and willingness to provide telepharmacy services were based on a previously published study [23]. We followed the guidelines developed by The International Society for Pharmacoeconomics and Outcome Research (ISPOR) for the adaptation process of the questionnaires [24]. The questionnaire was translated into Indonesian (forward translation) and retranslated into English (back translation) by two independent professional language translators. The translated version of the questionnaire was shared with three experts in clinical pharmacy from pharmacy academicians. Subsequently, expert opinion regarding the clarity of each item was considered before finalizing the questionnaire. Following content and face validity, a pilot study was conducted on 34 pharmacy students to verify the comprehensibility of the questionnaire. As a consequence, we modified the original version of the questionnaire based on feedback and cross-validation analysis, particularly on the questions to assess willingness of pharmacy students to provide telepharmacy services. Out of the original six willingness questions, only one question was utilized in this study due to the presence of multicollinearity. Furthermore, we have removed a question related to the willingness to pay for the telepharmacy application. This question was deemed not applicable to our target population of students, and its inclusion would have introduced confusion and potential bias to the study results.

The Indonesian version of the questionnaire showed to be valid (the correlation values of each question to the total score were > 0.679, > 0.645, and > 0.346 for knowledge, perception, and willingness to provide telepharmacy services, respectively) and reliable (Cronbach alpha coefficients of 0.782, 0.797, and 0.651 for knowledge, perception, and willingness to provide telepharmacy services, respectively).

Demographic characteristics

This section explored the diversity of students, which may be associated with their knowledge, perception, and willingness to provide telepharmacy services using questions on age on completion of the questionnaire, sex (male and female), and grade point average (GPA). Factors related to their experience in using a smartphone were also explored, such as perceived expertise in smartphone usage (beginner, expert, or advance), duration of smartphone use in a day (1–4 or ≥ 5 h), and availability of internet access at home (yes or no).

Knowledge of telepharmacy services

Knowledge of telepharmacy services was assessed using the following five questions: “To what extent are you familiar with the benefits of telepharmacy?,” “To what extent are you familiar with telepharmacy applications and platforms in Indonesia?,” “To what extent are you familiar with the use of telepharmacy abroad?,” “To what extent are you familiar with recently released guidelines of telepharmacy in Indonesia?,” and “To what extent do you participate in conferences and webinars related to telepharmacy?” [23]. Items in this section were rated based on a 5-point Likert scale ranging from “1 = very low” to “5 = very high.” We categorized the knowledge total score based on the Bloom cut-off point as follows: students with a total score between 20 (80%) and 25 (100%) were categorized as having a high knowledge level; a total score between 15 (60%) and 19.75 (79%), moderate knowledge; and a total score of < 15 (< 60%), low knowledge [25, 26].

Perception of telepharmacy services

Perception of telepharmacy services was assessed by the following five statements: “Telepharmacy is a viable approach for providing comprehensive healthcare to the patient,” “Telepharmacy enables the adoption of technology in healthcare,” “Telepharmacy saves time and reduces effort (workload),” “Telepharmacy helps in reducing the cost of service,” and “There are existing telepharmacy applications in Indonesia that can be easily adopted” [23]. Items in this section were classified using dichotomous scores: “agree” (1 point) and “disagree” (0 points). The total score of < 2.5 (50%) was categorized as a negative perception, whereas a total score of ≥2.5 (50%) was categorized as a positive perception of telepharmacy services [23].

Willingness to provide telepharmacy services

This section assessed the willingness of students to provide telepharmacy services in their future careers based on this question: “Are you willing to integrate telepharmacy with the existing system to provide care in the future?” [23]. Items in this section were classified using dichotomous scores: “agree” (1 point) and “disagree” (0 points).

Sample size calculation

The sample size was calculated using Slovin’s formula [27] because no prior knowledge on outcomes distributions is available. To obtain a 95% confidence interval (CI) and a margin error of 0.10 based on a statistical power of 80%, a minimum sample size of 300 pharmacy students was needed.

Data analysis

Descriptive statistics were used to summarize the characteristics of the pharmacy students. Multicollinearity was analyzed before entering variables into the multivariate regression analysis using the variance inflation factor. Two regression models were used, each for knowledge and perception of telepharmacy services. Ordinal regression analysis was conducted to assess univariate and multivariate associations of pharmacy students’ characteristics with their knowledge of telepharmacy services. Binary logistic regression analysis was conducted to assess univariate and multivariate associations of pharmacy students’ characteristics with their perception of telepharmacy services. The odds ratio (OR) and 95% confidence interval (CI) were reported. A p-value of < 0.05 was considered statistically significant. All statistical analyses were performed using IBM SPSS Statistics for Windows version 27.0 (IBM Corp., Armonk, NY, USA).

Results

Baseline characteristics

A total of 313 pharmacy students were included in this study, 83.4% were female (mean age, 20 years), 76.7% were perceived as expert in smartphone usage, and 78.0% used smartphones for > 5 h a day (Table 1). Although only 13.2% showed a high knowledge level, 66.5% showed a positive perception of telepharmacy services and 97.4% were willing to provide telepharmacy services in the future (Table 1).

Table 1 Characteristics of the respondents (N = 313)
Full size table

Among pharmacy students with knowledge of telepharmacy services, 24.6% were highly and 1.9% were very highly familiar with the benefits of telepharmacy, however 31.6% have low and 8.9% have very low familiarity with its applications and platforms in Indonesia (Fig. 1). Moreover, 48.9% have low and 16.0% have very low familiarity with the recent released guidelines of telepharmacy in Indonesia and 45.7% have low and 24.0% have very low participation in any telepharmacy-related training (Fig. 1.).

Fig. 1
figure 1

Responses to knowledge about telepharmacy services (N = 313)

Full size image

Most of the pharmacy students perceived that telepharmacy offered several benefits such as the provision of comprehensive healthcare to the patient (97.4%), adoption of technology in healthcare (99.4%,), saving time and reducing effort (96.2%), and reduction of the cost of service (86.3%). However, 77.3% of them agree that there are existing telepharmacy applications in Indonesia that can be easily adopted (Fig. 2.).

Fig. 2
figure 2

Responses to perception of telepharmacy services (N = 313)

Full size image

Factors associated with knowledge and perception of telepharmacy services

No significant multicollinearity was observed (variance inflation factors < 10). In the adjusted multivariate model, an increase in age (OR 1.33; 95% CI 1.14–1.54) and being an expert (OR 2.52; 95% CI 1.28–4.99) and advance (OR 5.21; 95% CI 2.03–13.42) in smartphone usage are associated with an increased likelihood of having a high knowledge level relative to moderate and low level of knowledge about telepharmacy services (Table 2). Meanwhile, male students (OR 0.46; 95% CI 0.24–0.85) are associated with a lower likelihood of having a positive perception of telepharmacy services (Table 3).

Table 2 Factors associated with a high knowledge level of telepharmacy services (N = 313)
Full size table
Table 3 Factors associated with a positive perception of telepharmacy services (N = 313)
Full size table

Discussion

Although only a small number of pharmacy students in our study showed a high knowledge level, most of them showed a positive perception and willingness to provide telepharmacy services in the future. An increase in age is associated with an increased likelihood of having a high knowledge level of telepharmacy services. Being a male student is associated with a lower likelihood of having a positive perception of telepharmacy services.

We observed that the proportion of female pharmacy students (74.4%) is higher than male pharmacy students (16.6%) in this study which is in line with national data showing that females will represent around 86% of pharmacists in Indonesia by 2030 [28]. We further observed that the level of knowledge of telepharmacy among pharmacy students in this study is lower than those of pharmacy students in Malaysia [21] and the USA [29] in which majority of the respondents also female pharmacy students. While most of them recognized the benefits of telepharmacy services, more than half of them were not aware of telepharmacy applications and its recent guidelines in Indonesia. The reason is that telepharmacy applications have not yet been made widely available in Indonesia as compared with telemedicine [30]. The prominence and availability of telemedicine services have garnered more attention and resources compared to telepharmacy in Indonesia, which might explain the low level in knowledge among more than half of pharmacy students. Furthermore, this lack of knowledge of telepharmacy services (e.g., medication selection, order review and dispensing, patient counselling and monitoring) may be attributed to the lack of regulations, insufficient information dissemination, and inadequate marketing of telepharmacy platforms. Another reason for the unsatisfactory level of knowledge is the absence of telepharmacy training courses in the curricula. Only a few pharmacy students are educated regarding telepharmacy, which is understandable because of the low number of students having attended any telepharmacy-related training through conferences or webinars. Therefore, an approach to promoting the adoption of telepharmacy services is to expose pharmacy students to telepharmacy practices earlier during their education in bachelor degree [11, 31, 32] as it has a great influence on their knowledge and opinion regarding their future work [20]. The integration of telepharmacy services into training programs has been shown to improve students’ comprehension of drug therapy problems and their capacity to communicate patient care plans [33, 34].

Despite only a small number of pharmacy students showing a high knowledge level, the majority of them showed a positive perception and willingness to provide telepharmacy services in the future. This is in line with the results of previous studies conducted among pharmacy students in the USA [29] and medical and allied healthcare students in India [23]. In the present study, students’ perceptions of telepharmacy services appear favorable, i.e., they agreed that telepharmacy services would benefit them in terms of saving time and workload. However, they remain unaware of existing telepharmacy applications that can be easily adopted in Indonesia. Again, this might be due to insufficient information dissemination and inadequate marketing of telepharmacy platforms. Furthermore, a smaller percentage of students were skeptical about the possibility of telepharmacy in reducing the cost of service, particularly if telepharmacy devices or services were overpriced. This is an important factor for decision makers to make telepharmacy services affordable and accessible. Moreover, the introduction of mandatory telepharmacy courses in the curriculum may improve students’ perceptions. This was demonstrated by a study conducted among undergraduate students in Australia where a statistically significant difference in perceptions was found before and after the eHealth workshop [35].

Furthermore, nearly all pharmacy students in our study were willing to provide telepharmacy services in the future, which is an important prerequisite for the successful adoption of telepharmacy services. This could indicate that telepharmacy services have the potential to be well implemented in future pharmacy practice in Indonesia, particularly beyond the COVID-19 pandemic. However, other factors should be also considered in implementing telepharmacy, such as regulation, infrastructure, facility, and patient acceptability [36, 37].

An increase in age is associated with an increased likelihood of having a high knowledge level of telepharmacy services. Older age may have higher exposure to diverse materials of pharmacy curriculum–including telepharmacy, due to their higher semester level. However, it is important to consider that a significant number of them still have limited engagement in telepharmacy-related activities in this study. Furthermore, being an expert and advance in smartphone usage are associated with an increased likelihood of having a high knowledge level of telepharmacy services compared to a beginner. The higher self-reported expertise in smartphone usage may be indicating the higher eHealth literacy [38] which may lead to their high knowledge level of telepharmacy services. Meanwhile, male students are associated with a lower likelihood of having a positive perception of telepharmacy services. This is surprising because men were previously reported to have a greater affinity for technology than women, which is reflected by a higher adoption of eHealth and telemedicine [39]. On the other side, men may have a negative perception of telepharmacy due to their concerns regarding the intricacies and technical aspects of the technology involved such as security concern, as they have greater affinity for technology [39]. The use of technology and remote communication in telepharmacy can lead to concerns about the security and privacy of personal health information, as well as doubts about the confidentiality and reliability of telepharmacy services [40]. Several strategies can be employed to promote a more positive perception, such as emphasize the robust security measures in place to protect patient information and ensure confidentiality, highlight the encryption protocols, secure platforms, and establish regulatory frameworks that govern the development and management health information technology systems [41,42,43].

In this study, no association was found between internet access at home, expertise in smartphone usage, and duration of smartphone use toward knowledge about telepharmacy services. This may be due to digitalization where everyone has access to the internet regardless of smartphone-related factors.

To the best of our knowledge, this is the first study conducted in Indonesia to assess the knowledge, perception, and willingness to provide telepharmacy services in a higher education setting. Furthermore, this study was conducted in different universities in different regions of Indonesia, which strengthens the generalizability of the results. However, some limitations should be acknowledged. Data collection using an online questionnaire has several methodological drawbacks: the lack of a trained interviewer to clarify the information provided can lead to less reliable data, and voluntary participation can result in participants with biases selecting themselves into the sample. However, the characteristics of pharmacy students in this study are comparable with other studies conducted among pharmacy students in Indonesia [44, 45]. We could not calculate the response rate because of the lack of data regarding the number of potentially eligible students who refused to participate in this study. However, as expected, the response rates in online surveys were lower than those in paper-based surveys [46]. We also could not draw causal inferences regarding the temporal associations between potential factors and outcomes. Furthermore, as with any survey, the data used were self-reported; thus, this study is prone to desirability bias. Although this study achieved the estimated sample size, we believe that a large sample from more cities in Indonesia may provide slightly different results. A stepwise approach was used to determine the variables that should be included in the model, which may be prone to chance findings. Future studies should justify the choice for potential variables included in the model based on literature. Moreover, our models had a relatively low pseudo-R-squared. This implies that other unmeasured factors may be associated with knowledge and perception of telepharmacy services among pharmacy students to varying degrees.

Our findings indicate a gap between the knowledge expected to implement telepharmacy services and the willingness of pharmacy students to provide such services in Indonesia. Previous findings that the general population in Indonesia had a positive perception and were willing to use telepharmacy services [47] are an opportunity for pharmacy students. The education system in Indonesia must enhance its responsiveness and capacity to respond to current needs. As such, efforts should be directed toward capacity building for pharmacy students. Specifically, telepharmacy practice models must be included as a subject course in the curriculum, better preparing future pharmacists to perform their roles effectively. Future studies can be conducted with faculty and staff for the assessment of their perceptions on the feasibility to include tele-education into the pharmacy curricula.

Conclusion

Despite the limited knowledge of telepharmacy, the majority of pharmacy students reported a positive perception and willingness to provide telepharmacy services in their future careers. Student-specific factors such as age and expertise in smartphone usage that associated with knowledge and gender that associated with perception should be considered to facilitate telepharmacy adoption in Indonesia.

Data Availability

The datasets used and/or analysed during the current study available from the corresponding author on reasonable request.

References

  1. Koster ES, Philbert D, Bouvy ML. Impact of the COVID-19 epidemic on the provision of pharmaceutical care in community pharmacies. Res Soc Adm Pharm. 2021;17:2002–4. https://doi.org/10.1016/J.SAPHARM.2020.07.001.

    Article  Google Scholar 

  2. Sekine I, Uojima H, Koyama H, Kamio T, Sato M, Yamamoto T, Fukaguchi K, Fukui H, Yamagami H. Impact of non-pharmaceutical interventions for the COVID‐19 pandemic on emergency department patient trends in Japan: a retrospective analysis. Acute Med Surg. 2020;7. https://doi.org/10.1002/ams2.603.

  3. Baldoni S, Amenta F, Ricci G. Telepharmacy services: Present status and future perspectives: a review. Med. 2019;55:1–12. https://doi.org/10.3390/medicina55070327.

    Article  Google Scholar 

  4. Li H, Zheng S, Liu F, Liu W, Zhao R. Fighting against COVID-19: innovative strategies for clinical pharmacists. Res Soc Adm Pharm. 2020. https://doi.org/10.1016/j.sapharm.2020.04.003.

    Article  Google Scholar 

  5. Hamid H, Masood RA, Khalid W, Saqlain M, Tariq H, Munir MU. Emerging pharmacy services; recommendations for emergency care of COVID-19 pandemic in low and middle-income countries. Pak J Pharm Sci. 2020;33:1735–8. https://doi.org/10.36721/PJPS.2020.33.4.REG.1735-1738.1.

    Article  Google Scholar 

  6. Crilly P, Kayyali R. A systematic review of Randomized controlled trials of Telehealth and Digital Technology Use by Community pharmacists to Improve Public Health. Pharmacy. 2020;8:137–53. https://doi.org/10.3390/pharmacy8030137.

    Article  Google Scholar 

  7. Diedrich L, Dockweiler C. Video-based teleconsultations in pharmaceutical care – a systematic review. Res Soc Adm Pharm. 2021;17:1523–31. https://doi.org/10.1016/J.SAPHARM.2020.12.002.

    Article  Google Scholar 

  8. Pathak S, Blanchard CM, Moreton E, Urick BY. A systematic review of the Effect of Telepharmacy Services in the Community Pharmacy setting on Care Quality and Patient Safety. J Health Care Poor Underserved. 2021;32:737–50. https://doi.org/10.1353/hpu.2021.0102.

    Article  Google Scholar 

  9. Rothwell M, Hogan A. Clinical pharmacists connecting with patients in rural and remote towns via telehealth. 13th Natl Rural Heal Conf (2015)1–14. Available at: http://www.ruralhealth.org.au/13nrhc/images/paper_Rothwell, Michelle.pdf.

  10. Alam S, Osama M, Iqbal F, Sawar I. Reducing pharmacy patient waiting time. Int J Health Care Qual Assur. 2018;31:834–44. https://doi.org/10.1108/IJHCQA-08-2017-0144.

    Article  Google Scholar 

  11. Smith AC, Thomas E, Snoswell CL, Haydon H, Mehrotra A, Clemensen J, Caffery LJ. Telehealth for global emergencies: implications for coronavirus Disease 2019 (COVID-19). J Telemed Telecare. 2020;26:309–13. https://doi.org/10.1177/1357633X20916567.

    Article  Google Scholar 

  12. Edirippulige S, Brooks P, Carati C, Wade VA, Smith AC, Wickramasinghe S, Armfield NR. It’s important, but not important enough: eHealth as a curriculum priority in medical education in Australia. J Telemed Telecare. 2018;24:697–702. https://doi.org/10.1177/1357633X18793282.

    Article  Google Scholar 

  13. Medina MS, Plaza CM, Stowe CS, Robinson ET, Delander G, Beck D, Melchert R, Supernaw R, Roche V, Gleason B et al. Center forthe Advancement of Pharmacy Education (CAPE) Educational Outcomes 2013. Am J Pharm Educ (2013) 77:Article 162. Available at: http://www.aacp.org/resources/education/cape/Open Access Documents/CAPEEducationalOutcomes2013.pdf.

  14. Bingham JM, Rossi MA, Truong H-A. Addressing the need for a telehealth readiness assessment tool as a digital health strategy. J Am Pharm Assoc. 2022;1–4. https://doi.org/10.1016/j.japh.2022.04.016.

  15. Dickinson D. Please take a seat in the virtual waiting room: Telepharmacy education in the pharmacy curriculum. Curr Pharm Teach Learn. 2022;14:127–9. https://doi.org/10.1016/j.cptl.2021.11.034.

    Article  Google Scholar 

  16. Skoy ET, Eukel HN, Frenzel JE, Schmitz TM. Performance and perceptions: evaluation of pharmacy students’ consultation via telepharmacy. J Pharm Technol. 2015;31:155–60. https://doi.org/10.1177/8755122514568123.

    Article  Google Scholar 

  17. Cen ZF, Tang PK, Hu H, Cavaco AC, Zeng L, Lei SL, Ung COL. Systematic literature review of adopting eHealth in pharmaceutical care during COVID-19 pandemic: recommendations for strengthening pharmacy services. BMJ Open. 2022;12:1–11. https://doi.org/10.1136/bmjopen-2022-066246.

    Article  Google Scholar 

  18. Alhmoud E, Al Khiyami D, Barazi R, Saad M, Al-Omari A, Awaisu A, El Enany R, Al Hail M. Perspectives of clinical pharmacists on the provision of pharmaceutical care through telepharmacy services during COVID-19 pandemic in Qatar: a focus group. PLoS ONE. 2022;17:1–19. https://doi.org/10.1371/journal.pone.0275627.

    Article  Google Scholar 

  19. Chellaiyan V, Nirupama A, Taneja N. Telemedicine in India: where do we stand? J Fam Med Prim Care. 2019;8:1872. https://doi.org/10.4103/jfmpc.jfmpc_264_19.

    Article  Google Scholar 

  20. MacNeill V, Sanders C, Fitzpatrick R, Hendy J, Barlow J, Knapp M, Rogers A, Bardsley M, Newman SP. Experiences of front-line health professionals in the delivery of telehealth: a qualitative study. Br J Gen Pract. 2014;64:e401–7. https://doi.org/10.3399/bjgp14X680485.

    Article  Google Scholar 

  21. Elnaem MH, Akkawi ME, Al-shami AK, Elkalmi R. Telepharmacy Knowledge, perceptions, and readiness among future Malaysian pharmacists amid the COVID-19 pandemic. Indian J Pharm Educ Res. 2022;56:09–16. https://doi.org/10.5530/ijper.56.1.2.

    Article  Google Scholar 

  22. von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP. The strengthening the reporting of Observational studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. J Clin Epidemiol. 2008;61:344–9. https://doi.org/10.1016/j.jclinepi.2007.11.008.

    Article  Google Scholar 

  23. Malhotra P, Ramachandran A, Chauhan R, Soni D, Garg N. Assessment of Knowledge, Perception, and willingness of using Telemedicine among Medical and Allied Healthcare Students studying in private institutions. Telehealth Med Today. 2020;1–14. https://doi.org/10.30953/tmt.v5.228.

  24. Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, Erikson P. Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures: report of the ISPOR Task Force for Translation and Cultural Adaptation. Value Heal. 2005;8:94–104. https://doi.org/10.1111/j.1524-4733.2005.04054.x.

    Article  Google Scholar 

  25. Feleke BT, Wale MZ, Yirsaw MT. Knowledge, attitude and preventive practice towards COVID-19 and associated factors among outpatient service visitors at Debre Markos compressive specialized hospital. PLoS ONE. 2021;16:e0251708. https://doi.org/10.1371/journal.pone.0251708.

    Article  Google Scholar 

  26. Bloom BS, Engelhart MD, Furst EJ, Hill WH, Krathwohl DR. Taxonomy of Educational objectives: the classification of Educational goals. Handbook I: cognitive domain. New York: David McKay Company; 1956.

    Google Scholar 

  27. Almeda JV, Capistrano T, Sarte G. Elementary statistics. Diliman Quezon City: University of the Philippines Press; 2010.

    Google Scholar 

  28. Meilianti S, Smith F, Kristianto F, Himawan R, Ernawati DK, Naya R, Bates I. A national analysis of the pharmacy workforce in Indonesia. Hum Resour Health. 2022;20:1–12. https://doi.org/10.1186/s12960-022-00767-4.

    Article  Google Scholar 

  29. Patel K. Assessment of Knowledge, attitude, perception of Pharmacy Students towards Telepharmacy. Appl Res Proj. 2021;75:1–51. https://doi.org/10.21007/chp.hiim.0072.

    Article  Google Scholar 

  30. Rahayu FR, Ramadhan IS, Hendriani R. Review Artikel: Pelaksanaan Telefarmasi Pada Pelayanan Kefarmasian Di Farmasi Komunitas. J Pharm Sci. 2023;6:273–80.

    Google Scholar 

  31. Marrone O, Lombardi C, Parati G. Effects of continuous positive airway pressure therapy on Hypertension control in patients with sleep-related breathing disorders: available evidence and unresolved issues. J Hypertens. 2010;28:2012–5. https://doi.org/10.1097/HJH.0b013e32833f0e7e.

    Article  Google Scholar 

  32. Edirippulige S, Armfield NR. Education and training to support the use of clinical telehealth: a review of the literature. J Telemed Telecare. 2017;23:273–82. https://doi.org/10.1177/1357633X16632968.

    Article  Google Scholar 

  33. Porter AL, Frenzel JE, Siodlak MM. Assessment of a two-school collaborative telepharmacy simulation. Curr Pharm Teach Learn. 2022;14:215–21. https://doi.org/10.1016/j.cptl.2021.11.020.

    Article  Google Scholar 

  34. Frenzel J, Porter A. The need to educate pharmacy students in telepharmacy and telehealth. Am J Pharm Educ. 2021;85:809–12. https://doi.org/10.5688/ajpe8566.

    Article  Google Scholar 

  35. Edirippulige S, Samanta M, Armfield NR. Assessment of Self-Perceived Knowledge in e-Health among undergraduate students. Telemed e-Health. 2018;24:139–44. https://doi.org/10.1089/tmj.2017.0056.

    Article  Google Scholar 

  36. Ridho A, Alfian SD, Boven JFM, Van LJ. Digital Health Technologies to improve medication adherence and treatment outcomes in patients with Tuberculosis: systematic review of randomized controlled trials corresponding author. J Med Internet Res. 2022;24:1–13. https://doi.org/10.2196/33062.

    Article  Google Scholar 

  37. Alfian SD, Insani WN, Puspitasari IM, Wawruch M, Abdulah R. Effectiveness and process evaluation of using digital health technologies in pharmaceutical care in low- and middle-income countries: A systematic review of quantitative and qualitative studies. Telemed and e-Health. 2023;29(9) 1289–1303. https://doi.org/10.1089/tmj.2022.0406.

  38. Blebil AQ, Dujaili JA, Mohammed AH, Loh LL, Chung WX, Selvam T, Siow JQ. Exploring the eHealth literacy and mobile health application utilisation amongst Malaysian pharmacy students. J Telemed Telecare. 2023;29:58–71. https://doi.org/10.1177/1357633X221077869.

    Article  Google Scholar 

  39. Zhang X, Guo X, Lai K, Guo F, Li C, Studies M, Kong TH. Understanding gender differences in m-Health adoption: a modified theory of reasoned action model. Telemed e-Health. 2014;20:39–46. https://doi.org/10.1089/tmj.2013.0092.

    Article  Google Scholar 

  40. Awotunde JB, Jimoh RG, Folorunso SO, Adeniyi EA, Abiodun KM, Banjo OO. “Privacy and Security Concerns in IoT-Based Healthcare Systems BT - The Fusion of Internet of Things, Artificial Intelligence, and Cloud Computing in Health Care,” in, eds. P. Siarry, M. A. Jabbar, R. Aluvalu, A. Abraham, A. Madureira (Cham: Springer International Publishing), 105–134. https://doi.org/10.1007/978-3-030-75220-0_6.

  41. Thierer AD. The internet of things and Wearable Technology: addressing privacy and security concerns without Derailing Innovation. RICH JL TECH. 2015;6. https://doi.org/10.2139/ssrn.2494382.

  42. Sheikh A, Anderson M, Albala S, Casadei B, Franklin BD, Richards M, Taylor D, Tibble H, Mossialos E. Health information technology and digital innovation for national learning health and care systems. Lancet Digit Heal. 2021;3:e383–96. https://doi.org/10.1016/S2589-7500(21)00005-4.

    Article  Google Scholar 

  43. Kaplan B. Revisiting Health Information Technology Ethical, legal, and Social issues and evaluation: Telehealth/Telemedicine and Covid-19. Int J Med Inform. 2020;143:104239. https://doi.org/10.1016/j.ijmedinf.2020.104239.

    Article  Google Scholar 

  44. Kristina SARI, Widayanti AW, Sari IKAP. Investigating perceived stress among final-year pharmacy students in Indonesia. J Pharm Res. 2020;2:439–44. https://doi.org/10.31838/ijpr/2020.12.02.0067.

    Article  Google Scholar 

  45. Alfian SD, Ng H, Destiani DP, Abdulah R. Psychological distress induces poor Sleep Quality: a cross-sectional study of Pharmacy students in Bandung City, Indonesia Psychological Distress induces poor Sleep Quality : a cross-sectional study of Pharmacy students in Bandung City, Indonesia. Open Public Heal JJournal. 2018;111:369–75. https://doi.org/10.2174/1874944501811010369.

    Article  Google Scholar 

  46. Kongsved SM, Basnov M, Holm-christensen K, Hjollund NH. Response rate and completeness of questionnaires: a randomized study of internet Versus Paper-and-pencil versions. J Med Internet Res. 2007;9:e25. https://doi.org/10.2196/jmir.9.3.e25.

    Article  Google Scholar 

  47. Tjiptoatmadja NN, Alfian SD, Knowledge. Perception, and willingness to Use Telepharmacy among the General Population in Indonesia. Front Public Heal. 2022;10:1–6. https://doi.org/10.3389/fpubh.2022.825554.

    Article  Google Scholar 

Download references

Acknowledgements

We thank all students and research assistants for their effort and contributions.

Funding

Open access funding provided by University of Padjadjaran. This study was supported by grant-in-aid from Universitas Padjadjaran (No. 2203/UN6.3.1/PT.00/2022). This funding body did not have any role in designing the study, writing this article, and deciding to submit it for publication.

Open access funding provided by University of Padjadjaran

Author information

Authors and Affiliations

  1. Department of Pharmacology and Clinical Pharmacy, Faculty of Pharmacy, Universitas Padjadjaran, Jatinangor, Indonesia

    Sofa D. Alfian, Qisty A. Khoiry, Ivan S. Pradipta & Rizky Abdulah

  2. Drug Utilization and Pharmacoepidemiology Research Group, Centre of Excellence for Pharmaceutical Care Innovation, Universitas Padjadjaran, Jatinangor, Indonesia

    Sofa D. Alfian, Mochammad Andhika A. Pratama, Ivan S. Pradipta & Rizky Abdulah

  3. Center for Health Technology Assessment, Universitas Padjadjaran, Jatinangor, Indonesia

    Sofa D. Alfian

  4. Department of Pharmaceutics, Faculty of Pharmacy, Universitas Gadjah Mada, Yogyakarta, Indonesia

    Susi A. Kristina

  5. Department of Pharmacy Practice, Faculty of Pharmacy, Universitas Airlangga, Surabaya, Indonesia

    Elida Zairina

  6. Innovative Pharmacy Practice and Integrated Outcome Research (INACORE) Group, Universitas Airlangga, Surabaya, Indonesia

    Elida Zairina

  7. Center of Excellence for Patient Safety and Quality, Universitas Airlangga, Surabaya, Indonesia

    Elida Zairina

  8. Unit of PharmacoTherapy, -Epidemiology, & -Economics, Groningen Research Institute of Pharmacy, University of Groningen, Groningen, the Netherlands

    Eelko Hak

Authors
  1. Sofa D. Alfian
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Qisty A. Khoiry
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mochammad Andhika A. Pratama
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ivan S. Pradipta
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Susi A. Kristina
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Elida Zairina
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Eelko Hak
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Rizky Abdulah
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

SDA, QAK, ISP, SAK, EZ, EH, and RA were involved in protocol development; SDA and QAK were involved in gaining ethical approval; SDA, QAK, MAAP, ISP, SAK, EZ, EH and RA were involved in patient recruitment and data analysis. SDA wrote the first draft of the manuscript. All authors reviewed and edited the manuscript and approved the final version of the manuscript.

Corresponding author

Correspondence to Sofa D. Alfian.

Ethics declarations

Competing interests

The authors declare no competing interests.

Ethical approval and consent to participate

The study was approved by the Health Research Ethics Committee of Universitas Padjadjaran, Indonesia (no. 614/UN6.KEP/EC/2022). A written informed consent was obtained electronically before proceeding with the survey. The study was conducted in agreement with the Declaration of Helsinki.

Consent for publication

Not applicable.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary Material 1

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Alfian, S.D., Khoiry, Q.A., Andhika A. Pratama, M. et al. Knowledge, perception, and willingness to provide telepharmacy services among pharmacy students: a multicenter cross-sectional study in Indonesia. BMC Med Educ 23, 800 (2023). https://doi.org/10.1186/s12909-023-04790-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12909-023-04790-4

Keywords

BMC Medical Education

ISSN: 1472-6920

Contact us