Skip to main content

Translating and validating a Japanese version of the Patient Care Ownership Scale: a multicenter cross-sectional study

Abstract

Background

Patient care ownership (PCO) is an essential component in medical professionalism and is crucial for delivering high-quality care. The 15-item PCO Scale (PCOS) is a validated questionnaire for quantifying PCO in residents; however, no corresponding tool for assessing PCO in Japan exists. This study aimed to develop a Japanese version of the PCOS (J-PCOS) and validate it among Japanese medical trainees.

Methods

We performed a multicenter cross-sectional survey to test the validity and reliability of the J-PCOS. The study sample was trainees of postgraduate years 1–5 in Japan. The participants completed the J-PCOS questionnaire. Construct validity was assessed through exploratory and confirmatory factor analyses. Internal consistency reliability was examined by calculating Cronbach’s alpha coefficients and inter-item correlations.

Results

During the survey period, 437 trainees at 48 hospitals completed the questionnaire. Exploratory factor analysis of the J-PCOS extracted four factors: assertiveness, sense of ownership, diligence, and being the “go-to” person. The second factor had not been identified in the original PCOS, which may be related to a unique cultural feature of Japan, namely, a historical code of personal conduct. Confirmatory factor analysis supported this four-factor model, revealing good model fit indices. The analysis results of Cronbach’s alpha coefficients and inter-item correlations indicated adequate internal consistency reliability.

Conclusions

We developed the J-PCOS and examined its validity and reliability. This tool can be used in studies on postgraduate medical education. Further studies should confirm its robustness and usefulness for improving PCO.

Peer Review reports

Background

Medical professionalism has received increasing attention in recent years [1, 2]. In medical education, it has become an indispensable core competence. In 2002, professional attributes were enshrined in the Physician’s Charter on Medical Professionalism [3, 4]. This charter has now been endorsed by numerous national and international professional associations [5], thereby reflecting the growing importance of medical professionalism.

Patient care ownership (PCO) is a commonly recognized and crucial component of medical professionalism [6]. It has been defined as a cognitive-affective state in which physicians apply intellectual and emotional components during decision-making [7, 8]. PCO is considered an important competency to develop during residency training [6]. Developing the PCO of medical trainees is supposed to enhance their responsibility and accountability for patient care and to improve their clinical skills and patient outcomes [6]. However, since the implementation of duty-hour restrictions by the American Accreditation Council for Graduate Medical Education, concerns regarding the erosion of PCO among medical trainees have grown [7, 9,10,11].

Although various qualitative studies have been conducted on PCO, no quantitative measurement tools had been available to quantify it among residents until the PCO Scale (PCOS) was developed; it was developed and validated in the United States in 2019 [12]. The original PCOS questionnaire is a 15-item tool. The items represent eight different constructs associated with PCO: advocacy (three items); responsibility, accountability, and follow-through (four items); knowledge (one item); communication (one item); initiative (one item); continuity of care (one item); autonomy (three items); and perceived ownership (one item). The responses to these items are given on a seven-point Likert scale that ranges from 1 = strongly disagree to 7 = strongly agree. Exploratory factor analysis extracted three factors defined as assertiveness, being the “go-to” person, and diligence. The PCOS is intended for use in investigating interventions to nurture PCO and exploring the ways through which PCO influences physicians’ decision-making, behaviors, and patient outcomes.

In Japan, medical care has a history of being reliant on the overwork of doctors, particularly that of young physicians [13, 14]. Specifically, 40 % of doctors perform a level of work that exceeds the standard working hours put in by workers in other industries, and over 10 % of physicians work more than 1,860 h of overtime per year, which is approximately twice the karoshi line, that is, the number of hours beyond which a death is speculated to be related to overwork [15]. Owing to this serious problem of overwork, the government has passed restrictions concerning working hours that will go into effect for physicians in April 2024. The availability of a Japanese version of the PCOS will enable Japanese physicians, in the coming era of duty-hour regulations, to evaluate trainees’ PCO and to provide feedback to them. However, because the concept of PCO originated in Western countries, revalidating the assessment tool so that due attention is paid to the immediate cultural context is crucial. In addition, although the original questionnaire was intended solely for residents in internal medicine, its benefits could be broadened if it were expanded and used for trainees in other departments as well.

In this study, we aimed to develop a Japanese version of the PCOS (J-PCOS) for trainees from various medical specialties rather than only internal medicine. Moreover, we also sought to examine the validity and reliability of the instrument.

Methods

Setting

In Japan, medical students pass through a six-year undergraduate medical course of study, followed by a national licensing examination. The undergraduate program typically comprises four years of preclinical education and two years of clinical education. Those who pass the national licensing examination and aim to practice clinical medicine proceed to an obligatory two-year initial postgraduate clinical training program [16]. In this system, all trainees spend two years rotating through multiple specialties. The clinical departments that a trainee passes through within this rotation must include the following seven specialties: internal medicine, surgery, emergency medicine, pediatrics, psychiatry, community medicine, and obstetrics and gynecology. Trainees are also required to obtain clinical experience at a general ambulatory site [17]. Subsequently, and only after the two-year training, young physicians enter an advanced postgraduate clinical training program for medical specialties, which spans three years or more [18].

Translation process

With the consent of the original author (MD), we translated the PCOS into Japanese following suggested guidelines for the cross-cultural adaptation of self-reported measures [19]. Translators 1 (HF), 2 (DS), and 3 (KK) independently translated the PCOS into Japanese (Stage I, Translation) and subsequently worked together to coordinate the three translations to produce a complete draft (Ver. 1) (Stage II, Synthesis). All the translators were familiar with the cultures of the environments in which each language is used, and Translator 3 (KK) was a fluent bilingual speaker of English and Japanese.

We then requested bilingual individuals who were not involved in this study and had no knowledge of the original English version of the PCOS to back translate Ver. 1 into English (Ver. BT). Subsequently, we compared Ver. BT to the original English version and modified Ver. 1 (Ver. 2) (Stage III, Back Translation). Moreover, we obtained feedback on Ver. 2 from a PCO expert (YT) to establish the validity of Ver. 2 and then revised Ver. 2 based on their feedback (Ver. 3) (Stage IV, Expert Review). Further, we revised Ver. 3 based on feedback from the original author (MD) (Ver. 4). A pilot test of Ver. 4 was conducted among 21 respondents, who were then interviewed to determine whether the instrument was comprehensible and whether it had been understood as intended (Stage V, Pretesting). Because no problematic items emerged in the pilot test as a result of the translation process, we decided to consider Ver. 4 the final version. All the authors confirmed the instrument’s face and content validity.

Data collection

After obtaining their contact information from the Residency Electronic Information System, a database of teaching hospitals developed and maintained by the Japanese Ministry of Health, Labor, and Welfare, we communicated with 186 postgraduate clinical training hospitals in Japan. In total, 48 hospitals agreed to cooperate with our multicenter cross-sectional study. Between December 2020 and January 2021, we distributed an anonymous online survey of the PCOS to all the potential participants (n = 2688, postgraduate years [PGY] 1–5) at the 48 hospitals. Approximately three weeks after the initial invitation, reminders were sent out to increase the response rate.

Ethical considerations

All the participants provided consent to participate in the study. This study was approved by the Institutional Review Board of the University of Tokyo (2019362NI).

Statistical analysis

The construct validity of the J-PCOS was examined through both an exploratory and a confirmatory factor analysis (EFA and CFA, respectively). Because we aimed to develop a scale optimized for the Japanese medical education culture, EFA was performed first in this study.

First, in the EFA, a maximum likelihood estimation via the promax rotation method was used to explore the structure of the items. The number of factors to be extracted was determined by checking the initial eigenvalues for each factor and the scree plot. The cut-off value for factor loadings was set at 0.35.

Second, the factor structure identified in the EFA was further validated by means of a CFA. The model fitness was assessed with the comparative fit index (CFI), the Tucker–Lewis index (TLI), and the root mean square error of approximation (RMSEA). The guidelines suggest that the CFI and the TLI values should be close to or above 0.95 and the RMSEA should be close to or below 0.06 for a good model fit [20].

Third, the internal consistency reliability was examined using the Cronbach’s alpha coefficient and inter-item correlations. A Cronbach’s alpha value of 0.70 or higher indicates an acceptable internal consistency, and an inter-item correlation of 0.30 or higher is considered to indicate acceptable reliability [21].

Finally, the descriptive statistics of the factors and overall scale were extrapolated. All the data were analyzed using SPSS Statistics 27.0 (IBM Japan; Tokyo, Japan) and AMOS 23.0 (IBM Japan; Tokyo, Japan).

Results

Respondents’ characteristics

Of the 2,688 eligible participants, 437 (16.3 %) responded to the survey. There were no missing values in any of the responses. Table 1 shows the characteristics of the respondents. Although race or ethnicity was not asked in the questionnaire, most doctors working in Japan are Japanese. It can be assumed that most of the respondents to the questionnaire are Japanese.

Table 1 Respondents’ characteristics

Construct validity

In EFA, of the 15 items, the first item measuring responsibility, accountability, and follow-through dimension and the second item measuring autonomy dimension were excluded because their factor loadings were less than 0.35; the remaining 13 items were used for analysis. In total, four factors with factor loadings of 0.35 or greater were identified. The cumulative contribution rate of the four factors was 55.9 % (Table 2).

Table 2 Results of exploratory factor analysis

Next, a CFA was performed on these 13 items to determine the fit for the four-factor model (Fig. 1). All the factor loadings for each item onto each factor exceeded 0.35. The indices of the model fit were good (CFI = 0.955, TLI = 0.941, and RMSEA = 0.066). Following a discussion among the researchers, the four factors determined in this analysis were labeled as follows: assertiveness, sense of ownership, diligence, and being the “go-to” person.

Fig. 1
figure 1

Path diagram for the confirmatory factor analysis of the Japanese version of the Patient Care Ownership Scale

Internal consistency and descriptive statistics

Table 3 shows the internal consistency of and score distribution for the J-PCOS. The overall Cronbach’s alpha coefficient for the J-PCOS was 0.90. For the factors of assertiveness, sense of ownership, and being the “go-to” person, all the Cronbach’s alpha coefficients were above 0.70. However, the factor of diligence slightly failed to meet the 0.70 criterion.

Table 3 Descriptive statistics and internal consistency reliability of the Japanese version of the Patient Care Ownership Scale

The highest self-evaluation for PCO was observed in the factor of the sense of ownership (Factor 2), followed by that of assertiveness (Factor 1); the factor with the lowest scores was being the “go-to” person (Factor 4).

Thus, we had obtained a final version of the questionnaire in Japanese (Additional file 1).

Discussion

In this study, we translated and validated the 13 items developed for the J-PCOS. Both construct validity and internal consistency reliability were maintained by following a translation process for the items. To the best of our knowledge, the present research is the first to develop a Japanese version of the original scale.

Psychometric analysis methods were employed to evaluate the J-PCOS. Although the factor analysis supported the construct validity of the scale, the J-PCOS differed from the original PCOS in its factor structure. In particular, we extracted four factors, including a factor labeled “sense of ownership”, which was not identified in the original PCOS. This discrepancy may be due to a unique attribute of Japanese culture. Trainees in Japan take pride in the hard work that they perform and display a substantial amount of commitment [22]. The Japanese spirit of self-sacrifice, which is expressed throughout their medical careers, is a core quality of Bushido, the moral code of personal conduct that originated among the samurai—the ancient warriors of Japan. Although Japanese society is changing, this tradition continues to impact doctors and patients’ expectations of them [22,23,24].

In the evaluation of internal consistency reliability, the Cronbach’s alpha value for diligence (Factor 3) was not above the 0.70 threshold. However, because Cronbach’s alpha values are considerably sensitive to the number of items that are in the scale, finding low values for Cronbach’s alpha in short scales (especially in two-item scales) is common [25]. In such cases, it is more appropriate to show inter-item correlations. In this study, all inter-item correlations exceeded the optimum criterion, thereby indicating an adequate internal consistency reliability of the scale.

The findings of this multicenter, cross-sectional study show that the PCOS is a useful tool for measuring PCO in Japanese settings and that it exhibits good reliability and validity. The differences between the cultural, historical, and social roots of medical professionalism in Western and in East Asian countries [26] make the recent development of the J-PCOS a valuable addition for PCO assessments. Furthermore, while the original PCOS was validated only among PGY1–PGY3 internal medicine residents at a single institution, our J-PCOS showed a good validity for PGY1–PGY5 trainees from various departments at numerous institutions. The findings herein have broadened the target population, thereby increasing the range of who can be assessed for the PCOS, and may have a major impact on future research in this field. The J-PCOS could be used to investigate educational programs that are aimed at developing ownership, to explore how ownership influences patient outcomes, and to conduct research on postgraduate medical professionalism. When using J-PCOS, it is expected that the total score will be utilized. The factor scores for each of the four factors may also be useful in clinical education settings when detailed information on PCO is required.

Several potential limitations should be acknowledged. First, the response rate to the survey was relatively low, representing potential selection bias. In general, online surveys are much less likely to achieve a high response rate than paper-based surveys [27]. Because it is not uncommon for web surveys to have a response rate of 10 % or less [28], the response rate herein is considered acceptable. Second, although we assessed construct validity and internal consistency reliability, other forms of validity and reliability were not evaluated. For example, criterion-related validity, which could further consolidate the scale’s robustness, should be assessed. However, the lack of other validated scales prevented this examination. Test–retest reliability was also not evaluated. These properties of the scale should be examined in future studies. Third, we performed EFA and CFA in the same sample. The validity of the study might have been increased if the researchers used a larger sample and randomly split it into two independent groups (i.e., split-half validation). However, insufficient sample size, due in part to difficulties caused by the coronavirus 2019 pandemic, prevented us from using this method. Finally, this scale was designed for trainees working in an inpatient setting. Future research should revise the scale for application in outpatient settings as well as for attendings.

Conclusions

We translated the PCOS into Japanese to create the J-PCOS and verified its construct validity and internal consistency reliability. This scale can be used to investigate postgraduate medical professionalism. Further research to consolidate the robustness of the J-PCOS is warranted.

Availability of data and materials

All data are kept in an available format in a secure cloud provided by the University of Tokyo.

References

  1. Cruess SR, Cruess RL. Professionalism must be taught. BMJ. 1997;315:1674–7.

    Article  Google Scholar 

  2. Stern DT, Papadakis M. The developing physician–becoming a professional. N Engl J Med. 2006;355:1794–9.

    Article  Google Scholar 

  3. ABIM Foundation. American Board of Internal Medicine; ACP-ASIM Foundation. American College of Physicians-American Society of Internal Medicine; European Federation of Internal Medicine. Medical professionalism in the new millennium: a physician charter. Ann Intern Med. 2002;136:243–6.

    Article  Google Scholar 

  4. Medical Professionalism Project. Medical professionalism in the new millennium: a physicians’ charter. Lancet. 2002;359:520–2.

    Article  Google Scholar 

  5. ABIM Foundation. Endorsements of The Charter. https://abimfoundation.org/what-we-do/physician-charter/endorsements-of-the-charter. Accessed 14 Apr 2021.

  6. McLaren K, Lord J, Murray SB, Levy M, Ciechanowski P, Markman J, et al. Ownership of patient care: a behavioural definition and stepwise approach to diagnosing problems in trainees. Perspect Med Educ. 2013;2:72–86.

    Article  Google Scholar 

  7. Dubov A, Fraenkel L, Seng E. The Importance of Fostering Ownership During Medical Training. Am J Bioeth. 2016;16:3–12.

    Article  Google Scholar 

  8. Pierce JL, Kostova T, Dirks KT. The state of psychological ownership: Integrating and extending a century of research. Rev Gen Psychol. 2003;7:84–107.

    Article  Google Scholar 

  9. Jamal MH, Rousseau MC, Hanna WC, Doi SA, Meterissian S, Snell L. Effect of the ACGME duty hours restrictions on surgical residents and faculty: a systematic review. Acad Med. 2011;86:34–42.

    Article  Google Scholar 

  10. Pincavage AT, Dahlstrom M, Prochaska M, Ratner S, Beiting KJ, Oyler J, et al. Results of an enhanced clinic handoff and resident education on resident patient ownership and patient safety. Acad Med. 2013;88:795–801.

    Article  Google Scholar 

  11. Desai SV, Asch DA, Bellini LM, Chaiyachati KH, Liu M, Sternberg AL, et al. Education Outcomes in a Duty-Hour Flexibility Trial in Internal Medicine. N Engl J Med. 2018;378:1494–508.

    Article  Google Scholar 

  12. Djulbegovic M, Beckstead JW, Fraenkel L. The Patient Care Ownership Scale: Development of an Instrument to Measure Patient Care Ownership Among Internal Medicine Trainees. J Gen Intern Med. 2019;34:1530–7.

    Article  Google Scholar 

  13. Shibuya K, Unno N. Unpaid doctors in Japanese university hospitals. Lancet. 2019;393:1096–7.

    Article  Google Scholar 

  14. Fujikawa H, Son D, Eto M. Are residents learners or workers? A historical perspective in Japan. The Asia Pacific Scholar. 2021;6:122–4.

    Article  Google Scholar 

  15. Ministry of Health, Labour and Welfare. On the upper limit for overtime among doctors (in Japanese). Document 2 presented at the 19th Committee on the Work Style Reform of Doctors. 2019. https://www.mhlw.go.jp/content/10800000/000481338.pdf. Accessed 14 Apr 2021.

  16. Teo A. The current state of medical education in Japan: a system under reform. Med Educ. 2007;41:302–8.

    Article  Google Scholar 

  17. Ministry of Health, Labour and Welfare. Objectives, Strategies, and Evaluation in Residency Training. 2020. https://www.mhlw.go.jp/content/10800000/000719078.pdf. Accessed 14 Apr 2021

  18. Onishi H. History of Japanese medical education. Korean J Med Educ. 2018;30:283–94.

    Article  Google Scholar 

  19. Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the Process of Cross-Cultural Adaptation of Self-Report Measures. Spine. 2000;25:3186–91.

    Article  Google Scholar 

  20. Hu Lt, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Struct Equ Modeling. 1999;6:1–55.

    Article  Google Scholar 

  21. Robinson JP, Shaver PR, Wrightsman LS. Measures of personality and social psychological attitudes. 1st ed. San Diego: Academic Press; 1991.

    Google Scholar 

  22. Heist BS, Torok HM. Contrasting Residency Training in Japan and the United States From Perspectives of Japanese Physicians Trained in Both Systems. J Grad Med Educ. 2019;11:125–33.

    Article  Google Scholar 

  23. Nishigori H, Harrison R, Busari J, Dornan T. Bushido and medical professionalism in Japan. Acad Med. 2014;89:560–3.

    Article  Google Scholar 

  24. Ono M, Shinozuka M, Matsumura S, Takahashi M, Green J. Japanese people’s view of an ideal primary-care physician: a qualitative study. Asia Pac Fam Med (e-journal). 2005;4:31.

    Google Scholar 

  25. Streiner DL, Norman GR, Cairney J. Health measurement scales: a practical guide to their development and use. 5th ed. Oxford: Oxford University Press; 2015.

    Book  Google Scholar 

  26. Hodges BD, Ginsburg S, Cruess R, Cruess S, Delport R, Hafferty F, et al. Assessment of professionalism: recommendations from the Ottawa 2010 Conference. Med Teach. 2011;33:354–63.

    Article  Google Scholar 

  27. Fan W, Yan Z. Factors affecting response rates of the web survey: A systematic review. Comput Hum Behav. 2010;26:132–9.

    Article  Google Scholar 

  28. Van Mol C. Improving web survey efficiency: the impact of an extra reminder and reminder content on web survey response. Int J Soc Res Methodol. 2016;20:317–27.

    Google Scholar 

Download references

Acknowledgements

None declared.

Funding

None.

Author information

Authors and Affiliations

Authors

Contributions

HF designed the study and participated in the implementation, data analysis, and drafting of the manuscript. DS, KK, MD, YT, and ME contributed to the design of the study and critically reviewed the manuscript. All authors agree with the final version of this paper.

Corresponding author

Correspondence to Hirohisa Fujikawa.

Ethics declarations

Ethics approval and consent to participate

An ethical review was conducted and approved by the Institutional Review Board of the University of Tokyo (IRB approval number: 2019362NI). After giving their informed consent by checking the agree box in the web-based questionnaire, participants were enrolled in this study.

Consent for publication

Not applicable.

Competing interests

The authors declare no conflict of interest in association with the present study.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

Japanese version of the Patient Care Ownership Scale.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Fujikawa, H., Son, D., Kondo, K. et al. Translating and validating a Japanese version of the Patient Care Ownership Scale: a multicenter cross-sectional study. BMC Med Educ 21, 415 (2021). https://doi.org/10.1186/s12909-021-02853-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12909-021-02853-y

Keywords