Benefits of off-campus education for students in the health sciences: a text-mining analysis

  • Kazumasa Nakagawa1Email author,

    Affiliated with

    • Yasuyoshi Asakawa2,

      Affiliated with

      • Keiko Yamada3,

        Affiliated with

        • Mitsuko Ushikubo2,

          Affiliated with

          • Tohru Yoshida2 and

            Affiliated with

            • Haruyasu Yamaguchi2

              Affiliated with

              BMC Medical Education201212:84

              DOI: 10.1186/1472-6920-12-84

              Received: 25 June 2012

              Accepted: 22 August 2012

              Published: 28 August 2012

              Abstract

              Background

              In Japan, few community-based approaches have been adopted in health-care professional education, and the appropriate content for such approaches has not been clarified. In establishing community-based education for health-care professionals, clarification of its learning effects is required. A community-based educational program was started in 2009 in the health sciences course at Gunma University, and one of the main elements in this program is conducting classes outside school. The purpose of this study was to investigate using text-analysis methods how the off-campus program affects students.

              Methods

              In all, 116 self-assessment worksheets submitted by students after participating in the off-campus classes were decomposed into words. The extracted words were carefully selected from the perspective of contained meaning or content. With the selected terms, the relations to each word were analyzed by means of cluster analysis.

              Results

              Cluster analysis was used to select and divide 32 extracted words into four clusters: cluster 1—“actually/direct,” “learn/watch/hear,” “how,” “experience/participation,” “local residents,” “atmosphere in community-based clinical care settings,” “favorable,” “communication/conversation,” and “study”; cluster 2—“work of staff member” and “role”; cluster 3—“interaction/communication,” “understanding,” “feel,” “significant/important/necessity,” and “think”; and cluster 4—“community,” “confusing,” “enjoyable,” “proactive,” “knowledge,” “academic knowledge,” and “class.”

              Conclusions

              The students who participated in the program achieved different types of learning through the off-campus classes. They also had a positive impression of the community-based experience and interaction with the local residents, which is considered a favorable outcome. Off-campus programs could be a useful educational approach for students in health sciences.

              Keywords

              Community-based education School of health sciences Early exposure Role model Text-mining methods

              Background

              It is becoming increasingly expected of health-care professionals that they promote not only residents’ health and longevity but also their quality of life. The collapse of the community-based medical system has emerged as a major social problem in Japan, and so the training of health-care professionals involved in community-based medicine is an urgent need. We take it as given that model health-care professionals for future community-based medicine will also be committed to regional development measures.

              To meet the social expectations of health-care professionals, it is necessary to implement interdisciplinary and problem-based educational methods to broaden students’ outlooks and enhance their practical abilities in developing a proper professional outlook. O’Toole et al. [1] reported that community-based experience can provide unique, relevant learning opportunities in the context of a professional curriculum, which can complement existing practices in the medical school. Various approaches in community-oriented and community-based medical education have been adopted around the world [2], and it has been reported that a community-oriented medical school curriculum is effective for community-based education [3]. In the field of education for health-care professionals, Davidson et al. [4] introduced a community-based education system based on such core values as disease prevention and teamwork. In Japan, a curriculum that orients students toward community-based medicine has yet to emerge in medical education; however, few approaches have been adopted in allied health-care professional education in this country, and the appropriate content has yet to be determined. To establish community-based education for health-care professionals, clarification of the learning effects is requisite.

              In Gunma University, an off-campus education program was initiated as a community-based education program in 2009 as part of the course in health sciences; it received the support of the Ministry of Education, Culture, Sports, Science, and Technology. This off-campus program is part of the university’s health education program for students to gain experience in community-based settings (off-campus classes). It is expected to that this community-based health-care program will facilitate students’ understanding of residents’ needs and activities performed within the community.

              The purpose of the present study was to investigate the effect of the off-campus program on students and examine its application.

              Methods

              Overview of off-campus classes

              Gunma University has four schools in the Faculty of Health Sciences: Nursing (80 students per grade); Laboratory Sciences (40 students per grade); Physical Therapy (20 students per grade); and Occupational Therapy (20 students per grade). Students’ opportunity to gain experience in community-based settings with off-campus classes is a unique feature of the health education program at this university. The off-campus classes are open to all students, and were designed so that students could participate and acquire experience in project-related activities or events taking place in the local community with attending instructors in charge. For the present study, details relating to project activities or events considered suitable for off-campus learning were collected by university instructors involved in health sciences, and applicants were recruited from among the students.

              An outline of the off-campus classes at Gunma University appears in Figure1. To coordinate and manage this program, the Promotion Center of Community-Based Education was established; this involved instructors from each specialty, who supervised overall management and pre- and post-learning of off-campus classes in addition to instructors who taught such classes. The implementation method differed according to the class content, though the number of students (two to five) and duration of each class (3 or 4 hours) were similar among all the classes. Students who participated in this program were required to submit a self-assessment worksheet, summarizing their learning, self-reflection, and general impressions about the class they had participated in, as well as a portfolio with documentation relating to other self-learning outcomes after completing the class.
              http://static-content.springer.com/image/art%3A10.1186%2F1472-6920-12-84/MediaObjects/12909_2012_606_Fig1_HTML.jpg
              Figure 1

              Outline of the off-campus classes. 1 (introduction) → 2 (announcement) → 3 (participation).

              Since the above program was an optional course, students were free to participate as many times as they wished in their spare time as long as they were students at our university. Students who participated in the off-campus class, which was considered equivalent to an academic credit (approximately 50 hours including pre- and post-studies) in terms of time, were required to submit a report. Academic credits were awarded with the approval of the education committee of our university.

              The off-campus classes were roughly categorized into the following six areas of content: (1) contact with local middle-aged and elderly people; (2) contact with disabled people living in the local community; (3) participation in interventions that promoted events conducted in the community; (4) study and experience of activities of health-care professionals working in the community; (5) organizing student-led seminars for local residents; and (6) others. The content of the classes and some examples are presented in Table1. Each class was held just once, and a university lecturer was always in attendance as an instructor.
              Table 1

              Overview and some examples of off-campus classes

              Category

              Types -times

              Example

              Location

              Number of participants

              Contents

              Contact with local middle-aged and elderly people

              4 types 6 times

              Exercise class for middle-aged people

              City gym

              5

              Participation in the class and experience exercises with middle-aged people

                

              Exercise class for elderly people

              Community center

              3-5

              Experience to provide some exercises for elderly people with staffs

              Contact with disabled people living in the local com munity

              3 types 5 times

              Supporting project for amyotrophic lateral sclerosis (ALS) patients and family members

              Public installation

              8-10

              Participations and experiences in the event supported by the local community for ALS patients and family members

                

              Supporting project for cancer patients and family members

              Public installation

              8-10

              Participations and experiences in the event supported by the local community for cancer patients and family members

                

              Group activities with disabled children

              Disabled child education instruction

              2-3

              Participations and experiences in the activities supported by the local community for mentally and physically disabled children and family members

                

              Group rehabilitation project for persons with higher brain dysfunction and their family members

              Community center

              3-5

              Participations and experiences in the rehabilitation activities for persons with higher brain dysfunction and their family members.

              Participation in interventions to promote events conducted in the community

              2 types 2 times

              Interventions in health promotion and disease prevention events run by the local government

              Community hall in the city, etc…

              5-8

              Participation in events which showing and promoting some interventions or activities for the community-dwelling persons in the community, and experience to run the events with staffs.

              Study and experience of activities of healthcare professionals working in the community

              3 types 3 times

              Study of care managers’ work contents

              Care managers’ working places

              2-3

              Following a care manager and studying her or his work contents in the community.

                

              Experience of medical checkups for high school baseball players

              Practice ground of the high school

              3-5

              Following a physiotherapist and experiences in some measurements, and studying her or his work contents for sports injury prevention in the community.

                

              Conducting stretching exercises in the workplace

              Working place

              3-5

              Following a physiotherapist and experiences in some exercise instructions, and studying her or his work contents for working dysfunction prevention in the community.

              Organizing student-led seminars for community residents

              2 types 3 times

              Stretching exercise classes

              Public installation

              3-5

              Experiences to make stretching exercise programs for community-dwelling persons and instruct them.

                

              Urinary incontinence prevention classes

              Public installation

              3-5

              Experiences to provide information on urinary incontinence prevention for community-dwelling elderly women.

              Others

              3 types 3 times

              Agricultural experience program

              Experimental farm

              4

              Experiences to do farming and think about farmers’ care.

                

              Interaction with midwives working in the local community

              Institutions of midwives

              10

              Experiences to communicate with midwives working in the local community and think about community-based midwives’ activities.

              Subjects and data collection

              After the program was implemented though prior to analysis, informed consent was obtained from participating students. Students were informed that their decision regarding participation would not affect their academic grades and that they were free to withdraw their consent at any time. Students who did not consent to the study were excluded. This study was approved by the Epidemiological Research Ethics Committee of Gunma University Faculty of Medicine (No. 22–13).

              In all, 163 students (10 freshmen, 43 sophomores, and 48 junior and 62 senior students; 107 students in 2009, 56 in 2010) participated in the off-campus classes conducted between June 2009 and August 2010. This program consisted of 21 types of class and was conducted 42 times in total. The distribution of the subjects according to their years and specialties is shown in Table2. Among the 163 students, the results from 116, who submitted the self-assessment worksheet, were used for the purposes of this study.
              Table 2

              Number of participants in the off-campus program

              School

              Nursing sciences

              Laboratory Sciences

              Physical Therapy

              Occupational therapy

              Total

              Grade

              1

              2

              3

              4

              1

              2

              3

              4

              1

              2

              3

              4

              1

              2

              3

              4

               

              2009 FY

              0

              21

              17

              16

              0

              0

              1

              0

              4

              2

              19

              21

              6

              0

              0

              0

              107

              2010 FY

              0

              0

              10

              15

              0

              0

              0

              0

              0

              3

              1

              10

              0

              17

              0

              0

              56

              Total

              0

              21

              27

              31

              0

              0

              1

              0

              4

              5

              20

              31

              6

              17

              0

              0

              163

              The off-campus learning experience and general impressions were described in freely written texts in the self-assessment worksheets. The data from these worksheets were converted to anonymous electronic data and used for later analysis. The instructors involved in the students’ education were different from those involved in the data management; therefore, the students’ privacy was protected, and they could not be identified from the electronic data.

              Analytical methods

              A text-mining method was used for analysis; this involved using automated procedures for exploiting the enormous amount of knowledge that is available in the biomedical literature [5, 6]. In this study, IBM SPSS Text Analytics for Surveys 4 was employed for analysis, which is specialized for mining frequently used individual words; in dealing with a single word, it allows categorization not only by how many times the word is used but how many people use it. All the data were originally in Japanese and analyzed as Japanese words. After the research was completed, all the words were translated into English by the authors for the purposes of this report.

              From the list of terms mined, those commonly used by more than 10 students were selected. Various numbers of terms (n = 5, n = 10, n = 15, n = 20, etc.) were tested as cut-off values before we selected the appropriate values; we did this because it was difficult to conduct our analysis using too many occurrences of small numbers of extracted words. We excluded the following terms: those that lacked meaning when used as a single word, such as auxiliary verbs and words specific to the contents of the class; we also excluded those that were not relevant to this study. Terms that referred to the same meaning or content were grouped as single terms. Apart from grouping, all the analytical work was conducted by faculty members, who consulted with one another to ensure whether each word was appropriate for analysis.

              Relations among all the remaining terms were analyzed by hierarchical cluster analysis (furthest neighbor method). IBM SPSS 17.0J for Windows was used for the cluster analyses. Analytical results were presented as a dendrogram, within which divisional lines were drawn to determine the lines of understanding; the effect of the program on the students was investigated based on the resulting categories. The appropriate number of clusters was set using Beale’s pseudo F statistic, and the work of drawing lines on the dendrogram was carried out by faculty members, who consulted with one another to ensure which line was the best for appropriate categorizing.

              Results

              From the 116 self-assessment worksheets, 3,221 terms in 218 categories were extracted by text mining. After we selected the terms commonly observed among more than 10 students, 567 words in 74 categories resulted. Following exclusion and grouping, 32 words were used for the analysis. Cluster analysis produced the following four clusters: cluster 1—“actually/direct,” “learn/watch/hear,” “how,” “experience/participation,” “local residents,” “atmosphere in community-based clinical care settings,” “favorable,” “communication/conversation,” and “study”; cluster 2—“work of staff member” and “role”; cluster 3—“interaction/communication,” “understanding,” “feel,” “significant/important/necessity,” and “think”; cluster 4—“community,” “confusing,” “enjoyable,” “proactive,” “knowledge,” “academic knowledge,” and “class.” The results of the cluster analysis are presented in Figure2.
              http://static-content.springer.com/image/art%3A10.1186%2F1472-6920-12-84/MediaObjects/12909_2012_606_Fig2_HTML.jpg
              Figure 2

              Relationships among extracted terms (dendrogram). (* = Line for separation into 4 clusters).

              Discussion

              Japan ranks among the top countries in the world in terms of life expectancy, and as the proportion of its elderly people increases, issues about longevity and way of life for the older population have become increasingly problematic. Further, many health-care professionals have been sent from Japan to work in developing countries. From both a domestic and international perspective, health-care professionals need to develop multi-skilled abilities that are adapted to the residents in their communities. However, few programs for early clinical exposure to community settings have been reported for students in the health sciences (i.e., health-care professional students). At Gunma University, implementation of its off-campus program is the first structured approach in this direction. Analysis of the educational effect of this program may provide with information that will help it include community-based education in the health sciences curriculum.

              Regarding cluster 1, students’ overall impression of off-campus classes was considered “favorable.” Since our study results showed a combined use of experience-related terms (“actually/watch/learn/hear”) and terms about the community (“local residents/community-based clinical care settings”), we considered that the off-campus classes were highly evaluated and favorably accepted by the students. We expected the community-based learning to be different from university classroom education, and students who participated in the off-campus classes achieved different types of learning in community settings. This was deemed a favorable outcome since the students obtained a good impression of community intervention. Other reports [7, 8] have also noted that community-based medical education programs were rated favorably by students.

              Cluster 2, which consisted of “work of staff member” and “role,” was different from the other clusters. It was expected that this cluster would reveal favorable intervention effects, whereby the program would enable students to visualize their futures working in the community by seeing health-care professionals or medical staff actually doing such work. However, the results suggested that university classroom education and the professional roles required in community settings are poorly matched. Community-based education for medical students reportedly motivates the students in understanding the health-care needs of the community and its residents, and at the same time students can learn from health-care professionals working in actual clinical settings [9]; hence, it is expected that the off-campus program at Gunma University will contribute to the education and development of health-care professionals able to work in the community. In contrast, Worley et al. [10] reported on students’ academic performance in tertiary and regional hospitals and found that the effects of community-based clinical practice were no different from those of general practice in hospitals. Their study content, which focused on examination performance by medical students, differs from that in the present study. However, it is expected that an educational approach that enables students to improve their professional knowledge and skills with links to related subjects in other specialty areas will become increasingly adopted in the future.

              Regarding cluster 3, the following terms were commonly used: “communication with local residents,” “interaction,” “significant,” “important,” and “necessity.” Martini et al. [11] reported that a community-based curriculum strongly affects students’ career choices. It was also revealed by Howe et al. [12] that physicians’ choosing of careers in community-based settings is closely related to their experience of community-based medical education. Our results suggest that the students became aware of the significance of community interactions and started to become interested in community work. This psychological change is considered an important experience for students during their school years; thus, it is suggested that the students achieved effective learning through the off-campus classes.

              Cluster 4 indicated that the students “enjoyed” and were “proactive” in community care settings, though they may have felt some confusion with respect to the actual situation. Some written passages related to these terms—for example, “I didn’t know what I should do, so I was confused” and “I wanted to study in on-campus classes, not to become confused in these settings”—led to the above interpretation. O’Sullivan et al. [13] identified improvement in communication skills and promotion of active learning as relative advantages of community-based clinical education. The present study also found favorable outcomes in that the students enjoyed community-based learning through active participation in the off-campus classes. It is hoped that such off-campus learning experiences will have a synergistic effect on in-campus learning in the future.

              Four factors acted as limits in clarifying the effectiveness of off-campus classes in the present study. The first is variety in the content of different classes: every class has its own particular content, and students’ learning may have been influenced by participation in different classes. The second factor is variety among the students: students’ learning and their grades or schools may be closely related, and since community exposure is multi-factorial this alone cannot exert a major effect on the future roles of health-care professionals. The timing of the off-campus exposure may also have an impact on the trainees’ career choices. In this study, we were unable to exclude the influence of such timing, so this needs to be addressed in future studies. Third, only 116 of 163 students submitted the self-assessment worksheets, so it is possible that the results were biased. No attempt was made to obtain information from the 47 students who failed to complete their assessment sheets; future trials would need to collect data from such students. Fourth, no statistical evaluation of the inter-rater agreement was made in this study; every result was judged only by discussion among analyzers. We expected that in this way, we would be able to evaluate every mined term or category statistically to support the results or conclusions.

              Seabrook et al. [14] found that a community-based program was beneficial for both community organizations and schools. Members of community organizations were able to obtain information regarding the university curriculum, and schoolteachers had the opportunity to learn about current medical issues and their application in the community. It was reported by Meyer et al. [15] that community-academic partnerships contribute to the overall health of the community, and Calleson et al. [16] demonstrated the importance of the balance between community needs and university requirements for knowledge. The present study was conducted to investigate students’ learning; future studies should investigate outcomes by focusing on the local community, including residents and medical staff members.

              Conclusions

              The students who participated in the program achieved different types of learning through the off-campus classes. At the same time, they had a positive impression about community-based experience and interaction with the local residents, which is considered a favorable outcome. Thus, off-campus programs can be a useful educational approach. Along with academic learning, it is necessary to teach health-care professionalism to students within a community context and to examine study outcomes with off-campus programs targeted at a community.

              Declarations

              Acknowledgements

              We would like to thank the community facility members, local residents, and instructors at the Promotion Center of Community-Based Education at Gunma University for their cooperation.

              Authors’ Affiliations

              (1)
              Faculty of Health Care, Takasaki University of Health and Welfare
              (2)
              Graduate School of Health Sciences, Gunma University
              (3)
              Comprehensive Regional Support Center

              References

              1. O’Toole TP, Kathuria N, Mishra M, Schukart D: Teaching professionalism within a community context: perspectives from a national demonstration project. Acad Med 2005, 80:339–343.View Article
              2. Habbick BF, Leeder SR: Orienting medical education to community need: a review. Med Educ 1996, 30:163–171.View Article
              3. Hyppola H, Kumpusalo E, Virjo I, Mattila K, Neittaanmaki L, Halila H, Kujala S, Luhtala R, Isokoski M: Evaluation of undergraduate medical education in Finnish community-oriented and traditional medical faculties: a 10-year follow-up. Med Educ 2000, 34:1016–1018.View Article
              4. Davidson RA, Waddell R: A historical overview of interdisciplinary family health: a community-based interprofessional health professions courses. Acad Med 2005, 80:334–338.View Article
              5. Aaron MC, William H: A survey of current work in biomedical text mining. Brief Bioinform 2005, 6:57–71.View Article
              6. Huang J, An A, Hu V, Tu K: Medical text analytics tools for search and classification. Studies in Health Technol Inform 2009, 143:519–524.
              7. Leone-Perkins M, Schnuth RL, Lipsky MS: Students’ evaluations of teaching and learning experiences at community- and residency- besed practices. Fam Med 1999, 31:572–577.
              8. Lennox A, Petersen S: Development and evaluation of a community based, multiagency course for medical students: descriptive survey. BMJ 1998, 316:596–599.View Article
              9. Shannon CK, Baker H, Jackson J, Roy A, Heady H, Gunel E: Evaluation of a required statewide interdisciplinary rural health education program: student attitudes, career intents and perceived quality. Educ Health (Abingdon) 2005, 18:395–404.View Article
              10. Worley P, Esterman A, Prideaux D: Cohort study of examination performance of undergraduate medical students learning in community settings. BMJ 2004, 328:207–209.View Article
              11. Martini CJ, Veloski JJ, Barzansky B, Xu G, Fields SK: Medical school and student characteristics that influence choosing a generalist career. JAMA 1994, 272:661–668.View Article
              12. Howe A, Ives G: Does community-based experience alter career preference? New evidence from a prospective longitudinal cohort study of undergraduate medical students. Med Educ 2001, 35:391–397.View Article
              13. O’Sullivan M, Martin J, Murray E: Students’ perceptions of the relative advantages and disadvantages of community-based and hospital-based teaching: a qualitative study. Med Educ 2000, 34:648–655.View Article
              14. Seabrook MA, Lempp H, Woodfield SF: Extending community involvement in the medical curriculum: lessons from a case study. Med Educ 1999, 33:838–845.View Article
              15. Meyer D, Armstrong-Coben A, Batista M: How a community-based organization and an academic health center are creating an effective partnership for training and service. Acad Med 2005, 80:327–333.View Article
              16. Calleson DC, Jordan C, Seifer SD: Community-engaged scholarship: is faculty work in communities a true academic enterprise? Acad Med 2005, 80:317–321.View Article
              17. Pre-publication history

                1. The pre-publication history for this paper can be accessed here:http://​www.​biomedcentral.​com/​1472-6920/​12/​84/​prepub

              Copyright

              © Nakagawa et al.; licensee BioMed Central Ltd. 2012

              This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://​creativecommons.​org/​licenses/​by/​2.​0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.