Ambulatory teaching: Do approaches to learning predict the site and preceptor characteristics valued by clerks and residents in the ambulatory setting?
© Delva et al; licensee BioMed Central Ltd. 2005
Received: 01 June 2005
Accepted: 14 October 2005
Published: 14 October 2005
In a study to determine the site and preceptor characteristics most valued by clerks and residents in the ambulatory setting we wished to confirm whether these would support effective learning. The deep approach to learning is thought to be more effective for learning than surface approaches. In this study we determined how the approaches to learning of clerks and residents predicted the valued site and preceptor characteristics in the ambulatory setting.
Postal survey of all medical residents and clerks in training in Ontario determining the site and preceptor characteristics most valued in the ambulatory setting. Participants also completed the Workplace Learning questionnaire that includes 3 approaches to learning scales and 3 workplace climate scales. Multiple regression analysis was used to predict the preferred site and preceptor characteristics as the dependent variables by the average scores of the approaches to learning and perception of workplace climate scales as the independent variables.
There were 1642 respondents, yielding a 47.3% response rate. Factor analysis revealed 7 preceptor characteristics and 6 site characteristics valued in the ambulatory setting. The Deep approach to learning scale predicted all of the learners' preferred preceptor characteristics (β = 0.076 to β = 0.234, p < .001). Valuing preceptor Direction was more strongly associated with the Surface Rational approach (β = .252, p < .001) and with the Surface Disorganized approach to learning (β = .154, p < 001) than with the Deep approach.
The Deep approach to learning scale predicted valued site characteristics of Office Management, Patient Logistics, Objectives and Preceptor Interaction (p < .001). The Surface Rational approach to learning predicted valuing Learning Resources and Clinic Set-up (β = .09, p = .001; β = .197, p < .001). The Surface Disorganized approach to learning weakly negatively predicted Patient Logistics (β = -.082, p = .003) and positively the Learning Resources (β = .088, p = .003).
Climate factors were not strongly predictive for any studied characteristics. Role Modeling and Patient Logistics were predicted by Supportive Receptive climate (β = .135, p < .001, β = .118, p < .001).
Most site and preceptor characteristics valued by clerks and residents were predicted by their Deep approach to learning scores. Some characteristics reflecting the need for good organization and clear direction are predicted by learners' scores on less effective approaches to learning.
Medical care is increasingly delivered in the ambulatory care setting. Since learning in context improves learning it is appropriate and necessary that medical training occurs in the future practice setting [1, 2]. Teachers must organize the setting and approach teaching in this context in order to maximize learning.
We developed a survey instrument to assess the site and preceptor characteristics that clerks and residents believe to be most valuable to their learning in the ambulatory setting using validated questionnaires and study group consensus . Many items such as giving feedback and discussing clinical reasoning were valued by most learners, although there were some differences for learners from different specialties or at different training levels. A few site and preceptor characteristics, such as teaching in the patient's presence, thought to be important for learning were not valued. Learner preferences may be appropriate guides for teaching, but it is not clear that these preferences always support effective learning. Studies in higher education suggest that the approach to learning affects learning outcomes. The conceptual models of approaches to learning include both motivation for learning and the strategies to fulfill the motivation and are influenced by the context for learning. It is widely accepted that the deep approach to learning which includes an integrative approach to understanding, leads to improved learning outcomes while surface (or reproducing) approaches which depend on rote memorization, are less effective . Learners adopting surface approaches to learning may prefer site and preceptor characteristics that support their surface learning; instructors who follow those preferences may inadvertently undermine their own teaching!
Bowen and Irby, reviewed the quality and costs of education in the ambulatory setting and described what is known and the gaps in our knowledge . Many studies have been conducted in single institutions and in the traditional ambulatory specialties. Bowen and Irby suggest that a conceptual model examining the teacher-learner-setting framework is needed to understand the effectiveness of the ambulatory setting for learning.
Challenges in examining the effectiveness of a learning environment include the reliability of the evaluation method, confounding factors and the ability to generalize beyond single groups or institutions. One way to examine the complex interaction of the environment and the approach taken by learners in that environment is by measuring the approaches to learning in the workplace .
Our assumption in this study was that a deep approach to learning could be viewed as a surrogate for more effective learning and that a surface disorganized approach was less effective in most circumstances. Students who adopt a deep approach to learning may value characteristics of the learning environment and teaching that support this approach which differ from students who adopt less effective approaches to learning. It would seem appropriate then for teachers to attend to those site and preceptor characteristics that support a deep approach to learning. The purpose of this study was to answer the question: Do approaches to learning and perception of the workplace climate predict the site and preceptor characteristics valued by clerkship students and residents in the ambulatory setting?
All medical clerks (n = 532) and residents (n = 2939) at the five medical schools in Ontario were invited to respond to a survey regarding the site and preceptor characteristics most valued in the ambulatory setting and to complete the Workplace Learning Questionnaire. The study was approved by the Queen's University Research Ethics Board.
Definitions of site and preceptor factors (sample items rated from most important to least important)
Professional Role Modeling
Models professional behviours with staff and patients (Demonstrates effective interactions with support staff)
Quality and efforts to provide good teaching (Discusses clinical topics in an organized way)
Open and caring towards students and patients (Makes student feel like a valued member of the practice)
The provision of timely and constructive feedback. (Gives constructive feedback)
Provides specific instruction on the student's role and is focused (Outlines specific task(s) to be done during a clinical encounter)
Teaching with the patient present (Reviews case in the patient's presence)
Health Care System Interaction
Preceptor teaches about resource use. (Teaches use of community resources)
Site Characteristic Factor
Teaching skills related to the running of a practice (Teaching of time management skills)
Opportunity to see a number and variety of patients (Opportunity to see an adequate number of patients)
Defines and meets objectives (Clearly defined site objectives for the rotation)
Availability of resources in the clinic (Library resources available in the clinic)
Proximity and educational orientation of the clinic (Close proximity of clinic to campus)
Effective teachers who are available and willing to demonstrate (Preceptors readily available)
Questionnaires were mailed in bulk to the undergraduate and postgraduate medical schools and forwarded to all clerks and residents with addressed and stamped return envelopes. Responses were anonymous and a separate card was returned for entry into a draw for a personal digital assistant or equivalent monetary prize. An email reminder was sent four weeks later and follow up mailings were sent 8 and 20 weeks after the initial mailing.
Multiple regression analysis was used to predict the preferred site and preceptor characteristics as the dependent variables by the average scores of the approaches to learning and perception of workplace climate scales as the independent variables. Hierarchical modeling did not alter the results.
Of the population surveyed, 1642 responded (47.3%). Participants with 10% or more missing data (those who did not respond to items (54) and those who responded "not applicable" (27)) were excluded, leaving 1561 respondents for analysis. Missing values for the remaining participants were replaced with item means. The distribution of respondents was compared to the distribution of clerks and residents in Ontario. The proportions of women, junior residents, family medicine residents and McMaster trainees responding were higher and Toronto trainees lower than the population surveyed [3, 13].
Factor analysis revealed 7 preceptor factors and 6 site factors valued in the ambulatory setting . These are defined in Table 1 with sample scale items. The factor structure and reliability of the Workplace Learning questionnaire were confirmed for the population . Scales are presented in italics in the following discussion to emphasize that the associations are between scale scores.
Prediction of valued preceptor characteristics by approaches to learning and perception of workplace climate. (β coefficients)
Professional Role Modelling
Health Care System Interaction
Prediction of valued site characteristics by approaches to learning and perception of workplace climate. (β coefficients)
Climate factors were not strongly predictive (tables 2 and 3). Role Modeling and Patient Logistics were predicted by Supportive Receptive climate. Perception of heavy workload (Workload) predicted valuing Direction, Clinic Set-up and Objectives. Perception of Choice/Independence in the workplace weakly and negatively predicted valuing Feedback.
In this analysis of a multi-site, multi-level and multi-specialty study we found that higher scores on the Deep approach to learning scale predicted all of the learners' preferred preceptor characteristics, supporting the implementation of these in the ambulatory setting. The Deep approach to learning was in general more strongly associated with the valued preceptor factors than the valued site characteristics except for Direction.
Giving direction was more valued by learners with higher scores on the Surface Rational and Surface Disorganized scales. One interpretation may be the need for these learners to know what is expected of them. Although struggling learners may require this support, too close direction may interfere with the development of independence and life-long learning skills. We have found that physicians who take a predominantly deep approach to learning are self-motivated for learning and prefer independent methods for continuing medical education . In contrast, the physicians who score highly on surface approaches to learning are motivated by extrinsic factors such as regulating authorities or fear of a lawsuit . As Samuel Johnson wrote, "when a man knows he is to be hanged in a fortnight, it concentrates his mind wonderfully" but it is likely a costly and ineffective approach for independent life-long learning. Relying too heavily on "what is on the exam" or what the preceptor wants does not allow for self-assessment and may lead to less effective outcomes.
Learners' approaches to learning are not one or another, but more or less of the approaches measured and will vary with the context. In this study we did not find a significant influence in the models of the perception of the workplace climate on valued site or preceptor characteristics. We did confirm earlier finding that the approach to learning and perception of the workplace climate are associated [6, 12, 13]. Thus, it may be that when the learning climate is stressful, learners may shift from a preferred approach to learning, to one that helps them survive. The surface rational approach may be necessary in a busy clinic when there is little time for reflection. In this setting, the organization or clinic characteristics may become more salient to the learner.
McManus has shown that approaches to learning are predicted by personality and learning styles . Personality traits tend to be stable but learning styles and approaches to learning can be modified by formal education [16–18]. It may be important to encourage the struggling or dependent learner to become more self-directed. As workload is associated with surface approaches to learning, the challenge in the ambulatory setting will be to pace the patient volume and variety of problems to provide adequate time for learning with the aim of supporting deeper approaches to learning.
Dolmans and colleagues used path analysis to determine the importance of some variables influencing the effectiveness of student rotations at out-patient clinics in one medical school . Input variables, such as organizational quality, number of students contemporaneously involved and available space, and process variables, such as patient mix and supervision, were analyzed in relation to one output variable: the students' evaluation of the effectiveness of the rotation. Supervision was the most important influence on the student's perception of the effectiveness of the rotation. This finding is consistent with the stronger prediction of valued preceptor characteristics than site characteristics in our study.
Dolman's model focused on organizational variables and did not take into account differences in the students and how they learn. Biggs' model suggests that the student's approaches to learning are input variables that interact with the organizational variables to affect what students do to learn . The trend for site characteristics to be more strongly predicted by the Surface Rational approach to learning reflects the desire for good organization by some learners. Our findings extend Dolman's model to help teachers understand the different values placed on site and preceptor characteristics in the ambulatory setting by learners employing different approaches to learning.
This study has several limitations. First, the predictive power of approach to learning on valued site characteristics is small, suggesting that other factors we have not measured, such as personality, may be important in determining characteristics valued by the learners . Ability, expectations and prior knowledge may also be important. Secondly, approaches to learning are influenced by many factors and do not represent an outcome of the learning experience. Thirdly, deep learners may be effective learners in any setting. It is not know if adapting the setting or changing preceptor behaviours to those valued by these learners will be helpful for learners who take less effective approaches. Further work is required to assess whether changes in preceptor or site characteristics affect learning outcomes or shift the learner's approach to learning.
Most site and preceptor characteristics valued by clerks and residents were predicted by their Deep approach to learning scores validating these preferences. Preceptor characteristics are likely more important for learning than site characteristics. Some characteristics reflecting the need for good organization and clear direction are predicted by learners' scores on less effective, surface approaches to learning. These findings provide insight on the needs of more vulnerable learners.
The project was supported by a Research in Medical Education grant from the Canadian Institute of Health Research and Association of Canadian Medical Colleges. The authors would like to thank Jason Schmelzle for careful data entry and Rachelle Sequin for project management.
- Irby DM: Teaching and Learning in Ambulatory Care Settings: A Thematic Review of the Literature. Acad Med. 1995, 70 (10): 898-931.View ArticleGoogle Scholar
- Lesky LG, Hershman WY: Practical Approaches to a Major Educational Challenge. Arch Intern Med. 1995, 155: 897-904. 10.1001/archinte.155.9.897.View ArticleGoogle Scholar
- Schultz KW, Kirby JR, Delva MD, Godwin M, Verma S, Birtwistle RV, Knapper C: Medical Student's and Resident's Preferred Site Characteristics and Preceptor Behaviours for Learning in the Ambulatory Setting: A Cross-Sectional Survey. BMC Med Educ. 2004, 4 (1): 12-10.1186/1472-6920-4-12. (Aug 6, 2004)View ArticleGoogle Scholar
- Kember D, Biggs J, Leung DY: Examining the multidimensionality of approaches to learning through the development of a revised version of the Learning Process Questionnaire. Br J Educ Psychol. 2004, 74: 261-79. 10.1348/000709904773839879.View ArticleGoogle Scholar
- Bowen J, Irby DM: Assessing Quality and Costs of Education in the Ambulatory Setting: A Review of the Literature. Acad Med. 2002, 77: 621-680.View ArticleGoogle Scholar
- Kirby JR, Knapper CK, Evans CJ, Carty AE, Gadula C: Approaches to learning at work and workplace climate. Int J Training Dev. 2003, 7: 31-52. 10.1111/1468-2419.00169.View ArticleGoogle Scholar
- Vu NV, van der Vleuten CPM, Lacombe G: Medical students' learning processes: A comparative and longitudinal study. Acad Med. 1998, s25-s27. Supp 73Google Scholar
- Biggs JB: Student approaches to learning and studying. 1987, Melbourne:Australian Council for Educational ResearchGoogle Scholar
- Entwistle NJ, Tait H: Approaches to learning, evaluations of teaching, and preferences for contrasting academic environments. Higher Educ. 1990, 19: 169-194. 10.1007/BF00137106.View ArticleGoogle Scholar
- Entwistle NJ: Approaches to learning and perceptions of the learning environment. Higher Educ. 1991, 22: 201-204. 10.1007/BF00132287.View ArticleGoogle Scholar
- Ramsden P: Context and strategy. Situational influences on learning. Learning Styles and Strategies. Edited by: Schmeck RR. 1986, New York: Plenum Press, 159-184.Google Scholar
- Delva MD, Kirby J, Knapper C, Birtwhistle RV: Postal survey of approaches to learning among Ontario physicians: Implications for continuing medical education. BM J. 2002, 325: 1218-10.1136/bmj.325.7374.1218.View ArticleGoogle Scholar
- Delva MD, Kirby J, Schultz K, Godwin M: Assessing the Relationship of Learning Approaches to Workplace Climate in Clerkship and Residency. Acad Med. 2004, 79: 1120-1126. 10.1097/00001888-200411000-00025.View ArticleGoogle Scholar
- Kirby JR, Delva MD, Knapper C, Birtwistle RV: Development of the Approaches to Work and Workplace Climate Questionnaires for Physicians. Eval Health Prof. 2003, 26: 104-21. 10.1177/0163278702250097.View ArticleGoogle Scholar
- McManus IC, Keeling A, Paice E: Stress, burnout and doctors' attitudes to work are determined by personality and learning style: A twelve year longitudinal study of UK medical graduates. BMC Medicine. 2004, 2: 29-10.1186/1741-7015-2-29.View ArticleGoogle Scholar
- Biggs JB: Teaching for quality learning at university. 2003, Milton Keynes: SRHE Open University PressGoogle Scholar
- McManus IC, Richards P, Winder BC: Intercalated degrees, learning styles, and career preferences: prospective longitudinal study of UK medical students. Brit Med J. 1999, 319: 542-546.View ArticleGoogle Scholar
- Biggs JB, Rihn BA: The effects of intervention on deep and surface approaches to learning. Cognitive strategies and educational performance. Edited by: Kirby JR. 1984, Orlando FL: Academic Press, 279-293.Google Scholar
- Dolmans DH, Wolfhagen HA, Essed GG, Scherpbier AJ, Van Der Vleuten CP: Students' perceptions of relationships between some educational variables in the out-patient setting. Med Educ. 2002, 36: 735-41. 10.1046/j.1365-2923.2002.01280.x.View ArticleGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6920/5/35/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.