We’re sorry, something doesn't seem to be working properly.
Please try refreshing the page. If that doesn't work, please contact support so we can address the problem.
Characteristics of student preparedness for clinical learning: clinical educator perspectives using the Delphi approach
BMC Medical Educationvolume 12, Article number: 112 (2012)
During clinical placements, clinical educators facilitate student learning. Previous research has defined the skills, attitudes and practices that pertain to an ideal clinical educator. However, less attention has been paid to the role of student readiness in terms of foundational knowledge and attitudes at the commencement of practice education. Therefore, the aim of this study was to ascertain clinical educators’ views on the characteristics that they perceive demonstrate that a student is well prepared for clinical learning.
A two round on-line Delphi study was conducted. The first questionnaire was emailed to a total of 636 expert clinical educators from the disciplines of occupational therapy, physiotherapy and speech pathology. Expert clinical educators were asked to describe the key characteristics that indicate a student is prepared for a clinical placement and ready to learn. Open-ended responses received from the first round were subject to a thematic analysis and resulted in six themes with 62 characteristics. In the second round, participants were asked to rate each characteristic on a 7 point Likert Scale.
A total of 258 (40.56%) responded to the first round of the Delphi survey while 161 clinical educators completed the second (62.40% retention rate). Consensus was reached on 57 characteristics (six themes) using a cut off of greater than 70% positive respondents and an interquartile deviation IQD of equal or less than 1.
This study identified 57 characteristics (six themes) perceived by clinical educators as indicators of a student who is prepared and ready for clinical learning. A list of characteristics relating to behaviours has been compiled and could be provided to students to aid their preparation for clinical learning and to universities to incorporate within curricula. In addition, the list provides a platform for discussions by professional bodies about the role of placement education.
Entry-level education of students within the allied health professions aims to equip graduates with the required knowledge, skills and professional behaviours to work safely and competently as contemporary health care professionals. At the core of entry-level education is the clinical education program that involves a symbiotic collaboration between clinical providers and universities. Broadly, clinical education involves learning clinical and professional skills in the workplace [1, 2]. This provides students with the opportunity to actively build and incorporate theoretical and practice knowledge, to socialise into a professional practice community and to understand the complexities of health care delivery [3, 4].
During clinical placements, students’ clinical learning is facilitated by clinical educators, also referred to as ‘preceptors’ or ‘clinical supervisors’ . While various models of supervision are used within the allied health professions [6, 7], clinical educators are generally responsible for facilitating the acquisition of profession-specific skills while students are out in the field . During this time, the relationship between the clinical educator and student is considered fundamental to the success of the learning opportunity [3, 9, 10]. To this end, a number of studies have attempted to define various skills, attitudes and practices that pertain to an ideal clinical educator and in doing so, have defined many characteristics to which clinical educators might aspire [9, 11–14]. This work generally implies that the presence of an educator with such characteristics is a major factor in ensuring a valuable clinical learning experience .
University programs also expect students to be actively engaged in contributing to their experience and determining appropriate learning outcomes. This is aligned with the principles and theory of adult learning. In the clinical context, this requires that educators collaborate with students’ to identify their learning needs, ensure they are provided with opportunities to be self-directed and develop a learning experience that supports the students’ level of interest. This enhances the opportunity for better student engagement and development of a relationship for learning. For the student, this requires that they are well prepared in terms of foundational knowledge and attitudes at the commencement of practice education. This infers that they accept a share of the responsibility for planning and preparing for the learning experience. Attention to preparation allows students’ to take full advantage of the clinical opportunity by making sense of their experiences. To achieve this, health professional curricula are generally sequenced to ensure that students are prepared for clinical learning prior to a specific clinical experience.
In the clinical setting, supervision of a poorly prepared student with an inadequate knowledge base adds to the demanding nature of the supervisory relationship. Thus, the onus for creating effective and successful relationships during clinical learning also falls to students who must present themselves as competent, professional and well prepared . Being well prepared will also maximise the learning a student gains from the placement. So what characteristics distinguish a competent, professional and well-prepared student to a clinical educator? A small body of work from Cross in the UK in the late 1990s evaluated the perceptions of university staff and clinical educators on the desirable and undesirable attributes of undergraduate physiotherapy students on clinical placement [10, 15, 16]. Desirable attributes included good communication skills, eagerness to learn, empathy and having a good knowledge base while undesirable attributes included being unsafe, unwilling to learn, arrogant and unprofessional [10, 15].
Since this work, professional practice and entry-level education has evolved with a greater focus on interprofessional collaboration as well as a focus on the acquisition of generic rather than profession-specific attributes [17–19]. In addition, this body of work evaluated physiotherapy students; no similar evaluation of student characteristics in other allied health professions has been published. Thus, the primary aim of this interprofessional project was to ascertain clinical educators’ views on the key characteristics that, in their opinion, demonstrate that an allied health student is well prepared at the start of a clinical placement. In this study, allied health students included students from occupational therapy, physiotherapy and speech pathology.
An observational approach using the Delphi technique that involved sequential on-line questionnaires interspersed by controlled feedback was used to gain consensus of opinion among clinical educators experienced with supervising occupational therapy, physiotherapy and speech pathology students . Controlled feedback was provided by presenting summaries of the data from each round to participants with the process continuing until group consensus is achieved . The Delphi technique is a widely used and accepted method for achieving consensus of opinion on a topic area solicited from experts within a field [20, 22, 23].
There were a number of advantages that made the Delphi technique suitable for exploring the issue of student preparedness for clinical learning opportunities . First, it had the advantage of maintaining anonymity among respondents while allowing time for participants to consider their response. The anonymity minimised the possibility that a dominant group member or group pressure for conformity may influence the outcome as may occur in a face-to-face meeting [21, 23]. Second, the technique allowed involvement of participants from diverse geographical locations and clinical backgrounds through the use of on-line and email communication. This was important as the sample consisted of allied health professionals located throughout Queensland in metropolitan, regional and remote areas. Third, the ability to use statistical analysis techniques allowed for objective and impartial analysis and summarisation of collected data . For these reasons, the Delphi method has been used commonly in educational research as a valuable method of exploring underlying assumptions leading to differing judgements . Approval for this study was obtained from the Human Research Ethics Committees of The University of Queensland and Queensland Health.
Two to three rounds of data collection are generally sufficient to elicit rich feedback and to reach consensus . Once consensus is reached, further rounds are not needed. It was envisaged that three rounds would be sufficient to reach consensus but if consensus was reached after two rounds, the process could be terminated. Participants were to be provided feedback in the form of group responses from each previous round.
Formation of the expert panel
The research team agreed to focus on the inclusion of clinical educators who engaged with students during block placements or who would be working with the same group of students over a number of weeks and for whom the learning relationship was a factor. Clinical educators who facilitated observational/one off experiences were not included in the expert panel. Thus, the expert panel consisted of clinical educators involved in the provision of clinical education to students enrolled in entry-level occupational therapy, physiotherapy and speech pathology programs at The University of Queensland during the preceding two years (2009/10). All clinical educators listed on The University of Queensland’s clinical educator mailing list were invited to participate. The list included only allied health staff with a designated clinical education role directly responsible for the supervision and assessment of students’ professional skills. All educators working with The University of Queensland are provided with training and support in the facilitation of student learning through the provision of regular clinical education workshops. An initial email was sent requesting involvement in the study. If clinical educators did not wish to be involved, they were requested to respond to this effect and were subsequently removed from the email list.
First round questionnaire
The first questionnaire was drafted and edited by all members of the project team. The questionnaire underwent several iterations during development and was finally piloted on three clinical educators considered to be representative of the sample population. Following further revisions, the first round questionnaire consisted of two sections. The first section of the questionnaire focused on item generation by asking one open-ended question. Here, participants were asked to describe what they believed were the key characteristics that indicate that a student is prepared for a clinical placement and ready to learn. The second section of the questionnaire sought demographic information such as gender, age, years experience and area of expertise. A link to the on-line questionnaire was emailed to participants along with relevant information about the study. Participants were informed that by accessing the link and completing the questionnaire they were providing their informed consent. Two reminder emails were sent to all prospective participants during a six-week period.
Second round questionnaire
The open-ended comments received for the first round were subject to a thematic framework analysis by the project team that used a staged approach . Each project member read and re-read the comments and then coded the interesting features of the data before collating into potential themes drawing on the study objectives. In a face to face meeting, the team consisting of members of each profession (occupational therapy, physiotherapy and speech pathology) discussed different themes and reach agreement on theme title. Each team member had evaluated responses from one of the three professions prior to the meeting. Then the project leader developed characteristics within each theme based on responses with similar meaning. This was then viewed by the whole team and amendments made where disagreement in interpretation occurred. Responses were discarded if they were incomprehensible or had no relationship to the study objectives.
The outcome was six themes:
Theme 1 Knowledge and Understanding - denoted responses relevant to students’ demonstrating knowledge and understanding of related theory, processes and tasks.
Theme 2 Willingness – denoted responses relevant to students willingness to engage, assist, learn and practice.
Theme 3 Professionalism – denoted responses relevant to students’ demonstration of professionals skills and behaviours
Theme 4 Communication and interaction – denoted responses relevant to students’ demonstration of communication and interactive ability.
Theme 5 Personal attributes- denoted responses relevant to students’ personal attributes such as their personality traits.
Theme 6 Skills – denoted responses that were relevant to the students demonstration of various professional and interpersonal skills.
Under each theme, there were a number of characteristics based on the open-ended responses. Each team member was responsible for categorising the characteristics under one or two themes. These were then agreed upon through email and verbal discussion. The final questionnaire asked participants their opinion of the relative value of these characteristics as representative of a student who, at the beginning of a placement, was prepared and ready to learn. A seven-point Likert Scale was used (1 = not important, 2 = slightly important, 3 = somewhat important, 4 = moderately important, 5 = important, 6 = very important, 7 = extremely important) as seven point scales have been found to be more reliable than five-point scales . The questionnaire was then emailed to participants who had responded to the first round. Again, two reminder emails were sent to non-respondents.
The responses to the first round were subject to a thematic analysis and demographic data were entered into Microsoft Excel for descriptive analysis. Data from the second questionnaire were reported as the means (SD) of the seven point Likert Scale. In addition, the interquartile deviation (IQD) for responses was calculated. The interquartile range is the absolute value of the difference between the 75th and 25th percentiles, with smaller values indicating higher degrees of consensus. An IQD of ≤ 1.00 has been identified as an indicator of consensus . However, Rayens and Hahn (2000) suggested using a secondary criterion such as the percentage of generally positive respondents to questions with an IQD ≤ 1.00 to indicate agreement . Commonly, a cut off of 70% generally positive respondents (5–7 on the Likert scale) means that if a factor has an IQD ≤ 1.00 and ≥ 70% of the respondents provided a positive response to this factor then it can be considered that consensus has been achieved. Finally, Cronbach’s alpha, a coefficient of reliability was used as a measure of the level of consistency of opinion among the respondents for each theme in the second round of the questionnaire. For comparing scales, alpha values of greater than 0.8 are regarded as good while those greater than 9 are regarded as excellent .
The first questionnaire was emailed to a total of 636 clinical educators in occupational therapy, physiotherapy and speech pathology. A total of 258 (40.56%) responded after reminder emails. There were an equal number of clinical educators from occupational therapy, physiotherapy and speech pathology with most working in metropolitan centres and 57 per cent of the sample having more than 5 years experience in clinical education (Table 1). The second questionnaire was sent to only those participants who had responded to the first questionnaire. A total of 161 clinical educators completed the second round. This represents a 62.40 per cent retention rate from round one and an overall response rate of 25.31 per cent of the original population.
The means and the IQD for each characteristic, along with the percentage of participants who agreed that the attributes were ‘important’, ‘very important’ or ‘extremely important’, are presented in Table 2. All factors reached consensus with IQD values equal to or less than 1. Of these, consensus was reached that five characteristics were not important (Table 2). Three were in the knowledge and understanding theme while two were in the professional attributes theme. For example, over 75 per cent of the sample perceived that it was not important that students demonstrated some understanding about the department or organisation where they will be undertaking the placement. Similarly, over 50 per cent perceived it as not important that a student demonstrates knowledge of other professions and their roles.
While there was agreement on 57 characteristics, educators tended to value characteristics within the themes of ‘willingness’, ‘professionalism’ and ‘personal attributes’ more than characteristics in the ‘knowledge and understanding’ theme (Table 2). Thus, views on student preparedness appear to be based on external professional traits, such as appropriate dress and appearance, and a willingness to be involved in learning and the placement rather than a specific level of knowledge and understanding.
Cronbach’s alpha for the second round of the Delphi process ranged between 0.85 and 0.93 (Table 3). This indicates a good to excellent degree of internal consistency in the responses for characteristics within each theme. As consensus was reached after the second round, there was no need for a third questionnaire.
This consensus study is the first to identify a range of characteristics perceived by clinical educators as indicators of an allied health student who is prepared and ready for a clinical learning opportunity. Six themes with a total of 57 characteristics were identified as being important. By conducting this study, a set of attributes relating to behaviours has been compiled and could be provided to students to aid their preparation for clinical learning. The final list of characteristics represents the consensus opinion of 161 experts in clinical education in Queensland, Australia. Of these, just over half the sample had more than five years experience as a clinical educator. In addition, we used several analytical methods (inter-quartile deviation, percentage agreement scores) to determine when consensus was reached. Cronbach’s alpha, which ranged between 0.85-0.94 for the second round, should be considered substantial and is consistent with reliability scores obtained for validated scales in clinical use . Our methodical and analytical approach, in addition to the solicitation of experienced clinical educators, ensures the developed list of attributes has content validity.
There are several interesting outcomes from this research. The first obvious finding is the large number of characteristics developed by the expert panel. However, some are not perceived to be as important as others. The three themes viewed as more important than others were ‘willingness’, ‘professionalism’ and ‘personal attributes’. For example, nine of 10 characteristics in the ‘willingness’ theme were viewed as important by over 90 per cent of participants. This contrasts to the theme ‘knowledge and understanding’ where only one of ten characteristics scored above 90 per cent. Thus, clinical educators’ views on preparedness appear based on external professional traits such as appropriate dress and appearance, along with a willingness to be involved in learning rather than a specific level of knowledge and understanding they portray commencing a placement. This may reflect the view that educators believe that knowledge takes longer to demonstrate or is developed in the context of clinical learning. Thus, it could be argued that perceptions of readiness to learn are represented by an initial phase that focuses on demonstrated external features of professional and interpersonal behaviours.
Second, the attributes developed by the expert panel were predominantly generic in nature. No attributes were raised that were profession-specific such as a particular clinical skill or assessment technique. This result is similar to that reported by Cross who identified eight constructs that were considered desirable for physiotherapy students on clinical placement: professional, abilities/persona, safety, communication, general disposition, knowledge base, approach to learning and commitment . In our study, the focus on generic attributes appeared to occur irrespective of the discipline. This finding reaffirms the focus by universities on students’ development of generic attributes and also suggests that educators believe that profession specific skills are likely to be consolidated during clinical placement.
Third, supervisors in this study appear to be focused on students’ readiness to engage in the learning environment through their personal attributes, willingness and demonstration of knowledge. The results support the status of these students as adult learners to take responsibility for their learning and demonstrate their willingness to activity engage. To build on the advantage of situated learning, educators and universities need to promote clinical learning experiences with learners as part of the clinical environment rather than being temporary adjuncts . The findings of this study promote understanding of how best to facilitate students’ transition into professional practice environments so they become more than a temporary adjunct.
A surprising outcome was the perception by our sample that it was not important for a student to demonstrate knowledge of other professions and their roles. Awareness of interprofessional practice is an important graduate skill . Our findings suggest that clinical educators may have viewed work-based learning as the location where students learn about and from other professions. Alternatively, the judgements of clinical educators are influenced by their professional competency statements that feed into the assessment tools used to evaluate students during clinical education placements . Across the professions, the assessment tools and overarching competency statements tend to encapsulate interprofessional engagement implicitly under an umbrella of descriptors such as professional communication and professional behaviour [32–34]. This explanation may account for the identification by clinical educators of traits such as ‘the student is willing to work as a team with peers, colleagues and other health professionals’ and ‘the student is able to communicate professionally with members of the multidisciplinary team.’
Another interesting finding is the absence of indicators relating to knowledge and use of technology. In a health and education environment where technology in the form of communication via e-health and telehealth systems is increasing in popularity, universities are addressing the use of technology for providing efficient and effective health outcomes . A possible interpretation is that clinical educators believe that these skills are inherent in every student and that, therefore, they do not need to be stated. An alternative explanation is that educators do not consider knowledge of technology practices an important skill for clinical practice. The latter explanation disregards contemporary thought about health and education practice but further investigation and clarification with educators would shed light on this disparity.
This Delphi study had a few limitations. First, the sample of clinical educators was from one state in Australia and may not be generalisable to other states or countries. Second, while the response rates are comparable to other similar studies, our response rate of 40.6 per cent and 25.3 per cent in the first and second rounds may have led to self selection bias . This means that the non-responders may have had systematically different responses than those who elected to respond. However, our retention rate between the two rounds suggests considerable interest in the topic by the responders. Third, there is an issue of whether or not the 'learned consensus' has validity beyond demonstrating the preconceptions of educators and encouraging students to 'play the game' by meeting these. Finally, while the educators were all involved in the provision of formal clinical block placements, there is the potential that each educator may have had different conceptions of teaching that may have impacted upon the results. To some degree, this was mitigated against by the Delphi methodology that encourages participants to reassess their initial judgments about the information provided in previous iterations. This approach created a list of characteristics that could be used by students to help them prepare for placements as it benchmarks the implicit views and consensus opinion of each of the three professions in Queensland. Further research is required to understand the basis for the views of the educators and whether there are differences in the perceptions between professions.
The Delphi methodology allowed the development of a consensus-based list of attributes that clinical educators perceived identify a student who is well prepared for clinical placement. While the list of characteristics is long, the list should be useful to educators involved in the preparation of students for clinical placement. The findings should also be useful to curricula developers as this study suggests preparation of students to undertake clinical learning goes beyond the acquisition of knowledge, understanding and skills to, perhaps more importantly, include attention on the development of personal attributes and interpersonal skills. In addition, the information contained within the themes could provide a platform for discussions by professional bodies about the role of placement education, underpinning philosophies and pedagogies in addition to challenging assumptions about professionals. Further research to refine the items in the list and evaluate differences between the perceptions of each profession is needed.
Chipchase L, Dalton M, Williams M, Scutter S: Is education immune from evidence-based scrutiny?. Aust J Physiother. 2004, 50 (3): 133-135.
Lekkas P, Larsen T, Kumar S, Grimmer K, Nyland L, Chipchase L, Jull G, Buttrum P, Carr L, Finch J: No model of clinical education for physiotherapy students is superior to another: a systematic review. Aust J Physiother. 2007, 53 (1): 19-28. 10.1016/S0004-9514(07)70058-2.
Ferguson K, Edwards H: Providing clinical education: the relationship between health and education. Educating Beginning Practitioners - Challenges for Health Profesional Education. Edited by: Higg J, Edwards E. 1999, Oxford: Butterworth Heinemann, 52-60.
Delany C, Bragge P: A study of physiotherapy students' and clinical educators' perceptions of learning and teaching. Med Teach. 2009, 31 (9): E402-E411. 10.1080/01421590902832970.
Rodger S, Webb G, Devitt L, Gilbert J, Wrightson P, McMeeken J: Clinical education and practice placements in the allied health professions: an international perspective. J Allied Health. 2008, 37 (1): 53-62.
Sheepway L, Lincoln M, Togher L: An international study of clinical education practices in speech-language pathology. Int J Speech Lang Pathol. 2011, 13 (2): 174-185. 10.3109/17549507.2011.491129.
Stiller K, Lynch E, Phillips AC, Lambert P: Clinical education of physiotherapy students in Australia: perceptions of current models. Aust J Physiother. 2004, 50 (4): 243-247.
Ernstzen DV, Bitzer E, Grimmer-Somers K: Physiotherapy students' and clinical teachers' perceptions of clinical learning opportunities: a case study. Med Teach. 2009, 31 (3): E102-E115. 10.1080/01421590802512870.
Cross V: Perceptions of the ideal clinical educator in physiotherapy education. Physiotherapy. 1995, 81 (9): 506-513. 10.1016/S0031-9406(05)66680-1.
Cross V: The same but different: a Delphi study of clinicians' and academics' perceptions of physiotherapy undergraduates. Physiotherapy. 1999, 85 (1): 28-39. 10.1016/S0031-9406(05)66061-0.
Irby DM: Clinical teacher-effectiveness in medicine. J Med Educ. 1978, 53 (10): 808-815.
Power R, Bogo M: Educating field instructors and students to deal with challenges in their teaching relationships. Clin Supervis. 2003, 21 (1): 39-58. 10.1300/J001v21n01_04.
Buchel TL, Edwards FD: Characteristics of effective clinical teachers. Fam Med. 2005, 37 (1): 30-35.
Yeates PJA, Stewart J, Roger Barton J: What can we expect of clinical teachers? Establishing consensus on applicable skills, attitudes and practices. Med Educ. 2008, 42 (2): 134-142. 10.1111/j.1365-2923.2007.02986.x.
Cross V: Begging to differ? Clinicians' and academics' views on desirable attributes for physiotherapy students on clincial placement. Assess Eval High Educ. 1998, 23 (3): 295-311. 10.1080/0260293980230306.
Cross V: Approaching consensus in clinical competence assessment: third round of a Delphi study of academics' and clinicians' perceptions of physiotherapy undergraduates. Physiotherapy. 2001, 87 (7): 341-10.1016/S0031-9406(05)60866-8.
Sherrill WW, Keels-Williams F: Mapping competencies for the multiskilled health care professional: an allied health curriculum reform project. J Allied Health. 2005, 34 (4): 185-191.
Cleak H, Williamson D: Preparing health science students for interdisciplinary professional practice. J Allied Health. 2007, 36 (3): 141-149.
Verma S, Broers T, Paterson M, Schroder C, Medves JMPRN, Morrison C: Core competencies: the next generation comparison of a common framework for multiple professions. J Allied Health. 2009, 38 (1): 47-53.
Vernon W: The Delphi technique: a review. Int J Ther Rehab. 2009, 16 (2): 69-76.
Hasson F, Keeney S, McKenna H: Research guidelines for the Delphi survey technique. J Adv Nurs. 2000, 32 (4): 1008-1015.
Keeney S, Hasson F, McKenna HP: A critical review of the Delphi technique as a research methodology for nursing. Int J Nurs Stud. 2001, 38 (2): 195-200. 10.1016/S0020-7489(00)00044-4.
Hsu C-H, Sandford BA: The Delphi technique - making sense of consensus. Practical Assess Res Eval. 2007, 12 (10): 1-8.
Braun V, Clark V: Using thematic analysis in psychology. Qualitative Research in Psychology. 2006, 3 (2): 77-101. 10.1191/1478088706qp063oa.
Alwin DF, Krosnick JA: The reliability of survey attitude measurement. Sociological Method Res. 1991, 20 (1): 139-181. 10.1177/0049124191020001005.
Raskin M: The Delphi study in field instruction revisited: results of a Delphi study. J Soc Work Educ. 1994, 30: 75-89.
Rayens M, Hahn E: Building consensus using the policy Dephi method. Policy Polit Nurs Pract. 2000, 1 (4): 308-315. 10.1177/152715440000100409.
Bland JM, Altman DG: Statistics notes: Cronbach's alpha. BMJ. 1997, 314 (7080): 572-10.1136/bmj.314.7080.572.
Graham B, Regehr G, Wright JG: Delphi as a method to establish consensus for diagnostic criteria. J Clin Epidemiol. 2003, 56 (12): 1150-1156. 10.1016/S0895-4356(03)00211-7.
Kaufman DM, Mann KV: Teaching and learning in medical education: how theory can inform practice. Understanding Medical Education: Evidence, Theory and Practice. Edited by: Swanwick T. 2010, Oxford: Wiley Blackwell, 16-36.
Trends in fieldwork education. Edited by: Smith M, Higgs J. 2010, RotterdamL: Sense Publishers
APC: Australian standards for physiotherapy. 2006, Canberra: Australian Physiotherapy Council
Australia OT: Australian minimum competency standards for new graduate occupational therapists. 2010, Brisbane: The University of Queensland
Australia SPA: Competency-based occupational standards for speech pathologists: entry level. 2011, Melbourne: Speech Pathology Australia
Lincoln M: The diversity challenge for universities and clinical educators. J Clin Pract Speech Lang Pathol. 2012, 14 (1): 2-6.
The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6920/12/112/prepub
This research was funded by a Queensland Health – Health Practitioner Research Scheme.
The authors report no declarations of interest.
All authors contributed to the concept and design, acquisition of data and interpretation of data. LC conducted the data analysis and wrote the first draft. All other authors were involved in revising the manuscript for important intellectual content and have given final approval of the version to be published.