Papp, Klara K. PhD; Huang, Grace C. MD; Lauzon Clabo, Laurie M. PhD, RN; Delva, Dianne MD; Fischer, Melissa MD, MEd; Konopasek, Lyuba MD; Schwartzstein, Richard M. MD; Gusic, Maryellen MD
Dr. Papp is professor and associate dean, Penn State College of Medicine, Hershey, Pennsylvania.
Dr. Huang is associate professor of medicine, Harvard Medical School, and director of assessment, Carl J. Shapiro Institute for Education and Research at Harvard Medical School and Beth Israel Deaconess Medical Center, Boston, Massachusetts.
Dr. Lauzon Clabo is dean and professor, MGH Institute of Health Professions School of Nursing, Boston, Massachusetts.
Dr. Delva is chair and professor, Department of Family Medicine, Faculty of Medicine, University of Ottawa, Ottawa, Ontario, Canada.
Dr. Fischer is associate professor of medicine and associate dean for undergraduate medical education, University of Massachusetts Medical School, Worcester, Massachusetts.
Dr. Konopasek is associate professor of pediatrics (education), Weill Cornell Medical College, and designated institutional official, NewYork-Presbyterian Hospital, New York, New York.
Dr. Schwartzstein is Ellen and Melvin Gordon professor of medicine and medical education and faculty associate dean for medical education, Harvard Medical School, vice president for education, Beth Israel Deaconess Medical Center, and executive director, Carl J. Shapiro Institute for Education and Research at Harvard Medical School and Beth Israel Deaconess Medical Center, Boston, Massachusetts.
Dr. Gusic is professor of pediatrics, Dolores and John Read professor of medical education, and executive associate dean for educational affairs, Indiana University School of Medicine, Indianapolis, Indiana.
Please see the end of this article for information about the authors.
Funding/Support: None reported.
Other disclosures: None reported.
Ethical approval: Reported as not applicable.
Correspondence should be addressed to Dr. Papp, Office of Medical Education MC H123, 500 University Dr., PO Box 850, Hershey, PA 17033-0850; telephone: (717) 531-0003 ext: 281249; fax: (717) 531-4786; e-mail: firstname.lastname@example.org.
Critical thinking, a key component of competence across all domains, underlies health professionals’ abilities and performance1–3; its deficit leads to cognitive biases that contribute to diagnostic and therapeutic errors.4,5 Decades of empirical and theoretical literature in health professions education have conceptualized critical thinking as “clinical judgment,” “clinical reasoning,” “diagnostic thinking,” “problem solving,” and “type 2 thinking”—constructs that emphasize the mental processes that clinicians use to think through problems and arrive at decisions.6–10 However, the following definition of critical thinking focuses on both qualities and habits of mind: “the ability to apply higher-order cognitive skills (conceptualization, analysis, evaluation) and the disposition to be deliberate about thinking (being open-minded or intellectually honest) that lead to action that is logical and appropriate” (adapted from Scriven and Paul11). The primacy of critical thinking and the potential harm to patients when it is lacking support the premise that it should be elevated as its own competency.
Furthermore, critical thinking is increasingly important in an era when biomedical science is progressing exponentially and knowledge acquisition alone is insufficient for practitioners to function in complex clinical environments. As noted by Lawrence Summers, higher education in the future “will be more about how to process and use information and less about imparting it. [I]n a world where the entire Library of Congress will soon be accessible on a mobile device … factual mastery will become less and less important.”12 Health professionals must also contend with a great deal of misinformation and the fact that many aspects of scientific knowledge are riddled with uncertainty. Defining expertise in health care must extend beyond the traditional static notions of “knowledge plus experience” to a dynamic model of thought that, while still based on a thorough understanding of basic scientific principles, allows for creativity and the formation of new solutions to problems not previously encountered.13,14
Despite its importance, critical thinking remains a challenge to assess. Though cross-sectional studies have examined how novices compare to experts in solving clinical problems,15 the literature has not described the developmental milestones that a learner achieves in becoming an accomplished thinker.16 Many of the tools widely used to measure critical thinking are insufficient to assess it in a clinical context17; moreover, these tools have not established standards for how learners think and behave as they gain proficiency in critical thinking. One can no longer assume that a learner’s ability to think critically will develop naturally through observation of more senior clinicians; it must instead be taught and explicitly assessed. Specific assessment will ensure that struggling learners are identified and supported with educational interventions to develop critical thinking skills.
The goal of our work was to delineate milestones through which an individual learner in medicine or nursing may progress during the course of training and in practice, so as to better characterize the competency of critical thinking. We hope to promote further dialogue and provide a foundation on which to base the creation of resources for educators and to establish expectations for learners.
The Process of Developing Milestones for Critical Thinking
Nine teams of health professions educators representing 17 medical and nursing schools were selected to participate in a conference on critical thinking through an application process described in detail in a separate paper.18 The goals of the conference were to explore approaches to teaching critical thinking and to develop strategies for integrating principles of critical thinking more explicitly into the curricula across the continuum of medical and nursing education.
A subset of conference participants, who were medical and nursing education leaders with responsibilities at the undergraduate, graduate, and continuing education levels, volunteered at the end of the conference to serve on a task force to continue work in this area. The group was charged by the conference organizers to define stages (i.e., developmental milestones) of critical thinking for medicine and nursing across the continuum. The group met by conference call for one hour semimonthly from December 2011 to September 2012.
The task force reviewed and considered competency models within and outside of the medicine and nursing literature. Building on the conceptual framework first established by the Foundation for Critical Thinking,19 the milestones for critical thinking articulated here were also heavily influenced by the Dreyfus model of the stages of expertise,20 which has been applied extensively in nursing21 and in medicine.16 The language used in specialty board guidelines was an additional resource for creating the description of the milestones.22,23 Finally, looking beyond the health professions literature, the group considered Kegan’s24 model of identity development, which acknowledges that individuals can be in transition between stages of development.
Importantly, the task force achieved consensus on a number of fundamental points. Milestones do not lock a person into a single developmental state. Critical thinkers at any stage may regress under certain circumstances, such as confronting a demanding workload with sleep loss and fatigue, or emotional exhaustion brought about by personal problems. Competence in critical thinking is not automatically gained with increasing level of training or by competence in other domains. One cannot assume that clinicians with years in practice are accomplished critical thinkers; conversely, undergraduate nursing or medical students may already be highly developed critical thinkers.
After reviewing these frameworks, the task force created a matrix of attributes for each stage of critical thinking. The attributes were classified as “metacognitive abilities” (the ability to think about thinking), “attitudes” (dispositions towards critical thinking), and “skills” (referring primarily to cognitive skills). The group used an iterative consensus-building process to finalize the matrix. Finally, the group prepared an illustrative example to demonstrate how a teacher may use the matrix to identify a learner’s stage of developing competency in critical thinking.
The Stages of Critical Thinking
The milestones in developing competency in critical thinking correspond to six stages of thinking.
Stage 1: Unreflective thinker
Metacognition. The unreflective thinker does not demonstrate the ability to examine his own actions and cognitive processes. Lacking knowledge about cognition, he is unaware of different approaches to thinking and cannot examine either his own or others’ cognitive processes.
Attitudes. A lack of flexibility in the unreflective thinker’s thinking is manifested in his fixation on current working beliefs. He is unable to accept ambiguity or incorporate or adapt to new knowledge. Feedback that challenges his approach to reasoning is frequently met with a lack of insight.
Skills. He has a single approach to gathering and processing information based on crude scripts (e.g., rote memorization).
Stage 2: Beginning critical thinker
Metacognition. As a learner begins to think critically, she becomes aware of different approaches to thinking and starts to recognize cognitive differences in others. She requires external motivation to sustain reflection on her own thought processes.
Attitudes. Although receptive to feedback from others about her thinking, she rarely solicits it herself.
Skills. A beginning critical thinker sporadically uses different approaches to thinking and is able to gather information in a focused manner. The use of a limited number of approaches may lead her to arrive at incorrect conclusions or to include only the most likely explanations for observed phenomena. She recognizes the relevance of foundational principles related to decision making but, disconnecting theory from practice, does not apply them in action.
Stage 3: Practicing critical thinker
Metacognition. At this stage, the learner is familiar with metacognitive theories and applies conscious effort in his own critical thinking.
Attitudes. He demonstrates humility in acknowledging uncertainties, is open to challenges about his own thinking, and welcomes new approaches.
Skills. A practicing critical thinker can articulate multiple approaches to problem solving and use established principles to make sense of observations and guide decisions.
Stage 4: Advanced critical thinker
Metacognition. An advanced critical thinker has a solid repertoire of approaches to thinking and is able to identify the ways in which her own cognitive approach differs from others’. She consciously performs critical thinking and recognizes it as important and satisfying. She is adept at self-regulation and habitually seeks to overcome her gaps.
Attitudes. She actively solicits and accepts feedback and demonstrates a natural curiosity about alternative approaches to thinking.
Skills. She uses intuitive and analytical strategies interchangeably to solve problems, adjusts her thinking as is appropriate to the context, and avoids cognitive biases. She explicitly bases her thinking and approach to problem solving on, and makes them congruent with, fundamental principles and concepts.
Stage 5: Accomplished critical thinker
Metacognition. An accomplished critical thinker uses theories of metacognition to enhance his understanding and conceptualization of problems. At this stage, he takes charge of his thinking and habitually monitors, revises, and rethinks approaches for continual improvement of his cognitive strategies.
Attitudes. He strives to advance not only his own but also others’ approaches to thinking and openly acknowledges his assumptions and biases. He embraces uncertainty as a means to further understanding, goes beyond accepted “best thinking practices,” and is creative and innovative in approaches to solving problems.
Skills. An accomplished critical thinker models critical thinking to others and demonstrates the ability to “toggle” adeptly between analytical and intuitive approaches. He elaborates complex connections between basic principles to create plausible hypotheses to explain observed phenomena. He has the ability to create new knowledge or understanding by reasoning inductively in this way.
A devolved state: The challenged thinker
External forces may precipitate a devolved stage of thinking; examples include an emotionally taxing situation (e.g., family illness or a complex, novel and intricate situation), a disproportionate value placed on personal priorities (e.g., the desire to succeed), or threats to individual identity (e.g., encounters with prejudice based on gender or race). A challenged thinker differs from a beginning critical thinker in that, while the latter operates in ignorance, the former is in a state of resistance (conscious or subconscious) to what she already knows about critical thinking and problem solving. This state is viewed as temporary; with resolution of internal or external stressors, the challenged thinker returns to her typical stage of critical thinking.
Metacognition. The challenged thinker resists considering others’ perspectives, flouting prior knowledge of metacognition, and fails to recognize her own personal cognitive biases.
Attitudes. She is unwilling to reflect upon her own thoughts and approaches to problem solving and demonstrates intellectual conceit in justifying her own decision making.
Skills. She is firmly entrenched in a singular approach to thinking about the current problem and does not adjust when it would be appropriate to do so or when there are aspects of the problem that do not exactly fit the clinical situation.
An illustrative example
Appendix 1 displays responses to the clinical scenario requiring diagnostic reasoning from individuals at different stages of critical thinking. The task at hand focuses on the experience of a physician trainee, but is relevant across the spectrum of learners in both nursing and medicine. Keep in mind that milestones may manifest differently depending on the context within which critical thinking is applied. For example, early learners such as preclinical medical students and prelicensure nursing students may demonstrate critical thinking skills while conducting comprehensive patient assessment (taking a patient history or conducting a physical examination), whereas more advanced learners may reach a milestone while creating a differential diagnosis or management plan. Although the contexts differ by the specific learner’s professional role, the stages of critical thinking development remain the same.
Milestones of Critic...Image Tools
Because it underlies performance in other competency domains, critical thinking can be considered a “meta-competency,” or a set of attributes that are necessary for one to attain mastery across multiple competency domains.25 Competence in critical thinking underlies the “entrustable professional activities” for health professionals, which define their ability to effectively care for patients without supervision.26 We have identified milestones in critical thinking using an iterative, consensus-based process, to prompt consideration of strategies to both teach and assess the development of this skill for learners in the health professions. The milestones were created with the recognition that the development of this competency is independent of one’s level of training, although advanced knowledge and experience are likely to be associated with higher levels of critical thinking.
The example we provide to demonstrate how critical thinking stages are discerned among learners is intended to illustrate, in a concrete and specific way, how the milestones may apply in a given clinical situation; in particular, a diagnostic task. Not only can the milestones in critical thinking apply to other clinical skills, such as comprehensive assessment or management of a patient, but they can also be used outside of the patient care context to address the research, translational, and basic science problems that nurses and physicians encounter.
Critical thinking includes attitudes, such as self-awareness, the ability to self-reflect, and curiosity, which can be difficult to measure. It also entails the humility to admit when one does not have enough information or understanding to make a decision, which can be especially challenging for senior clinicians in the face of hierarchical dynamics between learners and teachers in the health professions. Though difficult to measure, attitudes of learners (and of teachers) will be essential to promote a culture in which having a thoughtful, systematic approach to problem solving is as important as having the “right answer.”
We made some important assumptions in creating the milestones. Not all thinking should be considered critical thinking; excess reliance on intuitive, automatic thinking8 is characteristic of an “unreflective thinker” in this framework. Secondly, just as research related to problem solving is confounded by context specificity,27 the ability to identify a learner’s specific developmental stage in critical thinking also depends on the setting in which this competency is being measured. Thus, the use of milestones will require assessment across a variety of contexts to identify a learner’s stage of competency in critical thinking.28 We did not directly address the distinctions between hypothetico-deductive and inductive reasoning or the relative advantages and problems associated with each; our final model incorporates elements of both. Additionally, teachers must consider the various activities in which health professionals engage, such as conducting research and other scholarly work, participating in public policy and advocacy, and educating patients, colleagues, and learners. Lastly, although content expertise and critical thinking expertise may correlate, the command of knowledge typical of master clinicians should not be conflated with the ability to rationally solve problems.
The premises under which we developed these milestones also present some limitations to their use. The milestones related to critical thinking are conceptual and must largely be inferred from observable behaviors; direct measurement of thinking processes is not always feasible. The milestones were deliberately written to be applicable to any setting but, as noted above, additional refinement will be needed to ensure applicability to the full range of contexts in which health professionals learn and practice. Secondly, although stage theories are linear and reductionist by definition, in reality, individual differences are marked,29 and it is likely that some may be able to skip stages, demonstrate attributes from more than one stage at any given time, or find various pathways to reach the stage of an accomplished thinker. The members of the development task force, while all educators and leaders in medical and nursing education, participated and contributed to the discussions and decisions related to the matrix; however, consensus was not formally taken. Furthermore, the task force’s conclusions may not represent opinions that are generalizable to the community of nursing and physician educators at large.
This work is meant to stimulate further dialogue and open up possibilities for further work. Designing assessment tools for critical thinking based on these milestones is a natural next step that would allow us to test them against other measures currently used to determine a learner’s skill in thinking critically (e.g., global evaluation of decision-making skills and scores related to performance in practice-based learning and improvement). Though less frequently used in the health professions, published inventories of critical thinking could also serve as another source of validation of milestones-based tools.30
We submit that milestones are necessary to facilitate the development of specific strategies to both teach and assess learner performance. Critical thinking transcends all other domains integral to the responsibilities and tasks of health care providers and has the potential to impact patient care outcomes. Therefore, the ability to identify a learner’s challenges and guide them in the development of this vital competency must be a focus of more attention for educators in nursing and medicine.
Acknowledgments: Authors gratefully acknowledge all members of the task force, which also included Pat Ebright, Jean Hughes, and Valera Hudson, as well as the participants of the Millennium Conference for the wisdom and dialogue that led to this work. They also acknowledge the generous support of the Carl J. Shapiro Institute for Education and Research at Harvard Medical School and Beth Israel Deaconess Medical Center as well as support from the Josiah Macy Jr. Foundation for the Millennium Conference 2011 on Critical Thinking. In addition, authors thank an anonymous reviewer whose comments greatly improved this article.
1. Swing SR. The ACGME outcome project: Retrospective and prospective. Med Teach. 2007;29:648–654
2. Greiner AC, Knebel E Health Professions Education: A Bridge to Quality. 2003 Washington, DC National Academies Press
3. O’Sullivan PS, Blevins-Stephens WL, Smith FM, Vaughan-Wrobel B. Addressing the National League for Nursing critical-thinking outcome. Nurse Educ. 1997;22:23–29
4. Croskerry P. Cognitive forcing strategies in clinical decisionmaking. Ann Emerg Med. 2003;41:110–120
5. Graber ML, Franklin N, Gordon R. Diagnostic error in internal medicine. Arch Intern Med. 2005;165:1493–1499
6. Gupta M, Upshur R. Critical thinking in clinical medicine: What is it? J Eval Clin Pract. 2012;18:938–944
7. Elstein AS. Thinking about diagnostic thinking: A 30-year perspective. Adv Health Sci Educ Theory Pract. 2009;14(suppl 1):7–18
8. Kahneman D Thinking, Fast and Slow. 2011 New York, NY Farrar, Straus and Giroux
9. Croskerry P. A universal model of diagnostic reasoning. Acad Med. 2009;84:1022–1028
10. Bordage G, Lemieux M. Semantic structures and diagnostic thinking of experts and novices. Acad Med. 1991;66(9 suppl):S70–S72
11. Scriven M, Paul R Critical Thinking as Defined by the National Council for Excellence in Critical Thinking.Statement presented at: 8th Annual International Conference on Critical Thinking and Education ReformAugust 1987Rohnert Park, Calif
13. Borgida A, Mylopoulos JJeusfeld M, Jarke M, Mylopoulos J. A sophisticate’s guide to information modeling. Metamodeling for Method Engineering. 2009 Cambridge, Mass MIT Press
14. Cody WK. Critical thinking and nursing science: Judgment, or vision? Nurs Sci Q. 2002;15:184–189
15. Hobus PP, Schmidt HG, Boshuizen HP, Patel VL. Contextual factors in the activation of first diagnostic hypotheses: Expert–novice differences. Med Educ. 1987;21:471–476
16. Carraccio CL, Benson BJ, Nixon LJ, Derstine PL. From the educational bench to the clinical bedside: Translating the Dreyfus developmental model to the learning of clinical skills. Acad Med. 2008;83:761–767
17. Tanner CA. What have we learned about critical thinking in nursing? J Nurs Educ. 2005;44:47–48
18. Huang GC, Newman LR, Schwartzstein RM. Critical thinking in health professions education: Summary and consensus statements of the millennium conference 2011. Teach Learn Med. 2014;26:95–102
20. Dreyfus SE, Dreyfus HL. A five-stage model of the mental activities involved in directed skill acquisition (no. ORC-80-2). 1980 California Univ Berkeley Operations Research Center
21. Benner P From Novice to Expert: Excellence and Power in Clinical Nursing Practice. 1984 Menlo Park, Calif Addison-Wesley
24. Kegan R In Over Our Heads: The Mental Demands of Modern Life. 1994 Cambridge, UK Harvard University Press
25. Le Deist FD, Winterton J. What is competence? Hum Res Dev Int. 2005;8:27–46
26. ten Cate O, Scheele F. Competency-based postgraduate training: Can we bridge the gap between theory and clinical practice? Acad Med. 2007;82:542–547
27. Eva KW, Neville AJ, Norman GR. Exploring the etiology of content specificity: Factors influencing analogic transfer and problem solving. Acad Med. 1998;73(10 suppl):S1–S5
28. Carraccio C, Burke AE. Beyond competencies and milestones: Adding meaning through context. J Grad Med Educ. 2010;2:419–422
29. Hicks PJ, Schumacher DJ, Benson BJ, et al. The pediatrics milestones: Conceptual framework, guiding principles, and approach to development. J Grad Med Educ. 2010;2:410–418
30. Facione NC, Facione PA, Sanchez CA. Critical thinking disposition as a measure of competent clinical judgment: The development of the California Critical Thinking Disposition Inventory. J Nurs Educ. 1994;33:345–350