Checklists are increasingly used as tools to operationalize healthcare processes to support communication, shared understanding, and patient safety.1–4 Although deceptively simple, checklists can be difficult to implement within complex healthcare systems, which has hindered their broad adoption.5–10 Thus, the use of human factors and systems engineering approaches are recommended to identify challenges and facilitators embedded within the context of hospital work systems that may affect checklist performance.10,11 This information can then be used to redesign checklists and/or modify factors influencing their implementation to support their sustained use and positive impact on healthcare outcomes.
Family-centered rounds (FCR), in which families of hospitalized children ‘share in the control of the management plan and in the evaluation of the process itself,12 are endorsed as standard practice and a way to improve care quality and patient safety.13,14 We previously created an FCR checklist as a tool to support family engagement in rounds and provide guidance and a rounding structure for their healthcare team (HCT).15–18 Developed based on family and HCT feedback, this bundled intervention consists of an 8-item checklist of key activities to be completed during daily rounds with families (Table 1) and training curriculum and informational materials for their HCT. Implementation of this FCR checklist bundle was shown to improve HCT performance of these activities that were, in turn, associated with improved parent engagement during rounds, safety perceptions, and behaviors.18
While the FCR checklist intervention succeeded, factors influencing HCT adherence to this checklist were not well understood. Guided by a recognized human factors and systems engineering approach, the objective of this study was to describe HCT compliance with this checklist and identify and characterize challenges and facilitators that may influence its use. These data can be used to inform the optimal implementation and dissemination of the FCR checklist bundle to support the care of hospitalized children and their families and the work of the HCT.
Setting, Participants, and Study Design
We conducted this study with English-speaking patients admitted to a pediatric hospitalist teaching service at a 61-bed tertiary children’s hospital from October 2012 to May 2013 after the implementation of the FCR checklist bundle. This service included children hospitalized with acute and complex medical conditions. To evaluate checklist compliance, researchers conducted observations of morning hospital rounds and documented checklist item completion by HCT members. To elicit challenges and suggestions to facilitate checklist use, researchers conducted interviews with available senior resident and attending physicians immediately after rounds.
FCR Checklist Bundle
We developed and implemented the FCR checklist bundle at this institution before this study in 2012.15 This FCR checklist bundle includes an 8-item checklist that prompts completion of key FCR activities during rounds (Table 1) and associated implementation materials for HCT members, including a 90-minute training curriculum informational materials.15 The goal of the checklist is to promote the performance of optimal activities for engaging families in FCR, and setting expectations and providing structure for the HCT. The expectation is that FCR are conducted daily with the patient and/or family (if their preference) and the HCT (consisting of at least one physician and one nurse). Typically multiple students, intern and resident physicians, and other staff (ie, pharmacists) are also present. Any HCT member may complete checklist items; however, the senior resident and attending physician are ultimately responsible for completion. The HCT is to complete all items during every patient rounding session. If patients/families are not present or prefer not to participate, the HCT is still expected to complete relevant items (ie, all items except “introductions” and “ask family for questions”). Checklist training was conducted in September 2012 and yearly with all senior resident and attending physicians. More detail and guidance about the FCR checklist implementation process is provided in this free, online toolkit15,17: https://www.hipxchange.org/familyrounds.
To evaluate checklist compliance, 2 trained human factors engineering researchers (AX and YL) familiar with rounds conducted rounding observations according to their availability, capturing a sampling of rounds from all weekdays. On each observation day, a researcher shadowed the HCT throughout the entire rounding process for that day. Although the HCT was aware that the observer was collecting data, they were unaware of what data were being collected. The unit of observation was a rounding session for a single patient. The session’s beginning was indicated by the HCT’s arrival at the patient’s room, while the end was indicated by the HCT physically moving to the next patient.19,20 An observation form15 was used to collect (1) observation day, (2) number and roles of HCT members, (3) patient and/or family presence, (4) rounding location (eg, bedside or hallway), (5) rounding beginning and ending time, and (6) performance of each checklist item (yes/no). To capture the full scope of checklist compliance, we intentionally included in our data rounding observations with and without patients and/or families.
To evaluate barriers and facilitators to checklist use, observers also conducted brief, semistructured, one-on-one interviews with a convenience sample of 7 of the 10 eligible senior resident and attending physician participants. We interviewed 4 senior residents and 3 attending physicians immediately after rounds on each observation day during the study period. We interviewed each physician once for approximately 15 minutes and documented their responses. These physicians were asked about their perceptions of challenges/barriers to checklist use (ie, what are the challenges of using the FCR checklist?) and suggestions/facilitators to improve its use (ie, what suggestions do you have to improve the FCR checklist or its use?). Observers followed an observation training manual, interview guide, and protocol provided in the FCR checklist toolkit.15 This toolkit is available at https://www.hipxchange.org/familyrounds. The University of Wisconsin Institutional Review Board considered this study as quality improvement and not human subjects research; therefore, they did not require review and approval.
We entered data from observations and interviews into an Excel spreadsheet. Descriptive statistics characterized observed rounds and the completion of checklist items during rounds.
Researchers conducted a directed content analysis of qualitative interview note data guided by a recognized human factors and systems engineering model, the Systems Engineering Initiative for Patient Safety (SEIPS) framework (Fig. 1).21,22 SEIPS is a model that considers how each of a multitude of factors within complex healthcare work systems (eg, hospital) impacts the successful implementation of an intervention (eg, FCR checklist) and the impact of these interventions on patient safety.21 According to the SEIPS model,21 the sociotechnical system (ie, work system) can be conceptualized as being composed of people (eg, physicians) performing a range of tasks (eg, discussing care plan with family during rounds) using various tools and technologies (eg, checklist, computer). These activities occur within a physical environment (eg, bedside) and an organizational context (eg, care team). Using this approach, we can improve interventions, like the FCR checklist, and their implementation to most effectively support the entire work system (eg, HCT work) and improve outcomes (eg, family engagement and patient safety). Our objective was to conceptually “fill in” the SEIPS framework by capturing physician perspectives regarding factors influencing checklist use. SEIPS is an appropriate model for examining these data because we began from a framework of recognized hospital work systems and processes and not from a naïve perspective.
To corroborate data during analysis and minimize disciplinary biases, 4 researchers contributed to the analysis (AX, YL, PC, and MK). Two researchers (AX and YL) first independently identified factors related to challenges/barriers and facilitators to checklist use from interview notes data. They then came together with 2 other researchers (PC and MK) to reach consensus and resolve any discrepancies, always referring back to the data. These factors were then independently categorized by 2 researchers into known components of hospital work systems within the SEIPS framework. All researchers then all met again to reach consensus.
We observed a total of 88 individual rounding sessions on a pediatric hospitalist service during the study period. The characteristics of observed rounds are shown in Table 2. A majority of rounds occurred with the patient and/or family present (88%). The duration of rounds with the patient/family was an average of 12.9 and 16.6 minutes without their presence. Due to the small number of rounds that occurred without patients/families, it is not possible to report whether there was a significant difference in rounding duration with and without patients/families.
HCT Compliance with the FCR Checklist
In all rounds observed, the HCT competed 82% of checklist items in an average patient rounding session. An HCT member was observed asking a nurse or nursing representative (eg, charge nurse) to join rounds 97% of the time, and a nurse was subsequently present in 90% of rounds. Checklist items performed by the HCT included family preference in 98% of observed rounds, introductions in 84%, assessment/plan in 100%, and review of discharge goals in 70%. The HCT asked families if they had questions in 84% of observations. The patient or family asked the HCT questions in 64% of rounds, and orders were entered and read back in 60% of observations.
Application of the SEIPS Framework to Identify Challenges and Facilitators to Checklist Use
All challenges and facilitators to checklist item completion mentioned during checklist user interviews are shown and categorized into recognized components of the work system within the SEIPS model21 (P-people, T-tasks, T/T-tools/technologies, E-environment, and O-organization) in Table 3. Illustrative examples for each checklist item are described below:
- Ensure nurse is present. Facilitators for ensuring nurse presence included availability of the unit clerk to page the nurse (O, T), visibility of the nurse by the rounding team (E), and nursing knowledge of the order of patients to be rounded on before rounds, ie, when it was their turn to round with the team (O). To facilitate nurse presence, some interviewed physicians would delay rounds or come back to the patient later if the nurse was unavailable (P). Competing patient care activities that also occurred during rounds (ie, administering medications to other patients, transporting patients to radiology, and concurrent teams rounding) were noted by participants as barriers to checklist use (T).
- Check family preference for rounds. An absent, sleeping, or late-arriving patient/family member or visitor was perceived as a barrier (T) to checking whether patients/families preferred to participate in rounds (P) by physician participants.
- Ask if the family knows everyone on the team; if not, introduce unfamiliar team members and roles. The team’s familiarity with patients with chronic illnesses or prolonged hospital stays acted as a barrier to daily introductions, even if there were new members on the HCT that the family had not previously met (P). Late arrival of the patient/family to rounds also acted as a barrier to completing introductions (O).
- Review and update goals for discharge. Prolonged hospitalizations (P) and the team not yet knowing goals for discharge (P) acted as barriers to discussing discharge criteria.
- Ask the family for questions. Physician interviewees believed that the family voluntarily asking questions earlier in the rounding session acted as a barrier to the HCT explicitly asking for additional questions (P).
- Ask the team for questions. Discussing the patient’s care before or after rounds without the patient/family (eg, pre-rounding, discharge, or care conferences) served as a barrier (O) to asking the HCT explicitly for questions during FCR.
- Read back orders. Having an available mobile computer (T/T) and a specific HCT member responsible for entering orders (P) acted as facilitators to reading back orders. Time pressure (T) was also noted as a barrier specific to the completion of this item, which was last on the checklist. Some checklist users considered this task to be complete or repetitive if the daily plan had been discussed or was unchanged from prior days (P).
This study identified multiple human and systems factors that could influence the use of an FCR checklist by the HCT to support family engagement during FCR effectively. Physicians made suggestions for improvement of checklist use and implementation, specifically for items that were less frequently performed (eg, goals for discharge, read back orders). Examples include sharing the order of patients to be rounded on with the nurse beforehand and providing accessible mobile computers across units for use during rounds. These recommendations could be used to streamline FCR further and inform future checklist implementation, sustainability, and dissemination efforts.
Our results advance scientific knowledge regarding the challenges and facilitators influencing the implementation of FCR and the use of checklists in hospital care more broadly. Our results highlight and extend previously described challenges to effectively conducting daily rounds with families in the inpatient setting.23–25 Participants cited that time constraints and issues organizing the team together at the bedside impaired their ability to perform key activities during daily rounds. Our findings also corroborate and expand upon known challenges to using checklists to improve processes in health care.11,26,27 Participants reported that they did not always explicitly perform all items because they did not understand their purpose or felt that an item seemed repetitive. For example, some HCT participants reported that they did not explicitly ask families for questions if the family had already spontaneously asked questions earlier in the rounding session. Although this item may seem repetitive, our previous study found that specifically asking families for their questions during rounds was associated with significantly better parent perceptions of staff communication openness, handoff, and transition safety.18 Incorporating these results and feedback from families into the HCT training curriculum may reinforce the benefits that each item on the FCR checklist provides.
The results of this study also offer potential practical strategies to support the use of an FCR checklist to engage families and improve patient safety in pediatric hospitals optimally. FCR checklist use may be facilitated by restructuring HCT member tasks and the organizational structure within which FCR are implemented. This could include instituting a daily HCT “huddle” before FCR to clarify HCT roles (eg, who will get the nurses, place, and read back orders), identify, and prioritize other activities that need to be accomplished for the day, and communicate the anticipated order of patients to be rounded on to nurses. Consideration may also be given to sharing such a rounding schedule with families and other HCT participants so that they could anticipate and plan for their involvement in advance. Furthermore, to participate effectively in rounds, the necessary tools and technology need to be available. Specifically, to enter orders and read them back aloud to families during rounds, HCTs need accessible mobile computers. These computers could be located on every unit or with the functionality to move with the team between floors easily. Operationalizing these tools and technologies are necessary given that rounds are often a venue for families to discuss medication questions.28 We have demonstrated that reading back orders leads to significantly increased family engagement in information sharing and decision making and perceptions of safety.18
There are several limitations to consider. Data may not be generalizable to all settings because they represent a convenience sample of rounds with English-speaking patients/families and their available physicians at a single, academic children’s hospital. However, similar barriers to conducting FCR were found in published studies from both another single institution23 and a sampling of pediatric hospitalists nationally.29 Data do not quantify checklist “use” using a more literal definition, ie, holding, looking at, or referring to the checklist.
Further, HCTs being observed during rounds may have been influenced by the presence of observers and performed checklist items at a higher rate. This limitation of obtaining data on activities that only occur during rounds has been noted in other studies.30,31 Data on challenges and facilitators are from interviews of available physician rounding participants. Some physicians were not available due to unknown reasons. Additional interviews conducted systematically with a broader range of HCT members, and patients/families could potentially identify additional barriers and facilitators. Our data do not quantify the prevalence of or prioritize factors that may influence checklist use. Future studies could focus on each FCR bundle item to elicit specific barriers and further improve compliance with individual items. Also, this and our prior study did not assess the impact of checklist use on patient/family satisfaction or inpatient experience, which is a potential direction for future research. Lastly, there may be fluctuations in checklist adherence or changes in barriers or facilitators over time, data which we did not capture in this study.
Prior published work indicates that the FCR checklist intervention bundle is an effective tool to operationalize key FCR activities that influence family engagement and patient safety behaviors.18 In this study, a recognized human factors and systems engineering approach was used to identify practical strategies across hospital work systems and processes that could be used to continue to facilitate FCR checklist use, eg, having rounding schedules and available mobile computers on rounds. These strategies may be used to proactively target future checklist redesign, implementation, and dissemination efforts to support the care of hospitalized children.
We thank patients, parents, and healthcare team members who provided valuable input into the design and evaluation of the checklist intervention.
The authors have no financial interest to declare in relation to the content of this article.
1. Haynes AB, Weiser TG, Berry WR, et al.; Safe Surgery Saves Lives Study Group. A surgical safety checklist to reduce morbidity and mortality in a global population. N Engl J Med. 2009;360:491–499.
2. Hales BM, Pronovost PJ. The checklist–a tool for error management and performance improvement. J Crit Care. 2006;21:231–235.
3. Wolff AM, Taylor SA, McCabe JF. Using checklists and reminders in clinical pathways to improve hospital inpatient care. Med J Aust. 2004;181:428–431.
4. Pronovost P, Needham D, Berenholtz S, et al. An intervention to decrease catheter-related bloodstream infections in the ICU. N Engl J Med. 2006;355:2725–2732.
5. Urbach DR, Govindarajan A, Saskin R, et al. Introduction of surgical safety checklists in Ontario, Canada. N Engl J Med. 2014;370:1029–1038.
6. Leape LL. The checklist conundrum. N Engl J Med. 2014;370:1063–1064.
7. Pickering SP, Robertson ER, Griffin D, et al. Compliance and use of the World Health Organization checklist in U.K. operating theatres. Br J Surg. 2013;100:1664–1670.
8. Pronovost PJ, Freischlag JA. Improving teamwork to reduce surgical mortality. JAMA. 2010;304:1721–1722.
10. Wiegmann DA. Understanding why quality initiatives succeed or fail: a sociotechnical systems perspective. Ann Surg. 2016;263:9–11.
11. Vats A, Vincent CA, Nagpal K, et al. Practical challenges of introducing WHO surgical checklist: UK pilot experience. BMJ. 2010;340:b5433.
12. Sisterhen LL, Blaszak RT, Woods MB, et al. Defining family-centered rounds. Teach Learn Med. 2007;19:319–322.
13. Committee on Hospital Care and Institute for Patient- and Family-Centered Care. Patient- and family-centered care and the pediatrician’s role. Pediatrics. 2012;129:394–404.
15. Cox ED, Carayon P, Kelly MM, et al.; “The Family Centered Rounds Toolkit.” University of Wisconsin – Madison Department of Industrial and Systems Engineering, Department of Pediatrics, Institute for Clinical and Translational Research, and UW Health Innovation Program. 2014. http://www.hipxchange.org/familyrounds
. Accessed March 4, 2019
16. Xie A, Carayon P, Cartmill R, et al. Multi-stakeholder collaboration in the redesign of family-centered rounds process. Appl Ergon. 2015;46(Pt A):115–123.
17. Xie A, Carayon P, Cox ED, et al. Application of participatory ergonomics to the redesign of the family-centred rounds process. Ergonomics. 2015;58:1726–1744.
18. Cox ED, Jacobsohn GC, Rajamanickam VP, et al. A family-centered rounds checklist, family engagement, and patient safety: a randomized trial. Pediatrics. 2017;139(5);e20161688.
19. Cardarelli M, Vaidya V, Conway D, et al. Dissecting multidisciplinary cardiac surgery rounds. Ann Thorac Surg. 2009;88:809–813.
20. Sen A, Xiao Y, Lee SA, et al. Daily multidisciplinary discharge rounds in a trauma center: a little time, well spent. J Trauma. 2009;66:880–887.
21. Carayon P, Schoofs Hundt A, Karsh BT, et al. Work system design for patient safety: the SEIPS model. Qual Saf Health Care. 2006;15(1 Suppl):i50–i58.
22. Carayon P, Wetterneck TB, Rivera-Rodriguez AJ, et al. Human factors systems approach to healthcare quality and patient safety. Appl Ergon. 2014;45:14–25.
23. Muething SE, Kotagal UR, Schoettker PJ, et al. Family-centered bedside rounds: a new approach to patient care and teaching. Pediatrics. 2007;119:829–832.
24. Mittal VS, Sigrest T, Ottolini MC, et al. Family-centered rounds on pediatric wards: a PRIS network survey of US and Canadian hospitalists. Pediatrics. 2010;126:37–43.
25. Carayon P, Dubenske L, McCabe B, et al. Albolino S, Bagnara S, Bellandi T, et al. Work system barriers and facilitators to family engagement in rounds in a pediatric hospital. In: Healthcare Systems Ergonomics and Patient Safety 2011: Proceedings on the International Conference on Healthcare Systems Ergonomics and Patient Safety. 2011:London, UK: Taylor & Francis Group; 81–85.
26. LeMaster CH, Hoffart N, Chafe T, et al. Implementing the central venous catheter infection prevention bundle in the emergency department: experiences among early adopters. Ann Emerg Med. 2014;63:340–350.e1.
27. Fourcade A, Blache JL, Grenier C, et al. Barriers to staff adoption of a surgical safety checklist. BMJ Qual Saf. 2012;21:191–197.
28. Benjamin JM, Cox ED, Trapskin PJ, et al. Family-initiated dialogue about medications during family-centered rounds. Pediatrics. 2015;135:94–101.
29. Mittal V. Family-centered rounds: a decade of growth. Hosp Pediatr. 2014;4:6–8.
30. Rappaport DI, Ketterer TA, Nilforoshan V, et al. Family-centered rounds: views of families, nurses, trainees, and attending physicians. Clin Pediatr (Phila). 2012;51:260–266.
31. Sharma A, Norton L, Gage S, et al. A quality improvement initiative to achieve high nursing presence during patient- and family-centered rounds. Hosp Pediatr. 2014;4:1–5.