Adverse events in hospitalized patients are catastrophic and costly to individuals, hospitals, and society.1 The most recent Department of Health & Human Services report suggests that annually approximately 13.5% of hospitalized Medicare beneficiaries experience an adverse event during their hospitalization and alarmingly 44% are deemed preventable.1 The rate of preventable harm to patients was found to remain relatively stable at 40.2 adverse events per 1000 patient days over a 5-year study period, all signifying poor health care quality.2 Similarly, James3 found that preventable deaths due to medical error incidence rates range between 210 000 and 400 000 annually. Reports continue to indicate that despite national attention and substantial resource allocation over the past decade, there has been no substantive reduction in the incidence of preventable adverse inpatient events.4 In the absence of national standardization and reporting requirements, the most recent estimate reported in 2016, derived from pooling existing estimates and extrapolating to the 2013 US admission population, suggests that medical error is the third leading cause of death.5
In context of this burden and lag time, there is an increasing demand for transparency and subsequently voluntary adverse event–reporting systems have been broadly adopted in US health care systems.6,7 The reporting of adverse events by providers at the point of care is an established and recommended mechanism to identify “near misses” and actual errors in care despite the lack of national adverse event–reporting systems.7,8 Literature suggests that features of a positive patient safety culture (PSC), such as a nonpunitive environment, enhance voluntary reports of near misses and error.7–9
Patient safety is a vital component of health care quality. A culture of patient safety, characterized by shared health care provider perspectives of the importance of safety, fidelity, and transparency of communications, and shared confidence in the efficacy of preventive measures, has been associated with some improved patient outcomes.9–11 An emerging body of evidence also suggests that features inherent in a better PSC, such as attention to workload, organizational priorities, and communication, are associated with less missed nursing care by supporting nurses to do the important work they perform every day.12,13 Survey measures to assess PSC have been developed, tested, and broadly adopted in the United States.9,14
Missed nursing care, care that should be provided to patients but is left undone, as an indicator of inferior nursing care practices, is also theoretically and empirically associated with adverse patient events.13,15–18 A number of studies have demonstrated that missed nursing care processes in hospitals are both prevalent and portend certain patient outcomes including higher occurrence of infections and falls, new-onset delirium, pneumonia, medication variances and increased length of stay, delayed discharge, and increased pain and discomfort.16,18,19 This significant amount of nursing care processes missed in hospitals spans all nursing care responsibilities including assessment (44%), interventions and basic care (73%), and planning (71%).16
These studies provide empirical support that a stronger PSC is associated with improved patient outcomes and increased missed nursing care is associated with increased adverse patient safety events. Thus, although few in numbers, these early and novel lines of research are beginning to suggest an explanatory mechanism between PSC and adverse patient safety events. However, no studies have directly examined the relationship between PSC and missed care, and therefore no studies have tested the theoretical relationship that missed nursing care mediates the relationship between the PSC and the adverse patient safety events.
Guided by the missed nursing care model,17 the primary purpose of this cross-sectional study was to describe the relationships among PSC, missed nursing care, and adverse patient safety events in hospitals. The aims of this study were to determine (1) whether any dimensions of PSC predict missed nursing care, (2) whether missed nursing care predicts adverse patient safety events, and (3) the relationships among PSC and adverse patient safety event rates controlling for missed nursing care and other hospital and nurse characteristics.
Design and data sources
This was a cross-sectional study that pooled existing unit-level adverse outcomes data with primary PSC and missed nursing care survey data from hospital-based nurses. The sample used in the study included hospitals that differ in terms of structural and organizational characteristics (size, teaching, and Magnet designation status) and nursing characteristics (nurse education, specialty certification). Hospital inpatient units that used the adverse event reporting system CareLink6 were included (adult and pediatric inpatient medical-surgical units and intensive care units) and licensed registered nurses who provide direct care on those units were eligible to participate. The number of subjects for this exploratory study was based upon convenience sampling methodology. Our sample aim was a 50% response rate from 574 eligible nurses working on 38 inpatient units in 5 mid-Atlantic hospitals in 1 health care system.
Three instruments or data sources were used. The PSC was measured with the Agency for Healthcare Research and Quality Hospital Survey on Patient Safety Culture (HSOPS).9 The 44-item survey is used extensively to measure 12 dimensions of PSC: (1) teamwork across units, (2) staffing, (3) supervisor/manager expectations and actions promoting safety, (4) nonpunitive response to errors, (5) care handoffs and transitions, (6) feedback and communication about error, (7) communication openness, (8) overall perceptions of patient safety, (9) management support for patient safety, (10) organizational learning and continuous improvement, (11) teamwork within units, and (12) frequency of events reported.9 Items are measured using a 5-point Likert scale so that a 1 represents a low score and a 5 represents a high score and a composite score per dimension is obtained. The HSOPS has acceptable psychometric properties including Cronbach α values of 0.63 to 0.84, and there is an extensive and explicit Survey User's Guide, including instructions for items that are reverse coded and guidance for modifying and administering the tool.9 Hospital unit data were aggregated and analyzed in accordance with Agency for Healthcare Research and Quality survey procedures.9
The second instrument was the MISSCARE survey that asks nurses to identify how frequently elements of care (eg, ambulation, turning, patient assessment, teaching, discharge planning, medication administration) are missed using a 5-point Likert scale from 1 (always missed) to 5 (never missed), so that a lower score indicates more missed care.20 In addition to the individual item measures, a composite measure was constructed as an indicator of nursing care quality, as the care needs left undone cannot be directly matched to individual patient outcomes. The composite measure was calculated as the average count of the 24 nursing care activities left undone by each nurse respondent. These individual composite measures were then aggregated for each hospital unit, resulting in a percentage of unmet nursing care needs per hospital unit. The psychometric properties of this tool are well established and include content validity and internal reliability (Cronbach α = 0.64 to 0.86).20 In the survey of nurses, we asked several demographic questions, such as certification status, highest earned degree, and tenure on the unit.
The third data source used for outcome measures was the adverse reporting systems used in this setting, CareLink (version 6.6.1).6 This system is used nationally in many hospital settings and includes categorization of main event types as recommended following establishment of hospital guidelines for reporting. These guidelines for reporting and classification of event types follow standard and national guidelines per each event type.6 From this system, 4 events were selected: (a) patient falls, (b) medication variance, (c) quality of care concern, and (d) vascular access device (VAD) events. These were selected as they are nurse-sensitive indicators available in the adverse event reporting system, and there is theoretical and empiric support that these outcomes may be associated with missed nursing care.
Falls were operationalized by the National Database of Nursing Quality Indicators definition as a sudden, unintentional descent with or without injury to the patient that results in the patient coming to rest on the floor, or on or against a surface, object, or person.21 Medication variance was operationalized as the potential or actual medication error in prescribing, transcribing/documenting, dispensing, or administering that could result in inappropriate medication use, medication omission, and/or harm to the patients, as defined by the National Coordinating Council for Medication Error Reporting and Prevention, the US standard (http://www.nccmerp.org/vision-and-mission).
Quality of care concerns were defined as delays/lack of response to patient conditions, communication issues, inappropriate treatment, handoff issues, and similar such incidents. Vascular access device events were defined as untoward events related to the insertion, maintenance, use, or removal of any VAD device (including but not limited to peripheral IVs, central lines, and implanted ports) such as phlebitis, infiltration, infection, malposition, or multiple attempts at insertion. These data were aggregated to the unit level to create a unit event rate per 1000 patient days, and 1 year of each type of event data was collected per unit.
Following institutional review board approval and pretesting the electronic survey link, an invitation to participate was sent via e-mail to all eligible nursing staff (N = 574) on participating units (N = 38). Surveys were completed using the Web-based survey link over 3 months; 4 reminders were sent every 2 weeks in accordance with the Agency for Healthcare Research and Quality survey procedures. Units that achieved a greater than 50% participation rate received a nominal token of appreciation (insulated lunch totes). One year of existing adverse patient safety data were requested from the appropriate administrative staff to encompass 6 months pre- and postsurvey data. All data were collected between December 2016 and April 2017.
Standard descriptive statistics to gain familiarity with the distributions and frequencies of the data were followed by bivariate analyses to describe relationships among the key variables and correlations as appropriate. Differences in average missed nursing care by nurse and hospital characteristics were assessed using analysis of variance testing. No nurse-level differences in missed nursing care by hospital teaching status, bed size, Magnet status, nurse education, tenure in role or unit, staffing levels (number of patients cared for last shift), or number of hours worked per week were found, and therefore our models were not adjusted for these potential confounders.
Differences in missed nursing care were found between specialty-certified nurses compared with those who were not specialty certified (F1,258 = 5.73, P < .05), indicating that more care was reported missed by those certified; therefore, the unit proportion of certified nurses was adjusted for in the missed nursing care models. Differences in unit ratings of PSC dimensions (the predictor variables) were assessed using analysis of variance, and statistically significant differences (P < .05) were noted across units for all dimensions except communication openness (F1,28 = 1.21, P > .05), lending to greater precision of parameters.
Data from the HSOPS and the MISSCARE survey were pooled with adverse event outcomes data and used to determine whether hospital units with a more positive PSC had less missed nursing care and fewer adverse event patient outcomes. Ordinary least squares and multivariate regression analyses were conducted using Huber-White robust standard errors. The power calculations for this exploratory study with regression analyses, using α = .05, β = .80, indicated that 25 units would be needed to detect a large (0.35) and 54 units to detect a medium (0.15) effect difference in adverse outcomes. All statistical tests were conducted using STATA/MP v.15.0 (StataCorp, College Station, Texas).
A total of 385 (67% response rate) nurses responded to the survey. Nurse and hospital characteristics are shown in the Supplemental Digital Content Table 1, available at: http://links.lww.com/JNCQ/A514. For unit-level analyses, we retained data from (a) nurses who responded “yes” they provide direct care and selected the unit on which they work (n = 333) and (b) the units with greater than 5 and/or greater than 20% response rate (n = 29). The nurses on these units totaled 311. The average unit response rate was 45% (range: 7%-100%). The distribution of unit-level adverse event rates per 1000 patient days in descending order was quality of care concerns (M = 6.35, SD = 4.85); medication variance (M = 5.46, SD = 4.50); VAD events (M = 3.14, SD = 2.03); and falls (M = 2.74, SD = 1.1).
Nurses, on average, reported that features of a positive PSC (ie, agree/strongly agree, always/often) were present by unit aggregate PSC score (M = 3.52, SD = 0.30). Unit-level ratings were highest for teamwork within units (M = 4.02, SD = 0.34), followed by organizational learning/continuous improvement (M = 3.90, SD = 0.33) and feedback and communication about error (M = 3.90, SD = 0.40). In this sample, the HSOPS demonstrated internal reliability by Cronbach α of 0.92.
Most nurses (211, 77.9%) reported occasionally to always missing some aspect of nursing care. On a scale of 1 to 5, the average unit (N = 29) composite score was M = 3.44 (SD = 0.24), indicating that the unit aggregate of all care missed was occasionally. The items most frequently missed in descending order included ambulation 3 times per day or as ordered (M = 2.74, SD = 0.96), turning patient every 2 hours or as ordered (M = 2.89, SD = 0.97), and medications administered 30 minutes before/after schedule (M = 2.90, SD = 0.94). Items least frequently missed in descending order included patient assessments performed each shift (M = 4.43, SD = 0.70), bedside glucose monitoring as ordered (M = 4.15, SD = 0.72), and IV/central line site care/assessments per policy (M = 4.07, SD = 0.75). In this sample, the MISSCARE survey demonstrated internal reliability by Cronbach α of 0.95.
Dimensions of PSC that predict missed nursing care and adverse patient safety events
Addressing aim 1, to determine whether any dimensions of PSC predict missed nursing care, the unadjusted robust ordinary least squares regression models indicated that the aggregate PSC explained 15% of the variance in missed nursing care; when adjusted for nursing specialty certification, the relationship was nonsignificant. In unadjusted models, 6 dimensions were positive, independent predictors of missed care by ordinary least squares (p < .05): handoffs and transitions (R2 = 30%), overall perceptions of safety (R2 = 24%), management support for patient safety (R2 = 23%), staffing (R2 = 21%), teamwork across units (R2 = 20%), and organizational learning/continuous improvement (R2 = 9%). When models were adjusted for nursing specialty certification, handoffs and transitions (R2 = 30%), overall perceptions of safety (R2 = 24%), and management support for patient safety (R2 = 25%) remained significant predictors of missed nursing care (Table).
Regression Results of Patient Safety Culture Predictors of Missed Nursing Care (N = 29 Units)a
|Teamwork within units
|Organizational learning—continuous improvement
|Feedback and communication about error
|Supervisor/manager expectations and actions promoting patient safety
|Frequency of events reported
|Overall perceptions of patient safety
|Management support for patient safety
|Teamwork across units
|Nonpunitive response to errors
|Handoffs and transitions
|Aggregate PSC score
Abbreviation: PSC, patient safety culture.
aPSC measured on 5-point Likert scale so that 1 represents a low score and 5 represents a high score. Models adjusted for unit proportion nurse specialty certification.
Addressing aim 2, to determine whether missed nursing care predicts adverse patient safety events, missed nursing care was a statistically significant predictor of reported patient falls (R2 = 13%) in unadjusted models. The relationship was nonsignificant after adjusting for nursing specialty certification (see Supplemental Digital Content Table 2, available at: http://links.lww.com/JNCQ/A515).
Addressing aim 3, to determine the relationships among PSC and adverse patient safety event rates controlling for missed nursing care and other hospital and nurse characteristics, we first tested whether the PSC dimensions were independent or aggregate predictors of each of the 4 adverse events (see Supplemental Digital Content Table 3, available at: http://links.lww.com/JNCQ/A516). In unadjusted models, statistically significant (P < .05) relationships were found between nonpunitive response (R2 = 26%), frequency of events reported (R2 = 21%), feedback and communication about error (R2 = 4%), and quality of care concerns. None remained significant after adjusting for missed nursing care and nursing certification. The PSC dimension management support for patient safety was a predictor of VAD events in unadjusted (R2 = 15%) and adjusted models (R2 = 20%). There were no relationships among PSC dimensions and the adverse events of medication variance or patient falls.
In this first-known study to link PSC directly to missed nursing care and patient outcomes, we advanced our understanding of the interrelationships of these important factors in the following ways. First, we found that the majority of nurses reported missing some aspect of nursing care and these included ambulation, turning patients, and feeding and nutrition; notably, these are opportunities for direct contact with patients where patient assessment, education, and evaluation could occur. These activities are general in scope and require coordination and teamwork by example with physical therapy or nursing assistants. This finding is in concordance with literature that has demonstrated that the importance of teamwork is a predictor of missed nursing care.12,22,23
Unexpectedly, nursing care was more frequently missed by those who were specialty certified than those who were not certified. Certified nurses may be focused on overarching health outcomes of patients rather than attending to discrete patient care needs where the appearance of an adverse outcome may be delayed. By example, omitting a patient assessment during the shift would be evident as it is essential to all subsequent care planning whereas the impact of not turning and positioning a patient may not be evident until discharge or a pressure ulcer develops. Of concern to hospital administrators, these missed activities are also linked to hospital-acquired conditions that are mandated to report, such as pressure ulcers and falls. Conversely, specific functions that are typically performed independently by nurses were rated as rarely to never missed and included patient assessments performed each shift, bedside glucose monitoring as ordered, and IV/central line site care/assessments per policy. These findings add to the growing body of literature documenting the urgent and widespread problem of missed nursing care and the importance of overall unit composition, teamwork, and organizational support.
Second, we identified that the unit aggregate PSC is a predictor of the frequency of missed nursing care, explaining a small (15%) but reliable amount of the variance in missed care. This is important in and of itself as an indicator of the influence of organizational culture on discrete nursing functions and processes of care. To our knowledge, this is the first study to directly link PSC to processes of nursing care. Moreover, specific dimensions of the PSC, including handoffs and transitions, overall perceptions of safety, management support for patient safety, staffing, teamwork across units, and organizational learning/continuous improvement were particularly relevant indicators, each uniquely and independently explaining 9% to 30% of the variance in missed nursing care. These findings suggest that organizations focused on reducing the amount of missed nursing care should optimize these particularly clinically relevant domains. While PSC explained some of the missed nursing care, it is possible that unmeasured organizational factors, such as high patient turnover, unit-level workload, and presence of support staff, or unmeasured individual factors such as nurse burnout, may be contributing to the variance in missed nursing care.12,13,23–25
Third, we found that missed nursing care was positively and statistically associated with nurse reports of patient falls, a leading patient safety indicator with high associated morbidity, mortality, and cost.26 While falls are multicausal, demonstrating that missed nursing care as an aggregate measure is associated with patient falls suggests that efforts to support the completion of all nursing care activities is an essential prevention strategy. This affirms what is known in the literature and adds to our appreciation of nurse-reported outcomes as an important source of health services data.7,8,27–29
Finally, we found that PSC dimensions were a direct, positive predictor of nurse-sensitive reported adverse events with and without controlling for missed nursing care. Specifically, nonpunitive response, frequency of events reported, feedback and communication about error-predicted quality of care concerns, and management support for patient safety were a predictor of VAD events. To our knowledge, this is the first study to identify these relationships using nurse-sensitive indicators and a voluntary adverse event reporting system. While prior studies have demonstrated the relationship between features of the PSC and adverse patient outcomes, they have largely been limited to global outcomes measures, such as readmissions and mortality.10,28 Our findings are consistent with the literature that suggests that these PSC characteristics are correlated with nurses' intention to report errors.29
This adds to understanding of the relationship between PSC and missed nursing care and suggests to the nurse leaders that both the perception of PSC by nurses on the unit and the frequency of omitted care are important to monitor. Moreover, placing emphasis and action on providing staff feedback, setting expectations, and ensuring a nonpunitive environment and open communication about errors may influence the voluntary reporting of adverse events and the prevention of such events.
This study is cross-sectional and the 5 hospitals are part of 1 large health care system in the mid-Atlantic region of the United States. Causality cannot be established. The response rate per unit limited our abilities to include enough units to identify whether important relationships exist. Despite our individual response rate of 67%, the average response rate per unit was 45%, and we dropped units with a low response rate from our analyses, thus limiting the sample to 29 units (or 74% of all units). This may have limited our ability to detect important relationships. Nurses' self-reports of missed care may also present a limitation; however, we found the distribution consistent with existing literature. An additional limitation is the use of nurse-reported adverse outcomes. Although institutional policy requires clinicians to complete these reports, the rates may be too low at the unit level to detect differences, despite the extensive individual consequences of each outcome. However, the distribution of these events indicates that they are being reported, and as the measure includes near misses, this measure may have greater sensitivity and actionable consequence than administrative data.
Higher ratings of PSC were associated with less missed nursing care, and missed nursing care was associated with falls, an important patient outcome. Health care administrators and nurse leaders have a powerful opportunity to improve the conduct and impact of nursing care by taking discrete actions to enhance the unit PSC. Implications for nurses providing direct care include actively and transparently engaging with unit leadership and administrators to identify and address concerns, specifically as they relate to unit management style and support and open and nonpunitive communication. Recommended actions include quantifying unit PSC to address weak areas and conducting periodic audits of unit-level missed care to target efforts to support the full provision of safe care and reduce the impact on patient outcomes. Implications for future research include examining these relationships using a robust probability sample, examining other factors that influence missed nursing care including additional measures of organizational support for the provision of nursing care such as team composition, and broadening nurse-sensitive outcomes to include, for example, pressure ulcers.
1. US Department of Health & Human Services, Office of Inspector General. Adverse events in hospitals: National incidence among Medicare beneficiaries (OEI Publication No, 06-09-00090). https://oig.hhs.gov/oei/reports/oei-06-11-00370.pdf
. Published 2010. Accessed October 9, 2018.
2. Landrigan CP, Parry GJ, Bones CB, et al. Temporal trends in rates of patient harm resulting from medical care. N Engl J Med. 2010;363(26):2124–2134.
3. James JT. A new, evidence-based estimate of patient harms associated with hospital care. J Patient Saf. 2013;9(3):122–128.
4. Wachter RM. Patient safety at ten: unmistakable progress, troubling gaps. Health Aff. 2010;29(1):165–173.
5. Makary MA, Daniel M. Medical error—the third leading cause of death in the US.
6. RL Software for Safer Healthcare. RL6: Risk. https://www.rlsolutions.com/rl-products/risk-management/aha-endorsement
. Accessed October 9, 2018.
7. Burlison JD, Quillivan RR, Kath LM, et al. A multilevel analysis of U.S. hospital patient safety culture relationships with perceptions of voluntary event reporting [published online ahead of print November 3, 2016]. J Patient Saf. 2016. doi:10.1097/PTS.0000000000000336.
8. Richter JP, McAlearney AS, Pennell ML. Evaluating the effect of safety culture on error reporting: a comparison of managerial and staff perspectives. Am J Med Qual. 2015;30(6):550–558.
9. Sorra JS, Nieva VF. Hospital Survey on Patient Safety Culture. AHRQ Publication No. 04-0041, Agency for Health care Research and Quality, Rockville, MD: Agency for Healthcare Research and Quality; 2004. http://www.ahrq.gov/professionals/quality-patient-safety/patientsafetyculture/hospital/index.html
. Accessed October 9, 2018.
10. DiCuccio MH. The relationship between patient safety culture and patient outcomes: a systematic review. J Patient Saf. 2015;11(3):135–142.
11. Mardon RE, Khanna K, Sorra J, Dyer N, Famolaro T. Exploring relationships between hospital patient safety culture and adverse events. J Patient Saf. 2010;6(4):226–232.
12. Jones TL, Hamilton P, Murry N. Unfinished nursing care, missed care, and implicitly rationed care: state of the science review. Int J Nurs Stud. 2015;52(6):1121–1137.
13. Hessels AJ, Flynn L, Cimiotti JP, Cadmus E, Gershon RR. The impact of the nursing practice environment on missed nursing care. Clin Nurs Stud. 2015;3(4):60–65.
14. Singla AK, Kitch BT, Weissman JS, Campbell EG. Assessing patient safety culture: a review and synthesis of the measurement tools. J Patient Saf. 2006;2(3):105–115.
15. Kalisch BJ, Tschannen D, Lee KH. Missed nursing care, staffing, and patient falls. J Nurs Care Qual. 2012;27(1):6–12.
16. Kalisch BJ, Xie B. Errors of omission: missed nursing care. West J Nurs Res. 2014;36(7):875–890.
17. Kalisch BJ, Landstrom GL, Hinshaw AS. Missed nursing care: a concept analysis. J Adv Nurs. 2009;65(7):1509–1517.
18. Schubert M, Glass TR, Clarke SP, et al. Rationing of nursing care and its relationship to patient outcomes: the Swiss extension of the International Hospital Outcomes Study. Int J Qual Health Care. 2008;20(4):227–237.
19. Lucero RJ, Lake ET, Aiken LH. Nursing care quality and adverse events in US hospitals. J Clin Nur. 2010;19(15/16):2185–2195.
20. Kalisch BJ, Williams RA. Development and psychometric testing of a tool to measure missed nursing care. J Nurs Adm. 2009;39(5):211–219.
21. Montalvo I. The national database of nursing quality indicators (NDNQI). Online J Issues Nurs. 2007;12(3). https://login.proxy.libraries.rutgers.edu/login?url=http://search.ebscohost.com/login.aspx?direct=true&db=c8h&AN=105914001&site=ehost-live
. Accessed October 9, 2018.
22. Bragadóttir H, Kalisch BJ, Tryggvadóttir GB. Correlates and predictors of missed nursing care in hospitals. J Clin Nur. 2017;26(11-12):1524–1534.
23. Kalisch BJ, Lee KH. The impact of teamwork on missed nursing care. Nurs Outlook. 2010;58(5):233–241.
24. Orique SB, Patty CM, Woods E. Missed nursing care and unit-level nurse workload in the acute and post-acute settings. J Nurs Care Qual. 2016;31(1):84–89.
25. Willis E, Harvey C, Thompson S, Pearson M, Meyer A. Work intensification and quality assurance: missed nursing care. J Nurs Care Qual. 2018;33(2):E10–E16.
26. Chang JT, Morton SC, Rubenstein LZ, et al. Interventions for the prevention of falls in older adults: systematic review and meta-analysis of randomised clinical trials. BMJ. 2004;328(7441):680.
27. Van Bogaert P, Clarke S, Roelant E, Meulemans H, Van de Heyning P. Impacts of unit-level nurse practice environment and burnout on nurse-reported outcomes: a multilevel modelling approach. J Clin Nurs. 2010;19(11-12):1664–1674.
28. Wang X, Liu K, You LM, et al. The relationship between patient safety culture and adverse events: a questionnaire survey. Int J Nurs Stud. 2014;51(8):1114–1122.
29. Ko Y, Yu S. The relationships among perceived patients' safety culture, intention to report errors, and leader coaching behavior of nurses in Korea: a pilot study. J Patient Saf. 2017;13(3):175–183.