Hospital and healthcare providers such as surgeons understand that patient experience measures are indicators of care quality and that improving patient experience leads to improved health outcomes.1,2 To measure and interpret hospital patient feedback, health organizations commonly use the Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) questionnaire.3 This survey instrument gathers patient-reported aspects of care quality.2,4 Despite criticism of patient-reported experience measures as an objective assessment of the level of service provided by an organization, hospitals use these data to identify likely factors that influence patient experience of health services.5 Indeed, innovative models such as value-based care are emphasizing the importance of patient experience.6 The Centers for Medicare & Medicaid Services (CMS), for example, as well as other insurance providers, use HCAHPS data to decide on level of payments to facilities and providers.6 Moreover, recently, CMS made public a patient experience hospital star rating, allowing individuals to make a more informed decision about their location of care.7
The rapid growth in publications about patient experience provides evidence that many factors affect ratings of care.8,9 It is noteworthy that, to date, researchers studying the HCAHPS survey mostly emphasize individual (eg, demographic characteristics, socioeconomic status) factors that associate with patient-reported experience ratings.8,9 There is one notable exception, where researchers examine the relationship between county-level factors (eg, general practice, family medicine and physician specialist prevalence, percent living in poverty, percent minority population, median income, percent without insurance) and HCAHPS scores.10 However, to the best of our knowledge, researchers seemingly neglect the potential influence of neighborhood-level characteristics on patient experience ratings. Relevant to our study, it has been suggested that social determinants of health and neighborhood features influence clinical outcomes11 (eg, depressive disorder child’s health),12 as well as behaviors (eg, intimate partner violence).13 We now propose that this new approach should also be adopted to patient experience ratings and that patients’ residential environment (ie, neighborhood conditions) affect the scores independent of, and beyond, the individual-level factors.
Based on the previously well-described influence of different patient profiles on patient experience of care,8,9 in our current study, we integrate patient residential profiles to systematically explore how neighborhood-level characteristics influence patient self-reported hospital experience in the surgical setting. Given that the connections between patients and their residential conditions are complex and interdependent,11–13 we propose that neighborhood factors impact HCAHPS ratings above and beyond individual-level characteristics. Moreover, our objective is to propose a framework on how to integrate neighborhood-based, population-specific data into the study of patient experience and systematically assess the potential benefits of adopting this new paradigm as the industry standard. Although major challenges remain, we base our opinion on the promises of several ongoing initiatives in precision public health that represent a paradigm shift in health care.14
METHODS
Data Sources
For this new approach, our main dataset was a compilation of EMR records from a single center study of all consecutive inpatient adult elective surgical patients admitted between January 2014 and April 2019 (N = 2,062), combined with HCAHPS questionnaire administered by Press Ganey (Boston, MA) to the same population of patients. The survey was administered in both English and Spanish by phone or email within 72 hours of the visit. Each surgical patient data was geocoded based on the physical residential address and was then linked to the matching census tract, or neighborhood-level, social and economic housing unit indicators that were generated using the 2014–2018 American Community Survey (ACS) data.15 We excluded records for surgical patients living outside of Orange County, California (n = 6) and Census tracts with fewer than four patients (n = 99), resulting in a total sample size of 1,957 patients nested within 483 Census tracts or neighborhoods. Protocols were reviewed by the hospital’s Institutional Review Board, which concluded this study was exempt and does not qualify as human subject research.
Variables
The primary outcome of interest is a patient-reported experience HCAHPS composite score. For the purpose of this analysis, we used 14 equally weighted dimensions of patient experience, including overall hospital care (1–5), cleanliness (1–5), willingness to recommend the hospital to a family member or friend (1–4), amount of time physician spent with the patient (1–5), level of physician concern for the patient (1–5), whether the physician kept the patient informed (1–5), physician friendliness (1–5), physician skill level (1–5), level of nurse courtesy (1–4), whether the nurse listened to patient concerns (1–4), nurse attitude (1–5), whether the nurse kept the patient informed (1–5), nurse friendliness (1–5), and nurse skill level (1–5). We generated standardized scores ranging from 0 to 10 for each of the 14-questions. We then calculated the HCAHPS patient composite experience score by dividing the sum of all standardized scores by the total number of questions. The result is a composite patient experience measure with a mean of 9.26 (SD = 1.08), with higher values indicating higher rating. We also calculated a binary composite score, grouping answers 9–10 (highest ratings) to one group and answer 1–8 (lowest ratings) to a second group. This “top box” method indicates the proportion of people that answered 9 or 10 is derived from the HCAHPS standard methodology for hospitals. We found that our continuous composite measure is highly correlated with the binary composite measure (r = 0.80, P < 0.001) and as such have decided to use the continuous variable in our analyses. Still, in an effort to isolate the differences in ratings by patient- and neighborhood-level characteristics, and for ease of interpretation, in Figure 1 and Tables 1 and 2, we present results using the “top box” binary measure (ie, 0–8 and 9–10).
TABLE 1. -
Means and SD for Neighborhood-level Characteristics Overall and by Top Box
Patient Experience Scores
|
Full Sample |
1–8 |
9–10 |
Diff. |
| Race/ethnicity proportions |
Mean |
SD |
Mean |
SD |
Mean |
SD |
| % Non-Latino White |
64.49 |
18.01 |
66.33 |
17.37 |
63.97 |
18.16 |
|
| % Non-Latino Black |
2.23 |
1.06 |
2.29 |
1.08 |
2.22 |
1.05 |
|
| % Latino |
29.71 |
21.84 |
26.41 |
19.31 |
30.63 |
22.42 |
** |
| % Asian |
20.88 |
14.47 |
20.70 |
14.04 |
20.93 |
14.60 |
|
|
Socioeconomic proportions
|
| Population density |
61.15 |
27.61 |
59.26 |
26.74 |
61.68 |
27.84 |
|
| Median income |
34369.16 |
14222.46 |
35824.42 |
14372.19 |
33960.01 |
14160.15 |
* |
| % Adults <12 yrs education |
18.06 |
14.90 |
15.37 |
13.07 |
18.81 |
15.30 |
*** |
| % Adults = 12 yrs education |
19.00 |
6.72 |
18.50 |
7.13 |
19.14 |
6.60 |
|
| % Adults >12 and <16 yrs education |
28.34 |
6.50 |
29.04 |
6.00 |
28.15 |
6.63 |
* |
| % Adults = 16 yrs education |
22.76 |
9.97 |
24.28 |
9.77 |
22.33 |
9.99 |
** |
| % Adults = 18 yrs education |
11.84 |
9.60 |
12.81 |
9.49 |
11.57 |
9.62 |
* |
| % Unemployed |
3.37 |
2.49 |
3.60 |
2.67 |
3.14 |
2.44 |
|
| % Receiving public assistance |
9.33 |
7.57 |
8.34 |
7.00 |
9.61 |
7.71 |
** |
| % Female-headed households |
17.94 |
7.02 |
17.66 |
7.04 |
18.02 |
7.01 |
|
| % of Residents in poverty |
12.81 |
8.33 |
11.72 |
7.76 |
13.12 |
8.46 |
** |
| % of Rental homes |
43.07 |
22.35 |
41.13 |
22.62 |
43.62 |
22.26 |
|
N = 483 Census Tracts.
Data are from the American Community Survey.
Asterisks indicate significant difference evaluated using two-tailed independent means t-test.
*P < 0.05, **P < 0.01, ***P < 0.001.
TABLE 2. -
Means and SD for Patient-level Characteristics Overall and by Top Box
Patient Experience Scores
|
Full Sample |
1–8 |
9–10 |
|
| Independent Variables |
Mean |
SD |
Mean |
SD |
Mean |
SD |
Diff. |
|
Sociodemographic
|
|
Age |
56.71 |
17.42 |
55.07 |
18.27 |
57.15 |
17.16 |
* |
|
Gender |
|
Female |
0.53 |
0.50 |
0.56 |
0.50 |
0.52 |
0.50 |
|
|
Male |
0.47 |
0.50 |
0.44 |
0.50 |
0.48 |
0.50 |
|
|
Race/ Ethnicity |
|
Non-Latino White |
0.49 |
0.50 |
0.54 |
0.50 |
0.48 |
0.50 |
|
|
Non-Latino Black |
0.03 |
0.16 |
0.02 |
0.15 |
0.03 |
0.17 |
|
|
Latino |
0.24 |
0.43 |
0.18 |
0.39 |
0.26 |
0.44 |
** |
|
Asian |
0.20 |
0.40 |
0.22 |
0.41 |
0.19 |
0.39 |
|
|
Other Race |
0.04 |
0.20 |
0.04 |
0.20 |
0.04 |
0.20 |
|
|
Primary Language |
|
English |
0.74 |
0.44 |
0.82 |
0.39 |
0.72 |
0.45 |
*** |
|
Spanish |
0.13 |
0.34 |
0.05 |
0.21 |
0.15 |
0.36 |
*** |
|
Asian |
0.08 |
0.08 |
0.10 |
0.30 |
0.36 |
0.27 |
|
|
Other |
0.05 |
0.05 |
0.04 |
0.20 |
0.05 |
0.22 |
|
|
Education |
|
<High School |
0.12 |
0.33 |
0.06 |
0.24 |
0.14 |
0.35 |
*** |
|
High School Graduate |
0.18 |
0.39 |
0.15 |
0.36 |
0.19 |
0.39 |
|
|
Some College |
0.52 |
0.50 |
0.59 |
0.49 |
0.50 |
0.50 |
** |
|
College Graduate |
0.17 |
0.17 |
0.20 |
0.40 |
0.17 |
0.37 |
|
|
Health Insurance |
|
Private Provider |
0.37 |
0.09 |
0.44 |
0.50 |
0.35 |
0.48 |
** |
|
Medicaid |
0.23 |
0.42 |
0.19 |
0.39 |
0.24 |
0.42 |
|
|
Medicare |
0.40 |
0.49 |
0.37 |
0.48 |
0.41 |
0.49 |
|
|
Health Indicators
|
|
Physical Health |
|
Poor |
0.05 |
0.22 |
0.10 |
0.30 |
0.04 |
0.19 |
*** |
|
Fair |
0.18 |
0.38 |
0.23 |
0.42 |
0.17 |
0.37 |
** |
|
Good |
0.34 |
0.47 |
0.36 |
0.48 |
0.33 |
0.47 |
|
|
Very Good |
0.28 |
0.45 |
0.22 |
0.42 |
0.30 |
0.46 |
** |
|
Excellent |
0.15 |
0.36 |
0.08 |
0.27 |
0.17 |
0.38 |
*** |
|
Mental Health |
|
Poor |
0.02 |
0.14 |
0.04 |
0.20 |
0.01 |
0.12 |
*** |
|
Fair |
0.09 |
0.29 |
0.13 |
0.33 |
0.08 |
0.27 |
** |
|
Good |
0.26 |
0.44 |
0.33 |
0.47 |
0.25 |
0.43 |
** |
|
Very Good |
0.31 |
0.46 |
0.28 |
0.45 |
0.32 |
0.47 |
|
|
Excellent |
0.32 |
0.32 |
0.22 |
0.41 |
0.35 |
0.48 |
*** |
|
Length of Stay |
4.26 |
4.81 |
4.57 |
5.30 |
4.18 |
4.67 |
|
|
Pain Levels |
2.57 |
2.01 |
2.78 |
2.04 |
2.51 |
2.00 |
** |
N = 1,957.
Data are from UC Irvine Medical Center Records.
Asterisks indicate significant difference evaluated using two-tailed independent means t-test.
*P < 0.05, **P < 0.01, ***P < 0.001.
FIGURE 1.: Top box patient experience scores by census tract, Orange country, CA. SOURCE: Data are from UC Irvine Medical Center Records & 2014–2018 American Community Survey Data.
We included in the analysis covariates such as age at time of visit, gender, race/ethnicity, primary language spoken at home, educational attainment, and insurance type. We also included patient-reported length of stay and pain levels during the hospital stay. Social and economic indicators of the patient’s neighborhood of residence come from the ACS data and include population density, community-level education, unemployment rate, percent of female-headed households, percent receiving public assistance, percent in poverty, percent of homes in the tract that are rented, and racial and ethnic composition measured by percent of major racialized categories.15
Statistical Analysis
To test the impact of distinct neighborhood conditions on surgical patients’ experience ratings, we estimated multilevel linear regression models16,17 with Stata 16 software.18 We performed a series of conditional models that first include the covariates of individual patient sociodemographic and health characteristics at level-1 (age, gender, race/ethnicity, primary language spoken at home, educational attainment, insurance type, physical and mental health status, length of stay, and average pain levels) followed by models that add the neighborhood conditions at level-2 (population density, community-level education, unemployment rate, percent of female-headed households, percent receiving public assistance, percent in poverty, percent of homes in the tract that are rented, and racial and ethnic composition). The models treat level-1 individual patients as nested within level-2 neighborhood measures. All models use maximum likelihood estimation with adaptive quadrature.16 This approach controls for the lack of independence of data within higher level groups and adjusts for problems that otherwise downwardly bias estimated standard errors including individual clustering within neighborhoods, different sample sizes for level-1 and level-2 units, heteroscedastic error terms, and variable numbers of cases within level-2 units.17 We first estimated a model with only individual-level predictors included to test the influence of individual social determinants on the scores of patient experience. Then, in our fully specified model, we included the neighborhood conditions (and a neighborhood-level error component) along with the individual-level predictors and an individual error term. Model 1 includes age, gender, race/ethnicity, primary language spoken at home, educational attainment, insurance type, physical and mental health status, length of stay, and average pain levels at level-1. Model 2 adds the neighborhood-level characteristics, including median income, community-level education, unemployment rate, percent of female-headed households, percent receiving public assistance, percent in poverty, percent of rented homes in the tract, and racial/ethnic composition at level-2. All models control for logged population density.
RESULTS
In Figure 1, we illustrate the distribution of experience ratings across neighborhoods in Orange County, California. In Tables 1 and 2, we show descriptive information for neighborhood- and patient-level characteristics. The most disadvantaged communities make up the northern and western parts of the county and have the highest ratings on nearly every indicator. Patients residing in areas with higher proportions of residents receiving public assistance have a larger percentage of high ratings (9–10: 9.6% vs 1–8: 8.3%, P < 0.01), and communities with higher proportions of residents in poverty also have a larger percentage of high ratings (9–10: 13.1% vs 1–8: 11.7%, P < 0.01). As shown in Table 1, communities with a higher proportion of Latinos have a significantly larger percentage of high scores (1–8: 26.4% vs 9–10: 30.6%, P < 0.01). Higher overall levels of education correspond with significantly lower scores, and communities with higher proportions of adults earning a Bachelor’s degree (16 years of education) have a significantly smaller percentage of high scores (9–10: 22.3% vs 1–8: 24.3%, P < 0.001). This variation is most pronounced for the highest and lowest overall levels of education. Communities with the lowest education levels have significantly larger percentages of high scores (9–10: 18.8% vs 1–8: 15.4%, P < 0.001); neighborhoods with the highest proportion of graduate degree holders have the lowest percentage of high scores (9–10: 9.5%, P < 0.05).
Table 2 displays means and standard deviations for patient sociodemographic, health, length of stay, and pain indicators overall and by top box patient experience scores. Ratings vary significantly by age, such that younger individuals have lower scores (55 vs 57 years old, P < 0.05). The racial/ethnic and socioeconomic measures show considerable patient-level variation in ratings. Latinos, relative to non-Latino whites, have higher ratings (P < 0.01), and English (72%) and Spanish (15%) speakers, relative to all other languages, also have higher ratings (both P < 0.001). Similar to findings at the neighborhood-level, individuals with the least education have a larger percentage of high scores (9–10: 14% vs 1–8: 6%, P < 0.001), and those who have attended some college have a larger percentage of low scores (1–8: 59% vs 9–10: 50%, P < 0.01). Private insurance holders have a higher percentage of low scores (1–8: 44% vs 9–10: 35%, P < 0.01). Ratings vary significantly by physical health, such that those of “poor” health have the lowest percentage of high scores (9–10: 4% vs 1–8: 10%, P < 0.001); a similar pattern is observed for those of “fair” health. However, percentage of high, relative to low, ratings is larger in those of better physical and mental health. Finally, ratings vary significantly by pain level, and those presenting with lower levels of pain have a larger percentage of high scores (P < 0.01).
Next, as per the new conceptual framework, we constructed hierarchical linear regression models predicting the surgical experience. In model 1 of Table 3, we see that older patients, Spanish speakers, and those with better physical and mental health reported higher experience ratings. In model 2, we add the neighborhood conditions at level-2 to examine the influence of distinct neighborhood conditions on patient-reported experience ratings. Patient-level estimates in model 2 of Table 3, including neighborhood conditions, attenuates health indicator differences in the ratings, indicating that some of the lower coefficients for patients of “good,” relative to “excellent,” mental health is due to neighborhood context. Patients living in areas with greater proportions of residents with low levels of education, and larger proportions of people receiving public assistance, associate with significantly higher ratings (P < 0.05).
TABLE 3. -
Hierarchical Linear Regression Models Predicting
Patient Experience Scores
|
Model 1 |
Model 2 |
| Coeff |
SE |
Coeff |
SE |
| Intercept |
9.74*** |
0.14 |
9.67*** |
0.28 |
|
Patient-level
|
|
Sociodemographic
|
|
Age |
0.01** |
0.00 |
0.01** |
0.00 |
|
Gender (Female, ref) |
|
Male |
0.09 |
0.06 |
0.09 |
0.06 |
| Race/Ethnicity (non-Latino White, ref) |
|
Non-Latino Black |
0.34 |
0.23 |
0.37 |
0.23 |
|
Latino |
–0.03 |
0.11 |
–0.05 |
0.11 |
|
Asian |
0.05 |
0.12 |
0.04 |
0.12 |
|
Other Race |
–0.06 |
0.16 |
–0.07 |
0.16 |
|
Primary Language (English, ref) |
|
Spanish |
0.29* |
0.14 |
0.29* |
0.14 |
|
Asian |
–0.08 |
0.15 |
–0.07 |
0.15 |
|
Other |
–0.16 |
0.16 |
–0.19 |
0.16 |
|
Education (College Graduate, ref) |
|
<High School |
–0.12 |
0.14 |
–0.13 |
0.14 |
|
High School Graduate |
0.06 |
0.11 |
0.04 |
0.11 |
|
Some College |
–0.14 |
0.09 |
–0.15 |
0.09 |
|
Health Insurance (Private Provider, ref) |
|
Medicaid |
0.07 |
0.09 |
0.07 |
0.09 |
|
Medicare |
–0.04 |
0.09 |
–0.03 |
0.09 |
|
Health indicators
|
|
Physical health (Excellent, ref) |
|
Poor |
–0.40 |
0.18 |
–0.42 |
0.18 |
|
Fair |
–0.30* |
0.12 |
–0.30* |
0.12 |
|
Good |
–0.19 |
0.11 |
–0.19 |
0.11 |
|
Very Good |
–0.13 |
0.10 |
–0.13 |
0.10 |
|
Mental Health (Excellent, ref) |
|
Poor |
–1.07*** |
0.24 |
–1.07*** |
0.24 |
|
Fair |
–0.38** |
0.13 |
–0.38** |
0.13 |
|
Good |
–0.43*** |
0.09 |
–0.42*** |
0.09 |
|
Very Good |
–0.15 |
0.08 |
–0.15 |
0.08 |
|
Length of Stay |
–0.00 |
0.00 |
0.00 |
0.00 |
|
Pain Levels |
–0.04* |
0.02 |
–0.04* |
0.02 |
|
Neighborhood-level
|
|
Race/ethnicity proportions (% Non-Latino White, ref) |
|
% Non-Latino Black |
|
|
0.01 |
0.00 |
|
% Latino |
|
|
0.00 |
0.00 |
|
% Asian |
|
|
0.00 |
0.00 |
|
Socioeconomic proportions
|
|
Population density |
–0.00 |
0.00 |
–0.00 |
0.00 |
|
Median income |
|
|
–0.00 |
0.00 |
|
Community-level education (% adults = 18 yrs, ref) |
|
% Adults <12 yrs education |
|
0.01* |
0.00 |
|
% Adults = 12 yrs education |
|
–0.00 |
0.00 |
|
% Adults >12 and <16 yrs education |
|
–0.00 |
0.00 |
|
% Adults = 16 yrs education |
|
0.01 |
0.00 |
|
% Unemployed |
|
–0.00 |
0.00 |
|
% Receiving public assistance |
|
0.01* |
0.00 |
|
% Female-headed households |
|
–0.00 |
0.00 |
|
% of residents in poverty |
|
–0.00 |
0.00 |
|
% of rental homes |
|
0.00 |
0.00 |
|
Random effects
|
|
Intercept |
0.04*** |
0.01 |
0.03*** |
0.00 |
Data are from UC Irvine Medical Center Records & the American Community Survey.
Model 1 includes age, gender, race/ethnicity, primary language spoken at home, educational attainment, insurance type, physical and mental health status, length of stay, and average pain levels at level-1. Model 2 adds the neighborhood-level characteristics, including median income, community-level education, unemployment rate, percent of female-headed households, percent receiving public assistance, percent in poverty, percent of rented homes in the tract, and racial/ethnic composition at level-2.
*P < 0.05, **P < 0.01, ***P < 0.001.
DISCUSSION
There is an overwhelming consensus among scholars that patient experience scores vary by individual-level factors.8 Importantly, however, there is an absence of evidence on the contextual dimensions of residential environments that potentially have far-reaching consequences for experience-of-care ratings. Thus, we need to better understand how residential places influence patient-reported experience of care in surgical settings. Given the above, this study provides support for a new approach to understanding surgical patient experience. We find that above and beyond individual patient/family factors, if we include a focus on neighborhood factors, we can better understand patient experience scores. It is clear that communities are stratified by dimensions of socioeconomic status [eg, poverty, educational attainment, unemployment rates, family structure (female-headed households), and racial/ethnic composition (racial segregation)].19,20 This means that central features of the environment are dictated by variation in social and economic conditions.21,22 For example, population density is patterned by socioeconomic characteristics, which ultimately may lead to disparities in patient experience across different geographic areas.9,23 With this in mind, here we provide a framework on how to integrate patient address data into the study of patient experience. More specifically, we propose a geocoding model for surgical patient experience that can be adapted by providers and hospitals trying to enhance the care provided to patients. Indeed, using EMR, hospitals can adjust for the neighborhood-level factors, in addition to using previous diagnoses and mental health screening, to identify patients that will likely have lower patient experience scores. Given that the residential context influences experience-of-care ratings, attention to surgical patients’ community-level conditions may help to maximize the hospital experience. In this respect, our analysis is an example of a precision public health intervention.14 Indeed, our model aligns with several ongoing initiatives in precision public health that represent a paradigm shift in health care.14 Further, other researchers have taken a similar approach and argue that hospitals should account for social risk factors such as poverty, disability, housing instability, and residence in a disadvantaged neighborhood in order to reduce readmission rates.24 Taken together, because neighborhood context influences patient experience outcomes, to optimize the care experience, providers should consider patients’ residential profiles, in addition to the patient profiles.
Here, we show that individuals residing in the most impoverished communities, paradoxically, have the highest HCAHPS scores. We do recognize, however, that it is necessary to also weigh satisfaction ratings based on individual profiles. Indeed, previous research indicates that variation in patients’ experience-of-care scores is associated with age, gender, race/ethnicity, educational attainment, health status, and physical comfort/pain management.6,7 For example, and consistent with our findings, existing evidence indicates a positive association between respondents’ age and patient-reported ratings of care quality in both nonsurgical and surgical settings.25–28 Available surgical and medical care data also show that gender associates with the overall score of experience, but this relationship is contingent upon the dimension of experience evaluated.28–31 In addition, educational attainment is a known determinant of patient experience, although data are inconsistent.29 For example, in two separate studies, researchers show a negative4 and positive32 association between educational attainment and ratings of the overall hospital stay experience. Findings on self-reported health indicators are more consistent across studies. Indeed, our results are in line with previous findings,33,34 and those with better physical/mental health report higher scores. Related, patients presenting with pain consistently rate their overall hospital-care experience lower than those without pain,29,35 which is also the case in our sample. Finally, race/ethnicity further influences how nonsurgical and surgical patients experience, and report on, their quality of care,8,9 although findings are inconsistent. Notably, findings vary substantially by the survey instrument used, survey response rate, mode of assessment, domain of experience measured, patient insurance status, primary language spoken at home, and inpatient/outpatient status.36–38 In our sample, Latinos relative to Whites, as well as Spanish-speakers, relative to all other languages, report higher satisfaction with their quality of care. In Orange County, California, communities that are characterized by disadvantage tend to have higher proportions of Latino residents.39 With this said, it is possible that the higher ratings among patients residing in communities characterized by high levels of social disadvantage may partially be driven by the same language concordant care, which generates higher scores at the individual level.40 Nevertheless, we are confident in our results, and see evidence that variation in socioeconomic conditions across residential areas influences the self-reported satisfaction of hospital care, independent of the patients’ individual profiles.
We are the first to illuminate how patients’ neighborhood conditions influence self-reported experience of hospital care within a surgical setting. Despite that, this study is not without limitations. The cross-sectional nature of our single-source data and relatively small sample size limit the scope of our analysis. Consequently, power to identify complex relationships between patient experience scores and residential context is limited. Moreover, given the magnitude of our estimates and minor variation between models, our results indicate that neighborhood conditions matter comparatively less than expected for patient experience ratings. Rather, it is the difference in patient-level sociodemographic, economic, and overall health characteristics within distinctive neighborhood contexts that contributes comparatively more to the observed disparities in ratings. Further, published reports indicate that experience ratings vary substantially by the survey response rate and mode of assessment.41–43 Still, in our sample, the survey response rate is average at 31.1%,40 and the survey was administered in both English and Spanish by phone or email within 72 hours of the visit. Finally, although published findings are inconsistent,44–48 we should mention that we do not have data on the type of procedures patients underwent, nor about postoperative complications and readmissions, which both may impact experience-of-care ratings. Related, surgical outcomes disparities by race/ethnicity, socioeconomic status, income, and insurance type have been reported.49 Despite these limitations, our analysis of the neighborhood associations with patient experience in Orange County, California serves as a starting point for future researchers interested in parsing out the neighborhood factors that matter most for patient experience scores.
In conclusion, we underscore the need for health professionals to consider neighborhood-level factors when contextualizing surgical patient opinions on hospital experience. Such adjustments may help in the interpretation of patient feedback and add depth to our understanding of the patient’s perspective. Additionally, health care providers could use residential profiles to identify patients early on in their care experience to isolate specific needs and provide direct assistance to these individuals. Since neighborhood is a variable that is easily identifiable in the EMR, this approach will enable providers to maximize the hospital experience by providing the providers a priori information on this variable.
REFERENCES
1. Elliott MN, Lehrman WG, Goldstein EH, et al. Hospital survey shows improvements in
patient experience. Health Aff (Millwood). 2010; 29:2061–2067
2. Manary MP, Boulding W, Staelin R, et al. The
patient experience and health outcomes. N Engl J Med. 2013; 368:201–203
3. Giordano LA, Elliott MN, Goldstein E, et al. Development, implementation, and public reporting of the
HCAHPS survey. Med Care Res Rev. 2010; 67:27–37
4. Tefera L, Lehrman WG, Conway P. Measurement of the
patient experience: clarifying facts, myths, and approaches. JAMA. 2016; 315:2167–2168
5. Coulter A, Locock L, Ziebland S, et al. Collecting data on
patient experience is not enough: they must be used to improve care. BMJ. 2014; 348:g2225
7. Advisory Board website.
CMS gives 266 hospitals five stars for patient experience. See how yours fared on our map.
https://www.advisory.com/daily-briefing/2020/08/11/star-ratings. Accessed August 12, 2020
8. Trinh LN, Fortier MA, Kain ZN. Primer on adult patient satisfaction in perioperative settings. Perioper Med (Lond). 2019; 8:11
9. Elliott MN, Lehrman WG, Goldstein E, et al. Do hospitals rank differently on
HCAHPS for different patient subgroups? Med Care Res Rev. 2010; 67:56–73
10. Herrin J, Mockaitis KG, Hines S.
HCAHPS scores and community factors. Am J Med Qual. 2018; 33:461–471
11. Cantor M, Thorpe L. Integrating data on social determinants of health into electronic health records. Health Aff. 2017; 37:1252
12. Graham GN. Why your ZIP code matters more than your genetic code: promoting healthy outcomes from mother to child. Breastfeed Med. 2016; 11:396–397
13. Massey DS. The age of extremes: concentrated affluence and poverty in the twenty-first century. Demography. 2003; 33:395–412
14. Khoury MJ, Engelgau M, Chambers DA, et al. Beyond public health genomics: can big data and predictive analytics deliver precision public health? Public Health Genomics. 2018; 21:244–250
15. United States Census Bureau.
American Community Survey (ACS).https://www.census.gov/programs-surveys/acs. Accessed February 20, 2020
16. Raudenbush SW, Bryk AS. Hierarchical Linear Models. 2002, Sage Publications
17. Rabe-Hesketh S, Skrondal A. Multilevel and Longitudinal Modeling Using Stata. 2008, 2nd ed. Stata Press
18. StataCorp. Stata: Release 16. Statistical Software. 2020, StataCorp LLC
19. Sampson RJ, Raudenbush SW. Systematic social observation of public spaces: a new look at disorder in urban
neighborhoods. Am J Sociol. 1999; 105:603–51
20. Sampson RJ, Sharkey P. Neighborhood selection and the social reproduction of concentrated racial inequality. Demography. 2008; 45:1–29
21. Massey DS. The age of extremes: concentrated affluence and poverty in the twenty-first century. Demography. 1996; 33:395–412
22. Small ML, Harding DJ, Lamont M. Reconsidering culture and poverty. Ann Am Acad Pol Soc Sci. 2010; 629:6–27
23. Wirth L. Sennett R. Urbanism as a way of life. Classical essays on the culture of cities. 1969, Appleton-Centry-Crofts: 67–83
24. Joynt Maddox KE, Reidhead M, Hu J, et al. Adjusting for social risk factors impacts performance and penalties in the hospital readmissions reduction program. Health Serv Res. 2019; 54:327–336
25. Carlson MJ, Shaul JA, Eisen SV, et al. The influence of patient characteristics on ratings of managed behavioral health care. J Behav Health Serv Res. 2002; 29:481–489
26. Cleary PD, Edgman-Levitan S, McMullen W, et al. The relationship between reported problems and patient summary evaluations of hospital care. QRB Qual Rev Bull. 1992; 18:53–59
27. Haviland MG, Morales LS, Reise SP, et al. Do health care ratings differ by race or ethnicity? Jt Comm J Qual Saf. 2003; 29:134–145
28. Nguyen Thi PL, Briançon S, Empereur F, et al. Factors determining inpatient satisfaction with care. Soc Sci Med. 2002; 54:493–504
29. Otani K, Chumbler NR, Herrmann PA, et al. Impact of pain on patient satisfaction integration process: how patients with pain combine their health care attribute reactions. Health Serv Res Manag Epidemiol. 2015; 2:2333392815615103
30. Woods SE, Heidari Z. The influence of gender on patient satisfaction. J Gend Specif Med. 2003; 6:30–35
31. Elliott MN, Lehrman WG, Beckett MK, et al. Gender differences in patients’ perceptions of inpatient care. Health Serv Res. 2012; 47:1482–1501
32. Xiao H, Barber JP. The effect of perceived health status on patient satisfaction. Value Health. 2008; 11:719–725
33. Kroenke K, Stump T, Clark DO, et al. Symptoms in hospitalized patients: outcome and satisfaction with care. Am J Med. 1999; 107:425–431
34. Kroenke K. Patients presenting with somatic complaints: epidemiology, psychiatric comorbidity and management. Int J Methods Psychiatr Res. 2003; 12:34–43
35. Bhakta HC, Marco CA. Pain management: association with patient satisfaction among emergency department patients. J Emerg Med. 2014; 46:456–464
36. Seid M, Stevens GD, Varni JW. Parents’ perceptions of pediatric primary care quality: effects of race/ethnicity, language, and access. Health Serv Res. 2003; 38:1009–1031
37. Taira DA, Safran DG, Seto TB, et al. Do patient assessments of primary care differ by patient ethnicity? Health Serv Res. 2001; 366 Pt 11059–1071
38. Weech-Maldonado R, Morales LS, Elliott M, et al. Race/ethnicity, language, and patients’ assessments of care in Medicaid managed care. Health Serv Res. 2003; 38:789–808
39. United States Census Bureau..
Quick Facts: Orange County, California, 2020.https://www.census.gov/quickfacts/orangecountycalifornia. Accessed December 9, 2020
40. Davis-Dao CA, Ehwerhemuepha L, Chamberlin JD, et al. Keys to improving patient satisfaction in the pediatric urology clinic: a starting point. J Pediatr Urol. 2021; 16:377–383
41. Godden E, Paseka A, Gnida J, et al. The impact of response rate on Hospital Consumer Assessment of Healthcare Providers and System (
HCAHPS) dimension scores. Patient Exp J. 2019; 6:105–114
42. de Vries H, Elliott MN, Hepner KA, et al. Equivalence of mail and telephone responses to the CAHPS Hospital Survey. Health Serv Res. 2005; 406 Pt 22120–2139
43. Baruch Y, Holtom BC. Survey response rate levels and trends in organizational research. Hum Relat. 2008; 61:1139–1160
44. Sacks GD, Lawson EH, Dawes AJ, et al. Relationship between hospital performance on a patient satisfaction survey and surgical quality. JAMA Surg. 2015; 150:858–864
45. Kennedy GD, Tevis SE, Kent KC. Is there a relationship between patient satisfaction and favorable outcomes? Ann Surg. 2014; 260:592–598
46. Lyu H, Wick EC, Housman M, et al. Patient satisfaction as a possible indicator of quality surgical care. JAMA Surg. 2013; 148:362–367
47. Sheetz KH, Waits SA, Girotti ME, et al. Patients’ perspectives of care and surgical outcomes in Michigan: an analysis using the CAHPS hospital survey. Ann Surg. 2014; 260:5–9
48. Tsai TC, Orav EJ, Jha AK. Patient satisfaction and quality of surgical care in US hospitals. Ann Surg. 2015; 261:2–8
49. Haider AH, Scott VK, Rehman KA, et al. Racial disparities in surgical care and outcomes in the United States: a comprehensive review of patient, provider, and systemic factors. J Am Coll Surg. 2013; 216:482–92.e12