Background: The Consumer Assessment of Healthcare Providers and Systems Cultural Competency Item Set assesses patient perceptions of aspects of the cultural competence of their health care.
Objective: To determine characteristics of patients who identify the care they receive as less culturally competent.
Research Design: Cross-sectional survey consisting of face-to-face interviews.
Subjects: Safety-net population of patients with type 2 diabetes (n=600) receiving ongoing primary care.
Measures: Participants completed the Consumer Assessment of Healthcare Providers and Systems Cultural Competency and answered questions about their race/ethnicity, sex, age, education, health status, depressive symptoms, insurance coverage, English proficiency, duration of relationship with primary care provider, and comorbidities.
Results: In adjusted models, depressive symptoms were significantly associated with poor cultural competency in the Doctor Communication—Positive Behaviors domain [odds ratio (OR) 1.73, 95% confidence interval, 1.11–2.69]. African Americans were less likely than whites to report poor cultural competence in the Doctor Communication—Positive Behaviors domain (OR 0.52, 95% CI, 0.28–0.97). Participants who reported a longer relationship (≥3 y) with their primary care provider were less likely to report poor cultural competence in the Doctor Communication—Health Promotion (OR 0.35, 95% CI, 0.21–0.60) and Trust domains (OR 0.4, 95% CI, 0.24–0.67), whereas participants with lower educational attainment were less likely to report poor cultural competence in the Trust domain (OR 0.51, 95% CI, 0.30–0.86). Overall, however, sociodemographic and clinical differences in reports of poor cultural competence were insignificant or inconsistent across the various domains of cultural competence examined.
Conclusions: Cultural competence interventions in safety-net settings should be implemented across populations, rather than being narrowly focused on specific sociodemographic or clinical groups.
*Division of General Internal Medicine, University of California, San Francisco, CA
†Department of Health Services Administration, University of Alabama, Birmingham, AL
‡Division of General Medicine and Health Innovation Program, University of Wisconsin, Madison, WI
Supplemental Digital Content is available for this article. Direct URL citations appear in the printed text and are provided in the HTML and PDF versions of this article on the journal's Website (www.lww-medicalcare.com).
The authors declare no conflict of interest.
Supported by the Russell Sage Foundation and the Commonwealth Fund.
Reprints: Hilary K. Seligman, MD, MAS, Division of General Internal Medicine, University of California, P.O. Box 1364, San Francisco, CA 94143-1364. E-mail: email@example.com.
Culturally competent care is increasingly recognized as a critical component of high-quality and cost-effective health care in the United States. The National Quality Forum defines the provision of culturally competent care as care that is “safe, patient and family centered, evidence based, and equitable” for diverse populations.1 Accurate and broad-scale measurement of cultural competency from the patient’s perspective may help focus cultural competency interventions and elucidate how a lack of organizational and provider cultural competency contributes to disparities in health care. However, the measurement of this construct has been limited by the lack of valid, reliable cultural competency measurement tools.
A rigorously evaluated and valid tool was recently developed as an extension to the Consumer Assessment of Healthcare Providers and Systems (CAHPS) survey to allow for widespread measurement of cultural competency. This tool, the Consumer Assessment of Healthcare Providers and Systems Cultural Competency (CAHPS-CC) Item Set, assesses multiple aspects of care thought to be related to cultural competency. Our goal was to evaluate the extent to which patients’ reports of poor cultural competency, as assessed by 3 CAHPS-CC domains, are associated with sociodemographic and clinical characteristics. We chose to examine the Doctor Communication—Positive Behaviors, Doctor Communication—Health Promotion, and Trust domains because these domains had acceptable psychometric properties in our participant sample based on the authors’ previous work.2 The Doctor Communication—Positive Behaviors and Doctor Communication—Health Promotion domains measure aspects of patient-provider communication. Items in the Doctor Communication—Positive Behaviors domain ask patients the extent to which their provider exhibited various aspects of good communication, including explaining things in a way that is easy to understand, listening carefully, spending adequate time with you, and showing respect. Items in the Doctor Communication—Health Promotion domain ask patients the extent to which their provider discussed with them various aspects of health and wellness, including healthy diet, physical activity, and depression. Effective communication between patient and provider is a critical component of providing high-quality and culturally competent care, and previous work has shown that some vulnerable populations (including racial/ethnic minorities and populations with low education, low literacy, or low income) are less likely to report their providers communicate with them effectively.3
Like effective patient-provider communication, patient trust in their provider is also thought to be a critical component of culturally competent care. Patients who trust their providers demonstrate greater adherence to treatment plans and report greater satisfaction with their health care. Racial/ethnic minorities are less likely than whites to report they trust the health care system.4 The Trust domain includes items which ask patients to report the extent to which they feel they can tell their provider anything, trust their provider with their medical care, and feel their provider tells the truth about their health. It also asks patients how much their provider really cares about them as a person and their health.
Our focus was on determining which sociodemographic and clinical characteristics are associated with poor cultural competency, because these are the groups to which clinical or policy interventions might be appropriately targeted. We chose diabetes as a disease model because patients with diabetes generally have repeated and ongoing contact with the health care system, and because effective patient-provider communication, one important aspect of cultural competency, is essential to high-quality diabetes care.5–7 This communication often revolves around ongoing medication adherence, diet, and exercise, each of which are highly influenced by culture. There is therefore great opportunity for poor cultural competency to reduce the quality of diabetes care.
Study Design and Participants
We conducted a cross-sectional survey among patients recruited from academic and nonacademic hospital-based and community-based safety-net clinics in Chicago and the San Francisco Bay Area. Clinics were staffed by a mixture of attending physicians, resident physicians in training, and nonacademic physicians and mid-level providers. Patients were recruited into the study to allow for adequate representation of African American, white, and Mexican American patients whose primary language was either English or Spanish. Of those approached, 91% (n=711) agreed to participate. Inclusion criteria included age ≥18 years, a diagnosis of type 2 diabetes, and fluency in English or Spanish. Exclusion criteria included active substance use, cognitive impairment, or psychosis severe enough to preclude survey participation. Because the measurement of cultural competency includes evaluation of a primary care provider, we analyzed data only for participants who reported having a regular primary care provider (n=600).
After participants provided informed consent in English or Spanish, they participated in a face-to-face standardized interview with a trained, bilingual, and bicultural research assistant. The Institutional Review Boards of the participating institutions in Chicago and the San Francisco Bay Area approved all study activities.
Design and Measures
We used CAHPS-CC to determine participant perceptions of the cultural competency of their usual health care provider. Details of the development of CAHPS-CC can be found elsewhere.4 We present the 3 CAHPS-CC domains that were psychometrically sound among both English and Spanish speakers in our participant population.2 These domains include Doctor Communication—Positive Behaviors (5 items), Doctor Communication—Health Promotion (4 items), and Trust (5 items).
Responses to the 14 items in the 3 domains were transformed to a 0–100 scale (Supplementary Appendix, http://links.lww.com/MLR/A321), with a score of 100 representing the most culturally competent response for each item. We derived a domain score by calculating the mean of all items in the domain; therefore, a domain score of 100 indicates no responses on any item in the domain consistent with poor cultural competence. If participants skipped or declined to answer some items in the domain, we calculated the domain score as the mean of the answered items (rather than the mean of all items). There were few nonrespondents (<1% of the sample) for all items except 1 item in the Doctor Communication—Positive Behaviors domain (19%, see Supplementary Appendix, http://links.lww.com/MLR/A321). Because scores in each of the domains were highly positively skewed, a known phenomenon in patient assessments of provider quality, we arranged scores into quartiles.8 We refer to domain scores in the lowest quartile as “poor cultural competency.”
We identified potential risk factors for poor cultural competency from the communication and patient satisfaction literature and our personal experience working in safety-net institutions. Potential risk factors included race/ethnicity (African American, white, or Mexican American), sex, age (18–34, 35–64, or 65+ years), educational attainment (<high school degree), self-reported health status (fair, poor, or very poor vs. good, very good, or excellent), depressive symptoms, insurance coverage (Medicare with or without additional Medicaid coverage, Medicaid only, privately insured, or uninsured), English proficiency, length of relationship with provider (<1, 1–2, 3 y, or more), and self-reported comorbidity burden.9–12
We determined depressive symptoms using the Patient Health Questionnaire (PHQ-9).13 This 9-item scale is based directly on the diagnostic criteria for major depressive disorder in the Diagnostic and Statistical Manual, 4th ed. It asks respondents how often over the previous 2 weeks they have been bothered by each of the 9 symptom clusters identified in the Diagnostic and Statistical Manual, 4th ed. Points are accumulated based on symptom frequency. By established convention, we considered scores ≥10 indicative of clinically significant depressive symptoms. Scores of 10–14 are often described as minor depression, dysthymia, or a mild case of major depression, whereas higher scores are often described as moderate to severe cases of major depression. We refer to scores ≥10 as “depressive symptoms” as the scale does not allow us to determine a definitive diagnosis of depression.
We considered participants to be English proficient if they reported either that English was their primary language, or that English was not their primary language but they spoke English “well” or “very well.”
We included 6 comorbidities: heart attack, stroke, cancer (other than skin cancer), high blood pressure, arthritis, and high cholesterol. We summed the number of comorbidities to determine comorbidity burden (range, 0–6). We describe comorbidity burden as a continuous variable for regression analyses.
We used logistic regression analyses to determine whether potential sociodemographic and clinical risk factors were associated with odds of poor cultural competency (domain scores in the lowest quartile). Participants with missing values for one of the sociodemographic variables were excluded from analyses examining that variable only, which represented 0.3% or less of participants in all analyses. We then generated multivariate logistic regression models adjusting for all of our potential risk factors of interest to determine which were independently associated with poor cultural competency. We included recruitment site (Chicago or San Francisco) in regression analyses to adjust for clustering. We considered P values <0.05 to be statistically significant. All analyses were performed using SAS 9.2 (SAS Institute Inc., Cary, NC).
The sample included a racially and ethnically diverse group of participants with diabetes who were predominantly between the ages of 35 and 64 years (Table 1). Almost half of participants were uninsured. Overall the mean number of comorbidities reported by participants was 2.26 (SD 1.08, range, 0–5). Whites (mean 2.49, SD 1.04) and African Americans (mean 2.46, SD 1.02) reported the greatest number of comorbidities, and Mexican Americans the fewest number of comorbidities (mean 2.07, SD 1.10, P<0.001).
We used unadjusted logistic regression models to explore which sociodemographic and clinical groups reported the lowest cultural competency scores in each of the domains. African Americans and participants with better health status were significantly less likely to report poor cultural competency in the Doctor Communication—Positive Behaviors domain compared with whites and participants with poorer health status (Table 2). Younger participants and participants with depressive symptoms were significantly more likely to report poor cultural competency in the Doctor Communication—Positive Behaviors domain compared with older participants and those without depressive symptoms. Participants with a lengthier relationship with their primary care provider were significantly less likely to report poor cultural competency in the Doctor Communication—Health Promotion domain. These participants and participants with less educational attainment were significantly less likely to report poor cultural competency in the Trust domain.
In fully adjusted models including race/ethnicity, sex, age, education, health status, depressive symptoms, insurance coverage, English proficiency, duration of relationship with primary care provider, comorbidity burden as a continuous variable, and clinic location, depressive symptoms remained significantly associated with being in the lowest quartile of cultural competency in the Doctor Communication—Positive Behaviors domain (Table 3). African Americans remained significantly less likely than whites to report poor cultural competency scores. In the Doctor Communication—Health Promotion domain, only duration of relationship with primary care provider remained significantly associated with cultural competency; participants who had a relationship with their provider of 3 or more years were less likely than those in a relationship less than a year to report poor cultural competency scores. In the Trust domain, participants with less educational attainment and a longer relationship with their primary care provider were less likely to report poor cultural competency than those with higher educational attainment and a shorter relationship with their health care provider.
In this sample of patients with diabetes receiving care in safety-net outpatient clinics, race/ethnicity, age, educational attainment, self-reported health status, depressive symptoms, and length of relationship with one’s primary care provider were significantly associated with specific aspects of culturally competent care. After full adjustment, participants with depressive symptoms were significantly more likely than those without depressive symptoms to report poor cultural competency in the Doctor Communication—Positive Behaviors domain, whereas African Americans were significantly less likely than whites to report poor cultural competency in the Doctor Communication—Positive Behaviors domain. Participants who reported a 3 years or longer relationship with their primary care provider were less likely than those with a briefer relationship with their primary care provider to report poor cultural competence in the Doctor Communication—Health Promotion and Trust domains, whereas participants with lower educational attainment were less likely than those with higher educational attainment to report poor cultural competence in the Trust domain. Overall, however, sociodemographic and clinical differences in reports of poor cultural competence were insignificant or inconsistent across the various domains of cultural competence. Our data suggest that cultural competence interventions in safety-net settings should be broadly implemented across populations, rather than being narrowly focused on specific sociodemographic or clinical groups.
There may be a number of factors contributing to our surprising finding that African Americans were less likely than whites to report poor cultural competency in the Doctor Communication—Positive Behaviors domain. First, all of our patients were recruited from the safety-net setting. Our clinical experience suggests that, compared with Mexican American and African American patients, many more white patients seeking care in these settings are homeless, use illicit substances, or have ongoing psychiatric illness. It may be that white patients experience less culturally competent care not because of their race but because of these other comorbidities. Second, different racial/ethnic groups may have different expectations of their care, and these differences may be reflected in their reports of cultural competency. To the extent that cultural competency is related to patient satisfaction, our results are consistent with research showing that African Americans sometimes report greater satisfaction than whites in certain domains of care and practice settings.9,14 However, studies focusing more narrowly on domains of cultural competency have been relatively consistent in their finding that whites report care that is more culturally competent.15,16 Further research will be needed to fully understand why whites reported less culturally competent care in this setting.
Duration of relationship with one’s primary care provider was highly associated with cultural competency in the Doctor Communication—Health Promotion and Trust domains. In the safety-net setting from which we recruited, patients with a brief relationship with their primary care provider are more likely to receive care from a resident physician or mid-level health professional. It is therefore unclear from these data whether duration of relationship with one’s provider or provider level of experience is really the important predictor of cultural competency experiences. Although interventions may certainly be targeted toward extending the duration of patient-provider relationships (eg, by preventing discontinuous insurance enrollment), our data may also indicate the importance of focusing cultural competency training efforts on providers with the least clinical experience.
We observed a strong relationship between depressive symptoms and poor cultural competency in the Doctor Communication—Positive Behaviors domain. Studies examining patient satisfaction or perceptions of providers’ communication quality have also demonstrated associations with depressive symptoms,17–21 including among patients with diabetes.22 Medicare beneficiaries with depressive symptoms are significantly more likely to report worse experiences of care in other CAHPS domains as well.23 Although there is little research specifically focusing on perceptions of cultural competency among patients with depressive symptoms in the primary care setting, it is plausible that the association we observed between depression and poor cultural competency has multiple mechanisms. First, the manifestations of depression are culturally bound, and therefore providing optimal care to a patient with depression may require a higher level of cultural competency than providing care to a patient with a less culturally bound illness. Second, the perception of poor cultural competence may be a manifestation of the depression itself, that is patients with depression are more likely to report all aspects of their care as poor simply because they are depressed. Finally, patients with depression are “often disengaged, unassertive, and poorly informed,”23 which may limit providers’ opportunities for establishing rapport or demonstrating the cultural competence of their care. On the basis of these hypothetical pathways, it seems reasonable that cultural competency training courses for providers practicing in safety-net settings should specifically address the provision of culturally competent care to patients with depression, and the manifestations of depression in diverse populations. Although it may also seem reasonable to target cultural competency efforts to patients with depressive symptoms, such a narrow focus may miss a large number of patients experiencing less culturally competent care. Finally, improving treatment of depression may change patients’ perceptions of the cultural competence of their care. However, we are aware of no studies which specifically test the effects of these kinds of interventions on patient perceptions of cultural competence.
Our results have a number of limitations. Health care providers who are more values-motivated may gravitate toward jobs in safety-net settings, as these settings often present the greatest opportunity to interact with patients of diverse cultural backgrounds.24 Therefore, cultural competence skills of providers in our sample may be higher than cultural competence skills of less highly selected providers. Similarly, practice organization and systems-based health care in the safety-net setting may respond to increased patient diversity with an increased emphasis on providing culturally competent care. Patient from settings outside the safety net away from large, diverse urban areas may therefore experience their care as less culturally competent. Patients without diabetes, and particularly those without health conditions that require highly effective and ongoing patient-provider communication, may exhibit different socioeconomic and clinical associations with cultural competence. Finally, we are not able to determine from these data whether perceptions of cultural competency explain any sociodemographic inequalities in health care outcomes.
Although some sociodemographic and clinical subgroups in the safety-net setting report less culturally competent care, in general differences among groups are inconsistent across various domains of cultural competency. These findings suggest that cultural competency efforts in safety-net settings should be broadly targeted, rather than focusing on specific population subgroups.
1. A Comprehensive Framework and Preferred Practices for Measuring and Reporting Cultural Competency: A Consensus Report. 2009 Washington, DC National Quality Forum (NQF)
2. Stern RJ, Fernandez A, Jacobs EA, et al. Advances in measuring culturally competent care: a confirmatory factor analysis of the CAHPS-CC in a safety-net population. Med Care.
3. Collins KS, Hughes DL, Doty MM, et al. Diverse Communities, Common Concerns: Assessing Health Care Quality for Minority Americans. 2002 New York, NY The Commonwealth Fund
4. Weech-Maldonado R, Carle A, Weidmer B, et al. The Consumer Assessment of Healthcare Providers and Systems (CAHPS) Cultural Competenc (CC) item set. Med. Care
. 2012;50(suppl 2):S22–S31
5. Piette JD, Schillinger D, Potter MB, et al. Dimensions of patient-provider communication and diabetes self-care in an ethnically diverse population. J Gen Intern Med. 2003;18:624–633
6. Aikens JE, Bingham R, Piette JD. Patient-provider communication and self-care behavior among type 2 diabetes patients. Diabetes Educ. 2005;31:681–690
7. Heisler M, Bouknight RR, Hayward RA, et al. The relative importance of physician communication, participatory decision making, and patient understanding in diabetes self-management. J Gen Intern Med. 2002;17:243–252
8. Zweifler J, Hughes S, Lopez RA. Controlling for race/ethnicity: a comparison of California commercial health plans CAHPS scores to NCBD benchmarks. Int J Equity Health. 2010;9:4–12
9. Lurie N, Zhan C, Sangl J, et al. Variation in racial and ethnic differences in consumer assessments of health care. Am J Manage Care. 2003;9:502–509
10. Fongwa MN, Cunningham W, Weech-Maldonado R, et al. Reports and ratings of care: black and white Medicare enrollees. J Health Care Poor Underserved. 2008;19:1136–1147
11. Sisk JE, Gorman SA, Reisinger AL, et al. Evaluation of Medicaid managed care. Satisfaction, access, and use. JAMA. 1996;276:50–55
12. Keenan PS, Elliott MN, Cleary PD, et al. Quality assessments by sick and healthy beneficiaries in traditional Medicare and Medicare managed care. Med Care. 2009;47:882–888
13. Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. 2001;16:606–613
14. Morales LS, Elliott MN, Weech-Maldonado R, et al. Differences in CAHPS adult survey reports and ratings by race and ethnicity: an analysis of the National CAHPS benchmarking data 1.0. Health Serv Res. 2001;36:595–617
15. Johnson RL, Saha S, Arbelaez JJ, et al. Racial and ethnic differences in patient perceptions of bias and cultural competence in health care. J Gen Intern Med. 2004;19:101–110
16. Blanchard J, Lurie N. R-E-S-P-E-C-T: patient reports of disrespect in the health care setting and its impact on care. J Fam Pract. 2004;53:721–730
17. Rutten LJ, Augustson E, Wanke K. Factors associated with patients’ perceptions of health care providers’ communication behavior. J Health Commun. 2006;11(suppl 1):135–146
18. Jackson JL, Chamberlin J, Kroenke K. Predictors of patient satisfaction. Soc Sci Med. 2001;52:609–620
19. Hopton JL, Howie JG, Porter AM. The need for another look at the patient in general practice satisfaction surveys. Fam Pract. 1993;10:82–87
20. Bui QU, Ostir GV, Kuo YF, et al. Relationship of depression to patient satisfaction: findings from the barriers to breast cancer study. Breast Cancer Res Treat. 2005;89:23–28
21. Wyshak G, Barsky A. Satisfaction with and effectiveness of medical care in relation to anxiety and depression. Patient and physician ratings compared. Gen Hosp Psychiatry. 1995;17:108–114
22. Swenson SL, Rose M, Vittinghoff E, et al. The influence of depressive symptoms on clinician-patient communication among patients with type 2 diabetes. Med Care. 2008;46:257–265
23. Martino SC, Elliott MN, Kanouse DE, et al. Depression and the health care experiences of Medicare beneficiaries. Health Serv Res. 2011;46:1883–1904
24. Curlin FA, Dugdale LS, Lantos JD, et al. Do religious physicians disproportionately care for the underserved? Ann Fam Med. 2007;5:353–360