The Consumer Assessment of Healthcare Providers and Systems (CAHPS) Cultural Competence (CC) Item Set

Weech-Maldonado, Robert PhD*; Carle, Adam PhD; Weidmer, Beverly MA; Hurtado, Margarita PhD§; Ngo-Metzger, Quyen MD; Hays, Ron D. PhD

Medical Care:
doi: 10.1097/MLR.0b013e318263134b
Cultural Competence

Background: There is a need for reliable and valid measures of cultural competence (CC) from the patient’s perspective.

Objective: This paper evaluates the reliability and validity of the Consumer Assessments of Healthcare Providers and Systems (CAHPS) CC item set.

Research Design: Using 2008 survey data, we assessed the internal consistency of the CAHPS CC scales using the Cronbach α’s and examined the validity of the measures using exploratory and confirmatory factor analysis, multitrait scaling analysis, and regression analysis.

Subjects: A random stratified sample (based on race/ethnicity and language) of 991 enrollees, younger than 65 years, from 2 Medicaid managed care plans in California and New York.

Measures: CAHPS CC item set after excluding screener items and ratings.

Results: Confirmatory factor analysis (Comparative Fit Index=0.98, Tucker Lewis Index=0.98, and Root Mean Square Error or Approximation=0.06) provided support for a 7-factor structure: Doctor Communication—Positive Behaviors, Doctor Communication—Negative Behaviors, Doctor Communication—Health Promotion, Doctor Communication—Alternative Medicine, Shared Decision-Making, Equitable Treatment, and Trust. Item-total correlations (corrected for item overlap) for the 7 scales exceeded 0.40. Exploratory factor analysis showed support for 1 additional factor: Access to Interpreter Services. Internal consistency reliability estimates ranged from 0.58 (Alternative Medicine) to 0.92 (Positive Behaviors) and was 0.70 or higher for 4 of the 8 composites. All composites were positively and significantly associated with the overall doctor rating.

Conclusions: The CAHPS CC 26-item set demonstrates adequate measurement properties and can be used as a supplemental item set to the CAHPS Clinician and Group Surveys in assessing culturally competent care from the patient’s perspective.

Author Information

*Department of Health Services Administration, University of Alabama at Birmingham, Birmingham, AL

University of Cincinnati School of Medicine

RAND, Santa Monica, CA

§American Institutes for Research (AIR), Silver Spring, MD

Department of Medicine, University of California, Irvine School of Medicine, Irvine, CA

Department of Medicine, University of California Los Angeles, Los Angeles, CA

Funded in part by the Commonwealth Fund Grant #20060692. R.W-M. was supported in part by the UAB Center of Excellence in Comparative Effectiveness for Eliminating Disparities (CERED), NIH/NCMHD Grant 3P60MD000502-08S1. A.C. was partly supported by 1R15NR010631 (NIH/NINR) and U01 AR057940-02S1 (NIH/NIAMS). R.D.H. was supported by a cooperative agreement from the Agency for Healthcare Research and Quality (U18 HS016980), the National Institute on Aging (P30AG021684), and NCMHD (2P20MD000182).

Conducted while Q.N-M. was at the University of California, Irvine.

The views expressed in this publication are solely the opinions of the authors and do not necessarily reflect the official policies of the US Department of Health and Human Services or the Health Resources and Services Administration, nor does mention of the department or agency names imply endorsement by the US Government.

The authors declare no conflict of interest.

Reprints: Robert Weech-Maldonado, PhD, Department of Health Services Administration, University of Alabama at Birmingham, 1675 University Boulevard, 520 Webb, Birmingham, AL 35294. E-mail:

Article Outline

Among the strategies that have been advocated for reducing racial/ethnic differences in patient experiences is the provision of “culturally competent” care.1,2 The National Quality Forum (p. 2) recently defined cultural competency as the “ongoing capacity of health care systems, organizations, and professionals to provide for diverse patient populations high-quality care that is safe, patient-centered and family-centered, evidence-based, and equitable.”3

On the basis of the National Quality Forum definition, patient-centered care is one of the major elements of cultural competency. The Institute of Medicine (p. 3)4 defined patient-centered care as “care that is respectful and responsive to individual patient preferences, needs, and values…” McWhinney5 described patient-centered care as being able to see through the patient’s eyes. Thus, the patient’s perspective on the care that he or she receives is an essential barometer of culturally competence care.

The Consumer Assessment of Healthcare Providers and Systems (CAHPS) project has resulted in a set of standardized survey instruments that can be used to collect reliable information from patients about the care they have received. These evaluations provide important information about how well providers meet the needs of the people they serve.6 For example, the CAHPS Clinician and Group (C&G) Surveys assess patients’ experiences with health care providers and staff in doctor’s offices. The CAHPS C&G core survey contains 13 items measuring 3 domains of performance: timeliness of care, provider communication, and staff helpfulness. In addition, it has 1 global rating for provider.7

The CAHPS data have been used to assess racial/ethnic and language differences in patient experiences with care.8–12 However, there are concerns that the CAHPS instrument does not fully capture domains of care of particular relevance to diverse populations, such as trust, perceived discrimination, shared decision-making, and access to language services.1 To address this gap, the CAHPS team developed an item set to assess aspects of cultural competency not adequately addressed in the existing CAHPS surveys, which could serve as a supplemental item set to the CAHPS C&G surveys. The purpose of this study is to evaluate the internal consistency reliability and validity of the CAHPS cultural competence (CC) item set. The psychometric analysis by survey language (English/Spanish) is reported elsewhere.13

Back to Top | Article Outline


Guided by Bethell et al’s14 conceptual model of measuring health care quality among diverse populations and a comprehensive literature review on diverse populations in the United States, we developed a framework for obtaining the patient’s perspective on culturally competent care.1 In this framework, health care is experienced by the patient in the context of interactions with providers within the health care system. Therefore, there are 3 factors that affect the quality of care for diverse populations: patient factors, provider factors, and health care system factors. The framework focuses on the areas where the 3 factors overlap (Fig. 1). The first 2 domains reflect interactions between the patient and the provider: (1) patient–provider communication; (2) respect for patient preferences/shared decision-making. The other 4 domains include patient and provider interactions and interactions with other staff and the health care system overall: (3) experiences leading to trust or distrust; (4) experiences of discrimination; (5) health literacy strategies; and (6) language services. These 6 domains are best measured by patient assessments as opposed to organizational or provider assessments. There are other domains of quality care that are important, such as access (ability to get timely care) or coordination of care (between different providers and health care settings). However, because these domains of quality care have been extensively examined as part of patient-centered care, we chose not to include them within the scope of this study. Furthermore, health literacy was not included as one of the domains of CAHPS CC item set, because it was the focus of a separate project (CAHPS Health Literacy item set).15

We summarize below our literature review on 5 of the CC domains. We focused specifically on empirical studies that included diverse populations (African Americans, Hispanics/Latinos, Asians and Pacific Islanders, or American Indians). We also only included studies conducted in the United States, as the health care systems and experiences in other countries may be very different and thus, not generalizable to the United States.

Back to Top | Article Outline
Patient–Provider Communication

Communication in the medical interaction plays a central role in decisions about subsequent interventions and can influence patient adherence, satisfaction with care, and health outcomes.16 Some racial/ethnic groups and those of lower socioeconomic status are more likely to report poor communication with their physicians.17,18 Providers’ nonverbal and interpersonal communication behaviors have been found to be particularly important for diverse patient populations. For example, Hurtado et al19 found that empathy and establishing rapport (as opposed to just providing health information) were more important to minority patients than to white patients. Similarly, African American, Hispanic, and Asian patients were found to rate the provider’s display of “concern, courtesy, and respect” as the most important factor in the interaction.20,21 Finally, studies have found that listening and spending adequate time are especially important for Asian22 and Hispanic patients.23

Although the CAHPS C&G surveys include provider communication as a core measure, this measure focuses on the behavioral aspects rather than the content of communication. One important content area is communication about complementary and alternative medicine (CAM).1 CAM refers to diverse practices and products that are not currently considered part of conventional medicine.24 An estimated 26% of African Americans, 28% of Hispanics, 36% of non-Hispanic whites, and 43% of Asian Americans use CAM.25 It is important for patients to discuss their use of CAM with their medical practitioners. Some therapies, such as herbal or vitamin therapies, may cause adverse events or interfere with medical regimens. Furthermore, knowledge of patients’ CAM practices can provide valuable insight into patients’ values, lifestyles, and health beliefs, which may, in turn, assist practitioners in providing optimum care.26,27 Yet, in a national survey of US adults, 70% of patients who used CAM reported that their providers did not discuss CAM use with them.24,28

Another content area of particular importance to diverse populations is communication about health promotion. Racial/ethnic minorities suffer disproportionately from chronic diseases, such as diabetes and heart disease.29 As such, communication about diet and exercise are particularly important for prevention in promoting a healthy lifestyle among diverse patient populations. Similarly, racism and discrimination places minorities at higher risk for depression and anxiety.30 Yet minorities are less likely to receive treatment for depression than whites.31 Communication about stress and depression with diverse populations can help reduce disparities in care.

Back to Top | Article Outline
Respect for Patient Preferences/Shared Decision-Making

The Institute of Medicine encourages providers to respect patients’ preferences and promote their active participation in clinical decision-making to the extent that patients’ feel comfortable and are willing to take part.4 Patients may participate in their care in a variety of ways, which includes having meaningful dialogue about their preferences, knowing all the available options, and making final decisions about treatment.

A report by the Agency for Healthcare Research and Quality (p. 122)17 noted that “blacks, Asians, Hispanics, and low-income populations are more likely to feel disenfranchised in the decision-making process.” Compared with whites, African Americans, and Asians were more likely to report underinvolvement in the health care decision-making process (eg, 22% of whites vs. 27% of African Americans and 42% of Asians reported that they were “not as involved as they would like to have been”). Similarly, Hispanics were more likely than non-Hispanic whites to report feeling disenfranchised (34% vs. 21%), and low-income populations were more likely than higher-income populations to report this (30% vs. 20%).18

Back to Top | Article Outline
Experiences Leading to Trust

Patient’s trust is an important element of the health care encounter. Thom et al32 found that patients with lower levels of trust were less likely to adhere to their physician’s advice and were more likely to report not receiving the services they requested or needed. Similarly, patients with lower levels of trust have reported lower levels of satisfaction with the patient–provider relationship.32

Several studies have observed lower levels of patient trust among racial and ethnic minorities.33–36 Using data from a national sample of adults, Hunt et al33 reported that African Americans and Latinos were less trusting and less satisfied with their physicians than whites. Similarly, LaVeist et al36 found that African Americans were significantly more likely than whites to report mistrust of the medical system, and those who reported greater mistrust of the medical care system were less satisfied with their care.

Back to Top | Article Outline
Experiences of Discrimination

According to the Institute of Medicine,37 discrimination is differential treatment based on race, ethnicity, sex, or other individual attribute. Racial bias or discrimination in the practice and delivery of health care may be at least partly responsible for the observed racial and ethnic health disparities.38 Prior research has found that perceived discrimination is associated with various negative health outcomes. Perceived discrimination has also been found to have a negative effect on satisfaction with care.39–41 For example, a study of the California Health Interview survey found that patient perceptions of discrimination based on race or ethnicity were associated with lower ratings of health care quality.40 Similarly, Hausmann et al41 found that perceived racism was associated with low patient ratings of provider warmth/respectfulness and ease of communication. Finally, Weech-Maldonado et al42 found that Medicaid beneficiaries in Florida who perceived discrimination based on race/ethnicity and insurance reported lower CAHPS scores.

Back to Top | Article Outline
Language Services

According to the 2000 census, approximately 47 million people in the United States speak a language other than English at home and over 21 million are limited English proficient (LEP).43 Previous research has shown that non-English patients have worse access to care44–47 and report lower ratings of care than English-speaking patients.9,10,12,48,49

The limited supply of bilingual providers has led health care organizations to use interpreter services to bridge language gaps. When examining the impact of language services, it is important to distinguish between professional interpreters and ad hoc interpreters. Ad hoc interpreters are individuals whose primary job function is something other than interpretation and includes clinic staff as well as the patient’s family members and friends.50 In contrast, professional interpreters receive specialized training on medical interpretation and their main function is interpretation.50 This includes in-person interpretation, third party interpretation, and remote, third party interpretation using technology (eg, using telephone or video). Professional interpreters have been shown to reduce barriers to care among LEP patients.51,52

Back to Top | Article Outline


The CAHPS CC was designed to assess 5 domains of CC: patient–provider communication, respect for patient preferences/shared decision-making, experiences leading to trust or distrust, experiences of discrimination, and language services. The survey development involved 5 steps: (1) evaluating existing CAHPS surveys to identify existing items that addressed the domains of interest; (2) conducting a literature review to identify existing instruments or item sets that had been used in the past to collect data on cultural competency from the patient’s perspective; (3) placing a Federal Register notice with a call for measures; (4) reviewing and adapting existing measures in the public domain; and (5) writing additional survey items as needed for each of the proposed cultural competency domains.

Each of these steps was conducted collaboratively by members of the CAHPS Cultural Comparability Team, a subteam of the CAHPS Consortium that includes health researchers experienced in survey development and testing, psychometrics, and translation and cultural adaptation of survey measures. The review of the literature and the various CAHPS surveys yielded over 90 survey items related to the domains of interest for the CAHPS CC. This included survey items that could be adapted from other CAHPS Surveys, such as the CAHPS In-Center Hemodialysis Survey and the CAHPS American Indian Survey, as well as various surveys that are in the public domain (eg, the National Health Interview Survey, the California Health Interview Survey, the Child Hospitalization Communication, Quality and Safety Survey, Hablamos Juntos, the Commonwealth Fund’s Survey on Disparities in Quality of Healthcare, and the Primary Care Assessment Survey). Only 1 measure submission was received in response to the Federal Register Notice. The survey development team mapped each of the items that was identified through the literature and survey review to the domains of interest and adapted measures that best captured the domains of interest by rewording the items so that they would include a 12-month reference period, the same language in referencing the provider as used in other CAHPS measures, and response options that were consistent with the other CAHPS measures.

The CAHPS CC item set was translated into Spanish using the Agency for Healthcare Research and Quality’s Guidelines for Translating CAHPS Surveys.53 First, 2 independent American Translators Association’s–certified translators conducted 2 forward translations of the survey into Spanish. Translators were instructed to aim for a 6th grade reading level or lower. Second, a committee formed by the 2 translators and members of the CAHPS Cultural Comparability team reviewed the translations and reconciled the differences. The review committee had representation from different Spanish subgroups in the United States, such as Mexican, Puerto Rican, and South American.

Next, we conducted 18 semistructured cognitive interviews (9 in Spanish and 9 in English) with scripted probes in Los Angeles, Boston, and Chapel Hill, NC. Recruitment for the cognitive testing was aimed at getting a mix of respondents in terms of age, race/ethnicity, sex, and level of education. On the basis of the findings of the cognitive interviews, the instrument was revised and a final 44-item set was available for field testing.

Back to Top | Article Outline


Field Test

A field test of the CAHPS CC survey was conducted with a stratified random sample of 6000 adult (18 y and older) enrollees of 2 Medicaid managed care plans, one in New York (3200) and the other in California (2800) in 2008. We chose New York and California for the field test, given the diversity of their population. The stratified sample based on race/ethnicity and preferred language was drawn using the health plans’ administrative data: 1200 non-Hispanic white English speakers, 1200 non-Hispanic black English speakers, 900 Hispanic English speakers, 900 Hispanic Spanish speakers, 900 non-Hispanic Asian English speakers, and 900 non-Hispanic Asians with a preferred language other than English. Health plan enrollees 65 years and older were not included in the sample, as this population is generally dually eligible (Medicare and Medicaid) and their health care experiences may be different than those with Medicaid as their primary insurer.

The survey consisted of a 2-wave mailing with follow-up telephone interview of nonrespondents. The first mailing included an English survey and a cover letter in English and Spanish. The letter directed Spanish speakers to call an 800 number to request a copy of the survey materials in Spanish. Four weeks after the initial mailing, a second survey packet was mailed to nonrespondents. Telephone follow-ups in English and Spanish started 2 weeks after mailing the second survey packet. A monetary incentive of $10 was offered to nonrespondents after the second call attempt. A 26% response rate (n=1380) was achieved with the multipronged approach. After excluding individuals who did not have a personal doctor or a doctor visit during the last 12 months, the final analytic sample consisted of 991 respondents.

Back to Top | Article Outline
Measures and Analysis Plan

The analysis focuses on the CAHPS CC 27-item set after excluding screener items and ratings. Psychometric analysis was used to assess the internal consistency reliability and validity of the CAHPS CC scales. First, exploratory factor analysis (EFA) with varimax rotation in both SAS and Mplus was used.54 The number of factors retained was determined by a combination of criteria: (1) the roots criterion of selecting factors with eigenvalues to be >1; (2) the scree plot to examine the point at which the plot of eigenvalues begins to level off; and (3) the interpretability of factors based on the conceptual framework.55 The language services items were factor analyzed separately, as the items only applied to a small subset of respondents, those with LEP, and who had used an interpreter (N=76). LEP respondents were identified as those for which English was not their primary language and who spoke English not well or not at all.

Second, confirmatory factor analysis was conducted of the CAHPS CC scales derived from the EFA using Mplus. We used fit index levels for Root Mean Square Error or Approximation, Comparative Fit Index, and Tucker Lewis Index as identified by the literature.56 Mplus accounted for the ordinal nature of the response options.57

Third, multitrait scaling analysis was used to assess item discrimination across scales.58 Multitrait scaling generalizes multitrait–multimethod analytic methods from the trait level to the item level. In doing so, it allows the user to investigate convergent and divergent validity at the item level.

Fourth, we used Cronbach α to estimate scale internal consistency reliability. Cronbach α’s were estimated for the overall sample.

Finally, the convergent validity of the CAHPS CC scales was assessed. Regression analyses were conducted to examine the associations between the CAHPS CC composite scores and the overall doctor rating item, controlling for race/ethnicity, sex, age, education, self-rated health status, and language of the survey (Spanish vs. English). Separate regression models were run for each CAHPS CC composite. The CAHPS global rating (0–10) for personal doctor, where 0=worst possible doctor and 10=best possible doctor, was linearly transformed to a 0–100 possible range (ie, multiplied by 10). The CAHPS CC composite scores were calculated by linearly transforming items to a 0–100 possible (with a higher score representing more favorable scores) and then averaging items within each composite. Negatively worded items were rescored to show a positive scale. Self-reported race/ethnicity consisted of non-Hispanic white, Hispanics, non-Hispanic black, non-Hispanic Asian, and other. The sex item asked whether the respondent is male or female. Age consisted of 5 categories: 18–24, 25–34, 35–44, 45–54, and 55–64. Education consisted of 5 categories: eighth grade or less, some high school but did not graduate, high school graduate or GED, some college or 2-year degree, and 4-year college graduate or higher. Self-reported health status asked respondent to rate their overall health: excellent, very good, good, fair, and poor. Finally, Spanish survey is a dummy variable that identifies whether the survey was completed or administered in Spanish.

Back to Top | Article Outline


Descriptive statistics for the analytic sample are presented on Table 1. Hispanics were the largest racial/ethnic group (34%) in the sample, whereas non-Hispanic whites and blacks had the smallest representation with 15% each. Approximately 30% of respondents rated their health as fair or poor. The majority of the sample was female (67%) and younger than 44 years (52%). A significant proportion of respondents (31%) had less than high school graduation or GED. Finally, 12% of respondents completed a Spanish survey.

A comparison of respondents and nonrespondents based on sex, age, race/ethnicity, primary language, and health plan affiliation showed only a few significant differences. Respondents were more likely to be white (24% vs. 20%) and older (39 vs. 36 y) and less likely to be black (18% vs. 22%) compared with nonrespondents. There were no significant differences between respondents and nonrespondents in terms of sex, Hispanic or Asian ethnicity, preferred language, or health plan affiliation.

A 7-factor structure was obtained based on EFA (eigenvalues >1 and scree plot) and guided by the conceptual framework: Doctor Communication—Positive Behaviors (5 items), Doctor Communication—Negative Behaviors (3 items), Doctor Communication—Health Promotion (4 items), Doctor Communication—Alternative Medicine (2 items), Shared Decision-Making (2 items), Equitable Treatment (2 items), and Trust (5 items). Confirmatory factor analysis (Comparative Fit Index=0.98, Tucker Lewis Index=0.98, Root Mean Square Error or Approximation=0.06) provided support for the 7-factor structure: Item-total correlations (corrected for item overlap) were >0.40 for all the multi-item scales (Table 2). The 8 domains of the CAHPS CC match closely those of the initial conceptual framework, except that provider communication is further divided into 4 different scales based on both behavioral aspects (positive and negative behaviors) and content (health promotion and alternative medicine) of communication.

EFA (eigenvalue >1) of the language services items (4 items) provided support for a 1-factor structure for the Access to Interpreter Services. Factor loadings were >0.40 except for 1 item (how often did the interpreter you had most often at this doctor’s office treat you with courtesy and respect). This item was dropped from the Access to Interpreter Services resulting in a 3-item scale: (1) did you use friends or family members as interpreters because there was no other interpreter available at this doctor’s office?; (2) how often did your visit with this doctor start late because you had to wait for an interpreter?; and (3) was there any time when you needed an interpreter and did not get one at this doctor's office?

Means, SDs, and Cronbach α’s for each of the multi-item scales are shown on Table 3. The lowest CAHPS CC scores were observed for Doctor Communication—Alternative Medicine (mean=12.1), Doctor Communication—Health Promotion (mean=49.1), and Access to Interpreter Services (mean=76). Internal consistency reliability estimates were 0.60 or higher for 7 of the 8 composites and was 0.70 or higher for 4 of the 7 composites. The 2-item Doctor Communication—Alternative Medicine scale had the lowest internal consistency reliability of 0.58.

All CAHPS CC composites were positively and significantly associated with the overall doctor rating (Table 4). The largest unique association was observed for Doctor Communication—Positive Behaviors (B=0.71) with a 10-point increase (P<0.001) in this composite resulting in a 7.1-point increase in doctor rating (0–100 scale). The smallest effect was observed for Access to Interpreter Services (B=0.08) with a 10-point increase (P<0.10), resulting in a 0.8-point increase in doctor rating. The relatively small effect of Access to Interpreter Services may be due to the small sample size for this regression, because this scale was only applicable to those with LEP and who had used an interpreter (n=76).

Back to Top | Article Outline


Among the strategies that have been advocated for reducing racial/ethnic differences in patient experiences with care is the provision of “culturally competent” medical care. This study provides support for the psychometric properties of the CAHPS CC item set in general, especially for the English survey. Our results suggest that the 26-item set measures 8 separate domains [Doctor Communication—Positive Behaviors (Provider Communication core measure in the CAHPS C&G Survey), Doctor Communication—Negative Behaviors, Doctor Communication—Health Promotion, Doctor Communication—Alternative Medicine, Shared Decision-Making, Equitable Treatment, Trust, and Access to Interpreter Services] rather than a single “CC” construct (Appendix 1). CC is a multidimensional concept. Creating individual scales based on these items that correspond to each domain provides a rich set of items that can be used to supplement the CAHPS Health Plan and C&G survey instruments.59

There is the possibility that the multiple factors we observe may reflect “nuisance” factors rather than substantively meaningful factors. A bifactor analysis can be used to explore whether a multidimensional model or unidimensional (bifactor) model best represents the measurement structure of the data. Bifactor models posit that a unidimensional factor (eg, CC) accounts for the covariance among item responses but that 1 or more “nuisance” or “group” factors also exist. Group factors can result from patterns in survey questions, such as common content (eg, repeated questions about a similar topic) or common methodology (eg, questions with similar stems). A multidimensional factor structure consists of meaningful and separate factors. If the bifactor model fits better than the multidimensional model, one would generally choose the bifactor model over the multidimensional model. In a separate study by Carle and Weech-Maldonado,60 we use bifactor analysis to provide support for the multidimensional model and the use of separate CAHPS CC scales.

The lowest CAHPS CC mean scores were observed for Doctor Communication—Alternative Medicine, Doctor Communication—Health Promotion, and Access to Interpreter Services. These are domains of particular relevance to racial/ethnic minorities. Doctor communication on alternative medicine and health promotion is crucial when caring for diverse populations. Racial/ethnic minorities have greater use of alternative medicine and tend to engage less in health promotion behaviors. Access to interpreter services is important for patient communication particularly as the population becomes more linguistically diverse. Policymakers and health plans should incentivize providers to engage in these types of behaviors.

As our results suggest that all CAHPS CC measures are positively associated with CAHPS doctor ratings, there are 3 scales that are most strongly associated with doctor ratings: Provider Communication—Positive Behaviors, Provider Communication—Negative Behaviors, and Trust. Health care organizations wanting to improve their CAHPS ratings can implement quality improvement activities to address CAHPS CC domains, with a focus on the behavioral aspects of communication and trust.

The study presents several limitations. First, the study was limited to a Medicaid managed care population. However, a recent study by Stern et al61 tested the CAHPS CC with an uninsured/underinsured patient population with type 2 diabetes and provided support for the model reported here. Further research is needed testing these measures with other insured populations such as Medicare and commercial. Second, because of resource limitations, the survey was only translated into Spanish. Translation into other languages and research examining the measurement equivalence of CAHPS CC in other languages is needed. Third, we did not have any provider identifiers. Therefore, we were not able to assess the interrater reliability of the measures at the provider or practice level. Future studies are needed to examine the interrater reliability of the CAHPS CC measures and the temporal stability of the measures. Finally, the survey had a relatively low response rate. This may have resulted in potential response bias. Respondents were less likely to be black, but there were no significant differences between respondents and nonrespondents in terms of sex, Hispanic or Asian ethnicity, or preferred language. Despite these limitations, the CAHPS CC item set can serve as a tool to measure culturally competent care from the patient’s perspective.

Back to Top | Article Outline
APPENDIX 1 Cited Here...
Back to Top | Article Outline


1. Ngo-Metzger Q, Telfair J, Sorkin D, et al. Cultural Competency and Quality of Care: Obtaining the Patient’s Perspective. 2006 New York Commonwealth Fund
2. Weech-Maldonado R, Dreachslin JL, Dansky KH, et al. Racial/ethnic diversity management and cultural competency: the case of Pennsylvania hospitals. J Healthc Manag. 2002;47:111–126
3. National Quality Forum. A Comprehensive Framework and Preferred Practices for Measuring and Reporting Cultural Competency. 2008 Washington, DC National Quality Forum
4. Institute of Medicine (IOM), Committee on Quality Health Care in America. . Crossing the Quality Chasm. 2001 Washington, DC National Academy Press
5. McWhinney IStewart M, Roter D. The need for a transformed clinical method. Communicating With Medical Patients. 1989 London Sage:25–40
6. Crofton C, Lubalin JS, Darby C. Foreword. Med Care. 1999;37:MS1–MS9
7. Agency for Health Care Research and Quality (AHRQ). CAHPS Clinician & Group Surveys. 2012. Available at: Accessed on August 2, 2012
8. Morales LS, Elliott MN, Weech-Maldonado R, et al. Differences in CAHPS adult survey reports and ratings by race and ethnicity: an analysis of the National CAHPS benchmarking data 1.0. Health Serv Res. 2001;36:595–618
9. Weech-Maldonado R, Morales LS, Spritzer K, et al. Racial and ethnic differences in parents’ assessments of pediatric care in Medicaid managed care. Health Serv Res. 2001;36:575–594
10. Weech-Maldonado R, Morales LS, Elliott M, et al. Race/ethnicity, language, and patients’ assessments of care in Medicaid managed care. Health Serv Res. 2003;38:789–808
11. Weech-Maldonado R, Elliott MN, Morales LS, et al. Health plan effects on patient assessments of Medicaid managed care among racial/ethnic minorities. J Gen Intern Med. 2004;19:136–145
12. Weech-Maldonado R, Fongwa MN, Gutierrez P, et al. Language and regional differences in evaluations of Medicare managed care by Hispanics. Health Serv Res. 2008;43:552–568
13. Carle A, Weech-Maldonado R, Weidmer B, et al. Does the consumer assessment of healthcare providers and systems cultural competence survey provide equivalent measurement across English and Spanish versions? Med Care. 2012;50(suppl 2):S37–S41
14. Bethell C, Carter K, Latzke B, et al. Measuring and Interpreting Health Care Quality Across Culturally-Diverse Populations: A Focus on Consumer-reported Indicators of Health Care Quality. 2003 Portland Foundation for Accountability
15. Weidmer B, Brach C, Hays RD. Developmemt and evaluation of CAHPS® survey items assessing how well healthcare providers address health literacy. Med Care. 2012;50(suppl 2):S3–S11
16. Lambert BL, Street RL, Cegala DJ, et al. Provider-patient communication, patient-centered care, and the mangle of practice. Health Commun. 1997;9:27–43
17. Agency for Health Care Research and Quality (AHRQ). National Healthcare Disparities Report. 2003 Rockville U.S. Department of Health and Human Services
18. Collins KS, Hughes DL, Doty MM, et al. Diverse Communities, Common Concerns: Assessing Health Care Quality for Minority Americans. 2002 New York The Commonwealth Fund
19. Ngo-Metzger Q, Telfair J, Sorkin D, et al. Cultural Competency and Quality of Care: Obtaining the Patient's Perspective. New York: Commonwealth Fund; 2006
20. Murray-García JL, Selby JV, Schmittdiel J, et al. Racial and ethnic differences in a patient survey: patients’ values, ratings, and reports regarding physician primary care performance in a large health maintenance organization. Med Care. 2000;38:300–310
21. Nápoles-Springer AM, Santoyo J, Houston K, et al. Patients’ perceptions of cultural factors affecting the quality of their medical encounters. Health Expect. 2005;8:4–17
22. Ngo-Metzger Q, Legedza ATR, Phillips RS. Asian Americans’ reports of their health care experiences. J Gen Intern Med. 2004;19:111–119
23. Saha S, Arbelaez JJ, Cooper LA. Patient-physician relationships and racial disparities in the quality of health care. Am J Public Health. 2003;93:1713–1719
24. Eisenberg DM, Kessler RC, Foster C, et al. Unconventional medicine in the United States—prevalence, costs, and patterns of use. N Engl J Med. 1993;328:246–252
25. Barnes PM, Powell-Griner E, McFann K, et al. Complementary and alternative medicine use among adults: United States, 2002. Adv Data. 2004;343:1–19
26. Pappas S, Perlman A. Complementary and alternative medicine: the importance of doctor-patient communication. Med Clin North Am. 2002;86:1–10
27. Robinson A, McGrail M. Disclosure of CAM use to medical practitioners: a review of qualitative and quantitative studies. Complement Ther Med. 2004;12:90–98
28. Richardson MA, Straus SE. Complementary and Alternative Medicine: Opportunities and Challenges for Cancer Management and Research. 2002;29 Seminars in Oncology Edinburgh, Elsevier:531–545
29. Office of Minority Health and Health Disparities (OMHD). Disease Burden & Risk Factors. Available at: Accessed August 2, 2012
30. Center for Mental Health Services. Mental Health: Culture, Race, and Ethnicity—A Supplement to Mental Health: A Report of the Surgeon General. 2001 Rockville, MD Substance Abuse and Mental Health Services Administration: Department of Health and Human Services
31. Agency for Health Care Research and Quality (AHRQ). National Healthcare Disparities Report 2011. 2012 Rockville, MD Substance Abuse and Mental Health Services Administration: Department of Health and Human Services
32. Thom DH, Kravitz RL, Bell RA, et al. Patient trust in the physician: relationship to patient requests. Fam Pract. 2002;19:476–483
33. Hunt KA, Gaba A, Lavizzo-Mourey R. Racial and ethnic disparities and perceptions of health care: does health plan type matter? Health Serv Res. 2005;40:551–576
34. Schnittker J. Social distance in the clinical encounter: interactional and sociodemographic foundations for mistrust in physicians. Soc Psychol Q. 2004;67:217–235
35. Meredith LS, Siu AL. Variation and quality of self-report health data: Asians and Pacific Islanders compared with other ethnic groups. Med Care. 1995;33:1120–1131
36. LaVeist TA, Nickerson KJ, Bowie JV. Attitudes about racism, medical mistrust, and satisfaction with care among African American and white cardiac patients. Med Care Res Rev. 2000;57:146–161
37. Institute of Medicine (IOM). . Committee on Understanding and Eliminating Racial and Ethnic Disparities in Health Care. Unequal Treatment: Confronting Racial and Ethnic Disparities in Healthcare. 2003 Washington, DC The National Academy Press
38. King WD, Wong MD, Shapiro MF, et al. Does racial concordance between HIV-positive patients and their physicians affect the time to receipt of protease inhibitors? J Gen Intern Med. 2004;19:1146–1153
39. Benkert R, Peters RM, Clark R, et al. Effects of perceived racism, cultural mistrust and trust in providers on satisfaction with care. J Natl Med Assoc. 2006;98:1532–1540
40. Sorkin DH, Ngo-Metzger Q, De Alba I. Racial/ethnic discrimination in health care: impact on perceived quality of care. J Gen Intern Med. 2010;25:390–396
41. Hausmann LRM, Hannon MJ, Kresevic DM, et al. Impact of perceived discrimination in healthcare on patient-provider communication. Med Care. 2011;49:626–633
42. Weech-Maldonado R, Hall A, Bryant T, et al. The relationship between perceived discrimination and patient experiences with healthcare. Med Care. 2012;50(suppl 2):S62–S68
43. U.S. Census Bureau. Census 2000 Summary File 3, Matrices P19, P20, PCT13, and PCT14. 2000 Washington, DC U.S. Census Bureau
44. Solis JM, Marks G, Garcia M, et al. Acculturation, access to care, and use of preventive services by Hispanics: findings from HHANES 1982-84. Am J Public Health. 1990;80:11–19
45. Stein JA, Fox SA. Language preference as an indicator of mammography use among Hispanic women. J Natl Cancer Inst. 1990;82:1715–1716
46. Timmins CL. The impact of language barriers on the health care of Latinos in the United States: a review of the literature and guidelines for practice. J Midwifery Womens Health. 2002;47:80–96
47. Kirkman-Liff B, Mondragon D. Language of interview: relevance for research of southwest Hispanics. Am J Public Health. 1991;81:1399–1404
48. Morales LS, Cunningham WE, Brown JA, et al. Are Latinos less satisfied with communication by health care providers? J Gen Intern Med. 1999;14:409–417
49. Carrasquillo O, Orav EJ, Brennan TA, et al. Impact of language barriers on patient satisfaction in an emergency department. J Gen Intern Med. 1999;14:82–87
50. Grant Makers in Health (GIH). In the Right Words: Addressing Language and Culture in Providing Health Care. 2003 San Francisco, CA Grantmakers Health
51. Jacobs EA, Lauderdale DS, Meltzer D, et al. Impact of interpreter services on delivery of health care to limited–English-proficient patients. J Gen Intern Med. 2001;16:468–474
52. Tocher TM, Larson EB. Do physicians spend more time with non-English-speaking patients? J Gen Intern Med. 1999;14:303–309
53. Weidmer B, Hurtado M, Weech-Maldonado R, et al. Guidelines for Translating CAHPS Surveys. Rockville, MD: Agency for Healthcare Research and Quality. 2012. Available at: Accessed August 2, 2012.
54. Muthén LK, Muthén BO Mplus User’s Guide. 2009 Los Angeles, CA Muthén & Muthén
55. Hair JF Jr, Black W, Babin B, et al. Multivariate Data Analysis. 2006 Auflage, Upper Saddle River, NJ Pearson Prentice Hall
56. Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling. 1999;6:1–55
57. Muthén B. A general structural equation model with dichotomous, ordered categorical, and continuous latent variable indicators. Psychometrika. 1984;49:115–132
58. Hays RD, Hayashi T. Beyond internal consistency reliability: rationale and user’s guide for multitrait analysis program on the microcomputer. Behav Res Methods. 1990;22:167–175
59. Agency for Health Care Research and Quality (AHRQ). CAHPS Cultural Competence Item Set. 2011. Available at: Accessed August 2, 2012
60. Carle A, Weech-Maldonado R. Validly interpreting patients’ reports: using bifactor and multidimensional models to determine whether surveys and scales measure one or more constructs. Med Care. 2012;50(suppl 2):S42–S48
61. Stern RJ, Fernandez A, Jacobs EA, et al. Advances in measuring culturally competent care: a confirmatory factor analysis of CAHPS-CC in a safety-net population. Med Care. 2012;50(suppl 2):S49–S55

Cited By:

This article has been cited 6 time(s).

Medical Care
Does the Consumer Assessment of Healthcare Providers and Systems Cultural Competence Survey Provide Equivalent Measurement Across English and Spanish Versions?
Carle, AC; Weech-Maldonado, R
Medical Care, 50(): S37-S41.
PDF (94) | CrossRef
Medical Care
Advances in Measuring Culturally Competent Care: A Confirmatory Factor Analysis of CAHPS-CC in a Safety-Net Population
Stern, RJ; Fernandez, A; Jacobs, EA; Neilands, TB; Weech-Maldonado, R; Quan, J; Carle, A; Seligman, HK
Medical Care, 50(): S49-S55.
PDF (121) | CrossRef
Medical Care
Risk Factors for Reporting Poor Cultural Competency Among Patients With Diabetes in Safety Net Clinics
Seligman, HK; Fernandez, A; Stern, RJ; Weech-Maldonado, R; Quan, J; Jacobs, EA
Medical Care, 50(): S56-S61.
PDF (105) | CrossRef
Medical Care
The Relationship Between Perceived Discrimination and Patient Experiences With Health Care
Weech-Maldonado, R; Hall, A; Bryant, T; Jenkins, KA; Elliott, MN
Medical Care, 50(): S62-S68.
PDF (104) | CrossRef
Medical Care
Aspects of Culturally Competent Care are Associated With Less Emotional Burden Among Patients With Diabetes
Slean, GR; Jacobs, EA; Lahiff, M; Fisher, L; Fernandez, A
Medical Care, 50(): S69-S73.
PDF (108) | CrossRef
Medical Care
Associations Between Aspects of Culturally Competent Care and Clinical Outcomes Among Patients With Diabetes
Fernandez, A; Seligman, H; Quan, J; Stern, RJ; Jacobs, EA
Medical Care, 50(): S74-S79.
PDF (110) | CrossRef
Back to Top | Article Outline

CAHPS; cultural competence; patient-centered care; measurement

© 2012 Lippincott Williams & Wilkins, Inc.