Share this article on:

The Mandate to Measure Patient Experience: How Can Patients “Value” Anesthesia Care?

Meyer, Matthew J. MD; Hyder, Joseph A. MD, PhD; Cole, Daniel J. MD; Kamdar, Nirav V. MD, MPP

doi: 10.1213/ANE.0000000000001198
The Open Mind: The Open Mind

From the *Department of Anesthesia, Critical Care and Pain Medicine, Massachusetts General Hospital, Boston, Massachusetts; Department of Anesthesiology, Center for the Science of Health Care Delivery, Mayo Clinic, Rochester, Minnesota; Department of Anesthesiology and Perioperative Medicine, UCLA David Geffen School of Medicine, Los Angeles, California.

Accepted for publication December 28, 2015.

Funding: None.

The authors declare no conflicts of interest.

Reprints will not be available from the authors.

Address correspondence to Matthew J. Meyer, MD, Department of Anesthesia, Critical Care and Pain Medicine, Massachusetts General Hospital, 55 Fruit St., Boston, MA 02114. Address e-mail to mjmeyer@mgh.harvard.edu.

In an effort to ensure that the quality of medical care in the United States is commensurate with the societal and opportunity costs of providing this care, the health care industry has been compelled to place a greater emphasis on value.1 “Bending the cost curve” was popular jargon justifying the passage of the Affordable Care Act and the resultant public policy redefining health care. Experts posit that health care systems will reorganize around new payment models linking payment and resource allocation to quality metrics.2 In this article, we (1) present the fiscal and financial impetus for concentrating on health care value, (2) discuss how an influential survey quantifying patient experience in the perioperative period inadequately assesses anesthesiologists’ value, and (3) emphasize the importance of organizationally transforming anesthesiology to display our actual value as a comprehensive perioperative care team. For clarification, when “anesthesiology” is written, it refers to the profession; when “anesthesiologist” is written, it refers to the individual; and when “anesthesiologists” is written, it refers to the entire group of anesthesiologists contributing to a patient’s perioperative care.

Back to Top | Article Outline

FISCAL POLICY AND FINANCIAL EFFECTS ON HEALTH CARE

As health care systems improve performance and reduce waste to survive, 2 stakeholders must actively lead: patients and clinicians. Soon, all medical specialties will need to provide quantifiable evidence of value (outcomes relative to cost) to patients.3 Clinicians must ensure that the elimination of “waste” through cost-saving measures does not compromise our ability to provide high-value care to our patients (Fig. 1).

Figure 1

Figure 1

The Affordable Care Act created the Value-Based Payment modifier that financially penalizes or incentivizes Medicare reimbursements based on the value of care delivered to patients. Thirty percent of the Value-Based Payment modifier is patient experience metrics. The Centers for Medicare and Medicaid Services (CMS) stated that patient experience metrics for the perioperative period are a priority.a Notably, the Medicare Access and CHIP Reauthorization Act of 2015 mandated that, beginning in 2019, the Value-Based Payment modifier will be folded into a new system of payment (Merit-Based Incentive Payment System).b Although Merit-Based Incentive Payment System-specific rules have yet to be written, clinicians will be scored across several quality domains; rewards or penalties will be based on whether a score is above or below a threshold set by the Secretary of the Department of Health and Human Services.

Back to Top | Article Outline

QUANTIFYING PATIENT EXPERIENCE AS PART OF THE VALUE EQUATION

Hospital Consumer Assessment of Healthcare Providers and Systems

The Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) was the earliest comprehensive patient experience survey administered nationally by CMS. HCAHPS evaluates the in-hospital experience of medical, surgical, and obstetrical patients through patient feedback. It focuses on clinician care and communication, as well as on hospital cleanliness and quietness.4 In April 2015, CMS ranked hospitals by HCAHPS scores (http://www.medicare.gov/hospitalcompare/); only 251 institutions (7%) received top honors (5 stars). These CMS rankings were well publicized.5

The public reporting, financial implications, and explicit identification of care deficits by HCAHPS motivated hospitals to improve patient experience.6 Although 2 early studies did not find an association between HCAHPS scores and other surgical outcomes,7,8 both studies acknowledged that a surgery-specific instrument might better assess the relationship between patient experience and perioperative outcomes.

Back to Top | Article Outline

Consumer Assessment of Healthcare Providers and Systems Surgical Care Survey

The American Society of Anesthesiologists and American College of Surgeons helped develop the Consumer Assessment of Healthcare Providers and Systems Surgical Care Survey (Surgical CAHPS) as an analog to HCAHPS for the perioperative experience. Both organizations support its use as the patient experience metric for the Value-Based Payment modifier for surgical procedures and for public reporting on Physician Compare (www.medicare.gov/physiciancompare/).c Although there are numerous validated instruments assessing patient satisfaction with anesthesia care,9,10 we focus on Surgical CAHPS because it is administered by the Agency for Healthcare Research and Quality, and endorsed by the National Quality Forum (#1741). Surgical CAHPS is uniquely positioned to deploy nationally, to modify (i.e., incentivize or penalize) CMS reimbursements, and to influence hospital and departmental reputations.

The current version of Surgical CAHPS (2.0)d has 47 questions: 26 actionable, 2 quantitative rankings, 10 demographic, and 9 filter questions to guide the respondent. Of the 47 questions, 8 are in the anesthesiology section (Table 1), and only 3 are actionable, all pertaining exclusively to the preanesthesia visit:

  • Did this anesthesiologist encourage you to ask questions?
  • Did this anesthesiologist answer your questions in a way that was easy to understand?
  • Did talking with this anesthesiologist during this visit make you feel more calm and relaxed?
Table 1

Table 1

The final question is a quantitative ranking:

  • Using any number from 0 to 10, where 0 is the worst anesthesiologist possible and 10 is the best anesthesiologist possible, what number would you use to rate this anesthesiologist?
Figure 2

Figure 2

The anesthesiology section of the Surgical CAHPS asks 3 questions about the preanesthesia visit and requires an ordinal ranking of the anesthesiologist from worst to best. It neglects the majority of anesthesiologists’ perioperative contributions (Fig. 2). Surgical CAHPS devalues the impact of anesthesiologists on a patient’s perioperative experience by making only 3 of the 26 actionable Surgical CAHPS questions about anesthesiology, focusing only on a single anesthesiologist, and including none of the results in the scoring rubric.11

Back to Top | Article Outline

Beyond the Ether Screen: Anesthesiology and Patient Experience

CMS states that patient experience metrics in the perioperative period are a priority. We agree but do not believe that the anesthesiology section of Surgical CAHPS is a valid tool to assess the value of anesthesiologists to the perioperative patient experience. Surgical CAHPS, like many patient experience surveys assessing an anesthesiologist’s care within a care team model, has issues with validity.12 First, patients often interact with multiple anesthesiologists during the perioperative time period. Even when the same anesthesiologist performs the preoperative visit, intraoperative anesthesia care, and postoperative visit, <15% of patients recognize the anesthesiologist’s name 6 weeks after surgery13 when Surgical CAHPS may be administered. Second, Surgical CAHPS focuses only on a single anesthesiologist: perioperative outcomes are a result of intradisciplinary and interdisciplinary collaboration, and ascribing accountability to an individual anesthesiologist is challenging14 and likely inappropriate.15 Finally, and partly related to benzodiazepine premedication, 60% of patients have some component of amnesia to events before induction of general anesthesia,16 the only period Surgical CAHPS evaluates.

Future iterations of Surgical CAHPS must more accurately represent and assess anesthesiology’s impact on patient experience. Foremost, anesthesiology is a team-based specialty, and Surgical CAHPS should evaluate anesthesiologists as a team and anesthesiology as a system. In addition, anesthesiologists contribute to patient care at multiple critical moments in the perioperative period.17 The instrument should assess clinical and systems issues related to the preanesthesia clinic, operating room team, postanesthesia care unit, intensive care unit, and pain management team. Finally, the questions must be validated in the appropriate surgical populations.18

Back to Top | Article Outline

ANESTHESIOLOGY AS A COMPREHENSIVE PERIOPERATIVE CARE TEAM

Anesthesiology must proactively address our value proposition challenge by projecting the complexity and impact of anesthesiology-provided perioperative care to our colleagues and our patients. The demonstration of anesthesiology’s value to the patient experience, which includes promoting patient engagement,19 sharing clinical decisions,20 and incorporating patient voices into performance improvement,21 should emphasize the nonoperative time of the perioperative experience.22

Back to Top | Article Outline

Organizationally Transforming Anesthesiology to Display Its Actual Value

Anesthesiology can use this mandate for quality and patient experience metrics to motivate the transition of anesthesiology’s identity from fellowship-based departmental subspecialties to the perioperative surgical home (PSH) with an identity that emphasizes perioperative coordination of care. The PSH can function as an integrated practice unit displaying the breadth of involvement that anesthesiologists have in the perioperative period: preoperative medical assessment and optimization, interdisciplinary coordination, risk stratification, crisis management, knowledge of intraoperative physiology and pharmacology, and postoperative medical and pain management. The PSH,23 or Perioperative Enhancement Team, as entitled by Duke Anesthesiology, clearly demonstrates anesthesiologists’ role and value to the health care system. The PSH is a venue to longitudinally engage and advocate for patients from diagnosis to recovery. We can start this effort in the current model of anesthesia care by capitalizing on the perioperative experience as a teachable moment for patients.24

The preanesthesia clinic can provide a touchstone interaction between anesthesiologists and patients and may be a foundation for the PSH. However, for the subset of patients who do not attend the preanesthesia clinic, they have their initial contact with an anesthesiologist on the day of surgery with the preanesthesia visit. Anesthesiologists can provide a greater value to the patient experience and to the health of the population by expanding the traditional preanesthesia history and physical, risk stratifying patients, and developing customized, best practices. In addition, intraoperative physiologic and pharmacologic observations can be communicated postoperatively to intensive care and pain medicine colleagues to optimize management. The same information can be used to educate patients on their individual physiology and its implications for their long-term health.

These efforts will better inform patients about their health and anesthesiologists’ roles in their health care and result in greater patient satisfaction.25 If we do not work toward these goals, we risk diminished relevance in a health care system that increasingly values publicly reported, patient-centered, patient feedback metrics.26

Back to Top | Article Outline

Operationalizing the Change

Anesthesiology needs to clearly define anesthesiologists’ value proposition and broadcast it to patients, payers, and other clinicians.27 We must ensure Surgical CAHPS, and all metrics of anesthesiology quality, focus on the entirety of anesthesiologists’ perioperative contributions and thus assess the intended constructs and provide valid and actionable data. We have to continue to collect and analyze data from the entire perioperative period and change our practice with the results.28 Multicenter Perioperative Outcomes Group29 and National Anesthesia Clinical Outcomes Registry30 are foundational platforms to further develop and emulate. Because direct patient feedback cannot provide us with actionable intraoperative data,31 we should consider seeking feedback from our intraoperative colleagues: surgeons, nurses, allied professionals, and administrators to improve the quality of anesthesiology’s contribution to our patients’ experiences and outcomes. Anesthesiologists can best advocate for our patients when we function as a part of their perioperative clinical team.

Back to Top | Article Outline

CONCLUSIONS

Anesthesiologists have helped refine the intraoperative patient experience to its current level of safety and efficiency, and we continue to improve its effectiveness through standardization32 and reduction in complications33 and costs.34,35 With the mandate to evaluate anesthesiology’s contribution to patient experience, the metrics cannot be focused on the individual but must be on the care team. We must systematically display our value with anesthesiology-led, patient-centered, care coordination through the PSH as a key part of our future and be assessed accordingly. Our success with the intraoperative experience must now be expanded, by improving patient experience and patient value throughout the perioperative period.36 We should embrace this opportunity to prepare our profession for success and leadership in current and future health care paradigms.

Back to Top | Article Outline

DISCLOSURES

Name: Matthew J. Meyer, MD.

Contribution: This author helped write the manuscript.

Attestation: Matthew J. Meyer approved the final manuscript.

Name: Joseph A. Hyder, MD, PhD.

Contribution: This author helped write the manuscript.

Attestation: Joseph A. Hyder approved the final manuscript.

Name: Daniel J. Cole, MD.

Contribution: This author helped write the manuscript.

Attestation: Daniel J. Cole approved the final manuscript.

Name: Nirav V. Kamdar, MD, MPP.

Contribution: This author helped write the manuscript.

Attestation: Nirav V. Kamdar approved the final manuscript.

This manuscript was handled by: Franklin Dexter, MD, PhD.

Back to Top | Article Outline

ACKNOWLEDGMENTS

We thank Dr. Carl Rosow for his insightful critiques that strengthened our argument, Dr. Brian Bateman for his editing and support, and John William Meyer for his microeconomics review.

Back to Top | Article Outline

FOOTNOTES

a Centers for Medicare and Medicaid Services list of measures under consideration for December 1, 2014. Available at: https://www.qualityforum.org/setting_priorities/partnership/measures_under_consideration_list_2014.aspx. Accessed August 12, 2015.
Cited Here...

b H.R.2 - Medicare Access and CHIP Reauthorization Act of 2015. Available at: https://www.congress.gov/bill/114th-congress/house-bill/2/text. Accessed October 16, 2015.
Cited Here...

c Available at: http://asts.org/docs/default-source/reimbursement/letter-to-cms-supporting-inclusion-of-s-cahps-survey-in-pqrs-web-interface-december-13–2012.pdf?sfvrsn=6. Accessed July 20, 2015.
Cited Here...

d Get the surgical care survey and instructions. Available at: https://cahps.ahrq.gov/surveys-guidance/surgical/instructions/get-surg-care-survey-instruct.html. Accessed September 8, 2015.
Cited Here...

Back to Top | Article Outline

REFERENCES

1. Porter ME. What is value in health care? N Engl J Med. 2010;363:2477–81
2. Rajkumar R, Conway PH, Tavenner M. CMS—engaging multiple payers in payment reform. JAMA. 2014;311:1967–8
3. Newman MF, Mathew JP, Aronson S. The evolution of anesthesiology and perioperative medicine. Anesthesiology. 2013;118:1005–7
4. . NQF endorses HCAHPS patient perception survey. Healthcare Benchmarks Qual Improv. 2005;12:82–3
5. Rau J. Top hospital ratings prove scarce in Medicare’s latest tally. NPR. April 22, 2015 Available at: at http://www.npr.org/sections/health-shots/2015/04/17/400174947/only-251-hospitals-score-five-stars-in-medicare-s-new-ratings. Accessed February 6, 2016
6. Perna G. Hospital leaders create ‘the culture of always.’ Hospital leaders look at HCAHPS as a way to improve the patient-centered culture. Healthc Inform. 2013;30:42, 44, 56
7. Sheetz KH, Waits SA, Girotti ME, Campbell DA Jr, Englesbe MJ. Patients’ perspectives of care and surgical outcomes in Michigan: an analysis using the CAHPS hospital survey. Ann Surg. 2014;260:5–9
8. Kennedy GD, Tevis SE, Kent KC. Is there a relationship between patient satisfaction and favorable outcomes? Ann Surg. 2014;260:592–8
9. Barnett SF, Alagar RK, Grocott MP, Giannaris S, Dick JR, Moonesinghe SR. Patient-satisfaction measures in anesthesia: qualitative systematic review. Anesthesiology. 2013;119:452–78
10. Dexter F, Aker J, Wright WA. Development of a measure of patient satisfaction with monitored anesthesia care: the Iowa Satisfaction with Anesthesia Scale. Anesthesiology. 1997;87:865–73
11. Hyder JA. Pain-free surgery or pain-free parking: measuring patient satisfaction with perioperative care is humbling for the anesthesiologist. Anesthesiology. 2014;120:780–1
12. Capuzzo M, Alvisi R. Is it possible to measure and improve patient satisfaction with anesthesia? Anesthesiol Clin. 2008;26:613–26, v
13. Jeske HC, Lederer W, Lorenz I, Kolbitsch C, Margreiter J, Kinzl J, Benzer A. The impact of business cards on physician recognition after general anesthesia. Anesth Analg. 2001;93:1262–4
14. Abouleish AE, Zornow MH, Levy RS, Abate J, Prough DS. Measurement of individual clinical productivity in an academic anesthesiology department. Anesthesiology. 2000;93:1509–16
15. Wanderer JP, Shi Y, Schildcrout JS, Ehrenfeld JM, Epstein RH. Supervising anesthesiologists cannot be effectively compared according to their patients’ postanesthesia care unit admission pain scores. Anesth Analg. 2015;120:923–32
16. Chen Y, Cai A, Fritz BA, Dexter F, Pryor KO, Jacobsohn E, Glick DB, Willingham MD, Escallier KE, Winter AC, Avidan MS. Amnesia of the operating room in the B-Unaware and BAG-RECALL clinical trials. Anesth Analg. 2016;122:1158–68
17. Fleisher LA, Lee TH. Anesthesiology and anesthesiologists in the era of value-driven health care. Healthc (Amst). 2015;3:63–6
18. Vetter TR, Ivankova NV, Pittet JF. Patient satisfaction with anesthesia: beauty is in the eye of the consumer. Anesthesiology. 2013;119:245–7
19. Kash BA, Zhang Y, Cline KM, Menser T, Miller TR. The perioperative surgical home (PSH): a comprehensive review of US and non-US studies shows predominantly positive quality and cost outcomes. Milbank Q. 2014;92:796–821
20. Flierler WJ, Nübling M, Kasper J, Heidegger T. Implementation of shared decision making in anaesthesia and its influence on patient satisfaction. Anaesthesia. 2013;68:713–22
21. Yen C, Tsai M, Macario A. Preoperative evaluation clinics. Curr Opin Anaesthesiol. 2010;23:167–72
22. Maher DP, Wong W, Woo P, Padilla C, Zhang X, Shamloo B, Rosner H, Wender R, Yumul R, Louy C. Perioperative factors associated with HCAHPS responses of 2,758 surgical patients. Pain Med. 2015;16:791–801
23. Kain ZN, Vakharia S, Garson L, Engwall S, Schwarzkopf R, Gupta R, Cannesson M. The perioperative surgical home as a future perioperative practice model. Anesth Analg. 2014;118:1126–30
24. Margolis J, Hockenberry J, Grossman M, Chou S-Y Moral Hazard and Less Invasive Medical Treatment for Coronary Artery Disease: The Case of Cigarette Smoking (Working Paper No. 20373). Available at National Bureau of Economic Research website: http://www.nber.org/papers/w20373.pdf. Accessed February 6, 2016
25. Caljouw MA, van Beuzekom M, Boer F. Patient’s satisfaction with perioperative care: development, validation, and application of a questionnaire. Br J Anaesth. 2008;100:637–44
26. Barr P. The boomer challenge: baby boomers expect more out of health care. H&HN Magazine. December 9, 2014
27. Cohen B, Ogorek D, Oifa S, Cattan A, Matot I. Smart marketing may improve public understanding of the anesthesia profession. Isr J Health Policy Res. 2015;4:16
28. Simpao AF, Ahumada LM, Rehman MA. Big data and visual analytics in anaesthesia and health care. Br J Anaesth. 2015;115:350–6
29. Kheterpal S. Clinical research using an information system: the multicenter perioperative outcomes group. Anesthesiol Clin. 2011;29:377–88
30. Dutton RP. The national anesthesia clinical outcomes registry: a sustainable model for the information age? EGEMS (Wash DC). 2014;2:1070
31. Brown DL, Warner ME, Schroeder DR, Offord KP. Effect of intraoperative anesthetic events on postoperative patient satisfaction. Mayo Clin Proc. 1997;72:20–5
32. Cook DJ, Pulido JN, Thompson JE, Dearani JA, Ritter MJ, Hanson AC, Borah BJ, Habermann EB. Standardized practice design with electronic support mechanisms for surgical process improvement: reducing mechanical ventilation time. Ann Surg. 2014;260:1011–5
33. Liau A, Havidich JE, Dutton RP. An overview of adverse events in the National Anesthesia Clinical Outcomes Registry (NACOR). ASA Abstract. 2014 New Orleans, LA
34. Dexter F, Wachtel RE. Strategies for net cost reductions with the expanded role and expertise of anesthesiologists in the perioperative surgical home. Anesth Analg. 2014;118:1062–71
35. Raphael DR, Cannesson M, Schwarzkopf R, Garson LM, Vakharia SB, Gupta R, Kain ZN. Total joint Perioperative Surgical Home: an observational financial review. Perioper Med (Lond). 2014;3:6
36. . Anesthesiology: an important ally in building better surgical services. OR Manager. 2014;30:23–5
© 2016 International Anesthesia Research Society