BACKGROUND: Hemoglobin values (Hb) can facilitate decisions regarding perioperative transfusion management. Currently, Hb can be determined invasively by analyzing blood via laboratory Co–Oximetry (tHb) or by point-of-care HemoCue (HCue). Recently, a new noninvasive, continuous spectrophotometric sensor (Masimo SpHb) was introduced into clinical practice. We compared the accuracy of the SpHb and HCue with tHb.
METHODS: Twenty patients, ages 40 to 80 years, were studied. They received general anesthesia and underwent spine surgery in the prone position. All blood samples were obtained from a radial artery catheter. SpHb, tHb, and HCue were determined immediately after induction of anesthesia, but before the start of surgery and approximately every hour thereafter. Primary outcomes were defined on the basis of the following differences between measures: SpHb − tHb or HCue − tHb. All patients had 3 to 5 observations taken on each measure. Differences and absolute differences were analyzed by several techniques to assess accuracy. We also investigated the relationship between observed differences and the following variables: tHb level, duration of surgery, age, weight, and perfusion index.
RESULTS: Data consisted of 78 measurements of SpHb, tHb, and HCue made on the 20 patients. Absolute differences between SpHb and tHb were <1.5 g/dL for 61% of observations, between 1.6 to 2.0 g/dL for 16% and >2.0 g/dL for 22% of the observations. Observed differences displayed significant decreases with time and higher perfusion index values. No systematic relationships were observed with age or weight. Except for 1 value, all of the HCue values were <1.0 g/dL of tHb.
CONCLUSIONS: Although HCue was consistently accurate, our data confirm that SpHb often correlated well with tHb values. Yet our study indicates that SpHb may not be as accurate as clinically necessary in some patients. Improved refinement of continuous, noninvasive technology, such as SpHb, could address important clinical requirements.
Published ahead of print March 8, 2011
From the *Department of Anesthesia and Perioperative Care and †Department of Epidemiology and Biostatistics, University of California, San Francisco, San Francisco, California.
Funding: This study is funded by the Department of Anesthesia and Perioperative Care at the University of California, San Francisco. The Masimo Corporation provided the Radical 7 Pulse CO-Oximeter with SpHb™, sensors, and software for the study.
Conflict of Interest: See Disclosures at the end of the article.
Reprints will not be available from the authors.
Address correspondence to Ronald D. Miller, MD, Department of Anesthesia and Perioperative Care, University of California, San Francisco, 521 Parnassus Avenue, Box 0648, San Francisco, CA 94143. Address e-mail to firstname.lastname@example.org.
Accepted December 28, 2010
Published ahead of print March 8, 2011
The specific “transfusion trigger” that is the threshold for administering packed red blood cells or whole blood has been debated for years.1–3 Many clinical variables, especially assessment of intravascular volume, hemoglobin (Hb) levels, and their association with each other, are used to determine the amount, timing, and type of fluid to be administered.4 In a hypovolemic patient, an Hb level of <10 g/dL may indicate the need for a blood transfusion, whereas for all patients a level of <7.0 g/dL generally indicates the need for transfusion. Currently, the clinician must make 2 decisions: when to measure the Hb level and, on the basis of the results, when to transfuse blood. Sending a sample of the patient's blood to the laboratory allows Hb to be measured by a Co-Oximeter device (tHb). Alternatively, a sample of the patient's blood can be analyzed for Hb using a point-of-care-HemoCue (HCue) device5 in the operating room or at the bedside.
Until recently, these intermittent and invasive monitoring methods were the only ones available to assess Hb levels and required making a decision about the timing of sampling on the basis of clinical conditions.4 A new device is now available that allows Hb concentrations to be continuously and noninvasively monitored using the Masimo Radical 7 Pulse Co-Oximeter with SpHb™ (SpHb).6 Using this continuous, noninvasive device no longer requires the clinician to determine when a patient's Hb would need to be measured. The SpHb allows immediate and ongoing changing Hb levels to be displayed. Continuous Hb monitoring may allow a more rapid detection of clinically significant blood loss, and has the potential to significantly improve perioperative transfusion practices and even perhaps reduce needless transfusions.
We propose that SpHb has sufficient accuracy to minimize the need for invasive Hb monitoring, such as with tHb or HCue. To test this hypothesis, we compared Hb levels from the SpHb with those invasively derived and analyzed them with standard laboratory Co-Oximeter (tHb) and HCue5 methods. The study was performed in patients undergoing general anesthesia and spine surgery in the prone position.
There are several variables that could influence the difference between the SpHb and tHb. We examined some of these variables including tHb itself, duration of surgery, patient weight, and age. In addition, peripheral perfusion at the site of the measurement of SpHb may influence the detection of Hb levels. To assess this variable, we correlated SpHb − tHb differences with perfusion index (PI), an indirect measure of the perfusion of the finger using plethysmography.7
Patients and Data Collection
After approval from the University of California, San Francisco, Human Research Protection Program, 20 patients, 40 to 80 years of age, were studied. All were undergoing spine surgery in the prone position under general anesthesia and had provided written informed consent preoperatively. They were between 50 and 120 kg in weight. All patients had radial artery catheters inserted as part of their routine anesthetic care.
Hb levels were continuously monitored with the Masimo Radical 7 Pulse Co-Oximeter with SpHb™ and Rainbow Adult Adhesive sensors, version Rev E (Masimo Corporation, Irvine, California) (SpHb). The sensors were covered with an optical shield (provided by Masimo) to prevent optical interference. In addition, Hb levels were determined with a blood sample analyzed by Co-Oximetry (tHb, Beckman–Coulter)6 in the University of California, San Francisco Clinical Laboratories, and HemoCue™ (HCue, HemoCue AB, 262 23, Ängelholm, Sweden)5 by anesthesia providers in the operating room. The anesthesia providers completed quality assurance training before using the HCue monitor.
All patients had 3 to 5 sets of Hb data collected. Each set is based on simultaneous recording of both an SpHb value with an arterial blood sample drawn for tHb and HCue determination. An initial set was collected before surgical incision, but after the patient was anesthetized and placed in the prone position for the surgery. After the beginning of surgery, blood samples were taken on approximately an hourly basis. The type and amount of intravascular fluids given by the anesthesia team were recorded, including crystalloids, colloids, and all blood products.
Hb analysis for the purpose of our study ended after completion of the surgical procedure. The data from the SpHb (RevE, the commercially available version of the software at the study initiation), tHb, and HCue were recorded manually. Subsequently, the SpHb data were also analyzed by RevF software (another computer program not yet commercially available).
Accuracy was assessed by comparison of SpHb with tHb values measured at the same time point. The primary outcome for analysis was the difference between these measures, defined as SpHb minus tHb (SpHb − tHb), and calculated after each measurement occasion for each patient. Initial analyses summarized the distributions of observed differences using means, medians, and ranges. Following the approach recommended by Bland and Altman,8 we summarize bias as the mean difference between measures, and the 95% limits of agreement by the interval defined by the observed bias plus/minus twice the observed SD of the observed differences. Because of possible within-individual correlation between successive measurements, standard deviations were estimated using mixed effect linear regression models for linked replicate measurements, including patient and method level effects.9 The resulting limits of agreement have a prediction interval interpretation, and are generally somewhat wider than the standard Bland–Altman limits. Alternative limits computed with standard deviations on the basis of robust variance estimates10 were comparable, indicating that results are not unduly influenced by the assumptions underlying the linear modeling approach.
These outcome measures were subdivided into 5 groups (on the basis of absolute differences between SpHb and tHb) of <0.5, 0.5 to 1.0, 1.1 to 1.5, 1.6 to 2.0, and >2.0 g/dL, and the group membership proportions summarized with 95% confidence intervals (CIs). Standard errors for confidence limits controlled for repeated outcome observations from each participant by using generalized estimating equation (GEE) methods.10 The distribution of observations into groups was compared between initial measurements taken before surgical incision and those taken after surgical incision with a multinomial logistic regression model, with the outcome based on a categorical variable defining the 5 groups, and with a binary indicator of whether each measurement was taken pre- or postsurgical incision as the predictor. This analysis also controlled for repeated outcome observations using the GEE approach.
We also used graphical techniques to help visualize the observed differences between SpHb and tHb measurement, taking the latter as the true measure of Hb level. Similar to the “error analysis grid” approach described by Clarke et al.,11 the possible values for each pair of measurements on a scatterplot were divided into zones corresponding to differing degrees of absolute percentage difference between SpHb and tHb [defined as 100 × (SpHb − tHb/tHb)].
Additional analyses were conducted to investigate the effect of several variables on the observed SpHb − tHb differences, including measured tHb level, time elapsed (in minutes) after the start of the procedure, patient body weight, and age. These analyses included scatterplot summaries of the relationship between observed differences and these variables, including smoothed lines estimated using locally weighted smoothing12 to illustrate possible trends. Linearity of observed trends was assessed by the slope of a linear regression line fitted to the observed points, with variability summarized by the associated 95% confidence interval (computed using the GEE approach).10 Significance at the 5% level was concluded if the confidence intervals excluded a slope of zero. We also investigated the possible presence of a nonlinear trend by examining the significance of a quadratic term added to the linear models just described.
The function of the SpHb sensor is dependent on adequate bloodflow to the finger as indirectly reflected by the PI. The PI is a calculated value that is displayed with the SpHb. Accordingly, we also investigated the relationship between SpHb − tHb values with the PI using the approach described above. Because obtaining SpHb values with a PI <1.4 is not recommended by the manufacturer, we repeated the above analyses for PI divided into 2 groups and compared those with values <1.4 and those ≥1.4.
One representative actual record of our continuous measurements of SpHb and intermittent measurement of tHb is shown in Figure 1. A total of 78 paired Hb samples were collected and analyzed from 20 patients. Each individual pair contained 1 value from the SpHb monitor display and 1 value from a laboratory determination of tHb. In addition, each patient had a HCue determination of Hb performed simultaneously. Our primary outcome variable was the difference between SpHb and tHb. We also considered the absolute difference as an overall measure of error in measurement by SpHb.
To display the overall pattern of results, we categorized the 78 paired absolute differences into 1 of 5 groups on the basis of the magnitude of the differences. The results from both the RevE and RevF (in parentheses) programs are displayed for each of these groups in Table 1. Results from initial measurements (obtained after induction of anesthesia and positioning but before the start of surgery) are displayed separately from those measurements during surgery. Table 1 shows that the patterns of observed absolute differences are similar in initial measurements to those taken during surgery. Overall, 48 (61%) (95% CI: 43%, 77%) SpHb values corresponded with tHb values by <1.5 g/dL. The corresponding percentage of SpHb values differing from tHb values by >2.0 g/dL was 17 (22%) (95% CI: 12%, 37%). One patient had tHb high at one point and then lower than SpHb at another point. In all other patients, the SpHb remained either higher or lower than tHb during the surgery. Except for 1 value, all of the HCue values were <1.0 g/dL different from the tHb values (Table 2).
The error analysis grid shown in Figure 2 complements the results in Table 1. Basically, 24% of the SpHb measurements were within 5% of corresponding tHb measurements, 55% deviated from tHb by between 6% and 20%, and 21% deviated from tHb by >20%.
Bias, estimated as the average of the paired differences for all measurements, was 0.26 g/dL. The corresponding 95% limits of agreement, accounting for patient-specific replicate measures, were −3.24 and 3.77. Figure 3 displays the Bland–Altman plot of the relationship between the observed differences and the mean of the 2 measures. The horizontal dashed lines correspond to the estimated bias and limits of agreement. The estimated bias indicates an overall tendency of SpHb measures to overestimate the corresponding tHb value. The limits of agreement indicate that the majority of SpHb estimates were within 3 g/dL of the corresponding tHb values. However, Figure 3 also reveals a trend towards underestimation by SpHb with increasing mean values. A test for linear trend was significant (P = 0.02), indicating dependence of bias on average tHb level. Figure 4 shows this relationship in more detail, including a nonparametric smoothed regression line to illustrate trend. Further analyses indicated that for values of SpHb of >12 g/dL, the estimated bias is −1.64 (95% agreement limits: −4.58, 1.29).
The SpHb − tHb values were not systematically related to either patient age or weight. However, the variability of the SpHb − tHb differences tended to decrease with increasing duration of surgery and anesthesia (data not shown). The overall variability and absolute differences in SpHb − tHb values also were observed to decrease with increasing PI (Fig. 5), although these effects were only apparent for values of PI >4.0. Trend testing revealed that the observed differences were significantly associated with log-transformed values of tHb (P = 0.03), confirming the nonlinearity that is evident in Figure 5. The Bland–Altman plot in Figure 3 further identifies individual measurements according to corresponding PI values of <1.4 or ≥1.4. For lower ranges of the mean measurement (on the horizontal axis), there appears to be a tendency for SpHb to overestimate tHb, especially for measurements with PI ≥1.4. Conversely, underestimation by SpHb appears to be more common for measurements with PI <1.4. The difference in the average absolute differences between SpHb and tHb in the 2 groups defined by PI values of <1.4 or ≥1.4 was not statistically significant. For PI values larger than 4.0, average absolute differences were significantly smaller than were average differences for PI values <4.0. However, relatively few measurements were made for PI values larger than 4.0.
By providing additional and continuous data, SpHb monitoring may facilitate transfusion management. To reflect the tHb clinically, how accurate does the SpHb need to be? We propose that being within ≤1.5 g/dL of the tHb value would be sufficiently accurate. Although more than half of the patients' measurements met this benchmark, some did not. Specifically, we found that 48 (61%) of the absolute differences between SpHb and tHb were ≤1.5 g/dL. However, on the other side of the spectrum, 17 (22%) of the values were >2.0 g/dL (Table 1). Figure 2 provides complementary information on absolute differences expressed as a percentage of tHb values. From the error analysis grid in Figure 2, we conclude that 79% of SpHb measurements were within 20% of corresponding tHb values, and 39% were within 10%. HCue uniformly met our definition of being sufficiently accurate.
When comparing a new measuring device, such as SpHb, with a standard technique (e.g., tHb), variability of data from tHb should be considered. Several physiologic variables such as body position, blood source (e.g., arterial vs. peripheral venous), and time may influence the accuracy of tHb.13–15 To eliminate some of these variables, we used the same sampling site (radial artery), time, and body position (prone) in all patients. The overall variability for the measurement of tHb in our Medical Center's central laboratory is consistently small (coefficient of variation: 0.8%–1.0%).13 Hospitals are required to intermittently confirm the variability of their measurement techniques.
In addition to understanding the reproducibility of the tHb, we also evaluated the accuracy of the HCue. The accuracy of the HCue has been studied previously.5 Under the conditions of our study, the HCue and tHb concentrations are virtually interchangeable (Table 2). However, measurements in our study were from arterial blood samples. Had the samples been from peripheral venous blood samples, the results may not have been so consistently similar to laboratory Co-Oximeter readings.14,15
We observed an apparent relationship between the accuracy and variability of the SpHb and the PI (Fig. 5). Accuracy increased and variability decreased with higher PI values, with this effect being most apparent for PI values exceeding 4.0. The PI is a numerical value that has been added to the pulse oximeter. Plethysmographic pulse wave monitoring and amplitude are the basis upon which the PI is calculated. For the SpHb, the waveform and amplitude are converted into a numerical value that is displayed by the SpHb and is assumed to reflect the perfusion of the finger. The manufacturer (Masimo) recommends not using the SpHb values clinically when PI <1.4. Our results indicate that both magnitude and variability of observed differences in the 2 measurements persisted at a similar level up to PI values of at least 4.0 (Fig. 3). This increased (and unpredictable) variability associated with a lower PI supports the recommendation to not use SpHb to guide clinical decisions under these circumstances, and suggests that a higher cutoff value may be required to ensure reduced error and variability of measurements.
Finally, although the data analysis used in the study was based on the currently clinically used and available software version, we also retrospectively compared our data with data using a new software version (RevF). The data from RevF are in parentheses in Table 1. The conclusions regarding the relationships described in Figures 3 to 4 are the same using either software version.
We conclude that SpHb could have frequently been used in many patients to guide clinical decisions regarding the need for blood transfusions. In some cases, the continuous measurement can also guide the timing of direct Hb measurement using either Co-Oximetry (tHb) or point-of-care (HCue) measurements. Yet our study indicates that SpHb may not be as accurate as is clinically necessary in some patients. Our data document the need for better refinement of the noninvasive technology to address some clinically important requirements. For example, we demonstrated, not surprisingly, that peripheral perfusion is an important requirement for obtaining reliable noninvasive SpHb data. When perfusion diminishes, SpHb underestimates true Hb, so it should not be used to determine the need for blood transfusions without validation using a direct measurement methodology. As perfusion improves, the SpHb becomes a more accurate measurement methodology. PI, therefore, is as useful a clinical guide as is the actual SpHb measurement. Less obvious, but still clinically critical to understand, is why at lower Hb levels, even with good perfusion, the SpHb tends to overestimate the actual Hb level. As a result, the SpHb is an important addition to clinical monitoring as long as the current limitations are understood and addressed. As the technology improves, we may gain better insights into the relationship between perfusion, acute changes in Hb, and intravascular volume on the performance of this noninvasive monitor. It could become a standard monitor to assess patients at risk for bleeding and to guide transfusion therapy.
Name: Ronald D. Miller, MD, MS.
Attestation: Ronald D. Miller has seen the original study data, reviewed the analysis of the data, approved the final manuscript, and is the author responsible for archiving the study files.
Conflict of Interest: Ronald D. Miller received honoraria from Masimo and reported a conflict of interest with Masimo. Received travel reimbursement to attend Masimo's annual Scientific (Clinical) Advisory Board Meeting in Irvine, California.
Name: Theresa A. Ward, BSN, RN.
Attestation: Theresa A. Ward has seen the original study data, reviewed the analysis of the data, and approved the final manuscript.
Conflict of Interest: This author has no conflict of interest to report.
Name: Stephen C. Shiboski, PhD.
Attestation: Stephen C. Shiboski has seen the original study data, reviewed the analysis of the data, and approved the final manuscript.
Conflict of Interest: This author has no conflict of interest to report.
Name: Neal H. Cohen, MD, MPH, MS.
Attestation: Neal H. Cohen has seen the original study data, reviewed the analysis of the data, and approved the final manuscript.
Conflict of Interest: This author has no conflict of interest to report.
The authors thank James Caldwell, MB, ChB, Professor, and Judith Hellman, Associate Professor (Department of Anesthesia and Perioperative Care, University of California, San Francisco, San Francisco, California) for their scholarly review of our manuscript. The authors also thank the Masimo Corporation and the faculty, residents, and staff of the University of California, San Francisco, Moffitt/Long Operating Rooms, who facilitated the conduct of our patient studies.
1. Spahn DR. Physiologic transfusion triggers. Anesthesiology 2006;104:905–6
2. Marshall JC. Transfusion trigger: when to transfuse? Crit Care 2004;8:S31–3
3. Miller RD. Transfusion therapy. In: Miller RD, Eriksson LI, Fleisher LA, Wiener-Kronish JP, Young WL, eds. Miller's Anesthesia. 7th ed. Philadelphia: Elsevier, 2010
4. De Silva A. Anesthetic monitoring. In: Miller RD, Pardo M, eds. Basics of Anesthesia. 6th ed. Philadelphia: Elsevier, 2010
5. Lardi AM, Hirst C, Mortimer AJ, McCollum CN. Evaluation of the HemoCue for measuring intraoperative haemoglobin concentrations: a comparison with the Coulter Max-M. Anaesthesia 1998;53:349–52
7. Cannesson M, Desebbe O, Rosamel P, Delannoy B, Robin J, Bastien O, Lehot JJ. Pleth variability index to monitor the respiratory variations in the pulse oximeter plethysmographic waveform amplitude and predict fluid responsiveness in the operating theatre. Br J Anaesth 2008;101:200–6
8. Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1986;1:307–10
9. Carstensen B, Simpson J, Gurrin LC. Statistical models for assessing agreement in method comparison studies with replicate measurements. Int J Biostat 2008;4:Article 16
10. Liang KY, Zeger SL. Longitudinal data analysis using generalized linear models. Biometrika 1986;73:13–22
11. Clarke W, Cox D, Gonder-Frederick LA, Carter W, Pohl SL. Evaluating clinical accuracy of systems for self-monitoring of blood glucose. Diabetes Care 1987;10:622–8
12. Cleveland WS, Devlin SJ. Locally weighted regression: an approach to regression analysis by local fitting. J Am Stat Assoc 1988;83:596–610
13. Gehring H, Duembgen L, Peterlein M, Hagelberg S, Dibbelt L. Hemoximetry as the gold standard: error assessment based on differences among identical blood gas analyzer devices of five manufacturers. Anesth Analg 2007;105:S24–30
14. Yang ZW, Yang SH, Chen L, Zhu J, Tang Z. Comparison of blood counts in venous, fingertip, and arterial blood and their measurement variation. Clin Lab Haem 2001;23:155–9
© 2011 International Anesthesia Research Society
15. Evron S, Tress V, Ezri T, Szmuk P, Landau O, Hendel D, Schechter P, Medalion B. The importance of blood sampling site for determination of hemoglobin and biochemistry values in major abdominal and orthopedic surgery. J Clin Anesth 2007;19:92–6