Anesthesiology

Home Current Issue Previous Issues Published Ahead-of-Print Collections CME Journal Info
Skip Navigation LinksHome > April 2002 - Volume 96 - Issue 4 > Performance of the ARX-derived Auditory Evoked Potential Ind...
Anesthesiology:
April 2002 - Volume 96 - Issue 4 - pp 803-816
Clinical Investigations

Performance of the ARX-derived Auditory Evoked Potential Index as an Indicator of Anesthetic Depth: A Comparison with Bispectral Index and Hemodynamic Measures during Propofol Administration

Struys, Michel M. R. F. M.D., Ph.D.; Jensen, Erik Weber Ph.D.; Smith, Warren Ph.D.; Smith, N. Ty M.D.; Rampil, Ira M.S., M.D.; Dumortier, Frank J. E. M.D.; Mestach, Christel M.D.; Mortier, Eric P. M.D., D.Sc.

Free Access
Supplemental Author Material
Article Outline
Collapse Box

Author Information

*Staff Anesthesiologist and Coordinator of Clinical Research, **Staff Anesthesiologist, ††Professor and Chair, Department of Anesthesia, #Consultant Gynecologist, Department of Gynecology, Ghent University Hospital. †Research Fellow, Center of Research in Biomedical Engineering, Polytechnic University of Barcelona, Barcelona, Spain. ‡Professor, Biomedical Engineering Program, California State University, Sacramento, California. §Professor Emeritus, Department of Anesthesia, University of California, San Diego, California. ∥Professor, Department of Anesthesiology, State University of New York at Stony Brook, Stony Brook, New York.

Received from the Department of Anesthesia, University Hospital of Gent, Gent, Belgium.

This article is accompanied by an Editorial View. Please see: Kalkman CJ, Drummond GB: Monitors of depth of anesthesia, quo vadis? Anesthesiology 2002; 96:784-7.

Additional material to this article can be found on the Anesthesiology Web site. Go to the following address, click on the Enhancements Index, and then scroll down to find the appropriate article and link. http://www.anesthesiology.org

Submitted for publication March 20, 2001.

Accepted for publication October 25, 2001.

Supported in part by a nonrestricting grant from Alaris Medical Systems International, Basingstoke, United Kingdom.

Dr. Jensen is the inventor and patent holder of the A-Line algorithms and is a paid consultant to Danmeter A/S, Odense, Denmark, the manufacturer of the A-Line monitor. Dr. Rampil has served as a paid consultant to, and has received research funding from, Aspect Medical Systems, Inc., Newton, Massachusetts.

Address reprint requests to Dr. Struys: Department of Anesthesia, Ghent University Hospital, De Pintelaan 185, B-9000, Gent, Belgium. Address electronic mail to: Michel.Struys@rug.ac.be. Individual article reprints may be purchased through the Journal Web site, www.anesthesiology.org.

Collapse Box

Abstract

Background: Autoregressive modeling with exogenous input of middle-latency auditory evoked potential (A-Line autoregressive index [AAI]) has been proposed for monitoring anesthetic depth. The aim of the current study was to compare the accuracy of this new index with the Bispectral Index (BIS), predicted effect-site concentration of propofol, and hemodynamic measures.

Cited Here...: Twenty female patients scheduled for ambulatory gynecologic surgery received effect compartment controlled infusion of propofol. Target effect-site concentration was started at 1.5 μg/ml and increased every 4 min by 0.5 μg/ml. At every step, sedation level was compared with monitoring values using different clinical scoring systems and reaction to noxious stimulus.

Cited Here...: Bispectral Index, AAI, and predicted propofol effect-site concentration were accurate indicators for the level of sedation and loss of consciousness. Hemodynamic variables were poor indicators of the hypnotic-anesthetic status of the patient. BIS correlated best with propofol effect-site concentration, followed by AAI. Hemodynamic measurements did not correlate well. No indicators predicted reaction to noxious stimulus. Poststimulus, BIS and AAI showed an increase as a result of arousal. This reaction occurred more rapidly with the AAI than with BIS.

Conclusion: Bispectral Index, AAI, and predicted propofol effect-site concentration revealed information on the level of sedation and loss of consciousness but did not predict response to noxious stimulus.

Back to Top | Article Outline

ArticlePlus

Click on the links below to access all the ArticlePlus for this article.

Please note that ArticlePlus files may launch a viewer application outside of your web browser.

* http://links.lww.com/ALN/A129

* http://links.lww.com/ALN/A130

* http://links.lww.com/ALN/A131

BOTH electroencephalography and middle-latency auditory evoked potentials (MLAEP) have been proposed as monitors of the hypnotic state during anesthesia. 1 The waveforms of both raw measures require real-time quantification to become useful in clinical anesthesia practice. For electroencephalography, the Bispectral Index (BIS) incorporated in the A2000 BIS® monitor (Aspect Medical Systems Inc., Newton, MA) has been proven to have a high sensitivity and specificity compared with other processed electroencephalograpic variables. 2,3 For MLAEP, Mantzaridis and Kenny 4 extracted a single numerical variable, called the auditory evoked potential (AEP) index, applying a proprietary algorithm that uses a moving time average to extract the AEP waveform followed by the calculation of the sum, over the waveform, of the square root of the absolute difference between every two successive segments of that AEP waveform. As described, this classic moving time average method requires 256 sweeps, each of 144-ms duration, creating a response delay time of 36.9 s. This large number of sweeps is required to obtain an acceptable signal-to-noise ratio for the AEP, and this method is therefore poorly suited to recording changeable AEPs, which is the case during anesthesia. Throughout the last two decades, a number of methods have been applied to facilitate a single-sweep or a few-sweep extraction of the AEP. 5-7 Recently, Jensen et al.8 developed a new method for extracting the MLAEP from the electroencephalographic signal using an autoregressive model with an exogenous input (ARX) adaptive method (more details are provided later in the article). This method allows extraction of the AEP signal within 15-25 sweeps of 110-ms duration, resulting in only a 6-s response delay time. A new variable, called the A-Line ARX Index (AAI), is then calculated from this fast-extracted MLAEP wave. This new technology was incorporated in a recently commercialized system called A-Line® (A-Line Monitor; Danmeter A/S, Odense, Denmark).

This ARX-extracted AEP index may be as accurate as and is significantly faster than the 256-sweep moving time average method in detecting arousal reaction after tracheal intubation. 9 Other methods for processed electroencephalography and MLAEP have been recently proposed, 3,10-12 although only the tested indices, BIS and AAI, have become commercially available.

The purpose of the current study was to test the performance and reliability of BIS, AAI, predicted propofol effect-site concentration, and classic hemodynamic variables as indicators of the level of consciousness (defined by the responsiveness scores of the modified Observer's Assessment of Alertness/Sedation scale [OAA/S]13 and loss of eyelash reflex). In addition, we tested the ability of the proposed indicators to predict movement as a reaction to noxious stimulus. In an interference analysis, the possible alteration of the BIS value caused by the auditory input (clicks) from the A-Line® monitor was evaluated.

Back to Top | Article Outline

Methods and Materials

After obtaining approval from the Institutional Ethics Committee (Ghent University Hospital, Gent, Belgium), informed consent was obtained from 20 female patients (American Society of Anesthesiologists physical status I, aged 18-60 yr) scheduled for ambulatory gynecologic surgery. Exclusion criteria included weight less than 70% or more than 130% of ideal body weight, neurologic disorder, and recent use of psychoactive medication, including alcohol.

Propofol was administered via a computer-assisted continuous-infusion device to a target effect-site concentration (RUGLOOP Cited Here...) using a three-compartment model enlarged with an effect-site compartment, previously published by Schnider et al.14,15 The target effect-site concentration of propofol (Ce propofol) was computed to yield a time-to-peak effect 16 of 1.6 min after bolus injection, as also published by Schnider et al.14,15 and clinically confirmed by Struys et al.17 Propofol infusion was administered using a Fresenius Modular DPS Infusion Pump connected to a Fresenius Base A (Fresenius Vial Infusion Systems, Brézins, France). The computer ran RUGLOOP monitors and drove the pump at infusion rates between 0 and 1,200 ml/h via an RS-232 interface. Using this infusion technique, we were able to obtain a steady state condition for propofol at every target concentration after 4-min infusion. The initial propofol target effect-site concentration was set at 1.5 μg/ml and was increased every 4 min by 0.5 μg/ml until loss of all relevant clinical signs was observed (explanation to come). Propofol was infused via a large left forearm vein. Every patient received approximately 200 ml of crystalloid fluid during the study period. No fluid load was given before induction. No patient received preanesthetic medication. No other drugs were given. All patients maintained spontaneous ventilation via a face mask delivering 100% oxygen.

Heart rate and noninvasive blood pressure, oxygen saturation, and capnography were recorded at 1-min intervals using an AS3® monitor (Datex, Helsinki, Finland). BIS® (version 3.4) was derived from the frontal electroencephalography (At-Fpzt) and calculated by the A-2000 BIS® monitor using 3 BIS®-Sensor electrodes (Aspect Medical Systems, Inc.). The smoothening time of the BIS® monitor was set at 30 s. The AAI from the MLAEP was calculated using the A-Line® monitor. The MLAEP were elicited with a bilateral click stimulus of 70-dB intensity and 2-ms duration. Three electrodes (A-Line® AEP electrodes; Danmeter A/S) were positioned at mid-forehead (+), left forehead (reference) and left mastoid (-). The extraction of the MLAEP using a short moving time average together with an ARX model and the calculations of the AAI are described in Appendix 1, which can be found on the Anesthesiology Web site. Figure 1 shows a flow chart of the signal processing.

Fig. 1
Fig. 1
Image Tools

Before each increase in target concentration (after 4-min infusion at the specific target effect-site concentration), measures of BIS, AAI, hemodynamic variables, level of consciousness (using the modified OAA/S score shown in table 1 and the response to eyelash reflex), and reaction to noxious stimulus were recorded (more details are provided later in the article). The sequence of testing was always the same: first the electronic indicators, then the eyelash reflex test, followed by the OAA/S score. The response to noxious stimulus was recorded last.

Table 1
Table 1
Image Tools

The responsiveness component of the OAA/S scale (table 1) is an assessment procedure involving a presentation of progressively more intense stimulation, ranging from a moderate speaking voice to physical shaking or moderate noxious stimulus (trapezius squeeze) until response is observed. Patients were considered to have loss of consciousness at the transition between level 3 and level 2.

For measuring the reaction to noxious stimulus, a tetanic electrical stimulus (100 Hz, 50 mA) for 2 s was applied to the volar forearm level. To examine the possible change in BIS and AAI as a reaction to the stimulation sequence at each propofol concentration, we recorded latency and peak value of change in BIS and AAI until 1 min after stimulus.

Both BIS and AAI indices were also logged automatically. RUGLOOP digitally recorded the BIS each 10 s, and the A-Line® monitor recorded AAI index values nominally each 8 s. The time marks of both systems were synchronized with the manual timing for stimulus and manually recorded events to within ± 1 s.

Back to Top | Article Outline
Statistical Analysis

Significance level was set at 5% unless otherwise reported. Because some of the data violated the normality rules (tested with a chi-square test), we used nonparametric statistics. Spearman rank-order correlation analysis was performed to evaluate the relation between each measure and the propofol effect-site concentration. To evaluate the significance between the obtained Spearman rank correlation coefficients, a specific comparison test, described by Steiger, 18 was used.

To analyze the significant changes in each indicator (BIS, AAI, Ce propofol, heart rate, blood pressure) at different levels of the OAA/S score, a Friedman analysis was used. When P was < 0.05, a Wilcoxon signed rank test was used to distinguish significance between specific levels. To determine significant changes in each measurement during loss of eyelash reflex and loss of response to noxious stimulus, a Wilcoxon signed rank test was used.

The ability of the different indicators to describe depth of sedation, loss of consciousness, and response to noxious stimulus was evaluated using prediction probability (PK), which compares the performance of indicators having different units of measurements, as developed by Smith et al.19,20 Consider a predicting indicator such as BIS or AAI and a gold-standard measure of anesthetic depth such as the multilevel OAA/S score or the two-level responsiveness (yes-no) to eyelash reflex or noxious stimulus. Then, a PK of 1 for the BIS or AAI indicator would mean that BIS or AAI always increases (decreases) as the patient gets lighter (deeper) according to the gold-standard depth measure. Such an indicator can perfectly predict anesthetic depth. Alternatively, a PK value of 0.5 would mean that the indicator is useless for predicting anesthetic depth. A PK value of -1 also means a perfect indicator, once the direction of the scale is reversed. For the OAA/S score, a PK value was computed for all assessments combined. Similarly, PK values for all eyelash reflex responses and response to noxious stimulus assessments were determined. The jackknife method was used to compute the SE of the estimate, based on the assumption that all assessments were independent. A paired-data jackknife analysis 19,20 was used to evaluate whether the PK for one variable was different from another one. Bonferroni correction was used to the paired-data jackknife analysis to correct for multiple comparisons. Significance level was set at 0.01. Prediction probability was calculated using a custom spreadsheet macro, PKMACRO, developed by one of the authors (W. S.). The power on the PK values was calculated using a t statistic defined as the quotient between the difference considered of clinical importance and the SE of the difference between two indicators. Assuming a PK difference of 0.05 as being of clinical importance, then 20 patients should be included to find significant differences with a P < 0.01. The SE assumption was based on previous results of the AAI and other AEP indicators. 10

After the PK analysis, three measures were found to merit further analysis: BIS, AAI, and Ce propofol. For these variables, median effective dose (ED50) and ED95 were evaluated using a Probit procedure for the levels of the OAA/S score until loss of consciousness, for loss of eyelash reflex, and for loss of response to noxious stimulus. Goodness-of-fit tests for the Probit analyses are based on the Pearson chi-square test. Large P values for these tests indicate that the fitted model agrees well with the data. P < 0.05 indicates that the fitted model does not agree well with the data.

We further investigated the performance of the BIS, AAI, and Ce propofol indexes for three binary measures of anesthetic depth: conscious-unconscious as defined by the OAA/S score, presence-absence of eyelash reflex, and response-no response to noxious stimulus. For each of the three indexes and the three binary measures of depth, we computed values of normalized cumulative occurrence, values of sensitivity and specificity, and positive and negative predictive values versus index cutoff (threshold) value. For these calculations, we used positive to denote a test result that suggested consciousness or responsiveness and negative to denote a test result that suggested unconsciousness or nonresponsiveness. We assumed that increases in the BIS and AAI and a decrease in Ce propofol corresponded to an increased likelihood of consciousness or responsiveness. We computed the normalized cumulative occurrence of consciousness-responsiveness as the percentage of such occurrences with index values below the cutoff value for BIS and AAI and above the cutoff value for Ce propofol. Similarly, we computed the normalized cumulative occurrence of unconsciousness-nonresponsiveness as the percentage of such occurrences with index values above the cutoff value for BIS and AAI and below the cutoff value for Ce propofol. We computed sensitivity as the proportion of conscious-responsive patients with positive test results (index value higher than cutoff value for BIS and AAI and lower than cutoff value for Ce propofol). Similarly, we computed specificity as the proportion of unconscious-nonresponsive patients with negative test results (index value lower than cutoff value for BIS and AAI and higher than cutoff value for Ce propofol). We computed positive predictive value as the proportion of patients with positive test results that were correctly diagnosed as conscious or responsive. Similarly, we computed negative predictive value as the proportion of patients with negative test results that were correctly diagnosed as unconscious-nonresponsive.

Back to Top | Article Outline
Interference Analysis

We became concerned during the analysis of this study that the auditory input (clicks) from the A-Line® monitor might significantly alter BIS values because of the presence of the small evoked response in the electroencephalography. Therefore, an interference analysis study was performed. Fifteen female patients with the same inclusion criteria as the main study were included to receive three different concentrations of propofol (1.5-3-4.5 μg/ml) using an effect compartment controlled administration identical to the main study. Randomly in nine patients, both monitors were connected to the patient for 6 min, described as the on phase, whereafter the A-Line® clicks were disconnected for 2 min, described as the off phase. In six patients, the off period was maintained during the first 6 min, followed by a 2-min on period. In all patients, the sequence was repeated three times at the three different propofol target concentrations. The averaged BIS values (obtained using the area under the curve technique) between minutes 5 and 6 after the start of propofol administration were compared with the averaged BIS values between minutes 7 and 8, using a Wilcoxon signed rank test for two related samples.

Back to Top | Article Outline

Results

The demographics (mean ± SD) of the 20 female patients in the main study are as follows: age, 32 ± 5 yr; weight, 63 ± 6 kg; and height, 167 ± 10 cm.

Figure 2 shows the behavior of BIS, AAI, heart rate, and blood pressure at increasing propofol effect-site concentrations. A significant decrease in BIS and AAI was found with increasing propofol concentration. For heart rate, systolic blood pressure, and diastolic blood pressure, less significant changes were found. Considerably less scatter was observed in the BIS results than in the other variables. The Spearman rank-order correlation between the different variables and Ce propofol is shown in table 2. The best correlation was obtained for BIS, followed by AAI. For all hemodynamic variables, we observed a poor correlation with Ce propofol.

Fig. 2
Fig. 2
Image Tools
Table 2
Table 2
Image Tools

With increasing sedation (decrease in OAA/S score from level 5 to level 0), the median BIS decreased from 95 to 48, median AAI decreased from 70 to 19, and Ce propofol increased from 1.5 to 4 μg/ml (median), as shown in Figures 3A-C, respectively. In contrast (figs. 3D-F), only small, if any, changes were observed in heart rate (from 71 beats/min [median] at OAA/S level 5 to 69 beats/min at OAA/S level 0), systolic blood pressure (from 120 to 106 mmHg), and diastolic blood pressure (from 74 to 58 mmHg). For the mean arterial pressure, similar small changes were found (from 88 to 74 mmHg). The AAI (fig. 3B) reached its minimum early compared with the BIS (fig. 3A).

Fig. 3
Fig. 3
Image Tools

At the moment of loss of eyelash reflex (fig. 4), significant changes in median BIS (from 72 to 64), AAI (from 43 to 22), and Ce propofol (from 2.5 to 3 μg/ml) were found when comparing the values taken at the level just before loss of consciousness and just after loss of consciousness. No hemodynamic variables showed differences at loss of eyelash reflex. No indicators showed significant changes at the moment of loss of response to noxious stimulus (figure 5) when comparing the values taken at the last level before loss of response with the first level after loss of response. The ability of the indicators to predict the OAA/S score, loss of eyelash reflex, and loss of response to noxious stimulus as presented by the PK values is shown in table 3. In all tests, a similar performance was found for BIS, AAI, and Ce propofol. A much lower performance was observed for the hemodynamic indicators. The SE for the PKs of the OAA/S for BIS and AAI were 0.015 and 0.013, respectively. By calculating the t statistic, we found that this study including 20 patients had the power to determine significant differences between indicators of OAA/S score larger than 0.058, which is in accordance with our initial assumption that only difference larger than 0.05 would be considered significantly different.

Fig. 4
Fig. 4
Image Tools
Fig. 5
Fig. 5
Image Tools
Table 3
Table 3
Image Tools

Because the previous analysis revealed the best performance for BIS, AAI, and Ce propofol, further examination was warranted. By applying Probit analyses, the effective concentration or index at which 50% (ED50) and 95% (ED95) of the patients lost response to the OAA/S levels 5, 4, and 3 or eyelash reflex, were calculated (table 4). The complete probability curves for these observations are shown in figures 6A-C for Ce propofol, BIS, and AAI, respectively. For loss of response to noxious stimulus, the ED50 and ED95 are also shown in table 4, and the probability curves are plotted in figure 6 for Ce propofol, BIS, and AAI, respectively.

Table 4
Table 4
Image Tools
Fig. 6
Fig. 6
Image Tools

The normalized cumulative occurrence curves for these data are shown in figures 7A-C for BIS, figures 7D-F for AAI, and figures 8A-C for Ce propofol. The data in figures 7 and 8 are presented for the OAA/S levels (conscious vs. unconscious), (loss of) eyelash reflex, and (loss of) response to noxious stimulus. In all figures, no variable provided perfect sensitivity-specificity. Therefore, more in-depth sensitivity-specificity calculations were performed.

Fig. 7
Fig. 7
Image Tools
Fig. 8
Fig. 8
Image Tools

Tables 5-7 show the specific sensitivity and specificity valuesof different cutoff BIS, AAI, and Ce propofol levels toobserve loss of consciousness as described by OAA/S, loss of eyelash reflex, and loss of response to noxious stimulus. To be 100% certain of unconsciousness, a BIS value of just less than 55, an AAI of just less than 20, or a Ce propofol value just greater than 3.5 μg/ml was required. All patients were found to be conscious at a BIS value greater than 75, at an AAI value greater than 66, and at a Ce propofol value less than 2 μg/ml. For all indicators, some overlap between the curves was found.

Table 5
Table 5
Image Tools
Table 6
Table 6
Image Tools
Table 7
Table 7
Image Tools

After stimulus, the maximum mean increases in BIS and AAI until 1 min after stimulus were 8.2 (SD, 5.0) and 15.4 (SD, 11.1), respectively. The mean reaction times until maximum value were 39 s (SD, 12 s) and 20 s (SD, 15 s) (P < 0.05) for BIS and AAI, respectively. To illustrate this behavior, the time synchronized averages of the digitally recorded values are shown in figure 9.

Fig. 9
Fig. 9
Image Tools
Back to Top | Article Outline
Interference Analysis

The results for the on-off study at three different propofol steady state concentrations are shown in figure 10. No significant differences in BIS values between the on and off periods were found.

Fig. 10
Fig. 10
Image Tools
Back to Top | Article Outline

Discussion

The current study demonstrates that a stepwise increase in propofol effect-site concentration (Ce propofol) resulted in a monotonic decrease in BIS and AAI, which correlated well with the level of sedation and loss of consciousness as observed by the OAA/S score and loss of eyelash reflex. In contrast, the changes in hemodynamic measures in our study did not correlate well with changes in Ce propofol or in level of sedation of loss of consciousness. We selected the OAA/S score because it provides a good correlation with sedation and has been tested prospectively. 21 In addition, loss of eyelash reflex was used because it is a simple binary variable and is commonly applied by anesthesiologists in clinical practice to detect loss of consciousness.

Although both BIS and AAI indicators seemed to be clinically accurate, the Spearman correlation between BIS and Ce propofol was significantly better than the correlation between AAI and Ce propofol (table 2 and figure 2). This means that a better degree of monotonic relation was found between BIS and Ce propofol compared with AAI and Ce propofol. Recently, Iselin-Chaves et al.11 concluded that the Pearson correlation (measuring the degree of linear monotonic relation) between BIS and a measured steady state concentration of propofol (r = -0.8) was significantly better than the correlation between MLAEP latency variables, Pa and Nb latency, and propofol (rPa = 0.68 and rNb = 0.63). Bonhomme et al.12 found correlation coefficients similar to ours when comparing BIS with another AEP technique called steady state response. The differences in abilities of BIS and AAI to correlate with a range of propofol effect-site concentrations has to do with the fundamental difference in the signals that are being processed. Although the AAI is a linear mapping of the MLAEP peak amplitudes and latencies, it does not give a linear correlation to the Ce propofol, in contrast with BIS, which was developed using correlation between electroencephalography and drug concentrations. One might argue the appropriateness of attempting to develop an anesthetic depth indicator (e.g., cerebrally derived) by establishing a linear relation to anesthetic effect-site concentration. It is known that individuals vary in sensitivity to anesthetics and that anesthetic concentration is not a perfect predictor of an individual's anesthetic depth, especially if the interpretation of concentration value to predict depth is for a population of patients rather than one individual. 22 Therefore, an anesthetic depth indicator that is developed by crafting it to track concentration is inherently limited. A better strategy for developing an anesthetic depth indicator is to craft the indicator to track the patient's clinically measured anesthetic depth; therefore, we also studied the behavior of the different indicators in that way.

Bispectral Index, AAI, and Ce propofol changed significantly during the transition from a conscious to an unconscious state, as shown in figure 3 for the transition from OAA/S level 3 to level 2 and as shown in figure 4 for loss of eyelash reflex. This is in contrast to previous work from Gajraj et al.23,24 using a mathematically derived single numerical variable from the MLAEP, called the AEP index. During repeated transitions from awake to asleep and nonsteady conditions, they concluded that the AEP index was better able to detect the transition from unconsciousness to consciousness than was BIS (using an A-1000 monitor and software version 3.0). 4 For the hemodynamic data, no changes were observed at loss of consciousness. Once again, this suggests that hemodynamic data are not useful indicators for describing depth of sedation or loss of consciousness, as already stated by other investigators. 25

The correlations between the different indicators and the sedation score are important to observe in assessing their performance accuracy. As shown in figure 3, ordinal values obtained using a responsiveness rating scale such as the OAA/S score may not allow a perfect linear relation between the observed clinical state of the patient and the measured value of the indicator. To account for this, the prediction probability, PK, provides a better alternative to investigate the overall relative performance of the different indicators in describing a sedation level or loss of consciousness. 19,20,26 Table 3 shows that BIS, AAI, and Ce propofol comparably, and reasonably accurately, predicted the level of sedation or loss of consciousness as observed by the OAA/S score or the loss of eyelash reflex. The performance of the hemodynamic data was significantly worse in predicting the sedation level or loss of consciousness. These performance results indicate that both BIS and AAI are reliable indicators for assessing depth of sedation and loss of consciousness. At the level of significance used in our study, the cerebrally derived indicators, BIS and AAI, were found to be comparable in performance to estimated steady state propofol concentration, Ce propofol. Our findings agree with those previously found for propofol, 27 as well as the previously published observations between utility of BIS and measured sevoflurane or isoflurane end-tidal concentration. 21,26 This highly predictive accuracy of drug effect-site concentrations has only been established during steady state conditions and single-drug settings, as in this study. Additional research should be performed to study the performance of these indicators during multiple drug administration, as well as during non-steady state conditions.

Because BIS, AAI, and Ce propofol were the most accurate indicators that we studied, we examined these in greater depth. As shown in figure 6A and in table 4, higher propofol effect-site concentrations were required to cause loss of response at decreasing OAA/S levels until loss of consciousness. This was correlated with a decrease in BIS (fig. 6B) and AAI values (fig. 6C). The results for Ce propofol and BIS found in this study agree with those previously found by other investigators who used the same scoring systems. 21,26,28,29

The study was also aimed at observing the sensitivity-specificity characteristics for BIS, AAI, and Ce propofol in more detail. Recently, Drummond 30 expressed the opinion that a depth of anesthesia indicator should have, at a minimum, a 100% sensitivity (no false-negative results) if what the clinicians seek is a specific numeric threshold (cutoff value) that can be interpreted to mean not aware. Ideally, there should be a 100% sensitivity and specificity. Unfortunately, to the best of our knowledge there exists no system or monitor in the real world reaching this level.

In our study (figure 7), because the cumulative occurrence data derived from our population showed some overlap between conscious and not conscious, none of the three best indicators was found to be ideal. However, such monitors might still help provide in the decision support during anesthesia. The cutoff values with 100% sensitivity and their corresponding specificity found in this study are shown in tables 5-7.

The study also tested the performance of the indicators to predict movement as a reaction to noxious stimulus. The supramaximal tetanic stimulus used in this study was previously used by other investigators as a substitute for conventional forms of stimulation in humans. 27 As shown in figure 5, no indicator changed significantly when loss of response to noxious stimulus occurred. Other investigators have already observed that measures from the cerebral cortex such as electroencephalography and AEP are poor predictors of response to noxious stimulus. 31 Likewise, the hemodynamic values recorded in this study were also nonpredictive regarding loss of response to noxious stimulus. Because of the specific design of our protocol, we only observed static hemodynamic values recorded just before the stimulus and not changes in the hemodynamics after each noxious stimulus. Changes in hemodynamics caused by noxious stimulus might indicate stress response or arousal more accurately. Table 3 shows that the PK values, which indicate the ability of the variables to predict loss of response to the noxious stimulus, were not significantly better for one indicator over another because of the large SEM values. During propofol-alfentanil anesthesia, Doi et al.32 found a mean PK value of 0.54 (SE, 0.10) for BIS to predict movement at the insertion of a laryngeal mask. In contrast to our results, they found a significantly better prediction probability (PK = 0.87; SE = 0.073) for the AEP-derived variable, AEP index, to predict movement at laryngeal mask insertion. They concluded that the ability of the AEP to discriminate between movers and nonmovers in response to a noxious stimulus is caused by the fact that AEP reflects not only cortical but also subcortical brain activities. In contrast, our results describe no better performance of the AAI than BIS in predicting surgical immobility. No accurate threshold values could be defined for any indicator with acceptable specificity-sensitivity values (tables 5-7). With respect to movement in response to a noxious stimulus, Thornton and Sharpe 33 suggested that various end points such as loss of consciousness and loss of response to a noxious stimulus do not appear to be a part of a single continuum and can occur independently of one other. We suggest that the poor performance of the rostral central nervous system indicators tested here might support the hypothesis that movement response to a noxious stimulus occurs as a spinal reflex. 34 Only when the information can reach the cerebral cortex via afferent central nervous system pathways, changes might be observed in the cerebrally derived indicators (= arousal reaction). 35 This arousal reflex was clearly manifested by both indicators, BIS and AAI, as illustrated in figure 9. The reaction time for detecting arousal was significantly shorter with the AAI than BIS because of the shorter signal acquisition and processing time found with the A-Line® monitor compared with the BIS® monitor, as previously observed by other investigators. 9

A limitation of this study is the possible intraobserver bias because of the fact that the observer was not completely blinded to the indicator values when scoring the clinical measures. In addition, PK statistics assumed independent data. For the OAA/S score, the assessments were all collinear with depth. In the absence of a comparable statistical test to analyze these data, we have accepted, as have other investigators, 26 the potential bias introduced into our results.

For the interference analysis, the results for the on-off study at three different propofol steady state concentrations are shown in figure 10. No significant differences in BIS values between the on and off periods were found.

In conclusion, during propofol anesthesia with steady state conditions, we found that BIS, AAI, and Ce propofol were accurate indicators for the level of sedation and loss of consciousness. Hemodynamic variables were poor indicators of the hypnotic-anesthetic status of the patient. BIS correlated best with propofol effect-site concentration, followed by the AAI. Hemodynamic measurements did not correlate well. No indicators revealed any information concerning reaction to noxious stimulus. After stimulus, BIS and AAI showed an increase as a result of arousal. This reaction occurred more rapidly with the AAI than with BIS.

The authors thank Bob Butterfield, B.Sc. (Research Fellow, Alaris Medical Systems, Inc., San Diego, California) for help during the preparation of this manuscript.

Back to Top | Article Outline

FOOTNOTES

‡‡RUGLOOP, written by T. De Smet and M. Struys. More information is available at http://allserv.rug.ac.be/∼mstruys. Cited Here...

Back to Top | Article Outline

References

1. Heier T, Steen PA: Assessment of anaesthesia depth. Acta Anaesthesiol Scand 1996; 40: 1087-100

2. Sleigh JW, Donovan J: Comparison of bispectral index, 95% spectral edge frequency and approximate entropy of the EEG, with changes in heart rate variability during induction of general anaesthesia. Br J Anaesth 1999; 82: 666-71

3. Bruhn J, Ropcke H, Hoeft A: Approximate entropy as an electroencephalographic measure of anesthetic drug effect during desflurane anesthesia. A nesthesiology 2000; 92: 715-26

4. Mantzaridis H, Kenny GN: Auditory evoked potential index: A quantitative measure of changes in auditory evoked potentials during general anaesthesia. Anaesthesia 1997; 52: 1030-6

5. Bartnik EA, Blinowska KJ, Durka PJ: Single evoked potential reconstruction by means of wavelet transform. Biol Cybern 1992; 67: 175-81

6. Eysholdt U, Schreiner C: Maximum length sequences: A fast method for measuring brain-stem-evoked responses. Audiology 1982; 21: 242-50

7. Haig AR, Gordon E, Rogers G, Anderson J: Classification of single-trial ERP sub-types: Application of globally optimal vector quantization using simulated annealing. Electroencephalogr Clin Neurophysiol 1995; 94: 288-97

8. Jensen EW, Nygaard M, Henneberg SW: On-line analysis of middle latency auditory evoked potentials (MLAEP) for monitoring depth of anaesthesia in laboratory rats. Med Eng Phys 1998; 20: 722-8

9. Urhonen E, Jensen EW, Lund J: Changes in rapidly extracted auditory evoked potentials during tracheal intubation. Acta Anaesthesiol Scand 2000; 44: 743-8

10. Dutton RC, Smith WD, Rampil IJ, Chortkoff BS, Eger EI 2nd: Forty-hertz midlatency auditory evoked potential activity predicts wakeful response during desflurane and propofol anesthesia in volunteers. A nesthesiology 1999; 91: 1209-20

11. Iselin-Chaves IA, El Moalem HE, Gan TJ, Ginsberg B, Glass PS: Changes in the auditory evoked potentials and the bispectral index following propofol or propofol and alfentanil. A nesthesiology 2000; 92: 1300-10

12. Bonhomme V, Plourde G, Meuret P, Fiset P, Backman SB: Auditory steady-state response and bispectral index for assessing level of consciousness during propofol sedation and hypnosis. Anesth Analg 2000; 91: 1398-403

13. Chernik DA, Gillings D, Laine H, Hendler J, Silver JM, Davidson AB, Schwam EM, Siegel JL: Validity and reliability of the Observer's Assessment of Alertness/Sedation Scale: Study with intravenous midazolam. J Clin Psychopharmacol 1990; 10: 244-51

14. Schnider TW, Minto CF, Gambus PL, Andresen C, Goodale DB, Shafer SL, Youngs EJ: The influence of method of administration and covariates on the pharmacokinetics of propofol in adult volunteers. A nesthesiology 1998; 88: 1170-82

15. Schnider TW, Minto CF, Shafer SL, Gambus PL, Andresen C, Goodale DB, Youngs EJ: The influence of age on propofol pharmacodynamics. A nesthesiology 1999; 90: 1502-16

16. Shafer SL, Gregg KM: Algorithms to rapidly achieve and maintain stable drug concentrations at the site of drug effect with a computer-controlled infusion pump. J Pharmacokinet Biopharm 1992; 20: 147-69

17. Struys MM, De Smet T, Depoorter B, Versichelen LF, Mortier EP, Dumortier FJ, Shafer SL, Rolly G: Comparison of plasma compartment versus two methods for effect compartment-controlled target-controlled infusion for propofol. A nesthesiology 2000; 92: 399-406

18. Steiger J: Tests for comparing elements of a correlation matrix. Psych Bull 1980; 87: 245-51

19. Smith WD, Dutton RC, Smith NT: A measure of association for assessing prediction accuracy that is a generalization of non-parametric ROC area. Stat Med 1996; 15: 1199-215

20. Smith WD, Dutton RC, Smith NT: Measuring the performance of anesthetic depth indicators. A nesthesiology 1996; 84: 38-51

21. Glass PS, Bloom M, Kearse L, Rosow C, Sebel P, Manberg P: Bispectral analysis measures sedation and memory effects of propofol, midazolam, isoflurane, and alfentanil in healthy volunteers. A nesthesiology 1997; 86: 836-47

22. Danhof M: Does variability explain (all) variability in drug effects? Topics in Pharmaceutical Science. Edited by Breimer DD, Crommelin DJA, Midha KK. Noordwijk, Amsterdam Med. Press BV, 1989, pp 573-86

23. Gajraj RJ, Doi M, Mantzaridis H, Kenny GN: Analysis of the EEG bispectrum, auditory evoked potentials and the EEG power spectrum during repeated transitions from consciousness to unconsciousness. Br J Anaesth 1998; 80: 46-52

24. Gajraj RJ, Doi M, Mantzaridis H, Kenny GN: Comparison of bispectral EEG analysis and auditory evoked potentials for monitoring depth of anaesthesia during propofol anaesthesia. Br J Anaesth 1999; 82: 672-8

25. Shafer S, Hu C: Managing PK Variability in Anesthesia: Integrating the EEG, effect-site anesthesic concentrations and measures of anaesthetic depth, The Population Approach: Measuring and Managing Variability in Response, Concentration and Dose. Edited by Commision E. Brussels, European Commision, 1997, pp 83-94

26. Katoh T, Suzuki A, Ikeda K: Electroencephalographic derivatives as a tool for predicting the depth of sedation and anesthesia induced by sevoflurane. A nesthesiology 1998; 88: 642-50

27. Leslie K, Sessler DI, Smith WD, Larson MD, Ozaki M, Blanchard D, Crankshaw DP: Prediction of movement during propofol/nitrous oxide anesthesia: Performance of concentration, electroencephalographic, pupillary, and hemodynamic indicators. A nesthesiology 1996; 84: 52-63

28. Liu J, Singh H, White PF: Electroencephalographic bispectral index correlates with intraoperative recall and depth of propofol-induced sedation. Anesth Analg 1997; 84: 185-9

29. Iselin-Chaves IA, Flaishon R, Sebel PS, Howell S, Gan TJ, Sigl J, Ginsberg B, Glass PS: The effect of the interaction of propofol and alfentanil on recall, loss of consciousness, and the Bispectral Index. Anesth Analg 1998; 87: 949-55

30. Drummond J: Monitoring depth of anesthesia. A nesthesiology 2000; 93: 876-82

31. Mi WD, Sakai T, Takahashi S, Matsuki A: Haemodynamic and electroencephalograph responses to intubation during induction with propofol or propofol/fentanyl. Can J Anaesth 1998; 45: 19-22

32. Doi M, Gajraj RJ, Mantzaridis H, Kenny GN: Prediction of movement at laryngeal mask airway insertion: Comparison of auditory evoked potential index, bispectral index, spectral edge frequency and median frequency. Br J Anaesth 1999; 82: 203-7

33. Thornton C, Sharpe RM: Evoked responses in anaesthesia. Br J Anaesth 1998; 81: 771-81

34. Rampil IJ, Mason P, Singh H: Anesthetic potency (MAC) is independent of forebrain structures in the rat. A nesthesiology 1993; 78: 707-12

35. Antognini JF, Wang XW: Isoflurane indirectly depresses middle latency auditory evoked potentials by action in the spinal cord in the goat. Can J Anaesth 1999; 46: 692-5

Supplemental Digital Content

Back to Top | Article Outline

© 2002 American Society of Anesthesiologists, Inc.