An Ipsilateral Comparison of Acceleromyography and Electromyography During Recovery from Nondepolarizing Neuromuscular Block Under General Anesthesia in Humans

Abstract

BACKGROUND: 

Residual neuromuscular block is defined as a mechanomyography (MMG) or electromyography (EMG) train-of-four (TOF) ratio <0.90, and is common in patients receiving neuromuscular blocking drugs. Objective neuromuscular monitoring is the only reliable way to detect and exclude residual neuromuscular block. Acceleromyography (AMG) is commercially available and easy to use in the clinical setting. However, AMG is not interchangeable with MMG or EMG. Currently, it is unclear what value must be reached by AMG TOF ratio to reliably exclude residual neuromuscular block.

METHODS: 

During spontaneous recovery from neuromuscular block, we monitored TOF ratio on the same arm using AMG at the adductor pollicis and EMG at the first dorsal interosseus. AMG and EMG TOF ratios were compared by the Bland–Altman analysis for repeated measurements. The precision of each device was assessed by the repeatability coefficient. A small repeatability coefficient indicates high precision of the device. The agreement between the devices was assessed by the bias and the 95% limits of agreement. Small bias and narrow limits of agreement indicate strong agreement. We defined clinically acceptable agreement between AMG and EMG as a bias <0.025 and limits of agreement within −0.050 to 0.050, provided that the control comparison between EMG and itself can fulfill these criteria.

RESULTS: 

In 26 patients, 261 comparisons between AMG and EMG were made. The repeatability coefficient of AMG and EMG were 0.094 (95% confidence interval [CI], 0.088–0.100) and 0.051 (95% CI, 0.048–0.055), respectively. The bias between AMG and EMG TOF ratio was 0.176 (95% CI, 0.162–0.190), with limits of agreement −0.045 to 0.396 (95% CI, −0.067 to 0.419).

CONCLUSIONS: 

AMG is less precise than EMG and overestimates EMG TOF ratio by at least 0.15. The lack of agreement cannot be attributed to instrumental imprecision or the baseline difference between successive measurements during spontaneous recovery of neuromuscular function. Residual neuromuscular block cannot be excluded on reaching an AMG TOF ratio of 1.00.

In Brief

Published ahead of print July 2, 2013.

Residual neuromuscular block persisting into the recovery period occurs in approximately 40% of patients who receive neuromuscular blocking drugs during general anesthesia, placing them at risk of postoperative respiratory complications and delayed discharge from the postanesthetic care unit.¹ As clinical signs of muscle weakness cannot reliably detect residual neuromuscular block, experts recommend using objective, quantitative neuromuscular monitoring to ensure the train-of-four (TOF) ratio exceeds 0.90 at the end of anesthesia.^1–6

Objective neuromuscular monitoring devices include mechanomyography (MMG), electromyography (EMG), and acceleromyography (AMG). MMG measured at the adductor pollicis is the gold standard, but is impractical for perioperative use.² Both EMG and AMG are commercially available and easy to use in the clinical setting.⁷ Studies have demonstrated that EMG TOF ratio measured at the first dorsal interosseus muscle is equivalent to MMG during the late phase of recovery (TOF ratio > 0.70).^8–11 Hence, EMG at the first dorsal interosseus is an alternative gold standard for detecting residual neuromuscular block in clinical settings. Additionally, EMG yields more consistent responses because it is not affected by restriction of movement of the muscle.¹² Use of AMG reduces the incidence of residual neuromuscular block when compared with subjective neuromuscular monitoring. However, approximately 5% of patients monitored using AMG still had residual neuromuscular block.^13–15 To establish an AMG-based criterion for residual neuromuscular block, the bias between AMG and EMG TOF ratio must be known.

A recent systematic review drew attention to methodological shortcomings of previous studies comparing AMG and EMG TOF ratio during recovery from neuromuscular block.¹⁶ A contralateral comparison might be influenced by arm-to-arm variations such as electrode positioning, arm dominance, arm temperature, location of the IV catheter, and location of the blood pressure cuff. An ipsilateral comparison, where the AMG and EMG TOF ratios cannot be simultaneously measured, needs to account for the baseline difference between successive measurements during spontaneous recovery of neuromuscular function. Additionally, all previous studies overlooked the assessment of precision, which is a critical step in the Bland–Altman analysis of agreement between 2 methods. The review called for well-designed and sufficiently powered studies to further investigate the agreement between AMG and EMG.

This study evaluated the precision and agreement between TOF ratio obtained by AMG at the adductor pollicis and EMG at the first dorsal interosseus of the same hand during recovery from nondepolarizing neuromuscular block. We hypothesized that the bias between AMG and EMG TOF ratio is at least 0.10 based on the suggestion that an AMG TOF ratio of at least 1.00 should be achieved to exclude residual neuromuscular block.^1,2

METHODS

This study received approval from the Sydney Adventist Hospital Human Research Ethics Committee (EC00141:2011–022). Written informed consent was obtained from all patients. Adult patients requiring neuromuscular block for surgery at the Sydney Adventist Hospital were recruited. Patients with neuromuscular disorders were excluded. The following data were collected: age, sex, body mass index, dominant arm, study arm, and neuromuscular blocking drugs used.

The anesthesiologist in charge of each patient was responsible for making all clinical decisions. Neuromuscular function was monitored on the same arm using AMG (Infinity® Trident® NMT SmartPod® with software VF8, Dräger, Lübeck, Germany) and EMG (NMT-EMG with software 891647-2.0, Datex Ohmeda, Helsinki, Finland). TOF stimulation was set to deliver 4 supramaximal stimuli every 20 seconds, with frequency 2 Hz and pulse width 200 microseconds. AMG was used to record TOF ratios at the adductor pollicis muscle. EMG was used to record TOF ratios at the first dorsal interosseus muscle.

Before the initiation of neuromuscular block, the study arm was immobilized on an arm board with adhesive tape. Preparation of the skin and placement of the Red Dot Ag/AgCl Micropore™ backed Electrodes (3M, St. Paul, MN) followed current recommendations.¹⁷ To measure TOF ratio by EMG, 5 electrodes were needed. This included 2 stimulating electrodes over the ulnar nerve, 1 ground electrode, the recording electrode over the first dorsal interosseus muscle and the neutral electrode on the index finger (Fig. 1). To measure TOF ratio by AMG, we used the same stimulating electrodes and the piezoelectric sensor in the AMG hand adapter. The AMG hand adapter applies a small preload of 75 to 150 g, depending on the size of the patient’s hand. The arm was covered with a forced-air warming blanket to maintain the temperature of the study site above 32°C and monitored by the thermistor embedded in the hand adapter of the AMG. The supramaximal stimulating current for each device was established automatically by built-in functions, and we confirmed that both devices achieved stable signals by visual inspection that the EMG and AMG waveform had a smooth biphasic contour before neuromuscular blocking drugs were administered. Adjustment of gain to 100% twitch height using single twitch stimulation (calibration) was not necessary because this procedure equally amplifies all 4 responses, so the TOF ratio is not affected by this procedure.⁷

Figure 1: The green recording lead is connected to the electrode placed over the belly of the first dorsal interosseus muscle and the red neutral lead over the muscle tendon. The brown negative lead is connected to the electrode placed over the ulnar nerve distally and the white positive lead proximally. The black lead is connected to the ground electrode. Images adapted from http://www.flickr.com/photos/[email protected]/6971844253/in/photostream and http://www.flickr.com/photos/[email protected]/6825700156/in/photostream (accessed March 14, 2012). Images adapted with permission. © 2012 Paul Stewart.

Data recording commenced when TOF ratio recovered to 0.20 by EMG and terminated on completion of surgery or administration of neuromuscular block antagonist (because accelerated recovery would inflate the difference between measurements). Multiple comparisons were made. Each time, 2 consecutive AMG measurements were compared with 2 consecutive EMG measurements (Fig. 2). When switching between AMG and EMG, one device would be detached from the stimulating electrodes and the other device would be attached in its place, taking no more than 10 seconds. The recording order of AMG and EMG was reversed after each comparison because always having one device preceding the other may introduce systematic bias. Under this protocol, 4 consecutive EMG measurements would be recorded between each pair of comparisons. These data were used for a control comparison between EMG and itself to establish the baseline difference between successive measurements during spontaneous recovery of neuromuscular function.

Figure 2: This schematic illustrates the data recording sequence. Each comparison period collected 2 consecutive acceleromyography (AMG) measurements and 2 consecutive electromyography (EMG) measurements, which are used to evaluate the agreement between AMG and EMG. In the next comparison period, the recording order was reversed because always having one device preceding the other may introduce systematic bias. Four consecutive EMG responses obtained over 2 comparison periods were used for a control comparison between EMG and itself to account for the baseline difference between successive measurements during spontaneous recovery of neuromuscular function.

Statistical Analysis

AMG and EMG TOF ratios were compared by the Bland–Altman analysis for repeated measurements performed using the statistical software R (version 2.14.1, R Foundation for Statistical Computing, Vienna, Austria).¹⁸ This analysis involves assessing the agreement between the devices by the bias and the 95% limits of agreement. Small bias and narrow limits of agreement indicate strong agreement. Additionally, this analysis accounts for the effect of instrumental imprecision by evaluating the repeatability coefficient of each device.^18,19 A small repeatability coefficient indicates high precision of the device.

A hierarchy of analyses were planned. Initially, a standard Bland–Altman analysis would be performed, with multiple comparisons of AMG and EMG TOF ratio from the same patient treated as if they were from different patients. Compared with a random effects approach, the standard Bland–Altman analysis would yield an identical bias but the limits of agreement would be slightly narrower and therefore more conservative. If agreement between AMG and EMG was shown to be unsatisfactory by the standard Bland–Altman analysis, then we would not conduct further analysis. Otherwise, a random effects approach would be adopted. In the end, only the standard Bland–Altman analysis was performed.

Precision

One-way analysis of variance was performed on sets of consecutive TOF ratios measured by the same device. The 95% repeatability coefficient is defined as 1.96 times the standard deviation of the differences between 2 consecutive measurements. That is,

where

was estimated by the square root of the residual mean square. The 95% confidence interval (CI) for the repeatability coefficient was constructed using the sample variance of r,

where n is the number of comparisons. The interval (−r, r), known as the 95% repeatability limits, specifies the range within which 2 measurements by the same device will differ in 95% of cases.

Agreement

The bias (

) is defined as the mean difference of AMG minus EMG TOF ratio. The corresponding limits of agreement are defined as

where

was estimated by

The 95% CI for the limits of agreement was constructed using the sample variance of L,

, where n is the number of comparisons. The limits of agreement capture 95% of differences between AMG and EMG TOF ratio. We defined clinically acceptable agreement between AMG and EMG as a bias <0.025 and limits of agreement within −0.050 to 0.050, provided that the control comparison between EMG and itself can fulfill these criteria.

Sample Size

To ensure that reliable estimates of repeatability coefficient (r), bias (

), and limits of agreement (L) are obtained, we performed an a priori sample size calculation using parameters obtained from a pilot study. We decided that the 95% CIs must be within ±0.0250 of the estimates. For the repeatability coefficient (r) to achieve this, at least 24 comparisons were required. This was done by solving

with a pilot estimate of

Similarly, we solved

and

0.0250 with a pilot estimate of

and found that at least 43 and 128 comparisons were required to obtain reliable estimates for bias (

) and limits of agreement (L), respectively. To reduce the underestimation of the limits of agreement by the standard Bland–Altman analysis for repeated measurements, we ensured the number of comparisons per patient was less than the number of patients.¹⁹ Therefore, we required at least 128 comparisons between AMG and EMG from at least 16 patients.

RESULTS

Patient Characteristics

We collected 261 comparisons between AMG and EMG from 26 patients (Table 1). Two comparisons were excluded due to external movement of the study arm. This exceeded the sample size required for sufficiently reliable estimates of repeatability coefficient (r), bias (

), and limits of agreement (L).

Table 1: Patient Characteristics

Precision

AMG was significantly less precise than EMG for measuring TOF ratio over the range 0.20 to 1.00 (Table 2). When the comparisons were stratified into different levels of neuromuscular recovery, we found AMG to be less precise over medium range TOF ratios (0.40–0.59 and 0.60–0.79) compared with other ranges.

Table 2: Precision of AMG and EMG

Agreement

We found a bias of 0.176 (95% CI, 0.162–0.190) between AMG and EMG for measuring TOF ratio over the range 0.20 to 1.00, with wide and positively skewed limits of agreement (Table 3, Fig. 3). The agreement between AMG and EMG was not clinically acceptable by our a priori definition. The control comparison between EMG and itself showed that the baseline difference between successive measurements during spontaneous recovery of neuromuscular function was a negligible amount of 0.010 (95% CI, 0.005–0.014). The bias between AMG and EMG is significantly larger than the baseline. When the comparisons were stratified into different levels of neuromuscular recovery, we found a smaller bias between AMG and EMG over low range TOF ratios (0.20–0.39) compared with higher ranges.

Figure 3: On the left is a Bland–Altman plot of the differences between train-of-four (TOF) ratios measured by acceleromyography (AMG) and electromyography (EMG) against the corresponding means (n = 261). On the right is a similar plot for the control comparison between EMG and itself (n = 149). The baseline difference between successive measurements during spontaneous recovery of neuromuscular function is very small and cannot explain the large bias between AMG and EMG. CI = confidence interval.

Table 3: Agreement Between AMG and EMG

DISCUSSION

TOF ratios measured by AMG and EMG are not interchangeable for detecting residual neuromuscular block. Our study demonstrated that AMG overestimates EMG TOF ratio by 0.176 (95% CI, 0.162–0.190), with wide and positively skewed limits of agreement. The baseline difference of 0.010 (95% CI, 0.005–0.014) between successive measurements during spontaneous recovery of neuromuscular function accounted for a negligible amount of the overall bias. Furthermore, the lack of agreement cannot be explained by the imprecision of either device because the limits of agreement were significantly wider than the repeatability limits. An uncorrected AMG TOF ratio overestimates EMG by at least 0.15. Correction techniques are discussed later.

According to 1 systematic review, the agreement between AMG and EMG TOF ratio has been evaluated by 2 previous studies with acceptable methodology, despite some shortcomings.¹⁶ The studies reported different estimates of the bias between AMG and EMG TOF ratio. The bias estimate of 0.125 reported by Kopman et al.²¹ is consistent with our result of 0.176 (95% CI, 0.162–0.190). Using the standard error of the bias estimate reported by Kopman, we calculated the 95% CI to be 0.061 to 0.181.²¹ As this interval overlaps with our result, there is no significant difference between the 2 bias estimates. Both the study by Kopman and our study conducted an ipsilateral comparison, applied a small preload with AMG, and used EMG at the first dorsal interosseus muscle. However, some key distinctions must be made. An ipsilateral comparison needs to account for the baseline difference between successive measurements during spontaneous recovery of neuromuscular function. Kopman recognized this as a potential source of error, but did not assess the magnitude of the potential error as we have done by a control comparison between EMG and itself. We have further demonstrated that the lack of agreement between AMG and EMG TOF ratio also cannot be explained by the imprecision of either device. Kopman performed an a priori sample size analysis based on hypothesis testing rather than parameter estimation, resulting in an underestimation of the required sample size to obtain a sufficiently reliable bias estimate. Our bias estimate with a narrow 95% CI is more reliable.

In contrast, Dahaba et al.’s²⁰ bias estimate of 0.050 is significantly different to both Kopman’s²¹ and our results. Dahaba did not apply a preload with AMG and used EMG at a different muscle. We studied the first dorsal interosseus because EMG at this muscle is an alternative gold standard for detecting residual neuromuscular block in clinical settings. The first dorsal interosseus is also preferable when using EMG because its response exhibits good morphology with large peak to peak amplitude and relatively little baseline drift.¹² Furthermore, Dahaba’s contralateral comparison might have been influenced by arm-to-arm variations such as electrode positioning, arm dominance, and arm temperature.²² Like Kopman,²¹ Dahaba²⁰ omitted the assessment of precision, which is a critical step in the Bland–Altman analysis of agreement between 2 methods.^18,19 We have evaluated the agreement between AMG and EMG TOF ratio by an ipsilateral comparison to address these methodological issues.

Is it possible to correct an AMG TOF ratio so that it can be used interchangeably with EMG to detect residual neuromuscular block? One technique is normalization. This involves dividing an AMG TOF ratio by the preinduction control, which has an average value of 1.15.²³ Although normalization can effectively reduce the bias,²⁴ it is impractical to perform in clinical settings. Additionally, some AMG devices available for clinical use, such as the Infinity Trident NMT SmartPod, have been programmed to limit the displayed TOF ratio to 1.00 so the preinduction control cannot be obtained and normalization cannot be performed. Another technique used by AMG devices such as the TOF Watch® and the TOF WatchS® (Organon, Dublin, Ireland) is to display the T4/T2 ratio rather than the T4/T1 ratio under circumstances where T2 > T1. However, there are discrepancies between the T4/T2 ratio and the normalized TOF ratio.²⁵ The simplest correction involves adjusting an AMG TOF ratio by the bias. We believe subtracting at least 0.15 from an AMG TOF ratio gives a reliable estimate of the EMG TOF ratio. However, this technique should be used with caution given the poor reliability of AMG and the wide limits of agreements between AMG and EMG. Our findings provide evidence to support the suggestion by some experts that an AMG TOF ratio of at least 1.00, perhaps with an additional waiting period, may be necessary to exclude residual neuromuscular block before tracheal extubation.^26,27 This waiting period would vary according to factors including the choice of relaxant and reversal drug, patient gender and age, core temperature, and renal and liver function. Future studies should clinically validate such a proposal.

The limitations of our evaluation of the agreement between AMG and EMG TOF ratio should be addressed. First, we treated multiple observations from the same patient as if they were from different patients. We have taken the recommended measures to minimize the correlation between the patients and the comparisons.¹⁹ Compared with a random effects model, the standard Bland–Altman analysis would yield an identical bias but the limits of agreements would be slightly narrower and therefore more conservative.¹⁹ Even so, the agreement between AMG and EMG was still unsatisfactory. As such, we decided that there was no need to adopt a random effects model. Second, to pool comparisons of TOF ratios over the range 0.20 to 1.00, we assumed that the bias is relatively constant at different levels of neuromuscular recovery. Stratified analysis found a smaller bias over low range TOF ratios (0.20–0.39), but no significant difference among the remaining strata. Third, we assumed that the bias between AMG and EMG TOF ratios was not influenced by differences in factors such as patient characteristics or the anesthetic technique. This assumption holds because we are comparing AMG and EMG TOF ratios under identical conditions in 1 patient at 1 moment, allowing each patient to act as his or her own control. Additionally, the sensitivity of adductor pollicis and first dorsal interosseus share close resemblance and is not affected by the choice of relaxant.^28,29

In conclusion, AMG and EMG TOF ratio cannot be used interchangeably to assess residual neuromuscular block. After accounting for instrumental imprecision and the baseline difference between successive measurements during spontaneous recovery of neuromuscular function, AMG overestimates EMG TOF ratio by at least 0.15. Anesthesiologists should ensure by objective monitoring that patients do not have residual neuromuscular block before sending them to the recovery room. Therefore, anesthesiologists must be aware of how much AMG overestimates recovery. Residual neuromuscular block, defined as an EMG or MMG TOF ratio of <0.90, cannot be excluded immediately on reaching an AMG TOF ratio of 0.90 or indeed 1.00. This limits the clinical usefulness of AMG devices that can only display TOF ratio up to 1.00, such as the Infinity Trident NMT SmartPod.

DISCLOSURES

Name: Sophie S. Liang, BSc (Adv.).

Contribution: This author helped design the study, conduct the study, analyze the data, and write the manuscript.

Attestation: Sophie S. Liang has seen the original study data, reviewed the analysis of the data, approved the final manuscript, and is the author responsible for archiving the study files.

Name: Paul A. Stewart, MBBS, FANZCA.

Contribution: This author helped design the study, conduct the study, and write the manuscript.

Attestation: Paul A. Stewart has seen the original study data, reviewed the analysis of the data, and approved the final manuscript.

Name: Stephanie Phillips, BMed, FANZCA, FRCA.

Contribution: This author helped design the study, conduct the study, and write the manuscript.

Attestation: Stephanie Phillips has seen the original study data, reviewed the analysis of the data, and approved the final manuscript.

This manuscript was handled by: Dwayne R. Westenskow, PhD.

ACKNOWLEDGMENTS

The authors thank Professor J. Martin Bland, Department of Health Sciences, University of York, UK, and Associate Professor Gillian Heller, Department of Statistics, University of Macquarie, Australia, for their comments on the statistical analysis, and Dr. Adam Osomanski, Sydney Adventist Hospital, Australia, and Peter Xie, Sydney Medical School, Australia, for their contribution to data collection and manuscript preparation.