Secondary Logo

Journal Logo

Institutional members access full text with Ovid®

Interrater and Intrarater Agreement of the Chicago Classification of Achalasia Subtypes Using High-Resolution Esophageal Manometry

Hernandez, Jose C MD1; Ratuapli, Shiva K MD1; Burdick, George E MD1; DiBaise, John K FACG, MD1; Crowell, Michael D PhD, FACG, AGAF1

American Journal of Gastroenterology: February 2012 - Volume 107 - Issue 2 - p 207–214
doi: 10.1038/ajg.2011.353

OBJECTIVES: Subclassification of achalasia based on high-resolution manometry (HRM) may be clinically relevant because response to therapy may vary by subtype. However, the consistency and reliability of subtyping achalasia patients based on HRM remains undefined. The objectives of this study were to assess interrater and intrarater agreement (reliability) of achalasia subtyping using the Chicago classification, and to evaluate the diagnostic consistency between clinicians interpreting HRM.

METHODS: After receiving training on the classification criteria, five raters classified 20 achalasia and 10 non-achalasia cases in separate sessions 1 week apart. To further assess agreement, two raters classified all 101 available achalasia HRMs. Agreement for the classification of subtypes of achalasia was calculated using Cohen'sκand Krippendorff'sα-reliability estimate.

RESULTS: Estimates of agreement among raters was good during both sessions (α=0.75; 95% confidence interval=0.69, 0.81 andα=0.75; 95% confidence interval=0.68, 0.81). Both interrater (κ=0.86–1.0) and intrarater (κ=0.86–1.0) agreement were very good for type III achalasia. Agreement between types I and II was more variable. Reliability was improved when type I and type II were combined (α=0.84; 95% confidence interval=0.78, 0.89). When all available cases were classified by two experienced raters, agreement was very good (κ=0.81; 95% confidence interval=0.71, 0.91).

CONCLUSIONS: Interobserver and intraobserver agreement for differentiating achalasia from non-achalasia patients using HRM and the Chicago classification was very good to excellent. More variability was seen in agreement when classifying achalasia subtypes. The most variation was observed in classification between type I and type II achalasia, which have similar characteristics. Clearly, differentiating between panesophageal pressurization and compartmentalization should improve discrimination between these subtypes.

1 Division of Gastroenterology and Hepatology, Mayo Clinic, Scottsdale, Arizona, USA

Correspondence: Michael D. Crowell, PhD, FACG, AGAF, Division of Gastroenterology and Hepatology, Mayo Clinic Arizona, 13400 East Shea Boulevard, Scottsdale, Arizona 85259, USA. E-mail:

Received 26 June 2011; accepted 13 September 2011

published online 18 October 2011

© The American College of Gastroenterology 2012. All Rights Reserved.
You currently do not have access to this article

To access this article:

Note: If your society membership provides full-access, you may need to login on your society website