In Vivo Repeatability and Multiscanner Reproducibility of MRI Radiomics Features in Patients With Monoclonal Plasma Cell Disorders

A Prospective Bi-institutional Study

Abstract

Objectives 

Despite the extensive number of publications in the field of radiomics, radiomics algorithms barely enter large-scale clinical application. Supposedly, the low external generalizability of radiomics models is one of the main reasons, which hinders the translation from research to clinical application. The objectives of this study were to investigate reproducibility of radiomics features (RFs) in vivo under variation of patient positioning, magnetic resonance imaging (MRI) sequence, and MRI scanners, and to identify a subgroup of RFs that shows acceptable reproducibility across all different acquisition scenarios.

Materials and Methods 

Between November 30, 2020 and February 16, 2021, 55 patients with monoclonal plasma cell disorders were included in this prospective, bi-institutional, single-vendor study. Participants underwent one reference scan at a 1.5 T MRI scanner and several retest scans: once after simple repositioning, once with a second MRI protocol, once at another 1.5 T scanner, and once at a 3 T scanner. Radiomics feature from the bone marrow of the left hip bone were extracted, both from original scans and after different image normalizations. Intraclass correlation coefficient (ICC) was used to assess RF repeatability and reproducibility.

Results 

Fifty-five participants (mean age, 59 ± 7 years; 36 men) were enrolled. For T1-weighted images after muscle normalization, in the simple test-retest experiment, 110 (37%) of 295 RFs showed an ICC ≥0.8: 54 (61%) of 89 first-order features (FOFs), 35 (95%) of 37 volume and shape features, and 21 (12%) of 169 texture features (TFs). When the retest was performed with different technical settings, even after muscle normalization, the number of FOF/TF with an ICC ≥0.8 declined to 58/13 for the second protocol, 29/7 for the second 1.5 T scanner, and 49/7 for the 3 T scanner, respectively. Twenty-five (28%) of the 89 FOFs and 6 (4%) of the 169 TFs from muscle-normalized T1-weighted images showed an ICC ≥0.8 throughout all repeatability and reproducibility experiments.

Conclusions 

In vivo, only few RFs are reproducible with different MRI sequences or different MRI scanners, even after application of a simple image normalization. Radiomics features selected by a repeatability experiment only are not necessarily suited to build radiomics models for multicenter clinical application. This study isolated a subset of RFs, which are robust to variations in MRI acquisition observed in scanners from 1 vendor, and therefore are candidates to build reproducible radiomics models for monoclonal plasma cell disorders for multicentric applications, at least when centers are equipped with scanners from this vendor.