Developments in Artificial Intelligence for Ophthalmology: Federated Learning : The Asia-Pacific Journal of Ophthalmology

Secondary Logo

Journal Logo

Editorial

Developments in Artificial Intelligence for Ophthalmology: Federated Learning

Teo, Zhen Ling MBBS, MRCSEd*,†; Lee, Aaron Y. MD, MSc; Campbell, Peter PhD§; Chan, R.V. Paul MD; Ting, Daniel S.W. MD, PhD*,†,#

Author Information
Asia-Pacific Journal of Ophthalmology: November/December 2022 - Volume 11 - Issue 6 - p 500-502
doi: 10.1097/APO.0000000000000582
  • Open

Technological advances in machine learning and increasing global connectivity have accelerated and encouraged global collaborative training in artificial intelligence (AI) health research.1 Multisite collaboration allows for access to larger and more heterogenous data sets which lead to more robust and externally generalizable AI machine learning models.2,3 AI will revolutionize the future practice of ophthalmology.4–8 Quite a number of specific algorithms have been developed and are now available for aiding diagnosing and monitoring various eye diseases.9–13 However, a major concern with collaborative machine learning in health care is data privacy concerns which limit data sharing and the clinical implementation of what is technically possible.14–16 The great incentive of collaborative training to achieve better deep learning models and the rising need for data security has led to increasing focus on privacy-preserving approaches such as federated learning (FL), generative adversarial networks, and cryptographic methods such as concurrent use of blockchain technology with AI.

In 2016, Google first introduced FL,17 a distributed machine learning framework that allows collaborative machine learning while preserving data privacy. Over the years, FL has shown to produce AI models comparable to AI models built by centralized training18 and is increasingly seen as an attractive alternative to traditional centralized training.1,18 Specific to health research where data is often not independent and identically distributed, FL has shown to remain robust.18 FL also allows for the training of AI models amongst various data types including imaging—magnetic resonance imaging for brain tumor segmentation,19 chest x-ray for coronavirus disease 2019 clinical outcome prediction,20 electronic medical records for predicting hospitalization,21 retinal fundus photographs,22 histology slides—in cancer diagnosis,23 genomics,24 and even Internet of Medical Things.25

In a FL framework,26 initial weights of the global model parameters are broadcast by a centralized server to selected participating sites. Each participating site then trains a local model (shares the same model architecture with the global model) using its local data and sends updated model parameters to the centralized server. The server then aggregates them to update the global model weight. In this setting, original data never leaves the local device or site. The updated global model is then broadcast to a new set of participating sites for another round of local training. The process is repeated until the global model converges. The key advantage of FL is the generation of a higher quality model from a larger training data set obtained from multiple sources, beyond what could have been achieved with the data of a single device or site. Limiting the transfer of raw data also allows for high levels of data privacy and minimizes data aggregation costs.

FEDERATED LEARNING IN OPHTHALMOLOGY

Despite the relative infancy of FL, there is an increasing number of studies demonstrating the use of FL in the training of medical AI models.19–21 Within ophthalmology, a simulated FL model has been shown to achieve similar performance to local learning (training on internal single data set) and centralized learning (where data is pooled) in microvasculature segmentation and diabetic retinopathy classification using optical coherence tomography angiography images.27 The acquisition of optical coherence tomography angiography images from different machines shows that FL remained robust even in heterogenous data types, which is often the case in not independent and identically distributed medical data sets. Two studies further demonstrated the real-world clinical success of FL in ophthalmology via the evaluation of retinopathy of prematurity (ROP).22,28 The first study22 demonstrated the use of FL in diagnostics by developing a deep learning model for fundus image-based classification of ROP and showed similar performance to centralized learning.22 The second study28 utilized the FL framework to evaluate interinstitution ROP diagnostic performance via a FL-derived vascular severity score. Demographic factors and clinically labeled fundus images were used to train an FL model to generate a vascular severity score. The generated vascular severity score for each category of ROP severity was then compared across institutions to assess for interinstitution variability without the need to transfer confidential patient data.28

While the number of studies evaluating the use of FL in ophthalmology is limited, these early works demonstrate the feasibility of FL in the building of AI models for diagnostics and classification of ophthalmic diseases. In addition, it shows the potential variable benefits of FL beyond diagnostics such as disease classification and reporting standardization.

CURRENT AND FUTURE DEVELOPMENTS IN FEDERATED MACHINE LEARNING

While FL provides an option for better privacy preservation and collaborative training, there are still limitations to the FL framework that future research may address.

First, the robustness of the FL model is dependent on the quality of data contributed by each participating site. In FL, as original data is kept private at local sites and not directly examined by the entire federation, there may be unintentional inclusion of poor quality data that may compromise model performance. Despite this, several approaches to circumvent this have been proposed such as data cleaning at each local site with pretraining data normalization methods. In addition, the inclusion of heterogenous input data is overall advantageous in creating a generalizable global model and FL has shown to produce more robust models than models trained on local site data alone.18

Second, as with all deep learning models, explainability analyses are important for acceptance in real-world settings. While explainability analyses such as heat map generation via ablation analysis and saliency analysis are possible, further studies are required to validate these in the FL framework to increase clinician and patient acceptance.

Third, sites with large and good quality data sets may feel little incentive to participate in FL as local model training may yield acceptable results. Hence the shift from technical proof of concepts to actual clinical application of federated AI will require intellectual property considerations and the design of fair incentive mechanisms to attract participants to join the federation.

Fourth, while original data remains private, the transfer of model updates in FL is still susceptible to privacy attacks. Attackers may use model parameters to reconstruct original data sets (reconstruction attack) or infer if specific data records were used in model training (inference attack). Several approaches to further enhance privacy in FL have been proposed such as the use of cryptographic methods and differential privacy.

Fifth, to join the federation, local participating sites require the infrastructure and computational capabilities for model training and access to the communication network for model update sharing. This may limit the participation of less technologically developed sites. Efforts to address the digital divide across the world will allow for widespread implementation of FL.

With the explosion of big data and increased global digitalization, privacy-preserving technologies such as FL will play an increasingly important role. FL is a promising approach that supports global health collaboration. Further research is necessary to address the current barriers to clinical application and in doing so, will render FL a key strategy in preserving privacy in AI health research.

REFERENCES

1. Sheller MJ, Edwards B, Reina GA, et al. Federated learning in medicine: facilitating multi-institutional collaborations without sharing patient data. Sci Rep. 2020;10:12598.
2. Busse A, Kashino W, Suhartono S, et al. Acceptability and feasibility of using digital technology to train community practitioners to deliver a family-based intervention for adolescents with drug use disorders during the COVID-19 pandemic. Addict Behav Rep. 2021;14:100357.
3. Ting DSW, Cheung CY, Lim G, et al. Development and validation of a deep learning system for diabetic retinopathy and related eye diseases using retinal images from multiethnic populations with diabetes. JAMA. 2017;318:2211–2223.
4. Ting DSW, Pasquale LR, Peng L, et al. Artificial intelligence and deep learning in ophthalmology. Br J Ophthalmol. 2019;103:167–175.
5. Hogarty DT, Mackey DA, Hewitt AW. Current state and future prospects of artificial intelligence in ophthalmology: a review. Clin Exp Ophthalmol. 2019;47:128–139.
6. Ruamviboonsuk P, Chantra S, Seresirikachorn K, et al. Economic evaluations of artificial intelligence in ophthalmology. Asia Pac J Ophthalmol (Phila). 2021;10:307–316.
7. Abdullah YI, Schuman JS, Shabsigh R, et al. Ethics of artificial intelligence in medicine and ophthalmology. Asia Pac J Ophthalmol (Phila). 2021;10:289–298.
8. Ramessur R, Raja L, Kilduff CLS, et al. Impact and challenges of integrating artificial intelligence and telemedicine into clinical ophthalmology. Asia Pac J Ophthalmol (Phila). 2021;10:317–327.
9. Schmidt-Erfurth U, Sadeghipour A, Gerendas BS, et al. Artificial intelligence in retina. Prog Retin Eye Res. 2018;67:1–29.
10. Keenan TDL, Chen Q, Agrón E, et al. DeepLensNet: deep learning automated diagnosis and quantitative classification of cataract type and severity. Ophthalmology. 2022;129:571–584.
11. Chan EJJ, Najjar RP, Tang Z, et al. Deep learning for retinal image quality assessment of optic nerve head disorders. Asia Pac J Ophthalmol (Phila). 2021;10:282–288.
12. Lee EB, Wang SY, Chang RT. Interpreting deep learning studies in glaucoma: unresolved challenges. Asia Pac J Ophthalmol (Phila). 2021;10:261–267.
13. Ran A, Cheung CY. Deep learning-based optical coherence tomography and optical coherence tomography angiography image analysis: an updated summary. Asia Pac J Ophthalmol (Phila). 2021;10:253–260.
14. Price WN II, Cohen IG. Privacy in the age of medical big data. Nat Med. 2019;25:37–43.
15. Wiens J, Saria S, Sendak M, et al. Do no harm: a roadmap for responsible machine learning for health care. Nat Med. 2019;25:1337–1340.
16. He J, Baxter SL, Xu J, et al. The practical implementation of artificial intelligence technologies in medicine. Nat Med. 2019;25:30–36.
17. Dakka MA, Nguyen TV, Hall JMM, et al. Automated detection of poor-quality data: case studies in healthcare. Sci Rep. 2021;11:18005.
18. Sadilek A, Liu L, Nguyen D, et al. Privacy-first health research with federated learning. NPJ Digit Med. 2021;4:132.
19. Sheller MJ, Reina GA, Edwards B, et al. Multi-institutional deep learning modeling without sharing patient data: a feasibility study on brain tumor segmentation. Brainlesion. 2019;11383:92–104.
20. Dayan I, Roth HR, Zhong A, et al. Federated learning for predicting clinical outcomes in patients with COVID-19. Nat Med. 2021;27:1735–1743.
21. Brisimi TS, Chen R, Mela T, et al. Federated learning of predictive models from federated Electronic Health Records. Int J Med Inform. 2018;112:59–67.
22. Lu C, Hanif A, Singh P, et al. Federated learning for multicenter collaboration in ophthalmology: improving classification performance in retinopathy of prematurity. Ophthalmol Retina. 2022;6:657–663.
23. Adnan M, Kalra S, Cresswell JC, et al. Federated learning and differential privacy for medical image analysis. Sci Rep. 2022;12:1953.
24. Wang Q, Zhou Y. FedSPL: federated self-paced learning for privacy-preserving disease diagnosis. Brief Bioinform. 2022;23:bbab498.
25. Arikumar KS, Prathiba SB, Alazab M, et al. FL-PMI: federated learning-based person movement identification through wearable devices in smart healthcare systems. Sensors (Basel). 2022;22:1377.
26. McMahan HB, Moore E, Ramage D, et al. Federated learning of deep networks using model averaging. ArXiv.2016:1373–1382; arXiv:1602.05629.
27. Lo J, Yu TT, Ma D, et al. Federated learning for microvasculature segmentation and diabetic retinopathy classification of OCT data. Ophthalmol Sci. 2021;1:10069.
28. Hanif A, Lu C, Chang K, et al. Federated learning for multicenter collaboration in ophthalmology: implications for clinical diagnosis and disease epidemiology. Ophthalmol Retina. 2022;6:650–656.
Copyright © 2022 Asia-Pacific Academy of Ophthalmology. Published by Wolters Kluwer Health, Inc. on behalf of the Asia-Pacific Academy of Ophthalmology.