Automatic diagnosis of multiple fundus lesions based on depth graph neural network

Abstract:

Fundus images are commonly used to capture changes in fundus structures and the severity of fundus lesions, and are the basis for detecting and treating ophthalmic diseases as well as other important diseases. This study proposes an automatic diagnosis method for multiple fundus lesions based on a deep graph neural network (GNN). 2 083 fundus images were collected and annotated to develop and evaluate the performance of the algorithm. First, high-level semantic features of fundus images are extracted using deep convolutional neural networks (CNNs). Then the features are input into the GNN to model the correlation between different lesions by mining and learning the correlation between lesions. Finally, the input and output features of the GNN are fused, and a multi-label classifier is used to complete the automatic diagnosis of fundus lesions. Experimental results show that the method proposed in this study can learn the correlations between lesions to improve the diagnostic performance of the algorithm, achieving better performance than the original ResNet and DenseNet models in both qualitative and quantitative evaluation.