AI technology-based cataract patient vision impairment degree evaluation systemTechnical Field
The invention belongs to the technical field of medical image processing, and particularly relates to an AI technology-based cataract patient vision impairment degree evaluation system.
Background
Cataract is the first eye disease causing blindness, and China is the country with the most cataract patients and has over 7000 thousands of people. The cataract extraction operation at the present stage is the only effective treatment mode, and the timely diagnosis and the operation treatment can prevent the patient from blindness. However, cataract diagnosis at present depends on a limited specialized ophthalmologist. Data published by the International Council for Ophthalmology, ICO, 2012 showed that the total number of registered ophthalmologists in china was only 28338, only 1 ophthalmologist in every 6 ten thousand population, and had not reached the goal of 1 ophthalmologist in every 5 thousand population in asia by the year 2020 as proposed in the action of "vision 2020" initiated by the world health organization.
Ophthalmologists are relatively limited at present, cataract examination is time-consuming, and due to low sanitary expenditure, cataract blindness rate is high in middle and low income countries and regions, and extensive cataract blindness is difficult to prevent and avoid. Therefore, the artificial intelligence provides possibility for solving the contradiction between supply and demand of medical resources, can be popularized and used in primary hospitals and common people, is an important means for improving ophthalmic health care service in underdeveloped areas and bringing brightness to cataract patients.
However, the existing artificial intelligence system does not establish the relation between the severity of cataract and the degree of visual impairment, so that no specific diagnosis and treatment suggestions are given to patients with severe visual impairment and blindness, the diagnosis and treatment effect is easily reduced, and the illness state of the patients is delayed; the effectiveness of the blind prevention and blind treatment work is easily reduced, and the waste or insufficient administration of medical resources is caused.
Disclosure of Invention
Aiming at the existing problems, the invention provides the vision damage degree evaluation system for the cataract patient based on the AI technology, which can simply and quickly evaluate whether the patient has the cataract and the vision damage degree thereof, and provide related diagnosis and treatment suggestions, thereby improving the diagnosis and treatment efficiency.
The technical scheme of the invention is as follows: the cataract patient vision damage degree evaluation system based on the AI technology comprises an information acquisition module, a fundus image acquisition module, an image identification module, an image classification module, an illness state evaluation module and a diagnosis and treatment suggestion module;
the information acquisition module is used for acquiring basic information of an individual user;
the eye fundus image acquisition module is used for acquiring a mydriasis-free eye fundus image of a patient;
the image identification module is used for performing bottom image classification identification according to whether the patient has cataract in the mydriatic eye fundus image acquired by the eye fundus image acquisition module; grading and marking the fundus image marked as 'cataract' according to the vision damage degree of the cataract patient;
the image classification module is used for processing the mydriasis-free eye fundus image identification through the deep convolution neural network on the basis of the classification identification of whether cataract exists or not and the degree of cataract vision damage in the eye fundus image identified by the image identification module to obtain a deep learning model;
the disease condition evaluation module is used for acquiring a mydriasis-free eye fundus image of the patient through the eye fundus image acquisition module according to the deep learning model obtained by the image classification module, and evaluating and grading the vision damage degree of the cataract patient.
Further, the image identification module divides the fundus image into two stages according to the lenticular opacity: the degree of visual impairment of patients with cataract is marked in five grades, namely 1 grade, 2 grade, 3 grade, 4 grade and 5 grade.
Furthermore, the grade 1 represents no/mild visual impairment with the vision being more than or equal to 0.5, thegrade 2 represents no/mild visual impairment with the vision being more than or equal to 0.3, thegrade 3 represents moderate visual impairment with the vision being more than or equal to 0.1, thegrade 4 represents severe visual impairment with the vision being more than or equal to 0.05, and thegrade 5 represents blind with the vision being less than 0.05.
Furthermore, the diagnosis and treatment suggestion module gives necessary diagnosis and treatment suggestions according to different degrees of visual impairment of the cataract patient obtained by the disease condition evaluation module, and different diagnosis and treatment suggestions can be given in a targeted manner by giving the diagnosis and treatment suggestions with different degrees of visual impairment, so that the diagnosis accuracy is improved.
Further, the diagnosis and treatment suggestion module judges whether cataract surgery is needed or not at the time of diagnosis, and the judgment criteria are as follows: assessment of visual impairment abovegrade 3 requires cataract surgery.
Further, the deep convolutional neural network is a densenert 121, and the specific steps of performing interpretation training by using the densenert 121 are as follows:
first, the experimental algorithm sets up:
SGD is adopted as an optimization algorithm, the initial learning rate (lr) corresponding to the algorithm is set to be 0.001, the momentum is 0.9, the weight attenuation degree is 5 multiplied by 10-5The iteration time epoch is 80, and the batch size batchsize is 64; a learning rate attenuation strategy is adopted in the training process: each iteration 20 times, the learning rate decays to one tenth of the original, expressed as:
lr ═ Lr (0.1 ═ epoch//20)), i.e., the formula is as follows
Lr=lr×(0.1(k//20))
Wherein, the operator of integer division is obtained, namely the integer part (not including remainder) of the quotient is obtained, and k is the iteration number;
the Loss function used for the experiment was a Cross Entropy Loss function (Cross entry Loss):
wherein p isiAnd yiRespectively representing the prediction probability of the classification model predicted image as the ith class and the real label of the image, wherein n is the total number of the classified classes;
second, experimental environment:
in the experiment, a network model of the experiment is built by using a Pythrch deep learning framework, and the network model is trained on NVIDIA TITAN RTX GPUs with 24G video memory;
thirdly, data preprocessing:
the image size of the data set is uniformly scaled to 224 x 224 to meet the input requirement of the network model, meanwhile, in order to enhance the generalization capability of the model, the image is randomly rotated by 90 degrees and turned over in the horizontal or vertical direction, and the random probability is 0.5;
fourth, data set partitioning:
the original data set is randomly divided into a training set, a verification set and a test set, and the proportion of each part is 70%, 15% and 15% respectively.
Furthermore, in the above experimental process, after each round of training, the model is verified by using the verification set, and after the training times are completed, the final model after the training is completed is tested by using the test set, so as to evaluate the performance of the classification model.
Furthermore, when the eye fundus image acquisition module acquires the mydriasis-free eye fundus image of the patient, the digital photographing examination of the small pupil eye fundus is carried out through the mydriasis-free eye fundus digital photographing equipment, and the method for screening the moderate and severe cataract which obviously affects the vision is feasible, can replace a slit lamp microscopy examination method to screen the cataract, needs an operator, has the advantages of simple and quick process, and can realize the combined screening of various eye diseases causing blindness.
Further, the non-mydriatic fundus digital photographing apparatus includes, but is not limited to, a desktop fundus camera, a portable fundus camera, or a mobile terminal-equipped fundus camera.
The vision damage degree evaluation system for cataract patients based on AI technology is also suitable for after cataract.
The invention has the beneficial effects that:
the invention provides a cataract patient vision damage degree evaluation system based on AI technology, which classifies and marks a mydriasis-free eye fundus image according to whether a patient has cataract, classifies and finishes classification of corrected vision damage degree of the eye fundus image marked with cataract, and gives diagnosis and treatment suggestions pertinently for vision damage patients with different degrees caused by cataract; the system utilizes the deep learning artificial intelligence system to evaluate the disease condition, constructs a diagnosis and treatment suggestion module, gives the right of obtaining eye images to the eye health examination of community hospitals or intelligent terminal users, but not all levels of ophthalmic medical units, is wider and more popular to some extent, also relieves the problems of time and labor waste and high price in examination of general patients, and realizes a promising community medical treatment and portable emerging medical solution.
Drawings
FIG. 1 is a schematic overall flow diagram of the present invention;
FIG. 2 is a schematic view of an information collection module of the present invention;
FIG. 3 is a schematic diagram of the Lens opacity Classification System III (LOCS) of the present invention;
FIG. 4 is a schematic view of each level of fundus images of the present invention;
the system comprises an information acquisition module, a 2-fundus image acquisition module, a 3-image identification module, a 4-image classification module, a 5-illness state evaluation module and a 6-diagnosis and treatment suggestion module.
Detailed Description
Examples
As shown in fig. 1, the present embodiment provides an AI technology-based cataract patient vision impairment degree evaluation system, which includes an information acquisition module 1, a fundusimage acquisition module 2, animage identification module 3, animage classification module 4, an illnessstate evaluation module 5, and a diagnosis andtreatment suggestion module 6;
as shown in fig. 2, the information collecting module 1 is used for collecting basic information of an individual user, and includes: name, sex, age, cataract surgery history, etc. Name, sex, age, etc. for personal data improvement. The information collection of the cataract surgery history comprises the answer of the question of whether cataract surgery exists or not or whether cataract surgery and other eye surgery exist or not, if the answer of the two questions is no, the question is 'lens eye', and if the answer of any question of the two questions is 'yes', the question is 'non-crystalline eye'. The opacification of the posterior capsule formed by the proliferation of residual cortex and lens epithelial cells after cataract extraction is called as posterior cataract (posterior cataract). Both cataracts, and secondary cataracts, affect the passage of light through the ocular refractive medium, causing a decrease in fundus imaging quality, resulting in a decrease in visual function. The eyegroundimage acquisition module 2 is used for acquiring the patient mydriasis-free eyeground image, and is used for photographing and checking the eyeground under the small pupil by the mydriasis-free eyeground photographing device, and the mydriasis-free eyeground digital photographing device can be a desktop eyeground photographing instrument, a portable eyeground photographing instrument or an eyeground photographing instrument matched with a mobile terminal and the like.
As shown in fig. 3 and 4, theimage identification module 4 is used for performing classification identification of 'whether cataract exists' on the mydriatic fundus image acquired by the fundusimage acquisition module 2 according to whether cataract exists in the patient; grading and marking the fundus image marked as 'cataract' according to the vision damage degree of the cataract patient; wherein, the visual impairment degree of the cataract patient is divided into five grades of marks according to the phacoelomorphism, which are respectively 1 grade, 2 grade, 3 grade, 4 grade and 5 grade, wherein the 1 grade represents the no/mild visual impairment of the visual impairment of more than or equal to 0.5, the 2 grade represents the no/mild visual impairment of more than 0.5, the 3 grade represents the moderate visual impairment of more than 0.3, the 4 grade represents the severe visual impairment of more than 0.05, and the 5 grade represents the blind of less than 0.05;
theimage classification module 4 is used for identifying and processing the mydriasis-free eye fundus image through a deep convolution neural network on the basis of grading identification of cataract and degree of cataract vision damage in the eye fundus image identified by theimage identification module 3 to obtain a deep learning model;
the deep convolutional neural network is densenert 121, and the specific steps of performing interpretation training by using the densenert 121 are as follows:
first, the experimental algorithm sets up:
adopting SGD as an optimization algorithm, and obtaining an initial learning rate (learning) corresponding to the algorithmg rate, lr) is set to 0.001, momentum is 0.9, weight decay is 5 × 10-5The iteration time epoch is 80, and the batch size batchsize is 64; a learning rate attenuation strategy is adopted in the training process: each iteration 20 times, the learning rate decays to one tenth of the original, expressed as:
lr ═ Lr (0.1 ═ epoch//20)), i.e., the formula is as follows
Lr=lr×(0.1(k//20))
Wherein, the operator of integer division is obtained, namely the integer part (not including remainder) of the quotient is obtained, and k is the iteration number;
the Loss function used for the experiment was a Cross Entropy Loss function (Cross entry Loss):
wherein p isiAnd yiRespectively representing the prediction probability of the classification model predicted image as the ith class and the real label of the image, wherein n is the total number of the classified classes;
second, experimental environment:
in the experiment, a network model of the experiment is built by using a Pythrch deep learning framework, and the network model is trained on NVIDIA TITAN RTX GPUs with 24G video memory;
thirdly, data preprocessing:
the image size of the data set is uniformly scaled to 224 x 224 to meet the input requirement of the network model, meanwhile, in order to enhance the generalization capability of the model, the image is randomly rotated by 90 degrees and turned over in the horizontal or vertical direction, and the random probability is 0.5;
fourth, data set partitioning:
randomly dividing an original data set into a training set, a verification set and a test set, wherein the proportion of each part is 70%, 15% and 15%, respectively, after each training round, verifying the model by using the verification set, and after the training times are all completed, testing the final model after the training is completed by using the test set so as to evaluate the performance of the classification model;
the diseasecondition evaluation module 5 is used for acquiring a mydriasis-free eye fundus image of the patient through the eye fundusimage acquisition module 2 according to the deep learning model obtained by theimage classification module 4, and evaluating and grading the vision damage degree of the cataract patient;
the diseasecondition evaluation module 5 judges the collected mydriasis-free eye fundus images by using the established deep learning artificial intelligence system to obtain the classification of whether cataract exists and the vision damage degree grading;
the diagnosis andtreatment suggestion module 6 gives necessary diagnosis and treatment suggestions according to different degrees of the vision damage of the cataract patient obtained by the diseasecondition evaluation module 5, and suggests observation when the vision damage is grade 1 or no cataract exists; when the visual impairment isgrade 2, it is recommended that cataract surgery be considered according to the individual's living needs; the degree of visual impairment isgrade 3 or above, and patients are advised to seek medical advice in time to perform cataract surgery.