Disclosure of Invention
The embodiment of the invention provides a control method of an ultrasonic treatment device, which can control the ultrasonic treatment device according to the target position and the environmental information without manual replacement.
In a first aspect, an embodiment of the present invention provides a method for controlling an ultrasonic therapeutic apparatus, where the ultrasonic therapeutic apparatus is connected to a patient end through a signal, and the method for controlling the ultrasonic therapeutic apparatus includes:
receiving acquisition information sent by the patient end, wherein the acquisition information comprises image information and environment information;
performing target detection on the image information, and when the image information is detected to comprise a target part, matching control parameters corresponding to the ultrasonic treatment device according to the image information of the target part and the environment information, wherein the target part is determined through medical record information associated with the patient end;
and sending the control parameters to the patient end so that the patient end controls the ultrasonic treatment device according to the control parameters.
Optionally, before the step of performing object detection on the image information, the method further includes:
Acquiring medical record information associated with the patient side;
carrying out semantic analysis on the medical record information to obtain semantic features of the medical record information;
and determining the target part according to the semantic features.
Optionally, before the step of performing object detection on the image information, the method further includes:
Constructing a first sample image data set and a second sample image data set, wherein the first sample image data set comprises a sample image and a label of the target part, the sample image comprises the target part, the second sample image data set comprises a target sample image of a target person corresponding to medical record information and the label of the target part, and the target sample image comprises the target part;
Constructing a target detection model based on a convolutional neural network;
Performing first training on the target detection model through the first sample image data set to obtain a preliminarily trained target detection model;
performing second training on the primarily trained target detection model through the second sample image data set to obtain a final trained target detection model;
The final trained target detection model is used for carrying out target detection on the image information.
Optionally, when the image information includes a target portion, the step of matching control parameters corresponding to the ultrasound treatment device according to the image information of the target portion and the environmental information includes:
When the image information is detected to comprise a target part, extracting the image information of the target part;
Extracting state characteristics of the target part according to the image information of the target part, wherein the state characteristics comprise at least one of size characteristics and temperature characteristics;
and matching control parameters corresponding to the ultrasonic treatment device according to the state characteristics and the environmental information.
Optionally, the target part is a penis part, the environmental information includes an environmental temperature and an environmental humidity, and the step of matching control parameters corresponding to the ultrasonic treatment device according to the state characteristics and the environmental information includes:
Judging whether the penis portion is in an erect state according to at least one of the size characteristic and the temperature characteristic;
if the penis part is in a non-erection state, matching a first control parameter corresponding to the ultrasonic treatment device according to the ambient temperature and the ambient humidity;
and if the penis part is in an erection state, matching a second control parameter corresponding to the ultrasonic treatment device according to the ambient temperature and the ambient humidity, and adjusting the second control parameter according to at least one of the size characteristic and the temperature characteristic to obtain a third control parameter.
Optionally, the ultrasonic treatment device includes ultrasonic treatment heads disposed at different points, and if the penis part is in an erection state, the step of matching the second control parameter corresponding to the ultrasonic treatment device according to the ambient temperature and the ambient humidity includes:
If the penis part is in an erection state, SIFT feature extraction is carried out according to the image information of the penis part, so that SIFT feature points of the penis part are obtained;
Carrying out posture estimation on the penis part according to the SIFT feature points of the penis part to obtain posture information of the penis part;
According to the posture information of the penis part, matching point position control parameters of the ultrasonic treatment head;
Matching power control parameters of the ultrasonic treatment head according to the ambient temperature and the ambient humidity;
And obtaining a second control parameter corresponding to the ultrasonic treatment device according to the point position control parameter and the power control parameter.
In a second aspect, there is provided a control device for an ultrasound therapy device, the ultrasound therapy device being in signal connection with a patient side, the control device comprising:
the receiving module is used for receiving acquisition information sent by the patient end, wherein the acquisition information comprises image information and environment information;
the processing module is used for carrying out target detection on the image information, when the image information comprises a target part, the control parameters corresponding to the ultrasonic treatment device are matched according to the image information of the target part and the environment information, and the target part is determined through medical record information associated with the patient end;
And the sending module is used for sending the control parameters to the patient end so that the patient end can control the ultrasonic treatment device according to the control parameters.
In a third aspect, a control system of an ultrasonic therapeutic apparatus is provided, where the control system of an ultrasonic therapeutic apparatus includes an ultrasonic therapeutic apparatus, a service end and a patient end, where the service end is in signal connection with the patient end, the patient end is in signal connection with the ultrasonic therapeutic apparatus, and the service end includes the control device of an ultrasonic therapeutic apparatus according to the embodiment of the present invention.
In a fourth aspect, an electronic device is provided, comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the steps in the method of controlling an ultrasound therapy device according to any one of the embodiments of the present invention when executing the computer program.
In a fifth aspect, there is provided a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps in the method of controlling an ultrasound therapy device according to any one of the embodiments of the present invention.
In the embodiment of the invention, the acquisition information sent by the patient end is received, the acquisition information comprises image information and environment information, the image information is subjected to target detection, when the image information comprises a target position, the control parameter corresponding to the ultrasonic treatment device is matched according to the image information of the target position and the environment information, the target position is determined through medical record information associated with the patient end, and the control parameter is sent to the patient end so that the patient end can control the ultrasonic treatment device according to the control parameter. When the image information comprises the target part, the control parameters corresponding to the ultrasonic treatment device are matched according to the image information of the target part and the acquired environment information, and are sent to the patient end, the ultrasonic treatment device is controlled by the patient end to work with the control parameters, the ultrasonic treatment device does not need to be manually replaced, in addition, the corresponding control parameters are matched according to the tissue medium of the target part and the environment condition of the target part by identifying the target part and the environment information, and the control accuracy of the ultrasonic treatment device can be improved.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
Referring to fig. 1, fig. 1 is a schematic diagram of a control system of an ultrasonic treatment apparatus according to an embodiment of the present invention, and as shown in fig. 1, the control system of ultrasonic treatment includes an ultrasonic treatment apparatus, a service end and a patient end, wherein the service end is in signal connection with the patient end, and the patient end is in signal connection with the ultrasonic treatment apparatus.
The ultrasonic treatment device can be a wearable device and comprises a shell, an image acquisition module, an environment acquisition module, a first data transmission module and at least one ultrasonic treatment head. After the ultrasonic treatment device is worn by a patient, the image information of the wearing area can be acquired through the image acquisition module, the environment information of the wearing area can be acquired through the environment acquisition module, and the acquired image information and the acquired environment information are transmitted to the patient end through the first data transmission module.
In the ultrasonic treatment head, the ultrasonic transducer is mainly used for generating corresponding ultrasonic waves according to preset ultrasonic parameters, and the ultrasonic waves enable the inflamed part and surrounding normal tissues to generate non-broken instant quasi-cavitation states, so that the permeability of microcirculation of the tissues is enhanced, and further the liquid inflamed tissues can be promoted to diffuse to the surrounding tissues until the absorption capacity of the human normal tissues to inflammation exceeds the capacity of the inflamed tissues, and the aggregation and development of the inflamed tissues of the inflamed lesion part are restrained.
The server may be a cloud server, the server and the patient end may be connected by a wired connection or a wireless connection, the patient end receives the image information and the environment information acquired by the ultrasonic treatment device, then sends the image and the environment information to the server end, the server end receives the acquired information sent by the patient end, then carries out target detection on the image information, when detecting that the image information includes a target part, matches control parameters corresponding to the ultrasonic treatment device according to the image information and the environment information of the target part, the target part is determined by medical record information associated with the patient end, and sends the control parameters to the patient end, so that the patient end controls the ultrasonic treatment device according to the control parameters.
The patient end can be user terminal equipment or internet of things terminal equipment, the user terminal equipment can be electronic equipment such as a mobile phone, a tablet, a computer and the like, and the internet of things terminal equipment can be remote electronic equipment arranged on the ultrasonic treatment device.
For further explanation of the intention of the present invention, examples of the present invention will be described by taking ultrasonic treatment of male diseases as an example. For example, in the case of prostatitis, the existing ultrasonic treatment heads can be divided into two types, i.e., an in-vivo ultrasonic treatment head and an in-vitro ultrasonic treatment head, wherein the in-vivo ultrasonic treatment head is required to be used in a patient, and ultrasonic waves are emitted to the in-vivo prostate by introducing an ultrasonic transducer into the body through the urethra or rectum, and the in-vitro ultrasonic treatment head can emit ultrasonic waves from outside the body to the in-pelvic prostate. For male sexual dysfunction, the ultrasonic waves generated by the ultrasonic treatment head can also be used for treatment. Of course, for prostatitis and male sexual dysfunction, the required ultrasound is not identical in terms of frequency and wavelength.
For example, when a patient wears the ultrasonic therapy apparatus at home, image information of the wearing area may be collected by the image collection module, environment information of the wearing area may be collected by the environment collection module, and the collected image information and environment information of the wearing area may be transmitted to the patient end by the data transmission module. And the patient side forwards the received image information and the received environment information to the server side. The server extracts the image information of the target part according to the image information of the wearing area, and processes the image information of the target part and the environment information to obtain the control parameters corresponding to the ultrasonic treatment device. The server side transmits the control parameters to the patient side, the patient side converts the control parameters into control instructions, and the control instructions are transmitted to the ultrasonic treatment device for execution.
Further, above-mentioned ultrasonic therapy device is wearing formula device, and the patient can carry out communication connection through patient APP and wearing formula device, simultaneously, and the patient can carry out communication connection through patient APP and server, and simultaneously the server still carries out communication connection with doctor APP, and doctor can customize the control parameter that corresponds with ultrasonic therapy device through doctor APP to send the control parameter of this customization to the server, the server forwards patient APP with the control parameter that doctor formulated, and rethread patient APP forwards to ultrasonic therapy device. The control parameters may include an ultrasonic power parameter of the ultrasonic treatment head, a start time of the ultrasonic treatment head, a start frequency of the ultrasonic treatment head, and the like.
When the image information comprises the target part, the control parameters corresponding to the ultrasonic treatment device are matched according to the image information of the target part and the acquired environment information, and are sent to the patient end, the ultrasonic treatment device is controlled by the patient end to work with the control parameters, the ultrasonic treatment device does not need to be manually replaced, in addition, the corresponding control parameters are matched according to the tissue medium of the target part and the environment condition of the target part by identifying the target part and the environment information, and the control accuracy of the ultrasonic treatment device can be improved.
Referring to fig. 2, fig. 2 is a flowchart of a control method of an ultrasonic treatment apparatus according to an embodiment of the present invention, as shown in fig. 2, the control method of the ultrasonic treatment apparatus includes:
S201, receiving acquisition information sent by a patient end, wherein the acquisition information comprises image information and environment information.
In the embodiment of the invention, the control method of the ultrasonic treatment device is applied to the server, and the image information of the wearing area of the patient can be acquired through an image acquisition module, wherein the image acquisition module can be arranged in the ultrasonic treatment device or on an ultrasonic treatment head and is used for photographing the wearing area of the patient.
The image acquisition module can be the combination of an infrared camera and a common RGB camera, so that the RGB image of the human body is shot, and meanwhile, the infrared image of the human body is shot.
The infrared image reflects the heat radiation of the human body, and thus can be used to represent the body temperature information of the human body.
The above-mentioned ultrasonic therapy device wears in the region that human pelvic floor muscle is located, and the wearing area that above-mentioned image acquisition module mainly shooted can be the region that pelvic floor muscle is located, and above-mentioned wearing area can be the human body area that lower part of the lower abdomen position, pubic bone position, perineum position, anus position, penis etc. position corresponds.
Further, a light module is further arranged in the ultrasonic treatment device, after the ultrasonic treatment device is worn, the light module is turned on, and the wearing area is irradiated with a certain light intensity, so that the image acquisition module shoots a clear information image.
Above-mentioned environmental information of patient wearing region can acquire through the environmental collection module, and the environmental collection module can set up in ultrasonic therapy device, also can set up on ultrasonic therapy head for carry out environmental information acquisition to patient's wearing region.
The ultrasonic therapy device is a wearable device, and after the ultrasonic therapy device is worn, a gap space between the ultrasonic therapy device and the target site is formed, the gap space is the environment of the target site, and the environmental information refers to the information of the gap space.
The ultrasonic treatment device sends the acquired image information and environment information of the wearing area to the patient end, the patient end comprises a first encryption module and a second data transmission module, the patient end carries out first encryption on the image information and the environment information of the wearing area through the first encryption module to obtain encrypted data, and the encrypted data is sent to the server end through the second data transmission module.
The server receives the encrypted data, decrypts the encrypted data, and obtains image information and environment information of the wearing area.
Furthermore, the encryption mode may be asymmetric encryption, and the patient side includes a patient side public key and a patient side private key, where the patient side public key and the patient side private key are obtained according to medical record information associated with the patient side.
Specifically, feature extraction is performed on medical record information associated with a patient end, a feature vector corresponding to the medical record information of the patient end is obtained, the feature vector is used as a filter, an inverse filter is generated according to the feature vector, the inverse filter can restore content filtered by the filter, the filter is used as a public key of the patient end, and the inverse filter is used as a private key of the patient end. The server stores feature extraction modes corresponding to different medical record information.
The patient side carries out first encryption on the image information and the environment information of the wearing area through a patient side public key in the first encryption module to obtain encrypted data, and the encrypted data is sent to the server side through the second data transmission module. The server side matches the corresponding feature extraction mode according to the medical record information of the patient side, performs feature extraction on the medical record information of the patient side through the matched feature extraction mode to obtain a feature vector corresponding to the medical record information of the patient side, generates an inverse filter according to the feature vector, and decrypts the encrypted data through the inverse filter to obtain image information and environment information of the wearing area. In this way, the security of data transmission can be ensured.
And S202, performing target detection on the image information, and matching control parameters corresponding to the ultrasonic treatment device according to the image information and the environment information of the target part when the image information comprises the target part.
In the embodiment of the invention, the target part is determined through medical record information associated with the patient side. Each patient side is associated with medical record information of a corresponding patient.
Furthermore, the medical record information of the patient can be provided by a doctor, specifically, the doctor can provide an electronic medical record list, and the medical record information of the patient can also be provided by the patient, for example, the patient provides own medical record card. The medical record information includes diagnosis and treatment opinion fields which are presented by a doctor after diagnosis according to examination information of a patient and recorded in the medical record information. For example, the patient is Zhang San, the examination information is prostatitis, and the doctor gives the diagnosis and treatment opinion that ultrasonic treatment is applied to the perineum of the patient. "
The medical record information includes corresponding position keywords, for example, in the diagnosis and treatment opinion field, the position keywords are perineum positions in the process of applying ultrasonic treatment to the perineum positions of patients. For example, in the diagnosis and treatment opinion field, the position keywords are the penis shaft and the penis foot by applying ultrasonic treatment to the penis shaft and the penis foot.
The image information may include an RGB image of the wearing part, and the RGB image is subject to object detection to detect whether the RGB image includes the target part.
If the image information includes a location corresponding to a keyword in medical record information, the location can be confirmed as a target location. For example, if the keyword in the medical record information is a perineum and the image information includes a perineum part (the image includes a perineum part through target detection), the perineum can be confirmed as the target part. The medical record information contains a penis as a key word, and the image information contains a penis part (the penis part is contained in the image through target detection), so that the penis can be confirmed as the target part.
If the part information does not have the part corresponding to the keyword in the medical record information, a doctor can be prompted, for example, the doctor is required to confirm whether the medical record information is complete or not or to take a picture again on the patient if the doctor does not match the diagnosis and treatment part in the medical record information. Or may prompt the patient, such as "please adjust the position of the ultrasound therapy device.
After the image information is determined to include the target part, the image information corresponding to the target part can be extracted, and the image information of the target part can be obtained. Image information of the target portion may be extracted from the image of the wearing region by an image segmentation technique.
The image information of the wearing area comprises an RGB image of the wearing area and an infrared image of the wearing area, and after the RGB image is determined to comprise the target part, temperature information corresponding to the target part can be extracted according to the infrared image.
The degree of attenuation of the ultrasonic wave is related to factors such as the frequency of the acoustic wave, the propagation distance, the structural characteristics of the propagation medium, and the temperature, wherein the propagation distance can be determined by the ultrasonic treatment head according to different parts, and the ultrasonic treatment head generally generates the ultrasonic wave by being attached to the part to be treated. The tissue structures of all the parts are different, for example, the tissue structure of the penis is a cavernous body, the pelvic cavity part is a pelvic bone structure, and the different structures are the medium for transmitting ultrasonic waves, and the ultrasonic waves are transmitted in different media and attenuated. In addition, the degree of attenuation of the ultrasonic wave during the propagation of the ultrasonic wave is also affected by the temperature, the speed of sound of the ultrasonic wave increases with the increase of the differential temperature, and the degree of attenuation of the ultrasonic wave decreases with the increase of the temperature.
Through the target part, the corresponding tissue structure can be determined, and the medium for transmitting ultrasonic waves can be determined. By combining the temperature information of the target part with the tissue structure of the target part, the corresponding ultrasonic parameters can be designed so that the attenuation degree of the ultrasonic wave is minimum in the ultrasonic wave propagation process. Of course, the ultrasonic parameters may be designed in advance.
Meanwhile, the embodiment of the invention also considers the environment information of the wearing area, and combines the tissue structure of the target part, the temperature of the target part and the environment information of the target part to match the control parameters of the ultrasonic treatment device.
The control parameters of the ultrasonic treatment device comprise ultrasonic power parameters.
Further, the above-mentioned ultrasonic power parameters are designed in advance. The designer designs the corresponding ultrasonic power parameters according to the tissue structure of different target positions, the temperature of the target positions and the environmental information of the target positions, so that the designed ultrasonic power parameters can be directly used under the same tissue structure of the target positions, the temperature of the target positions and the environmental information of the target positions.
For example, when treating the prostate, for a patient whose target site is the perineum, the temperature of the perineum is 37.5 degrees, the ambient temperature of the perineum is 37 degrees, by calculating that when using the ultrasonic power parameter a, the degree of ultrasonic attenuation is minimum, the ultrasonic power parameter a can be used as a parameter template, and when the patient next encounters the patient whose target site is the perineum, the temperature of the perineum is 37.5 degrees, and the ambient temperature of the perineum is 37 degrees, the ultrasonic power parameter a can be matched as the ultrasonic power parameter for the ultrasonic treatment.
For example, when treating impotence, the target site is the penis, the temperature of the penis is 38 degrees, the ambient temperature of the penis is 37.6 degrees, by calculation, when using the ultrasonic power parameter B, the ultrasonic attenuation degree is minimum, the ultrasonic power parameter B can be used as a parameter template, and when the patient next encounters the target site, the temperature of the penis is 38 degrees, the ambient temperature of the penis is 37.6 degrees, the ultrasonic power parameter B can be matched as the ultrasonic power parameter for the ultrasonic treatment.
And S203, the control parameters are sent to the patient end, so that the patient end controls the ultrasonic treatment device according to the control parameters.
In an embodiment of the invention, the ultrasound therapy device comprises at least one ultrasound therapy head. The control parameters of the ultrasonic treatment device comprise ultrasonic power parameters.
In the ultrasonic treatment head, the ultrasonic transducer generates corresponding ultrasonic waves according to set ultrasonic parameters, and the ultrasonic waves enable the inflamed part and surrounding normal tissues to generate non-broken instant quasi-cavitation states, so that the permeability of microcirculation of the tissues is enhanced, and further the liquid inflamed tissues can be promoted to diffuse to the surrounding tissues until the absorption capacity of the human normal tissues to inflammation exceeds the capacity of the inflamed tissues, and the aggregation and development of the inflamed tissues of the inflamed lesion part are restrained.
Further, the server side comprises a second encryption module and a third data transmission module, after the server side is matched with the control parameters corresponding to the ultrasonic treatment device, the second encryption module is used for carrying out second encryption on the control parameters to obtain encrypted control parameters, the encrypted control parameters are sent to the patient side, the patient side decrypts the encrypted control parameters to obtain the control parameters corresponding to the ultrasonic treatment device, the patient side converts the control parameters corresponding to the ultrasonic treatment device into control instructions corresponding to the ultrasonic treatment device and sends the control instructions to the ultrasonic treatment device, the ultrasonic treatment head is subjected to ultrasonic power parameter adjustment through the control instructions, and the control instructions comprise ultrasonic power parameters.
And in the second encryption, the patient-side public key is adopted for encryption, and after the patient receives the encrypted control parameters, the patient-side private key is adopted for decryption. The public key and the private key of the patient end are generated through medical record information of the patient, so that the safety of the data transmission process is improved.
After receiving the ultrasonic power parameter, the ultrasonic treatment device transmits the ultrasonic power parameter to an ultrasonic transducer in an ultrasonic treatment head, and the ultrasonic transducer generates corresponding ultrasonic waves according to the ultrasonic power parameter.
In the embodiment of the invention, the acquisition information sent by the patient end is received, the acquisition information comprises image information and environment information, the image information is subjected to target detection, when the image information comprises a target position, the control parameter corresponding to the ultrasonic treatment device is matched according to the image information of the target position and the environment information, the target position is determined through medical record information associated with the patient end, and the control parameter is sent to the patient end so that the patient end can control the ultrasonic treatment device according to the control parameter. When the image information comprises the target part, the control parameters corresponding to the ultrasonic treatment device are matched according to the image information of the target part and the acquired environment information, and are sent to the patient end, the ultrasonic treatment device is controlled by the patient end to work with the control parameters, the ultrasonic treatment device does not need to be manually replaced, in addition, the corresponding control parameters are matched according to the tissue medium of the target part and the environment condition of the target part by identifying the target part and the environment information, and the control accuracy of the ultrasonic treatment device can be improved.
Optionally, before the step of performing target detection on the image information, medical record information associated with the patient end can be obtained, semantic analysis is performed on the medical record information to obtain semantic features of the medical record information, and a target position is determined according to the semantic features.
In the embodiment of the invention, the semantic analysis can be understood as extracting the character strings in the medical record information, and analyzing the semantics contained in the medical record information through the character strings. In some medical record information, keywords corresponding to a target part, such as "cavernous body is damaged and cavernous body repair treatment is suggested," such as "deferens varicose, inflammation symptoms are found," and no keywords of the penis exist, but the semantics of the keywords are the penis part to be treated, so that the target part can be determined through semantic analysis, and the target part can be determined from the medical record information more accurately.
Optionally, before the step of performing target detection on the image information, a first sample image data set and a second sample image data set may be further constructed, where the first sample image data set includes a sample image and labels of target locations, the sample image includes the target locations, the second sample image data set includes target sample images of target personnel corresponding to medical record information and labels of the target locations, the target sample image includes the target locations, a target detection model based on a convolutional neural network is constructed, the first sample image data set is used for performing a first training on the target detection model to obtain a primarily trained target detection model, the second sample image data set is used for performing a second training on the primarily trained target detection model to obtain a final trained target detection model, and the final trained target detection model is used for performing target detection on the image information.
In the embodiment of the invention, the sample image can comprise image information of each part of the human body, and the image information of each part of the human body has corresponding marks, for example, the sample image comprises the parts such as perineum, penis, anus and the like, and the corresponding marks are corresponding mark values of the perineum, penis, anus and the like.
The sample images in the first sample image data set include the human body images of different persons under the big data, and the sample images in the second sample image data set are sampled in the human body images of different persons under the big data, and at the same time, the human body images of the target person (patient) are also required to be included.
The target detection model is subjected to first training through the first sample image data set to obtain a preliminarily trained target detection model, and the preliminarily trained target detection model is strong in generalization capability and can be used for target detection of most people. In the embodiment of the invention, the primarily trained target detection model is subjected to the second training through the second sample image data set containing the sample image of the target person, and the primarily trained target detection model can be subjected to the second training in a targeted manner, so that the target part detection accuracy of the target person is improved. Because the diseases of men often need long-time treatment, the pertinence of the target detection model to the target personnel can be enhanced through the second training, so that the target part detection accuracy of the target personnel is improved.
Optionally, when the image information includes the target portion, in the step of matching the control parameter corresponding to the ultrasonic treatment device according to the image information and the environmental information of the target portion, the image information of the target portion may be extracted when the image information includes the target portion, the state feature of the target portion may be extracted according to the image information of the target portion, the state feature may include at least one of a size feature and a temperature feature, and the control parameter corresponding to the ultrasonic treatment device may be matched according to the state feature and the environmental information.
In the embodiment of the invention, the image information of the wearing area includes an RGB image of the wearing area, or the image information of the wearing area includes an RGB image of the wearing area and an infrared image of the wearing area, whether the wearing area includes a target portion is determined by the RGB image of the wearing area, if the wearing area includes the target portion, the image information of the target portion is extracted, and the size feature of the target portion is extracted according to the image information of the target portion. If the wearing area image information further includes the target part included in the determined RGB image, temperature information corresponding to the target part may be extracted according to the infrared image.
The dimensional characteristics correspond to the tissue structure of the target region, and the temperature characteristics correspond to the temperature of the target region.
Specifically, whether the tissue structure of the target portion changes can be determined by the size characteristics of the target portion, whether the temperature of the target portion changes can be determined by the temperature characteristics of the target portion, if the size characteristics of the target portion change, it can be determined that the tissue structure of the target portion changes to some extent, for example, congestion, swelling, water accumulation, inflammation and other changes can cause the tissue structure of the target portion to change, and the ultrasonic wave propagation can be affected. If the temperature characteristics of the target portion change, it can be determined that the temperature of the target portion changes to some extent, and the ultrasonic wave propagation is also affected.
Therefore, the control parameters corresponding to the ultrasonic treatment device are matched with the state characteristics and the environment information of the target part more accurately, so that the control accuracy of the ultrasonic treatment device is improved.
Optionally, the target portion is a penis portion, the environmental information includes an environmental temperature and an environmental humidity, in the step of matching control parameters corresponding to the ultrasonic treatment device according to the state characteristics and the environmental information, whether the penis portion is in an erection state or not may be determined according to at least one of the size characteristics and the temperature characteristics, if the penis portion is in a non-erection state, the first control parameters corresponding to the ultrasonic treatment device are matched according to the environmental temperature and the environmental humidity, and if the penis portion is in an erection state, the second control parameters corresponding to the ultrasonic treatment device are matched according to the environmental temperature and the environmental humidity, and the second control parameters are adjusted according to at least one of the size characteristics and the temperature characteristics, so as to obtain the third control parameters.
In the embodiment of the invention, the penis part has different shapes and temperatures in the erection state and the non-erection state, so that different control parameters can be matched for the penis part in the erection state and the penis part in the non-erection state, thereby further improving the control accuracy of the ultrasonic treatment device.
In the embodiment of the invention, the ultrasonic treatment head can be a non-contact ultrasonic treatment head, namely the ultrasonic treatment head does not contact the penis, so that more space can be provided when the shape and the size of the penis are changed, and the penis in an erection state is prevented from being pressed. Therefore, a certain gap space exists between the ultrasonic treatment device and the penis part, the ultrasonic wave transmission is also influenced by the medium and the temperature of the gap space, the medium of the gap space is influenced by the ambient temperature, and the temperature of the gap space is the ambient temperature. The environment collection module can comprise a temperature sensor and a humidity sensor, wherein the temperature sensor is used for collecting the environment temperature, and the humidity sensor is used for collecting the environment humidity.
Further, the second control parameter corresponding to the ultrasonic treatment device may be first matched according to the temperature of the penis portion and the penis portion, the ambient temperature, the ambient humidity. And then adjusting the second control parameter according to the penis size characteristic and the temperature characteristic to obtain a third control parameter.
Or determining the tissue structure of the penis part according to the size characteristics of the penis part, and determining the temperature of the penis part according to the temperature characteristics of the penis part, so as to directly determine the third control parameter according to the tissue structure of the penis part, the temperature of the penis part, the ambient temperature and the ambient humidity.
Wherein the first control parameter or the third control parameter is used as the control parameter corresponding to the ultrasonic treatment device.
Optionally, the ultrasonic treatment device comprises ultrasonic treatment heads arranged on different points, in the step of matching the second control parameters corresponding to the ultrasonic treatment device according to the ambient temperature and the ambient humidity if the penis part is in an erection state, SIFT feature extraction can be performed according to image information of the penis part to obtain SIFT feature points of the penis part, gesture estimation is performed on the penis part according to the SIFT feature points of the penis part to obtain gesture information of the penis part, the point position control parameters of the ultrasonic treatment head are matched according to the gesture information of the penis part, the power control parameters of the ultrasonic treatment head are matched according to the ambient temperature and the ambient humidity, and the second control parameters corresponding to the ultrasonic treatment device are obtained according to the point position control parameters and the power control parameters.
In the embodiment of the invention, when the penis part is in an erection state, some ultrasonic treatment heads can be shielded, so that SIFT feature points of the penis part can be extracted, and the posture of the penis part is estimated through the SIFT feature points of the penis part to obtain posture information of the penis part, wherein the posture information can comprise erection length, erection angle, erection coarseness and the like.
Judging whether the ultrasonic treatment head is blocked or not according to the posture information of the penis part, and if the ultrasonic treatment head with the blocked point position exists, controlling the ultrasonic treatment head corresponding to the point position to stop working or adjusting the power control parameter of the ultrasonic treatment head corresponding to the point position. For example, because the patient erects, the patient's penis contacts the ultrasonic treatment head E, and the situation that no environmental factor is influenced between the ultrasonic treatment head E and the penis can be known, so that the point position control parameter is E, and the power control parameter is matched under the condition of not considering environmental information.
The SIFT feature is a point of interest based on some local appearance on the penis site, independent of the size and rotation of the acquired image. The tolerance to light, noise, micro-viewing angle changes is also quite high. Therefore, the SIFT feature is adopted to estimate the posture of the penis part, so that more accurate posture information of the penis part can be mentioned.
In the embodiment of the invention, the target part is identified through the acquired image information, when the image information comprises the target part, the control parameters corresponding to the ultrasonic treatment device are matched according to the image information of the target part and the acquired environment information and are sent to the patient end, the ultrasonic treatment device is controlled by the patient end to work with the control parameters, the ultrasonic treatment device does not need to be manually replaced, in addition, the control accuracy of the ultrasonic treatment device can be improved by identifying the target part and the environment information and matching the corresponding control parameters according to the tissue medium of the target part and the environment condition of the target part.
Optionally, after matching the corresponding control parameters, the control parameters can be sent to a display device at the doctor end for display so as to enable the doctor to observe and finely tune the control parameters, after receiving a fine tuning instruction of the doctor on the control parameters, the control parameters are modified to obtain modified control parameters, the modified control parameters are sent to the server end and forwarded to the patient end through the server end, and accordingly the ultrasonic treatment device generates corresponding ultrasonic waves according to the modified control parameters.
The fine adjustment may be performed by inputting a numerical value or by speech recognition. Preferably, voice recognition can be used to fine tune the ultrasonic power parameters, since the physician needs to wear sterile gloves. For example, if the doctor says "decrease frequency to xxx", the doctor adjusts the frequency in the ultrasonic power parameter so that the frequency in the ultrasonic power parameter is adjusted to xxx.
Therefore, doctors can flexibly modify the ultrasonic power parameters to ensure the quality of ultrasonic waves, and the ultrasonic power parameter correction device can be suitable for more medical scenes.
Referring to fig. 3, fig. 3 is a block diagram of a control device of an ultrasonic therapeutic apparatus according to an embodiment of the present invention, where the ultrasonic therapeutic apparatus is connected to a patient end through signals, and as shown in fig. 3, the control device of the ultrasonic therapeutic apparatus includes:
The receiving module 301 is configured to receive acquisition information sent by the patient side, where the acquisition information includes image information and environmental information;
the processing module 302 is configured to perform target detection on the image information, and when it is detected that the image information includes a target portion, match control parameters corresponding to the ultrasound treatment device according to the image information and the environmental information of the target portion, where the target portion is determined by medical record information associated with the patient end;
And the sending module 303 is configured to send the control parameter to the patient end, so that the patient end controls the ultrasound therapeutic apparatus according to the control parameter.
Optionally, the apparatus further includes:
the acquisition module is used for acquiring medical record information associated with the patient end;
the semantic analysis module is used for carrying out semantic analysis on the medical record information to obtain semantic features of the medical record information;
And the determining module is used for determining the target part according to the semantic features.
Optionally, the apparatus further includes:
The first construction module is used for constructing a first sample image data set and a second sample image data set, wherein the first sample image data set comprises a sample image and a label of the target part, the sample image comprises the target part, the second sample image data set comprises a target sample image of a target person corresponding to medical record information and the label of the target part, and the target sample image comprises the target part;
The second construction module is used for constructing a target detection model based on the convolutional neural network;
The first training module is used for carrying out first training on the target detection model through the first sample image data set to obtain a preliminarily trained target detection model;
the second training module is used for carrying out second training on the preliminarily trained target detection model through the second sample image data set to obtain a final trained target detection model;
The final trained target detection model is used for carrying out target detection on the image information.
Optionally, the processing module 302 is further configured to extract image information of a target location when the image information includes the target location, extract a status feature of the target location according to the image information of the target location, where the status feature includes at least one of a size feature and a temperature feature, and match a control parameter corresponding to the ultrasound therapy device according to the status feature and the environmental information.
Optionally, the target portion is a penis portion, the environmental information includes an environmental temperature and an environmental humidity, and the processing module 302 is further configured to determine whether the penis portion is in an erection state according to at least one of the size feature and the temperature feature, match a first control parameter corresponding to the ultrasonic therapy device according to the environmental temperature and the environmental humidity if the penis portion is in a non-erection state, match a second control parameter corresponding to the ultrasonic therapy device according to the environmental temperature and the environmental humidity if the penis portion is in an erection state, and adjust the second control parameter according to at least one of the size feature and the temperature feature to obtain a third control parameter.
Optionally, the ultrasonic treatment device comprises ultrasonic treatment heads arranged on different points, the processing module 302 is further configured to extract SIFT features according to image information of the penis part if the penis part is in an erection state, obtain SIFT feature points of the penis part, estimate the pose of the penis part according to the SIFT feature points of the penis part, obtain pose information of the penis part, match point position control parameters of the ultrasonic treatment heads according to the pose information of the penis part, match power control parameters of the ultrasonic treatment heads according to the environmental temperature and the environmental humidity, and obtain second control parameters corresponding to the ultrasonic treatment device according to the point position control parameters and the power control parameters.
The embodiment of the invention provides electronic equipment, which comprises a memory, a processor and a computer program stored in the memory and capable of running on the processor, wherein the processor realizes the steps in the control method of the ultrasonic treatment device provided by the embodiment of the invention when executing the computer program.
An embodiment of the present invention provides a computer-readable storage medium having a computer program stored thereon, which when executed by a processor, implements steps in a control method of an ultrasound therapy device provided by the embodiment of the present invention.
It should be noted that, for simplicity of description, the foregoing method embodiments are all described as a series of acts, but it should be understood by those skilled in the art that the present invention is not limited by the order of acts described, as some steps may be performed in other orders or concurrently in accordance with the present invention. Further, those skilled in the art will also appreciate that the embodiments described in the specification are alternative embodiments, and that the acts and modules referred to are not necessarily required for the present invention.
In the foregoing embodiments, the descriptions of the embodiments are emphasized, and for parts of one embodiment that are not described in detail, reference may be made to related descriptions of other embodiments.
In the several embodiments provided by the present invention, it should be understood that the disclosed apparatus may be implemented in other manners. For example, the device embodiments described above are merely illustrative
In addition, the processor and the chip in the embodiments of the present invention may be integrated in one processing unit, or may exist alone physically, or two or more pieces of hardware may be integrated in one unit. The computer readable storage medium or the computer readable program may be stored in a computer readable memory. Based on this understanding, the technical solution of the present invention may be embodied essentially or partly in the form of a software product, or all or part of the technical solution, which is stored in a memory, and includes several instructions for causing a computer device (which may be a personal computer, a server, a network device, or the like) to perform all or part of the steps of the method according to the embodiments of the present invention. The Memory includes a U disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a removable hard disk, a magnetic disk, or an optical disk, etc. which can store the program codes.
Those of ordinary skill in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be implemented by a program to instruct related hardware, where the program may be stored in a computer readable Memory, and the Memory may include a flash disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a magnetic disk or an optical disk, etc.
The foregoing is a further detailed description of the invention in connection with specific preferred embodiments, and it is not intended that the invention be limited to these descriptions. It will be apparent to those skilled in the art that several simple deductions or substitutions may be made without departing from the spirit of the invention, and these should be considered to be within the scope of the invention.