Movatterモバイル変換


[0]ホーム

URL:


CN111415727A - Multi-mode image data management system and analysis method - Google Patents

Multi-mode image data management system and analysis method
Download PDF

Info

Publication number
CN111415727A
CN111415727ACN202010177977.6ACN202010177977ACN111415727ACN 111415727 ACN111415727 ACN 111415727ACN 202010177977 ACN202010177977 ACN 202010177977ACN 111415727 ACN111415727 ACN 111415727A
Authority
CN
China
Prior art keywords
module
image
patient
image data
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010177977.6A
Other languages
Chinese (zh)
Inventor
张国前
张书旭
谭剑明
王锐濠
雷怀宇
王琳婧
李萍
曾庆星
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Cancer Center of Guangzhou Medical University
Original Assignee
Cancer Center of Guangzhou Medical University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Cancer Center of Guangzhou Medical UniversityfiledCriticalCancer Center of Guangzhou Medical University
Priority to CN202010177977.6ApriorityCriticalpatent/CN111415727A/en
Publication of CN111415727ApublicationCriticalpatent/CN111415727A/en
Pendinglegal-statusCriticalCurrent

Links

Images

Classifications

Landscapes

Abstract

Translated fromChinese

本发明适用于医疗多模态影像技术领域,提供了一种多模态影像数据管理系统及分析方法,包括用于对患者体内进行多模态影像拍摄的影像拍摄模块,还包括影像数据库、存储模块和对比模块,所述影像数据库和存储模块均与所述对比模块数据连接;影像拍摄模块将对患者进行拍摄所形成的多模态影像数据发送至影像数据库的内部进行存储,随之根据患者的多模态影像数据将其转化为患者体内的三维视图,并发送至对比模块内部,对比模块调取存储模块内部所存储的常人体内结构图与患者之前所拍摄的患者体内三维视图进行对比,并将对比的结果进行发送显示,供医护人员审查和观看,进而避免了医护人员单独的肉眼识别,并充分减少患者的眼部疲劳。

Figure 202010177977

The invention is applicable to the technical field of medical multi-modal imaging, and provides a multi-modal image data management system and an analysis method, including an image shooting module for shooting multi-modal images inside a patient, and further comprising an image database, storage module and a comparison module, both the image database and the storage module are connected to the comparison module; the image capture module will send the multimodal image data formed by shooting the patient to the interior of the image database for storage, and then according to the patient The multimodal image data is converted into a three-dimensional view of the patient's body, and sent to the comparison module. The comparison results are sent and displayed for the medical staff to review and watch, thereby avoiding the medical staff's separate visual identification and fully reducing the patient's eye fatigue.

Figure 202010177977

Description

Translated fromChinese
一种多模态影像数据管理系统及分析方法A multimodal image data management system and analysis method

技术领域technical field

本发明属于医疗多模态影像技术领域,尤其涉及一种多模态影像数据管理系统及分析方法。The invention belongs to the technical field of medical multimodal imaging, and in particular relates to a multimodal imaging data management system and an analysis method.

背景技术Background technique

医学成像技术为临床诊断提供了多种模态的医学影像,如X射线成像、CT(计算机X线断层扫描)、MRI(核磁共振成像)、PET(正子发射层扫描)、医学超声波检查、血管摄像、心血管照影等,医学影像及报告数据是包括上述各类医学检查生成的图像及报告数据;有时候影像数据提示患者某些病变还需要进行病理学检查,此时对这些影像及报告数据还会有相对应的病理报告数据Medical imaging technology provides a variety of modalities of medical imaging for clinical diagnosis, such as X-ray imaging, CT (computed tomography), MRI (magnetic resonance imaging), PET (positron emission tomography), medical ultrasound, blood vessels Videography, cardiovascular imaging, etc. Medical imaging and report data include the images and report data generated by the above-mentioned various medical examinations; sometimes the imaging data indicates that some lesions of the patient require pathological examination. The data will also have corresponding pathological report data

目前医护人员大多利用患者体内的多模态影像观察患者体内的情况,而单纯用肉眼对影像以及图像的观察易使得医护人员出现眼部疲劳的问题,进而影像医护人员的后续工作。At present, most medical staff use multi-modal images in the patient to observe the situation in the patient's body, and simply observing the images and images with the naked eye can easily lead to the problem of eye fatigue for medical staff, and then image the follow-up work of medical staff.

发明内容SUMMARY OF THE INVENTION

本发明提供一种多模态影像数据管理系统及分析方法,旨在解决目前医护人员大多利用患者体内的多模态影像观察患者体内的情况,而单纯用肉眼对影像以及图像的观察易使得医护人员出现眼部疲劳的问题,进而影像医护人员的后续工作问题。The present invention provides a multi-modal image data management system and an analysis method, aiming at solving the problem that most medical staff use the multi-modal images in the patient's body to observe the situation in the patient's body. The problem of eye fatigue occurs in the personnel, and then the follow-up work of the imaging medical staff is problematic.

本发明是这样实现的,一种多模态影像数据管理系统,包括用于对患者体内进行多模态影像拍摄的影像拍摄模块,还包括影像数据库、存储模块、对比模块和图像处理模块,所述影像数据库和存储模块均与所述对比模块数据连接,所述影像拍摄模块与所述影像数据库的输入端相连接,所述影像拍摄模块将其拍摄的多模态影像数据发送至所述影像数据库的内部进行存储,所述影像数据库根据多模态影像数据模拟人体内部的三维视图,并通过所述对比模块对比所述影像数据库与存储模块内部所存储的人体三位影像,所述图像处理模块与影像数据库相连接,所述图像处理模块根据确定后的患者病历资料将其病历特征标注到影像数据之中,并同步添加影像数据的同步索引关键词,并发送至存储模块的内部进行存储。The present invention is realized in this way, a multi-modal image data management system includes an image capturing module for shooting multi-modal images in a patient, and also includes an image database, a storage module, a comparison module and an image processing module, so The image database and the storage module are both data-connected to the comparison module, the image capture module is connected to the input end of the image database, and the image capture module sends the multi-modal image data captured by the image capture module to the image The interior of the database is stored, and the image database simulates a three-dimensional view of the inside of the human body according to the multimodal image data, and compares the image database with the three-dimensional images of the human body stored in the storage module through the comparison module. The module is connected with the image database, and the image processing module marks the patient's medical record characteristics into the image data according to the determined patient medical record data, and synchronously adds the synchronous index keyword of the image data, and sends it to the interior of the storage module for storage. .

优选的,还包括成像模块,所述成像模块包括分解模块和印记模块,所述分解模块对患者拍摄的影像数据进行肢体化的分解,并利用所述印记模块对分解图像中的关节部分进行标注,所述成像模块的输入端和输出端分别与所述影像拍摄模块和影像数据库相连接,用于对所述影像拍摄模块拍摄影像的图像化。Preferably, it also includes an imaging module, the imaging module includes a decomposition module and an imprinting module, the decomposing module decomposes the image data captured by the patient into limbs, and uses the imprinting module to mark the joint parts in the decomposed images , the input end and the output end of the imaging module are respectively connected with the image capturing module and the image database, and are used to image the images captured by the image capturing module.

优选的,所述影像数据库包括分类模块、标识模块和三维模块,所述分类模块用于对多模态影像数据的分类处理,所述标识模块用于对患者体内影像以及图像中重要器官的标识,所述三维模块与所述对比模块相连接,用于对患者体内三维视图的规划以及发送。Preferably, the image database includes a classification module, an identification module and a three-dimensional module, the classification module is used for classifying and processing multimodal image data, and the identification module is used for in vivo images of patients and identification of important organs in the images , the three-dimensional module is connected with the comparison module, and is used for planning and sending the three-dimensional view of the patient's body.

优选的,所述分类模块对影像数据的分类可依据影像中所拍摄的对象以及影像的内容。Preferably, the classification module can classify the image data according to the object captured in the image and the content of the image.

优选的,所述存储模块内部所存储的数据包括患者的病理报告、患者之前所拍摄形成的体内三维视图以及常人体内三维视图Preferably, the data stored in the storage module includes the pathological report of the patient, the in-vivo three-dimensional view captured by the patient before, and the normal human in-vivo three-dimensional view.

优选的,所述图像处理模块包括结构子模块、扫描装置、匹配子单元和调度单元,所述调度单元调取存储模块内部所存储的病例资料,并利用扫描装置扫描医护人员最终所确定的病例报告,结构子模块与影像数据库相连接,调取影像数据库内所存储影像数据,并发送至匹配子单元内部,匹配子单元根据两病例资料对医疗影像进行医疗特征标注,并同步添加医疗特征的索引关键词存储至存储模块内部。Preferably, the image processing module includes a structural sub-module, a scanning device, a matching sub-unit and a scheduling unit, and the scheduling unit retrieves the case data stored in the storage module, and uses the scanning device to scan the cases finally determined by the medical staff In the report, the structure sub-module is connected with the image database, and the image data stored in the image database is retrieved and sent to the matching sub-unit. The index key is stored in the storage module.

优选的,还包括显示模块,所述对比模块与显示模块相连接,用于接收所述对比模块对比出的区别特征,并进行显示。Preferably, it also includes a display module, the comparison module is connected with the display module, and is used for receiving and displaying the distinguishing features compared by the comparison module.

一种多模态影像数据管理分析方法,包括如下步骤:A multimodal image data management and analysis method, comprising the following steps:

步骤S10:进行患者体内的多模态影像拍摄,并对成像进行分解和印记标注;Step S10: photographing multi-modal images in the patient's body, and decomposing and marking the images;

步骤S20:对形成的多模态影像数据进行存储;Step S20: storing the formed multimodal image data;

步骤S30:对影像数据中的患者体内重要器官部位进行标记;Step S30: marking the vital organs of the patient in the image data;

步骤S40:将标号的患者体内影像数据与原始影像数据和标椎影像数据进行对比;Step S40: comparing the labeled patient in-vivo image data with the original image data and the marked vertebrae image data;

步骤S50:对比得出影像数据之间的区别。Step S50: Compare and obtain the difference between the image data.

优选的,还包括如下步骤:Preferably, it also includes the following steps:

步骤S60:发送到显示模块内部进行显示;Step S60: sending to the display module for display;

步骤S70:确定患者的病例资料后将其病例资料扫描并匹配到该患者对应的图像数据之中,并索引存储。。Step S70: After determining the patient's case data, scan and match the patient's case data into the image data corresponding to the patient, and store the data in an index. .

优选的,所述步骤S60中,将对比区别的数据进行发送显示的同时,将患者的病历资料进行同步发送。Preferably, in the step S60, the data of the patient's medical records are simultaneously sent while the compared and differentiated data are sent and displayed.

与现有技术相比,本发明的有益效果是:本发明的一种多模态影像数据管理系统及分析方法,通过设置影像拍摄模块、影像数据库、存储模块以及对比模块,在使用的过程中,影像拍摄模块将对患者进行拍摄所形成的多模态影像数据发送至影像数据库的内部进行存储,随之根据患者的多模态影像数据将其转化为患者体内的三维视图,并发送至对比模块内部,对比模块调取存储模块内部所存储的常人体内结构图与患者之前所拍摄的患者体内三维视图进行对比,并将对比的结果进行发送显示,供医护人员审查和观看,进而避免了医护人员单独的肉眼识别,并充分减少患者的眼部疲劳,其次,在图像处理模块的作作用下,可以对医疗影像数据进行进一步的标注,且同步索引关键词的设置,可以更加方便对医护人员对相同症状患者影像数据的调取。Compared with the prior art, the beneficial effects of the present invention are: a multi-modal image data management system and analysis method of the present invention, by setting the image shooting module, the image database, the storage module and the comparison module, in the process of use , the image capturing module will send the multi-modal image data formed by the patient to the image database for storage, and then convert it into a three-dimensional view of the patient's body according to the patient's multi-modal image data, and send it to the comparison. Inside the module, the comparison module retrieves the internal structure diagram of the normal human body stored in the storage module and compares it with the three-dimensional view of the patient's body taken by the patient before, and sends the comparison results to be displayed for the medical staff to review and watch, thus avoiding the need for medical care. Personnel can be identified by naked eyes alone, and the eye fatigue of patients can be fully reduced. Secondly, under the action of the image processing module, medical image data can be further marked, and the setting of synchronous index keywords can be more convenient for medical staff. The retrieval of image data of patients with the same symptoms.

附图说明Description of drawings

图1为本发明的系统结构示意图;Fig. 1 is the system structure schematic diagram of the present invention;

图2为本发明中的方法流程示意图;Fig. 2 is the schematic flow chart of the method in the present invention;

图中:1、影像拍摄模块;2、成像模块;21、分解模块;22、印记模块;3、影像数据库;31、分类模块;32、标识模块;33、三维模块;4、存储模块;5、对比模块;6、显示模块;7、图像处理模块;71、结构子模块;72、扫描装置;73、匹配子单元;74、调度单元。In the figure: 1. Image shooting module; 2. Imaging module; 21. Decomposition module; 22. Imprinting module; 3. Image database; 31. Classification module; 32. Identification module; 33. Three-dimensional module; 4. Storage module; 5 7, a comparison module; 6, a display module; 7, an image processing module; 71, a structure submodule; 72, a scanning device; 73, a matching subunit; 74, a scheduling unit.

具体实施方式Detailed ways

为了使本发明的目的、技术方案及优点更加清楚明白,以下结合附图及实施例,对本发明进行进一步详细说明。应当理解,此处所描述的具体实施例仅仅用以解释本发明,并不用于限定本发明。In order to make the objectives, technical solutions and advantages of the present invention clearer, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention, but not to limit the present invention.

请参阅图1,本发明提供一种技术方案:一种多模态影像数据管理系统,包括用于对患者体内进行多模态影像拍摄的影像拍摄模块1,还包括影像数据库3、存储模块4、对比模块5和图像处理模块7,影像数据库3和存储模块4均与对比模块5数据连接,影像拍摄模块1与影像数据库3的输入端相连接,影像拍摄模块1将其拍摄的多模态影像数据发送至影像数据库3的内部进行存储,影像数据库3根据多模态影像数据模拟人体内部的三维视图,并通过对比模块5对比影像数据库3与存储模块4内部所存储的人体三位影像,图像处理模块7与影像数据库3相连接,图像处理模块7根据确定后的患者病历资料将其病历特征标注到影像数据之中,并同步添加影像数据的同步索引关键词,并发送至存储模块4的内部进行存储。Referring to FIG. 1 , the present invention provides a technical solution: a multi-modal image data management system, including an image capturing module 1 for capturing multi-modal images inside a patient, animage database 3 and astorage module 4 , thecomparison module 5 and the image processing module 7, theimage database 3 and thestorage module 4 are all connected with thecomparison module 5 data, the image capture module 1 is connected with the input end of theimage database 3, and the image capture module 1 shoots the multi-modal The image data is sent to the interior of theimage database 3 for storage. Theimage database 3 simulates a three-dimensional view of the inside of the human body according to the multi-modal image data, and compares the three-dimensional images of the human body stored in theimage database 3 and thestorage module 4 through thecomparison module 5. The image processing module 7 is connected with theimage database 3, and the image processing module 7 annotates its medical record features into the image data according to the determined patient medical record data, and synchronously adds the synchronous index keyword of the image data, and sends it to thestorage module 4 internal storage.

在本实施方式中,在使用的过程中,首先通过影像拍摄模块1对患者进影像数据的拍摄,且影像拍摄模块1可设置多个,利用多个影像拍摄模块1对患者的进行体内多模态影像数据的拍摄,并将拍摄后的影像数据发送至成像模块2的内部,当成像模块2在接收到多模态影像数据之后,便会对影像数据进行图像化处理,并将处理后所形成的患者体内的多模态图像发送至影像数据库3的内部,由于在影像数据库3的内部设置有分类模块31、标识模块32以及三维模块33,首先,通过分类模块31对影像数据库3所接收到的多模态图像进行分类处理,并可以依据多模态图像所拍摄的人体部位以及图像的内容进行分类,随后三维模块33根据所分类的多模态影像以及图像数据进行人体体内三维视图的转化,随后标识模块32根据所形成的三维视图对其进行重要器官以及血管的标注标识,该标识以及标注的名称可选择器官以及血管所对应的医学专用名词,进而更加方便医护人员的后续观看,随后三维模块33将标识模块32所标识和标注的患者体内三维视图发送至对比模块5内部,由于对比模块5与存储模块4相连接,且存储模块4的内部存储有患者的病理报告、患者之前所拍摄形成的体内三维视图以及常人体内三维视图,进而对比模块5便可调取存储模块4内部所存储的患者之前所拍摄的体内三维视图以及常人体内三维视图,并将两者的三维视图分别与三维模块33所发送的现患者体内三维视图进行对比,利用对比模块5的对比区别现患者体内拍摄形成的三维视图与患者之前所拍摄的体内三维视图以及常人体内三维视图之间的区别,并对对比的区别特征进行标注,并发送至显示模块6的内部进行显示,供医护人员审查和观看,进而避免了医护人员单独的肉眼识别,并充分减少患者的眼部疲劳,随后,当医护人员在进行患者医疗图像的观看之后,并可确定患者的病情,进而医护人员便可将患者的病例更新诊断手册,由于扫描装置72的设置,便可对病历手册医护人员所更新的病例资料进行扫描,并形成文字数据发送至匹配子单元73的内部,随后,结构子模块71调取影像数据库3内部所存储的患者历史病历资料,并再次发送至匹配子单元73的内部,匹配子单元73根据扫描装置72以及调度单元74所发送的患者病例资料调取其病症关键词,将其病历特征标注到影像数据之中,并同步添加索引的关键词发送至存储模块4的内部进行存储,进而方便医护人员后续的调取;例如:患者经过诊断身患肿瘤,进而匹配子模块便会将“肿瘤”列为关键词,并同步在患者的医疗图像上进行位置的标注,并根据资料备注“肿瘤”的大小等,随后,便可将患者的医疗影像数据添加“肿瘤”的索引关键词存储到存储模块4的内部,当医护人员需要进行后续的调取时,便可根据索引的关键词调取到同样病情的患者影像资料,进而方便医疗影像之间的对比和后续的调取。In this embodiment, in the process of use, the image data of the patient is firstly captured by the image capturing module 1 , and multiple image capturing modules 1 can be set up, and the multiple image capturing modules 1 are used to perform in vivo multi-mode imaging on the patient. After the imaging module 2 receives the multi-modal image data, it will perform image processing on the image data, and the processed The formed multimodal image in the patient's body is sent to the inside of theimage database 3. Since theimage database 3 is provided with aclassification module 31, anidentification module 32 and a three-dimensional module 33, first, theimage database 3 is received by theclassification module 31. The received multimodal images are classified and processed, and can be classified according to the body parts captured by the multimodal images and the content of the images, and then the three-dimensional module 33 performs a three-dimensional view of the human body according to the classified multimodal images and image data. After conversion, theidentification module 32 marks and marks the vital organs and blood vessels according to the formed three-dimensional view, and the marks and the marked names can select the medical term corresponding to the organs and blood vessels, which is more convenient for the subsequent viewing of medical staff, Then the three-dimensional module 33 sends the three-dimensional view of the patient's body identified and marked by theidentification module 32 to the inside of thecomparison module 5. Since thecomparison module 5 is connected to thestorage module 4, and thestorage module 4 stores the patient's pathology report, the patient's previous The in-vivo 3D view and the normal body 3D view formed by shooting, and then thecomparison module 5 can retrieve the in-vivo 3D view of the patient and the normal body 3D view stored in thestorage module 4 before, and compare the two 3D views respectively. Compare with the current in vivo 3D view of the patient sent by the3D module 33, and use the comparison of thecomparison module 5 to distinguish the difference between the 3D view captured in the patient's body, the in vivo 3D view captured by the patient before, and the 3D view in the normal human body, and The distinguishing features of the comparison are marked and sent to the interior of thedisplay module 6 for display for review and viewing by medical staff, thereby avoiding the medical staff's separate visual identification and fully reducing the patient's eye fatigue. After viewing the patient's medical image, the patient's condition can be determined, and then the medical staff can update the patient's case in the diagnostic manual. Due to the setting of thescanning device 72, the case data updated by the medical staff in the medical record manual can be scanned. , and form text data and send it to the interior of thematching sub-unit 73. Subsequently, thestructural sub-module 71 retrieves the patient historical medical record data stored in theimage database 3, and sends it to the interior of thematching sub-unit 73 again. The matchingsub-unit 73 is based on The patient case data sent by thescanning device 72 and thescheduling unit 74 retrieves its disease keywords, marks its medical record features into the image data, and synchronously adds the indexed keywords to the interior of thestorage module 4 for storage, thereby facilitating Subsequent retrieval by medical staff; for example, after a patient is diagnosed with a tumor, matching the sub-module will assign the "tumor" List it as a keyword, and simultaneously mark the position on the patient's medical image, and note the size of the "tumor" according to the data, and then add the index keyword of "tumor" to the patient's medical image data and store it in the storage. Inside themodule 4, when the medical staff needs to perform subsequent retrieval, they can retrieve the image data of patients with the same condition according to the keywords of the index, thereby facilitating the comparison between medical images and the subsequent retrieval.

进一步的,还包括成像模块2,成像模块2包括分解模块21和印记模块22,分解模块21对患者拍摄的影像数据进行肢体化的分解,并利用所述印记模块22对分解图像中的关节部分进行标注成像模块2的输入端和输出端分别与影像拍摄模块1和影像数据库3相连接,用于对影像拍摄模块1拍摄影像的图像化。Further, it also includes an imaging module 2. The imaging module 2 includes adecomposition module 21 and an imprinting module 22. The decomposingmodule 21 decomposes the image data captured by the patient into limbs, and uses the imprinting module 22 to decompose the joint parts in the decomposed images. The input end and the output end of the imaging module 2 for labeling are respectively connected with the image capturing module 1 and theimage database 3 , and are used to image the images captured by the image capturing module 1 .

在本实施方式中,在使用的过程中,影像拍摄模块1将拍摄后的影像数据发送至成像模块2的内部,当成像模块2在接收到多模态影像数据之后,便会对影像数据进行图像化处理,在处理的过程中,首先分解模块21根据患者的肢体将对患者所拍摄的多模态影像数据分解为肢体多对应的图像数据,并将分解后的图像数据发送至印记模块22内,通过印记模块22对肢体图像中的关节部位以及肌肉部位进行标识印记,并将印记后的图像数据发送至影像数据库3的内部,方便后续图像与图像之间的对比,而肢体图像的对比更加简单明了,因此更为方便使用。In this embodiment, during use, the image capturing module 1 sends the captured image data to the interior of the imaging module 2. After the imaging module 2 receives the multi-modal image data, it will process the image data. Image processing, in the process of processing, thedecomposition module 21 first decomposes the multimodal image data captured by the patient into image data corresponding to the limbs according to the patient's limbs, and sends the decomposed image data to the imprinting module 22 Inside, through the imprinting module 22, the joint parts and muscle parts in the limb image are marked and imprinted, and the imprinted image data is sent to the interior of theimage database 3 to facilitate the comparison between subsequent images and images, and the comparison of the limb images Simpler and clearer, and therefore more convenient to use.

进一步的,影像数据库3包括分类模块31、标识模块32和三维模块33,分类模块31用于对多模态影像数据的分类处理,标识模块32用于对患者体内影像以及图像中重要器官的标识;分类模块31对影像数据的分类可依据影像中所拍摄的对象以及影像的内容,三维模块33与对比模块5相连接,用于对患者体内三维视图的规划以及发送。Further, theimage database 3 includes aclassification module 31, anidentification module 32, and a three-dimensional module 33. Theclassification module 31 is used to classify and process the multimodal image data, and theidentification module 32 is used to identify the patient's in-vivo images and important organs in the images. Theclassification module 31 can classify the image data according to the object captured in the image and the content of the image. The three-dimensional module 33 is connected to thecomparison module 5 for planning and sending the three-dimensional view of the patient's body.

在本实施方式中,通过分类模块31对影像数据库3所接收到的多模态图像进行分类处理,并可以依据多模态图像所拍摄的人体部位以及图像的内容进行分类,随后三维模块33根据所分类的多模态影像以及图像数据进行人体体内三维视图的转化,随后标识模块32根据所形成的三维视图对其进行重要器官以及血管的标注标识,该标识以及标注的名称可选择器官以及血管所对应的医学专用名词,进而更加方便医护人员的后续观看。In this embodiment, the multi-modal images received by theimage database 3 are classified and processed by theclassification module 31, and can be classified according to the body parts captured by the multi-modal images and the content of the images, and then the three-dimensional module 33 can classify according to the content of the images. The classified multimodal images and image data are converted into a three-dimensional view of the human body, and then theidentification module 32 labels and identifies important organs and blood vessels according to the formed three-dimensional view. The corresponding medical terminology is more convenient for medical staff to follow up.

进一步的,图像处理模块7包括结构子模块71、扫描装置72、匹配子单元73和调度单元74,调度单元74调取存储模块4内部所存储的病例资料,并利用扫描装置72扫描医护人员最终所确定的病例报告,结构子模块71与影像数据库3相连接,调取影像数据库3内所存储影像数据,并发送至匹配子单元73内部,匹配子单元73根据两病例资料对医疗影像进行医疗特征标注,并同步添加医疗特征的索引关键词存储至存储模块4内部。Further, the image processing module 7 includes a structural sub-module 71, ascanning device 72, a matchingsub-unit 73 and ascheduling unit 74. Thescheduling unit 74 retrieves the case data stored in thestorage module 4, and uses thescanning device 72 to scan the medical staff's final results. For the determined case report, the structural sub-module 71 is connected to theimage database 3, retrieves the image data stored in theimage database 3, and sends it to the matchingsub-unit 73, and the matchingsub-unit 73 performs medical treatment on the medical images according to the two case data. The features are marked, and the index keywords of the added medical features are stored in thestorage module 4 synchronously.

在本实施方式中,当医护人员在进行患者医疗图像的观看之后,并可确定患者的病情,进而医护人员便可将患者的病例更新诊断手册,由于扫描装置72的设置,便可对病历手册医护人员所更新的病例资料进行扫描,并形成文字数据发送至匹配子单元73的内部,随后,结构子模块71调取影像数据库3内部所存储的患者历史病历资料,并再次发送至匹配子单元73的内部,匹配子单元73根据扫描装置72以及调度单元74所发送的患者病例资料调取其病症关键词,将其病历特征标注到影像数据之中,并同步添加索引的关键词发送至存储模块4的内部进行存储,进而方便医护人员后续的调取。In this embodiment, after viewing the patient's medical image, the medical staff can determine the patient's condition, and then the medical staff can update the patient's case in the diagnostic manual. Due to the setting of thescanning device 72, the medical record manual can be updated. The case data updated by the medical staff is scanned, and text data is formed and sent to the matchingsub-unit 73. Subsequently, thestructure sub-module 71 retrieves the patient historical medical record data stored in theimage database 3, and sends it to the matching sub-unit again. Inside 73, the matchingsubunit 73 retrieves the disease keywords according to the patient case data sent by thescanning device 72 and thescheduling unit 74, marks the characteristics of the medical records into the image data, and synchronously adds the indexed keywords to the storage. The interior of themodule 4 is stored to facilitate subsequent retrieval by medical staff.

进一步的,存储模块4内部所存储的数据包括患者的病理报告、患者之前所拍摄形成的体内三维视图以及常人体内三维视图。Further, the data stored in thestorage module 4 includes the pathological report of the patient, the in-vivo three-dimensional view captured by the patient before, and the normal human in-vivo three-dimensional view.

在本实施方式中,在使用的过程中,当对比模块5将标注后的区别特征发送至显示模块6的内部时,便会同步将患者病理报告发送至显示模块6的内部,供医护人员的同步观看和参考。In this embodiment, in the process of use, when thecomparison module 5 sends the marked distinctive features to the inside of thedisplay module 6, the patient's pathology report will be sent to the inside of thedisplay module 6 synchronously for the medical staff to use. Simultaneous viewing and reference.

进一步的,还包括显示模块6,对比模块5与显示模块6相连接,用于接收对比模块5对比出的区别特征,并进行显示。Further, adisplay module 6 is also included, and thecomparison module 5 is connected to thedisplay module 6 for receiving and displaying the distinguishing features compared by thecomparison module 5 .

在本实施方式中,在使用的过程中,对比模块5将标注后的区别特征发送至显示模块6的内部进行显示,供医护人员审查和观看,进而避免了医护人员单独的肉眼识别。In this embodiment, during use, thecomparison module 5 sends the marked distinguishing features to the interior of thedisplay module 6 for display for review and viewing by medical staff, thereby avoiding separate visual identification by medical staff.

请参阅图2,一种多模态影像数据管理分析方法,包括如下步骤:Please refer to FIG. 2 , a multimodal image data management and analysis method, including the following steps:

步骤S10:进行患者体内的多模态影像拍摄,并对成像进行分解和印记标注;Step S10: photographing multi-modal images in the patient's body, and decomposing and marking the images;

步骤S20:对形成的多模态的影像数据进行存储;Step S20: storing the formed multimodal image data;

步骤S30:对影像数据中的患者体内重要器官部位进行标记;Step S30: marking the vital organs of the patient in the image data;

步骤S40:将标号的患者体内影像数据与原始影像数据和标椎影像数据进行对比;Step S40: comparing the labeled patient in-vivo image data with the original image data and the marked vertebrae image data;

步骤S50:对比得出影像数据之间的区别;Step S50: comparing the difference between the image data;

步骤S60:发送到显示模块6内部进行显示。Step S60: Send to thedisplay module 6 for display.

步骤S70:确定患者的病例资料后将其病例资料扫描并匹配到该患者对应的图像数据之中,并索引存储。Step S70: After determining the patient's case data, scan and match the patient's case data into the image data corresponding to the patient, and store the data in an index.

在本实施方式中,首先通过影像拍摄模块1对患者进影像数据的拍摄,且影像拍摄模块1可设置多个,利用多个影像拍摄模块1对患者的进行体内多模态影像数据的拍摄,并将拍摄后的影像数据发送至成像模块2的内部,当成像模块2在接收到多模态影像数据之后,便会对影像数据进行图像化处理,并将处理后所形成的患者体内的多模态图像发送至影像数据库3的内部,由于在影像数据库3的内部设置有分类模块31、标识模块32以及三维模块33,首先,通过分类模块31对影像数据库3所接收到的多模态图像进行分类处理,并可以依据多模态图像所拍摄的人体部位以及图像的内容进行分类,随后三维模块33根据所分类的多模态影像以及图像数据进行人体体内三维视图的转化,随后标识模块32根据所形成的三维视图对其进行重要器官以及血管的标注标识,该标识以及标注的名称可选择器官以及血管所对应的医学专用名词,进而更加方便医护人员的后续观看,随后三维模块33将标识模块32所标识和标注的患者体内三维视图发送至对比模块5内部,由于对比模块5与存储模块4相连接,且存储模块4的内部存储有患者的病理报告、患者之前所拍摄形成的体内三维视图以及常人体内三维视图,进而对比模块5便可调取存储模块4内部所存储的患者之前所拍摄的体内三维视图以及常人体内三维视图,并将两者的三维视图分别与三维模块33所发送的现患者体内三维视图进行对比,利用对比模块5的对比区别现患者体内拍摄形成的三维视图与患者之前所拍摄的体内三维视图以及常人体内三维视图之间的区别,并对对比的区别特征进行标注,并发送至显示模块6的内部进行显示,供医护人员审查和观看,进而避免了医护人员单独的肉眼识别,并充分减少患者的眼部疲劳,随后,当医护人员在进行患者医疗图像的观看之后,并可确定患者的病情,进而医护人员便可将患者的病例更新诊断手册,由于扫描装置72的设置,便可对病历手册医护人员所更新的病例资料进行扫描,并形成文字数据发送至匹配子单元73的内部,随后,结构子模块71调取影像数据库3内部所存储的患者历史病历资料,并再次发送至匹配子单元73的内部,匹配子单元73根据扫描装置72以及调度单元74所发送的患者病例资料调取其病症关键词,将其病历特征标注到影像数据之中,并同步添加索引的关键词发送至存储模块4的内部进行存储,进而方便医护人员后续的调取。In this embodiment, first, the image data of the patient is captured by the image capture module 1, and multiple image capture modules 1 can be set up, and the multiple image capture modules 1 are used to capture in-vivo multimodal image data of the patient. The captured image data is sent to the interior of the imaging module 2. After the imaging module 2 receives the multi-modal image data, it will perform image processing on the image data, and convert the multi-modal images formed in the patient's body after processing. The modal image is sent to the interior of theimage database 3. Since the interior of theimage database 3 is provided with aclassification module 31, anidentification module 32, and a three-dimensional module 33, first, theclassification module 31 analyzes the multi-modal images received by theimage database 3. Perform classification processing, and can be classified according to the body parts captured by the multi-modal image and the content of the image, and then the three-dimensional module 33 converts the three-dimensional view of the human body according to the classified multi-modal images and image data, and then theidentification module 32 According to the formed three-dimensional view, the important organs and blood vessels are marked and marked. The marking and the marked name can be selected from the medical terms corresponding to the organs and blood vessels, which is more convenient for medical staff to follow up. Then the three-dimensional module 33 will mark The three-dimensional view of the patient's body identified and marked by themodule 32 is sent to the interior of thecomparison module 5. Since thecomparison module 5 is connected to thestorage module 4, and the interior of thestorage module 4 stores the patient's pathology report and the in-vivo three-dimensional view formed by the patient's previous shooting. view and the three-dimensional view in the body of an ordinary person, and then thecomparison module 5 can retrieve the three-dimensional view in the body of the patient and the three-dimensional view in the body of the ordinary human body stored in thestorage module 4, and send the two-dimensional views with the three-dimensional module 33 Compare the three-dimensional views in the patient's body, use thecontrast module 5 to distinguish the three-dimensional view formed by shooting in the patient's body, the three-dimensional view in the patient's body before shooting, and the three-dimensional view in the body of ordinary people, and compare the distinguishing features. It is marked and sent to the interior of thedisplay module 6 for display for review and viewing by medical staff, thereby avoiding the medical staff’s separate visual recognition and fully reducing the patient’s eye fatigue. After viewing, the patient's condition can be determined, and then the medical staff can update the patient's case in the diagnostic manual. Due to the setting of thescanning device 72, the case data updated by the medical staff in the medical record manual can be scanned, and text data can be sent. to the inside of the matchingsub-unit 73, then, thestructure sub-module 71 retrieves the patient historical medical record data stored in theimage database 3, and sends it to the inside of the matchingsub-unit 73 again. The matchingsub-unit 73 is based on thescanning device 72 and the scheduling unit. The patient case data sent by 74 retrieves its disease keywords, marks its medical record features into the image data, and synchronously adds the indexed keywords to the interior of thestorage module 4 for storage, thereby facilitating subsequent retrieval by medical staff. .

以上所述仅为本发明的较佳实施例而已,并不用以限制本发明,凡在本发明的精神和原则之内所作的任何修改、等同替换和改进等,均应包含在本发明的保护范围之内。The above descriptions are only preferred embodiments of the present invention and are not intended to limit the present invention. Any modifications, equivalent replacements and improvements made within the spirit and principles of the present invention shall be included in the protection of the present invention. within the range.

Claims (10)

1. The utility model provides a multimode image data management system, is including being used for taking the module to the image that carries out multimode image to taking in the patient, its characterized in that: also comprises an image database, a storage module, a comparison module and an image processing module, wherein the image database and the storage module are in data connection with the comparison module, the image shooting module is connected with the input end of the image database, the image shooting module sends the multi-modal image data shot by the image shooting module to the interior of the image database for storage, the image database simulates the three-dimensional view of the interior of the human body according to the multi-modal image data, and the image database is compared with the human body three-dimensional image stored in the storage module through the comparison module, the image processing module is connected with the image database, the image processing module labels the medical record characteristics of the patient into the image data according to the determined medical record data of the patient, and synchronously adding the synchronous index key words of the image data, and sending the synchronous index key words to the inside of the storage module for storage.
CN202010177977.6A2020-03-132020-03-13Multi-mode image data management system and analysis methodPendingCN111415727A (en)

Priority Applications (1)

Application NumberPriority DateFiling DateTitle
CN202010177977.6ACN111415727A (en)2020-03-132020-03-13Multi-mode image data management system and analysis method

Applications Claiming Priority (1)

Application NumberPriority DateFiling DateTitle
CN202010177977.6ACN111415727A (en)2020-03-132020-03-13Multi-mode image data management system and analysis method

Publications (1)

Publication NumberPublication Date
CN111415727Atrue CN111415727A (en)2020-07-14

Family

ID=71494216

Family Applications (1)

Application NumberTitlePriority DateFiling Date
CN202010177977.6APendingCN111415727A (en)2020-03-132020-03-13Multi-mode image data management system and analysis method

Country Status (1)

CountryLink
CN (1)CN111415727A (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN111881979A (en)*2020-07-282020-11-03复旦大学Multi-modal data annotation device and computer-readable storage medium containing program
CN112002390A (en)*2020-08-312020-11-27南京市口腔医院Oral CBCT data imaging structured management system
CN112237416A (en)*2020-09-102021-01-19北京信息科技大学Fundus multi-mode imaging system calibration method based on retinal surface blood vessel characteristics
CN112315497A (en)*2020-10-272021-02-05武汉聚信同创科技有限公司Ultrasonic probe and ultrasonic scanning system thereof
CN113268623A (en)*2021-06-012021-08-17上海市第一人民医院Artificial intelligence gastroscope image recognition processing system
CN113425251A (en)*2021-05-282021-09-24云南中医药大学Eye diagnosis image recognition system and method
CN113626413A (en)*2021-08-162021-11-09电子科技大学 A method and system for constructing a special disease database
CN115082409A (en)*2022-06-302022-09-20心禾互联网医院(成都)有限公司 A system for automatic identification of radionuclide imaging for diagnosis of myocardial ischemia
CN119380939A (en)*2024-12-262025-01-28浙江中医药大学附属第三医院(浙江省中山医院) Recommendation method of traditional Chinese medicine rehabilitation nursing strategy for stroke patients based on RNN monitoring

Citations (13)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN102968572A (en)*2012-12-102013-03-13吴志宏Orthopaedic case information collecting system and collecting method thereof
CN103020446A (en)*2012-12-102013-04-03吴志宏Data processing system for information of chronicle spinal degenerative diseases and deformity
CN202960510U (en)*2012-11-282013-06-05徐州医学院Magnetic resonance imaging (MRI) imaging diagnosis automatic system
CN103345576A (en)*2013-06-252013-10-09上海交通大学Clinical history database diagnostic system based on four-modal medical image
CN105893778A (en)*2016-04-282016-08-24陕西数字人信息科技有限公司Four-dimensional digital human body physiological data visual monitoring, analyzing and assessing method and system
CN107194158A (en)*2017-05-042017-09-22深圳美佳基因科技有限公司A kind of disease aided diagnosis method based on image recognition
CN107273657A (en)*2017-05-152017-10-20慧影医疗科技(北京)有限公司The generation method and storage device of diagnostic imaging picture and text report
CN107610756A (en)*2017-09-132018-01-19刘志鹏Medical image data based on total digitalization obtains and used system
CN108109682A (en)*2018-01-192018-06-01大连外国语大学A kind of medical image identifying system and its method
CN108231194A (en)*2018-04-042018-06-29苏州医云健康管理有限公司A kind of disease diagnosing system
CN108229584A (en)*2018-02-022018-06-29莒县人民医院A kind of Multimodal medical image recognition methods and device based on deep learning
CN108806776A (en)*2018-06-142018-11-13暨南大学附属第医院(广州华侨医院)A method of the Multimodal medical image based on deep learning
WO2019052063A1 (en)*2017-09-152019-03-21深圳市前海安测信息技术有限公司Medical image classification processing system and method based on artificial intelligence

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN202960510U (en)*2012-11-282013-06-05徐州医学院Magnetic resonance imaging (MRI) imaging diagnosis automatic system
CN102968572A (en)*2012-12-102013-03-13吴志宏Orthopaedic case information collecting system and collecting method thereof
CN103020446A (en)*2012-12-102013-04-03吴志宏Data processing system for information of chronicle spinal degenerative diseases and deformity
CN103345576A (en)*2013-06-252013-10-09上海交通大学Clinical history database diagnostic system based on four-modal medical image
CN105893778A (en)*2016-04-282016-08-24陕西数字人信息科技有限公司Four-dimensional digital human body physiological data visual monitoring, analyzing and assessing method and system
CN107194158A (en)*2017-05-042017-09-22深圳美佳基因科技有限公司A kind of disease aided diagnosis method based on image recognition
CN107273657A (en)*2017-05-152017-10-20慧影医疗科技(北京)有限公司The generation method and storage device of diagnostic imaging picture and text report
CN107610756A (en)*2017-09-132018-01-19刘志鹏Medical image data based on total digitalization obtains and used system
WO2019052063A1 (en)*2017-09-152019-03-21深圳市前海安测信息技术有限公司Medical image classification processing system and method based on artificial intelligence
CN108109682A (en)*2018-01-192018-06-01大连外国语大学A kind of medical image identifying system and its method
CN108229584A (en)*2018-02-022018-06-29莒县人民医院A kind of Multimodal medical image recognition methods and device based on deep learning
CN108231194A (en)*2018-04-042018-06-29苏州医云健康管理有限公司A kind of disease diagnosing system
CN108806776A (en)*2018-06-142018-11-13暨南大学附属第医院(广州华侨医院)A method of the Multimodal medical image based on deep learning

Cited By (10)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN111881979A (en)*2020-07-282020-11-03复旦大学Multi-modal data annotation device and computer-readable storage medium containing program
CN112002390A (en)*2020-08-312020-11-27南京市口腔医院Oral CBCT data imaging structured management system
CN112237416A (en)*2020-09-102021-01-19北京信息科技大学Fundus multi-mode imaging system calibration method based on retinal surface blood vessel characteristics
CN112315497A (en)*2020-10-272021-02-05武汉聚信同创科技有限公司Ultrasonic probe and ultrasonic scanning system thereof
CN113425251A (en)*2021-05-282021-09-24云南中医药大学Eye diagnosis image recognition system and method
CN113268623A (en)*2021-06-012021-08-17上海市第一人民医院Artificial intelligence gastroscope image recognition processing system
CN113268623B (en)*2021-06-012022-07-19上海市第一人民医院Artificial intelligence gastroscope image identification processing system
CN113626413A (en)*2021-08-162021-11-09电子科技大学 A method and system for constructing a special disease database
CN115082409A (en)*2022-06-302022-09-20心禾互联网医院(成都)有限公司 A system for automatic identification of radionuclide imaging for diagnosis of myocardial ischemia
CN119380939A (en)*2024-12-262025-01-28浙江中医药大学附属第三医院(浙江省中山医院) Recommendation method of traditional Chinese medicine rehabilitation nursing strategy for stroke patients based on RNN monitoring

Similar Documents

PublicationPublication DateTitle
CN111415727A (en)Multi-mode image data management system and analysis method
CN108324246B (en) Auxiliary system and method for medical diagnosis
CN111583249B (en)Medical image quality monitoring system and method
CN110400617B (en)Combination of imaging and reporting in medical imaging
US20050121505A1 (en)Patient-centric data acquisition protocol selection and identification tags therefor
CN106202948B (en)A kind of method for digitizing echocardiogram report and managing automatically
CN112308888B (en)Full-mode medical image sequence grouping method based on deep learning physical sign structure
CN113656706A (en)Information pushing method and device based on multi-mode deep learning model
CN111904379B (en) Scanning method and device for multimodal medical equipment
CN103258111A (en)Structured, image-assisted finding generation
JP7102999B2 (en) Information collection processing equipment, information collection processing method and program
US20040024292A1 (en)System and method for assigning a computer aided detection application to a digital image
CN115206478A (en)Medical report generation method and device, electronic equipment and readable storage medium
CN115910300A (en)Medical virtual platform system based on artificial intelligence and information processing method
CN110974266A (en)Image workstation
CN112331329A (en) System and method for real-time interpretation of hand bone age by personal device
US20050288568A1 (en)Real-time automatic searching system for medical image and method for the same
JP4617116B2 (en) Instant medical video automatic search and contrast method and system
WO2019150326A3 (en)Medical record/management system with augmented patient images for rapid retrieval
KR20190143657A (en)Apparatus and method for alignment of bone suppressed chest x-ray image
KR20190138106A (en)Medical image information starage system
KR20150113286A (en) Medical image storage and transmission system tagging simultaneously with recording
US20240339214A1 (en)Method and system for optimizing medical imagining examination
CN115082733B (en) Method, system and device for determining the shooting part of medical images
US11587232B1 (en)Systems and methods for preventing errors in medical imaging

Legal Events

DateCodeTitleDescription
PB01Publication
PB01Publication
SE01Entry into force of request for substantive examination
SE01Entry into force of request for substantive examination
RJ01Rejection of invention patent application after publication
RJ01Rejection of invention patent application after publication

Application publication date:20200714


[8]ページ先頭

©2009-2025 Movatter.jp