CN115005989A - A multi-optical fusion brain localization method and corresponding localization system - Google Patents
A multi-optical fusion brain localization method and corresponding localization systemDownload PDFInfo
- Publication number
- CN115005989A CN115005989ACN202210772992.4ACN202210772992ACN115005989ACN 115005989 ACN115005989 ACN 115005989ACN 202210772992 ACN202210772992 ACN 202210772992ACN 115005989 ACN115005989 ACN 115005989A
- Authority
- CN
- China
- Prior art keywords
- brain
- fusion
- image
- light
- images
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/20—Image enhancement or restoration using local operators
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/90—Dynamic range modification of images or parts thereof
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0012—Biomedical image inspection
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/74—Image or video pattern matching; Proximity measures in feature spaces
- G06V10/75—Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
- G06V10/751—Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
- A61B2034/101—Computer-aided simulation of surgical operations
- A61B2034/105—Modelling of the patient, e.g. for ligaments or bones
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
- A61B2034/107—Visualisation of planned trajectories or target regions
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
- A61B2034/108—Computer aided selection or customisation of medical implants or cutting guides
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
- A61B2034/2046—Tracking techniques
- A61B2034/2065—Tracking using image or pattern recognition
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10048—Infrared image
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20221—Image fusion; Image merging
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30016—Brain
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Surgery (AREA)
- Life Sciences & Earth Sciences (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Public Health (AREA)
- Animal Behavior & Ethology (AREA)
- Molecular Biology (AREA)
- Heart & Thoracic Surgery (AREA)
- Biomedical Technology (AREA)
- Veterinary Medicine (AREA)
- Robotics (AREA)
- Quality & Reliability (AREA)
- Multimedia (AREA)
- Software Systems (AREA)
- Evolutionary Computation (AREA)
- Databases & Information Systems (AREA)
- Computing Systems (AREA)
- Artificial Intelligence (AREA)
- Radiology & Medical Imaging (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
Abstract
Translated fromChinese
Description
Translated fromChinese技术领域technical field
本发明涉及图像融合成像技术领域，具体涉及一种多光融合脑部定位方法及相应的定位系统。The invention relates to the technical field of image fusion imaging, in particular to a multi-light fusion brain positioning method and a corresponding positioning system.
背景技术Background technique
目前植入式脑机体电极植入方式主要依靠术前对脑部进行影像学检查，初步定位后确定植入的手术方案。然后依据手术方案将头部固定在适当位置后，进行开颅手术。开颅后脑部会发生相对位移，医疗人员依据经验寻找需要植入的位置，手动将电极植入。At present, the implantable brain-body electrode implantation method mainly relies on preoperative imaging examination of the brain, and the surgical plan for implantation is determined after preliminary positioning. Then, after fixing the head in the proper position according to the surgical plan, a craniotomy is performed. After craniotomy, relative displacement occurs in the brain. Medical personnel find the location to be implanted based on experience, and manually implant the electrodes.
现有的脑部手术定位系统，主要靠术前的影像学检查结果，固定头部位置后，较高程度依赖医疗人员临床经验，基于人为估计的定位范围也不够精确，手术中花费大量的时间和精力来定位，仍然做不到能确保发现病变。而对脑部观察，多依赖可见光或结构光技术，光谱单一，能提取的信息不够丰富。The existing brain surgery positioning system mainly relies on the results of preoperative imaging examinations. After the head position is fixed, it relies to a high degree on the clinical experience of medical personnel. The positioning range based on human estimation is not accurate enough, and it takes a lot of time during the operation. and energy to locate, still can not do to ensure the detection of lesions. For brain observation, it mostly relies on visible light or structured light technology, the spectrum is single, and the information that can be extracted is not rich enough.
也有一些人提出新的解决办法，诸如中国专利CN103371870A公开了一种基于多模影像的外科手术导航系统，将术前的3D影像转化为虚拟超声图像，与术中超声匹配，得出的图像再与手术中的内窥镜图像做融合，最后在云平台上完成术后评估。但此方法在没有专门的内窥镜超声探头的医院无法使用，限制了应用范围；而且，大量运算工作必须在本地端的处理器完成，对配置也提出了一定的要求。Some people have also proposed new solutions, such as Chinese patent CN103371870A, which discloses a surgical navigation system based on multimodal images, which converts preoperative 3D images into virtual ultrasound images, matches with intraoperative ultrasound, and the obtained image is regenerated. It is fused with the endoscopic image during the operation, and finally the postoperative evaluation is completed on the cloud platform. However, this method cannot be used in hospitals without special endoscopic ultrasound probes, which limits the scope of application; moreover, a large amount of computing work must be completed on the local processor, which also puts forward certain requirements for the configuration.
由此，提供一种定位方式简捷、快速地实现脑部手术定位，以期解决现有技术中存在的问题，对于真正实现早期治疗具有重要的指导意义。Therefore, a positioning method is provided to realize the positioning of brain surgery simply and quickly, in order to solve the problems existing in the prior art, which has important guiding significance for the real realization of early treatment.
发明内容SUMMARY OF THE INVENTION
有鉴于此，本发明提出了一种多光融合脑部定位方法及相应的定位系统，用以解决现有技术中脑部手术定位不准确的问题。In view of this, the present invention proposes a multi-optical fusion brain positioning method and a corresponding positioning system to solve the problem of inaccurate brain surgery positioning in the prior art.
为解决上述技术问题，根据本发明的一个方面，本发明提供了如下技术方案：In order to solve the above-mentioned technical problems, according to one aspect of the present invention, the present invention provides the following technical solutions:
一种多光融合脑部定位方法，包括如下步骤：A multi-light fusion brain localization method, comprising the following steps:
S1.获取至少两幅多光脑部图像数据形成多波段图像数据，分析处理后获得融合图像；S1. Obtain at least two multi-optical brain image data to form multi-band image data, and obtain a fusion image after analysis and processing;
S2.基于融合图像的区域特征与脑区图谱进行比对，通过特征点匹配，建立头部功能脑区位置模型，加入术前脑部影像数据，建立与实际脑部模型对应关系，完成所述多光融合脑部定位。S2. Comparing the regional features of the fusion image with the brain region map, establishing the location model of the functional brain region of the head through feature point matching, adding the preoperative brain image data, establishing the corresponding relationship with the actual brain model, and completing the above Multi-light fusion brain localization.
作为本发明所述的一种多光融合脑部定位方法的优选方案，其中：所述步骤S1中，所述分析处理具体为：As a preferred solution of the multi-optical fusion brain localization method according to the present invention, wherein: in the step S1, the analysis processing is specifically:
S1.1.进行特征提取，得到图像细节特征与区域特征；S1.1. Perform feature extraction to obtain image detail features and regional features;
S1.2.针对细节特征调整多光成像元件之间的空间位置关系，根据空间位置关系定位后互相叠加形成融合图像。S1.2. Adjust the spatial positional relationship between the multi-light imaging elements according to the detailed features, and superimpose each other to form a fusion image after positioning according to the spatial positional relationship.
作为本发明所述的一种多光融合脑部定位方法的优选方案，其中：所述步骤S1中，所述至少两幅多光脑部图像分别通过红外、近红外、可见光采集多波段图像数据，并对每个波段的图像进行图像预处理。As a preferred solution of the multi-light fusion brain localization method according to the present invention, wherein: in the step S1, the at least two multi-light brain images collect multi-band image data through infrared, near-infrared and visible light respectively. , and perform image preprocessing on the images of each band.
作为本发明所述的一种多光融合脑部定位方法的优选方案，其中：所述步骤S1中，红外图像来自脑部自发热辐射，可见光图像、近红外图像获取提供配套光源。红外图像由物体自身热辐射，不易受到外部光照条件等影像，具有独特的纹理特征，近红外光图像的光谱特征对血管图像敏感，并且可以穿透一定深度的皮层得到浅层的结构信息，搭配可见光图像，融合后图像有用信息多。As a preferred solution of the multi-light fusion brain localization method of the present invention, wherein: in the step S1, the infrared image comes from the self-heating radiation of the brain, and the visible light image and the near-infrared image are obtained to provide a matching light source. Infrared images are thermally radiated by the object itself, and are not easily affected by external lighting conditions. They have unique texture characteristics. The spectral characteristics of near-infrared images are sensitive to blood vessel images, and can penetrate a certain depth of cortex to obtain superficial structural information. Visible light image, the image after fusion has more useful information.
作为本发明所述的一种多光融合脑部定位方法的优选方案，其中：所述步骤S1中，红外图像经过非均匀校正、滤波等算法，可见光与近红外光进行灰度值归一化处理，得到动态响应一致性好的多光图像，以便进行图像分析处理。As a preferred solution of the multi-light fusion brain localization method according to the present invention, wherein: in the step S1, the infrared image is subjected to algorithms such as non-uniform correction and filtering, and the gray value of the visible light and the near-infrared light is normalized. After processing, a multi-light image with good dynamic response consistency is obtained for image analysis and processing.
作为本发明所述的一种多光融合脑部定位方法的优选方案，其中：所述步骤S2中，通过脑区图谱与脑部影像数据相互印证，分辨颅内脑部的包络信息，同时与脑区功能做对应关系，多光融合图像的包络细节特征构建后，与脑部影像数据的包络进行对比确定位置。As a preferred solution of the multi-optical fusion brain localization method according to the present invention, wherein: in the step S2, the brain area atlas and the brain image data are mutually verified to distinguish the envelope information of the intracranial brain, and at the same time Corresponding to the function of the brain area, after the detailed feature of the envelope of the multi-light fusion image is constructed, it is compared with the envelope of the brain image data to determine the location.
作为本发明所述的一种多光融合脑部定位方法的优选方案，其中：所述步骤S2中，同时通过红外得到脑部兴奋区域和近红外得到的浅层血管数据实验比对，查找图像信息后能够精确定位到显示的脑区位置及功能特性。As a preferred solution of the multi-optical fusion brain localization method according to the present invention, wherein: in the step S2, the experimental comparison of the brain excitation region obtained by infrared and the superficial blood vessel data obtained by near-infrared is performed, and the image is searched. After the information, the location and functional characteristics of the displayed brain regions can be precisely located.
作为本发明所述的一种多光融合脑部定位方法的优选方案，其中：所述方法还包括：S3.完成所述多光融合脑部定位后，通过输出接口传输相对脑部植入角度和位置的信息，引导植入设备自动完成植入；或者传输大脑模型和功能脑区位置与植入参考位置到显示模块，辅助人工进行植入。As a preferred solution of the multi-optical fusion brain positioning method of the present invention, wherein: the method further includes: S3. After completing the multi-optical fusion brain positioning, transmit the relative brain implantation angle through the output interface and position information, to guide the implantation device to automatically complete the implantation; or transmit the brain model and functional brain area location and implantation reference position to the display module to assist manual implantation.
本发明的有益效果如下：The beneficial effects of the present invention are as follows:
本发明提出了一种多光融合脑部定位方法，具有如下优点：The present invention proposes a multi-optical fusion brain localization method, which has the following advantages:
(1)通过融合图像，定位到脑部位置后，传递相关数据给到自动植入装置，能够指导植入装置找到植入位置，进行植入导航时易于观察，能够简单就能辨别脑部的位置信息；(1) After locating the position of the brain by fusing the images, the relevant data is transmitted to the automatic implantation device, which can guide the implantation device to find the implantation position, which is easy to observe during implantation navigation, and can easily identify the brain location information;
(2)可扩展性好，具有统一的数据管理能力，能够指导医生进行手术，也为后期脑部手术智能化打下了良好基础；(2) Good scalability, unified data management capabilities, able to guide doctors to perform operations, and lay a good foundation for later brain surgery intelligence;
(3)准确可靠，通过多光形式读取图像可以得到高于肉眼观察更多的信息，有助于判断，因此，分析处理的结果准确可靠；(3) Accurate and reliable, reading images in multi-light form can obtain more information than naked eye observation, which is helpful for judgment. Therefore, the results of analysis and processing are accurate and reliable;
(4)通用性好，依据脑区图谱与脑部影像数据比对，可以针对不同患者进行适配，不受医生经验能力等因素影响，减少医生脑部手术难度。(4) Good versatility. According to the comparison of brain area atlas and brain image data, it can be adapted for different patients, and it is not affected by factors such as the doctor's experience and ability, reducing the difficulty of brain surgery for doctors.
附图说明Description of drawings
为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图示出的结构获得其他的附图。In order to explain the embodiments of the present invention or the technical solutions in the prior art more clearly, the following briefly introduces the accompanying drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention, and for those of ordinary skill in the art, other drawings can also be obtained according to the structures shown in these drawings without creative efforts.
图1为本发明多光融合脑部定位方法的流程图；Fig. 1 is the flow chart of the multi-optical fusion brain localization method of the present invention;
图2为本发明融合图像形成示意图。FIG. 2 is a schematic diagram of forming a fusion image according to the present invention.
具体实施方式Detailed ways
下面将结合实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本发明的一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。The following will clearly and completely describe the technical solutions in the embodiments. Obviously, the described embodiments are only a part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.
需要说明，若本发明实施例中有涉及方向性指示(诸如上、下、左、右、前、后……)，则该方向性指示仅用于解释在某一特定姿态(如附图所示)下各部件之间的相对位置关系、运动情况等，如果该特定姿态发生改变时，则该方向性指示也相应地随之改变。It should be noted that if there are directional indications (such as up, down, left, right, front, back, etc.) involved in the embodiments of the present invention, the directional indications are only used to explain a certain posture (as shown in the accompanying drawings). If the specific posture changes, the directional indication also changes accordingly.
另外，若本发明实施例中有涉及“第一”、“第二”等的描述，则该“第一”、“第二”等的描述仅用于描述目的，而不能理解为指示或暗示其相对重要性或者隐含指明所指示的技术特征的数量。由此，限定有“第一”、“第二”的特征可以明示或者隐含地包括至少一个该特征。另外，各个实施例之间的技术方案可以相互结合，但是必须是以本领域普通技术人员能够实现为基础，当技术方案的结合出现相互矛盾或无法实现时应当认为这种技术方案的结合不存在，也不在本发明要求的保护范围之内。In addition, if there are descriptions involving "first", "second", etc. in the embodiments of the present invention, the descriptions of "first", "second", etc. are only used for the purpose of description, and should not be construed as indicating or implying Its relative importance or implicitly indicates the number of technical features indicated. Thus, a feature delimited with "first", "second" may expressly or implicitly include at least one of that feature. In addition, the technical solutions between the various embodiments can be combined with each other, but must be based on the realization by those of ordinary skill in the art. When the combination of technical solutions is contradictory or cannot be realized, it should be considered that the combination of such technical solutions does not exist. , is not within the scope of protection required by the present invention.
本发明提供一种多光融合脑部定位方法，能够解决现有技术中脑部手术定位不准确的问题。首先获取至少两幅多光脑部图像形成多波段图像数据；针对每个所述多波段图像数据进行分析处理，得到图像细节特征与区域特征；针对细节特征调整多光成像元件之间的空间位置关系，根据空间位置关系定位后互相叠加形成融合图像；基于融合图像的区域特征与脑区图谱进行比对，通过特征点匹配，建立头部功能脑区位置模型，加入术前脑部影像数据，建立与实际脑部模型对应关系，完成所述多光融合脑部定位。实现通过对采集的多光图像进行融合处理，与术前影像信息对比，将脑部手术部位及其功能检测和显示，既可辅助医生进行手术，也可指导植入设备进行自动控制与导航。The invention provides a multi-optical fusion brain positioning method, which can solve the problem of inaccurate brain surgery positioning in the prior art. First, obtain at least two multi-light brain images to form multi-band image data; analyze and process each of the multi-band image data to obtain image detail features and regional features; adjust the spatial position between the multi-light imaging elements according to the detail features According to the spatial position relationship, they are superimposed on each other to form a fusion image; the regional features of the fusion image are compared with the brain area map, and the location model of the head functional brain area is established through the matching of feature points, and the preoperative brain image data is added. A corresponding relationship with the actual brain model is established to complete the multi-optical fusion brain localization. By merging the collected multi-light images and comparing them with preoperative image information, the operation part of the brain and its function can be detected and displayed, which can not only assist the doctor in the operation, but also guide the implanted equipment to perform automatic control and navigation.
融合图像包含多光谱数据的特征值，其中所有光谱均有自身光谱的包络细节特征，红外能够取得头部热成像数据，近红外能够分辨出浅部脑区内的血管分布信息。而脑区图谱与脑部影像数据可以相互印证，能够分辨颅内脑部的包络信息，同时与脑区功能做对应关系。多光融合的包络细节特征构建后，与脑部影像数据的包络进行对比，通过比对沟回等初步确定位置，同时通过红外得到脑部兴奋区域，近红外得到的浅层血管数据同时比对，查找图像信息后能够精确定位到显示的脑区位置及功能特性。The fusion image contains the eigenvalues of the multispectral data, in which all spectra have their own spectral envelope details, infrared can obtain head thermal imaging data, and near-infrared can distinguish the blood vessel distribution information in the superficial brain region. The brain area map and brain image data can confirm each other, and can distinguish the envelope information of the intracranial brain, and at the same time make a corresponding relationship with the function of the brain area. After the detailed feature of the envelope of the multi-light fusion is constructed, it is compared with the envelope of the brain image data, and the position is preliminarily determined by comparing the sulci and gyri. By comparison, the location and functional characteristics of the displayed brain regions can be precisely located after searching for image information.
实施例1Example 1
本发明实施例1公开了一种多光融合脑部定位的方法，如图1所示，包括以下步骤：Embodiment 1 of the present invention discloses a method for multi-optical fusion brain localization, as shown in FIG. 1 , including the following steps:
S1.获取至少两幅多光脑部图像形成多波段图像数据，所述至少两幅多光脑部图像分别通过至少两个不同成像元件针对同一脑部部位进行成像；S1. Acquiring at least two multi-optical brain images to form multi-band image data, the at least two multi-optical brain images are respectively imaged by at least two different imaging elements for the same brain part;
具体的，本实施例中，至少两幅多光脑部图像分别通过红外、近红外、可见光采集多波段图像数据，并对每个波段的图像进行图像预处理，至少两个不同成像元件的相对位置固定。Specifically, in this embodiment, at least two multi-optical brain images collect multi-band image data through infrared, near-infrared, and visible light, respectively, and perform image preprocessing on the images of each band. Fixed position.
具体的，本实施例中，红外图像来自脑部自发热辐射，可见光、近红外光图像获取提供配套光源。红外图像经过非均匀校正、滤波算法，可见光与近红外光进行灰度值归一化处理，得到动态响应一致性好的多光图像，以便进行图像分析处理。Specifically, in this embodiment, the infrared image comes from the self-heating radiation of the brain, and a matching light source is provided for the acquisition of visible light and near-infrared light images. The infrared image is subjected to non-uniform correction and filtering algorithm, and the gray value of visible light and near-infrared light is normalized to obtain a multi-light image with good dynamic response consistency for image analysis and processing.
具体的，本实例中，针对每个所述多波段图像数据进行分析处理，通过数据分别进行特征提取，得到图像细节特征与区域特征；Specifically, in this example, analysis and processing is performed for each of the multi-band image data, and feature extraction is performed respectively through the data to obtain image detail features and regional features;
具体的，本实例中，针对细节特征调整多光成像元件之间的空间位置关系，根据空间位置关系定位后互相叠加形成融合图像；Specifically, in this example, the spatial positional relationship between the multi-light imaging elements is adjusted according to the detailed features, and the fusion image is formed by superimposing each other after positioning according to the spatial positional relationship;
具体的，在实际的调整过程中，会获取至少两幅图像中预设目标的重合程度，若重合程度不提高，则说明调整方向错误，则逆转方向来进行调整，以此不断提高图像中预设目标的重合程度，最终实现完全重合，完成图像融合。Specifically, in the actual adjustment process, the degree of overlap of the preset targets in at least two images will be obtained. If the degree of overlap does not increase, it means that the adjustment direction is wrong, and the direction will be reversed to adjust, so as to continuously improve the preset target in the image. Set the coincidence degree of the target, and finally achieve complete coincidence and complete image fusion.
S2.基于融合图像的区域特征与脑区图谱进行比对，通过特征点匹配，建立头部功能脑区位置模型，加入术前脑部影像数据，建立与实际脑部模型对应关系，完成所述多光融合脑部定位。S2. Comparing the regional features of the fusion image with the brain region map, establishing the location model of the functional brain region of the head through feature point matching, adding the preoperative brain image data, establishing the corresponding relationship with the actual brain model, and completing the above Multi-light fusion brain localization.
具体的，本实例中，通过脑区图谱与脑部影像数据相互印证，分辨颅内脑部的包络信息，同时与脑区功能做对应关系，多光融合图像的包络细节特征构建后，与脑部影像数据的包络进行对比确定位置。Specifically, in this example, the brain area atlas and the brain image data are mutually verified to distinguish the envelope information of the intracranial brain, and at the same time make a corresponding relationship with the function of the brain area. After the detailed envelope features of the multi-light fusion image are constructed, The location is determined by comparison with the envelope of the brain image data.
S3.完成所述多光融合脑部定位后，通过输出接口传输相对脑部植入角度和位置的信息，引导植入设备自动完成植入。S3. After completing the positioning of the multi-optical fusion brain, the information on the relative brain implantation angle and position is transmitted through the output interface, and the implantation device is guided to automatically complete the implantation.
实施例2Example 2
本发明实施例2公开了一种多光融合脑部定位的方法，包括以下步骤：Embodiment 2 of the present invention discloses a method for multi-optical fusion brain localization, comprising the following steps:
S1.获取至少两幅多光脑部图像形成多波段图像数据，所述至少两幅多光脑部图像分别通过至少两个不同成像元件针对同一脑部部位进行成像；S1. Acquiring at least two multi-optical brain images to form multi-band image data, the at least two multi-optical brain images are respectively imaged by at least two different imaging elements for the same brain part;
具体的，本实施例中，所述至少两幅多光脑部图像在可见光图像、近红外图像、短波红外图像、中波红外图像、以及长波红外图像中选取，并对每个波段的图像进行图像预处理。Specifically, in this embodiment, the at least two multi-optical brain images are selected from visible light images, near-infrared images, short-wave infrared images, medium-wave infrared images, and long-wave infrared images, and the images of each wavelength band are selected. Image preprocessing.
具体的，本实施例中，红外图像来自脑部自发热辐射，可见光、近红外光图像获取提供配套光源。红外图像经过非均匀校正、滤波算法，可见光与近红外光进行灰度值归一化处理，得到动态响应一致性好的多光图像，以便进行图像分析处理。Specifically, in this embodiment, the infrared image comes from the self-heating radiation of the brain, and a matching light source is provided for the acquisition of visible light and near-infrared light images. The infrared image is subjected to non-uniform correction and filtering algorithm, and the gray value of visible light and near-infrared light is normalized to obtain a multi-light image with good dynamic response consistency for image analysis and processing.
具体的，本实例中，针对每个所述多波段图像数据进行分析处理，通过数据分别进行特征提取，得到图像细节特征与区域特征；Specifically, in this example, analysis and processing is performed for each of the multi-band image data, and feature extraction is performed respectively through the data to obtain image detail features and regional features;
具体的，本实例中，针对细节特征调整多光成像元件之间的空间位置关系，根据空间位置关系定位后互相叠加形成融合图像；Specifically, in this example, the spatial positional relationship between the multi-light imaging elements is adjusted according to the detailed features, and the fusion image is formed by superimposing each other after positioning according to the spatial positional relationship;
具体的，在实际的调整过程中，会获取至少两幅图像中预设目标的重合程度，若重合程度不提高，则说明调整方向错误，则逆转方向来进行调整，以此不断提高图像中预设目标的重合程度，最终实现完全重合，完成图像融合。Specifically, in the actual adjustment process, the degree of overlap of the preset targets in at least two images will be obtained. If the degree of overlap does not increase, it means that the adjustment direction is wrong, and the direction will be reversed to adjust, so as to continuously improve the preset target in the image. Set the coincidence degree of the target, and finally achieve complete coincidence and complete image fusion.
S2.基于融合图像的区域特征与脑区图谱进行比对，通过特征点匹配，建立头部功能脑区位置模型，加入术前脑部影像数据，建立与实际脑部模型对应关系，完成所述多光融合脑部定位。S2. Comparing the regional features of the fusion image with the brain region map, establishing the location model of the functional brain region of the head through feature point matching, adding the preoperative brain image data, establishing the corresponding relationship with the actual brain model, and completing the above Multi-light fusion brain localization.
具体的，本实例中，通过脑区图谱与脑部影像数据相互印证，分辨颅内脑部的包络信息，同时与脑区功能做对应关系，多光融合图像的包络细节特征构建后，与脑部影像数据的包络进行对比确定位置，同时通过红外得到脑部兴奋区域和近红外得到的浅层血管数据实验比对，查找图像信息后能够精确定位到显示的脑区位置及功能特性。Specifically, in this example, the brain area atlas and the brain image data are mutually verified to distinguish the envelope information of the intracranial brain, and at the same time make a corresponding relationship with the function of the brain area. After the detailed envelope features of the multi-light fusion image are constructed, The location is determined by comparing with the envelope of the brain image data. At the same time, the brain excitation region obtained by infrared and the superficial blood vessel data obtained by near-infrared are compared experimentally. After finding the image information, the location and functional characteristics of the displayed brain area can be accurately located. .
S3.传输大脑模型和功能脑区位置与植入参考位置到显示模块，辅助人工进行植入。S3. Transmit the location of the brain model and functional brain regions and the reference location of implantation to the display module to assist in the artificial implantation.
实施例3Example 3
本发明实施例3公开了一种多光融合脑部定位方法，通过多光融合数据得到融合图像，融合图像包含多光谱数据的特征值。其中所有光谱均有自身光谱的包络细节特征，红外能够取得头部热成像数据，近红外能够分辨出浅部脑区内的血管分布信息。而脑区图谱与脑部影像数据可以相互印证，能够分辨颅内脑部的包络信息，同时与脑区功能做对应关系。多光融合的包络细节特征构建后，与脑部影像数据的包络进行对比，通过比对沟回等初步确定位置，同时通过红外得到脑部兴奋区域，近红外得到的浅层血管数据同时比对，查找图像信息后能够精确定位到显示的脑区位置及功能特性。Embodiment 3 of the present invention discloses a multi-optical fusion brain localization method. A fusion image is obtained by using multi-optical fusion data, and the fusion image includes characteristic values of the multi-spectral data. All of the spectra have their own spectral envelope details, infrared can obtain head thermal imaging data, and near-infrared can distinguish blood vessel distribution information in the superficial brain region. The brain area map and brain image data can confirm each other, and can distinguish the envelope information of the intracranial brain, and at the same time make a corresponding relationship with the function of the brain area. After the detailed feature of the envelope of the multi-light fusion is constructed, it is compared with the envelope of the brain image data, and the position is preliminarily determined by comparing the sulci and gyri. By comparison, the location and functional characteristics of the displayed brain regions can be precisely located after searching for image information.
通过融合后的图像，定位到脑部位置后，传递相关数据给到自动植入装置，能够指导植入装置找到植入位置，进行植入导航。Through the fused image, after locating the position of the brain, relevant data is transmitted to the automatic implantation device, which can guide the implantation device to find the implantation position and perform implantation navigation.
数据分析能够精确定位离不开多光融合模块，融合图像形成示意图如图2所示，前端为多光图像，每路光谱均需按各自图像处理方式处理，并取得各自特性数据，经过分析可得到融合图像。可见光、近红外光、红外光均需进行各自图像预处理，得到响应一致性较好的图像。The accurate positioning of data analysis is inseparable from the multi-optical fusion module. The schematic diagram of the fusion image formation is shown in Figure 2. The front end is a multi-optical image. Each spectrum needs to be processed according to its own image processing method, and its own characteristic data can be obtained. Get the fused image. Visible light, near-infrared light, and infrared light all need to undergo image preprocessing to obtain images with better response consistency.
对预处理后的图像，经过图像增强、高斯滤波分离高低频图像数据等方法，将图像的细节进行分离，提取到各自的包络特征、细节特征等特征信息。通过将多光的包络特征相关性计算，得到图像之间的相对关系，进而为融合找到定位点。然后将各光谱图像归一化处理，将细节合并到图像上，得到包含由各类信息的融合图像，以便定位系统进行分析。For the preprocessed image, through image enhancement, Gaussian filtering and other methods to separate high and low frequency image data, the details of the image are separated, and the respective feature information such as envelope features and detail features are extracted. By calculating the correlation of the envelope features of the multi-light, the relative relationship between the images is obtained, and then the positioning point is found for the fusion. Then, each spectral image is normalized, and the details are merged into the image to obtain a fusion image containing various types of information for analysis by the positioning system.
基于前述实施例，本实施例提供一种多光融合脑部定位系统，该多光融合脑部定位系统实现前述实施例的定位方法。Based on the foregoing embodiments, this embodiment provides a multi-optical fusion brain localization system, and the multi-optical fusion brain localization system implements the localization methods of the foregoing embodiments.
在本发明所提供的几个实施例中，应该理解到，所揭露的方法和系统，也可以通过其它的方式实现。以上所描述的装置实施例仅仅是示意性的，例如，附图中的流程图和结构图显示了根据本发明的多个实施例的装置、方法和计算机程序产品的可能实现的体系架构、功能和操作。在这点上，流程图或框图中的每个方框可以代表一个模块、程序段或代码的一部分，所述模块、程序段或代码的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。也应当注意，在作为替换的实现方式中，方框中所标注的功能也可以以不同于附图中所标注的顺序发生。例如，两个连续的方框实际上可以基本并行地执行，它们有时也可以按相反的顺序执行，这依所涉及的功能而定。也要注意的是，结构图和/或流程图中的每个方框、以及结构图和/或流程图中的方框的组合，可以用执行规定的功能或动作的专用的基于硬件的系统来实现，或者可以用专用硬件与计算机指令的组合来实现。In the several embodiments provided by the present invention, it should be understood that the disclosed method and system may also be implemented in other manners. The apparatus embodiments described above are only schematic, for example, the flowcharts and structural diagrams in the accompanying drawings show the possible implementation architectures and functions of the apparatuses, methods and computer program products according to various embodiments of the present invention and operation. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code that contains one or more functions for implementing the specified logical function(s) executable instructions. It should also be noted that, in alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It is also noted that each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart diagrams, can be implemented using dedicated hardware-based systems that perform the specified functions or actions. be implemented, or may be implemented in a combination of special purpose hardware and computer instructions.
另外，在本发明各个实施例中的各功能模块或单元可以集成在一起形成一个独立的部分，也可以是各个模块单独存在，也可以两个或更多个模块集成形成一个独立的部分。In addition, each functional module or unit in each embodiment of the present invention may be integrated to form an independent part, or each module may exist alone, or two or more modules may be integrated to form an independent part.
以上所述仅为本发明的优选实施例，并非因此限制本发明的专利范围，凡是在本发明的发明构思下，利用本发明说明书内容所作的等效结构变换，或直接/间接运用在其他相关的技术领域均包括在本发明的专利保护范围内。The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the scope of the present invention. Under the inventive concept of the present invention, the equivalent structural transformation made by the content of the present invention is used, or the direct/indirect application in other related All technical fields are included in the scope of patent protection of the present invention.
Claims (10)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210772992.4ACN115005989A (en) | 2022-06-30 | 2022-06-30 | A multi-optical fusion brain localization method and corresponding localization system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210772992.4ACN115005989A (en) | 2022-06-30 | 2022-06-30 | A multi-optical fusion brain localization method and corresponding localization system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115005989Atrue CN115005989A (en) | 2022-09-06 |
Family
ID=83078745
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210772992.4APendingCN115005989A (en) | 2022-06-30 | 2022-06-30 | A multi-optical fusion brain localization method and corresponding localization system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115005989A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115024819A (en)* | 2022-06-30 | 2022-09-09 | 武汉衷华脑机融合科技发展有限公司 | Multi-light fusion brain positioning system |
| CN115564748A (en)* | 2022-10-20 | 2023-01-03 | 上海联影智能医疗科技有限公司 | Display method, computer device, and storage medium |
| CN115708678A (en)* | 2022-11-21 | 2023-02-24 | 昆明理工大学 | Brain-computer interface experimental method based on functional near infrared |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080081982A1 (en)* | 2006-09-29 | 2008-04-03 | Medtronic, Inc. | Method And Apparatus For Optimizing A Computer Assisted Surgical Procedure |
| EP2419007A1 (en)* | 2009-04-17 | 2012-02-22 | Technische Universität Dresden | Method and device for intraoperative imaging of brain areas |
| KR20210099237A (en)* | 2020-02-03 | 2021-08-12 | 고려대학교 산학협력단 | Method for fusing multi-modal image and multi-modal image surgery guided apparatus for performing the same |
| CN114463304A (en)* | 2022-01-29 | 2022-05-10 | 华科精准（北京）医疗科技有限公司 | A method for segmentation and labeling of brain atlas and surgical navigation system |
| CN115024819A (en)* | 2022-06-30 | 2022-09-09 | 武汉衷华脑机融合科技发展有限公司 | Multi-light fusion brain positioning system |
- 2022
- 2022-06-30CNCN202210772992.4Apatent/CN115005989A/enactivePending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080081982A1 (en)* | 2006-09-29 | 2008-04-03 | Medtronic, Inc. | Method And Apparatus For Optimizing A Computer Assisted Surgical Procedure |
| EP2419007A1 (en)* | 2009-04-17 | 2012-02-22 | Technische Universität Dresden | Method and device for intraoperative imaging of brain areas |
| KR20210099237A (en)* | 2020-02-03 | 2021-08-12 | 고려대학교 산학협력단 | Method for fusing multi-modal image and multi-modal image surgery guided apparatus for performing the same |
| CN114463304A (en)* | 2022-01-29 | 2022-05-10 | 华科精准（北京）医疗科技有限公司 | A method for segmentation and labeling of brain atlas and surgical navigation system |
| CN115024819A (en)* | 2022-06-30 | 2022-09-09 | 武汉衷华脑机融合科技发展有限公司 | Multi-light fusion brain positioning system |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115024819A (en)* | 2022-06-30 | 2022-09-09 | 武汉衷华脑机融合科技发展有限公司 | Multi-light fusion brain positioning system |
| CN115564748A (en)* | 2022-10-20 | 2023-01-03 | 上海联影智能医疗科技有限公司 | Display method, computer device, and storage medium |
| CN115708678A (en)* | 2022-11-21 | 2023-02-24 | 昆明理工大学 | Brain-computer interface experimental method based on functional near infrared |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN115005989A (en) | A multi-optical fusion brain localization method and corresponding localization system | |
| KR101572487B1 (en) | System and Method For Non-Invasive Patient-Image Registration | |
| US11986252B2 (en) | ENT image registration | |
| JP4849755B2 (en) | Imaging apparatus and sample analysis method | |
| JP6745998B2 (en) | System that provides images to guide surgery | |
| CN114283179B (en) | Fracture far-near end space pose real-time acquisition and registration system based on ultrasonic image | |
| CN116570370B (en) | A spinal needle puncture navigation system | |
| CN107822600A (en) | Device and system and method for work applied to hyperplasic vascular dermatosis detection, positioning | |
| CN117618109A (en) | MRI-based breast surgery preoperative focus positioning and puncture guiding system | |
| CN105534606A (en) | Intelligent imaging system for surgical operation | |
| CN114300095A (en) | Image processing apparatus, image processing method, apparatus, device, and storage medium | |
| CN118154775A (en) | Method and system for constructing three-dimensional model of lung airway | |
| CN109363676A (en) | A method for detecting the symmetry of double breasts in breast electrical impedance scanning imaging | |
| CN115024819A (en) | Multi-light fusion brain positioning system | |
| CN115607286A (en) | Knee joint replacement surgery navigation method, system and equipment based on binocular calibration | |
| Wu et al. | UltraBones100k: A reliable automated labeling method and large-scale dataset for ultrasound-based bone surface extraction | |
| CN112352289A (en) | Method and system for providing ECG analysis interface | |
| CN104224321B (en) | Use operation guiding system and the surface adjustment signal acquisition method of wireless surface adjustment | |
| WO2018109227A1 (en) | System providing images guiding surgery | |
| US11850022B2 (en) | NIR image-guided targeting | |
| CN113842212A (en) | Fluorescence scattering optical tomography processing method and system | |
| WO2018027793A1 (en) | Method and system for visually localizing brain functional structure in craniotomy | |
| CN118236174B (en) | Surgical assistance system, method, electronic device, and computer storage medium | |
| EP4555964A1 (en) | Projection apparatus for analysing objects of interest on or over a surface of a subject | |
| CN119867935B (en) | Multimodal electromagnetic navigation-assisted transnasal endoscopic anatomical measurement device and method for fresh cadaver heads |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |