Nerve feedback system fusing individualized brain rhythm ratio and forehead myoelectricity energyTechnical Field
The invention relates to a nerve feedback system fusing an individualized brain rhythm ratio and forehead electromyogram energy, in particular to a nerve feedback training technology for realizing attention improvement training and mood relaxation regulation by fusing the individualized brain rhythm ratio and forehead electromyogram energy.
Background
Neurofeedback generally refers to collecting and calculating a neural signal index (e.g., brain wave EEG, functional magnetic resonance imaging fMRI) in real time during cognitive training, and then feeding the neural signal index to a trainee in a visual or auditory situation, so that the trainee can learn to self-regulate brain functions according to the fed-back information.
Electroencephalography (EEG) is the most effective and most widely used tool for nerve detection. The brain nerve rhythm information can be obtained by dividing the brain electricity according to specific frequency bands, such as Delta (2-4Hz), Theta (4-8Hz), Alpha (8-13Hz), Beta (13-30Hz) and the like, and can directly reflect the state of a brain nerve system. According to the recent development of brain science and technology, a new technology is designed, the characteristics reflecting the state of the nervous system of a user are obtained by collecting signals of brain electricity and the like in real time and analyzing the nervous rhythm of the user, and the user is guided to self-regulate the rhythm of the cerebral nervous system through audio and video feedback so as to influence the state of the cerebral nervous system, and the technology is called as cerebral nervous feedback technology.
We notice that when the attention of children is deficient, the frontal lobe rhythm of the brain of the children is changed specifically, and based on the specific change of the rhythm of the brain, the attention of the children can be improved by utilizing a brain nerve feedback technology. Currently, the cerebral neurofeedback technology is beginning to be applied in attention level regulation and relaxation improvement training of emotion. For example, attention level is low, and excessive movement/impulse is caused in children with hyperactivity, and electroencephalogram has the characteristics that low-frequency energy rises and high-frequency energy falls, so that the low-frequency/high-frequency energy ratio can be used for attention level training of children with hyperactivity. However, it has been found that the neuro-cerebral feedback technique is not effective in all children, for example, the low/high frequency ratio training method is only effective in 70% of children with hyperactivity, and may even risk a reduction in attention level and deterioration of mood. The main reason is that the current cranial nerve feedback technology adopts uniform neural rhythm division, actually, the development conditions of the cranial nerve system of each person are different, the brain rhythm is different, and the uniform frequency band division cannot completely represent the real condition of the cranial nerve system.
The invention focuses on designing individualized rhythm division, and for each user performing the cerebral nerve feedback training, the real frequency band division can be obtained in a self-adaptive manner through the creative design algorithm, so that more effective feedback indexes are obtained, and the nerve feedback training effect which is targeted and has no side effect is achieved. In addition, we have found that many cranial nervous system disorders result in impaired tension-relaxation control of the forehead muscles, which are constantly at high levels. The forehead myoelectricity is mainly generated by frown muscle-forehead muscle, and the excessive forehead myoelectricity can reflect the problems of mental emotion tension or mental stress and the like, so that the state of a nervous system can be inferred through the forehead myoelectricity, and the user is guided to adjust the forehead myoelectricity in a nerve feedback mode, so that the user is guided to adjust the emotional condition. Meanwhile, the forehead myoelectricity is large, so that the collection of electroencephalogram signals can be influenced.
The prior art has the following disadvantages:
1. because the development conditions of the cranial nerve systems of all users are different, the feedback characteristics are inaccurate because the individual rhythm of the cranial nerve systems is not really reflected by adopting the uniform electroencephalogram signal frequency band division;
2. the individual users have great difference, and the adoption of the cranial nerve feedback training in a fixed mode can possibly be ineffective or even counterproductive to a great part of trainers;
3. the existing brain nerve feedback training system mainly adopts electroencephalogram for feedback, objectively forehead electromyogram signals are also valuable data, and can directly reflect characteristics such as psychological emotion and the like, and the existing nerve feedback training system ignores important neuropsychological emotion elements and does not apply forehead electromyogram signals.
Therefore, the technology of the invention provides a nerve feedback system fusing an individualized brain rhythm ratio and forehead electromyogram energy, which adopts the individualized brain rhythm and fuses the forehead electromyogram signal to carry out the brain nerve feedback training, thereby improving the effectiveness of the brain nerve feedback training.
Disclosure of Invention
Based on the technical problems in the background technology, the invention provides a brain nerve feedback training technology adopting an individualized brain rhythm aiming at the problems in the background technology, and the technology is started to integrate the individualized brain rhythm ratio and forehead electromyographic signals, so that the brain nerve feedback training can be efficiently and safely used for attention level training and emotion relaxation regulation.
The purpose of the invention is realized by the following technical scheme:
aiming at the safety problems that real brain nerve rhythm cannot be reflected by fixed frequency band division and training is invalid and even causes damage to a user possibly due to subsequent training, the technology provides a nerve feedback system integrating individualized brain rhythm ratio and forehead myoelectric energy and a using method thereof, and specifically provides a self-adaptive individualized electroencephalogram rhythm division mode.
According to the invention, the forehead myoelectric signals are fused for nerve feedback, so that on one hand, the physiological value of the forehead myoelectric signals is fully utilized, and on the other hand, the influence of the myoelectric signals on the brain signals can be reduced; therefore, such a fused neurofeedback training system would have higher performance.
The invention discloses a nerve feedback system fusing individualized brain rhythm ratio and forehead myoelectricity energy, which comprises a forehead myoelectricity and cranial nerve signal acquisition module, a real-time signal processing module, a characteristic fusion module and a feedback control module.
The invention also optimizes the algorithm of the collected forehead myoelectric and cranial nerve signals to obtain precision greatly superior to the prior art, realizes precise medical treatment, and is effective and free of side effect.
Preferably, the specific workflow of the neural feedback system fusing the individualized brain rhythm ratio and the forehead myoelectric energy is as follows:
(1) collecting resting brain electricity before training, and recording brain electricity of electrodes P1, P2, Pz, O1 and O2 by taking ear-linked (ear-linked) as reference; open eye conditions (EO) and closed Eye Conditions (EC) were each three minutes. The recorded data is divided into length signals of 4s, and the division sections are overlapped by 50 percent;
(2) removing artifacts in the segmented electroencephalogram, wherein the artifacts in the EEG comprise eye movement, blinking, power frequency and myoelectricity, detecting each segment, and discarding the segment of segmented signals once the artifacts exceed a given threshold;
(3) respectively calculating the resting state electroencephalograms under two conditions (EO and EC) to respectively obtain power spectral density curves:
(4) compared with electroencephalography under EC conditions, the frequency band with power spectrum energy reduced by more than 20% under EO conditions is considered as personalized Alpha band partitioning (IAF);
(5) according to the IAF division, taking the range from 3Hz to the lower boundary of the IAF as a Theta waveband, and taking the range from the upper boundary of the IAF to 18Hz as the Beta waveband;
(6) calculating the low-frequency/high-frequency energy ratio of the ith segment, namely Theta/Beta ratio (TBR), according to the segment data of the resting electroencephalogram under the EO condition:
(7) collecting forehead electromyogram signals, and recording the forehead brow muscle-forehead muscle position. Cutting the signal into sections with the length of 1s without superposition; calculating the mean square energy of the electromyographic signal of the ith segment:
(8) marking the state of the electromyographic signals, distinguishing the steady state from the muscle action state:
Ethr=μ+Tδ
wherein mu and delta are the average value and standard deviation of mean square energy of all segmented myoelectricity, and T is used for adjusting tolerance degree. Here, we take T-3.
(9) The mean square energy of the resting electroencephalogram TBR and the electromyogram signal in a stable state is used as a training baseline.
(10) In the training process, the electroencephalogram of the occipital area and the myoelectricity of the forehead are collected in real time, the TBR based on the IAF is calculated in real time, and the parameters are as follows: the window length is 1s, the superposition is 50%, 1024-point fast Fourier transform is performed, and a Hamming window is adopted to reduce frequency spectrum leakage; the mean square energy of the forehead electromyogram signal is real-time, the window length is 0.5s, no coincidence exists, 512-point fast Fourier transform is performed, and a Hamming window is adopted to reduce frequency spectrum leakage.
(11) The feedback control strategy is: awarding a reward when both conditions one and two are met, otherwise awarding a penalty: compared with a resting baseline, the TBR is reduced by 20 percent; the mean square energy of the real-time myoelectricity does not exceed the sum of the average value of the forehead myoelectricity in a stable state and 3 times of standard deviation.
In the neural feedback training process, the acquisition equipment respectively acquires the electroencephalogram signals and the forehead electromyogram signals, and respectively analyzes the signals to extract corresponding characteristics.
The technical core is to fuse the forehead myoelectric index obtained by calculation with the individual rhythm ratio index to obtain an accurate state index of the cranial nerve system, and then control a nerve feedback system to ensure that audio and video feedback is consistent with the current requirement of cranial nerve feedback training. Finally, a real-time forehead myoelectric and cranial nerve signal acquisition-real-time signal processing-feature fusion-feedback control nerve feedback training technology is formed.
The technology adopts the individualized rhythm ratio as one of the training indexes, overcomes the problem of low effective rate caused by inaccurate rhythm division of the cranial nerve system caused by adopting fixed frequency band division, and simultaneously avoids the safety problem caused by subsequent inaccurate training; the technology integrates the individualized rhythm ratio and the forehead myoelectric signal, integrates the nerve psychology emotion characterization advantage of the forehead myoelectric, and improves the effectiveness of nerve feedback training.
The invention has the advantages that:
compared with the traditional division mode adopting fixed brain rhythms, the method has the advantages that the individualized rhythms can reflect the real state of the brain nervous system, so that the effectiveness and the safety of the neural feedback training are ensured; another great advantage is that the neural rhythm information and the forehead myoelectric information are fused, and the brain nervous system development disorder is described from more dimensions, so that the effectiveness of the neural feedback training is improved.
Detailed Description
FIG. 1 is a flow chart of the neural feedback method fusing individualized brain rhythm ratio and forehead myoelectric energy according to the present invention.
Detailed Description
According to the invention, the forehead myoelectric signals are fused for nerve feedback, so that on one hand, the physiological value of the forehead myoelectric signals is fully utilized; on the other hand, the effect of myoelectricity on brain signals can also be reduced. Therefore, the fused neurofeedback training system has higher safety and effectiveness.
The technology adopts the individualized rhythm ratio as one of the training indexes, overcomes the problem of low effective rate caused by inaccurate rhythm division of the cranial nerve system caused by adopting fixed frequency band division, and simultaneously avoids the safety problem caused by subsequent inaccurate training; the technology integrates the individualized rhythm ratio and the forehead myoelectric signal, integrates the nerve psychology emotion characterization advantage of the forehead myoelectric, and improves the effectiveness of nerve feedback training.
The nerve feedback method fusing the individualized brain rhythm ratio and the forehead myoelectric energy comprises the following specific working procedures:
(1) collecting resting brain electricity before training, recording brain electricity of electrodes P1, P2, Pz, O1 and O2 by taking binaural connection as reference; open eye conditions (EO) and closed Eye Conditions (EC) were each three minutes. The recorded data is divided into length signals of 4s, and the division sections are overlapped by 50 percent;
(2) removing artifacts in the segmented electroencephalogram, wherein the artifacts in the EEG comprise eye movement, blinking, power frequency and myoelectricity, detecting each segment, and discarding the segment of segmented signals once the artifacts exceed a given threshold;
(3) respectively calculating the resting state electroencephalograms under two conditions (EO and EC) to respectively obtain power spectral density curves:
(4) compared with electroencephalography under EC conditions, the frequency band with power spectrum energy reduced by more than 20% under EO conditions is considered as personalized Alpha band partitioning (IAF);
(5) according to the IAF division, taking the range from 3Hz to the lower boundary of the IAF as a Theta waveband, and taking the range from the upper boundary of the IAF to 18Hz as the Beta waveband;
(6) calculating the low-frequency/high-frequency energy ratio of the ith segment, namely Theta/Beta ratio (TBR), according to the segment data of the resting electroencephalogram under the EO condition:
(7) collecting forehead electromyogram signals, and recording the forehead brow muscle-forehead muscle position. Cutting the signal into sections with the length of 1s without superposition; calculating the mean square energy of the electromyographic signal of the ith segment:
(8) a threshold for marking the state of the electromyographic signals and distinguishing the stable state from the muscle action state:
Ethr=μ+Tδ
wherein mu and delta are the average value and standard deviation of mean square energy of all segmented myoelectricity, and T is used for adjusting tolerance degree. Here, we take T ═ 3;
(9) using the mean square energy of the resting electroencephalogram TBR and the electromyogram signal in a stable state as a training baseline;
(10) in the training process, the electroencephalogram of the occipital area and the myoelectricity of the forehead are collected in real time, the TBR based on the IAF is calculated in real time, and the parameters are as follows: the window length is 1s, the superposition is 50%, 1024-point fast Fourier transform is performed, and a Hamming window is adopted to reduce frequency spectrum leakage; real-time forehead electromyogram signal mean square energy, wherein the parameter is the window length of 0.5s, no coincidence exists, 512-point fast Fourier transform is performed, and a Hamming window is adopted to reduce frequency spectrum leakage;
(11) the feedback control strategy is: awarding a reward when both conditions one and two are met, otherwise awarding a penalty: compared with a resting baseline, the TBR is reduced by 20 percent; the mean square energy of the real-time myoelectricity does not exceed the sum of the average value of the forehead myoelectricity in a stable state and 3 times of standard deviation.
In the neural feedback training process, the acquisition equipment respectively acquires the electroencephalogram signals and the forehead electromyogram signals, and respectively analyzes the signals to extract corresponding characteristics. The technical core is to fuse the forehead myoelectric index obtained by calculation with an individual rhythm ratio index to obtain an accurate state index of a cranial nerve system, then control a nerve feedback system to ensure that audio and video feedback is consistent with the current requirement of cranial nerve feedback training, and finally form a real-time forehead myoelectric and cranial nerve signal acquisition-real-time signal processing-feature fusion-feedback control nerve feedback training technology.
The technology adopts the individualized rhythm ratio as one of the training indexes, overcomes the problem of low effective rate caused by inaccurate rhythm division of the cranial nerve system caused by adopting fixed frequency band division, and simultaneously avoids the safety problem caused by subsequent inaccurate training; the technology integrates the individualized rhythm ratio and the forehead myoelectric signal, integrates the nerve psychology emotion characterization advantage of the forehead myoelectric, and improves the effectiveness of nerve feedback training.
The above description is only for the preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art should be considered to be within the technical scope of the present invention, and the technical solutions and the inventive concepts thereof according to the present invention should be equivalent or changed within the scope of the present invention.