技术领域Technical Field
本发明涉及记忆认知能力测评技术领域，尤其涉及一种记忆认知能力测评方法及系统。The present invention relates to the technical field of memory and cognitive ability evaluation, and in particular to a memory and cognitive ability evaluation method and system.
背景技术Background technique
记忆是过去经验在人脑中的反映，用信息加工的观点解释记忆，把记忆看作是对输入信息的编码、存储和在一定条件下提取的过程。记忆认知能力是评价个体智力的重要维度，是认知能力水平的重要表现，对作业人员的作业过程有重要影响。现代人机系统的交互界面复杂，包含大量信息加工成分，如果操作者记忆认知能力过低时，容易出现记忆负荷过载的情况，面对紧急情况，无法快速识别面板提供的信息并做出正确反应，严重威胁系统的效率及安全性。人机交互中发生人因失误的一个主要原因就是记忆负荷过载。因此，记忆认知能力的测量和训练，对特殊作业人员筛选、职业测评、人因操作过程等具有实际意义。传统的记忆认知能力测评方法，有直接测量和间接测量的两种方式。直接测量是对感知过的信息进行回忆或再认，比如对刚刚展示过的数字是否回忆起来；间接测量是采用词干补笔或知觉辨认，通过减少个体认知负荷测量实际记忆认知能力。无论哪种测量方式，测试内容都比较简单，并且忽视了作业人员的当前状态、心理负荷、脑力负荷程度等个体参与测评时的实际状态，尚未存在将生理数据纳入测评标准进行更精确的记忆认知能力测量。目前，记忆测评系统存在评估方式单一、忽略个体差异、无法针对不同作业人员的记忆特点进行准确的测评分析，影响实际测试结果等问题。Memory is the reflection of past experience in the human brain. Memory is explained from the perspective of information processing, and is regarded as the process of encoding, storing and extracting input information under certain conditions. Memory cognitive ability is an important dimension for evaluating individual intelligence, an important manifestation of cognitive ability level, and has an important impact on the operation process of operators. The interactive interface of modern human-machine systems is complex and contains a large number of information processing components. If the operator's memory cognitive ability is too low, memory overload is likely to occur. In the face of an emergency, it is impossible to quickly identify the information provided by the panel and make a correct response, which seriously threatens the efficiency and safety of the system. One of the main reasons for human errors in human-computer interaction is memory overload. Therefore, the measurement and training of memory cognitive ability is of practical significance for the screening of special operators, occupational assessment, and human operation process. There are two traditional methods for evaluating memory cognitive ability: direct measurement and indirect measurement. Direct measurement is to recall or recognize the perceived information, such as whether the numbers just displayed are recalled; indirect measurement is to use stem completion or perceptual recognition to measure the actual memory cognitive ability by reducing the individual cognitive load. Regardless of the measurement method, the test content is relatively simple and ignores the actual state of the individual when participating in the assessment, such as the current state of the operator, psychological workload, and mental workload. There is no method that incorporates physiological data into the assessment criteria for more accurate measurement of memory and cognitive abilities. At present, the memory assessment system has problems such as a single assessment method, ignoring individual differences, and being unable to conduct accurate assessment and analysis based on the memory characteristics of different operators, which affects the actual test results.
发明内容Summary of the invention
有鉴于此，本发明提供了一种记忆认知能力测评方法及系统，以解决现有技术中存在的一个或多个问题。In view of this, the present invention provides a memory cognitive ability assessment method and system to solve one or more problems existing in the prior art.
根据本发明的一个方面，本发明公开了一种记忆认知能力测评方法，所述方法包括：According to one aspect of the present invention, the present invention discloses a method for evaluating memory and cognitive ability, the method comprising:
根据与操作人员相匹配的测试内容对操作人员进行记忆认知能力测试，得到所述操作人员的测试结果；Performing a memory and cognitive ability test on the operator according to the test content matching the operator, and obtaining the test result of the operator;
获取操作人员在测试过程中的心率变异性HRV指标、眼动指标或脑电指标中的至少一个生理数据，基于获取到的所述生理数据确定所述操作人员的心理负荷指数；Acquire at least one physiological data of the operator's heart rate variability HRV index, eye movement index or EEG index during the test, and determine the operator's mental load index based on the acquired physiological data;
基于操作人员的所述测试结果及操作人员的心理负荷指数确定所述操作人员的理论记忆水平。The theoretical memory level of the operator is determined based on the test result of the operator and the mental load index of the operator.
在本发明的一些实施例中，所述方法还包括：In some embodiments of the present invention, the method further comprises:
根据与操作人员相匹配的测试内容对操作人员的记忆保持量进行多次间隔测试；Conduct multiple interval tests on the operator's memory retention based on test content that matches the operator;
并基于各记忆保持量及其对应的测试时间生成遗忘曲线；And generate a forgetting curve based on each memory retention amount and its corresponding test time;
根据遗忘曲线及操作人员的所述测试结果确定所述操作人员适合的记忆策略及记忆训练内容。The memory strategy and memory training content suitable for the operator are determined according to the forgetting curve and the test results of the operator.
在本发明的一些实施例中，所述方法还包括：获取操作人员的个人信息；所述个人信息包括年龄和职业信息；In some embodiments of the present invention, the method further comprises: obtaining personal information of the operator; the personal information comprises age and occupation information;
根据获取到的操作人员的个人信息确定与所述操作人员相匹配的测试内容。The test content matching the operator is determined according to the acquired personal information of the operator.
在本发明的一些实施例中，所述方法还包括：In some embodiments of the present invention, the method further comprises:
根据与多个成员中的各成员相匹配的测试内容分别对各成员进行记忆认知能力测试，得到各个成员的测试结果；Performing memory and cognitive ability tests on each member according to the test content matched with each member of the plurality of members, and obtaining test results of each member;
基于各个成员的测试结果建立动态常模；Establish dynamic norms based on the test results of each member;
基于所述动态常模以及操作人员的所述测试结果确定所述操作人员的常模水平。A norm level of the operator is determined based on the dynamic norm and the test result of the operator.
在本发明的一些实施例中，所述测试内容为视觉记忆、听觉记忆、空间记忆、情境记忆以及语义记忆中的至少一种。In some embodiments of the present invention, the test content is at least one of visual memory, auditory memory, spatial memory, situational memory and semantic memory.
在本发明的一些实施例中，所述测试结果包括：记忆广度值、记忆容量以及记忆速度；或In some embodiments of the present invention, the test results include: memory span value, memory capacity and memory speed; or
基于获取到的所述生理数据确定所述操作人员的心理负荷指数，包括：Determining the operator's psychological load index based on the acquired physiological data includes:
将获取到的所述生理数据输入预训练模型，基于所述预训练模型确定所述操作人员的心理负荷指数。The acquired physiological data is input into a pre-training model, and the psychological load index of the operator is determined based on the pre-training model.
在本发明的一些实施例中，In some embodiments of the present invention,
所述心率变异性HRV指标包括R-R间期平均值AVNN、平均心率AVHR、R-R间期标准差SDNN、相邻两个R-R间期差值的均方根RMSSD、相邻两个R-R间期之差大于50ms占全部R-R间期的百分比PNN50；The heart rate variability HRV index includes the average value of R-R interval AVNN, the average heart rate AVHR, the standard deviation of R-R interval SDNN, the root mean square RMSSD of the difference between two adjacent R-R intervals, and the percentage PNN50 of the difference between two adjacent R-R intervals greater than 50ms in all R-R intervals;
所述眼动指标包括注视时间、注视次数、扫视频率、扫视速度、扫视幅度及瞳孔直径；The eye movement indicators include fixation time, fixation times, scan frequency, scan speed, scan amplitude and pupil diameter;
所述脑电指标包括状态相关脑波复杂度Cs。The EEG index includes state-related EEG complexity Cs.
在本发明的一些实施例中，获取操作人员在测试过程中的心率变异性HRV指标、眼动指标或脑电指标中的至少一个生理数据，基于获取到的所述生理数据确定所述操作人员的心理负荷指数包括：In some embodiments of the present invention, obtaining at least one physiological data of a heart rate variability HRV index, an eye movement index, or an EEG index of an operator during a test, and determining the psychological load index of the operator based on the obtained physiological data includes:
获取指尖、手环或耳夹传感器检测到的操作人员的PPG信号；Obtain the operator's PPG signal detected by the fingertip, bracelet or ear clip sensor;
基于获取到的所述PPG信号确定所述心率变异性HRV指标。The heart rate variability HRV index is determined based on the acquired PPG signal.
在本发明的一些实施例中，所述方法还包括：生成包括操作人员信息、操作人员的测试结果、心理负荷指数、常模水平、理论记忆水平的测试报告。In some embodiments of the present invention, the method further comprises: generating a test report including operator information, operator test results, mental load index, normative level, and theoretical memory level.
根据本发明的另一方面，还公开了一种记忆认知能力测评系统，所述系统包括：处理器；以及存储器，存储器上存储有计算机程序，当所述处理器执行存储器上存储的计算机程序时，所述记忆认知能力测评系统用于实现如上任一实施例所述的记忆认知能力测评方法。According to another aspect of the present invention, a memory and cognitive ability assessment system is also disclosed, the system comprising: a processor; and a memory, wherein a computer program is stored in the memory. When the processor executes the computer program stored in the memory, the memory and cognitive ability assessment system is used to implement the memory and cognitive ability assessment method described in any of the above embodiments.
本发明实施例中的记忆认知能力测评方法及系统，在对操作人员进行测评时获取操作人员的心率变异性HRV指标、眼动指标或脑电指标中的至少一个生理数据，通过训练模型获得操作人员的心理负荷指数，并基于操作人员的心理负荷指数确定操作人员的理论记忆水平，该测评方法综合考虑了不同操作人员之间的个体差异性，从而使测试结果更准确，更具有针对性。该测评系统将主观调查问卷、行为测验与多种生理数据利用机器学习与相关公式，实现多模态数据融合，能够快速准确的捕获多模态数据中固有的内部结构和外部关系，评估个体的记忆认知能力。另外，该测评方法基于操作人员的测试结果以及遗忘曲线为操作人员确定适合的记忆策略及训练内容，从而提高了操作人员的记忆效率。The memory cognitive ability evaluation method and system in the embodiment of the present invention obtains at least one physiological data of the operator's heart rate variability HRV index, eye movement index or EEG index when evaluating the operator, obtains the operator's psychological load index through a training model, and determines the operator's theoretical memory level based on the operator's psychological load index. The evaluation method comprehensively considers the individual differences between different operators, so that the test results are more accurate and more targeted. The evaluation system uses machine learning and related formulas to achieve multimodal data fusion of subjective questionnaires, behavioral tests and various physiological data, and can quickly and accurately capture the inherent internal structure and external relationship in multimodal data to evaluate the individual's memory cognitive ability. In addition, the evaluation method determines suitable memory strategies and training content for the operator based on the operator's test results and forgetting curve, thereby improving the operator's memory efficiency.
本发明的附加优点、目的，以及特征将在下面的描述中将部分地加以阐述，且将对于本领域普通技术人员在研究下文后部分地变得明显，或者可以根据本发明的实践而获知。本发明的目的和其它优点可以通过在书面说明及其权利要求书以及附图中具体指出的结构实现到并获得。Additional advantages, purposes, and features of the present invention will be described in part in the following description, and will become apparent to those skilled in the art after studying the following, or may be learned from the practice of the present invention. The purposes and other advantages of the present invention may be achieved and obtained by the structures specifically pointed out in the written description, claims, and drawings.
本领域技术人员将会理解的是，能够用本发明实现的目的和优点不限于以上具体所述，并且根据以下详细说明将更清楚地理解本发明能够实现的上述和其他目的。Those skilled in the art will appreciate that the objectives and advantages that can be achieved with the present invention are not limited to the above specific description, and the above and other objectives that can be achieved by the present invention will be more clearly understood from the following detailed description.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
此处所说明的附图用来提供对本发明的进一步理解，构成本申请的一部分，并不构成对本发明的限定。附图中的部件不是成比例绘制的，而只是为了示出本发明的原理。为了便于示出和描述本发明的一些部分，附图中对应部分可能被放大，即，相对于依据本发明实际制造的示例性装置中的其它部件可能变得更大。在附图中：The drawings described herein are used to provide a further understanding of the present invention, constitute a part of this application, and do not constitute a limitation of the present invention. The components in the drawings are not drawn to scale, but are only for illustrating the principles of the present invention. In order to facilitate the illustration and description of some parts of the present invention, the corresponding parts in the drawings may be enlarged, that is, they may become larger relative to other parts in the exemplary device actually manufactured according to the present invention. In the drawings:
图1为本发明一实施例的记忆认知能力测评方法的流程示意图。FIG1 is a flow chart of a method for evaluating memory and cognitive ability according to an embodiment of the present invention.
图2为本发明另一实施例的记忆认知能力测评方法的流程示意图。FIG. 2 is a flow chart of a method for evaluating memory and cognitive ability according to another embodiment of the present invention.
图3为本发明一实施例的记忆认知能力测评方法的多模态数据结合的流程示意图。FIG3 is a schematic diagram of a flow chart of multimodal data integration of a memory and cognitive ability assessment method according to an embodiment of the present invention.
具体实施方式Detailed ways
为使本发明实施例的目的、技术方案和优点更加清楚明白，下面结合附图对本发明实施例做进一步详细说明。在此，本发明的示意性实施例及其说明用于解释本发明，但并不作为对本发明的限定。To make the purpose, technical solution and advantages of the embodiments of the present invention more clear, the embodiments of the present invention are further described in detail below in conjunction with the accompanying drawings. Here, the exemplary embodiments of the present invention and their descriptions are used to explain the present invention, but are not intended to limit the present invention.
在此，需要说明的是，为了避免因不必要的细节而模糊了本发明，在附图中仅仅示出了与根据本发明的方案密切相关的结构和/或处理步骤，而省略了与本发明关系不大的其他细节。It should be noted here that in order to avoid obscuring the present invention due to unnecessary details, only structures and/or processing steps closely related to the solutions according to the present invention are shown in the accompanying drawings, while other details that are not closely related to the present invention are omitted.
应该强调，术语“包括/包含/具有”在本文使用时指特征、要素、步骤或组件的存在，但并不排除一个或更多个其它特征、要素、步骤或组件的存在或附加。It should be emphasized that the terms “include/comprises/has” when used herein refer to the presence of features, elements, steps or components, but do not exclude the presence or addition of one or more other features, elements, steps or components.
现有技术在对记忆认知能力进行测评时具有以下缺点：(1)评估方式较为单一。其一般是以单一复述训练方式为主，较多的是测试操作人员对数字或字母记忆材料的瞬时记忆容量，没有针对不同记忆种类进行全方面的测量，因而无法针对个人的记忆特点进行针对性分析。(2)评估结果也较为单一。具体的其没有将个体对刺激材料的后期遗忘作为评估内容。(3)无法实现系统的测试方案。即现有的训练手段大多是无科学训练模式及流程的，没有系统的测评-训练-测评-报告模式；只能实现基本的训练，无整体逻辑性。(4)缺少科学的评价指标。即仅对个体单一的操作人员进行测试，无法和群体进行比较以突出实际记忆特点；(5)测量结果不够精确。即单纯的行为实验只能通过不同记忆水平正确率评估记忆水平，没有将受测人的主观评分与生理表现融合进去。针对上述问题，发明人进行了大量实验，且发明人在实验过程中发现，个体的记忆认知能力还与遗忘特性以及个体的心理负荷存在关联，因此本发明公开了一种记忆认知能力测评方法及系统，弥补了现有的记忆测评方法及系统存在的诸多缺陷。图1为本发明一实施例的记忆认知能力测评方法的流程示意图，如图1所示，该方法包括步骤S10～S30。The existing technologies have the following disadvantages when evaluating memory and cognitive abilities: (1) The evaluation method is relatively simple. It is generally based on a single repetition training method, and most of the tests are about the operator's instantaneous memory capacity of digital or letter memory materials. There is no comprehensive measurement of different memory types, and therefore it is impossible to conduct targeted analysis of individual memory characteristics. (2) The evaluation results are also relatively simple. Specifically, it does not take the individual's later forgetting of stimulus materials as an evaluation content. (3) It is impossible to implement a systematic test plan. That is, most of the existing training methods do not have a scientific training model and process, and there is no systematic evaluation-training-evaluation-reporting model; only basic training can be achieved without overall logic. (4) There is a lack of scientific evaluation indicators. That is, only individual operators are tested, and it is impossible to compare with the group to highlight the actual memory characteristics; (5) The measurement results are not accurate enough. That is, a simple behavioral experiment can only evaluate the memory level through the accuracy of different memory levels, and does not integrate the subjective score of the subject with the physiological performance. In view of the above problems, the inventors conducted a large number of experiments, and found that the memory and cognitive ability of an individual is also related to the forgetting characteristics and the individual's psychological load. Therefore, the present invention discloses a memory and cognitive ability evaluation method and system, which makes up for the many defects of the existing memory evaluation methods and systems. Figure 1 is a flow chart of a memory and cognitive ability evaluation method according to an embodiment of the present invention. As shown in Figure 1, the method includes steps S10 to S30.
步骤S10：根据与操作人员相匹配的测试内容对操作人员进行记忆认知能力测试，得到操作人员的测试结果。Step S10: Performing a memory and cognitive ability test on the operator according to the test content matching the operator to obtain the test result of the operator.
在该步骤中，测试内容的种类具有多种，如：视觉记忆、听觉记忆、空间记忆、情境记忆以及语义记忆等。其中，不同种类的测试内容的刺激材料有所不同；如数字/字符主要用于测试视觉记忆，声音主要用于测试听觉记忆，空间位置主要用于测试视觉空间记忆，情景信息可用于测试情境记忆，有意义的文字用于测试语义记忆。在具体测试时，针对不同的操作人员可以选择不同的测试维度，即实际测试内容会因操作人员的年龄、职业以及选择的测试维度有所差别，但每种测试内容的难度几乎无差别。示例性的，操作人员为核电厂操控室作业人员，为其匹配的测试内容为空间记忆，且刺激材料可为机器按钮，即在测试过程中要求操作人员将机器按钮尽量放回机器原位中。另，若操作人员为机动车驾驶员，与其匹配的测试内容为视觉记忆，刺激材料可交通指示灯、过路行人或其它车辆等。In this step, there are many types of test content, such as visual memory, auditory memory, spatial memory, situational memory, and semantic memory. Among them, the stimulus materials of different types of test content are different; for example, numbers/characters are mainly used to test visual memory, sounds are mainly used to test auditory memory, spatial positions are mainly used to test visual spatial memory, situational information can be used to test situational memory, and meaningful text is used to test semantic memory. In the specific test, different test dimensions can be selected for different operators, that is, the actual test content will vary depending on the operator's age, occupation, and selected test dimension, but the difficulty of each test content is almost the same. Exemplarily, the operator is an operator in the control room of a nuclear power plant, and the test content matched for him is spatial memory, and the stimulus material can be a machine button, that is, during the test, the operator is required to put the machine button back to the original position of the machine as much as possible. In addition, if the operator is a motor vehicle driver, the test content matched with it is visual memory, and the stimulus material can be a traffic light, a pedestrian passing by or other vehicles.
根据上述内容可知，针对操作人员的测试内容可基于操作人员的年龄、职业进行改变，因而在测试之前，操作人员可进行信息注册。信息可包括姓名、年龄、职业等；其中职业具体的可选择为无职业、驾驶员、工作人员、运动员以及飞行员等。并且当操作人员进行信息注册后，进一步的可基于操作人员的选择确定测试内容，也可基于获取到的操作人员的个人信息确定与操作人员相匹配的测试内容。应当理解的是，在实际测试中，测试内容具体的可为视觉记忆、听觉记忆、空间记忆、情境记忆以及语义记忆中的一种或多种；示例性的，视觉记忆和听觉记忆相结合可作为操作人员的刺激材料。According to the above content, the test content for the operator can be changed based on the age and occupation of the operator, so before the test, the operator can register the information. The information may include name, age, occupation, etc.; the occupation can be selected as no occupation, driver, staff, athlete, and pilot, etc. And after the operator registers the information, the test content can be further determined based on the operator's selection, and the test content matching the operator can also be determined based on the acquired personal information of the operator. It should be understood that in the actual test, the test content can be specifically one or more of visual memory, auditory memory, spatial memory, situational memory, and semantic memory; illustratively, the combination of visual memory and auditory memory can be used as stimulation material for the operator.
另外，在对操作人员进行具体记忆测试时可进行多维度测试，其中多维度测试可包括记忆容量测试及记忆效果测试。记忆容量测试是指使用部分报告法对操作人员瞬时记忆的容量进行测试；但记忆容量测试在个体间的差异较小，因而提升空间小。记忆效果测试可采用节省法测量操作人员正确识记全部记忆内容所需要的时间；从而有助于为操作人员匹配更合适的记忆策略。部分报告法是要求操作人员将看到的刺激材料的一部分报告出来，从而判断出操作人员的记忆容量的方法。节省法是记忆研究中测量保持量的方法之一，具体的即为先让操作人员学习一些材料，达到某种记忆标准(如刚刚能无误地背诵)，看要学习多少遍或花多少时间，然后间隔一定时间之后，再让其重新学习这些材料，也达到同一记忆标准要学习多少遍或花多少时间；初学时所需用的遍数或时间与再学时所需用的遍数或时间之间的差异的百分数作为保持量的指标。In addition, when conducting specific memory tests on operators, multidimensional tests can be conducted, wherein the multidimensional tests may include memory capacity tests and memory effect tests. Memory capacity tests refer to the use of partial reporting methods to test the capacity of operators' instantaneous memory; however, the differences between individuals in memory capacity tests are small, so there is little room for improvement. Memory effect tests can use the savings method to measure the time required for operators to correctly memorize all memory contents; thus, it helps to match more appropriate memory strategies for operators. The partial reporting method is a method that requires operators to report part of the stimulus materials they see, so as to determine the memory capacity of operators. The savings method is one of the methods for measuring retention in memory research. Specifically, operators are asked to learn some materials first, reach a certain memory standard (such as just being able to recite without error), see how many times or how much time it takes to learn, and then after a certain interval, let them re-learn these materials, and how many times or how much time it takes to reach the same memory standard; the percentage of the difference between the number of times or time required for initial learning and the number of times or time required for re-learning is used as an indicator of retention.
上述的节省法由于需操作人员进行多遍学习，因而进一步的，该方法还可根据与操作人员相匹配的测试内容对操作人员的记忆保持量进行多次间隔测试，并进一步的基于各记忆保持量及其对应的测试时间生成遗忘曲线。其中，对于记忆保持量的多次测试中的各间隔时间可以相同也可以不同；示例性的，各间隔时间可为1天，且15天作为一个测试周期。记忆遗忘曲线由艾宾浩斯提出，它表示了个体在识记材料后不同时间内遗忘材料的数量，其对后期复习具有重要意义；而该测评方法针对每个人的多次测量结果生成个人专属的遗忘曲线，因此在后续步骤中可基于个体之间不同的特点可确定不同的记忆策略及训练内容。Since the above-mentioned saving method requires the operator to study multiple times, further, the method can also perform multiple interval tests on the operator's memory retention according to the test content matching the operator, and further generate a forgetting curve based on each memory retention and its corresponding test time. Among them, the interval time in the multiple tests of memory retention can be the same or different; illustratively, each interval time can be 1 day, and 15 days is used as a test cycle. The memory forgetting curve was proposed by Ebbinghaus. It represents the amount of material forgotten by an individual at different times after memorizing the material, which is of great significance for later review; and this evaluation method generates a personal forgetting curve based on the multiple measurement results of each person, so in the subsequent steps, different memory strategies and training contents can be determined based on the different characteristics between individuals.
在本发明另一实施例中，测试结果可包括记忆广度值、记忆容量以及记忆速度。记忆容量具体的可用于反映对记忆材料的正确识记个数，而记忆速度具体的可反映正确识记全部记忆材料所花费的时间。其中记忆广度是指按照固定顺序呈现一系列刺激以后刚刚能够立刻正确再现的刺激系列的长度，即其是测定短时记忆认知能力的一种简单易行的方法。在具体测试时，可采用难度递进式的方法对操作人员进行测试，即实验初始时为初级难度，当操作人员正确率达到合格率后进入高难度的测试；而具体的，对于记忆广度，若在测试过程中测得操作人员记忆的最高水平正确率达到60％，则记忆广度为水平值；若操作人员记忆的最高水平正确率为40％～60％，则记忆广度为-0.5；若操作人员记忆的最高水平正确率低于40％时，则可将前次实验的水平数作为该测试结果中的记忆广度。In another embodiment of the present invention, the test results may include memory span value, memory capacity and memory speed. Memory capacity can be specifically used to reflect the number of correctly memorized memory materials, while memory speed can specifically reflect the time spent on correctly memorizing all memory materials. Memory span refers to the length of a series of stimuli that can be reproduced correctly immediately after a series of stimuli are presented in a fixed order, that is, it is a simple and easy method to measure short-term memory cognitive ability. In the specific test, the operator can be tested by a progressive difficulty method, that is, the initial difficulty of the experiment is primary, and the operator enters the high-difficulty test when the correct rate reaches the qualified rate; and specifically, for memory span, if the highest level of accuracy of the operator's memory measured during the test reaches 60%, the memory span is the level value; if the highest level of accuracy of the operator's memory is 40% to 60%, the memory span is -0.5; if the highest level of accuracy of the operator's memory is lower than 40%, the level number of the previous experiment can be used as the memory span in the test result.
步骤S20：获取操作人员在测试过程中的心率变异性HRV指标、眼动指标或脑电指标中的至少一个生理数据，基于获取到的所述生理数据确定所述操作人员的心理负荷指数。Step S20: obtaining at least one physiological data of the operator's heart rate variability HRV index, eye movement index or EEG index during the test, and determining the operator's psychological load index based on the obtained physiological data.
操作人员的记忆认知能力与其在记忆过程中呈现的心理负荷具有较大的密切关系，因此为了在后续步骤中能准确的确定操作人员的理论记忆水平，在测试过程中就需要对操作人员进行心率变异性(HRV)分析、眼动分析或脑电图分析，进而基于生理数据确定所述操作人员的心理负荷指数。心理负荷指数的范围示例性的可为数字1至数字10，其中数字越大则心理负荷越高。上述的心理负荷指数范围仅是一个具体示例，其还可以根据实际应用场合确定更合适的指数范围。The operator's memory and cognitive ability are closely related to the psychological load presented during the memory process. Therefore, in order to accurately determine the operator's theoretical memory level in the subsequent steps, it is necessary to perform heart rate variability (HRV) analysis, eye movement analysis or electroencephalogram analysis on the operator during the test process, and then determine the operator's psychological load index based on physiological data. The range of the psychological load index can be exemplarily 1 to 10, where the larger the number, the higher the psychological load. The above-mentioned psychological load index range is only a specific example, and a more suitable index range can also be determined according to actual application scenarios.
在获取操作人员在测试过程中的生理指标之前，可以根据需要先选择生理指标的具体类型，所选择的生理指标可为心率变异性HRV指标、眼动指标和脑电指标中的一个或多个。在获取所选择的指标的生理数据时，可将指尖传感器、手环传感器、耳夹传感器、眼动仪或脑电仪在测试之前穿戴在操作人员的身体相应部位，并且为了确保测试结果的准确性，在实际测试之前，还需要检测操作人员的生理信号以及传感器是否正常。Before obtaining the operator's physiological indicators during the test, the specific type of physiological indicators can be selected as needed. The selected physiological indicators can be one or more of the heart rate variability HRV indicator, the eye movement indicator and the EEG indicator. When obtaining the physiological data of the selected indicator, the fingertip sensor, the bracelet sensor, the ear clip sensor, the eye tracker or the EEG instrument can be worn on the corresponding part of the operator's body before the test, and in order to ensure the accuracy of the test results, before the actual test, it is also necessary to detect whether the operator's physiological signals and sensors are normal.
对于本实施例的记忆认知能力测评方法，采用HRV指标、眼动指标和脑电指标表征操作人员在记忆任务中的心理负荷。具体的，心率变异性分析是一种敏感的无创伤的评价心脏自主神经系统功能的定量方法；即心率变异性部分指标可以用于心脏交感神经和迷走神经活动的紧张性、均衡性的定量评价。根据心率变异的非线性分析发现，心率变异性的复杂度指数的变化趋势可以反映自主神经系统不同神经的主导作用；心率变异性分析建立在逐次心动间期提取的基础上，心率变异性的时域分析和频域分析运算简单，广泛用于测量脑力负荷水平或心理负荷。另外，心率变异性的时域分析主要是对RR间期进行数理统计运算，具体的心率变异性指标包括R-R间期平均值AVNN、平均心率AVHR、R-R间期标准差SDNN、相邻两个R-R间期差值的均方根RMSSD、相邻两个R-R间期之差大于50ms占全部R-R间期的百分比PNN50；各个指标的具体计算方法如下：For the memory cognitive ability evaluation method of this embodiment, HRV index, eye movement index and EEG index are used to characterize the psychological load of the operator in the memory task. Specifically, heart rate variability analysis is a sensitive and non-invasive quantitative method for evaluating the function of the cardiac autonomic nervous system; that is, some indicators of heart rate variability can be used for quantitative evaluation of the tension and balance of cardiac sympathetic and vagus nerve activities. According to the nonlinear analysis of heart rate variability, it is found that the changing trend of the complexity index of heart rate variability can reflect the dominant role of different nerves in the autonomic nervous system; heart rate variability analysis is based on the extraction of successive cardiac intervals, and the time domain analysis and frequency domain analysis of heart rate variability are simple to operate and are widely used to measure the level of mental load or psychological load. In addition, the time domain analysis of heart rate variability mainly performs mathematical statistical operations on the RR interval. Specific heart rate variability indicators include the average value of the R-R interval AVNN, the average heart rate AVHR, the standard deviation of the R-R interval SDNN, the root mean square RMSSD of the difference between two adjacent R-R intervals, and the percentage of the difference between two adjacent R-R intervals greater than 50ms in all R-R intervals PNN50. The specific calculation methods of each indicator are as follows:
NN(ms)为正常心跳R-R间期的值；即NN＝RRi；其中，RRi为第i个R-R的间期值大小。而AVNN(ms)为选定时间内所有R-R间期的平均值，也即心电信号的平均心动间隔(平均R-R间期值)，具体计算公式为：其中，N为待分析时间段内的总的心动次数，而RRi为第i个R-R间期值的大小。AVHR(ms)为平均心率值，其具体的计算公式为：其中，f为采样频率，N为R波个数，也即待分析时间段内的总的心动次数，xi(i＝1,2,...,N)为第i个波的位置。SDNN(ms)为一段时间内所有R-R间期的标准差，与自主神经系统的活性存在着一定的相关性，其具体的计算公式为：其中，N为待分析时间段内的总的心动次数，/>为待分析时间内RR间期的平均值，RRi为第i个R-R间期值的大小。RMSSD(ms)为相邻两个R-R间期差值的均方根，可以用来表示R-R间期的突然变化，具体的计算公式为：其中，RRi为第i个R-R间期值的大小，而N为待分析时间段内的总的心动次数。应当理解的是，NN50为选定时间内，相邻正常R-R间期之差大于50ms的心搏个数，其常用作衡量迷走神经张力对心率的调控作用；因而PNN50为相邻两个R-R间期之差大于50ms占全部R-R间期的百分比，其具体的计算公式为：/>其中，num_NN为分析时间段内NN(RR)间期的总数量。NN (ms) is the value of the RR interval of a normal heartbeat; that is, NN = RRi ; where RRi is the value of the interval of the i-th RR. AVNN (ms) is the average value of all RR intervals within the selected time, that is, the average heartbeat interval (average RR interval value) of the ECG signal. The specific calculation formula is: Where N is the total number of heartbeats in the time period to be analyzed, and RRi is the value of the i-th RR interval. AVHR (ms) is the average heart rate value, and its specific calculation formula is: Where f is the sampling frequency, N is the number of R waves, that is, the total number of heartbeats in the time period to be analyzed, and xi (i＝1,2,...,N) is the position of the i-th wave. SDNN (ms) is the standard deviation of all RR intervals in a period of time, which has a certain correlation with the activity of the autonomic nervous system. The specific calculation formula is: Where N is the total number of heart beats in the time period to be analyzed, /> is the average value of the RR interval in the time to be analyzed, and RRi is the value of the i-th RR interval. RMSSD (ms) is the root mean square of the difference between two adjacent RR intervals, which can be used to indicate the sudden change of the RR interval. The specific calculation formula is: Among them, RRi is the value of the i-th RR interval, and N is the total number of heartbeats in the time period to be analyzed. It should be understood that NN50 is the number of heartbeats with a difference of more than 50ms between adjacent normal RR intervals within the selected time period, which is often used to measure the regulatory effect of vagal nerve tension on heart rate; therefore, PNN50 is the percentage of the difference of two adjacent RR intervals greater than 50ms in all RR intervals, and its specific calculation formula is:/> Where num_NN is the total number of NN(RR) intervals during the analysis period.
眼动分析即分析在测试过程中操作人员的眼动数据，眼动指标具体的指能反应眼球变化的各种指标，其中用于研究心理负荷的眼动指标可以分为注视指标、扫视指标、眨眼指标和瞳孔指标四类。其中，注视时间、注视次数、扫视频率、扫视速度、扫视幅度和瞳孔大小指标均为最有效的心理负荷测量指标。Eye movement analysis is to analyze the eye movement data of the operator during the test. Eye movement indicators specifically refer to various indicators that can reflect the changes in the eyeballs. Among them, the eye movement indicators used to study psychological load can be divided into four categories: fixation indicators, saccade indicators, blink indicators and pupil indicators. Among them, fixation time, number of fixations, saccade frequency, saccade speed, saccade amplitude and pupil size indicators are the most effective indicators for measuring psychological load.
脑电分析是通过直接记录操作人员在记忆任务执行过程中的自发脑电信号，然后加以处理分析，进而对心理负荷做出评估。对脑电EEG信号处理时，系统将EEG信号处理分为3个阶段：第一阶段是脑电信号的预处理，目的是去除原始脑电信号中的噪声干扰；第二阶段是脑电信号特征提取。从预处理的脑电信号提取特征量用以区别不同的脑电信号，同时实现信号的降维简化计算过程；第三阶段是对提取的特征量进行分类。在具体分析时，EEG信号主要进行时域分析和频域分析，时域分析主要是通过分析EEG波形的几何特性，常见的指标如幅度、最大峰值、中值幅度、标准差、方差、峭度等方式来对波形进行识别。而功率谱估计是EEG信号频域分析中的一个重要算法。EEG信号的功率谱是脑电功率与时间之间的关系图，可以从此图上直接观察EEG信号中各个节律(δ、θ、α、β等)的分布情况，包括TotalPower各频段的总能量值、Power Percent该波段的能量值占所有波段总能量值的百分比、Average Power该波段的平均能量值。同时，通过脑地形图可以精确定位脑区在不同功能状态下的激活区域与激活程度。EEG analysis is to directly record the spontaneous EEG signals of operators during the execution of memory tasks, and then process and analyze them to evaluate the psychological workload. When processing EEG signals, the system divides the EEG signal processing into three stages: the first stage is the preprocessing of EEG signals, the purpose of which is to remove noise interference in the original EEG signals; the second stage is the extraction of EEG signal features. Feature quantities are extracted from the preprocessed EEG signals to distinguish different EEG signals, while achieving signal dimensionality reduction to simplify the calculation process; the third stage is to classify the extracted feature quantities. In specific analysis, EEG signals are mainly analyzed in the time domain and frequency domain. The time domain analysis mainly analyzes the geometric characteristics of the EEG waveform, and common indicators such as amplitude, maximum peak, median amplitude, standard deviation, variance, kurtosis, etc. are used to identify the waveform. Power spectrum estimation is an important algorithm in the frequency domain analysis of EEG signals. The power spectrum of the EEG signal is a graph of the relationship between EEG power and time. From this graph, we can directly observe the distribution of each rhythm (δ, θ, α, β, etc.) in the EEG signal, including the total energy value of each frequency band of TotalPower, the percentage of the energy value of this band in the total energy value of all bands of Power Percent, and the average energy value of this band of AveragePower. At the same time, the brain topography can accurately locate the activation area and activation degree of the brain region in different functional states.
其中，脑电相标包括状态相关脑波复杂度Cs，且其相关指标还包括P300和CNV关联负变(Contingent Negative Variation)。P300：在Oddball范式下，实验记录到小概率刺激出现之后300ms时观察到一个正波，称为P300，这个波在Pz点附近最高。研究发现P300的波幅与所投入的心理资源量成正相关，其潜伏期随任务难度增加而变长。CNV被认为主要与心理因素有关，比如期待、意动、朝向反应、觉醒、注意、动机等，可以认为它基本上是一个综合的心理准备状态的反映，处于紧张或应急状态的反映。Among them, the EEG phase markers include the state-related brain wave complexity Cs, and its related indicators also include P300 and CNV contingent negative variation. P300: Under the oddball paradigm, the experiment recorded a positive wave 300ms after the appearance of a small probability stimulus, called P300, and this wave was highest near the Pz point. Studies have found that the amplitude of P300 is positively correlated with the amount of psychological resources invested, and its latency increases with the difficulty of the task. CNV is believed to be mainly related to psychological factors, such as expectation, intention, orientation reaction, arousal, attention, motivation, etc. It can be considered that it is basically a reflection of a comprehensive state of psychological preparation, a reflection of being in a tense or emergency state.
在该步骤中，参考图3，可先对一批操作人员进行记忆认知能力测试，并主观评估在刚刚测试过程中的各操作人员心理负荷程度，将测试过程中的生理数据与主观评估结果输入模型中进行模型训练得到预训练模型；进而将将获取到的操作人员的所述生理数据输入预训练模型，基于被训练后的模型则可根据生理数据获得操作人员的实时心理负荷指数。In this step, referring to FIG3 , a memory and cognitive ability test can be first performed on a group of operators, and the psychological stress level of each operator in the test process can be subjectively evaluated. The physiological data in the test process and the subjective evaluation results can be input into the model for model training to obtain a pre-trained model. Then, the acquired physiological data of the operators can be input into the pre-trained model, and based on the trained model, the real-time psychological stress index of the operators can be obtained according to the physiological data.
在该步骤中，考虑到不同操作人员个体的心理负荷、认知消耗等差异，通过生理仪器测得的生理指标实时评估操作人员在测试过程中的认知投入，因而确保了测评结果的准确性及针对性。In this step, taking into account the differences in psychological workload, cognitive consumption, etc. among individual operators, the physiological indicators measured by physiological instruments are used to evaluate the operators' cognitive input during the test in real time, thus ensuring the accuracy and pertinence of the evaluation results.
步骤S30：基于操作人员的测试结果及操作人员的心理负荷指数确定所述操作人员的理论记忆水平。Step S30: Determine the operator's theoretical memory level based on the operator's test result and the operator's mental load index.
在该步骤中，理论记忆水平指操作人员个体在全力以赴使用最大心理力量时记忆全部刺激材料对应的各个参数，各个参数是个体在记忆测试中能够达到的理论最大值；示例性的，若操作人员的测试结果包括记忆容量参数时，而理论记忆水平则也可包括操作人员个体在全力以赴使用心理力量时的记忆容量；而若操作人员的测试结果包括测得的正确识记个数时，理论记忆水平则也可包括操作人员个体在全力以赴使用最大心理力量时的正确识记个数。另外，操作人员个体全力以赴使用最大心理力量是指心理负荷指数为最大值的时刻，当心理负荷指数被划分为十个等级时，其最大心理负荷指数数值即为10。示例性的，理论记忆水平的计算方式用公式表示为：理论记忆水平＝(实际测量结果/心理负荷指数)*最大心理负荷指数；即理论正确识记个数具体的计算方法为，先计算测得的实际识记个数与实际心理负荷指数的比值，然后再计算前述比值与理论最大努力指数的乘积即得到理论记忆水平参数；示例性的，当心理负荷指数被划分为1至10时，其最大心理负荷指数的数值即为10。In this step, the theoretical memory level refers to the parameters corresponding to the memory of all stimulus materials when the operator is using his/her maximum mental strength, and each parameter is the theoretical maximum value that the individual can reach in the memory test; illustratively, if the test result of the operator includes the memory capacity parameter, the theoretical memory level may also include the memory capacity of the operator when the operator is using his/her maximum mental strength; and if the test result of the operator includes the measured number of correct recognitions, the theoretical memory level may also include the number of correct recognitions when the operator is using his/her maximum mental strength. In addition, the moment when the operator is using his/her maximum mental strength refers to the moment when the mental load index is at its maximum value. When the mental load index is divided into ten levels, the maximum mental load index value is 10. Exemplarily, the calculation method of the theoretical memory level is expressed by the formula: theoretical memory level = (actual measurement result/psychological load index) * maximum psychological load index; that is, the specific calculation method of the theoretical number of correct memorization is to first calculate the ratio of the actual number of memorization measured to the actual psychological load index, and then calculate the product of the above ratio and the theoretical maximum effort index to obtain the theoretical memory level parameter; exemplarily, when the psychological load index is divided into 1 to 10, the value of the maximum psychological load index is 10.
在本发明一实施例中，当根据与操作人员相匹配的测试内容对操作人员进行多次遗忘测试且生成遗忘曲线之后，该方法还可进一步的基于操作人员的测试结果以及遗忘曲线确定操作人员适合的记忆策略及记忆训练内容。示例性的，可采用艾宾浩斯的节省法对操作人员进行连续性测量，且遗忘曲线以间隔时间为横坐标(天)，以节省时间的百分比为纵坐标，绘制出初始学习后经过的时间和记忆保持量之间的关系；其中，节省时间百分比＝(初始时间-重学时间)/初始时间。该遗忘曲线描述了操作人员的遗忘特点；基于该遗忘曲线以及操作人员的测试结果可确定适合该操作人员的记忆策略以及训练内容。在该实施例中，针对操作人员的自身记忆特点为其推荐相匹配的记忆策略以及训练内容，从而使操作人员基于向其推荐的记忆策略以及训练内容进行记忆训练，提高了自身的记忆效率。In one embodiment of the present invention, after the operator is subjected to multiple forgetting tests according to the test content matching the operator and a forgetting curve is generated, the method can further determine the memory strategy and memory training content suitable for the operator based on the test results of the operator and the forgetting curve. Exemplarily, the Ebbinghaus saving method can be used to measure the operator continuously, and the forgetting curve uses the interval time as the horizontal axis (day) and the percentage of saved time as the vertical axis to draw the relationship between the time after initial learning and the memory retention amount; wherein, the percentage of saved time = (initial time-relearning time)/initial time. The forgetting curve describes the forgetting characteristics of the operator; based on the forgetting curve and the test results of the operator, the memory strategy and training content suitable for the operator can be determined. In this embodiment, matching memory strategies and training contents are recommended for the operator according to the operator's own memory characteristics, so that the operator can perform memory training based on the memory strategy and training content recommended to it, thereby improving its own memory efficiency.
另外，在基于操作人员的测试结果及遗忘曲线确定记忆策略及训练内容之前，系统可预先储存有多种记忆策略，且每种记忆策略具有相关题库。而向操作人员推荐的记忆策略包含相应记忆策略的历史、来源、理论依据，而确定的与操作人员相匹配的训练内容可每日均向操作人员进行推送，从而使得操作人员可基于推送的记忆策略以及训练内容进行训练及记忆。In addition, before determining the memory strategy and training content based on the operator's test results and forgetting curve, the system can pre-store a variety of memory strategies, and each memory strategy has a related question bank. The memory strategy recommended to the operator includes the history, source, and theoretical basis of the corresponding memory strategy, and the determined training content that matches the operator can be pushed to the operator every day, so that the operator can train and memorize based on the pushed memory strategy and training content.
在本发明一实施例中，该记忆认知能力测评方法还包括以下步骤：根据与多个成员中的各成员相匹配的测试内容分别对各成员进行记忆认知能力测试，得到各个成员的测试结果；基于各个成员的测试结果建立动态常模。In one embodiment of the present invention, the memory and cognitive ability assessment method also includes the following steps: performing memory and cognitive ability tests on each member according to the test content matching each member of the multiple members to obtain the test results of each member; and establishing a dynamic norm based on the test results of each member.
类似的，测试内容的种类具有多种，如：视觉记忆、听觉记忆、空间记忆、情境记忆以及语义记忆等。在具体测试时，不同的操作人员可以选择或被匹配不同的测试内容，即实际测试内容会因操作人员的年龄以及职业有所差别，但每种测试内容的难度几乎无差别。在测试之前，还可进一步的获取与各个成员相对应的测试内容，再根据与各个成员相匹配的测试内容分别对各个成员进行记忆认知能力测试，得到各个成员的测试结果；并进一步基于各个成员的测试结果建立动态常模。其中各个成员的测试结果与操作人员的测试结果类似的，其具体的也可包括记忆广度值、对记忆材料的正确识记个数以及正确识记全部记忆材料所花费的时间等。另外，在实际测试时，操作人员也可作为用于建立动态常模的多个成员中的一员，此时也即在步骤S10中获得的操作人员的测试结果可作为用于建立动态常模的样本结果。Similarly, there are many types of test content, such as visual memory, auditory memory, spatial memory, situational memory, and semantic memory. In the specific test, different operators can choose or be matched with different test contents, that is, the actual test content will vary due to the age and occupation of the operator, but the difficulty of each test content is almost the same. Before the test, the test content corresponding to each member can be further obtained, and then the memory cognitive ability test of each member is performed on each member according to the test content matched with each member, and the test results of each member are obtained; and the dynamic norm is further established based on the test results of each member. The test results of each member are similar to the test results of the operator, and specifically include the memory span value, the number of correctly recognized memory materials, and the time spent on correctly recognizing all memory materials. In addition, in the actual test, the operator can also be used as one of the multiple members for establishing the dynamic norm. At this time, the test results of the operator obtained in step S10 can be used as the sample results for establishing the dynamic norm.
在该步骤中，多个成员可为不同年龄、职业的操作人员，由于操作人员成员的个体差异，则该测试团体中的各个成员的测试内容也不同。因而，该方法通过对大量成员进行施测后，针对不同的年龄阶段、不同刺激材料等建立数据库，从而形成独特的动态常模。In this step, multiple members can be operators of different ages and occupations. Due to individual differences among the operators, the test contents of each member in the test group are also different. Therefore, this method establishes a database for different age stages, different stimulus materials, etc. after testing a large number of members, thereby forming a unique dynamic norm.
进一步的，本发明还基于动态常模以及操作人员的测试结果获取所述操作人员的常模水平。其中，常模水平是将原始分数与平均数的距离以标准差为单位表示出来的量表，其基本单位为标准差，因而也可被称为标准分数。因为绝对的记忆容量值并不能够准确的表达记忆容量水平，因而在形成独特的常模水平之后，操作人员个体在完成测试后除了会获得绝对的记忆容量和记忆效果之外，还可基于该动态常模获得标准分数以及超越同等测试人群的百分比，从而让测试结果更有实际意义，以及更直观。标准分数具体的可用Z表示，具体计算公式为其中，X为操作人员的原始分数，/>S分别为参与测试团体的平均分数和标准差。另，在求出标准分数之后，可根据动态常模的标准正态分布曲线图找出该标准分数对应的百分比，即该百分比则为超越同等测试人群的百分比。Furthermore, the present invention also obtains the norm level of the operator based on the dynamic norm and the test results of the operator. Among them, the norm level is a scale that expresses the distance between the original score and the mean in units of standard deviation, and its basic unit is standard deviation, so it can also be called a standard score. Because the absolute memory capacity value cannot accurately express the memory capacity level, after forming a unique norm level, the individual operator will not only obtain the absolute memory capacity and memory effect after completing the test, but also obtain the standard score based on the dynamic norm and the percentage of exceeding the same test population, thereby making the test results more practical and more intuitive. The standard score can be specifically represented by Z, and the specific calculation formula is Where X is the operator's original score, /> S is the average score and standard deviation of the test group. In addition, after the standard score is obtained, the percentage corresponding to the standard score can be found according to the standard normal distribution curve of the dynamic norm, that is, the percentage is the percentage of the test group that exceeds the same test group.
另外，采用该方法对操作人员测试完毕之后，还进一步的生成包括有操作人员信息、操作人员的测试结果、心理负荷指数、常模水平、理论记忆水平的测试报告。该测试报告可被下载、打印。其中，操作人员信息是根据操作人员填写的个人信息自动生成的，操作人员信息包括姓名、年龄、职业等信息。而测试内容可是操作人员具体选择的，也可以是基于操作人员的具体信息为其匹配的。而操作人员的测试结果可包括单个试次内刺激材料的内容、操作人员做出的反应、反应的正确性以及反应时长等参数；另外，操作人员的测试结果也可包括记忆广度、记忆容量以及记忆速度等。心理负荷指数具体的是基于生理数据的得出的结果；该方法集合了生理指标机器学习内容，包含大量数据库，可根据生理数据实时呈现个体的脑力负荷(即心理负荷)水平，并在实验结束后得出个体心理负荷指数，在本发明中，心理负荷指数可被划分为1至10共十个等级。In addition, after the operator is tested by this method, a test report including operator information, operator test results, mental load index, norm level, and theoretical memory level is further generated. The test report can be downloaded and printed. Among them, the operator information is automatically generated based on the personal information filled in by the operator, and the operator information includes name, age, occupation and other information. The test content can be specifically selected by the operator, or it can be matched based on the specific information of the operator. The operator's test results may include parameters such as the content of the stimulus material in a single trial, the reaction made by the operator, the correctness of the reaction, and the reaction time; in addition, the operator's test results may also include memory breadth, memory capacity, and memory speed. The mental load index is specifically a result obtained based on physiological data; this method integrates the machine learning content of physiological indicators, contains a large number of databases, can present the individual's mental load (i.e., mental load) level in real time according to physiological data, and obtain the individual mental load index after the experiment. In the present invention, the mental load index can be divided into ten levels from 1 to 10.
另外，该测试报告还可包括报告描述、参数性质以及详细试次结果。其中报告描述包含有对操作人员记忆的综合描述，对测量内容和测试维度的基本介绍，以及实验原理等内容。而对于参数性质，具体的在测试过程中采用难度递进式的方式进行测试，即实验初始时为统一的初级难度，当操作人员正确率达到合格水平时进入更高难度的测试，且参数性质部分内容会显示最高难度等级测试的参数配置。In addition, the test report may also include a report description, parameter properties, and detailed test results. The report description includes a comprehensive description of the operator's memory, a basic introduction to the measurement content and test dimensions, and the experimental principles. As for parameter properties, the test is carried out in a progressive manner during the test process, that is, the experiment starts with a uniform primary difficulty, and when the operator's accuracy reaches a qualified level, a higher difficulty test is entered, and the parameter properties section will display the parameter configuration of the highest difficulty level test.
为了进一步详细描述本发明实施例的记忆认知能力测评方法，图2示出了另一实施例的记忆认知能力测评方法的流程图，如图2所示，操作人员首先进行操作人员注册，注册信息包括姓名、性别、年龄、职业等，职业具体的可在系统提供的多个信息中进行选择。进一步的，选择测试维度以及测试内容，测试维度包括记忆容量测试以及记忆效果测试，而测试内容包括数字、文本、图片、空间位置等。进而操作人员佩戴生理仪器，生理仪器示例性的如指尖、手环以及耳夹传感器。当佩戴完毕生理仪器之后，即进入测试，测试完毕之后，确定操作人员的心理负荷指数，进而再确定操作人员在最大心理负荷指数下的理论记忆水平；最终生成测试报告。另外，采用该方法还可对操作人员进行多次测试，如在十五天中以天为单位进行持续测量，从而获得十五个测试结果；进一步的基于多个测试结果生成专属遗忘曲线。在得到操作人员的专属遗忘曲线之后，还基于操作人员的测试结果以及专属遗忘曲线为该操作人员推荐记忆策略以及相关训练内容。In order to further describe the memory cognition ability evaluation method of the embodiment of the present invention in detail, FIG2 shows a flow chart of the memory cognition ability evaluation method of another embodiment. As shown in FIG2, the operator first registers the operator, and the registration information includes name, gender, age, occupation, etc. The specific occupation can be selected from the multiple information provided by the system. Further, the test dimension and test content are selected. The test dimension includes memory capacity test and memory effect test, and the test content includes numbers, text, pictures, spatial position, etc. Then the operator wears a physiological instrument, and the physiological instrument is exemplified as a fingertip, bracelet, and ear clip sensor. After wearing the physiological instrument, the test is entered. After the test is completed, the operator's psychological load index is determined, and then the operator's theoretical memory level under the maximum psychological load index is determined; and finally a test report is generated. In addition, the method can also be used to test the operator multiple times, such as continuous measurement in units of days for fifteen days, so as to obtain fifteen test results; and further generate a dedicated forgetting curve based on multiple test results. After obtaining the operator's exclusive forgetting curve, the operator is recommended a memory strategy and related training content based on the operator's test results and the exclusive forgetting curve.
对于上述实施例所公开的记忆认知能力测评方法，示例性的可应用在学习过程中。特别是如操作员、控制室工作人员、驾驶员等，作业人员需要依靠强大的记忆认知能力和适当的记忆策略对当前情景信息、界面反馈的文字信息和按钮等操作位置进行准确的识记。因而采用该方法对作业人员进行记忆测评，可在准确评估操作人员的记忆认知能力的前提下为操作人员提供适当的记忆策略，并进而对操作人员进行提升记忆力的训练。The memory cognition ability evaluation method disclosed in the above embodiment can be applied in the learning process. In particular, operators, control room staff, drivers, etc., need to rely on strong memory cognition ability and appropriate memory strategies to accurately remember the current situation information, text information fed back by the interface, and operation positions such as buttons. Therefore, by using this method to evaluate the memory of operators, appropriate memory strategies can be provided to operators on the premise of accurately evaluating the memory cognition ability of operators, and then training operators to improve their memory.
另外，本发明还提供了一种记忆认知能力测评系统，该系统包括处理器以及存储器，存储器上存储有计算机程序，当所述处理器执行存储器上存储的计算机程序时，所述记忆认知能力测评系统用于实现如上述施例中任意一项所述方法的步骤。In addition, the present invention also provides a memory and cognitive ability assessment system, which includes a processor and a memory, wherein a computer program is stored in the memory. When the processor executes the computer program stored in the memory, the memory and cognitive ability assessment system is used to implement the steps of the method described in any one of the above embodiments.
根据上述实施例可以发现，本发明所公开的记忆认知能力测评方法及系统实现了多维度测评，即除了进行传统的记忆容量测试外，本系统根据记忆的特点提出了记忆效果测试；在经过短暂学习后，对刚刚的学习内容进行测试，通过正确率评估个体的记忆效果。另外，该系统还实现了多内容测试，即针对不同年龄的个体设置不同的刺激材料；以及与生理仪器测量心理负荷结合测评，即根据生理指标实时评估个体在测试过程中的心理负荷。还可进一步的实现系统化的针对应训练模式，即该系统会推送适合个体的记忆策略以及记忆训练内容，从而可帮助个体更好的掌握记忆策略，从而摆脱简单复述的方法以实现灵活记忆。According to the above embodiments, it can be found that the memory cognitive ability evaluation method and system disclosed in the present invention realize multi-dimensional evaluation, that is, in addition to the traditional memory capacity test, the system proposes a memory effect test according to the characteristics of memory; after a short period of learning, the just learned content is tested, and the individual's memory effect is evaluated by the accuracy. In addition, the system also realizes multi-content testing, that is, different stimulus materials are set for individuals of different ages; and combined with physiological instruments to measure psychological load, that is, the psychological load of individuals during the test is evaluated in real time according to physiological indicators. It is also possible to further realize a systematic response training mode, that is, the system will push memory strategies and memory training content suitable for individuals, so as to help individuals better master memory strategies, thereby getting rid of the simple repetition method to achieve flexible memory.
还需要说明的是，本发明中提及的示例性实施例，基于一系列的步骤或者装置描述一些方法或系统。但是，本发明不局限于上述步骤的顺序，也就是说，可以按照实施例中提及的顺序执行步骤，也可以不同于实施例中的顺序，或者若干步骤同时执行。It should also be noted that the exemplary embodiments mentioned in the present invention describe some methods or systems based on a series of steps or devices. However, the present invention is not limited to the order of the above steps, that is, the steps can be performed in the order mentioned in the embodiments, or in a different order from the embodiments, or several steps can be performed simultaneously.
本发明中，针对一个实施方式描述和/或例示的特征，可以在一个或更多个其它实施方式中以相同方式或以类似方式使用，和/或与其他实施方式的特征相结合或代替其他实施方式的特征。In the present invention, features described and/or illustrated for one embodiment may be used in the same or similar manner in one or more other embodiments, and/or combined with features of other embodiments or replace features of other embodiments.
以上所述仅为本发明的优选实施例而已，并不用于限制本发明，对于本领域的技术人员来说，本发明实施例可以有各种更改和变化。凡在本发明的精神和原则之内，所作的任何修改、等同替换、改进等，均应包含在本发明的保护范围之内。The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the embodiments of the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111595156.5ACN114246589B (en) | 2021-12-23 | 2021-12-23 | Memory and cognitive ability assessment method and system |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111595156.5ACN114246589B (en) | 2021-12-23 | 2021-12-23 | Memory and cognitive ability assessment method and system |
| Publication Number | Publication Date |
|---|---|
| CN114246589A CN114246589A (en) | 2022-03-29 |
| CN114246589Btrue CN114246589B (en) | 2024-05-24 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111595156.5AActiveCN114246589B (en) | 2021-12-23 | 2021-12-23 | Memory and cognitive ability assessment method and system |
| Country | Link |
|---|---|
| CN (1) | CN114246589B (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114983415B (en)* | 2022-05-12 | 2024-12-13 | 华南理工大学 | Working memory load level identification method based on facial video |
| CN115462755B (en)* | 2022-08-31 | 2024-11-12 | 北京津发科技股份有限公司 | Pilot cognitive ability assessment method, system and storage medium |
| CN115458112A (en)* | 2022-08-31 | 2022-12-09 | 北京津发科技股份有限公司 | Cognitive ability evaluation method and system |
| CN115295124B (en)* | 2022-09-30 | 2023-01-20 | 北京智精灵科技有限公司 | Multi-mode cognitive improvement method and system |
| CN115844405B (en)* | 2022-12-20 | 2024-01-23 | 中国民航大学 | Civil aviation pilot psychological competency assessment method and system integrating biofeedback |
| CN117954100B (en)* | 2024-03-26 | 2024-06-14 | 天津市品茗科技有限公司 | Cognitive ability testing and training method and system based on user behaviors |
| CN120360545B (en)* | 2025-06-26 | 2025-09-16 | 杭州汇听科技有限公司 | Auditory cognitive dysfunction assessment and screening system |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH08278745A (en)* | 1995-04-05 | 1996-10-22 | Sharp Corp | Educational device and method |
| WO2006073384A1 (en)* | 2004-12-30 | 2006-07-13 | Sam Technology, Inc. | Neurocognitive function eeg measurement method and system |
| CN101201812A (en)* | 2006-12-14 | 2008-06-18 | 英业达股份有限公司 | System and method for auxiliary learning language words executable by computer |
| CN101756705A (en)* | 2008-11-14 | 2010-06-30 | 北京宣爱智能模拟技术有限公司 | System and method for testing driving accident proneness |
| CN101779960A (en)* | 2010-02-24 | 2010-07-21 | 沃建中 | Test system and method of stimulus information cognition ability value |
| CN103413478A (en)* | 2013-07-09 | 2013-11-27 | 复旦大学 | Word memory intelligent learning method and system thereof |
| CN105069294A (en)* | 2015-08-07 | 2015-11-18 | 北京环度智慧智能技术研究所有限公司 | Calculation and analysis method for testing cognitive competence values |
| CN112137627A (en)* | 2020-09-10 | 2020-12-29 | 北京津发科技股份有限公司 | Self-adaptive method and system for human factor evaluation and training |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE202016009220U1 (en)* | 2015-07-10 | 2024-07-09 | Abbott Diabetes Care, Inc. | Device and system for dynamic glucose profile response to physiological parameters |
| US11908581B2 (en)* | 2018-04-10 | 2024-02-20 | Hill-Rom Services, Inc. | Patient risk assessment based on data from multiple sources in a healthcare facility |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH08278745A (en)* | 1995-04-05 | 1996-10-22 | Sharp Corp | Educational device and method |
| WO2006073384A1 (en)* | 2004-12-30 | 2006-07-13 | Sam Technology, Inc. | Neurocognitive function eeg measurement method and system |
| CN101201812A (en)* | 2006-12-14 | 2008-06-18 | 英业达股份有限公司 | System and method for auxiliary learning language words executable by computer |
| CN101756705A (en)* | 2008-11-14 | 2010-06-30 | 北京宣爱智能模拟技术有限公司 | System and method for testing driving accident proneness |
| CN101779960A (en)* | 2010-02-24 | 2010-07-21 | 沃建中 | Test system and method of stimulus information cognition ability value |
| CN103413478A (en)* | 2013-07-09 | 2013-11-27 | 复旦大学 | Word memory intelligent learning method and system thereof |
| CN105069294A (en)* | 2015-08-07 | 2015-11-18 | 北京环度智慧智能技术研究所有限公司 | Calculation and analysis method for testing cognitive competence values |
| CN112137627A (en)* | 2020-09-10 | 2020-12-29 | 北京津发科技股份有限公司 | Self-adaptive method and system for human factor evaluation and training |
| Title |
|---|
| "基于因子模型的高速公路特长隧道驾驶人心理负荷特性研究";朱彤, 吴玲, 胡月琦等;《中国公路学报》;第31卷(第11期);165-175* |
| 下肢康复机器人按需辅助自适应控制方法;尹贵;张小栋;陈江城;马伟光;张强;杨昆才;;西安交通大学学报;20170523(第10期);全文* |
| 基于遗忘曲线的自适应词汇记忆模型;蔡乐;熊万强;孙晓光;;微型电脑应用(第05期);全文* |
| 记忆力先天发育水平测量指标体系的建立及其实验研究;苗治平;林波;刘欢;吕振中;钟明;;西安工业大学学报(第01期);全文* |
| Publication number | Publication date |
|---|---|
| CN114246589A (en) | 2022-03-29 |
| Publication | Publication Date | Title |
|---|---|---|
| CN114246589B (en) | Memory and cognitive ability assessment method and system | |
| Giannakakis et al. | Review on psychological stress detection using biosignals | |
| Lohani et al. | A review of psychophysiological measures to assess cognitive states in real-world driving | |
| KR102143343B1 (en) | Attention/fatigue/drowsiness monitoring system based on autonomic nervous system signal reflecting brain activity | |
| Sharma et al. | Objective measures, sensors and computational techniques for stress recognition and classification: A survey | |
| Fucci et al. | A replication study on code comprehension and expertise using lightweight biometric sensors | |
| CN105496404B (en) | Appraisal procedure based on brain-computer interface auxiliary CRS-R scale Auditory Startles | |
| Kołodziej et al. | Fatigue detection caused by office work with the use of EOG signal | |
| CN110600103B (en) | Wearable intelligent service system for improving eyesight | |
| Hasan et al. | Validation and interpretation of a multimodal drowsiness detection system using explainable machine learning | |
| CN108922629A (en) | The screening and its application of brain function corelation behaviour normal form index | |
| Ren et al. | Comparison of the use of blink rate and blink rate variability for mental state recognition | |
| Antonenko et al. | Assessing working memory dynamics with electroencephalography: Implications for research on cognitive load | |
| Jiao et al. | A quick identification model for assessing human anxiety and thermal comfort based on physiological signals in a hot and humid working environment | |
| Fujiwara et al. | Driver drowsiness detection using rr interval of electrocardiogram and self-attention autoencoder | |
| KR20220047187A (en) | Server and method for cognitive function testing using feature combination | |
| Sanjaya et al. | Review on the application of physiological and biomechanical measurement methods in driving fatigue detection | |
| Qin et al. | Stress level evaluation using BP neural network based on time-frequency analysis of HRV | |
| KR20170130207A (en) | Psychiatric symptoms rating scale system using multiple contents and bio-signal analysis | |
| Jegan et al. | Mental stress detection and classification using SVM classifier: A pilot study | |
| Khaleghi et al. | Linear and nonlinear analysis of multimodal physiological data for affective arousal recognition | |
| KR20220028967A (en) | Treatement apparatus and method based on neurofeedback | |
| Sandhu et al. | Evaluation of learning performance by quantifying user's engagement investigation through low-cost multi-modal sensors | |
| Wijayarathna et al. | Toward stress detection during gameplay: A survey | |
| Mohammed et al. | A Survey for Lie Detection Methodology Using EEG Signal Processing |
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |