CN113842139A

Movatterモバイル変換

Info

Publication number: CN113842139A
Application number: CN202111082723.7A
Authority: CN
Inventors: 苑红伟; 赵永才; 李玉强; 吕守鹏; 许升; 虞朝丰
Original assignee: Qingdao Haier Smart Technology R&D Co Ltd; Haier Smart Home Co Ltd
Current assignee: Qingdao Haier Smart Technology R&D Co Ltd; Haier Smart Home Co Ltd; Haier Shenzhen R&D Co Ltd
Priority date: 2021-09-15
Filing date: 2021-09-15
Publication date: 2021-12-28
Anticipated expiration: 2041-09-15
Also published as: CN113842139B

Abstract

Translated fromChinese

本申请涉及智能家电技术领域，公开一种用于监测睡眠的方法。在当前周期内，获取毫米波雷达在第一时长T1内的检测信号；对检测信号进行处理，获得用户在当前周期内的运动强度指数和运动状态指数；根据获得的运动强度指数和运动状态指数，确定用户在当前周期内的睡眠状态。在当前周期内，获取毫米波雷达在第一时长T1内的检测信号，并对该信号进行处理，获得用户的运动强度指数和运动状态指数，以确定用户的睡眠状态，仅仅需要根据雷达获取的检测信号进行数据分析，即可判断用户当前的睡眠状态，过程简单，实用性高。本申请还公开一种用于监测睡眠的装置及家电设备。

The present application relates to the technical field of smart home appliances, and discloses a method for monitoring sleep. In the current cycle, the detection signal of the millimeter-wave radar in the first time period T1 is obtained; the detection signal is processed to obtain the exercise intensity index and exercise state index of the user in the current cycle; according to the obtained exercise intensity index and exercise state index , to determine the user's sleep state in the current cycle. In the current cycle, the detection signal of the millimeter-wave radar in the first time period T1 is obtained, and the signal is processed to obtain the user's exercise intensity index and exercise state index to determine the user's sleep state. The data analysis of the detection signal can determine the current sleep state of the user, the process is simple, and the practicability is high. The present application also discloses a device for monitoring sleep and a home appliance.

Description

Method and device for monitoring sleep and household appliance

Technical Field

The application relates to the technical field of intelligent household appliances, for example, to a method and a device for monitoring sleep and a household appliance.

Background

Currently, there is an air conditioner control method for an air conditioner, the method including: the method comprises the steps of obtaining the motion amplitude of a user in a space acted by the air conditioner, wherein the motion amplitude is detected by a radar sensor, the detection of the motion amplitude is within a period of time, the period of time comprises a plurality of detection periods, the distances between the air conditioner and the user are obtained, and the motion amplitude is calculated according to the distances detected by the front detection period and the rear detection period; judging whether the user enters a sleep state or not according to the motion amplitude; the step of judging whether the user enters the sleep state or not according to the motion amplitude comprises the following steps: when the motion amplitude is smaller than the preset motion amplitude, controlling the radar sensor to detect the motion amplitude of the user in the space acted by the air conditioner again; when the motion amplitude detected again is smaller than the preset motion amplitude, judging that the user enters a sleep state; the method comprises the following steps of obtaining the motion amplitude of a user in a space acted by the air conditioner, and after the step of detecting the motion amplitude by a radar sensor, further comprising the following steps: acquiring the respiratory frequency of a user in a space acted by an air conditioner, wherein the respiratory frequency is detected by a radar sensor; judging whether the user enters a sleep state or not according to the breathing frequency and the motion amplitude; the step of judging whether the user enters the sleep state or not according to the breathing frequency and the motion amplitude comprises the following steps: the type of the user is detected through the breathing frequency, whether the user corresponds to the breathing frequency when the user correspondingly enters the sleep is judged through the user type correspondence, and if the user corresponds to the breathing frequency when the user correspondingly enters the sleep, the user is judged to enter the sleep if the user corresponds to the breathing frequency and the movement amplitude is smaller than the preset movement amplitude.

In the process of implementing the embodiments of the present disclosure, it is found that at least the following problems exist in the related art:

the method comprises the steps of obtaining the change rate of the motion amplitude of a user through a radar sensor in real time or at regular time, and determining the sleep stage of the user according to the change rate of the motion amplitude. The distance between the air conditioner and the user needs to be detected, and the motion amplitude is calculated through the distance, so that the process is excessively complicated, and the practicability is low.

Disclosure of Invention

The following presents a simplified summary in order to provide a basic understanding of some aspects of the disclosed embodiments. This summary is not an extensive overview nor is intended to identify key/critical elements or to delineate the scope of such embodiments but rather as a prelude to the more detailed description that is presented later.

The embodiment of the disclosure provides a method and a device for monitoring sleep and household electrical appliance equipment, so as to simplify the step of monitoring the sleep state of a user and improve the practicability.

In some embodiments, the method is applied to a household appliance, and the household appliance is provided with a millimeter wave radar; the method comprises the following steps:

in the current period, acquiring a detection signal of the millimeter wave radar in a first time length T1;

processing the detection signal to obtain a motion intensity index and a motion state index of the user in the current period;

and determining the sleep state of the user in the current period according to the obtained exercise intensity index and the exercise state index.

In some embodiments, the apparatus comprises:

the processor and the memory processor storing program instructions are configured, upon execution of the program instructions, to perform the method for monitoring sleep described above.

In some embodiments, the air conditioner includes:

the device comprises a millimeter wave radar arranged on the air conditioner and the device for monitoring sleep.

The method, the device and the household appliance for monitoring sleep provided by the embodiment of the disclosure can achieve the following technical effects:

in the current period, a detection signal of the millimeter wave radar in the first time period T1 is obtained, and the signal is processed to obtain the exercise intensity index and the exercise state index of the user so as to determine the sleep state of the user. The current sleep state of the user can be judged only by carrying out data analysis according to the detection signals acquired by the radar, and the method is simple in process and high in practicability.

The foregoing general description and the following description are exemplary and explanatory only and are not restrictive of the application.

Drawings

One or more embodiments are illustrated by way of example in the accompanying drawings, which correspond to the accompanying drawings and not in limitation thereof, in which elements having the same reference numeral designations are shown as like elements and not in limitation thereof, and wherein:

FIG. 1 is a schematic diagram of a method for monitoring sleep provided by an embodiment of the present disclosure;

fig. 2 is a schematic diagram of another method for monitoring sleep provided by an embodiment of the present disclosure;

fig. 3 is a schematic diagram of another method for monitoring sleep provided by an embodiment of the present disclosure;

FIG. 4 is a schematic diagram of another method for monitoring sleep provided by an embodiment of the present disclosure;

fig. 5 is a schematic diagram of an apparatus for monitoring sleep according to an embodiment of the present disclosure.

Detailed Description

So that the manner in which the features and elements of the disclosed embodiments can be understood in detail, a more particular description of the disclosed embodiments, briefly summarized above, may be had by reference to the embodiments, some of which are illustrated in the appended drawings. In the following description of the technology, for purposes of explanation, numerous details are set forth in order to provide a thorough understanding of the disclosed embodiments. However, one or more embodiments may be practiced without these details. In other instances, well-known structures and devices may be shown in simplified form in order to simplify the drawing.

The terms "first," "second," and the like in the description and in the claims, and the above-described drawings of embodiments of the present disclosure, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It should be understood that the data so used may be interchanged under appropriate circumstances such that embodiments of the present disclosure described herein may be made. Furthermore, the terms "comprising" and "having," as well as any variations thereof, are intended to cover non-exclusive inclusions.

The term "plurality" means two or more unless otherwise specified.

The term "correspond" may refer to an association or binding relationship, and a corresponds to B refers to an association or binding relationship between a and B.

Referring to fig. 1, an embodiment of the present disclosure provides a method for monitoring sleep, which is applied to a household appliance provided with a millimeter wave radar, and includes:

and S01, the household appliance acquires the detection signal of the millimeter wave radar in the first time length T1 in the current period.

And S02, the household appliance processes the detection signal to obtain the exercise intensity index and the exercise state index of the user in the current period.

And S03, the household appliance determines the sleep state of the user in the current period according to the obtained exercise intensity index and the exercise state index.

By adopting the method for monitoring sleep provided by the embodiment of the disclosure, in the current period, the household appliance equipment acquires the detection signal of the millimeter wave radar in the first time period T1, processes the signal and acquires the exercise intensity index and the exercise state index of the user. The household appliance performs data processing on the detection signal of the millimeter wave radar, and the obtained motion intensity index and motion state index can reflect the activity condition of the user detected by the millimeter wave radar in the current period. And then, the household appliance determines the sleep state of the user according to the exercise intensity index and the exercise state index. The current sleep state of the user can be judged only by carrying out data analysis according to the detection signals acquired by the radar without complex calculation steps, and the method is simple in process and high in practicability.

Optionally, the first time duration T1 is k × T, k being an integer greater than 1, and T being the time duration of each period. Therefore, the detection signals of the millimeter wave radar in the first time period T1 are processed, the data signals of the time period can more objectively reflect the physical activity condition of the user, and the misjudgment of the physical activity condition of the user caused by the fact that the obtained detection signals are too short is avoided.

Optionally, T1 includes a duration T of the current cycle and a duration T of the previous cycle. In this way, the detection signal of the time period can more accurately reflect the physical activity condition of the user in the current cycle. The situation that the sleep state of the user is misjudged due to the fact that the obtained detection signal is too far is avoided.

Optionally, the processing, performed by the home device, of the detection signal includes: the household appliance performs data cleaning on the detection signal, and data with high level lasting for more than a second time period t2 is reserved as target data; the household appliance equipment performs feature extraction on the target data to obtain the motion intensity and the motion state of the user in the current period; the household appliance determines a movement intensity index corresponding to the movement intensity according to the first corresponding relation; and the household appliance determines a motion state index corresponding to the motion state according to the second corresponding relation.

In this way, the household appliance performs data cleaning on the detection signal, retains the data with the high level lasting for the second time length t2 or more as the target data, and performs feature extraction on the target data. Through data cleaning, the interference of invalid data is eliminated, the difficulty of feature extraction is reduced, and the accuracy of feature extraction is improved. And obtaining the exercise intensity and the exercise state of the user in the current period through feature extraction, and respectively determining the exercise intensity index corresponding to the exercise intensity and the exercise state index corresponding to the exercise state by the household appliance according to the first corresponding relation and the second corresponding relation. The physical activity condition of the user in the current period detected by the millimeter wave radar is accurately reflected, the accuracy of monitoring the sleep state of the user by the household appliance is improved, and the practicability is improved. For example: the exercise intensity is divided into four levels with indexes of 0 to 3 according to comparison of the exercise intensity with a threshold value. The motion states are divided into nine states according to their comparison with a threshold, namely: no continuous fluctuation (index 0), no to little fluctuation (index 9), no to severe fluctuation (index 18), little to no continuous fluctuation (index 10), little to no fluctuation (index 1), little to severe fluctuation (index 19), severe to severe fluctuation (index 20), severe to none fluctuation (index 2). The greater the exercise intensity is, the greater the exercise intensity index is; the more severe the motion state, the larger the motion state index.

Optionally, the performing, by the home appliance, feature extraction on the target data to obtain the exercise intensity and the exercise state of the user in the current period includes: the household appliance takes the total number of data with the high-level duration time being more than t2 as the movement intensity; the home appliance device takes the length of the data with the maximum high level duration as the motion state.

In this way, because the millimeter wave radar continuously detects the body movement data of the user, the detection signal of the millimeter wave radar clearly reflects the body movement condition of the detected user. At this time, the exercise intensity and state of the user in the current period can be obtained by extracting features of the target data, for example, taking the total number of data having the high level duration of t2 or more as the exercise intensity, and taking the length of data having the maximum high level duration as the exercise state. The movement intensity and the state of the user in the current period can be obtained only by analyzing and analyzing the data of the detection signal of the millimeter wave radar, and the step of monitoring the sleep of the user is greatly simplified.

Optionally, the determining, by the home appliance device, the sleep state of the user in the current period according to the obtained exercise intensity index and the exercise state index includes: the household appliance determines whether a wakeful mark exists in the current period according to the motion intensity index and the motion state index; under the condition that the wakefulness mark exists in the current period and the continuous previous n periods, the household appliance determines that the user is in a wakefulness state; otherwise, the household appliance determines that the user is in the sleep state.

In this way, the household appliance determines whether a waking flag exists in the current period according to the motion intensity index and the motion state index, and the waking flag is used for representing whether the body motion of the user in the current period reaches a certain intensity and whether the motion state reaches a certain intensity. Therefore, the sleep state of the user is judged according to the existence condition of the waking mark in a plurality of cycles, and the real sleep state of the user can be accurately obtained. That is, when the awake flag exists in the current period and the previous n consecutive periods, the home appliance determines that the user is in the awake state, otherwise, the user is in the sleep state. The sleep state of the user is determined through the existence condition of the waking marks in multiple periods, so that the accuracy of sleep monitoring of the user is improved, and the practicability of the method is improved.

Optionally, the determining, by the home device, whether the awake flag exists in the current period according to the exercise intensity index and the exercise state index includes: in the current period and the previous m consecutive periods, the number of times that the motion intensity index is greater than the first threshold or the number of times that the motion state index is greater than the second threshold reaches a first set proportion, and then the household appliance determines that the wakeful mark exists in the current period.

In this way, in the current period and the previous m consecutive periods, the number of times that the exercise intensity index is greater than the first threshold value or the number of times that the exercise state index is greater than the second threshold value reaches the first set proportion. It is shown that in m +1 periods, the body movement intensity of the user is high, and the movement state is violent. At this time, since the probability that the user is in the awake state is high, the home appliance determines that the awake flag is present in the current period. The exercise intensity index and the exercise state index of a plurality of cycles can comprehensively reflect the body exercise condition of the user within a period of time, thereby judging whether the wakefulness mark exists or not. The accuracy of monitoring the sleep state of the user by the wake up indicator is improved.

With reference to fig. 2, another method for monitoring sleep is provided in an embodiment of the present disclosure, and is applied to a household appliance provided with a millimeter wave radar, including:

And S21, the household appliance determines the sleep degree of the user according to the occurrence frequency of the waking mark of the user for N continuous periods.

Wherein N is an integer greater than 2, and the N consecutive cycles comprise a current cycle. Provided N is less than or equal to 2, the data may be too short and the number of occurrences of the wake flag may not be sufficient to characterize the user's current level of sleep.

By adopting the method for monitoring sleep provided by the embodiment of the disclosure, in the current period, the household appliance performs data processing on the detection signal of the millimeter wave radar, and the obtained motion intensity index and motion state index can reflect the activity condition of the user detected by the millimeter wave radar in the current period. And then, the household appliance determines the sleep state of the user according to the exercise intensity index and the exercise state index. The current sleep state of the user can be judged only by carrying out data analysis according to the detection signals acquired by the radar without complex calculation steps, and the method is simple in process and high in practicability. In addition, the household appliance can monitor whether the user is asleep or not, and can determine the sleep degree of the user according to the occurrence frequency of the waking mark of the user for N continuous periods. The occurrence frequency of the waking mark of N continuous periods can represent the sleep degree of the user, and the accuracy of sleep monitoring is improved. The sleep degree of the user can be judged only by carrying out data analysis on the detection signal according to the millimeter wave radar, so that the sleep monitoring step is greatly simplified, and the practicability of sleep monitoring is improved.

Optionally, the determining, by the home device, the sleep level of the user according to the number of occurrences of the waking flag of the user for N consecutive periods includes: under the condition that the occurrence frequency of the waking mark in the continuous N periods is smaller than a third threshold value and the motion state index is smaller than a fourth threshold value, the household appliance determines that the sleep degree of the user is in a deep sleep state; otherwise, the home device determines to be in a light sleep state.

Thus, under the condition that the number of occurrences of the wakeful marker in N consecutive periods is smaller than the third threshold and the exercise status index is smaller than the fourth threshold, at this time, the number of occurrences of the wakeful marker is small, which indicates that the user does not exercise violently or the exercise intensity is relatively low, and the exercise status index is smaller than the fourth threshold, which indicates that the user does exercise violently within the period of time, and it can be determined that the user does not exercise weakly within the period of time. Therefore, the home appliance determines that the sleep level of the user is in a deep sleep state, and otherwise, the home appliance determines that the user is in a light sleep state. The sleep degree of the user is represented by the occurrence times of the waking marks in the continuous N periods, and the condition that the judgment error of the waking marks occurs is further avoided by the condition that the motion state index is smaller than the fourth threshold value. For example, when a user moves suddenly during a sleep process, the movement intensity is large and the intensity of the movement state is low, and at this time, the home appliance may determine that the waking flag exists in the current period because the movement intensity of the user in the current period is large. Therefore, by comparing the occurrence frequency and the motion state index of the waking mark in the continuous N periods with the third threshold and the fourth threshold respectively, the sleep degree of the user in the current period can be monitored, the interference of misjudgment of the refreshing mark can be eliminated, and the sleep monitoring accuracy of the user is improved.

With reference to fig. 3, another method for monitoring sleep is provided in an embodiment of the present disclosure, and is applied to a household appliance provided with a millimeter wave radar, including:

and S31, the household appliance judges whether a person exists.

Under the condition that a person exists, the household appliance performs operation of acquiring a detection signal of the millimeter wave radar within a first time period T1.

By adopting the method for monitoring sleep provided by the embodiment of the disclosure, the household appliance determines the sleep state of the user according to the exercise intensity index and the exercise state index. The current sleep state of the user can be judged only by carrying out data analysis according to the detection signals acquired by the radar without complex calculation steps, and the method is simple in process and high in practicability. In addition, a step of judging whether the user exists is added before monitoring the current sleep state of the user, if the person exists, the household appliance performs the operation of acquiring the detection signal of the millimeter wave radar in the first time length T1, and if the person does not exist, the operation of monitoring the sleep state of the user is not performed. The condition that the household appliance still carries out sleep monitoring under the condition that no person exists is avoided, the energy consumption is reduced, the system resources are saved, and the sleep monitoring efficiency is improved.

Optionally, the determining, by the home device, whether a person exists includes: the household appliance judges whether a person exists in the current period or not according to the current and previous motion intensity indexes of continuous Q periods; under the condition that the occurrence proportion that the current and previous continuous Q-period motion intensity indexes are larger than a fifth threshold value reaches a preset proportion, the household appliance determines that a person exists; otherwise, the household appliance determines that no person exists.

Therefore, the household appliance judges whether a person exists in the current period according to the exercise intensity indexes of the current and previous continuous Q periods, and the exercise intensity indexes can represent the body exercise intensity of the user, so that the exercise intensity of the user in a period of time, namely the activity condition, can be judged through the exercise intensity indexes of a plurality of periods. And under the condition that the occurrence proportion that the current and previous motion intensity indexes of the continuous Q periods are larger than the fifth threshold value reaches a preset proportion, the household appliance determines that a person exists, otherwise, the household appliance determines that no person exists. The occurrence proportion that the exercise intensity index is larger than the fifth threshold reaches a preset proportion, which shows that the continuous body exercise of the user reaches a certain intensity in the period of time and meets the existing standards of people. Whether people exist or not is judged through the exercise intensity of a plurality of periods, the condition that the household appliance still carries out sleep monitoring under the condition that no people exist is avoided, the energy consumption is reduced, the system resources are saved, and the sleep monitoring efficiency is improved.

With reference to fig. 4, another method for monitoring sleep is provided in an embodiment of the present disclosure, and is applied to a household appliance provided with a millimeter wave radar, including:

and S41, the household appliance judges whether a person exists.

By adopting the method for monitoring sleep provided by the embodiment of the disclosure, the household appliance determines the sleep state of the user according to the exercise intensity index and the exercise state index. The current sleep state of the user can be judged only by carrying out data analysis according to the detection signals acquired by the radar without complex calculation steps, and the method is simple in process and high in practicability. And before monitoring the current sleep state of the user, adding a step of judging whether the user exists, wherein if the user exists, the household appliance performs the operation of acquiring the detection signal of the millimeter wave radar within the first time length T1, and if the user does not exist, the operation of monitoring the sleep state of the user is not performed. The condition that the household appliance still carries out sleep monitoring under the condition that no person exists is avoided, the energy consumption is reduced, the system resources are saved, and the sleep monitoring efficiency is improved. In addition, the household appliance can monitor whether the user is asleep or not, and can determine the sleep degree of the user according to the occurrence frequency of the waking mark of the user for N continuous periods. The occurrence frequency of the waking mark of N continuous periods can represent the sleep degree of the user, and the accuracy of sleep monitoring is improved. The sleep degree of the user can be judged only by carrying out data analysis on the detection signal according to the millimeter wave radar, so that the sleep monitoring step is greatly simplified, and the practicability of sleep monitoring is improved.

As shown in fig. 5, an apparatus for monitoring sleep according to an embodiment of the present disclosure includes a processor (processor)100 and a memory (memory) 101. Optionally, the apparatus may also include a Communication Interface (Communication Interface)102 and abus 103. Theprocessor 100, thecommunication interface 102, and thememory 101 may communicate with each other via abus 103. Thecommunication interface 102 may be used for information transfer. Theprocessor 100 may call logic instructions in thememory 101 to perform the method for monitoring sleep of the above-described embodiment.

In addition, the logic instructions in thememory 101 may be implemented in the form of software functional units and stored in a computer readable storage medium when the logic instructions are sold or used as independent products.

Thememory 101, which is a computer-readable storage medium, may be used for storing software programs, computer-executable programs, such as program instructions/modules corresponding to the methods in the embodiments of the present disclosure. Theprocessor 100 executes functional applications and data processing, i.e., implements the method for monitoring sleep in the above-described embodiments, by executing program instructions/modules stored in thememory 101.

Thememory 101 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to the use of the terminal device, and the like. In addition, thememory 101 may include a high-speed random access memory, and may also include a nonvolatile memory.

The embodiment of the present disclosure provides a home appliance, including: the above-described apparatus for monitoring sleep; a millimeter wave radar configured to operate under control of the processor.

Embodiments of the present disclosure provide a storage medium storing computer-executable instructions configured to perform the above-described method for monitoring sleep.

The storage medium may be a transitory storage medium or a non-transitory storage medium.

The technical solution of the embodiments of the present disclosure may be embodied in the form of a software product, where the computer software product is stored in a storage medium and includes one or more instructions to enable a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method of the embodiments of the present disclosure. And the aforementioned storage medium may be a non-transitory storage medium comprising: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes, and may also be a transient storage medium.

The above description and drawings sufficiently illustrate embodiments of the disclosure to enable those skilled in the art to practice them. Other embodiments may incorporate structural, logical, electrical, process, and other changes. The examples merely typify possible variations. Individual components and functions are optional unless explicitly required, and the sequence of operations may vary. Portions and features of some embodiments may be included in or substituted for those of others. Furthermore, the words used in the specification are words of description only and are not intended to limit the claims. As used in the description of the embodiments and the claims, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. Similarly, the term "and/or" as used in this application is meant to encompass any and all possible combinations of one or more of the associated listed. Furthermore, the terms "comprises" and/or "comprising," when used in this application, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. Without further limitation, an element defined by the phrase "comprising an …" does not exclude the presence of other like elements in a process, method or apparatus that comprises the element. In this document, each embodiment may be described with emphasis on differences from other embodiments, and the same and similar parts between the respective embodiments may be referred to each other. For methods, products, etc. of the embodiment disclosures, reference may be made to the description of the method section for relevance if it corresponds to the method section of the embodiment disclosure.

Those of skill in the art would appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software may depend upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the disclosed embodiments. It can be clearly understood by the skilled person that, for convenience and brevity of description, the specific working processes of the system, the apparatus and the unit described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

In the embodiments disclosed herein, the disclosed methods, products (including but not limited to devices, apparatuses, etc.) may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units may be merely a logical division, and in actual implementation, there may be another division, for example, multiple units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form. The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to implement the present embodiment. In addition, functional units in the embodiments of the present disclosure may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. In the description corresponding to the flowcharts and block diagrams in the figures, operations or steps corresponding to different blocks may also occur in different orders than disclosed in the description, and sometimes there is no specific order between the different operations or steps. For example, two sequential operations or steps may in fact be executed substantially concurrently, or they may sometimes be executed in the reverse order, depending upon the functionality involved. Each block of the block diagrams and/or flowchart illustrations, and combinations of blocks in the block diagrams and/or flowchart illustrations, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.