技术领域Technical Field
本申请涉及终端设备技术领域,尤其涉及一种监测睡眠的方法和相关电子设备。The present application relates to the technical field of terminal devices, and in particular to a method for monitoring sleep and related electronic devices.
背景技术Background Art
睡眠呼吸暂停对健康危害大,全球近10亿人有睡眠呼吸暂停问题,如果呼吸暂停时间过久,会导致血氧降低,低血氧会损伤心、脑等器官,影响身体健康。睡眠呼吸暂停引发的过低血氧可能会激发恶性心血管事件,比如常见的夜间心肌梗死死亡。然而,睡眠呼吸暂停综合征患病知晓率不到20%,临床上需要在多组设备的监测下进行筛查,不适用于家庭日常。Sleep apnea is a serious health hazard. Nearly 1 billion people worldwide have sleep apnea. If apnea lasts too long, it will cause low blood oxygen, which can damage the heart, brain and other organs and affect physical health. Low blood oxygen caused by sleep apnea may trigger malignant cardiovascular events, such as common nocturnal myocardial infarction and death. However, the awareness rate of sleep apnea syndrome is less than 20%, and clinical screening requires monitoring under multiple sets of equipment, which is not suitable for daily home use.
发明内容Summary of the invention
本申请实施例提供了一种监测睡眠的方法和相关电子设备,通过使用易获得的电子设备检测用户在睡眠中发生呼吸暂停时的睡姿,可实现电子设备对用户的非接触式睡姿检测,并且输出用于提示用户调整睡姿的提示信息,以在用户发生睡眠呼吸暂停时,及时干预,保护用户的生命安全。The embodiments of the present application provide a method for monitoring sleep and related electronic devices. By using readily available electronic devices to detect the sleeping position of a user when sleep apnea occurs, the electronic device can detect the user's sleeping position non-contactly, and output prompt information to prompt the user to adjust the sleeping position, so as to intervene in time when the user has sleep apnea and protect the user's life safety.
第一方面,本申请实施例提供一种监测睡眠的方法,应用于电子设备,所述电子设备包括超声波发射装置和超声波接收装置,所述方法包括:在检测到用户在睡眠状态下发生呼吸暂停时,通过所述超声波发射装置向所述用户发射第一超声波;通过所述超声波接收装置接收第二超声波,所述第二超声波为反射的第一超声波,所述第二超声波包括所述用户反射的所述第一超声波;根据所述用户反射的所述第一超声波的总功率,确定所述用户的睡姿;在所述用户的睡姿为仰卧时,输出提示信息,所述提示信息用于提示所述用户调整睡姿。In a first aspect, an embodiment of the present application provides a method for monitoring sleep, which is applied to an electronic device, wherein the electronic device includes an ultrasonic transmitting device and an ultrasonic receiving device, and the method includes: when it is detected that a user has apnea while sleeping, transmitting a first ultrasonic wave to the user by the ultrasonic transmitting device; receiving a second ultrasonic wave by the ultrasonic receiving device, wherein the second ultrasonic wave is a reflected first ultrasonic wave, and the second ultrasonic wave includes the first ultrasonic wave reflected by the user; determining the sleeping position of the user based on the total power of the first ultrasonic wave reflected by the user; and when the user's sleeping position is supine, outputting a prompt message, wherein the prompt message is used to prompt the user to adjust the sleeping position.
第一方面提供的方法可由终端电子设备执行,终端电子设备易获得,因此该方法适用于日常。电子设备在与用户一定距离下识别用户的睡姿,实现了非接触式的睡姿检测,并且电子设备输出提示信息提醒用户,通过在用户发生睡眠呼吸暂停时,及时干预,保护用户的生命安全。同时,电子设备持续监测用户的睡眠,在判断到用户发生了呼吸暂停,开启睡姿检测,这样在必要时开启该功能,可降低电子设备的耗能。The method provided in the first aspect can be executed by a terminal electronic device, which is easily available, so the method is suitable for daily use. The electronic device identifies the user's sleeping posture at a certain distance from the user, realizing non-contact sleeping posture detection, and the electronic device outputs a prompt message to remind the user, and timely intervenes when the user has sleep apnea to protect the user's life safety. At the same time, the electronic device continuously monitors the user's sleep, and turns on the sleeping posture detection when it is determined that the user has apnea. Turning on this function when necessary can reduce the energy consumption of the electronic device.
结合第一方面,在一些实施例中,所述根据所述用户反射的所述第一超声波的总功率,确定所述用户的睡姿,具体包括:在所述用户反射的所述第一超声波的总功率小于目标阈值时,确定所述用户的睡姿为仰卧。In combination with the first aspect, in some embodiments, determining the sleeping position of the user based on the total power of the first ultrasonic wave reflected by the user specifically includes: when the total power of the first ultrasonic wave reflected by the user is less than a target threshold, determining that the sleeping position of the user is supine.
结合第一方面,在一些实施例中,所述在所述用户反射的所述第一超声波的总功率小于目标阈值时,确定所述用户的睡姿为仰卧之前,所述方法还包括:根据所述用户的身高和所述用户与所述电子设备的距离,确定所述目标阈值;在所述距离不变时,所述身高越大,所述目标阈值越大;在所述身高不变时,所述距离越大,所述目标阈值越小。In combination with the first aspect, in some embodiments, when the total power of the first ultrasonic wave reflected by the user is less than a target threshold, before determining that the user's sleeping position is supine, the method further includes: determining the target threshold based on the user's height and the distance between the user and the electronic device; when the distance remains unchanged, the greater the height, the greater the target threshold; when the height remains unchanged, the greater the distance, the smaller the target threshold.
结合第一方面,在一些实施例中,所述超声波发射装置包括阵列排列的多个发射阵元,所述通过所述超声波发射装置向所述用户发射第一超声波,包括:获取所述电子设备与所述用户的距离;根据所述用户的身高计算所述用户的上半身的长度;根据所述距离、所述长度和所述发射阵元的位置确定波束宽度;在所述距离下,通过所述超声波发射装置以所述波束宽度向所述用户发射第一超声波,以使所述第一超声波覆盖用户的上半身。In combination with the first aspect, in some embodiments, the ultrasonic emitting device includes a plurality of transmitting array elements arranged in an array, and transmitting a first ultrasonic wave to the user through the ultrasonic emitting device includes: obtaining the distance between the electronic device and the user; calculating the length of the upper body of the user according to the height of the user; determining a beam width according to the distance, the length and the position of the transmitting array element; and transmitting a first ultrasonic wave to the user through the ultrasonic emitting device at the distance with the beam width so that the first ultrasonic wave covers the upper body of the user.
结合第一方面,在一些实施例中,获取所述电子设备与所述用户的距离,包括:通过所述超声波发射装置向所述用户发射第三超声波;过所述超声波接收装置接收第四超声波,所述第四超声波为反射的所述第三超声波;根据所述第三超声波与所述第四超声波之间的时差与所述第三超声波的传播速度,确定所述距离。In combination with the first aspect, in some embodiments, obtaining the distance between the electronic device and the user includes: transmitting a third ultrasonic wave to the user through the ultrasonic transmitting device; receiving a fourth ultrasonic wave through the ultrasonic receiving device, wherein the fourth ultrasonic wave is the reflected third ultrasonic wave; and determining the distance based on the time difference between the third ultrasonic wave and the fourth ultrasonic wave and the propagation speed of the third ultrasonic wave.
结合第一方面,在一些实施例中,所述通过所述超声波接收装置接收第二超声波之后,所述根据所述用户反射的所述第一超声波的总功率,确定所述用户的睡姿之前,所述方法还包括:从所述第二超声波的功率信息中滤除除所述用户之外的障碍物反射的第一超声波的功率信息,得到所述用户反射的第一超声波的功率信息,所述第二超声波包括所述用户反射的第一超声波和除所述用户之外的障碍物反射的所述第一超声波。In combination with the first aspect, in some embodiments, after receiving the second ultrasonic wave by the ultrasonic receiving device, before determining the sleeping position of the user based on the total power of the first ultrasonic wave reflected by the user, the method also includes: filtering out the power information of the first ultrasonic wave reflected by obstacles other than the user from the power information of the second ultrasonic wave to obtain the power information of the first ultrasonic wave reflected by the user, the second ultrasonic wave including the first ultrasonic wave reflected by the user and the first ultrasonic wave reflected by obstacles other than the user.
结合第一方面,在一些实施例中,所述方法还包括:在接收可穿戴设备发送的指示信息时,则检测到用户在睡眠状态下发生呼吸暂停,所述指示信息用于指示所述用户在睡眠状态下发生呼吸暂停。In combination with the first aspect, in some embodiments, the method further includes: when receiving indication information sent by the wearable device, detecting that the user has apnea while sleeping, the indication information is used to indicate that the user has apnea while sleeping.
结合第一方面,在一些实施例中,所述方法还包括:接收可穿戴设备发送的生理信息,所述生理信息包括血氧饱和度;在检测到所述用户处于睡眠状态且所述血氧饱和度小于第一血氧阈值时,确定所述用户发生睡眠呼吸暂停。In combination with the first aspect, in some embodiments, the method further includes: receiving physiological information sent by a wearable device, the physiological information including blood oxygen saturation; when it is detected that the user is in a sleeping state and the blood oxygen saturation is less than a first blood oxygen threshold, determining that the user has sleep apnea.
结合第一方面,在一些实施例中,所述电子设备还包括音频采集装置,所述方法还包括:在检测到所述用户处于睡眠状态时,通过所述音频采集装置获取环境的第一声音;在所述第一声音不包括呼吸声或所述第一声音包括的呼吸声的呼吸率小于第一阈值时,所述用户发生睡眠呼吸暂停。In combination with the first aspect, in some embodiments, the electronic device also includes an audio collection device, and the method also includes: when it is detected that the user is in a sleeping state, acquiring a first sound of the environment through the audio collection device; when the first sound does not include a breathing sound or the breathing rate of the breathing sound included in the first sound is less than a first threshold, the user has sleep apnea.
结合第一方面,在一些实施例中,所述电子设备还包括音频采集装置,所述方法还包括:通过所述音频采集装置获取环境的第二声音;所述第二声音包括的呼吸声的呼吸率小于第二阈值时,确定所述用户处于睡眠状态。In combination with the first aspect, in some embodiments, the electronic device also includes an audio collection device, and the method also includes: acquiring a second sound of the environment through the audio collection device; when a breathing rate of a breathing sound included in the second sound is less than a second threshold, determining that the user is in a sleeping state.
结合第一方面,在一些实施例中,所述方法还包括:接收可穿戴设备发送的心率;在所述心率处于第一心率范围时,确定所述用户处于睡眠状态,所述第一心率范围是以所述用户的睡眠基准心率为中心的心率范围,所述睡眠基准心率为所述用户在睡眠状态下的平均心率。In combination with the first aspect, in some embodiments, the method also includes: receiving a heart rate sent by a wearable device; when the heart rate is in a first heart rate range, determining that the user is in a sleep state, the first heart rate range being a heart rate range centered on the user's sleep baseline heart rate, and the sleep baseline heart rate being the average heart rate of the user in the sleep state.
结合第一方面,在一些实施例中,所述输出提示信息,包括:向可穿戴设备发送提示信息,以使所述可穿戴设备在接收到所述提示信息后,所述可穿戴设备震动和显示所述提示信息。In combination with the first aspect, in some embodiments, the outputting the prompt information includes: sending the prompt information to the wearable device, so that after the wearable device receives the prompt information, the wearable device vibrates and displays the prompt information.
第二方面,本申请实施例提供了一种电子设备,包括处理器、存储器、超声波发射装置和超声波接收装置,其中,所述处理器通过总线分别耦合所述超声波发射装置、所述超声波接收装置、所述一个或多个存储器;所述一个或多个存储器用于存储计算机程序代码,所述计算机程序代码包括计算机指令;所述处理器用于调用所述计算机指令执行以下操作:在检测到用户在睡眠状态下发生呼吸暂停时,通过所述超声波发射装置向所述用户发射第一超声波;通过所述超声波接收装置接收第二超声波,所述第二超声波为反射的第一超声波,所述第二超声波包括所述用户反射的所述第一超声波;根据所述用户反射的所述第一超声波的总功率,确定所述用户的睡姿;在所述用户的睡姿为仰卧时,输出提示信息,所述提示信息用于提示所述用户调整睡姿。In a second aspect, an embodiment of the present application provides an electronic device, comprising a processor, a memory, an ultrasonic transmitting device and an ultrasonic receiving device, wherein the processor is respectively coupled to the ultrasonic transmitting device, the ultrasonic receiving device and the one or more memories through a bus; the one or more memories are used to store computer program codes, and the computer program codes include computer instructions; the processor is used to call the computer instructions to perform the following operations: when it is detected that a user has apnea in a sleeping state, a first ultrasonic wave is transmitted to the user through the ultrasonic transmitting device; a second ultrasonic wave is received through the ultrasonic receiving device, the second ultrasonic wave is a reflected first ultrasonic wave, and the second ultrasonic wave includes the first ultrasonic wave reflected by the user; the sleeping position of the user is determined according to the total power of the first ultrasonic wave reflected by the user; when the user's sleeping position is supine, a prompt message is output, and the prompt message is used to prompt the user to adjust the sleeping position.
结合第二方面,在一些实施例中,所述处理器执行根据所述用户反射的所述第一超声波的总功率,确定所述用户的睡姿,包括执行:在所述用户反射的所述第一超声波的总功率小于目标阈值时,确定所述用户的睡姿为仰卧。In combination with the second aspect, in some embodiments, the processor determines the sleeping position of the user based on the total power of the first ultrasonic wave reflected by the user, including executing: when the total power of the first ultrasonic wave reflected by the user is less than a target threshold, determining that the sleeping position of the user is supine.
结合第二方面,在一些实施例中,所述处理器在所述用户反射的所述第一超声波的总功率小于目标阈值时,确定所述用户的睡姿为仰卧之前,包括执行:根据所述用户的身高和所述用户与所述电子设备的距离,确定所述目标阈值;在所述距离不变时,所述身高越大,所述目标阈值越大;在所述身高不变时,所述距离越大,所述目标阈值越小。In combination with the second aspect, in some embodiments, when the total power of the first ultrasonic wave reflected by the user is less than the target threshold, the processor determines that the user's sleeping position is supine before executing: determining the target threshold based on the user's height and the distance between the user and the electronic device; when the distance remains unchanged, the larger the height, the larger the target threshold; when the height remains unchanged, the larger the distance, the smaller the target threshold.
结合第二方面,在一些实施例中,所述超声波发射装置包括阵列排列的多个发射阵元,所述处理器执行通过所述超声波发射装置向所述用户发射第一超声波,包括执行:获取所述电子设备与所述用户的距离;根据所述用户的身高计算所述用户的上半身的长度;根据所述距离、所述长度和所述发射阵元的位置确定波束宽度;在所述距离下,通过所述超声波发射装置以所述波束宽度向所述用户发射第一超声波,以使所述第一超声波覆盖用户的上半身。In combination with the second aspect, in some embodiments, the ultrasonic emitting device includes a plurality of transmitting array elements arranged in an array, and the processor executes the emission of a first ultrasonic wave to the user through the ultrasonic emitting device, including: obtaining the distance between the electronic device and the user; calculating the length of the upper body of the user according to the height of the user; determining the beam width according to the distance, the length and the position of the transmitting array element; and at the distance, emitting the first ultrasonic wave to the user through the ultrasonic emitting device with the beam width so that the first ultrasonic wave covers the upper body of the user.
结合第二方面,在一些实施例中,所述处理器执行获取所述电子设备与所述用户的距离,包括执行:通过所述超声波发射装置向所述用户发射第三超声波;通过所述超声波接收装置接收第四超声波,所述第四超声波为反射的所述第三超声波;根据所述第三超声波与所述第四超声波之间的时差与所述第三超声波的传播速度,确定所述距离。In combination with the second aspect, in some embodiments, the processor executes obtaining the distance between the electronic device and the user, including: transmitting a third ultrasonic wave to the user through the ultrasonic wave transmitting device; receiving a fourth ultrasonic wave through the ultrasonic wave receiving device, wherein the fourth ultrasonic wave is the reflected third ultrasonic wave; and determining the distance based on the time difference between the third ultrasonic wave and the fourth ultrasonic wave and the propagation speed of the third ultrasonic wave.
结合第二方面,在一些实施例中,所述通过所述超声波接收装置接收第二超声波之后,所述处理器执行根据所述用户反射的所述第一超声波的总功率,确定所述用户的睡姿之前,还包括执行:从所述第二超声波的功率信息中滤除除所述用户之外的障碍物反射的第一超声波的功率信息,得到所述用户反射的第一超声波的功率信息,所述第二超声波包括所述用户反射的第一超声波和除所述用户之外的障碍物反射的所述第一超声波。In combination with the second aspect, in some embodiments, after receiving the second ultrasonic wave by the ultrasonic receiving device, the processor executes the following steps before determining the sleeping position of the user based on the total power of the first ultrasonic wave reflected by the user: filtering out the power information of the first ultrasonic wave reflected by obstacles other than the user from the power information of the second ultrasonic wave to obtain the power information of the first ultrasonic wave reflected by the user, wherein the second ultrasonic wave includes the first ultrasonic wave reflected by the user and the first ultrasonic wave reflected by obstacles other than the user.
结合第二方面,在一些实施例中,所述处理器还包括执行:通过所述通信模块接收可穿戴设备发送的指示信息,所述指示信息用于指示所述用户在睡眠状态下发生呼吸暂停。In combination with the second aspect, in some embodiments, the processor also includes executing: receiving indication information sent by the wearable device through the communication module, and the indication information is used to indicate that the user has apnea in a sleeping state.
结合第二方面,在一些实施例中,所述处理器还包括执行:通过所述通信模块接收可穿戴设备发送的生理信息,所述生理信息包括血氧饱和度;在检测到所述用户处于睡眠状态且所述血氧饱和度小于第一血氧阈值时,确定所述用户发生睡眠呼吸暂停。In combination with the second aspect, in some embodiments, the processor also includes executing: receiving physiological information sent by the wearable device through the communication module, the physiological information including blood oxygen saturation; when it is detected that the user is in a sleeping state and the blood oxygen saturation is less than a first blood oxygen threshold, determining that the user has sleep apnea.
结合第二方面,在一些实施例中,所述电子设备还包括音频采集装置,所述处理器还包括执行:在检测到所述用户处于睡眠状态时,通过所述音频采集装置获取环境的第一声音;在所述第一声音不包括呼吸声或所述第一声音包括的呼吸声的呼吸率小于第一阈值时,所述用户发生睡眠呼吸暂停。In combination with the second aspect, in some embodiments, the electronic device also includes an audio collection device, and the processor also includes executing: when it is detected that the user is in a sleeping state, acquiring a first sound of the environment through the audio collection device; when the first sound does not include a breathing sound or the breathing rate of the breathing sound included in the first sound is less than a first threshold, the user has sleep apnea.
结合第二方面,在一些实施例中,所述电子设备还包括音频采集装置,所述处理器还包括执行:通过所述音频采集装置获取环境的第二声音;所述第二声音包括的呼吸声的呼吸率小于第二阈值时,确定所述用户处于睡眠状态。In combination with the second aspect, in some embodiments, the electronic device also includes an audio collection device, and the processor also includes executing: acquiring a second sound of the environment through the audio collection device; when the breathing rate of the breathing sound included in the second sound is less than a second threshold, determining that the user is in a sleeping state.
结合第二方面,在一些实施例中,所述处理器还包括执行:通过所述通信模块接收可穿戴设备发送的心率;在所述心率处于第一心率范围时,确定所述用户处于睡眠状态,所述第一心率范围是以所述用户的睡眠基准心率为中心的心率范围,所述睡眠基准心率为所述用户在睡眠状态下的平均心率。In combination with the second aspect, in some embodiments, the processor also includes executing: receiving the heart rate sent by the wearable device through the communication module; when the heart rate is in a first heart rate range, determining that the user is in a sleep state, the first heart rate range is a heart rate range centered on the user's sleep baseline heart rate, and the sleep baseline heart rate is the average heart rate of the user in the sleep state.
结合第二方面,在一些实施例中,所述处理器执行所述输出提示信息,包括:向可穿戴设备发送提示信息,以使所述可穿戴设备在接收到所述提示信息后,所述可穿戴设备震动和显示所述提示信息。In combination with the second aspect, in some embodiments, the processor executes the output prompt information, including: sending the prompt information to the wearable device, so that after the wearable device receives the prompt information, the wearable device vibrates and displays the prompt information.
第三方面,本申请实施例提供了一种计算机存储介质,包括计算机指令,当所述计算机指令在电子设备上运行时,使得所述电子设备执行如第一方面所述的监测睡眠的方法。In a third aspect, an embodiment of the present application provides a computer storage medium, including computer instructions, which, when executed on an electronic device, enables the electronic device to execute the method for monitoring sleep as described in the first aspect.
可以理解地,上述第二方面提供的电子设备、第三方面提供的计算机可读存储介质均用于执行上述第一方面所提供的方法。因此,其所能达到的有益效果可参考对应方法中的有益效果,此处不再赘述。It can be understood that the electronic device provided in the second aspect and the computer-readable storage medium provided in the third aspect are both used to execute the method provided in the first aspect. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method, which will not be repeated here.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
图1是本申请实施例提供的一种睡眠干预系统的示意性说明图;FIG1 is a schematic diagram of a sleep intervention system provided in an embodiment of the present application;
图2A是本申请实施例提供的一种第一电子设备的硬件架构示意图;FIG2A is a schematic diagram of a hardware architecture of a first electronic device provided in an embodiment of the present application;
图2B是本申请实施例提供的一种第二电子设备的硬件架构示意图;FIG2B is a schematic diagram of a hardware architecture of a second electronic device provided in an embodiment of the present application;
图3是本申请实施例提供的第一种监测睡眠的方法的流程示意图;FIG3 is a flow chart of a first sleep monitoring method provided in an embodiment of the present application;
图4是本申请实施例提供的第二种监测睡眠的方法的流程示意图;FIG4 is a schematic diagram of a flow chart of a second method for monitoring sleep provided in an embodiment of the present application;
图5是本申请实施例提供的第三种监测睡眠的方法的流程示意图。FIG5 is a flow chart of a third method for monitoring sleep provided in an embodiment of the present application.
具体实施方式DETAILED DESCRIPTION
本申请以下实施例中所使用的术语只是为了描述特定实施例的目的,而并非旨在作为对本申请的限制。如在本申请的说明书和所附权利要求书中所使用的那样,单数表达形式“一个”、“一种”、“所述”、“上述”、“该”和“这一”旨在也包括复数表达形式,除非其上下文中明确地有相反指示。还应当理解,本申请中使用的术语“和/或”是指并包含一个或多个所列出项目的任何或所有可能组合。The terms used in the following embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to be used as limitations to the present application. As used in the specification and appended claims of the present application, the singular expressions "one", "a kind of", "said", "above", "the" and "this" are intended to also include plural expressions, unless there is a clear indication to the contrary in the context. It should also be understood that the term "and/or" used in the present application refers to and includes any or all possible combinations of one or more listed items.
下面首先介绍本申请实施例提供的一种睡眠干预系统的示意性说明图,如图1所示,该系统可以包括第一电子设备11和第二电子设备12,其中,第一电子设备11可以是手机、平板电脑等设备,第二电子设备12可以是智能手表、智能手环等可实现血氧测量的可穿戴设备。The following first introduces a schematic diagram of a sleep intervention system provided by an embodiment of the present application. As shown in Figure 1, the system may include a first electronic device 11 and a second electronic device 12, wherein the first electronic device 11 may be a mobile phone, a tablet computer or other device, and the second electronic device 12 may be a wearable device such as a smart watch or a smart bracelet that can realize blood oxygen measurement.
第一电子设备11可以包括超声波发射装置和超声波接收装置,可以用于超声波的发射和接收,以通过超声波检测用户的睡眠姿态。The first electronic device 11 may include an ultrasonic transmitting device and an ultrasonic receiving device, which may be used for transmitting and receiving ultrasonic waves so as to detect the sleeping posture of the user through ultrasonic waves.
第二电子设备12可以与第一电子设备11进行通信连接,例如蓝牙连接,WiFi连接等。第一电子设备11还可以向第二电子设备12发送用于指示其检测睡眠呼吸暂停的第一指令或用于获取生理信息、运动参数和声音等的第二指令。The second electronic device 12 can be connected to the first electronic device 11 in communication, such as Bluetooth connection, WiFi connection, etc. The first electronic device 11 can also send a first instruction for instructing the second electronic device 12 to detect sleep apnea or a second instruction for obtaining physiological information, motion parameters, and sound, etc.
第二电子设备12可以响应于上述第一指令,可以检测用户是否发生睡眠呼吸暂停。第二电子设备12可以包括心率传感器、血氧传感器、运动传感器等。其中,心率传感器用于获取心率和心率相关参数,心率可以用于检测用户是否进入睡眠状态;血氧传感器可以测量用户的血氧饱和度,血氧饱和度可以用于检测用户是否发生睡眠呼吸暂停;运动传感器可以获取用户的运动信息,进而识别到用户处于静止状态还是运动状态。在一种实现中,第二电子设备12可以检测用户是否发生睡眠呼吸暂停,进一步地,在检测到用户发生睡眠呼吸暂停后或在检测到发生严重睡眠呼吸暂停后,向第一电子设备11发送用于指示发生严重睡眠呼吸暂停的指示信息。The second electronic device 12 can respond to the above-mentioned first instruction and detect whether the user has sleep apnea. The second electronic device 12 may include a heart rate sensor, a blood oxygen sensor, a motion sensor, etc. Among them, the heart rate sensor is used to obtain the heart rate and heart rate-related parameters, and the heart rate can be used to detect whether the user has entered a sleep state; the blood oxygen sensor can measure the user's blood oxygen saturation, and the blood oxygen saturation can be used to detect whether the user has sleep apnea; the motion sensor can obtain the user's motion information, and then identify whether the user is in a static state or a moving state. In one implementation, the second electronic device 12 can detect whether the user has sleep apnea, and further, after detecting that the user has sleep apnea or after detecting that severe sleep apnea has occurred, it sends indication information to the first electronic device 11 to indicate that severe sleep apnea has occurred.
在另一种实现中,第二电子设备12可以响应于上述第二指令,将通过心率传感器用于获取心率和心率相关参数、血氧传感器可以测量用户的血氧饱和度、运动传感器可以获取用户的运动信息等实时发送至第一电子设备11,由第一电子设备11基于上述生理信息、运动信息来识别用户是否发生睡眠呼吸暂停。In another implementation, the second electronic device 12 can respond to the above-mentioned second instruction and send the heart rate and heart rate-related parameters obtained by the heart rate sensor, the blood oxygen sensor to measure the user's blood oxygen saturation, the motion sensor to obtain the user's motion information, etc. in real time to the first electronic device 11, and the first electronic device 11 can identify whether the user has sleep apnea based on the above-mentioned physiological information and motion information.
第一电子设备11在检测到用户发生呼吸睡眠暂停后,可以通过超声波发射装置发射第一超声波,该第一超声波经过用户、床、墙体等障碍物反射后,被超声波接收装置接收。这里将接收到的发射的第一超声波称为第二超声波。其中,第二超声波中包括用户反射的第一超声波和除用户之外的障碍物反射的第一超声波。进一步地,第一电子设备11可以根据用户反射的第一超声波的总功率确定用户的睡姿,总功率小于目标阈值时,确定该用户的睡姿为仰卧。在用户睡姿为仰卧时,可以向进行震动或者语音提示等,还可以向第二电子设备发送用于指示其震动和/或播放用于提示用户调整睡姿的语音信息等。After detecting that the user has sleep apnea, the first electronic device 11 can transmit a first ultrasonic wave through an ultrasonic wave transmitting device, and the first ultrasonic wave is reflected by obstacles such as the user, bed, and wall, and then received by an ultrasonic wave receiving device. The received transmitted first ultrasonic wave is referred to as the second ultrasonic wave here. Among them, the second ultrasonic wave includes the first ultrasonic wave reflected by the user and the first ultrasonic wave reflected by obstacles other than the user. Further, the first electronic device 11 can determine the sleeping position of the user based on the total power of the first ultrasonic wave reflected by the user, and when the total power is less than the target threshold, it is determined that the sleeping position of the user is supine. When the user's sleeping position is supine, vibration or voice prompts can be performed, and a voice message for instructing the second electronic device to vibrate and/or play a voice message for prompting the user to adjust the sleeping position can also be sent to the second electronic device.
上述监测睡眠的方法,通过监测用户睡眠时的呼吸状态,判断用户是否发生呼吸暂停,当用户发生呼吸暂停时,开启超声波检测用户的睡姿,检测到用户的睡姿为仰卧时,电子设备可以干预用户睡眠,发出提醒用户调整睡姿的提示信息,以提示用户调整睡姿,保障用户的生命安全。The above-mentioned method of monitoring sleep determines whether the user has sleep apnea by monitoring the user's breathing status during sleep. When the user has sleep apnea, the ultrasonic wave is turned on to detect the user's sleeping position. When it is detected that the user is sleeping in a supine position, the electronic device can intervene in the user's sleep and send a prompt message to remind the user to adjust the sleeping position, so as to prompt the user to adjust the sleeping position and ensure the user's life safety.
本申请实施例中,第一电子设备可以是手机、平板电脑等终端设备,为大众都具有的电子设备,适用于用户的日常生活。电子设备在用户处于睡眠状态时判断到用户发生了呼吸暂停,开启睡姿识别,这样在必要时开启该功能,可降低电子设备的耗能。In the embodiment of the present application, the first electronic device can be a terminal device such as a mobile phone or a tablet computer, which is an electronic device that is commonly used by the public and is suitable for the daily life of the user. When the user is in a sleeping state, the electronic device determines that the user has apnea and turns on the sleeping posture recognition. In this way, turning on this function when necessary can reduce the energy consumption of the electronic device.
下面首先介绍本申请实施例提供的示例性第一电子设备100。The following first introduces an exemplary first electronic device 100 provided in an embodiment of the present application.
图2A示出了第一电子设备100的硬件架构示意图。第一电子设备100可以是手机、平板电脑、智能音响等电子设备。Fig. 2A shows a schematic diagram of the hardware architecture of the first electronic device 100. The first electronic device 100 may be an electronic device such as a mobile phone, a tablet computer, or a smart speaker.
第一电子设备100可以包括处理器110,外部存储器接口120,内部存储器121,通用串行总线(universal serial bus,USB)接口130,充电管理模块140,电源管理模块141,电池142,天线1,天线2,移动通信模块150,无线通信模块160,音频模块170,扬声器170A,受话器170B,音频采集装置170C,耳机接口170D,超声波发射装置170E,超声波接收装置170F,传感器模块180,按键190,马达191,指示器192,摄像头193,显示屏194,以及用户标识模块(subscriber identification module,SIM)卡接口195等。其中传感器模块180可以包括压力传感器180A,陀螺仪传感器180B,气压传感器180C,磁传感器180D,加速度传感器180E,距离传感器180F,接近光传感器180G,指纹传感器180H,温度传感器180J,触摸传感器180K,环境光传感器180L,骨传导传感器180M等。The first electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, an audio collection device 170C, an earphone interface 170D, an ultrasonic transmitting device 170E, an ultrasonic receiving device 170F, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
可以理解的是,本发明实施例示意的结构并不构成对第一电子设备100的具体限定。在本申请另一些实施例中,第一电子设备100可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the first electronic device 100. In other embodiments of the present application, the first electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.
处理器110可以包括一个或多个处理单元,例如:处理器110可以包括应用处理器(application processor,AP),调制解调处理器,图形处理器(graphics processingunit,GPU),图像信号处理器(image signal processor,ISP),控制器,存储器,视频编解码器,数字信号处理器(digital signal processor,DSP),基带处理器,和/或神经网络处理器(neural-network processing unit,NPU)等。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and/or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.
其中,控制器可以是第一电子设备100的神经中枢和指挥中心。控制器可以根据指令操作码和时序信号,产生操作控制信号,完成取指令和执行指令的控制。The controller may be the nerve center and command center of the first electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.
处理器110中还可以设置存储器,用于存储指令和数据。在一些实施例中,处理器110中的存储器为高速缓冲存储器。该存储器可以保存处理器110刚用过或循环使用的指令或数据。如果处理器110需要再次使用该指令或数据,可从所述存储器中直接调用。避免了重复存取,减少了处理器110的等待时间,因而提高了系统的效率。The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
在一些实施例中,处理器110可以包括一个或多个接口。接口可以包括集成电路(inter-integrated circuit,I2C)接口,集成电路内置音频(inter-integrated circuitsound,I2S)接口,脉冲编码调制(pulse code modulation,PCM)接口,通用异步收发传输器(universal asynchronous receiver/transmitter,UART)接口,移动产业处理器接口(mobile industry processor interface,MIPI),通用输入输出(general-purposeinput/output,GPIO)接口,用户标识模块(subscriber identity module,SIM)接口,和/或通用串行总线(universal serial bus,USB)接口等。In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver/transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input/output (GPIO) interface, a subscriber identity module (SIM) interface, and/or a universal serial bus (USB) interface, etc.
I2C接口是一种双向同步串行总线,包括一根串行数据线(serial data line,SDA)和一根串行时钟线(derail clock line,SCL)。在一些实施例中,处理器110可以包含多组I2C总线。处理器110可以通过不同的I2C总线接口分别耦合触摸传感器180K,充电器,闪光灯,摄像头193等。例如:处理器110可以通过I2C接口耦合触摸传感器180K,使处理器110与触摸传感器180K通过I2C总线接口通信,实现第一电子设备100的触摸功能。The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple groups of I2C buses. The processor 110 may be coupled to the touch sensor 180K, the charger, the flash, the camera 193, etc. through different I2C bus interfaces. For example: the processor 110 may be coupled to the touch sensor 180K through the I2C interface, so that the processor 110 communicates with the touch sensor 180K through the I2C bus interface, thereby realizing the touch function of the first electronic device 100.
I2S接口可以用于音频通信。在一些实施例中,处理器110可以包含多组I2S总线。处理器110可以通过I2S总线与音频模块170耦合,实现处理器110与音频模块170之间的通信。在一些实施例中,音频模块170可以通过I2S接口向无线通信模块160传递音频信号,实现通过蓝牙耳机接听电话的功能。The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to achieve communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit an audio signal to the wireless communication module 160 via the I2S interface to achieve the function of answering a call through a Bluetooth headset.
PCM接口也可以用于音频通信,将模拟信号抽样,量化和编码。在一些实施例中,音频模块170与无线通信模块160可以通过PCM总线接口耦合。在一些实施例中,音频模块170也可以通过PCM接口向无线通信模块160传递音频信号,实现通过蓝牙耳机接听电话的功能。所述I2S接口和所述PCM接口都可以用于音频通信。The PCM interface can also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface to implement the function of answering calls via a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.
UART接口是一种通用串行数据总线,用于异步通信。该总线可以为双向通信总线。它将要传输的数据在串行通信与并行通信之间转换。在一些实施例中,UART接口通常被用于连接处理器110与无线通信模块160。例如:处理器110通过UART接口与无线通信模块160中的蓝牙模块通信,实现蓝牙功能。在一些实施例中,音频模块170可以通过UART接口向无线通信模块160传递音频信号,实现通过蓝牙耳机播放音乐的功能。The UART interface is a universal serial data bus for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is generally used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to implement the Bluetooth function. In some embodiments, the audio module 170 can transmit an audio signal to the wireless communication module 160 through the UART interface to implement the function of playing music through a Bluetooth headset.
MIPI接口可以被用于连接处理器110与显示屏194,摄像头193等外围器件。MIPI接口包括摄像头串行接口(camera serial interface,CSI),显示屏串行接口(displayserial interface,DSI)等。在一些实施例中,处理器110和摄像头193通过CSI接口通信,实现第一电子设备100的拍摄功能。处理器110和显示屏194通过DSI接口通信,实现第一电子设备100的显示功能。The MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc. In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to implement the shooting function of the first electronic device 100. The processor 110 and the display screen 194 communicate via the DSI interface to implement the display function of the first electronic device 100.
GPIO接口可以通过软件配置。GPIO接口可以被配置为控制信号,也可被配置为数据信号。在一些实施例中,GPIO接口可以用于连接处理器110与摄像头193,显示屏194,无线通信模块160,音频模块170,传感器模块180等。GPIO接口还可以被配置为I2C接口,I2S接口,UART接口,MIPI接口等。The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 with the camera 193, the display 194, the wireless communication module 160, the audio module 170, the sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.
USB接口130是符合USB标准规范的接口,具体可以是Mini USB接口,Micro USB接口,USB Type C接口等。USB接口130可以用于连接充电器为第一电子设备100充电,也可以用于第一电子设备100与外围设备之间传输数据。也可以用于连接耳机,通过耳机播放音频。该接口还可以用于连接其他第一电子设备,例如AR设备等。The USB interface 130 is an interface that complies with the USB standard specification, and can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the first electronic device 100, and can also be used to transfer data between the first electronic device 100 and a peripheral device. It can also be used to connect headphones to play audio through the headphones. The interface can also be used to connect other first electronic devices, such as AR devices, etc.
可以理解的是,本发明实施例示意的各模块间的接口连接关系,只是示意性说明,并不构成对第一电子设备100的结构限定。在本申请另一些实施例中,第一电子设备100也可以采用上述实施例中不同的接口连接方式,或多种接口连接方式的组合。It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present invention is only a schematic illustration and does not constitute a structural limitation on the first electronic device 100. In other embodiments of the present application, the first electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.
充电管理模块140用于从充电器接收充电输入。其中,充电器可以是无线充电器,也可以是有线充电器。在一些有线充电的实施例中,充电管理模块140可以通过USB接口130接收有线充电器的充电输入。在一些无线充电的实施例中,充电管理模块140可以通过第一电子设备100的无线充电线圈接收无线充电输入。充电管理模块140为电池142充电的同时,还可以通过电源管理模块141为第一电子设备供电。The charging management module 140 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive wireless charging input through a wireless charging coil of the first electronic device 100. While the charging management module 140 is charging the battery 142, it may also power the first electronic device through the power management module 141.
电源管理模块141用于连接电池142,充电管理模块140与处理器110。电源管理模块141接收电池142和/或充电管理模块140的输入,为处理器110,内部存储器121,外部存储器,显示屏194,摄像头193,和无线通信模块160等供电。电源管理模块141还可以用于监测电池容量,电池循环次数,电池健康状态(漏电,阻抗)等参数。在其他一些实施例中,电源管理模块141也可以设置于处理器110中。在另一些实施例中,电源管理模块141和充电管理模块140也可以设置于同一个器件中。The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and/or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.
第一电子设备100的无线通信功能可以通过如天线1,天线2,移动通信模块150,无线通信模块160,调制解调处理器以及基带处理器等实现。上述可以统称为通信模块。The wireless communication function of the first electronic device 100 can be implemented by, for example, antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc. The above can be collectively referred to as communication modules.
天线1和天线2用于发射和接收电磁波信号。第一电子设备100中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用,以提高天线的利用率。例如:可以将天线1复用为无线局域网的分集天线。在另外一些实施例中,天线可以和调谐开关结合使用。Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the first electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.
移动通信模块150可以提供应用在第一电子设备100上的包括2G/3G/4G/5G等无线通信的解决方案。移动通信模块150可以包括至少一个滤波器,开关,功率放大器,低噪声放大器(low noise amplifier,LNA)等。移动通信模块150可以由天线1接收电磁波,并对接收的电磁波进行滤波,放大等处理,传送至调制解调处理器进行解调。移动通信模块150还可以对经调制解调处理器调制后的信号放大,经天线1转为电磁波辐射出去。在一些实施例中,移动通信模块150的至少部分功能模块可以被设置于处理器110中。在一些实施例中,移动通信模块150的至少部分功能模块可以与处理器110的至少部分模块被设置在同一个器件中。The mobile communication module 150 can provide solutions for wireless communications including 2G/3G/4G/5G applied to the first electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.
调制解调处理器可以包括调制器和解调器。其中,调制器用于将待发送的低频基带信号调制成中高频信号。解调器用于将接收的电磁波信号解调为低频基带信号。随后解调器将解调得到的低频基带信号传送至基带处理器处理。低频基带信号经基带处理器处理后,被传递给应用处理器。应用处理器通过音频设备(不限于扬声器170A,受话器170B等)输出声音信号,或通过显示屏194显示图像或视频。在一些实施例中,调制解调处理器可以是独立的器件。在另一些实施例中,调制解调处理器可以独立于处理器110,与移动通信模块150或其他功能模块设置在同一个器件中。The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.
无线通信模块160可以提供应用在第一电子设备100上的包括无线局域网(wireless local area networks,WLAN)(如无线保真(wireless fidelity,Wi-Fi)网络),蓝牙(bluetooth,BT),全球导航卫星系统(global navigation satellite system,GNSS),调频(frequency modulation,FM),近距离无线通信技术(near field communication,NFC),红外技术(infrared,IR)等无线通信的解决方案。无线通信模块160可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块160经由天线2接收电磁波,将电磁波信号调频以及滤波处理,将处理后的信号发送到处理器110。无线通信模块160还可以从处理器110接收待发送的信号,对其进行调频,放大,经天线2转为电磁波辐射出去。The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., applied on the first electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of the signal, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.
在一些实施例中,第一电子设备100的天线1和移动通信模块150耦合,天线2和无线通信模块160耦合,使得第一电子设备100可以通过无线通信技术与网络以及其他设备通信。所述无线通信技术可以包括全球移动通讯系统(global system for mobilecommunications,GSM),通用分组无线服务(general packet radio service,GPRS),码分多址接入(code division multiple access,CDMA),宽带码分多址(wideband codedivision multiple access,WCDMA),时分码分多址(time-division code divisionmultiple access,TD-SCDMA),长期演进(long term evolution,LTE),BT,GNSS,WLAN,NFC,FM,和/或IR技术等。所述GNSS可以包括全球卫星定位系统(global positioning system,GPS),全球导航卫星系统(global navigation satellite system,GLONASS),北斗卫星导航系统(beidou navigation satellite system,BDS),准天顶卫星系统(quasi-zenithsatellite system,QZSS)和/或星基增强系统(satellite based augmentation systems,SBAS)。In some embodiments, the antenna 1 of the first electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the first electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and/or IR technology, etc. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and/or a satellite based augmentation system (SBAS).
第一电子设备100通过GPU,显示屏194,以及应用处理器等实现显示功能。GPU为图像处理的微处理器,连接显示屏194和应用处理器。GPU用于执行数学和几何计算,用于图形渲染。处理器110可包括一个或多个GPU,其执行程序指令以生成或改变显示信息。The first electronic device 100 implements a display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.
显示屏194用于显示图像,视频等。显示屏194包括显示面板。显示面板可以采用液晶显示屏(liquid crystal display,LCD),有机发光二极管(organic light-emittingdiode,OLED),有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrixorganic light emitting diode的,AMOLED),柔性发光二极管(flex light-emittingdiode,FLED),Miniled,MicroLed,Micro-oLed,量子点发光二极管(quantum dot lightemitting diodes,QLED)等。在一些实施例中,第一电子设备100可以包括1个或N个显示屏194,N为大于1的正整数。The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the first electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.
摄像头193用于捕获静态图像或视频。物体通过镜头生成光学图像投射到感光元件。感光元件可以是电荷耦合器件(charge coupled device,CCD)或互补金属氧化物半导体(complementary metal-oxide-semiconductor,CMOS)光电晶体管。感光元件把光信号转换成电信号,之后将电信号传递给ISP转换成数字图像信号。ISP将数字图像信号输出到DSP加工处理。DSP将数字图像信号转换成标准的RGB,YUV等格式的图像信号。在一些实施例中,第一电子设备100可以包括1个或N个摄像头193,N为大于1的正整数。The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the first electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.
数字信号处理器用于处理数字信号,除了可以处理数字图像信号,还可以处理其他数字信号。例如,当第一电子设备100在频点选择时,数字信号处理器用于对频点能量进行傅里叶变换等。The digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the first electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.
视频编解码器用于对数字视频压缩或解压缩。第一电子设备100可以支持一种或多种视频编解码器。这样,第一电子设备100可以播放或录制多种编码格式的视频,例如:动态图像专家组(moving picture experts group,MPEG)1,MPEG2,MPEG3,MPEG4等。The video codec is used to compress or decompress digital video. The first electronic device 100 may support one or more video codecs. In this way, the first electronic device 100 can play or record videos in multiple coding formats, such as moving picture experts group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.
NPU为神经网络(neural-network,NN)计算处理器,通过借鉴生物神经网络结构,例如借鉴人脑神经元之间传递模式,对输入信息快速处理,还可以不断的自学习。通过NPU可以实现第一电子设备100的智能认知等应用,例如:图像识别,人脸识别,语音识别,文本理解等。The NPU is a neural network (NN) computing processor that quickly processes input information by drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, and can also continuously self-learn. The NPU can realize applications such as intelligent cognition of the first electronic device 100, such as image recognition, face recognition, voice recognition, text understanding, etc.
外部存储器接口120可以用于连接外部存储卡,例如Micro SD卡,实现扩展第一电子设备100的存储能力。外部存储卡通过外部存储器接口120与处理器110通信,实现数据存储功能。例如将音乐,视频等文件保存在外部存储卡中。The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the first electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function, such as storing music, video and other files in the external memory card.
内部存储器121可以用于存储计算机可执行程序代码,所述可执行程序代码包括指令。处理器110通过运行存储在内部存储器121的指令,从而执行第一电子设备100的各种功能应用以及数据处理。内部存储器121可以包括存储程序区和存储数据区。其中,存储程序区可存储操作系统,至少一个功能所需的应用程序(比如声音播放功能,图像播放功能等)等。存储数据区可存储第一电子设备100使用过程中所创建的数据(比如音频数据,电话本等)等。此外,内部存储器121可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件,闪存器件,通用闪存存储器(universal flash storage,UFS)等。The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the first electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the first electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.
第一电子设备100可以通过音频模块170,扬声器170A,受话器170B,音频采集装置170C,耳机接口170D,以及应用处理器等实现音频功能。例如音乐播放,录音等。The first electronic device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the audio collection device 170C, the earphone interface 170D, and the application processor.
音频模块170用于将数字音频信息转换成模拟音频信号输出,也用于将模拟音频输入转换为数字音频信号。音频模块170还可以用于对音频信号编码和解码。在一些实施例中,音频模块170可以设置于处理器110中,或将音频模块170的部分功能模块设置于处理器110中。The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110.
扬声器170A,也称“喇叭”,用于将音频电信号转换为声音信号。第一电子设备100可以通过扬声器170A收听音乐,或收听免提通话。The speaker 170A, also called a "speaker", is used to convert an audio electrical signal into a sound signal. The first electronic device 100 can listen to music or listen to a hands-free call through the speaker 170A.
受话器170B,也称“听筒”,用于将音频电信号转换成声音信号。当第一电子设备100接听电话或语音信息时,可以通过将受话器170B靠近人耳接听语音。The receiver 170B, also called a "earpiece", is used to convert audio electrical signals into sound signals. When the first electronic device 100 receives a call or voice message, the voice can be received by placing the receiver 170B close to the ear.
音频采集装置170C,用于将声音信号转换为电信号。当拨打电话或发送语音信息时,用户可以通过人嘴靠近音频采集装置170C发声,将声音信号输入到音频采集装置170C。第一电子设备100可以设置至少一个音频采集装置170C。在另一些实施例中,第一电子设备100可以设置两个音频采集装置170C,除了采集声音信号,还可以实现降噪功能。在另一些实施例中,第一电子设备100还可以设置三个,四个或更多音频采集装置170C,实现采集声音信号,降噪,还可以识别声音来源,实现定向录音功能等。音频采集装置170C可以是麦克风,也称“话筒”,“传声器”。The audio collection device 170C is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can make a sound by approaching the audio collection device 170C with his mouth to input the sound signal into the audio collection device 170C. The first electronic device 100 can be provided with at least one audio collection device 170C. In other embodiments, the first electronic device 100 can be provided with two audio collection devices 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the first electronic device 100 can also be provided with three, four or more audio collection devices 170C to realize the collection of sound signals, noise reduction, identification of sound sources, realization of directional recording function, etc. The audio collection device 170C can be a microphone, also called "microphone" or "microphone".
耳机接口170D用于连接有线耳机。耳机接口170D可以是USB接口130,也可以是3.5mm的开放移动第一电子设备平台(open mobile terminal platform,OMTP)标准接口,美国蜂窝电信工业协会(cellular telecommunications industry association of theUSA,CTIA)标准接口。The earphone interface 170D is used to connect a wired earphone and can be a USB interface 130 or a 3.5 mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.
超声波发射装置170E,用于将电信号转换成超声波信号,在一些实施例中,超声波发射装置170E也可以是扬声器170A。在另一些实施例中,超声波发射装置170E可以包括阵列排列的多个发射阵元每个发射阵元用于发射超声波。在具体实现中,可以通过该多个发射阵元中的部分或全部发射阵元发射超声波。The ultrasonic emitting device 170E is used to convert the electrical signal into an ultrasonic signal. In some embodiments, the ultrasonic emitting device 170E may also be a speaker 170A. In other embodiments, the ultrasonic emitting device 170E may include a plurality of transmitting array elements arranged in an array, each transmitting array element is used to emit ultrasonic waves. In a specific implementation, ultrasonic waves may be emitted by some or all of the plurality of transmitting array elements.
超声波接收装置170F,用于将超声波信号转换成电信号,在一些实施例中,超声波接收装置170F也可以是麦克风。在另一些实施例中,超声波接收装置170F可以包括阵列排列的多个接收阵元,每个接收阵元,用于接收超声波。在具体实现中,可以通过该多个接收阵元中的部分或全部接收阵元接收超声波。The ultrasonic receiving device 170F is used to convert the ultrasonic signal into an electrical signal. In some embodiments, the ultrasonic receiving device 170F may also be a microphone. In other embodiments, the ultrasonic receiving device 170F may include a plurality of receiving array elements arranged in an array, each receiving array element being used to receive ultrasonic waves. In a specific implementation, the ultrasonic wave may be received by some or all of the plurality of receiving array elements.
压力传感器180A用于感受压力信号,可以将压力信号转换成电信号。在一些实施例中,压力传感器180A可以设置于显示屏194。压力传感器180A的种类很多,如电阻式压力传感器,电感式压力传感器,电容式压力传感器等。电容式压力传感器可以是包括至少两个具有导电材料的平行板。当有力作用于压力传感器180A,电极之间的电容改变。第一电子设备100根据电容的变化确定压力的强度。当有触摸操作作用于显示屏194,第一电子设备100根据压力传感器180A检测所述触摸操作强度。第一电子设备100也可以根据压力传感器180A的检测信号计算触摸的位置。在一些实施例中,作用于相同触摸位置,但不同触摸操作强度的触摸操作,可以对应不同的操作指令。例如:当有触摸操作强度小于第一压力阈值的触摸操作作用于短消息应用图标时,执行查看短消息的指令。当有触摸操作强度大于或等于第一压力阈值的触摸操作作用于短消息应用图标时,执行新建短消息的指令。The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be set on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. The capacitive pressure sensor can be a parallel plate including at least two conductive materials. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The first electronic device 100 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the first electronic device 100 detects the touch operation intensity according to the pressure sensor 180A. The first electronic device 100 can also calculate the touch position according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, an instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, an instruction to create a new short message is executed.
陀螺仪传感器180B可以用于确定第一电子设备100的运动姿态。在一些实施例中,可以通过陀螺仪传感器180B确定第一电子设备100围绕三个轴(即,x,y和z轴)的角速度。陀螺仪传感器180B可以用于拍摄防抖。示例性的,当按下快门,陀螺仪传感器180B检测第一电子设备100抖动的角度,根据角度计算出镜头模组需要补偿的距离,让镜头通过反向运动抵消第一电子设备100的抖动,实现防抖。陀螺仪传感器180B还可以用于导航,体感游戏场景。The gyro sensor 180B can be used to determine the motion posture of the first electronic device 100. In some embodiments, the angular velocity of the first electronic device 100 around three axes (i.e., x, y, and z axes) can be determined by the gyro sensor 180B. The gyro sensor 180B can be used for anti-shake shooting. Exemplarily, when the shutter is pressed, the gyro sensor 180B detects the angle of the shake of the first electronic device 100, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shake of the first electronic device 100 through reverse movement to achieve anti-shake. The gyro sensor 180B can also be used for navigation and somatosensory game scenes.
气压传感器180C用于测量气压。在一些实施例中,第一电子设备100通过气压传感器180C测得的气压值计算海拔高度,辅助定位和导航。The air pressure sensor 180C is used to measure air pressure. In some embodiments, the first electronic device 100 calculates the altitude through the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation.
磁传感器180D包括霍尔传感器。第一电子设备100可以利用磁传感器180D检测翻盖皮套的开合。在一些实施例中,当第一电子设备100是翻盖机时,第一电子设备100可以根据磁传感器180D检测翻盖的开合。进而根据检测到的皮套的开合状态或翻盖的开合状态,设置翻盖自动解锁等特性。The magnetic sensor 180D includes a Hall sensor. The first electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip leather case. In some embodiments, when the first electronic device 100 is a flip phone, the first electronic device 100 can detect the opening and closing of the flip cover according to the magnetic sensor 180D. Then, according to the detected opening and closing state of the leather case or the opening and closing state of the flip cover, the flip cover automatic unlocking and other features are set.
加速度传感器180E可检测第一电子设备100在各个方向上(一般为三轴)加速度的大小。当第一电子设备100静止时可检测出重力的大小及方向。还可以用于识别第一电子设备姿态,应用于横竖屏切换,计步器等应用。The acceleration sensor 180E can detect the magnitude of the acceleration of the first electronic device 100 in various directions (generally three axes). When the first electronic device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the first electronic device, and is applied to applications such as horizontal and vertical screen switching, pedometers, etc.
距离传感器180F,用于测量距离。第一电子设备100可以通过红外或激光测量距离。在一些实施例中,睡姿识别场景,第一电子设备100可以利用距离传感器180F测量第一电子设备和用户人体之间的距离。The distance sensor 180F is used to measure the distance. The first electronic device 100 can measure the distance by infrared or laser. In some embodiments, in the sleeping posture recognition scenario, the first electronic device 100 can use the distance sensor 180F to measure the distance between the first electronic device and the user's body.
接近光传感器180G可以包括例如发光二极管(LED)和光检测器,例如光电二极管。发光二极管可以是红外发光二极管。第一电子设备100通过发光二极管向外发射红外光。第一电子设备100使用光电二极管检测来自附近物体的红外反射光。当检测到充分的反射光时,可以确定第一电子设备100附近有物体。当检测到不充分的反射光时,第一电子设备100可以确定第一电子设备100附近没有物体。第一电子设备100可以利用接近光传感器180G检测用户手持第一电子设备100贴近耳朵通话,以便自动熄灭屏幕达到省电的目的。接近光传感器180G也可用于皮套模式,口袋模式自动解锁与锁屏。The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The first electronic device 100 emits infrared light outward through the light emitting diode. The first electronic device 100 uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the first electronic device 100. When insufficient reflected light is detected, the first electronic device 100 can determine that there is no object near the first electronic device 100. The first electronic device 100 can use the proximity light sensor 180G to detect that the user holds the first electronic device 100 close to the ear to talk, so as to automatically turn off the screen to save power. The proximity light sensor 180G can also be used in leather case mode and pocket mode to automatically unlock and lock the screen.
环境光传感器180L用于感知环境光亮度。第一电子设备100可以根据感知的环境光亮度自适应调节显示屏194亮度。环境光传感器180L也可用于拍照时自动调节白平衡。环境光传感器180L还可以与接近光传感器180G配合,检测第一电子设备100是否在口袋里,以防误触。The ambient light sensor 180L is used to sense the brightness of the ambient light. The first electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the first electronic device 100 is in a pocket to prevent accidental touch.
指纹传感器180H用于采集指纹。第一电子设备100可以利用采集的指纹特性实现指纹解锁,访问应用锁,指纹拍照,指纹接听来电等。The fingerprint sensor 180H is used to collect fingerprints. The first electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc.
温度传感器180J用于检测温度。在一些实施例中,第一电子设备100利用温度传感器180J检测的温度,执行温度处理策略。例如,当温度传感器180J上报的温度超过阈值,第一电子设备100执行降低位于温度传感器180J附近的处理器的性能,以便降低功耗实施热保护。在另一些实施例中,当温度低于另一阈值时,第一电子设备100对电池142加热,以避免低温导致第一电子设备100异常关机。在其他一些实施例中,当温度低于又一阈值时,第一电子设备100对电池142的输出电压执行升压,以避免低温导致的异常关机。The temperature sensor 180J is used to detect temperature. In some embodiments, the first electronic device 100 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the first electronic device 100 reduces the performance of a processor located near the temperature sensor 180J to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the first electronic device 100 heats the battery 142 to avoid abnormal shutdown of the first electronic device 100 due to low temperature. In other embodiments, when the temperature is lower than another threshold, the first electronic device 100 boosts the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperature.
触摸传感器180K,也称“触控面板”。触摸传感器180K可以设置于显示屏194,由触摸传感器180K与显示屏194组成触摸屏,也称“触控屏”。触摸传感器180K用于检测作用于其上或附近的触摸操作。触摸传感器可以将检测到的触摸操作传递给应用处理器,以确定触摸事件类型。可以通过显示屏194提供与触摸操作相关的视觉输出。在另一些实施例中,触摸传感器180K也可以设置于第一电子设备100的表面,与显示屏194所处的位置不同。The touch sensor 180K is also called a "touch panel". The touch sensor 180K can be arranged on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be arranged on the surface of the first electronic device 100, which is different from the position of the display screen 194.
骨传导传感器180M可以获取振动信号。在一些实施例中,骨传导传感器180M可以获取人体声部振动骨块的振动信号。骨传导传感器180M也可以接触人体脉搏,接收血压跳动信号。在一些实施例中,骨传导传感器180M也可以设置于耳机中,结合成骨传导耳机。音频模块170可以基于所述骨传导传感器180M获取的声部振动骨块的振动信号,解析出语音信号,实现语音功能。应用处理器可以基于所述骨传导传感器180M获取的血压跳动信号解析心率信息,实现心率检测功能。The bone conduction sensor 180M can obtain a vibration signal. In some embodiments, the bone conduction sensor 180M can obtain a vibration signal of a vibrating bone block of the vocal part of the human body. The bone conduction sensor 180M can also contact the human pulse to receive a blood pressure beat signal. In some embodiments, the bone conduction sensor 180M can also be set in an earphone and combined into a bone conduction earphone. The audio module 170 can parse out a voice signal based on the vibration signal of the vibrating bone block of the vocal part obtained by the bone conduction sensor 180M to realize a voice function. The application processor can parse the heart rate information based on the blood pressure beat signal obtained by the bone conduction sensor 180M to realize a heart rate detection function.
按键190包括开机键,音量键等。按键190可以是机械按键。也可以是触摸式按键。第一电子设备100可以接收按键输入,产生与第一电子设备100的用户设置以及功能控制有关的键信号输入。The key 190 includes a power key, a volume key, etc. The key 190 may be a mechanical key or a touch key. The first electronic device 100 may receive key input and generate key signal input related to user settings and function control of the first electronic device 100.
马达191可以产生振动提示。马达191可以用于来电振动提示,也可以用于触摸振动反馈。例如,作用于不同应用(例如拍照,音频播放等)的触摸操作,可以对应不同的振动反馈效果。作用于显示屏194不同区域的触摸操作,马达191也可对应不同的振动反馈效果。不同的应用场景(例如:时间提醒,接收信息,闹钟,游戏等)也可以对应不同的振动反馈效果。触摸振动反馈效果还可以支持自定义。在本申请的一些实施例中,在第一电子设备检测到用户睡眠时呼吸暂停并且睡姿为仰卧时,马达191可以震动提醒用户翻身。Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 194, motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization. In some embodiments of the present application, when the first electronic device detects that the user has apnea during sleep and the sleeping position is supine, the motor 191 can vibrate to remind the user to turn over.
指示器192可以是指示灯,可以用于指示充电状态,电量变化,也可以用于指示消息,未接来电,通知等。Indicator 192 may be an indicator light, which may be used to indicate charging status, power changes, messages, missed calls, notifications, etc.
SIM卡接口195用于连接SIM卡。SIM卡可以通过插入SIM卡接口195,或从SIM卡接口195拔出,实现和第一电子设备100的接触和分离。第一电子设备100可以支持1个或N个SIM卡接口,N为大于1的正整数。SIM卡接口195可以支持Nano SIM卡,Micro SIM卡,SIM卡等。同一个SIM卡接口195可以同时插入多张卡。所述多张卡的类型可以相同,也可以不同。SIM卡接口195也可以兼容不同类型的SIM卡。SIM卡接口195也可以兼容外部存储卡。第一电子设备100通过SIM卡和网络交互,实现通话以及数据通信等功能。在一些实施例中,第一电子设备100采用eSIM,即:嵌入式SIM卡。eSIM卡可以嵌在第一电子设备100中,不能和第一电子设备100分离。The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to and separated from the first electronic device 100 by inserting it into the SIM card interface 195 or pulling it out from the SIM card interface 195. The first electronic device 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, and the like. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external memory cards. The first electronic device 100 interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the first electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the first electronic device 100 and cannot be separated from the first electronic device 100.
下面介绍本申请实施例提供的示例性第二电子设备200。该第二电子设备200可以是智能手表、智能手环、智能眼镜等可穿戴设备。The following describes an exemplary second electronic device 200 provided in an embodiment of the present application. The second electronic device 200 may be a wearable device such as a smart watch, a smart bracelet, or smart glasses.
请参阅图2B,第二电子设备200可以包括处理器210,外部存储器接口220,内部存储器221,通用串行总线(universal serial bus,USB)接口230,充电管理模块240,电源管理模块241,电池242,显示屏250无线通信模块260,音频模块270,传感器模块280,按键290,马达291,指示器292等。Referring to Figure 2B, the second electronic device 200 may include a processor 210, an external memory interface 220, an internal memory 221, a universal serial bus (USB) interface 230, a charging management module 240, a power management module 241, a battery 242, a display screen 250, a wireless communication module 260, an audio module 270, a sensor module 280, a button 290, a motor 291, an indicator 292, etc.
可以理解的是,本发明实施例示意的结构并不构成对第二电子设备200的具体限定。在本申请另一些实施例中,第二电子设备200可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the second electronic device 200. In other embodiments of the present application, the second electronic device 200 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.
处理器210可以包括一个或多个处理单元,例如:处理器210可以包括应用处理器(application processor,AP),调制解调处理器,图形处理器(graphics processingunit,GPU),图像信号处理器(image signal processor,ISP),控制器,存储器,视频编解码器,数字信号处理器(digital signal processor,DSP),基带处理器,和/或神经网络处理器(neural-network processing unit,NPU)等。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。The processor 210 may include one or more processing units, for example, the processor 210 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and/or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.
外部存储器接口220可以用于连接外部存储卡,例如Micro SD卡,实现扩展第二电子设备200的存储能力。外部存储卡通过外部存储器接口220与处理器210通信,实现数据存储功能。例如将音乐,视频等文件保存在外部存储卡中。The external memory interface 220 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the second electronic device 200. The external memory card communicates with the processor 210 through the external memory interface 220 to implement a data storage function. For example, files such as music and videos are stored in the external memory card.
内部存储器221可以用于存储计算机可执行程序代码,所述可执行程序代码包括指令。处理器210通过运行存储在内部存储器221的指令,从而执行第二电子设备200的各种功能应用以及数据处理。内部存储器221可以包括存储程序区和存储数据区。其中,存储程序区可存储操作系统,至少一个功能所需的应用程序(比如声音播放功能,图像播放功能等)等。存储数据区可存储第二电子设备200使用过程中所创建的数据(比如音频数据,电话本等)等。此外,内部存储器221可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件,闪存器件,通用闪存存储器(universal flash storage,UFS)等。The internal memory 221 can be used to store computer executable program codes, which include instructions. The processor 210 executes various functional applications and data processing of the second electronic device 200 by running the instructions stored in the internal memory 221. The internal memory 221 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the second electronic device 200 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 221 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.
USB接口230是符合USB标准规范的接口,具体可以是Mini USB接口,Micro USB接口,USB Type C接口等。USB接口230可以用于连接充电器为第二电子设备200充电,也可以用于第二电子设备200与外围设备之间传输数据。也可以用于连接耳机,通过耳机播放音频。该接口还可以用于连接其他电子设备,例如AR设备等。The USB interface 230 is an interface that complies with the USB standard specification, and can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 230 can be used to connect a charger to charge the second electronic device 200, and can also be used to transmit data between the second electronic device 200 and a peripheral device. It can also be used to connect headphones to play audio through the headphones. The interface can also be used to connect other electronic devices, such as AR devices, etc.
充电管理模块240用于从充电器接收充电输入。其中,充电器可以是无线充电器,也可以是有线充电器。在一些有线充电的实施例中,充电管理模块240可以通过USB接口230接收有线充电器的充电输入。在一些无线充电的实施例中,充电管理模块240可以通过第二电子设备200的无线充电线圈接收无线充电输入。充电管理模块240为电池242充电的同时,还可以通过电源管理模块241为第一电子设备供电。The charging management module 240 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 240 may receive charging input from a wired charger through the USB interface 230. In some wireless charging embodiments, the charging management module 240 may receive wireless charging input through a wireless charging coil of the second electronic device 200. While the charging management module 240 is charging the battery 242, it may also power the first electronic device through the power management module 241.
电源管理模块241用于连接电池242,充电管理模块240与处理器210。电源管理模块241接收电池242和/或充电管理模块240的输入,为处理器210,内部存储器221,外部存储器220,显示屏194,摄像头193,和无线通信模块160等供电。电源管理模块241还可以用于监测电池容量,电池循环次数,电池健康状态(漏电,阻抗)等参数。在其他一些实施例中,电源管理模块241也可以设置于处理器210中。在另一些实施例中,电源管理模块241和充电管理模块240也可以设置于同一个器件中。The power management module 241 is used to connect the battery 242, the charging management module 240 and the processor 210. The power management module 241 receives input from the battery 242 and/or the charging management module 240, and supplies power to the processor 210, the internal memory 221, the external memory 220, the display screen 194, the camera 193, and the wireless communication module 160. The power management module 241 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 241 can also be set in the processor 210. In other embodiments, the power management module 241 and the charging management module 240 can also be set in the same device.
显示屏250用于显示图像,视频等。显示屏250包括显示面板。显示面板可以采用液晶显示屏(liquid crystal display,LCD),有机发光二极管(organic light-emittingdiode,OLED),有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrixorganic light emitting diode的,AMOLED),柔性发光二极管(flex light-emittingdiode,FLED),Miniled,MicroLed,Micro-oLed,量子点发光二极管(quantum dot lightemitting diodes,QLED)等。在一些实施例中,第二电子设备200可以包括1个或N个显示屏250,N为大于1的正整数。The display screen 250 is used to display images, videos, etc. The display screen 250 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the second electronic device 200 may include 1 or N display screens 250, where N is a positive integer greater than 1.
无线通信模块260用于接收和发送无线信号,主要集成了第二电子设备的通信模块,可以提供应用在第二电子设备200上的包括无线局域网(wireless local areanetworks,WLAN)(如无线保真(wireless fidelity,Wi-Fi)网络),蓝牙(bluetooth,BT),全球导航卫星系统(global navigation satellite system,GNSS),调频(frequencymodulation,FM),近距离无线通信技术(near field communication,NFC),红外技术(infrared,IR)等无线通信的解决方案。无线通信模块260可以是集成至少一个通信处理模块的一个或多个器件。The wireless communication module 260 is used to receive and send wireless signals, and mainly integrates the communication module of the second electronic device, and can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) network), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication technology (NFC), infrared technology (IR), etc., which are applied to the second electronic device 200. The wireless communication module 260 can be one or more devices integrating at least one communication processing module.
第二电子设备200可以通过音频模块270以及应用处理器等实现音频功能。例如音乐播放,录音等。The second electronic device 200 can implement audio functions such as music playing and recording through the audio module 270 and the application processor.
压力传感器280A用于感受压力信号,可以将压力信号转换成电信号。在一些实施例中,压力传感器280A可以设置于显示屏250。压力传感器280A的种类很多,如电阻式压力传感器,电感式压力传感器,电容式压力传感器等。电容式压力传感器可以是包括至少两个具有导电材料的平行板。当有力作用于压力传感器280A,电极之间的电容改变。第二电子设备200根据电容的变化确定压力的强度。当有触摸操作作用于显示屏250,第二电子设备200根据压力传感器280A检测所述触摸操作强度。第二电子设备200也可以根据压力传感器280A的检测信号计算触摸的位置。The pressure sensor 280A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 280A can be arranged on the display screen 250. There are many types of pressure sensors 280A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. A capacitive pressure sensor can be a parallel plate including at least two conductive materials. When a force acts on the pressure sensor 280A, the capacitance between the electrodes changes. The second electronic device 200 determines the intensity of the pressure based on the change in capacitance. When a touch operation acts on the display screen 250, the second electronic device 200 detects the intensity of the touch operation based on the pressure sensor 280A. The second electronic device 200 can also calculate the position of the touch based on the detection signal of the pressure sensor 280A.
陀螺仪传感器280B可以用于确定第二电子设备200的运动姿态。在一些实施例中,可以通过陀螺仪传感器280B确定第二电子设备200围绕三个轴(即,x,y和z轴)的角速度。The gyro sensor 280B may be used to determine the motion posture of the second electronic device 200. In some embodiments, the angular velocity of the second electronic device 200 around three axes (ie, x, y, and z axes) may be determined by the gyro sensor 280B.
加速度传感器280C可检测第二电子设备200在各个方向上(一般为三轴)加速度的大小。当第二电子设备200静止时可检测出重力的大小及方向。还可以用于识别第一电子设备姿态,应用于横竖屏切换,计步器等应用。The acceleration sensor 280C can detect the magnitude of the acceleration of the second electronic device 200 in various directions (generally three axes). When the second electronic device 200 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the first electronic device, and is applied to applications such as horizontal and vertical screen switching, pedometers, etc.
距离传感器280D,用于测量距离。第二电子设备200可以通过红外或激光测量距离。在一些实施例中,睡姿识别场景,第二电子设备200可以利用距离传感器180F测量第一电子设备和用户人体之间的距离。The distance sensor 280D is used to measure the distance. The second electronic device 200 can measure the distance by infrared or laser. In some embodiments, in the sleeping posture recognition scenario, the second electronic device 200 can use the distance sensor 180F to measure the distance between the first electronic device and the user's body.
指纹传感器280E用于采集指纹。第二电子设备200可以利用采集的指纹特性实现指纹解锁,访问应用锁,指纹拍照,指纹接听来电等。The fingerprint sensor 280E is used to collect fingerprints. The second electronic device 200 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc.
触摸传感器280F,也称“触控面板”。触摸传感器280F可以设置于显示屏250,由触摸传感器280F与显示屏250组成触摸屏,也称“触控屏”。触摸传感器280F用于检测作用于其上或附近的触摸操作。触摸传感器可以将检测到的触摸操作传递给应用处理器,以确定触摸事件类型。可以通过显示屏250提供与触摸操作相关的视觉输出。在另一些实施例中,触摸传感器280F也可以设置于第二电子设备200的表面,与显示屏250所处的位置不同。The touch sensor 280F is also called a "touch panel". The touch sensor 280F can be arranged on the display screen 250, and the touch sensor 280F and the display screen 250 form a touch screen, also called a "touch screen". The touch sensor 280F is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 250. In other embodiments, the touch sensor 280F can also be arranged on the surface of the second electronic device 200, which is different from the position of the display screen 250.
心率传感器280G用于检测用户的心率。在一些实施例中,心率传感器可以采用光体积扫描法的原理来测量心率和心率相关参数。其测量原理为:人体的皮肤、骨骼、肉、脂肪等组织对光的反射是固定的;而毛细血管、动脉、静脉等由于随着心脏的跳动脉搏容积规律的变化,因此对光的反射是波动值,这个波动的频率即为心率。可选地,该心率传感器可以包括可发射发光源和光电探测器,心率传感器通过光电探测器检测发光源发射的光的反射量得到PPG信号,通过该PPG信号来检测心率相关参数。应理解,检测心率和心率相关参数采用的光可以是红光、红外光、绿光等。The heart rate sensor 280G is used to detect the user's heart rate. In some embodiments, the heart rate sensor can use the principle of photoplethysmography to measure heart rate and heart rate-related parameters. The measurement principle is: the reflection of light by human skin, bones, meat, fat and other tissues is fixed; while the capillaries, arteries, veins, etc. change with the pulse volume law of the heartbeat, so the reflection of light is a fluctuating value, and the frequency of this fluctuation is the heart rate. Optionally, the heart rate sensor may include a light source that can emit light and a photodetector. The heart rate sensor detects the reflected amount of light emitted by the light source through the photodetector to obtain a PPG signal, and detects heart rate-related parameters through the PPG signal. It should be understood that the light used to detect heart rate and heart rate-related parameters can be red light, infrared light, green light, etc.
在一些实施例中,心率传感器280G可以用于检测心电图(electro-cardiogram,ECG)信号,通过分析ECG信号可以得到心率和心率相关参数等。此时,心率传感器可以包括一组电极和与该至少2个电极耦合的ECG电路,一组电极可以包括至少2个电极。其中,至少2个电极分别用于接触用户不同位置的皮肤,例如,一组电极包括三个电极,以用户左手佩戴可穿戴设备为例,电极1可以接触用户的右手手指,电极2和电极3可以分别接触用户的左手手腕。ECG电路用于将一组电极采集到的电信号转换为ECG信号。In some embodiments, the heart rate sensor 280G can be used to detect electrocardiogram (ECG) signals, and the heart rate and heart rate-related parameters can be obtained by analyzing the ECG signals. At this time, the heart rate sensor may include a group of electrodes and an ECG circuit coupled to the at least two electrodes, and a group of electrodes may include at least two electrodes. Among them, at least two electrodes are used to contact the skin of the user at different positions, for example, a group of electrodes includes three electrodes. Taking the user wearing the wearable device on the left hand as an example, electrode 1 can contact the user's right hand fingers, and electrode 2 and electrode 3 can contact the user's left wrist respectively. The ECG circuit is used to convert the electrical signals collected by a group of electrodes into ECG signals.
血氧传感器280H可以包括至少一个发光源和至少一个光电探测器(photoelectric detector,PD),用于计算血氧饱和度。其中,该至少一个发光源可以发射红光和红外光,发射的红光和红外光经人体组织反射,至少一个光电探测器可以接收该反射的光并将其分别转变为光电容积脉搏波(photoplethysmography,PPG)信号,其中,接收红光转变为红光PPG信号,接收的红外光转变为红外PPG信号。红光PPG信号及红外PPG信号用于计算血氧饱和度。例如,血氧传感器包括2个LED和2个PD,其中,一个LED可以发射红光,一个LED可以发射近红外光,一个PD用于检测红光,一个PD用于检测近红外光。The blood oxygen sensor 280H may include at least one light source and at least one photoelectric detector (PD) for calculating blood oxygen saturation. The at least one light source may emit red light and infrared light, and the emitted red light and infrared light are reflected by human tissue, and at least one photodetector may receive the reflected light and convert it into a photoplethysmography (PPG) signal, respectively, wherein the received red light is converted into a red light PPG signal, and the received infrared light is converted into an infrared PPG signal. The red light PPG signal and the infrared PPG signal are used to calculate blood oxygen saturation. For example, the blood oxygen sensor includes 2 LEDs and 2 PDs, wherein one LED may emit red light, one LED may emit near-infrared light, one PD may be used to detect red light, and one PD may be used to detect near-infrared light.
按键290包括开机键,音量键等。按键290可以是机械按键。也可以是触摸式按键。第二电子设备200可以接收按键输入,产生与第二电子设备200的用户设置以及功能控制有关的键信号输入。The key 290 includes a power key, a volume key, etc. The key 290 may be a mechanical key or a touch key. The second electronic device 200 may receive key input and generate key signal input related to user settings and function control of the second electronic device 200.
马达291可以产生振动提示。马达291可以用于来电振动提示,也可以用于触摸振动反馈。例如,作用于不同应用的触摸操作,可以对应不同的振动反馈效果。作用于显示屏250不同区域的触摸操作,马达291也可对应不同的振动反馈效果。不同的应用场景(例如:时间提醒,接收信息,闹钟,游戏等)也可以对应不同的振动反馈效果。触摸振动反馈效果还可以支持自定义。在本申请的一些实施例中,在第一电子设备检测到用户睡眠时呼吸暂停并且睡姿为仰卧时,马达291可以震动提醒用户翻身。Motor 291 can generate vibration prompts. Motor 291 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 250, motor 291 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization. In some embodiments of the present application, when the first electronic device detects that the user has apnea during sleep and the sleeping position is supine, the motor 291 can vibrate to remind the user to turn over.
指示器292可以是指示灯,可以用于指示充电状态,电量变化,也可以用于指示消息,未接来电,通知等。Indicator 292 may be an indicator light, which may be used to indicate charging status, power changes, messages, missed calls, notifications, etc.
(一)请参阅图3,图3为本实施例提供的一种监测睡眠的方法的流程示意图。该方法可以由上述图1或图2A所示的第一电子设备执行,或由上述图1所示的系统来实现。应理解,如图3所示,该方法可以包括但不限于如下步骤:(I) Please refer to FIG. 3, which is a flowchart of a method for monitoring sleep provided in this embodiment. The method can be performed by the first electronic device shown in FIG. 1 or FIG. 2A, or implemented by the system shown in FIG. 1. It should be understood that, as shown in FIG. 3, the method may include but is not limited to the following steps:
S02、第一电子设备监测用户是否处于睡眠状态。S02: The first electronic device monitors whether the user is in a sleeping state.
在一种实现中,如图2A所示,第一电子设备100包括音频采集装置,该音频采集装置可以是麦克风。第一电子设备通过音频采集装置获取环境的第二声音。第二声音中包括用户的呼吸声,第一电子设备根据该呼吸声的提取用户的呼吸率,在呼吸率小于第二阈值时,确定该用户处于睡眠状态,进一步地,可以执行步骤S04。反之,在呼吸率不小于第二阈值时,第一电子设备确定该用户未处于睡眠状态,可返回执行S02。其中,第二阈值可以为该用户在睡眠时的呼吸率的平均值。In one implementation, as shown in FIG2A , the first electronic device 100 includes an audio acquisition device, which may be a microphone. The first electronic device acquires a second sound of the environment through the audio acquisition device. The second sound includes the breathing sound of the user, and the first electronic device extracts the breathing rate of the user based on the breathing sound. When the breathing rate is less than a second threshold, it determines that the user is in a sleeping state, and further, step S04 may be executed. On the contrary, when the breathing rate is not less than the second threshold, the first electronic device determines that the user is not in a sleeping state, and may return to execute S02. Among them, the second threshold may be the average value of the breathing rate of the user when sleeping.
在另一种实现中,第一电子设备可以接收第二电子设备发送的用于指示是否为睡眠状态的指示信息;进而,基于该指示信息识别用户的是否处于睡眠状态。In another implementation, the first electronic device may receive indication information sent by the second electronic device to indicate whether the user is in a sleep state; and then, based on the indication information, identify whether the user is in a sleep state.
在又一种实现中,第一电子设备可以接收第二电子设备实时发送的生理信息,进而基于该生理信息来检测用户是否处于睡眠状态。该生理信息可以包括PPG信号、心率等。In another implementation, the first electronic device may receive physiological information sent in real time by the second electronic device, and then detect whether the user is in a sleeping state based on the physiological information. The physiological information may include a PPG signal, a heart rate, and the like.
S04、第一电子设备检测用户是否发生睡眠呼吸暂停。S04. The first electronic device detects whether the user has sleep apnea.
在一种实现中,第一电子设备在检测到用户处于睡眠状态时,通过音频采集装置持续获取环境的第一声音。在第一声音不包括呼吸声时,或第一声音包括的呼吸声的呼吸率小于第一阈值时,第一电子设备确定用户发生睡眠呼吸暂停,进一步地,可以执行步骤S06。其中,第一阈值小于上述第二阈值。反之,在第一声音中包括呼吸声,且呼吸率不小于第一阈值,第一电子设备确定用户未发生睡眠呼吸暂停,进一步地,可返回执行步骤S02。在一些实施例中,第一电子设备确定用户未发生睡眠呼吸暂停时,还可以返回执行S04。In one implementation, when the first electronic device detects that the user is in a sleeping state, the first electronic device continuously acquires the first sound of the environment through the audio acquisition device. When the first sound does not include breathing sounds, or when the breathing rate of the breathing sounds included in the first sound is less than the first threshold, the first electronic device determines that the user has sleep apnea, and further, step S06 can be executed. Among them, the first threshold is less than the above-mentioned second threshold. Conversely, the first sound includes breathing sounds, and the breathing rate is not less than the first threshold, the first electronic device determines that the user does not have sleep apnea, and further, it can return to execute step S02. In some embodiments, when the first electronic device determines that the user does not have sleep apnea, it can also return to execute S04.
在另一种实现中,第一电子设备可以接收第二电子设备发送的用于指示是否发生睡眠呼吸暂停的指示信息;进而,基于该指示信息识别用户的是否发生睡眠呼吸暂停。In another implementation, the first electronic device may receive indication information sent by the second electronic device to indicate whether sleep apnea occurs; and then, identify whether sleep apnea occurs in the user based on the indication information.
在又一种实现中,第一电子设备可以接收第二电子设备实时发送的生理信息和运动参数,进而基于该生理信息和运动参数中的一种或多种来检测用户是否发生睡眠呼吸暂停。该生理信息可以包括PPG信号、血氧饱和度等。In another implementation, the first electronic device may receive physiological information and motion parameters sent in real time by the second electronic device, and then detect whether the user has sleep apnea based on one or more of the physiological information and motion parameters. The physiological information may include PPG signals, blood oxygen saturation, etc.
应理解,第一电子设备还可以结合上述生理信息、运动参数、第一声音等联合检测用户是否发生睡眠呼吸暂停。It should be understood that the first electronic device may also combine the above-mentioned physiological information, motion parameters, the first sound, etc. to jointly detect whether the user has sleep apnea.
S06、第一电子设备通过超声波发生装置向用户发射第一超声波。S06. The first electronic device transmits a first ultrasonic wave to the user through an ultrasonic wave generating device.
第一电子设备包括超声波发射装置和超声波接收装置,该超声波发射装置包括阵列排列的多个发射阵元,发射阵元的排列方式可影响发射的超声波的波束宽度。在本申请实施例中,超声波发射装置将第一超声波发射至用户的上半身,通过分析用户的上半身反射的第一超声波确定用户的睡姿,因此,需要在第一电子设备与用户的距离下,确定第一超声波的波束宽度,使得第一超声波能够覆盖用户的上半身。第一超声波的波束宽度可以由发射阵元的排列、第一电子设备与用户的距离、用户上半身的长度决定。The first electronic device includes an ultrasonic transmitting device and an ultrasonic receiving device. The ultrasonic transmitting device includes a plurality of transmitting array elements arranged in an array. The arrangement of the transmitting array elements can affect the beam width of the transmitted ultrasonic wave. In an embodiment of the present application, the ultrasonic transmitting device transmits a first ultrasonic wave to the upper body of the user, and determines the sleeping position of the user by analyzing the first ultrasonic wave reflected by the upper body of the user. Therefore, it is necessary to determine the beam width of the first ultrasonic wave at a distance between the first electronic device and the user so that the first ultrasonic wave can cover the upper body of the user. The beam width of the first ultrasonic wave can be determined by the arrangement of the transmitting array elements, the distance between the first electronic device and the user, and the length of the upper body of the user.
其中,超声波发射装置可以是如图2A中所示的扬声器170A,超声波接收装置可以是如图2A中所示的音频采集装置170C,音频采集装置170C可以是麦克风。The ultrasonic wave transmitting device may be a speaker 170A as shown in FIG. 2A , and the ultrasonic wave receiving device may be an audio collecting device 170C as shown in FIG. 2A , and the audio collecting device 170C may be a microphone.
在具体实施方式中,S06可以但不限于以下步骤:In a specific implementation, S06 may include but is not limited to the following steps:
S061、第一电子设备获取该第一电子设备与用户的距离。S061: The first electronic device obtains the distance between the first electronic device and the user.
在一种实施方式中,第一电子设备与用户的距离测量方法可以通过超声波测距实现。具体的,S061可以包括但不限于以下步骤:In one implementation, the distance measurement method between the first electronic device and the user may be implemented by ultrasonic distance measurement. Specifically, S061 may include but is not limited to the following steps:
A、第一电子设备通过上述超声波发射装置向用户发射第三超声波。A. The first electronic device transmits a third ultrasonic wave to the user through the ultrasonic wave transmitting device.
B、第一电子设备通过超声波接收装置接收第四超声波,第四超声波为反射的第三超声波。B. The first electronic device receives a fourth ultrasonic wave through an ultrasonic receiving device, where the fourth ultrasonic wave is the reflected third ultrasonic wave.
C、根据第三超声波与第四超声波之间的时差与第三超声波的传播速度,确定第一电子设备与用户的距离。C. Determine the distance between the first electronic device and the user according to the time difference between the third ultrasonic wave and the fourth ultrasonic wave and the propagation speed of the third ultrasonic wave.
可以理解的,在本申请实施例中,将第一电子设备置于与用户仰卧时的相同高度的物体上,第一电子设备通过超声波发射装置发射的第三超声波沿直线传播,第三超声波可能到达用户的身体上的不同位置,在不同位置测得的距离在一定的数值范围内,在该数值范围内确定的第一超声波的波束宽度相同。It can be understood that in the embodiment of the present application, the first electronic device is placed on an object at the same height as the user when he is lying on his back, and the third ultrasonic wave emitted by the first electronic device through the ultrasonic transmitting device propagates in a straight line. The third ultrasonic wave may reach different positions on the user's body. The distances measured at different positions are within a certain numerical range, and the beam width of the first ultrasonic wave determined within the numerical range is the same.
在另一些实施方式中,第一电子设备与用户的距离还可以通过如图2A中的距离传感器180F进行测量。In other implementations, the distance between the first electronic device and the user may also be measured by a distance sensor 180F as shown in FIG. 2A .
S062、第一电子设备根据用户的身高计算用户的上半身的长度。S062. The first electronic device calculates the length of the user's upper body according to the user's height.
S063、第一电子设备根据S061获取的距离、用户上半身的长度和所述发射阵的位置确定波束宽度。S063. The first electronic device determines the beam width according to the distance obtained in S061, the length of the user's upper body and the position of the transmitting array.
S064、在该距离下,通过超声波发射装置以该波束宽度向用户发射第一超声波,以使第一超声波覆盖用户的上半身。S064. At the distance, the first ultrasonic wave is emitted to the user with the beam width by the ultrasonic wave emitting device, so that the first ultrasonic wave covers the upper body of the user.
应理解,确定波束宽度的过程,即为确定超声波发射装置中用于发射第一超声波的发射阵元以及确定第一超声波辐射角度的过程。It should be understood that the process of determining the beam width is the process of determining the transmitting array element used to transmit the first ultrasonic wave in the ultrasonic wave transmitting device and determining the radiation angle of the first ultrasonic wave.
S08、第一电子设备通过超声波接收装置接收第二超声波。S08. The first electronic device receives the second ultrasonic wave through the ultrasonic wave receiving device.
第一电子设备通过超声波接收装置接收第二超声波,第二超声波为反射的第一超声波,第二超声波包括用户反射的第一超声波。用户反射的第一超声波即为用户的上半身反射的第一超声波。The first electronic device receives a second ultrasonic wave through an ultrasonic receiving device, the second ultrasonic wave being the reflected first ultrasonic wave, and the second ultrasonic wave including the first ultrasonic wave reflected by the user, which is the first ultrasonic wave reflected by the upper body of the user.
S10、从第二超声波的功率信息中滤除除用户之外的障碍物反射的第一超声波的功率信息,得到用户反射的第一超声波的功率信息。S10 , filtering out the power information of the first ultrasonic wave reflected by obstacles other than the user from the power information of the second ultrasonic wave, and obtaining the power information of the first ultrasonic wave reflected by the user.
在第一电子设备接收到第二超声波后,可以基于发射的第一超声波和接收的第二超声波之间的时延,确定障碍物与第一电子设备的距离。进一步地,第一电子设备可以根据用户与第一电子设备的距离范围,从第二超声波的功率信息中滤除除用户之外的障碍物反射的第一超声波的功率信息,得到用户反射的第一超声波的功率信息。After the first electronic device receives the second ultrasonic wave, the distance between the obstacle and the first electronic device can be determined based on the time delay between the transmitted first ultrasonic wave and the received second ultrasonic wave. Furthermore, the first electronic device can filter out the power information of the first ultrasonic wave reflected by obstacles other than the user from the power information of the second ultrasonic wave according to the distance range between the user and the first electronic device, and obtain the power information of the first ultrasonic wave reflected by the user.
应理解,功率信息即为功率谱。It should be understood that the power information is the power spectrum.
S12、第一电子设备根据用户反射的第一超声波的总功率检测用户的睡姿是否为仰卧。S12. The first electronic device detects whether the user's sleeping position is supine based on the total power of the first ultrasonic wave reflected by the user.
第一电子设备通过得到用户反射的第一超声波的功率信息计算该用户反射的第一超声波的总功率。该总功率为用户的上半身所有的点反射的第一超声波的功率之和。The first electronic device calculates the total power of the first ultrasonic wave reflected by the user by obtaining the power information of the first ultrasonic wave reflected by the user. The total power is the sum of the powers of the first ultrasonic wave reflected by all points of the upper body of the user.
在用户反射的第一超声波的总功率小于目标阈值时,第一电子设备确定用户的睡姿为仰卧,第一电子设备执行下述步骤S14。在用户反射的所述第一超声波的总功率不小于目标阈值时,确定用户的睡姿不为仰卧,第一电子设备可返回执行上述步骤S02检测用户是否处于睡眠状态。在一些实施例中,第一电子设备确定用户的睡姿不为仰卧时,可返回执行上述步骤S04。When the total power of the first ultrasonic wave reflected by the user is less than the target threshold, the first electronic device determines that the user's sleeping posture is supine, and the first electronic device executes the following step S14. When the total power of the first ultrasonic wave reflected by the user is not less than the target threshold, it is determined that the user's sleeping posture is not supine, and the first electronic device may return to execute the above step S02 to detect whether the user is in a sleeping state. In some embodiments, when the first electronic device determines that the user's sleeping posture is not supine, it may return to execute the above step S04.
其中,第一电子设备可以根据用户的身高和所述用户与第一电子设备的距离,确定上述目标阈值。在上述距离不变时,身高越大,目标阈值越大;在上述身高不变时,距离越大,目标阈值越小。The first electronic device may determine the target threshold according to the height of the user and the distance between the user and the first electronic device. When the distance remains unchanged, the greater the height, the greater the target threshold; when the height remains unchanged, the greater the distance, the smaller the target threshold.
S14、第一电子设备输出提示信息。S14: The first electronic device outputs prompt information.
在所述用户的睡姿为仰卧时,第一电子设备输出提示信息,该提示信息用于提示用户调整睡姿,该提示信息可以是震动、声音等,本申请实施例不作限定。When the user's sleeping position is supine, the first electronic device outputs a prompt message, where the prompt message is used to prompt the user to adjust the sleeping position. The prompt message may be a vibration, a sound, etc., which is not limited in the embodiment of the present application.
第一电子设备在执行S14之后,可返回S02,实现持续监测用户的睡眠。After executing S14, the first electronic device may return to S02 to continuously monitor the user's sleep.
上述图3所示的方法,可由易获得的电子设备执行,适用于日常。电子设备在与用户一定距离下识别用户的睡姿,实现了非接触式的睡姿检测,并且电子设备输出提示信息提醒用户实现了干预用户的睡眠呼吸暂停。同时,电子设备持续监测用户的睡眠,在判断到用户发生了呼吸暂停,开启睡姿检测,这样在必要时开启该功能,可降低电子设备的耗能。The method shown in FIG3 above can be performed by an easily available electronic device and is suitable for daily use. The electronic device identifies the user's sleeping posture at a certain distance from the user, realizing non-contact sleeping posture detection, and the electronic device outputs a prompt message to remind the user that intervention in the user's sleep apnea has been achieved. At the same time, the electronic device continuously monitors the user's sleep, and turns on sleeping posture detection when it is determined that the user has apnea. Turning on this function when necessary can reduce the energy consumption of the electronic device.
(二)请参阅图4,图4为本实施例提供的第二种监测睡眠的方法的流程示意图。该方法可以由图2A所示的第一电子设备与图2B所示的第二电子设备执行,第一电子设备的硬件架构可以是上述图2A中所示的架构,第二电子设备的硬件架构可以是上述图2B中所示的架构。应理解,在如图4所示,该方法可以包括但不限于如下步骤:(ii) Please refer to FIG. 4, which is a flow chart of a second method for monitoring sleep provided in this embodiment. The method can be performed by the first electronic device shown in FIG. 2A and the second electronic device shown in FIG. 2B. The hardware architecture of the first electronic device can be the architecture shown in FIG. 2A above, and the hardware architecture of the second electronic device can be the architecture shown in FIG. 2B above. It should be understood that, as shown in FIG. 4, the method can include but is not limited to the following steps:
S200、第一电子设备和第二电子设备通过无线通信模块建立通信连接。S200: A first electronic device and a second electronic device establish a communication connection via a wireless communication module.
S202、第二电子设备检测用户是否处于睡眠状态。S202: The second electronic device detects whether the user is in a sleeping state.
在一些实施例中,第二电子设备可以通过心率传感器采集用户的心率,基于心率来识别用户是否处于睡眠状态。In some embodiments, the second electronic device may collect the user's heart rate through a heart rate sensor, and identify whether the user is in a sleeping state based on the heart rate.
第二电子设备包括如图2B中所示的心率传感器,通过心率传感器获取用户的心率,具体可以参见上述图2B的相关描述,此处不再赘述。第二电子设备在采集到的心率处于第一心率范围时,确定所述用户处于睡眠状态,进一步地,可以执行步骤S204。在采集到的心率未处于第一心率范围时,第二电子设备返回执行步骤S202。The second electronic device includes a heart rate sensor as shown in FIG2B, and obtains the user's heart rate through the heart rate sensor. For details, please refer to the relevant description of FIG2B above, which will not be repeated here. When the collected heart rate is within the first heart rate range, the second electronic device determines that the user is in a sleeping state, and further, step S204 can be executed. When the collected heart rate is not within the first heart rate range, the second electronic device returns to execute step S202.
其中,第一心率范围是以所述用户的睡眠基准心率为中心的心率范围,可以表示为“T±Δa”。其中,T为睡眠基准心率,睡眠基准心率可以是用户在睡眠状态下的平均心率,反映了用户在睡眠期间的基础心率水平;Δa为用户在睡眠状态下心率基于平均心率的变化幅度。The first heart rate range is a heart rate range centered on the user's sleep reference heart rate, which can be expressed as "T±Δa". T is the sleep reference heart rate, which can be the average heart rate of the user in the sleep state, reflecting the user's basic heart rate level during sleep; Δa is the range of change of the user's heart rate in the sleep state based on the average heart rate.
在另一些实施例中,第二电子设备可以通过加速度传感器、陀螺仪等运动传感器获取用户的运动参数,进而,可以基于该运动参数分析用户的运动情况,在用户处于静止时,则确定用户处于睡眠状态。In other embodiments, the second electronic device may obtain the user's motion parameters through motion sensors such as acceleration sensors and gyroscopes, and then analyze the user's motion conditions based on the motion parameters, and when the user is stationary, determine that the user is in a sleeping state.
可以理解,第二电子设备还可以结合心率传感器和运动传感器获得的数据融合检测用户的睡眠状态,此时,在采集到的心率处于第一心率范围且用户处于静止时,才确定用户处于睡眠状态。It is understandable that the second electronic device can also combine the data obtained by the heart rate sensor and the motion sensor to detect the user's sleeping state. At this time, it is determined that the user is in a sleeping state only when the collected heart rate is within the first heart rate range and the user is stationary.
S204、第二电子设备检测用户是否发生睡眠呼吸暂停。S204: The second electronic device detects whether the user has sleep apnea.
第二电子设备包括如图2B中所示的血氧传感器,通过血氧传感器采集用户的血氧饱和度,具体可以参见上述图2B的相关描述,此处不再赘述。第二电子设备在检测到用户处于睡眠状态且血氧饱和度小于第一血氧阈值时,确定用户发生睡眠呼吸暂停,进一步地,可以执行步骤S206。反之,第二电子设备在检测到所述用户处于睡眠状态,但血氧饱和度不小于第一血氧阈值时,确定用户未发生睡眠呼吸暂停,则返回执行步骤S202。The second electronic device includes a blood oxygen sensor as shown in FIG2B , and the blood oxygen saturation of the user is collected through the blood oxygen sensor. For details, please refer to the relevant description of FIG2B above, which will not be repeated here. When the second electronic device detects that the user is in a sleeping state and the blood oxygen saturation is less than the first blood oxygen threshold, it determines that the user has sleep apnea, and further, step S206 can be executed. Conversely, when the second electronic device detects that the user is in a sleeping state, but the blood oxygen saturation is not less than the first blood oxygen threshold, it determines that the user does not have sleep apnea, and returns to execute step S202.
S206、第二电子设备向第一电子设备发送用于指示用户发生睡眠呼吸暂停的指示信息。S206: The second electronic device sends indication information to the first electronic device for indicating that the user has sleep apnea.
第一电子设备在接收第二电子设备发送的指示信息时,则检测到用户在睡眠状态下发生呼吸暂停,该指示信息用于指示用户在睡眠状态下发生呼吸暂停。第一电子设备接收第二电子设备发送的指示信息后,执行步骤S208至S212,具体可以参见上述(一)中步骤S06至S10,此处不再赘述。When the first electronic device receives the indication information sent by the second electronic device, it detects that the user has apnea in the sleep state, and the indication information is used to indicate that the user has apnea in the sleep state. After the first electronic device receives the indication information sent by the second electronic device, steps S208 to S212 are executed, and the details can be referred to steps S06 to S10 in (I) above, which will not be repeated here.
S214、第一电子设备根据用户反射的第一超声波的总功率检测用户的睡姿是否为仰卧。S214: The first electronic device detects whether the user's sleeping position is supine based on the total power of the first ultrasonic wave reflected by the user.
通过得到用户反射的第一超声波的功率信息计算该用户反射的第一超声波的总功率。该总功率为用户的上半身所有的点反射的第一超声波的功率之和。The total power of the first ultrasonic wave reflected by the user is calculated by obtaining the power information of the first ultrasonic wave reflected by the user. The total power is the sum of the powers of the first ultrasonic wave reflected by all points of the upper body of the user.
第一电子设备在用户反射的第一超声波的总功率小于目标阈值时,确定用户的睡姿为仰卧,进一步地,可以执行下述步骤S216。反之,第一电子设备在用户反射的所述第一超声波的总功率不小于目标阈值时,确定用户的睡姿不为仰卧,则可执行步骤S215。When the total power of the first ultrasonic wave reflected by the user is less than the target threshold, the first electronic device determines that the user's sleeping posture is supine, and further, the following step S216 can be executed. Conversely, when the total power of the first ultrasonic wave reflected by the user is not less than the target threshold, the first electronic device determines that the user's sleeping posture is not supine, and step S215 can be executed.
其中,第一电子设备可以根据用户的身高和用户与第一电子设备的距离,确定上述目标阈值。在上述距离不变时,身高越大,目标阈值越大;在上述身高不变时,距离越大,目标阈值越小。The first electronic device may determine the target threshold according to the height of the user and the distance between the user and the first electronic device. When the distance remains unchanged, the target threshold increases with the height; when the height remains unchanged, the target threshold decreases with the distance.
S215、停止睡姿调整提醒。S215: Stop the sleeping posture adjustment reminder.
S216、第一电子设备向第二电子设备发送用于提示用户调整睡姿的提示信息。S216: The first electronic device sends a prompt message to the second electronic device to prompt the user to adjust the sleeping position.
S218、第二电子设备震动、显示该提示信息。S218: The second electronic device vibrates and displays the prompt information.
第二电子设备接收第一电子设备发送的用于提示用户调整睡姿的提示信息,第二电子设备通过如图2B中所示的马达震动,并通过如图2B中所示的显示屏显示该提示信息。The second electronic device receives the prompt information sent by the first electronic device to prompt the user to adjust the sleeping position. The second electronic device vibrates through the motor as shown in FIG. 2B , and displays the prompt information through the display screen as shown in FIG. 2B .
第二电子设备在执行S218之后,可返回S202,实现持续监测用户的睡眠。After executing S218 , the second electronic device may return to S202 to continuously monitor the user's sleep.
(三)请参阅图5,图5为本实施例提供的第三种监测睡眠的方法的流程示意图。该方法可以由图2A所示的第一电子设备与图2B所示的第二电子设备执行,第一电子设备的硬件架构可以是上述图2A中所示的架构,第二电子设备的硬件架构可以是上述图2B中所示的架构。应理解,在如图5所示,该方法可以包括但不限于如下步骤:(III) Please refer to FIG5, which is a flow chart of the third method for monitoring sleep provided in this embodiment. The method can be performed by the first electronic device shown in FIG2A and the second electronic device shown in FIG2B. The hardware architecture of the first electronic device can be the architecture shown in FIG2A above, and the hardware architecture of the second electronic device can be the architecture shown in FIG2B above. It should be understood that, as shown in FIG5, the method can include but is not limited to the following steps:
S300、第二电子设备获取用户的生理信息。S300: The second electronic device obtains physiological information of the user.
第二电子设备通过如图2B所示的心率传感器、血氧传感器、心电图传感器采集用户的生理信息,该生理信息包括血氧饱和度、心率、心率相关参数和脉搏信息(强度和速度)、呼吸率中的一个或多个,具体可以参见上述图2B的相关描述,此处不再赘述。The second electronic device collects the user's physiological information through the heart rate sensor, blood oxygen sensor, and electrocardiogram sensor as shown in Figure 2B. The physiological information includes one or more of blood oxygen saturation, heart rate, heart rate-related parameters and pulse information (intensity and speed), and respiratory rate. For details, please refer to the relevant description of Figure 2B above, which will not be repeated here.
S301、第二电子设备向第一电子设备发送用户的生理信息。S301: The second electronic device sends physiological information of a user to the first electronic device.
S302、第一电子设备检测用户是否处于睡眠状态。S302: The first electronic device detects whether the user is in a sleeping state.
第一电子设备接收第二电子设备发送的生理信息,该生理信息包括用户的心率。第一电子设备在获取到的心率处于第一心率范围时,确定所述用户处于睡眠状态,进一步地,可以执行步骤S304。反之,在获取到的心率未处于第一心率范围时,第一电子设备可返回执行步骤S302。The first electronic device receives physiological information sent by the second electronic device, and the physiological information includes the heart rate of the user. When the acquired heart rate is within the first heart rate range, the first electronic device determines that the user is in a sleeping state, and further, step S304 can be executed. On the contrary, when the acquired heart rate is not within the first heart rate range, the first electronic device can return to execute step S302.
其中,第一心率范围是以所述用户的睡眠基准心率为中心的心率范围,可以表示为“T±Δa”。其中,T为睡眠基准心率,睡眠基准心率可以是用户在睡眠状态下的平均心率,反映了用户在睡眠期间的基础心率水平;Δa为用户在睡眠状态下心率基于平均心率的变化幅度。The first heart rate range is a heart rate range centered on the user's sleep reference heart rate, which can be expressed as "T±Δa". T is the sleep reference heart rate, which can be the average heart rate of the user in the sleep state, reflecting the user's basic heart rate level during sleep; Δa is the range of change of the user's heart rate in the sleep state based on the average heart rate.
S304、第一电子设备检测用户是否发生呼吸暂停。S304: The first electronic device detects whether the user has respiratory arrest.
第一电子设备接收第二电子设备发送的生理信息,该生理信息包括用户的血氧饱和度。第一电子设备在检测到用户处于睡眠状态且所述血氧饱和度小于第一血氧阈值时,确定用户发生睡眠呼吸暂停,进一步地,可以执行步骤S306。反之,第一电子设备在检测到所述用户处于睡眠状态,但血氧饱和度不小于第一血氧阈值时,确定用户未发生睡眠呼吸暂停,则返回执行步骤S302。The first electronic device receives physiological information sent by the second electronic device, and the physiological information includes the blood oxygen saturation of the user. When the first electronic device detects that the user is in a sleeping state and the blood oxygen saturation is less than the first blood oxygen threshold, it determines that the user has sleep apnea, and further, step S306 can be executed. On the contrary, when the first electronic device detects that the user is in a sleeping state, but the blood oxygen saturation is not less than the first blood oxygen threshold, it determines that the user does not have sleep apnea, and returns to execute step S302.
在第一电子设备检测到用户发生呼吸暂停后,第一电子设备执行如图5中所示的S306至S310,具体可以参见上述(一)中步骤S06至S10,此处不再赘述。After the first electronic device detects that the user has apnea, the first electronic device executes S306 to S310 as shown in FIG. 5 . For details, please refer to steps S06 to S10 in (I) above, which will not be described again.
在另一些实施例中,第二电子设备还可以通过运动传感器采集用户的运动参数,并将运动参数发送至第一电子设备。第二电子设备可以基于生理信息、运动参数和第一声音等综合判断用户是否处于睡眠状态,是否发生呼吸暂停。具体的,第一电子设备在基于运动参数识别用户处于静止、血氧饱和度低于第一血氧阈值、且第一声音检测不到呼吸声时,确定用户处于睡眠状态,且发生呼吸暂停;反之,第一电子设备在基于运动参数识别用户处于静止,血氧饱和度不低于第一血氧阈值、且第一声音检测到呼吸声时,确定用户处于睡眠状态,但未发生呼吸暂停。或者,第一电子设备在基于运动参数识别用户处于静止,且血氧饱和度低于第一血氧阈值或第一声音检测不到呼吸声时,确定用户在睡眠状态下发生呼吸暂停;反之,第一电子设备在基于运动参数识别用户处于静止,但血氧饱和度不低于第一血氧阈值且第一声音检测到呼吸声时,确定用户在睡眠状态下未发生呼吸暂停。可以理解的,第一电子设备在基于运动参数识别用户未处于静止,则可以确定用户未处于睡眠状态。In other embodiments, the second electronic device may also collect the user's motion parameters through a motion sensor and send the motion parameters to the first electronic device. The second electronic device may comprehensively judge whether the user is in a sleeping state and whether apnea occurs based on physiological information, motion parameters, and the first sound. Specifically, when the first electronic device identifies that the user is stationary based on the motion parameters, the blood oxygen saturation is lower than the first blood oxygen threshold, and the first sound cannot detect the breathing sound, it determines that the user is in a sleeping state and apnea occurs; conversely, when the first electronic device identifies that the user is stationary based on the motion parameters, the blood oxygen saturation is not lower than the first blood oxygen threshold, and the first sound detects the breathing sound, it determines that the user is in a sleeping state, but apnea does not occur. Alternatively, when the first electronic device identifies that the user is stationary based on the motion parameters, and the blood oxygen saturation is lower than the first blood oxygen threshold or the first sound cannot detect the breathing sound, it determines that the user has apnea in the sleeping state; conversely, when the first electronic device identifies that the user is stationary based on the motion parameters, but the blood oxygen saturation is not lower than the first blood oxygen threshold and the first sound detects the breathing sound, it determines that the user has not apnea in the sleeping state. It can be understood that when the first electronic device recognizes that the user is not stationary based on the motion parameters, it can determine that the user is not in a sleeping state.
S312、第一电子设备根据用户反射的第一超声波的总功率检测用户的睡姿是否为仰卧。S312: The first electronic device detects whether the user is sleeping in a supine position according to the total power of the first ultrasonic wave reflected by the user.
通过得到用户反射的第一超声波的功率信息计算该用户反射的第一超声波的总功率。该总功率为用户的上半身所有的点反射的第一超声波的功率之和。The total power of the first ultrasonic wave reflected by the user is calculated by obtaining the power information of the first ultrasonic wave reflected by the user. The total power is the sum of the powers of the first ultrasonic wave reflected by all points of the upper body of the user.
第一电子设备在用户反射的第一超声波的总功率小于目标阈值时,确定用户的睡姿为仰卧,进一步地,可以执行下述步骤S314。反之,在用户反射的所述第一超声波的总功率不小于目标阈值时,确定用户的睡姿不为仰卧,第一电子设备可返回执行步骤302检测用户是否处于睡眠状态。When the total power of the first ultrasonic wave reflected by the user is less than the target threshold, the first electronic device determines that the user's sleeping posture is supine, and further, the following step S314 can be executed. On the contrary, when the total power of the first ultrasonic wave reflected by the user is not less than the target threshold, it is determined that the user's sleeping posture is not supine, and the first electronic device can return to step 302 to detect whether the user is in a sleeping state.
其中,第一电子设备可以根据用户的身高和用户与第一电子设备的距离,确定上述目标阈值。在上述距离不变时,身高越大,目标阈值越大;在上述身高不变时,距离越大,目标阈值越小。The first electronic device may determine the target threshold according to the height of the user and the distance between the user and the first electronic device. When the distance remains unchanged, the target threshold increases with the height; when the height remains unchanged, the target threshold decreases with the distance.
S314、第一电子设备向第二电子设备发送用于提示用户调整睡姿的提示信息。S314: The first electronic device sends a prompt message to the second electronic device to prompt the user to adjust the sleeping position.
S316、第二电子设备震动、显示该提示信息。S316: The second electronic device vibrates and displays the prompt information.
第二电子设备接收第一电子设备发送的用于提示用户调整睡姿的提示信息,第二电子设备通过如图2B中所示的马达震动,并通过如图2B中所示的显示屏显示该提示信息。The second electronic device receives the prompt information sent by the first electronic device to prompt the user to adjust the sleeping position. The second electronic device vibrates through the motor as shown in FIG. 2B , and displays the prompt information through the display screen as shown in FIG. 2B .
第二电子设备在执行S316之后,可返回S300,实现持续监测用户的睡眠。After executing S316 , the second electronic device may return to S300 to continuously monitor the user's sleep.
上述实施例中所用,根据上下文,术语“当…时”可以被解释为意思是“如果…”或“在…后”或“响应于确定…”或“响应于检测到…”。类似地,根据上下文,短语“在确定…时”或“如果检测到(所陈述的条件或事件)”可以被解释为意思是“如果确定…”或“响应于确定…”或“在检测到(所陈述的条件或事件)时”或“响应于检测到(所陈述的条件或事件)”。As used in the above embodiments, the term "when..." may be interpreted to mean "if..." or "after..." or "in response to determining..." or "in response to detecting...", depending on the context. Similarly, the phrases "upon determining..." or "if (the stated condition or event) is detected" may be interpreted to mean "if determining..." or "in response to determining..." or "upon detecting (the stated condition or event)" or "in response to detecting (the stated condition or event)", depending on the context.
在上述实施例中,可以全部或部分地通过软件、硬件、固件或者其任意组合来实现。当使用软件实现时,可以全部或部分地以计算机程序产品的形式实现。所述计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行所述计算机程序指令时,全部或部分地产生按照本申请实施例所述的流程或功能。所述计算机可以是通用计算机、专用计算机、计算机网络、或者其他可编程装置。所述计算机指令可以存储在计算机可读存储介质中,或者从一个计算机可读存储介质向另一个计算机可读存储介质传输,例如,所述计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如同轴电缆、光纤、数字用户线)或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心进行传输。所述计算机可读存储介质可以是计算机能够存取的任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。所述可用介质可以是磁性介质,(例如,软盘、硬盘、磁带)、光介质(例如DVD)、或者半导体介质(例如固态硬盘)等。In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integration. The available medium can be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk), etc.
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,该流程可以由计算机程序来指令相关的硬件完成,该程序可存储于计算机可读取存储介质中,该程序在执行时,可包括如上述各方法实施例的流程。而前述的存储介质包括:ROM或随机存储记忆体RAM、磁碟或者光盘等各种可存储程序代码的介质。A person skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by a computer program to instruct the relevant hardware, and the program can be stored in a computer-readable storage medium. When the program is executed, it can include the processes of the above-mentioned method embodiments. The aforementioned storage medium includes: ROM or random access memory RAM, magnetic disk or optical disk and other media that can store program codes.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011194226.1ACN114431891B (en) | 2020-10-30 | 2020-10-30 | Sleep monitoring method and related electronic equipment |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011194226.1ACN114431891B (en) | 2020-10-30 | 2020-10-30 | Sleep monitoring method and related electronic equipment |
| Publication Number | Publication Date |
|---|---|
| CN114431891A CN114431891A (en) | 2022-05-06 |
| CN114431891Btrue CN114431891B (en) | 2024-10-11 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011194226.1AActiveCN114431891B (en) | 2020-10-30 | 2020-10-30 | Sleep monitoring method and related electronic equipment |
| Country | Link |
|---|---|
| CN (1) | CN114431891B (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117678970B (en)* | 2022-09-09 | 2024-10-15 | 荣耀终端有限公司 | Sleep state detection method, electronic device and system |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2016193020A (en)* | 2015-03-31 | 2016-11-17 | セコム株式会社 | Ultrasonic sensor |
| CN107205721A (en)* | 2014-12-08 | 2017-09-26 | 华盛顿大学 | Systems and methods for identifying movement of a subject |
| CN107692976A (en)* | 2017-10-26 | 2018-02-16 | 深圳恩鹏健康产业股份有限公司 | A kind of intelligent sleep obstacle detection therapeutic system |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CA2107718A1 (en)* | 1992-10-05 | 1994-04-06 | Mark F. Piscopo | Posture monitor |
| CN103347438A (en)* | 2010-12-07 | 2013-10-09 | Jt拉布斯有限公司 | Sleeping position sensing and monitoring system |
| CN102125368B (en)* | 2011-03-10 | 2013-07-17 | 余炳华 | Pillow capable of automatically adjusting height |
| JP6123449B2 (en)* | 2013-04-16 | 2017-05-10 | 富士通株式会社 | Biological information acquisition apparatus, method, and program |
| KR102383790B1 (en)* | 2015-05-22 | 2022-04-08 | 삼성전자주식회사 | Environment recognition method and electronic device thereof |
| KR101669453B1 (en)* | 2015-06-08 | 2016-10-27 | 유익수 | Sleep apnea management device |
| JPWO2018016392A1 (en)* | 2016-07-22 | 2019-05-09 | コニカミノルタ株式会社 | Posture detection apparatus and posture detection method |
| CN109009141A (en)* | 2018-06-14 | 2018-12-18 | 努比亚技术有限公司 | Sleep-Monitoring method, wearable device and computer readable storage medium |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107205721A (en)* | 2014-12-08 | 2017-09-26 | 华盛顿大学 | Systems and methods for identifying movement of a subject |
| JP2016193020A (en)* | 2015-03-31 | 2016-11-17 | セコム株式会社 | Ultrasonic sensor |
| CN107692976A (en)* | 2017-10-26 | 2018-02-16 | 深圳恩鹏健康产业股份有限公司 | A kind of intelligent sleep obstacle detection therapeutic system |
| Publication number | Publication date |
|---|---|
| CN114431891A (en) | 2022-05-06 |
| Publication | Publication Date | Title |
|---|---|---|
| US11928947B2 (en) | Fall detection-based help-seeking method and electronic device | |
| CN113552937B (en) | Display control method and wearable device | |
| CN113395382B (en) | A method for data interaction between devices and related devices | |
| CN113892920B (en) | Wearing detection method and device of wearable equipment and electronic equipment | |
| CN114521878B (en) | Sleep evaluation method, electronic device and storage medium | |
| CN114451874B (en) | Intelligent eye shield, terminal equipment, health management method and system | |
| EP4209174A1 (en) | Method for periodically measuring blood oxygen, and electronic device | |
| CN113069089A (en) | Electronic device, method and medium for controlling electronic device to perform PPG detection | |
| WO2024160266A1 (en) | Device operation method and apparatus and electronic device | |
| CN113129916B (en) | A method, system and related device for audio collection | |
| CN114847892A (en) | Wearable device and wearing state detection method | |
| CN113509145B (en) | Sleep risk monitoring method, electronic device and storage medium | |
| CN114431891B (en) | Sleep monitoring method and related electronic equipment | |
| EP4600955A1 (en) | Signal collection method, and electronic device and storage medium | |
| CN109285563B (en) | Voice data processing method and device in online translation process | |
| CN115665632B (en) | Audio circuit, related device and control method | |
| CN214959861U (en) | An interactive monitoring device | |
| WO2021204036A1 (en) | Sleep risk monitoring method, electronic device and storage medium | |
| CN115706755A (en) | Echo cancellation method, electronic device, and storage medium | |
| EP4509062A1 (en) | Method for predicting fertile window, apparatus and electronic device | |
| CN113749611B (en) | Data measurement method and related device | |
| CN113359120B (en) | Method and device for measuring user activity distance and electronic device | |
| CN113509144B (en) | Prompting method and device | |
| WO2024234730A1 (en) | Fatigue reminding method and apparatus, and electronic device | |
| CN120690429A (en) | Method and electronic device for identifying abnormal blood sugar events |
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |