WEARABLE DEVICE FOR DETECTING PHYSIOLOGICAL SIGNALS, AND SYSTEM AND METHOD FOR USING THE SAMEBACKGROUNDEmbodiments of the present disclosure relate to systems and methods for detecting physiological signals, which may be applicable to a wearable device, such as an earbud or an earphone.
With the gradual development and expansion of the information technology into the society, smart devices have becoming increasingly popular. These devices have powerful computing technologies, wireless connection, and, most importantly, provide various convenience for people’s lifestyles. Some smart devices are wearable by humans. Examples include smart bracelets, sport watches, etc.
With the developing need on monitoring human health, new types of health monitoring devices, such as skin electronics, have seen burgeoning appearance in our daily lives. The existing health monitoring devices are usually cumbersome for the users to carry with them. Their large size and complicated electronics also make them unsuitable for long-time use due to the limit of battery capacity. Also, some health monitoring devices use opto-electronic components susceptible to environmental interferences, such as ambient light, which reduce accuracy and sensitivity of these devices.
Therefore, there has been a need for small-sized, durable, and accurate health monitoring devices with high degree of sensitivity.
SUMMARY
Embodiments of systems and methods for using a wearable device to detect physiological signals are disclosed herein.
In some examples, a wearable device for detecting one or more physiological signals of a user is provided. The wearable device may include a pressure sensor and an electrical circuit coupled to the pressure sensor. The pressure sensor is configured to generate pressure signals in response to one or more forces applied to the pressure sensor. The one or more forces may be indicative of one or more physiological signals of the user. The electrical circuit is configured to generate pressure information based on the pressure signals.
In some examples, the physiological signals may include at least one of the following: blood flow, heart rate, pulse, humidity, respiratory rate, respiratory amplitude, or contours of an ear canal.
In some examples, the pressure sensor may include an elastic conducting layer configured to sense forces applied to the pressure sensor from any point of contact between the wearable device and the user. The elastic conducting layer may include hollow microstructures or pyramid-array microstructures.
In some examples, the electrical circuit may include one or more stretchable electrodes electrically coupled to the elastic conducting layer and generating electrical signals based on the pressure signals.
In some examples, the one or more stretchable electrodes may include an M*N matrix of electrodes distributed over the elastic conducting layer.
In some examples, the wearable device may be an ear bud or an ear phone configured to be inserted into the user’s ear canal, and the one or more stretchable electrodes may be disposed circumferentially along the ear canal, axially along the ear canal, or both.
In some examples, the one or more stretchable electrodes may include at least two rows of electrodes along a circumferential direction and at least two columns of electrodes in a depth direction in the user’s ear canal. For example, the one or more stretchable electrodes may include three rows of electrodes along a circumferential direction and eight columns of electrodes in a depth direction in the user’s ear canal, and the twenty-four electrodes may be uniformly disposed over the pressure sensor.
In some examples, the one or more electrodes may be densely provided in a portion of the wearable device that, when the wearable device is inserted into the ear canal, corresponds to a portion of the ear canal with a high concentration of the physiological signals.
In some examples, the electrical circuit may further include a signal processor electrically coupled to the one or more stretchable electrodes and configured to generate pressure information based on the electrical signals generated by the one or more stretchable electrodes.
In some examples, the pressure information may include at least one of pressing trigger, degree of pressure, direction of pressure, duration of pressure, position of pressure, mode of pressure, pressure distribution over the pressure sensor, or change of distribution of pressure.
In some examples, the wearable device may further include a processor coupled to the electrical circuit and configured to generate the user’s physiological data based on the pressure information.
In some examples, the processor may be configured to detect whether the wearable device is inserted into the ear canal of the user based on the change of the distribution of pressure.
In some examples, the wearable device may further include a memory configured to store a set of physiological data corresponding to an existing user. The processor may be further configured to compare the stored set of physiological data with a new set of physiological data generated when the wearable device is inserted into the ear canal of a current user. If the comparison result is out of a predetermined range of similarity between the existing user and the current user, the wearable device may be deactivated, locked, or turned off.
In some examples, the predetermined range of similarity may be based upon the contours of the ear canal.
In some examples, the processor may be further configured to set a time limit for the wearable device to be used by the user based on the user’s physiological data.
In some examples, the pressure information may include impedance change of the one or more stretchable electrodes.
In some examples, the processor may be further configured to determine the humidity inside the ear canal by comparing the impedance change of the electrodes along the depth direction of the ear canal. An audible warning message may be generated by the wearable device if the humidity exceeds a predetermined value.
In some examples, the processor may be further configured to determine one or more of the following physiological signals based on the fluctuation of the impedance of the one or more electrodes: blood flow, a heart rate, a respiratory rate, or a respiratory amplitude.
In some examples, the wearable device may further have a sleep mode. The processor may be further configured to generate sleep information based on the physiological signals in the sleep mode.
In some examples, an audio play instruction may be generated when one of the physiological signals reaches a predetermined value.
In some examples, the processor may be further configured to generate motion data of the user based on the pressure information outputted by the electrical circuit. The motion data may correspond to at least one of the following motion parameters of the user: posture, velocity, acceleration, or moving direction.
In some examples, the pressure information may include at least the pressure distribution over the pressure sensor.
In some examples, the processor may process the pressure distribution in both time and space to obtain the motion data indicating velocity, acceleration, or moving direction of the user.
In some examples, the processor may process the pressure information from both ears of the user to obtain the motion data indicating the posture of the user.
In some examples, a system comprising an earphone and an ear bud removably attached to an earphone is provided. The ear bud may include a pressure sensor and an electrical circuit coupled to the pressure sensor, and the earphone may include a processor. The pressure sensor may be any of the pressure sensors described in the above examples. The electrical circuit may be any of the electrical circuits described in the above examples. The processor may be any of the processors described in the above examples.
In some examples, a method for detecting one or more physiological signals of a user is provided. The method may include generating, by a pressure sensor, pressure signals in response to one or more forces applied to the pressure sensor; and generating, by an electrical circuit, pressure information based on the pressure signals. The one or more forces may be indicative of one or more physiological signals of the user.
BRIEF DESCRIPTION OF THE DRAWINGSThe accompanying drawings, which are incorporated herein and form a part of the specification, illustrate embodiments of the present disclosure and, together with the description, further serve to explain the principles of the present disclosure and to enable a person skilled in the pertinent art to make and use the present disclosure.
Fig. 1 illustrates a block diagram of a wearable device, in accordance with various embodiments.
Fig. 2 illustrates an exemplary schematic diagram of an elastic conducting layer, in accordance with various embodiments.
Fig. 3 illustrates another exemplary schematic diagram of an elastic conducting layer, in accordance with various embodiments.
Fig. 4A illustrates an exemplary schematic diagram of an elastic conducting layer, in accordance with various embodiments.
Fig. 4B illustrates an exemplary schematic diagram of an elastic conducting layer with multiple electrodes, in accordance with various embodiments.
Fig. 5 illustrates an exemplary schematic diagram of a layout of multiple electrodes on an elastic conducting layer, in accordance with various embodiments.
Fig. 6 illustrates an exemplary diagram of a system having an ear bud and an earphone, in accordance with various embodiments.
Fig. 7 illustrates six exemplary polar diagrams of output from the matrix of twenty-four electrodes described in Fig. 5, in accordance with various embodiments.
Fig. 8 illustrates six exemplary polar diagrams of output from the matrix of twenty-four electrodes described in Fig. 5, in accordance with additional embodiments.
Fig. 9 illustrates an exemplary polar diagram of electrical signal output from a row of eight electrodes described in Fig. 5, in accordance with various embodiments.
Fig. 10 illustrates an exemplary pulse of the electrical signal output of an electrode whose output is shown at point A in Fig. 9.
Fig. 11 illustrates six exemplary polar diagrams of output from the matrix of twenty-four electrodes described in Fig. 5, in accordance with further additional embodiments.
Fig. 12 illustrates an exemplary time-divided polar diagrams of output from a row of electrodes described in Fig. 5, in accordance with various embodiments.
Fig. 13 illustrates an exemplary flowchart of a method for detecting one or more physiological signals of a user, in accordance with various embodiments.
DETAILED DESCRIPTIONAlthough specific configurations and arrangements are discussed, it should be understood that this is done for illustrative purposes only. A person skilled in the pertinent art will recognize that other configurations and arrangements can be used without departing from the spirit and scope of the present disclosure. It will be apparent to a person skilled in the pertinent art that the present disclosure can also be employed in a variety of other applications.
It is noted that references in the specification to “one embodiment, ” “an embodiment, ” “an example embodiment, ” “some embodiments, ” “certain embodiments, ” etc., indicate that one or more embodiments described may include a particular feature, structure, or characteristic, but every embodiment may not necessarily include the particular feature, structure, or characteristic. Moreover, such phrases do not necessarily refer to the same embodiment. Further, when a particular feature, structure, or characteristic is described in connection with an embodiment, it would be within the knowledge of a person skilled in the pertinent art to effect such feature, structure, or characteristic in connection with other embodiments whether or not explicitly described.
In general, terminology may be understood at least in part from usage in context. For example, the term “one or more” as used herein, depending at least in part upon context, may be used to describe any feature, structure, or characteristic in a singular sense or may be used to describe combinations of features, structures or characteristics in a plural sense. Similarly, terms, such as “a, ” “an, ” or “the, ” again, may be understood to convey a singular usage or to convey a plural usage, depending at least in part upon context. In addition, the terms “based on, ” “based upon, ” and terms with similar meaning may be understood as not necessarily intended to convey an exclusive set of factors and may, instead, allow for existence of additional factors not necessarily expressly described, again, depending at least in part on context.
Various aspects of the present disclosure will now be described with reference to various apparatus and methods. These apparatus and methods will be described in the following detailed description and illustrated in the accompanying drawings by various blocks, modules, units, components, circuits, steps, operations, processes, algorithms, etc. (collectively referred to as “elements” ) . These elements may be implemented using electronic hardware, firmware, computer software, or any combination thereof. Whether such elements are implemented as hardware, firmware, or software depends upon the particular application and design constraints imposed on the overall system.
The following disclosure relates to a wearable device, such as smart bracelets, sports watches, ear buds, earphones, or other devices that can contact the skin of a user in use. Fig. 1 illustrates a block diagram of a wearable device 10, in accordance with various embodiments. The wearable device 10 may include a pressure sensor 11 and an electrical circuit 12 coupled to the pressure sensor. The pressure sensor 11 may generate pressure signals in response to one or more forces applied to the pressure sensor. Such forces may indicate one or more physiological signals of the user. For example, the signals may be a waveform that has a peak and a trough in a periodic duration. In some embodiments according to the present disclosure, the force is the largest in a periodic duration when the signal is at its peak value while the smallest when the signal is at its trough value. The electrical circuit 12 may generate pressure information based on the pressure signals from the pressure sensor 11. In some embodiments, the physiological signals may include one or more of the following parameters of a user: blood flow, heart rate, pulse, humidity, respiratory rate, respiratory amplitude, or contours of an ear canal. In some embodiments, the electrical circuit may also generate physiological data of the user based on the pressure information. In other embodiments, the forces may be applied to the pressure sensor from the skin of a user as a result of the user’s physical exercise, such as running, jogging, walking, jumping, etc. Thus, the electrical circuit may be able to generate motion data of the user based on the pressure information.
As shown in Fig. 1, the pressure sensor 11 may include an elastic conducting layer 111. The elastic conducting layer 11 may sense forces applied to the pressure sensor 11. For example, the elastic conducting layer 111 may sense the small electric current generated as a result of its deformation caused by the forces applied thereto. In some embodiments, the small electric current may be generated by deformation of the elastic conducting layer 111 from any point of contact between the wearable device 10 and the user. Therefore, unlike existing wearable devices only capable of sensing forces in limited areas of contact due to its use of traditional pressure sensors, the pressure sensors and the elastic conducting layers according to the present disclosure may detect the current generated by forces applied to the pressure sensors from any point of contact between the wearable device and the user.
In some embodiments, the elastic conducting layer 111 may be disposed inside the wearable device 10. In other embodiments, the elastic conducting layer 111 may be disposed over the wearable device and directly contact the user's skin. The elastic conducting layer 111 may be further at least partially covered with a high-resistance insulating layer to prevent the user’s skin from causing the change of potential to the elastic conducting layer 111. The insulation layer may be disposed over the portion of the pressure sensor 11 where the elastic conducting layer 111 is also disposed. The effective modulus of the elastic conducting layer 111 may be between 150kPa and 2MPa. This range allows the elastic conducting layer 111 to have sufficient sensitivity to the tiny forces applied to the wearable device while also allowing it to have a broad range of operation.
Among the many sensor devices for collecting health information, photoelectric devices are the most common. The photoelectric devices use arrays of complex optical sensors and a large number of digital signal processors to transform the user’s physiological information into optical signals, and then to digital signals. However, optoelectronic devices have disadvantages. such as susceptibility to interference, high power consumption, and complex structure.
The pressure sensor according to the present disclosure may be a sensor with high-sensitivity impedance and simple structure, which directly converts the user’s physiological information into electrical signals. The high-sensitivity impedance sensors, such as sensors having elastic conducting layers, have an advantage of high-pressure sensitivity, and can accurately collect the mechanical forces related to the human body. Moreover, the elastic conducting layer can achieve adaptive contact with the user’s ear canal, providing high wearing comfort and avoiding unpleasant symptoms commonly found in traditional wearable devices, such as ear canal swelling and inflammation caused by the mismatch between the ear canal and the earbud or the earphone.
In some embodiments, the elastic conducting layer may include multiple hollow microstructures. Fig. 2 illustrates an exemplary schematic diagram of an elastic conducting layer 20, in accordance with various embodiments. As shown in Fig. 2, when a surface 21 of the elastic conducting layer 20 is subject to a pressing force F, the hollow microstructures under the surface 21 in the elastic conducting layer 20 may deform, which will cause the impedance of the elastic conducting layer 20 to change. The elastic conducting layer 20 according to the present disclosure may detect the absolute value of the impedance, the change of impedance value, or both. Such detection may be realized by sensing the small electric current generated as a result of the impedance change. In some embodiments, the multiple hollow microstructures may have a uniform distribution inside the elastic conducting layer 20. In other embodiments, the distribution does not have to be uniform. The diameters of the hollow microstructures may be between 30 μm and 50 μm, thus enabling the elastic conducting layer 20 to have sufficient number of such hollow microstructures for detecting small forces exerted from all directions.
In some embodiments, the elastic conducting layer may include multiple pyramid-array microstructures. Fig. 3 illustrates another exemplary schematic diagram of an elastic conducting layer 30, in accordance with various embodiments. The pyramid-array microstructures may include a silicon substrate and a film with an array of pyramid protrusions disposed over the silicon substrate. The silicon substrate may have pyramid recesses. For example, as shown in Fig. 3, the elastic conducting layer 30 includes multiple small pyramid-like protrusions 32. These protrusions 32 may be provided in a two-dimensional array in the elastic conducting layer 30. The density of the distribution of these protrusions 32 may determine the sensitivity of the elastic conducting layer 30 to the pressure applied thereon. When a surface 31 of the elastic conducting layer 30 is subject to a pressing force F, the pyramid-array microstructures in the elastic conducting layer 30 may deform, which will cause the capacitance of the elastic conducting layer 30 to change. The elastic conducting layer 30 according to the present disclosure may detect the absolute value of the capacitance, the change of capacitance value, or both. Similar to the embodiments where multiple hollow microstructures are used with the elastic conducting layer 30, the detection in the current embodiments may be realized by sensing the small electric current generated as a result of the capacitance change. In some embodiments, the multiple hollow microstructures may have a uniform distribution inside the elastic conducting layer 30. In other embodiments, the distribution does not have to be uniform.
Referring back to Fig. 1, in some embodiments, the electrical circuit 12 may include one or more electrodes 121 electrically coupled to the elastic conducting layer. The one or more electrodes 121 may be micro-electrodes. The one or more electrodes 121 may be stretchable. Fig. 4A illustrates an exemplary schematic diagram of an elastic conducting layer 42, and Fig. 4B illustrates an exemplary schematic diagram of an elastic conducting layer 42 with multiple electrodes, in accordance with various embodiments.
For ease of displaying the distribution of multiple electrodes 41, an example where the electrodes 41 are disposed on the outer surface of the elastic conducting layer 42 is described herein in conjunction with Fig. 4B. However, it is understood that the electrodes 41 may also be disposed on the inner surface of the elastic conducting layer 42 in other embodiments according to the present disclosure. Therefore, the electrodes 41 are partially or entirely invisible to human eyes and hidden from the environment, thus less prone to damage from outside forces. The electrodes 41 may convert the pressure signals output by the elastic conducting layer 42 into electrical signals. The electrodes 41 may be connected by stretchable structures 43, such as stretchable serpentine structures to adapt to the deformation of the elastic conducting layer 42. Such stretchable electrodes 41 are not easy to break up when in use.
Consistent with some embodiments, the multiple electrodes may be arranged in an array and distributed over the elastic conducting layer. For example, the multiple electrodes may be arranged in an M×N matrix, may be arranged in multiple rings, or may be arranged radially. In some embodiments, the elastic conducting layer may not have a plane surface large enough to accommodate the entire electrode array. Nonetheless, the multiple electrodes according to the present disclosure may be arranged in accordance with the specific shape and structure of the elastic conducting layer on the wearable device. The multiple electrodes may be uniformly arranged on the elastic conducting layer. However, uniform arrangement is not required. In some embodiments, the multiple electrodes are more densely provided in a portion of the wearable device that corresponds to a portion of skin of the user with a higher concentration of the physiological signals. In this way, the wearable device achieves higher sensitivity to those signals.
Referring back to Fig. 1, in some embodiments, the electrical circuit 12 may further include a signal processor 122 electrically coupled to the one or more electrodes 121. The signal processer 122 may analyze the electrical signals output by the electrodes 121 and generate pressure information based on the electrical signals. For example, the signal processor 122 may filter these electrical signals and classify them to low-frequency and high-frequency signals in order to distinguish different types of signals. For example, the signal processor 122 may obtain various fluctuation signals indicating the user’s physiological signals, such as heartbeat, pulse, exercise, or respiration, which are usually high-frequency signals. On the other hand, the signal processor 122 may obtain various fluctuation signals indicating the user’s motion, such as posture, velocity, acceleration, or moving direction, which are usually low-frequency signals.
The signal processor 122 may further amplify the filtered signals. In some embodiments, the signal processor 122 may use different magnitudes to amplify the low-frequency signals and the high-frequency signals. For example, the signal processor 122 may use a larger magnitude to amplify the high-frequency signals than the low-frequency signals. This may route signals of different frequencies to be processed separately.
In some embodiments, the pressure information may include at least one of pressing trigger, degree of pressure, direction of pressure, duration of pressure, position of pressure, mode of pressure, pressure distribution over the pressure sensor, or change of distribution of pressure. The pressing trigger may be a triggering pulse signal that indicates the application of pressure. The mode of pressure represents the types of pressure exerted by an object onto the wearable device, such as a fingerprint, blood flow, etc. The position of pressure may be the position on the elastic conducting layer, the position on the user's body, the position on the wearable device, etc.
The elastic conductive layer may be designed to different shapes corresponding to different wearable devices. For example, when the wearable device is an ear bud, the elastic conductive layer may be cylindrical inside the ear bud. Thus, when the earbud is inserted into a user’s ear canal, the elastic conductive layer can be pressed and fit into the canal as well. In other embodiments, the ear bud may be removably attached to an earphone. As shown in Figs. 4A and 4B, the elastic conducting layer 42 may define a receiving cavity 45 that accommodates the main housing of an earphone. The main housing may include a speaker assembly and may be inserted into the ear canal of the user so that the user may listen to music or phone calls through the speaker. The multiple electrodes 41 may be distributed on the surface of the elastic conducting layer 42 facing or opposite to the receiving cavity.
The elastic conducting layer 42 may cover at least a part of the surface of the main housing of the earphone. It can be located between the main housing and the surface of the user’s ear canal. As shown in Fig. 4B, the elastic conductive layer 42 is wrapped into a cylindrical sleeve. In some embodiments, the elastic conducting layer 42 may also have other shapes. For example, the ear bud may have a support sleeve designed to accommodate the main housing of an earphone, and the elastic conducting layer may only cover part of the surface of the support sleeve that contacts the user’s ear canal.
In some embodiments, the multiple electrodes on the elastic conducting layer may be disposed circumferentially along the ear canal. In other embodiments, they may be disposed axially along the ear canal. Consistent with the present disclosure, the multiple electrodes may include at least two rows of electrodes along a circumferential direction and at least two columns of electrodes in a depth direction in the user’s ear canal. Fig. 5 illustrates an exemplary schematic diagram of a layout 50 of multiple electrodes 503 on an elastic conducting layer, in accordance with various embodiments. When disposed on the elastic conducting layer, the multiple electrodes 503 may include three rows 501 of electrodes along a circumferential direction 51 and eight columns 502 of electrodes in a depth direction 52 in the user’s ear canal. In these embodiments, the twenty-four electrodes are uniformly disposed over the elastic conducting layer, meaning that adjacent electrodes in this electrode matrix are separated by the same distance along one direction. Such a layout of electrodes can cover the inner surface of the ear canal in both a circumferential direction and a depth direction, which helps the multiple electrodes detect the pressure exerted on the elastic conducting layer at different positions of the ear canal.
In some embodiments, the multiple electrodes may be more densely provided in a portion of the wearable device that corresponds to a portion of the ear canal with a higher concentration of the physiological signals when the wearable device is inserted into the ear canal. For example, if the blood vessels (which may convey heartbeat, respiratory, or blood pressure signals) are more concentrated deep into the ear canal, the spacing between the electrodes at the tip end of the ear bud (thus deep into the ear canal when inserted) can be smaller than that between the electrodes far award from that tip end. This configuration improves the sensitivity of detecting these physiological signals.
In some embodiments, the wearable device may further include a processor coupled to the electrical circuit. The processor may generate the user’s physiological data based on the pressure information generated by the electrical circuit. When the wearable device is an earphone, the processor may be provided in a portion of the earphone that is physically separate from but electrically coupled to the earbud. The earphone may additionally include a speaker assembly and a main board electrically coupled to the speaker assembly. The processor may be electrically coupled to the main board of the earphone via wired or wireless connection, and send the generated physiological data to the main board of the earphone. For example, the processor may be electrically coupled to the main board through a data access port of the speaker assembly.
Fig. 6 illustrates an exemplary diagram of a system including an ear bud 61 and an earphone 60, in accordance with various embodiments. The ear bud 61 may be removably attached to the earphone 60. The ear bud 61 may include a pressure sensor and an electrical circuit, as discussed above in conjunction with Fig. 1. The earphone 60 may include a processor 601 electrically coupled to the electrical circuit of the ear bud 61 via a wired or a wireless means. The processor 601 may be disposed inside the earphone. For example, the processor 601 may be disposed inside the main housing of the earphone 60. The main housing may further accommodate a speaker assembly 602. The processor 601 may be electrically coupled to, or disposed on, a main board 603 of the earphone 60. The processor 601 may receive the pressure information generated by the electrical circuit and generate the user’s physiological data based on the pressure information.
In some embodiments consistent with the present disclosure, the wearable device may be an earphone. The pressure sensor and the electrical circuit described above may be a part of the earphone instead of a part of an ear bud. The elastic conducting layer may be at least partially disposed over the inner surface or the outer surface of the earphone. When being inserted in a user’s ear canal, the elastic conducting layer may sense forces applied thereto through contact between the wearable device and the ear canal.
Fig. 7 illustrates six exemplary polar diagrams of output from the matrix of twenty-four electrodes described in Fig. 5, in accordance with various embodiments. The first three polar diagrams respectively show the electrical signal output from the three rows 501 of electrodes in Fig. 5 before the wearable device is inserted into the user’s ear canal. The last three polar diagrams respectively show the electrical signal output from the three rows 501 of electrodes in Fig. 5 after the wearable device is inserted into the user’s ear canal. Each polar diagram has eight spokes, each of which indicates the electrical signal output from one of the eight electrodes in that row 501. As discussed above, the electrical signal may represent the pressure signal generated by the pressure sensor in response to the forces applied thereto, so the signal output from each electrode may indicate the force received by the wearable device at a location that is close to or encompasses that electrode. In this example, the three rows of electrodes 501 are distributed along the circumferential direction 51 and separated by distance in the depth direction 52. Thus, the change of electrical signal output before and after the wearable device being inserted into the ear canal can be converted to the change of pressure applied to the different locations of the wearable device that are in contact with the canal.
In various embodiments of the present disclosure, the user’s physiological data may include the contours of the user’s ear canal. As discussed above in conjunction with Fig. 7, the pressure distribution over the pressure sensor can be calculated based on the three polar diagrams. Therefore, the deformation of the elastic conducting layer may be obtained by comparing the post-insertion pressure distribution to the pre-insertion pressure distribution. The deformation may be used to reconstruct the contours of the user’s ear canal. By this way, the wearable device according to the present disclosure may detect whether it is inserted into the ear canal of a user. All such processing may be carried out at the processor included in the wearable device. The processor may be turned on after an in-ear detection is completed, thereby helping to avoid a false trigger. Alternatively, the data may be transmitted in a wired or a wireless means to a device separate from the wearable device, such as a cloud computer, so that the above processing may be carried out at the separate device.
Given the above ability to determine the contours of the user’s ear canal, the wearable device according to the current disclosure may further detect whether it is inserted into the ear canal of the user based on the change of the distribution of pressure over the pressure senor. If it is inserted into the ear canal, the wearable device may be automatically turned on, unlocked, or activated from a battery-saving mode, a standby mode, or a hibernation mode.
In some embodiments, the processor may further perform user identification. For example, the wearable device may include a memory for storing at least a set of physiological data corresponding to an existing user, such as the contour of the existing user’s ear canal. The processor may compare the stored set of physiological data with a new set of physiological data generated when the wearable device is inserted into the ear canal of a current user, and determine whether the current user is the existing user based on the comparison result. In one embodiment, if the comparison result is out of a predetermined range of similarity between the existing user and the current user, the processor determines the current user is not the existing user. The range of similarity may include several parameters, such as the amplitude of the electrical signal output in the polar diagrams related to the electrode matrix, the difference between the amplitudes obtained respectively from two insertions, or the like.
In some embodiments, the wearable device may optionally perform some corresponding steps based on the result of user identification. For example, the wearable device can login the user’s account automatically and provide personalized service to the user after the processor determines the current user is the existing user. Alternatively, the wearable device can be turned off, deactivated (e.g., into a battery-saving mode, a standby mode, or a hibernation mode) , or locked after it is determined that the current user is not the existing user.
In other embodiments, the wearable device may optionally perform some corresponding steps when some of the physiological data exceeds a predetermined range. For example, the wearable device may generate an audible warning message or turn off automatically. Separately, the wearable device may further set a time limit for user usage based on the user’s physiological data. As a nonlimiting example, if the user has a short breath for a prolonged period of time, which, for instance, can be measured by the number of breaths the user has in one minute, the wearable device can be automatically turned off, deactivated, or locked.
In some embodiments, the wearable device may display the user’s physiological data measured by the device on a screen thereof, or send the user’s physiological data to a user terminal (such as a smart watch, a smartphone, etc. ) for displaying. For example, when the wearable device is a sports headphone and the user is undergoing physical exercise, it may display the user’s heart rate as one of the physiological data measured thereby, which helps the user monitor his/her exercise status in time.
In some embodiments, the wearable device may have a sleep mode, and the wearable device can monitor the user’s sleep by following the user’s physiological data in the sleep mode, such as the user’s respiratory rate or respiratory amplitude. The wearable device may further generate sleep information of the user. The wearable device may display the sleep information or send the sleep information to a user terminal for displaying. In some embodiments, the wearable device may further generate an audio playing instruction in the sleep mode. The wearable device may be an ear bud and send the audio playing instruction to the earphone connected with the ear bud for instructing the earphone to play some audio during the user’s sleep. Alternatively, the wearable device may be an earphone and instructing the speaker assembly of the earphone to play some audio via the audio playing instruction.
In some embodiments, the user’s physiological data may include the humidity inside the user’s ear canal, which can be detected by the wearable device. Fig. 8 illustrates six exemplary polar diagrams of output from the matrix of the twenty-four electrodes described in Fig. 5, in accordance with additional embodiments. The first three polar diagrams respectively show the electrical signal output from the three rows 501 of electrodes in Fig. 5 when the user’s ear canal has a first humidity level. The last three polar diagrams respectively show the electrical signal output from the three rows 501 of electrodes in Fig. 5 when the user’s ear canal has a second humidity level different from the first humidity level. In an example where the size of the wearable device does not fit the user’s ear canal, after wearing the device for a long time, the user may have a swollen ear canal. As a result, the metabolism near the ear canal may increase, which causes the humidity level inside the ear canal to increase. The elastic conducting layer according to the present disclosure may have such a sensitivity to humidity that it may detect the difference in humidity levels in different depths of the ear canal by comparing the impedance changes of the electrodes along the depth direction of the ear canal, as shown in Fig. 8. Upon detecting the increase of humidity level has exceeded a predetermined range, the wearable device may be turned off, deactivated, or locked so that the user may no longer use it.
In some embodiments, the user’s physiological data may include the user’s heart rate. Fig. 9 illustrates an exemplary polar diagram of electrical signal output from a row 501 of eight electrodes described in Fig. 5. A human’s heart beat may cause a weak vibration in the anterior cochlear artery due to the blood flow, which brings a tiny fluctuation of pressure imposed on one or more electrodes (e.g., the electrode at point A in Fig. 9) located near the anterior cochlear artery in the user’s ear canal. This may further cause pulsing output of the electrical signals of the one or more electrodes. Fig. 10 illustrates an exemplary pulse of the electrical signal output of an electrode whose output is shown at point A in Fig. 9.
The processor can obtain the user’s heart rate by analyzing the pulsing output of the electrical signals of the one or more electrodes located near the anterior cochlear artery. In some embodiments, the processor can use a baseline to calculate the fluctuation of the output. In other embodiments, the processor can further use an adaptive filtering method and/or a morphological filtering method to calculate in order to avoid the interference of the noise and baseline drift in the calculation.
In some embodiments, the user’s physiological data may include the user’s respiratory rate. Fig. 11 illustrates six exemplary polar diagrams of output from the matrix of twenty-four electrodes described in Fig. 5, in accordance with further additional embodiments. The first three polar diagrams respectively show the electrical signal output from the three rows 501 of electrodes in Fig. 5 when the user is exhaling (breathing out) . The last three polar diagrams respectively show the electrical signal output from the three rows 501 of electrodes in Fig. 5 when the user is inhaling (breathing in) . When the user is breathing, the user’s ear canal may have a periodical expansion and contraction, which will bring a periodical fluctuation of pressure imposed on the pressure sensor, therefore causing a periodical pulsing of the electrical signal output of the electrodes. Similar to the measurement of heart rate, the wearable device can analyze the pulsing to obtain the user’s respiratory rate.
In some embodiments, the user’s physiological data may include the user’s blood flow information, such as pulse rate or blood pressure. The fluctuation of blood vessels may reflect the blood pressure, and the fluctuation of blood vessels may bring fluctuation of pressure imposed on one or more electrodes located near the blood vessels. Thus, it may cause a fluctuation of the output from the one or more electrodes located near the blood vessels. According to the present disclosure, the wearable device can obtain the blood pressure by analyzing the fluctuation of the output from the one or more electrodes located near the blood vessels. The processor of the wearable device can further generate a warning message when the blood pressure is out of a predetermined range. In some embodiments, the wearable device may further obtain the pulse rate by calculating the phase difference between the fluctuation of the output from the one or more electrodes located at different blood vessels.
In some embodiments, the processor may further generate motion data of the user based on electrical signals output by the one or more electrodes. The motion data may include at least one of posture, velocity, acceleration, motion amplitude, or moving direction of the user.
Fig. 12 illustrates an exemplary time-divided polar diagrams of output from a row 501 of electrodes described in Fig. 5. When the user 1201 is in motion, such as running, jogging, walking, or jumping, the distribution of pressure over the pressure sensor of the wearable device may generally fluctuate in a certain direction relating to the moving direction of the user. As shown in Fig. 12, the overall electrical signal output 1202 from the row of electrodes shift in a direction generally opposite to the moving direction of the user 1201. The wearable device thus can process the distribution of pressure in both time and space, thus obtaining the motion data of the user 1201, such as velocity, acceleration, motion amplitude, and moving direction.
In some embodiments, the wearable device may obtain the user’s posture based on pressure information from both ears of the user. In these cases, the wearable device may include two ear buds or two earphones to be inserted into the user’s left and right ear canals respectively. As the posture of the user changes, the pressure sensor in the left ear and the pressure sensor in the right ear may be subject to different pressure distribution. The processor in the wearable device may process the pressure distribution from both ears at different time points and compare the pressure distribution from both ears at the same time point to obtain the posture of the user.
Although the majority of the above descriptions on the applications of the wearable device according to the present disclosure use the embodiments of twenty-four electrodes, it is understood the present disclosure may be implemented by a wearable device having other number of electrodes. The number of electrodes used in the wearable device may be pre-designed according to the needs of overall sensitivity and complexity of the device, as well as consideration for cost.
Fig. 13 illustrates an exemplary flowchart of a method 1300 for detecting one or more physiological signals of a user, in accordance with various embodiments. It is to be appreciated that some of the steps may be optional to perform the disclosure provided herein, and that some steps may be inserted in the flowchart of the method 1300 that are consistent with other embodiments according to the current disclosure. Further, some of the steps may be performed simultaneously, or in an order different from that shown in Fig. 13.
The wearable device may include a pressure sensor and an electrical circuit coupled to the pressure sensor. At step 1301, the pressure sensor can generate pressure signals in response to one or more forces applied to the pressure sensor, said one or more forces being indicative of one or more physiological signals of the user. For example, when a user places a wearable device according to embodiments of the disclosure in his/her ear, pressure signals can be generated by the pressure sensor. The physiological signals may include at least one of the following: blood flow, heart rate, pulse, humidity, respiratory rate, respiratory amplitude, or contours of an ear canal.
The pressure sensor may sense forces by an elastic conducting layer. The elastic conducting layer may sense forces applied to the pressure sensor from any point of contact between the wearable device and the user. The elastic modulus of the elastic conducting layer may be 150kPa~2MPa. The elastic conducting layer may include hollow microstructures. The elastic conducting layer may generate impedance change in response to deformation caused by forces applied to the hollow microstructures. The diameters of the hollow microstructures may be between 30μm and 50μm. Alternatively, the elastic conducting layer may include pyramid-array microstructures configured to sense forces applied to the pressure sensor, and the pyramid-array microstructures may include a silicon substrate and a film with an array of pyramid protrusions disposed over the silicon substrate.
The electrical circuit may further use one or more stretchable electrodes to generate electrical signals based on the pressure signals received from the elastic conducting layer. The one or more stretchable electrodes may be distributed as an M*N matrix over the elastic conducting layer. In some embodiments, the wearable device may be configured to be inserted into the user’s ear canal, and the one or more stretchable electrodes may be disposed circumferentially along the ear canal, axially along the ear canal, or both. The one or more stretchable electrodes may include at least two rows of electrodes along a circumferential direction and at least two columns of electrodes in a depth direction in the user’s ear canal. For example, the one or more stretchable electrodes may include three rows of electrodes along a circumferential direction and eight columns of electrodes in a depth direction in the user’s ear canal, and the 24 electrodes are uniformly disposed over the pressure sensor. In some embodiments, the one or more electrodes may be densely provided in a portion of the wearable device that, when the wearable device is inserted into the ear canal, corresponds to a portion of the ear canal with a high concentration of the physiological signals.
At step 1302, the electrical circuit can generate pressure information based on the pressure signals. In some embodiments, the electrical circuit may further use a signal processor to generate pressure information based on the electrical signals generated by the one or more stretchable electrodes. The pressure information may include at least one of pressing trigger, degree of pressure, direction of pressure, duration of pressure, position of pressure, mode of pressure, pressure distribution over the pressure sensor, or change of distribution of pressure.
In some embodiments, the process may further include a step 1303. At step 1303, a processor may generate the user’s physiological data based on the pressure information received from the electrical circuit. The processor may be coupled to the electrical circuit and generate the user’s physiological data based on the pressure information. The processor may detect whether the wearable device is inserted into the ear canal of the user based on the change of the distribution of pressure. The processor may compare a stored set of physiological data corresponding to an existing user with a new set of physiological data generated when the wearable device is inserted into the ear canal of a current user, and determine whether the current user is the existing user. The processor may determine the current user is not the existing user when the comparison result is out of a predetermined range of similarity between the existing user and the current user. The predetermined range of similarity may be based upon the contours of the ear canal. The wearable device may be deactivated, locked, or turned off when the processor determines the current user is not the existing user.
In some embodiments, the pressure information may include impedance change of the one or more stretchable electrodes, and the processor may determine humidity inside the ear canal by comparing the impedance change of the electrodes along the depth direction of the ear canal. The wearable device may generate an audible warning message when the humidity exceeds a predetermined value.
In some embodiments, the pressure information may include fluctuation of impedance of the one or more stretchable electrodes, and the processor may determine one or more of the following physiological signals based on the fluctuation of impedance of the electrodes: blood flow, a heart rate, a respiratory rate, or a respiratory amplitude.
In some embodiments, the wearable device may include a sleep mode, and the processor may generate sleep information based on the physiological signals in the sleep mode. The processor may further generate an audio play instruction when one of the physiological signals reaches a predetermined value.
In some embodiments, the process may further include a step 1304. At step 1304, the processor may further generate motion data of the user based on the pressure information output by the electrical circuit. The motion data may correspond to at least one of the following motion parameters of the user: posture, velocity, acceleration, or moving direction. The pressure information may include at least the pressure distribution over the pressure sensor. The processor may process the pressure distribution in both time and space to obtain the motion data. The processor may process the pressure information from both ears of the user to obtain the motion data indicating the posture of the user.
The foregoing description of the specific embodiments will so reveal the general nature of the present disclosure that others can, by applying knowledge within the skill of the art, readily modify and/or adapt for various applications such specific embodiments, without undue experimentation, without departing from the general concept of the present disclosure. Therefore, such adaptations and modifications are intended to be within the meaning and range of equivalents of the disclosed embodiments, based on the teaching and guidance presented herein. It is to be understood that the phraseology or terminology herein is for the purpose of description and not of limitation, such that the terminology or phraseology of the present specification is to be interpreted by the skilled artisan in light of the teachings and guidance.
Embodiments of the present disclosure have been described above with the aid of functional building blocks illustrating the implementation of specified functions and relationships thereof. The boundaries of these functional building blocks have been arbitrarily defined herein for the convenience of the description. Alternate boundaries can be defined so long as the specified functions and relationships thereof are appropriately performed.
The Summary and Abstract sections may set forth one or more but not all exemplary embodiments of the present disclosure as contemplated by the inventor (s) , and thus, are not intended to limit the present disclosure and the appended claims in any way.
Various functional blocks, modules, and steps are disclosed above. The particular arrangements provided are illustrative and without limitation. Accordingly, the functional blocks, modules, and steps may be re-ordered or combined in different ways than in the examples provided above. Likewise, certain embodiments include only a subset of the functional blocks, modules, and steps, and any such subset is permitted.
The breadth and scope of the present disclosure should not be limited by any of the above-described exemplary embodiments, but should be defined only in accordance with the following claims and their equivalents.