





技术领域technical field
本发明涉及车辆技术领域,尤其涉及一种智能穿戴设备和一种智能网联车辆系统的控制方法。The invention relates to the technical field of vehicles, in particular to an intelligent wearable device and a control method of an intelligent networked vehicle system.
背景技术Background technique
近年来可穿戴设备概念持续火热,目前,可穿戴设备不仅仅是一种硬件设备,更是通过软件支持以及数据交互、云端交互来实现强大的功能,对我们的生活、感知带来很大的转变。然而,涉及汽车领域的可穿戴设备,目前还是初期发展阶段,可穿戴设备与座舱系统之间缺乏整体协调,功能相关性较低,用户交互体验不佳。In recent years, the concept of wearable device has continued to be popular. At present, wearable device is not only a hardware device, but also realizes powerful functions through software support, data interaction and cloud interaction, which brings great impact to our life and perception. change. However, the wearable devices involved in the automotive field are still in the early stage of development. There is a lack of overall coordination between the wearable device and the cockpit system, the functional correlation is low, and the user interaction experience is poor.
发明内容SUMMARY OF THE INVENTION
本发明旨在至少在一定程度上解决相关技术中的技术问题之一。为此,本发明的第一个目的在于提出一种智能穿戴设备,能够增强智能穿戴设备与智能网联车辆的联动性,同时,提高车内HMI交互体验。The present invention aims to solve one of the technical problems in the related art at least to a certain extent. Therefore, the first objective of the present invention is to provide an intelligent wearable device, which can enhance the linkage between the intelligent wearable device and the intelligent networked vehicle, and at the same time, improve the HMI interaction experience in the vehicle.
本发明的第二个目的在于提出一种智能网联车辆系统的控制方法。The second object of the present invention is to provide a control method for an intelligent networked vehicle system.
为达到上述目的,本发明第一方面实施例提出的智能穿戴设备,应用于智能网联车辆系统,所述智能穿戴设备包括主设备模组、从设备模组和控制模组,所述控制模组分别与所述主设备模组和所述从设备模组相连,其中,所述主设备模组用于监测驾驶员的行为信息和生理信息,并将所述驾驶员的行为信息和生理信息发送给所述控制模组;所述从设备模组用于监测乘客的生理信息和位置信息,并将所述乘客的生理信息和位置信息发送给所述控制模组;所述控制模组用于根据所述驾驶员的生理信息确定所述驾驶员的驾驶状态,并根据所述驾驶员的驾驶状态确定车辆状态信息存在危险因素时发出告警信息,以及通过与车辆进行通信以对所述车辆进行主动介入控制;所述控制模组还用于,根据所述驾驶员的行为信息确定所述驾驶员的操作指令,并根据所述驾驶员的操作指令通过与所述车辆进行通信以对所述车辆进行驾驶操作控制;所述控制模组还用于,根据所述乘客的生理信息和位置信息,通过与所述车辆进行通信以对所述车辆进行主动介入控制。In order to achieve the above purpose, the smart wearable device proposed by the embodiment of the first aspect of the present invention is applied to an intelligent network-connected vehicle system. The smart wearable device includes a master device module, a slave device module, and a control module. The control module The group is respectively connected with the master device module and the slave device module, wherein the master device module is used to monitor the driver's behavior information and physiological information, and use the driver's behavior information and physiological information sent to the control module; the slave device module is used to monitor the passenger's physiological information and position information, and send the passenger's physiological information and position information to the control module; the control module uses When the driving state of the driver is determined according to the physiological information of the driver, and the vehicle state information is determined to have a dangerous factor according to the driving state of the driver, an alarm message is issued, and an alarm message is sent to the vehicle by communicating with the vehicle. Perform active intervention control; the control module is further configured to determine the driver's operation instruction according to the driver's behavior information, and communicate with the vehicle according to the driver's operation instruction to communicate with the vehicle. The vehicle performs driving operation control; the control module is further configured to perform active intervention control on the vehicle by communicating with the vehicle according to the passenger's physiological information and position information.
根据本发明实施例的智能穿戴设备,通过主设备模组监测驾驶员的行为信息和生理信息,并将驾驶员的行为信息和生理信息发送给控制模组,并通过从设备模组监测乘客的生理信息和位置信息,并将乘客的生理信息和位置信息发送给控制模组,以及通过控制模组根据驾驶员的生理信息确定驾驶员的驾驶状态,并根据驾驶员的驾驶状态确定车辆状态信息存在危险因素时发出告警信息,以及通过与车辆进行通信以对车辆进行主动介入控制,或者,根据驾驶员的行为信息确定驾驶员的操作指令,并根据驾驶员的操作指令通过与车辆进行通信以对车辆进行驾驶操作控制,或者,根据乘客的生理信息和位置信息,通过与车辆进行通信以对车辆进行主动介入控制。由此,增强智能穿戴设备与智能网联车辆的联动性,同时,提高车内HMI交互体验。According to the smart wearable device of the embodiment of the present invention, the driver's behavior information and physiological information are monitored through the master device module, and the driver's behavior information and physiological information are sent to the control module, and the passenger's behavior information is monitored through the slave device module. Physiological information and position information, and send the passenger's physiological information and position information to the control module, and the control module determines the driver's driving state according to the driver's physiological information, and determines the vehicle state information according to the driver's driving state When there are dangerous factors, it can issue warning information, and actively intervene and control the vehicle by communicating with the vehicle, or determine the driver's operating instructions according to the driver's behavior information, and communicate with the vehicle according to the driver's operating instructions. Control the driving operation of the vehicle, or perform active intervention control of the vehicle by communicating with the vehicle based on the physiological information and location information of the passengers. As a result, the linkage between smart wearable devices and smart connected vehicles is enhanced, and at the same time, the HMI interaction experience in the car is improved.
另外,根据本发明上述实施例的智能穿戴设备,还可以具有如下的附加技术特征:In addition, the smart wearable device according to the above embodiments of the present invention may also have the following additional technical features:
根据本发明的一个实施例,所述驾驶员的行为信息包括手势行为和语音行为,其中,所述控制模组还用于根据所述手势行为进行手势判定,并在确定所述手势行为为有效功能控制手势时,进一步判断所述有效功能控制手势是否为开启语音识别手势,如果是,则确定所述语音行为对应的语音指令,并通过与所述车辆进行通信以将所述语音指令发送给所述车辆,以便对所述车辆进行语音控制;如果否,则确定所述有效功能控制手势对应的控制指令,并通过与所述车辆进行通信以将所述控制指令发送给所述车辆,以便对所述车辆进行手势控制。According to an embodiment of the present invention, the behavior information of the driver includes gesture behavior and voice behavior, wherein the control module is further configured to perform gesture determination according to the gesture behavior, and when determining that the gesture behavior is valid When the function control gesture is used, it is further judged whether the effective function control gesture is a voice recognition gesture, and if so, the voice command corresponding to the voice behavior is determined, and the voice command is sent to the vehicle by communicating with the vehicle. the vehicle, so as to perform voice control on the vehicle; if not, determine the control instruction corresponding to the effective function control gesture, and communicate with the vehicle to send the control instruction to the vehicle, so as to Gesture control of the vehicle.
根据本发明的一个实施例,所述驾驶员的生理信息包括驾驶员情绪信息,其中,所述控制模组还用于根据所述驾驶员情绪信息判断所述驾驶员的情绪信息指标是否异常,并在所述驾驶员的情绪信息指标异常时判断所述车辆状态信息是否存在危险驾驶行为数据,如果是,则对驾驶员发出一级警报强提醒信息,并生成第一车内环境调节指令,以及通过与所述车辆进行通信以将所述第一车内环境调节指令发送给所述车辆,以便所述车辆根据所述第一车内环境调节指令进行车内环境调节;如果否,则对驾驶员发出二级警报弱提醒信息。According to an embodiment of the present invention, the driver's physiological information includes driver emotional information, wherein the control module is further configured to determine whether the driver's emotional information index is abnormal according to the driver's emotional information, And when the driver's emotional information index is abnormal, it is judged whether the vehicle state information has dangerous driving behavior data, and if so, a first-level alarm strong reminder information is issued to the driver, and a first in-vehicle environment adjustment instruction is generated, and by communicating with the vehicle to send the first in-vehicle environment adjustment instruction to the vehicle, so that the vehicle can adjust the in-vehicle environment according to the first in-vehicle environment adjustment instruction; The driver issues a secondary alarm weak reminder message.
根据本发明的一个实施例,所述驾驶员的生理信息包括驾驶员体征信息,其中,所述控制模组还用于根据所述驾驶员体征信息判断所述驾驶员的体征信息指标是否异常,并在所述驾驶员的体征信息指标异常时判断所述车辆状态信息是否存在行车危险数据,如果是,则对驾驶员发出一级警报强提醒信息,并生成第二车内环境调节指令,以及通过与所述车辆进行通信以将所述第二车内环境调节指令发送给所述车辆,以便所述车辆根据所述第二车内环境调节指令进行车内环境调节,同时主动触发所述车辆的辅助驾驶功能;如果否,则对驾驶员发出二级警报健康提醒信息。According to an embodiment of the present invention, the driver's physiological information includes driver's sign information, wherein the control module is further configured to determine whether the driver's sign information index is abnormal according to the driver's sign information, and when the driver's physical information index is abnormal, determine whether the vehicle status information has driving danger data, if so, issue a first-level alarm strong reminder information to the driver, and generate a second in-vehicle environment adjustment instruction, and By communicating with the vehicle, the second in-vehicle environment adjustment instruction is sent to the vehicle, so that the vehicle adjusts the in-vehicle environment according to the second in-vehicle environment adjustment instruction, and at the same time actively triggers the vehicle assisted driving function; if not, a secondary alarm health reminder message will be issued to the driver.
根据本发明的一个实施例,所述控制模组还用于根据所述乘客的位置信息确定所述乘客处于车内时,判断所述车辆是否处于行车状态,其中,如果是,则通过与所述车辆进行通信以将所述乘客的位置信息发送给所述车辆,以便所述车辆执行对应车门童锁的开关控制及对应座位区域的车内环境调节;如果否,则在确定所述车辆处于驻车锁定状态时控制所述主设备模组进行一级警报强提醒,同时根据所述乘客的生理信息生成第三车内环境调节指令,以及通过与所述车辆进行通信以将所述第三车内环境调节指令发送给所述车辆,以便所述车辆根据所述第三车内环境调节指令进行车内环境调节。According to an embodiment of the present invention, the control module is further configured to determine whether the vehicle is in a driving state when the passenger is in the vehicle according to the position information of the passenger, wherein, if it is, the The vehicle communicates to send the position information of the passenger to the vehicle, so that the vehicle can perform the switch control corresponding to the door child lock and the in-vehicle environment adjustment corresponding to the seat area; if not, determine that the vehicle is in In the parking lock state, the main equipment module is controlled to perform a first-level alarm and strong reminder, and at the same time, a third in-vehicle environment adjustment instruction is generated according to the passenger's physiological information, and the third in-vehicle environment adjustment instruction is generated by communicating with the vehicle. The in-vehicle environment adjustment instruction is sent to the vehicle, so that the vehicle performs in-vehicle environment adjustment according to the third in-vehicle environment adjustment instruction.
为达到上述目的,本发明第二方面实施例提出的智能网联车辆系统的控制方法,包括如上所述的智能穿戴设备,所述控制方法包括以下步骤:通过所述主设备模组监测驾驶员的行为信息和生理信息,并通过所述从设备模组监测乘客的生理信息和位置信息;根据所述驾驶员的生理信息确定所述驾驶员的驾驶状态,并根据所述驾驶员的驾驶状态确定车辆状态信息存在危险因素时发出告警信息,以及通过与车辆进行通信以对所述车辆进行主动介入控制;根据所述驾驶员的行为信息确定所述驾驶员的操作指令,并根据所述驾驶员的操作指令通过与所述车辆进行通信以对所述车辆进行驾驶操作控制;根据所述乘客的生理信息和位置信息,通过与所述车辆进行通信以对所述车辆进行主动介入控制。In order to achieve the above object, the control method for the intelligent networked vehicle system proposed by the embodiment of the second aspect of the present invention includes the above-mentioned smart wearable device, and the control method includes the following steps: monitoring the driver through the main device module The behavior information and physiological information of the passenger are monitored by the slave device module; the driving state of the driver is determined according to the physiological information of the driver, and the driving state of the driver is determined according to the When it is determined that the vehicle state information has dangerous factors, an alarm information is issued, and the vehicle is actively intervened and controlled by communicating with the vehicle; the operation instruction of the driver is determined according to the behavior information of the driver, and the operation instruction of the driver is determined according to the driving The operator's operation instruction communicates with the vehicle to control the driving operation of the vehicle; and according to the passenger's physiological information and location information, communicates with the vehicle to perform active intervention control of the vehicle.
根据本发明实施例的智能网联车辆系统的控制方法,通过主设备模组监测驾驶员的行为信息和生理信息,并通过从设备模组监测乘客的生理信息和位置信息,进而,根据驾驶员的生理信息确定驾驶员的驾驶状态,并根据驾驶员的驾驶状态确定车辆状态信息存在危险因素时发出告警信息,以及通过与车辆进行通信以对车辆进行主动介入控制,或者,根据驾驶员的行为信息确定驾驶员的操作指令,并根据驾驶员的操作指令通过与车辆进行通信以对车辆进行驾驶操作控制,或者,根据乘客的生理信息和位置信息,通过与车辆进行通信以对车辆进行主动介入控制。由此。增强智能穿戴设备与智能网联车辆的联动性,同时,提高车内HMI交互体验。According to the control method of the intelligent networked vehicle system according to the embodiment of the present invention, the behavior information and physiological information of the driver are monitored through the master device module, and the physiological information and position information of the passengers are monitored through the slave device module. The physiological information of the driver determines the driving state of the driver, and according to the driving state of the driver, the vehicle state information is determined to issue an alarm message when there are dangerous factors, and the vehicle is actively intervened by communicating with the vehicle, or, according to the driver's behavior. The information determines the driver's operation instruction, and communicates with the vehicle to control the vehicle's driving operation according to the driver's operation instruction, or, according to the passenger's physiological information and location information, communicates with the vehicle to actively intervene in the vehicle control. thus. Enhance the linkage between smart wearable devices and smart connected vehicles, and at the same time, improve the HMI interaction experience in the car.
另外,根据本发明上述实施例的智能网联车辆系统的控制方法,还可以具有如下的附加技术特征:In addition, the control method for the intelligent networked vehicle system according to the above-mentioned embodiment of the present invention may also have the following additional technical features:
根据本发明的一个实施例,所述驾驶员的行为信息包括手势行为和语音行为,其中,根据所述驾驶员的行为信息确定所述驾驶员的操作指令,并根据所述驾驶员的操作指令通过与所述车辆进行通信以对所述车辆进行驾驶操作控制,包括:根据所述手势行为进行手势判定,并在确定所述手势行为为有效功能控制手势时,进一步判断所述有效功能控制手势是否为开启语音识别手势;如果是,则确定所述语音行为对应的语音指令,并通过与所述车辆进行通信以将所述语音指令发送给所述车辆,以便对所述车辆进行语音控制;如果否,则确定所述有效功能控制手势对应的控制指令,并通过与所述车辆进行通信以将所述控制指令发送给所述车辆,以便对所述车辆进行手势控制。According to an embodiment of the present invention, the behavior information of the driver includes gesture behavior and voice behavior, wherein the operation instruction of the driver is determined according to the behavior information of the driver, and the operation instruction of the driver is determined according to the operation instruction of the driver. Performing driving operation control on the vehicle by communicating with the vehicle includes: performing gesture determination according to the gesture behavior, and when determining that the gesture behavior is an effective function control gesture, further determining the effective function control gesture Whether the gesture is to enable voice recognition; if so, determine the voice command corresponding to the voice behavior, and communicate with the vehicle to send the voice command to the vehicle, so as to perform voice control on the vehicle; If not, determining a control instruction corresponding to the effective function control gesture, and communicating with the vehicle to send the control instruction to the vehicle, so as to perform gesture control on the vehicle.
根据本发明的一个实施例,所述驾驶员的生理信息包括驾驶员情绪信息,其中,根据所述驾驶员的生理信息确定所述驾驶员的驾驶状态,并根据所述驾驶员的驾驶状态确定车辆状态信息存在危险因素时发出告警信息,以及通过与车辆进行通信以对所述车辆进行主动介入控制,包括:根据所述驾驶员情绪信息判断所述驾驶员的情绪信息指标是否异常,并在所述驾驶员的情绪信息指标异常时判断所述车辆状态信息是否存在危险驾驶行为数据;如果是,则对驾驶员发出一级警报强提醒信息,并生成第一车内环境调节指令,以及通过与所述车辆进行通信以将所述第一车内环境调节指令发送给所述车辆,以便所述车辆根据所述第一车内环境调节指令进行车内环境调节;如果否,则对驾驶员发出二级警报弱提醒信息。According to an embodiment of the present invention, the physiological information of the driver includes driver emotional information, wherein the driving state of the driver is determined according to the physiological information of the driver, and the driving state of the driver is determined according to the driving state of the driver. Sending out warning information when there is a risk factor in the vehicle state information, and actively intervening and controlling the vehicle by communicating with the vehicle, includes: judging whether the driver's emotional information index is abnormal according to the driver's emotional information, and When the driver's emotional information index is abnormal, determine whether the vehicle state information has dangerous driving behavior data; if so, issue a first-level alarm strong reminder information to the driver, and generate a first in-vehicle environment adjustment instruction, and pass communicating with the vehicle to send the first in-vehicle environment adjustment command to the vehicle for the vehicle to perform in-vehicle environment adjustment according to the first in-vehicle environment adjustment command; if not, to the driver A secondary alarm weak reminder message is issued.
根据本发明的一个实施例,所述驾驶员的生理信息包括驾驶员体征信息,其中,根据所述驾驶员的生理信息确定所述驾驶员的驾驶状态,并根据所述驾驶员的驾驶状态确定车辆状态信息存在危险因素时发出告警信息,以及通过与车辆进行通信以对所述车辆进行主动介入控制,包括:根据所述驾驶员体征信息判断所述驾驶员的体征信息指标是否异常,并在所述驾驶员的体征信息指标异常时判断所述车辆状态信息是否存在行车危险数据;如果是,则对驾驶员发出一级警报强提醒信息,并生成第二车内环境调节指令,以及通过与所述车辆进行通信以将所述第二车内环境调节指令发送给所述车辆,以便所述车辆根据所述第二车内环境调节指令进行车内环境调节,同时主动触发所述车辆的辅助驾驶功能;如果否,则对驾驶员发出二级警报健康提醒信息。According to an embodiment of the present invention, the driver's physiological information includes driver sign information, wherein the driver's driving state is determined according to the driver's physiological information, and the driver's driving state is determined according to the driver's driving state. Sending out warning information when there is a risk factor in the vehicle state information, and performing active intervention control on the vehicle by communicating with the vehicle, includes: judging whether the driver's sign information index is abnormal according to the driver sign information, and When the driver's physical information index is abnormal, it is judged whether the vehicle state information has driving danger data; if so, a first-level alarm strong reminder information is issued to the driver, and a second in-vehicle environment adjustment instruction is generated. The vehicle communicates to send the second in-vehicle environment adjustment instruction to the vehicle, so that the vehicle adjusts the in-vehicle environment according to the second in-vehicle environment adjustment instruction, and at the same time actively triggers the assistance of the vehicle Driving function; if no, a secondary alert health reminder message is issued to the driver.
根据本发明的一个实施例,根据所述乘客的生理信息和位置信息,通过与所述车辆进行通信以对所述车辆进行主动介入控制,包括:根据所述乘客的位置信息确定所述乘客处于车内时,判断所述车辆是否处于行车状态;如果是,则通过与所述车辆进行通信以将所述乘客的位置信息发送给所述车辆,以便所述车辆执行对应车门童锁的开关控制及对应座位区域的车内环境调节;如果否,则在确定所述车辆处于驻车锁定状态时控制所述主设备模组进行一级警报强提醒,同时根据所述乘客的生理信息生成第三车内环境调节指令,以及通过与所述车辆进行通信以将所述第三车内环境调节指令发送给所述车辆,以便所述车辆根据所述第三车内环境调节指令进行车内环境调节。According to an embodiment of the present invention, performing active intervention control on the vehicle by communicating with the vehicle according to the physiological information and position information of the passenger includes: determining that the passenger is in a position according to the position information of the passenger When in the vehicle, determine whether the vehicle is in a driving state; if so, send the passenger's position information to the vehicle by communicating with the vehicle, so that the vehicle can execute the switch control corresponding to the child lock of the door and the in-vehicle environment adjustment of the corresponding seat area; if not, control the main equipment module to perform a first-level alarm strong reminder when it is determined that the vehicle is in a parking lock state, and generate a third-level alarm according to the passenger's physiological information at the same time. an in-vehicle environment adjustment instruction, and by communicating with the vehicle to send the third in-vehicle environment adjustment instruction to the vehicle, so that the vehicle can perform in-vehicle environment adjustment according to the third in-vehicle environment adjustment instruction .
本发明附加的方面和优点将在下面的描述中部分给出,部分将从下面的描述中变得明显,或通过本发明的实践了解到。Additional aspects and advantages of the present invention will be set forth, in part, from the following description, and in part will be apparent from the following description, or may be learned by practice of the invention.
附图说明Description of drawings
图1为根据本发明实施例的智能网联车辆系统的智能穿戴设备的方框示意图;1 is a schematic block diagram of a smart wearable device of an intelligent networked vehicle system according to an embodiment of the present invention;
图2为根据本发明实施例的智能网联车辆系统的控制方法的流程示意图;2 is a schematic flowchart of a control method of an intelligent networked vehicle system according to an embodiment of the present invention;
图3为根据本发明一个具体实施例的智能网联车辆系统的控制方法的流程示意图;3 is a schematic flowchart of a control method of an intelligent networked vehicle system according to a specific embodiment of the present invention;
图4为根据本发明一个具体实施例的智能网联车辆系统的控制方法的流程示意图;FIG. 4 is a schematic flowchart of a control method of an intelligent networked vehicle system according to a specific embodiment of the present invention;
图5为根据本发明一个具体实施例的智能网联车辆系统的控制方法的流程示意图;5 is a schematic flowchart of a control method of an intelligent networked vehicle system according to a specific embodiment of the present invention;
图6为根据本发明一个具体实施例的智能网联车辆系统的控制方法的流程示意图。FIG. 6 is a schematic flowchart of a control method of an intelligent networked vehicle system according to a specific embodiment of the present invention.
具体实施方式Detailed ways
下面详细描述本发明的实施例,所述实施例的示例在附图中示出,其中自始至终相同或类似的标号表示相同或类似的元件或具有相同或类似功能的元件。下面通过参考附图描述的实施例是示例性的,旨在用于解释本发明,而不能理解为对本发明的限制。The following describes in detail the embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein the same or similar reference numerals refer to the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary, and are intended to explain the present invention and should not be construed as limiting the present invention.
下面参考附图描述本发明实施例的智能穿戴设备和智能网联车辆系统的控制方法。The following describes the control method of the smart wearable device and the smart networked vehicle system according to the embodiments of the present invention with reference to the accompanying drawings.
图1为根据本发明实施例的智能网联车辆系统的智能穿戴设备的方框示意图。FIG. 1 is a schematic block diagram of a smart wearable device of an intelligent networked vehicle system according to an embodiment of the present invention.
本发明实施例提出了一种应用于智能网联车辆系统的智能穿戴设备1000,如图1所示,智能穿戴设备1000包括主设备模组10、从设备模组20和控制模组30。An embodiment of the present invention proposes a smart wearable device 1000 applied to an intelligent networked vehicle system. As shown in FIG. 1 , the smart wearable device 1000 includes a master device module 10 , a slave device module 20 and a control module 30 .
具体地,控制模组30分别与主设备模组10和从设备模组20相连,其中,主设备模组10用于监测驾驶员的行为信息和生理信息,并将驾驶员的行为信息和生理信息发送给控制模组30;从设备模组20用于监测乘客的生理信息和位置信息,并将乘客的生理信息和位置信息发送给控制模组30;控制模组30用于根据驾驶员的生理信息确定驾驶员的驾驶状态,并根据驾驶员的驾驶状态确定车辆状态信息存在危险因素时发出告警信息,以及通过与车辆进行通信以对车辆进行主动介入控制;控制模组30还用于,根据驾驶员的行为信息确定驾驶员的操作指令,并根据驾驶员的操作指令通过与车辆进行通信以对车辆进行驾驶操作控制;控制模组30还用于,根据乘客的生理信息和位置信息,通过与车辆进行通信以对车辆进行主动介入控制。Specifically, the control module 30 is respectively connected with the master device module 10 and the slave device module 20, wherein the master device module 10 is used to monitor the driver's behavior information and physiological information, and combine the driver's behavior information and physiological information. The information is sent to the control module 30; the slave device module 20 is used to monitor the passenger's physiological information and position information, and send the passenger's physiological information and position information to the control module 30; the control module 30 is used to monitor the passenger's physiological information and position information according to the driver's The physiological information determines the driving state of the driver, and according to the driving state of the driver, it is determined that the vehicle state information issues an alarm message when there is a risk factor, and the vehicle is actively intervened and controlled by communicating with the vehicle; the control module 30 is also used for: Determine the driver's operation instruction according to the driver's behavior information, and communicate with the vehicle to control the vehicle's driving operation according to the driver's operation instruction; the control module 30 is also used for, according to the passenger's physiological information and position information, Active intervention control of the vehicle by communicating with the vehicle.
可选地,智能网联车辆系统可包括AI语音助手系统、座舱环境调节系统、主机功能交互系统和界面信息交互系统等,主设备模组10和从设备模组20可以为集成有NFC、蓝牙、WIFI、陀螺仪、屏幕、移动网络、心率血压健康监测和震动等模块的车联手环或手表,且主设备模组10和从设备模组20之间具有联动功能。Optionally, the intelligent networked vehicle system may include an AI voice assistant system, a cockpit environment adjustment system, a host function interaction system and an interface information interaction system, etc. The master device module 10 and the slave device module 20 may be integrated with NFC, Bluetooth, etc. , WIFI, gyroscope, screen, mobile network, heart rate, blood pressure, health monitoring, vibration and other modules of the car band or watch, and the main device module 10 and the slave device module 20 have linkage function.
应理解的是,在本发明的实施例中,控制模组30可根据主设备模组10反馈的驾驶员的行为信息和生理信息,确定驾驶员的驾驶状态或驾驶员的操作指令,以便于根据驾驶员的驾驶状态确定车辆状态信息存在危险因素时发出告警信息,以及通过与车辆进行通信以对车辆进行主动介入控制,或者,根据驾驶员的操作指令通过与车辆进行通信以对车辆进行驾驶操作控制,以及可根据从设备模组20反馈的乘客的生理信息和位置信息,通过与车辆进行通信以对车辆进行主动介入控制。由此,增强智能穿戴设备1000与智能网联车辆的联动性,同时,提高车内HMI交互体验。It should be understood that, in the embodiment of the present invention, the control module 30 may determine the driving state of the driver or the operation instruction of the driver according to the behavior information and physiological information of the driver fed back by the main equipment module 10, so as to facilitate the operation of the driver. According to the driving state of the driver, when it is determined that the vehicle state information has a dangerous factor, an alarm message is issued, and the vehicle is actively intervened and controlled by communicating with the vehicle, or the vehicle is driven by communicating with the vehicle according to the driver's operating instructions. Operation control, and active intervention control of the vehicle by communicating with the vehicle based on the occupant's physiological information and position information fed back from the device module 20 . Thereby, the linkage between the smart wearable device 1000 and the smart connected vehicle is enhanced, and at the same time, the HMI interaction experience in the vehicle is improved.
下面结合本发明的多个具体实施例,对本发明实施例的智能穿戴设备1000的具体应用场景进行相应的说明。In the following, specific application scenarios of the smart wearable device 1000 according to the embodiment of the present invention will be described correspondingly with reference to multiple specific embodiments of the present invention.
进一步地,驾驶员的行为信息包括手势行为和语音行为,其中,控制模组30还用于根据手势行为进行手势判定,并在确定手势行为为有效功能控制手势时,进一步判断有效功能控制手势是否为开启语音识别手势,如果是,则确定语音行为对应的语音指令,并通过与车辆进行通信以将语音指令发送给车辆,以便对车辆进行语音控制;如果否,则确定有效功能控制手势对应的控制指令,并通过与车辆进行通信以将控制指令发送给车辆,以便对车辆进行手势控制。Further, the behavior information of the driver includes gesture behavior and voice behavior, wherein, the control module 30 is also used to perform gesture judgment according to the gesture behavior, and when determining that the gesture behavior is an effective function control gesture, it is further judged whether the effective function control gesture is In order to enable the voice recognition gesture, if yes, determine the voice command corresponding to the voice behavior, and communicate with the vehicle to send the voice command to the vehicle, so as to perform voice control on the vehicle; if not, determine the corresponding function control gesture. Control commands, and communicate with the vehicle to send the control commands to the vehicle for gesture control of the vehicle.
也就是说,当确定手势行为为有效功能控制手势,且为开启语音识别手势时,确定语音行为对应的语音指令,并通过与车辆进行通信以将语音指令发送给车辆,以便对车辆进行语音控制,当确定手势行为为有效功能控制手势,且非开启语音识别手势时,确定有效功能控制手势对应的控制指令,并通过与车辆进行通信以将控制指令发送给车辆,以便对车辆进行手势控制。That is to say, when it is determined that the gesture behavior is an effective function control gesture and is a gesture for enabling voice recognition, the voice command corresponding to the voice behavior is determined, and the voice command is sent to the vehicle by communicating with the vehicle, so as to perform voice control on the vehicle , when it is determined that the gesture behavior is an effective function control gesture and the voice recognition gesture is not enabled, the control instruction corresponding to the effective function control gesture is determined, and the control instruction is sent to the vehicle by communicating with the vehicle, so as to perform gesture control on the vehicle.
举例而言,智能穿戴设备1000可通过多种常规手势交互(上下左右滑动、画圆和画勾/叉等),做出执行手势,且在执行手势时,无需将手放置在特定摄像头范围(可通过陀螺仪或重力传感器实现手势识别)如:下一首歌,暂停歌曲等,另外,主设备模组10可具备智能降噪收音模块,用于结合开启语音识别手势和语音指令,实现对车辆的语音控制,做到全场景语音免唤醒使用前述AI语音助手。For example, the smart wearable device 1000 can interact with various conventional gestures (swipe up, down, left and right, draw a circle, and draw a tick/cross, etc.) to perform gestures, and when performing gestures, there is no need to place the hand in a specific camera range ( Gesture recognition can be achieved through gyroscope or gravity sensor) such as: next song, pause song, etc. In addition, the main device module 10 can be equipped with an intelligent noise reduction radio module, which is used to combine voice recognition gestures and voice commands to achieve correct The voice control of the vehicle enables the use of the aforementioned AI voice assistant for full-scene voice without wake-up.
可选地,用户可建立并自定义特殊的快捷手势交互,例如,手腕翻转、画圈敲击车联手环或者手表某个区域,以完成便捷的接打电话或者开关床,空调等车载设备,或者,佩戴手表反转手腕(通过陀螺仪、重力传感器实现手势识别)保持3S,以在行车中拒绝来电,避免来电骚扰,确保行车的安全驾驶,或者,连续敲击环带或表盘,以快速切换车内情景模式或使用某项用户自定义的功能。Optionally, users can create and customize special shortcut gesture interactions, such as flipping the wrist, tapping a circle on the car band or a certain area of the watch, so as to conveniently answer calls or switch on and off the bed, air conditioners and other in-vehicle devices. Or, wear the watch to invert the wrist (use the gyroscope and gravity sensor to realize gesture recognition) and keep it for 3S to reject the incoming call while driving, avoid the harassment of incoming calls, and ensure the safe driving of the traffic, or tap the ring band or dial continuously to quickly Switch between in-car profiles or use a user-defined function.
进一步地,驾驶员的生理信息包括驾驶员情绪信息,其中,控制模组30还用于根据驾驶员情绪信息判断驾驶员的情绪信息指标是否异常,并在驾驶员的情绪信息指标异常时判断车辆状态信息是否存在危险驾驶行为数据,如果是,则对驾驶员发出一级警报强提醒信息,并生成第一车内环境调节指令,以及通过与车辆进行通信以将第一车内环境调节指令发送给车辆,以便车辆根据第一车内环境调节指令进行车内环境调节;如果否,则对驾驶员发出二级警报弱提醒信息。Further, the physiological information of the driver includes the driver's emotional information, wherein the control module 30 is further configured to judge whether the driver's emotional information index is abnormal according to the driver's emotional information, and to determine whether the driver's emotional information index is abnormal or not. Whether there is any dangerous driving behavior data in the status information, if so, a first-level alarm and strong reminder information will be issued to the driver, and the first in-vehicle environment adjustment command will be generated, and the first in-vehicle environment adjustment command will be sent by communicating with the vehicle. To the vehicle, so that the vehicle can adjust the interior environment according to the first interior environment adjustment instruction; if not, send out a secondary alarm weak reminder message to the driver.
也就是说,当根据驾驶员情绪信息判断驾驶员的情绪信息指标异常,且判断车辆状态信息存在危险驾驶行为数据时,对驾驶员发出一级警报强提醒信息,并生成第一车内环境调节指令,以及通过与车辆进行通信以将第一车内环境调节指令发送给车辆,以便车辆根据第一车内环境调节指令进行车内环境调节,否则,对驾驶员发出二级警报弱提醒信息。That is to say, when it is judged that the driver's emotional information index is abnormal according to the driver's emotional information, and it is judged that there is dangerous driving behavior data in the vehicle state information, a first-level alarm strong reminder information is issued to the driver, and the first in-vehicle environment adjustment is generated. and send the first in-vehicle environment adjustment instruction to the vehicle by communicating with the vehicle, so that the vehicle can adjust the in-vehicle environment according to the first in-vehicle environment adjustment instruction, otherwise, a secondary alarm weak reminder message is issued to the driver.
举例而言,在驾驶员佩戴主设备模组10驾驶车辆过程中,若根据驾驶员情绪信息判断驾驶员的情绪信息指标异常,且判断车辆状态信息存在危险驾驶行为数据,例如,驾驶员心率异常,认为驾驶员情绪处于亢奋、烦躁或愤怒状态,且车辆多次进行加速/减速和/或车辆多次进行转向和/或驾驶员疲劳驾驶时,可控制主设备模组10对驾驶员发出一级警报强提醒信息,例如,震动提醒和/或语音提醒,提示驾驶员安全驾驶,并生成第一车内环境调节指令,以及通过与车辆进行通信以将第一车内环境调节指令发送给车辆,以便车辆根据第一车内环境调节指令进行车内环境调节,例如,自动调节车内氛围灯、空调器和香氛等,同时,播放舒缓音乐,平复驾驶员情绪,确保车辆行驶安全。For example, when the driver wears the main device module 10 to drive the vehicle, if the driver's emotional information index is determined to be abnormal according to the driver's emotional information, and it is determined that the vehicle state information contains dangerous driving behavior data, for example, the driver's heart rate is abnormal. , it is considered that the driver is in a state of excitement, irritability or anger, and the vehicle accelerates/decelerates many times and/or the vehicle turns many times and/or the driver is fatigued, the main device module 10 can be controlled to issue a message to the driver. Level alarm Strong reminder information, such as vibration reminder and/or voice reminder, prompts the driver to drive safely, and generates a first in-vehicle environment adjustment command, and communicates with the vehicle to send the first in-vehicle environment adjustment command to the vehicle , so that the vehicle can adjust the in-vehicle environment according to the first in-vehicle environment adjustment command, for example, automatically adjust the ambient light, air conditioner and fragrance in the car, and at the same time, play soothing music to calm the driver's emotions and ensure the safety of the vehicle.
以及,若根据驾驶员情绪信息判断驾驶员的情绪信息指标无异常,或者,判断车辆状态信息未存在危险驾驶行为数据,则对驾驶员发出二级警报弱提醒信息,例如,给出相应的情绪保持建议或安全行驶建议,从而,维持驾驶员的情绪稳定和驾驶安全性。And, if it is judged that the driver's emotional information index is normal according to the driver's emotional information, or that there is no dangerous driving behavior data in the vehicle state information, a secondary alarm weak reminder information is issued to the driver, for example, a corresponding emotion is given. Maintain the advice or safe driving advice, thereby maintaining the driver's emotional stability and driving safety.
进一步地,驾驶员的生理信息包括驾驶员体征信息,其中,控制模组30还用于根据驾驶员体征信息判断驾驶员的体征信息指标是否异常,并在驾驶员的体征信息指标异常时判断车辆状态信息是否存在行车危险数据,如果是,则对驾驶员发出一级警报强提醒信息,并生成第二车内环境调节指令,以及通过与车辆进行通信以将第二车内环境调节指令发送给车辆,以便车辆根据第二车内环境调节指令进行车内环境调节,同时主动触发车辆的辅助驾驶功能;如果否,则对驾驶员发出二级警报健康提醒信息。Further, the physiological information of the driver includes the driver's physical information, wherein the control module 30 is further configured to determine whether the driver's physical information index is abnormal according to the driver's physical information, and determine whether the driver's physical information index is abnormal when the driver's physical information index is abnormal. Whether there is driving danger data in the status information, if so, a first-level alarm and strong reminder information will be issued to the driver, and a second in-vehicle environment adjustment command will be generated, and the second in-vehicle environment adjustment command will be sent to the vehicle by communicating with the vehicle. vehicle, so that the vehicle adjusts the interior environment according to the second interior environment adjustment instruction, and at the same time actively triggers the assisted driving function of the vehicle; if not, a second-level alarm health reminder information is issued to the driver.
也就是说,当根据驾驶员体征信息判断驾驶员的体征信息指标异常,且判断车辆状态信息存在行车危险数据时,对驾驶员发出一级警报强提醒信息,并生成第二车内环境调节指令,以及通过与车辆进行通信以将第二车内环境调节指令发送给车辆,以便车辆根据第二车内环境调节指令进行车内环境调节,同时主动触发车辆的辅助驾驶功能,否则,对驾驶员发出二级警报健康提醒信息。That is to say, when it is judged that the driver's sign information index is abnormal according to the driver's sign information, and the vehicle status information is judged to have driving danger data, a first-level alarm and strong reminder information are issued to the driver, and a second in-vehicle environment adjustment instruction is generated. , and by communicating with the vehicle to send the second in-vehicle environment adjustment instruction to the vehicle, so that the vehicle can adjust the in-vehicle environment according to the second in-vehicle environment adjustment instruction, and at the same time actively trigger the assisted driving function of the vehicle, otherwise, the driver A secondary alert health alert message is issued.
举例而言,在驾驶员佩戴主设备模组10运动后上车立即开启低温空调制冷,若根据驾驶员体征信息判断驾驶员的体征信息指标异常,且判断车辆状态信息存在危险驾驶行为数据时,例如,用户体温偏高,不适于处于温差较大的环境,且车辆多次进行加速/减速和/或车辆多次进行转向和/或驾驶员疲劳驾驶时,可控制主设备模组10对驾驶员发出一级警报强提醒信息,例如,震动提醒和/或语音提醒,提示驾驶员安全驾驶,并生成第二车内环境调节指令,以及通过与车辆进行通信以将第二车内环境调节指令发送给车辆,以便车辆根据第二车内环境调节指令进行车内环境调节,同时主动触发车辆的辅助驾驶功能,例如,将空调调整至适宜温度和风速,主动打开座椅通风,同时辅助驾驶员进行车辆驾驶,确保行车安全。For example, after the driver wears the main equipment module 10 for exercise, the low-temperature air conditioner is turned on immediately after getting in the car. If the driver's physical information index is determined to be abnormal according to the driver's physical information, and it is determined that the vehicle state information contains dangerous driving behavior data, For example, when the user's body temperature is too high, it is not suitable to be in an environment with large temperature difference, and the vehicle accelerates/decelerates many times and/or the vehicle turns many times and/or the driver is fatigued, the main device module 10 can be controlled to drive The driver sends out a first-level alarm and strong reminder information, for example, a vibration reminder and/or a voice reminder, prompts the driver to drive safely, and generates a second in-vehicle environment adjustment command, and communicates with the vehicle to send the second in-vehicle environment adjustment command. Sent to the vehicle, so that the vehicle can adjust the interior environment according to the second interior environment adjustment command, and at the same time actively trigger the assisted driving functions of the vehicle, for example, adjust the air conditioner to a suitable temperature and wind speed, actively open the seat ventilation, and assist the driver at the same time Drive the vehicle to ensure driving safety.
以及,若根据驾驶员体征信息判断驾驶员的体征信息指标无异常,或者,判断车辆状态信息未存在危险驾驶行为数据,则对驾驶员发出二级警报弱提醒信息,例如,给出相应的温度调节建议,从而,保证驾驶员的健康。And, if it is judged that the driver's physical information index is normal according to the driver's physical information, or that there is no dangerous driving behavior data in the vehicle state information, a second-level alarm weak reminder information is issued to the driver, for example, the corresponding temperature is given. Adjustment recommendations, thus, to ensure the health of the driver.
进一步地,控制模组30还用于根据乘客的位置信息确定乘客处于车内时,判断车辆是否处于行车状态,其中,如果是,则通过与车辆进行通信以将乘客的位置信息发送给车辆,以便车辆执行对应车门童锁的开关控制及对应座位区域的车内环境调节;如果否,则在确定车辆处于驻车锁定状态时控制主设备模组10进行一级警报强提醒,同时根据乘客的生理信息生成第三车内环境调节指令,以及通过与车辆进行通信以将第三车内环境调节指令发送给车辆,以便车辆根据第三车内环境调节指令进行车内环境调节。Further, the control module 30 is further configured to determine whether the vehicle is in a driving state when the passenger is in the vehicle according to the position information of the passenger, wherein, if it is, the position information of the passenger is sent to the vehicle by communicating with the vehicle, In order for the vehicle to perform the switch control corresponding to the door child lock and the in-vehicle environment adjustment corresponding to the seat area; if not, control the main equipment module 10 to perform a first-level alarm strong reminder when it is determined that the vehicle is in the parking lock state, and at the same time according to the passenger's The physiological information generates a third in-vehicle environment adjustment instruction, and communicates with the vehicle to transmit the third in-vehicle environment adjustment instruction to the vehicle, so that the vehicle performs in-vehicle environment adjustment according to the third in-vehicle environment adjustment instruction.
也就是说,当根据乘客的位置信息确定乘客处于车内,且判断车辆处于行车状态时,通过与车辆进行通信以将乘客的位置信息发送给车辆,以便车辆执行对应车门童锁的开关控制及对应座位区域的车内环境调节,当根据乘客的位置信息确定乘客处于车内,且在确定车辆处于驻车锁定状态时控制主设备模组10进行一级警报强提醒,同时根据乘客的生理信息生成第三车内环境调节指令,以及通过与车辆进行通信以将第三车内环境调节指令发送给车辆,以便车辆根据第三车内环境调节指令进行车内环境调节。That is to say, when it is determined that the passenger is in the car according to the position information of the passenger, and it is determined that the vehicle is in a driving state, the position information of the passenger is sent to the vehicle by communicating with the vehicle, so that the vehicle can execute the switch control and control of the child lock corresponding to the door. Corresponding to the in-vehicle environment adjustment of the seating area, when it is determined that the passenger is in the car according to the passenger's position information, and when it is determined that the vehicle is in the parking lock state, the main equipment module 10 is controlled to perform a first-level alarm strong reminder, and at the same time according to the passenger's physiological information A third in-vehicle environment adjustment instruction is generated, and the third in-vehicle environment adjustment instruction is sent to the vehicle by communicating with the vehicle, so that the vehicle performs in-vehicle environment adjustment according to the third in-vehicle environment adjustment instruction.
举例而言,当乘客佩戴从设备模组20,并根据乘客的位置信息确定乘客处于车内,且判断车辆处于行车状态时,可根据乘客的位置信息,执行对应车门童锁的自动开启,避免儿童意外打开车门,以及对应座位区域的车内环境调节,例如,当识别到乘客属于睡眠状态,则可将对应座位区域的空调口风量和风向进行自动调节,并降低对应座位区域的音响声源系统音量大小。For example, when the passenger wears the slave device module 20, and determines that the passenger is in the vehicle according to the passenger's position information, and judges that the vehicle is in a driving state, the corresponding door child lock can be automatically opened according to the passenger's position information to avoid Children accidentally open the car door and adjust the interior environment of the corresponding seat area. For example, when it is recognized that the passenger is in a sleeping state, the air volume and direction of the air conditioner in the corresponding seat area can be automatically adjusted, and the sound source of the corresponding seat area can be reduced. System volume level.
以及,当乘客佩戴从设备模组20,并根据乘客的位置信息确定乘客处于车内,且确定车辆处于驻车锁定状态时,控制主设备模组10进行一级警报强提醒,以提醒用户有乘客滞留在车内,同时根据乘客的生理信息生成第三车内环境调节指令,以及通过与车辆进行通信以将第三车内环境调节指令发送给车辆,以便车辆根据第三车内环境调节指令进行车内环境调节,例如,乘客可通过从设备模组20一键开启SOS模式,车辆车窗解锁变为通风模式,同时,车辆持续开启双闪灯,或者,根据乘客的生理信息判断乘客体征信息指标异常时,直接开启SOS模式。And, when the passenger wears the slave device module 20, and determines that the passenger is in the car according to the passenger's position information, and determines that the vehicle is in the parking lock state, the master device module 10 is controlled to perform a first-level alarm strong reminder to remind the user that there is a The passenger stays in the vehicle, while generating a third in-vehicle environment adjustment instruction according to the passenger's physiological information, and by communicating with the vehicle to send the third in-vehicle environment adjustment instruction to the vehicle, so that the vehicle can adjust the instruction according to the third in-vehicle environment. To adjust the in-vehicle environment, for example, passengers can turn on the SOS mode with one key from the device module 20, the vehicle windows are unlocked and changed to the ventilation mode, and at the same time, the vehicle continues to turn on the double flashing lights, or, according to the passenger's physiological information, determine the passenger's physical signs When the information indicator is abnormal, directly enable the SOS mode.
综上,根据本发明实施例的智能穿戴设备,通过主设备模组监测驾驶员的行为信息和生理信息,并将驾驶员的行为信息和生理信息发送给控制模组,并通过从设备模组监测乘客的生理信息和位置信息,并将乘客的生理信息和位置信息发送给控制模组,以及通过控制模组根据驾驶员的生理信息确定驾驶员的驾驶状态,并根据驾驶员的驾驶状态确定车辆状态信息存在危险因素时发出告警信息,以及通过与车辆进行通信以对车辆进行主动介入控制,或者,根据驾驶员的行为信息确定驾驶员的操作指令,并根据驾驶员的操作指令通过与车辆进行通信以对车辆进行驾驶操作控制,或者,根据乘客的生理信息和位置信息,通过与车辆进行通信以对车辆进行主动介入控制。由此,增强智能穿戴设备与智能网联车辆的联动性,同时,提高车内HMI交互体验。To sum up, according to the smart wearable device of the embodiment of the present invention, the driver's behavior information and physiological information are monitored through the master device module, and the driver's behavior information and physiological information are sent to the control module, and the slave device module is used to monitor the driver's behavior information and physiological information. Monitor the passenger's physiological information and position information, and send the passenger's physiological information and position information to the control module, and determine the driver's driving state according to the driver's physiological information through the control module, and determine the driver's driving state according to the driver's driving state. When there is a danger factor in the vehicle status information, the alarm information is issued, and the vehicle is actively intervened and controlled by communicating with the vehicle. Communication is performed to control the driving operation of the vehicle, or, based on the occupant's physiological information and location information, to perform active intervention control of the vehicle by communicating with the vehicle. As a result, the linkage between smart wearable devices and smart connected vehicles is enhanced, and at the same time, the HMI interaction experience in the car is improved.
图2为根据本发明实施例的智能网联车辆系统的控制方法的流程示意图。FIG. 2 is a schematic flowchart of a control method of an intelligent networked vehicle system according to an embodiment of the present invention.
本发明实施例还提出一种智能网联车辆系统的控制方法,其中,智能网联车辆系统包括如前述本发明实施例的智能穿戴设备1000,如图2所示,控制方法包括以下步骤:An embodiment of the present invention also provides a control method for an intelligent networked vehicle system, wherein the intelligent networked vehicle system includes the smart wearable device 1000 according to the aforementioned embodiment of the present invention. As shown in FIG. 2 , the control method includes the following steps:
S101,通过主设备模组监测驾驶员的行为信息和生理信息,并通过从设备模组监测乘客的生理信息和位置信息。S101, monitor the driver's behavior information and physiological information through the master device module, and monitor the passenger's physiological information and position information through the slave device module.
S1021,根据驾驶员的生理信息确定驾驶员的驾驶状态,并根据驾驶员的驾驶状态确定车辆状态信息存在危险因素时发出告警信息,以及通过与车辆进行通信以对车辆进行主动介入控制。S1021 , determining the driving state of the driver according to the driver's physiological information, and sending out warning information when it is determined that the vehicle state information has a risk factor according to the driving state of the driver, and actively intervening and controlling the vehicle by communicating with the vehicle.
S1022,根据驾驶员的行为信息确定驾驶员的操作指令,并根据驾驶员的操作指令通过与车辆进行通信以对车辆进行驾驶操作控制。S1022: Determine the driver's operation instruction according to the driver's behavior information, and perform driving operation control on the vehicle by communicating with the vehicle according to the driver's operation instruction.
S1023,根据乘客的生理信息和位置信息,通过与车辆进行通信以对车辆进行主动介入控制。S1023, according to the physiological information and position information of the passenger, perform active intervention control on the vehicle by communicating with the vehicle.
进一步地,驾驶员的行为信息包括手势行为和语音行为,其中,如图3所示,根据驾驶员的行为信息确定驾驶员的操作指令,并根据驾驶员的操作指令通过与车辆进行通信以对车辆进行驾驶操作控制,包括:Further, the behavior information of the driver includes gesture behavior and voice behavior, wherein, as shown in FIG. 3 , the operation instruction of the driver is determined according to the behavior information of the driver, and the communication with the vehicle is performed according to the operation instruction of the driver. The vehicle performs driving operation controls, including:
S201,根据手势行为进行手势判定,并在确定手势行为为有效功能控制手势时,进一步判断有效功能控制手势是否为开启语音识别手势。S201: Perform gesture determination according to the gesture behavior, and when it is determined that the gesture behavior is an effective function control gesture, further determine whether the effective function control gesture is a gesture for enabling speech recognition.
S202,如果是,则确定语音行为对应的语音指令,并通过与车辆进行通信以将语音指令发送给车辆,以便对车辆进行语音控制。S202, if yes, determine a voice command corresponding to the voice behavior, and communicate with the vehicle to send the voice command to the vehicle, so as to perform voice control on the vehicle.
S203,如果否,则确定有效功能控制手势对应的控制指令,并通过与车辆进行通信以将控制指令发送给车辆,以便对车辆进行手势控制。S203, if not, determine the control instruction corresponding to the effective function control gesture, and communicate with the vehicle to send the control instruction to the vehicle, so as to perform gesture control on the vehicle.
进一步地,驾驶员的生理信息包括驾驶员情绪信息,其中,如图4所示,根据驾驶员的生理信息确定驾驶员的驾驶状态,并根据驾驶员的驾驶状态确定车辆状态信息存在危险因素时发出告警信息,以及通过与车辆进行通信以对车辆进行主动介入控制,包括:Further, the physiological information of the driver includes the emotional information of the driver, wherein, as shown in FIG. 4 , the driving state of the driver is determined according to the physiological information of the driver, and when the vehicle state information is determined according to the driving state of the driver when there is a risk factor Issue alerts and communicate with the vehicle for active intervention control, including:
S301,根据驾驶员情绪信息判断驾驶员的情绪信息指标是否异常,并在驾驶员的情绪信息指标异常时判断车辆状态信息是否存在危险驾驶行为数据。S301: Determine whether the driver's emotional information index is abnormal according to the driver's emotional information, and determine whether the vehicle state information contains dangerous driving behavior data when the driver's emotional information indicator is abnormal.
S302,如果是,则对驾驶员发出一级警报强提醒信息,并生成第一车内环境调节指令,以及通过与车辆进行通信以将第一车内环境调节指令发送给车辆,以便车辆根据第一车内环境调节指令进行车内环境调节。S302, if yes, send out a first-level alarm strong reminder information to the driver, generate a first in-vehicle environment adjustment instruction, and communicate with the vehicle to send the first in-vehicle environment adjustment instruction to the vehicle, so that the vehicle can adjust according to the first in-vehicle environment adjustment instruction. An in-vehicle environment adjustment command performs in-vehicle environment adjustment.
S303,如果否,则对驾驶员发出二级警报弱提醒信息。S303, if not, send out a second-level alarm weak reminder information to the driver.
进一步地,驾驶员的生理信息包括驾驶员体征信息,其中,如图5所示,根据驾驶员的生理信息确定驾驶员的驾驶状态,并根据驾驶员的驾驶状态确定车辆状态信息存在危险因素时发出告警信息,以及通过与车辆进行通信以对车辆进行主动介入控制,包括:Further, the driver's physiological information includes the driver's physical information, wherein, as shown in Figure 5, the driver's driving state is determined according to the driver's physiological information, and the vehicle state information is determined according to the driver's driving state when there is a risk factor. Issue alerts and communicate with the vehicle for active intervention control, including:
S401,根据驾驶员体征信息判断驾驶员的体征信息指标是否异常,并在驾驶员的体征信息指标异常时判断车辆状态信息是否存在行车危险数据。S401: Determine whether the driver's physical information index is abnormal according to the driver's physical information, and determine whether the vehicle state information has driving danger data when the driver's physical information index is abnormal.
S402,如果是,则对驾驶员发出一级警报强提醒信息,并生成第二车内环境调节指令,以及通过与车辆进行通信以将第二车内环境调节指令发送给车辆,以便车辆根据第二车内环境调节指令进行车内环境调节,同时主动触发车辆的辅助驾驶功能。S402, if yes, send out a first-level alarm strong reminder information to the driver, and generate a second in-vehicle environment adjustment instruction, and communicate with the vehicle to send the second in-vehicle environment adjustment instruction to the vehicle, so that the vehicle can adjust according to the first in-vehicle environment adjustment instruction. The second in-vehicle environment adjustment command adjusts the in-vehicle environment, and at the same time actively triggers the assisted driving function of the vehicle.
S403,如果否,则对驾驶员发出二级警报健康提醒信息。S403 , if not, send out a second-level alarm health reminder information to the driver.
进一步地,如图6所示,根据乘客的生理信息和位置信息,通过与车辆进行通信以对车辆进行主动介入控制,包括:Further, as shown in FIG. 6 , according to the physiological information and position information of the passenger, the vehicle is actively intervened and controlled by communicating with the vehicle, including:
S501,根据乘客的位置信息确定乘客处于车内时,判断车辆是否处于行车状态。S501 , when it is determined that the passenger is in the vehicle according to the position information of the passenger, determine whether the vehicle is in a driving state.
S502,如果是,则通过与车辆进行通信以将乘客的位置信息发送给车辆,以便车辆执行对应车门童锁的开关控制及对应座位区域的车内环境调节。S502, if yes, send the position information of the passenger to the vehicle by communicating with the vehicle, so that the vehicle can perform switch control corresponding to the child lock of the vehicle door and in-vehicle environment adjustment corresponding to the seat area.
S503,如果否,则在确定车辆处于驻车锁定状态时控制主设备模组进行一级警报强提醒,同时根据乘客的生理信息生成第三车内环境调节指令,以及通过与车辆进行通信以将第三车内环境调节指令发送给车辆,以便车辆根据第三车内环境调节指令进行车内环境调节。S503, if no, control the main equipment module to perform a first-level alarm strong reminder when it is determined that the vehicle is in the parking lock state, and simultaneously generate a third in-vehicle environment adjustment instruction according to the passenger's physiological information, and communicate with the vehicle to The third in-vehicle environment adjustment instruction is sent to the vehicle, so that the vehicle adjusts the in-vehicle environment according to the third in-vehicle environment adjustment instruction.
需要说明的是,本发明实施例的智能网联车辆系统的控制方法的具体实施方式与前述本发明实施例的智能穿戴设备1000的具体实施方式一一对应,在此不再赘述。It should be noted that the specific implementations of the control method for the intelligent networked vehicle system in the embodiment of the present invention correspond to the specific implementations of the smart wearable device 1000 in the foregoing embodiment of the present invention, and are not repeated here.
综上,根据本发明实施例的智能网联车辆系统的控制方法,通过主设备模组监测驾驶员的行为信息和生理信息,并通过从设备模组监测乘客的生理信息和位置信息,进而,根据驾驶员的生理信息确定驾驶员的驾驶状态,并根据驾驶员的驾驶状态确定车辆状态信息存在危险因素时发出告警信息,以及通过与车辆进行通信以对车辆进行主动介入控制,或者,根据驾驶员的行为信息确定驾驶员的操作指令,并根据驾驶员的操作指令通过与车辆进行通信以对车辆进行驾驶操作控制,或者,根据乘客的生理信息和位置信息,通过与车辆进行通信以对车辆进行主动介入控制。由此。增强智能穿戴设备与智能网联车辆的联动性,同时,提高车内HMI交互体验。To sum up, according to the control method of the intelligent networked vehicle system according to the embodiment of the present invention, the driver's behavior information and physiological information are monitored through the master device module, and the passenger's physiological information and position information are monitored through the slave device module, and further, Determine the driver's driving state according to the driver's physiological information, and issue an alarm when there are dangerous factors in the vehicle state information according to the driver's driving state, and actively intervene and control the vehicle by communicating with the vehicle, or, according to the driving state The driver's behavior information determines the driver's operation instruction, and communicates with the vehicle to control the vehicle's driving operation according to the driver's operation instruction, or, according to the passenger's physiological information and location information, communicates with the vehicle to control the vehicle. Active intervention control. thus. Enhance the linkage between smart wearable devices and smart connected vehicles, and at the same time, improve the HMI interaction experience in the car.
需要说明的是,在流程图中表示或在此以其他方式描述的逻辑和/或步骤,例如,可以被认为是用于实现逻辑功能的可执行指令的定序列表,可以具体实现在任何计算机可读介质中,以供指令执行系统、装置或设备(如基于计算机的系统、包括处理器的系统或其他可以从指令执行系统、装置或设备取指令并执行指令的系统)使用,或结合这些指令执行系统、装置或设备而使用。就本说明书而言,"计算机可读介质"可以是任何可以包含、存储、通信、传播或传输程序以供指令执行系统、装置或设备或结合这些指令执行系统、装置或设备而使用的装置。计算机可读介质的更具体的示例(非穷尽性列表)包括以下:具有一个或多个布线的电连接部(电子装置),便携式计算机盘盒(磁装置),随机存取存储器(RAM),只读存储器(ROM),可擦除可编辑只读存储器(EPROM或闪速存储器),光纤装置,以及便携式光盘只读存储器(CDROM)。另外,计算机可读介质甚至可以是可在其上打印所述程序的纸或其他合适的介质,因为可以例如通过对纸或其他介质进行光学扫描,接着进行编辑、解译或必要时以其他合适方式进行处理来以电子方式获得所述程序,然后将其存储在计算机存储器中。It should be noted that the logic and/or steps represented in the flowcharts or otherwise described herein, for example, may be considered as an ordered listing of executable instructions for implementing the logical functions, and may be embodied in any computer readable medium for use by an instruction execution system, apparatus, or device (such as a computer-based system, a system including a processor, or other system that can fetch and execute instructions from an instruction execution system, apparatus, or device), or in combination with these used to execute a system, device or device. For the purposes of this specification, a "computer-readable medium" can be any device that can contain, store, communicate, propagate, or transport the program for use by or in connection with an instruction execution system, apparatus, or apparatus. More specific examples (non-exhaustive list) of computer readable media include the following: electrical connections with one or more wiring (electronic devices), portable computer disk cartridges (magnetic devices), random access memory (RAM), Read Only Memory (ROM), Erasable Editable Read Only Memory (EPROM or Flash Memory), Fiber Optic Devices, and Portable Compact Disc Read Only Memory (CDROM). In addition, the computer readable medium may even be paper or other suitable medium on which the program may be printed, as the paper or other medium may be optically scanned, for example, followed by editing, interpretation, or other suitable medium as necessary process to obtain the program electronically and then store it in computer memory.
应当理解,本发明的各部分可以用硬件、软件、固件或它们的组合来实现。在上述实施方式中,多个步骤或方法可以用存储在存储器中且由合适的指令执行系统执行的软件或固件来实现。例如,如果用硬件来实现,和在另一实施方式中一样,可用本领域公知的下列技术中的任一项或他们的组合来实现:具有用于对数据信号实现逻辑功能的逻辑门电路的离散逻辑电路,具有合适的组合逻辑门电路的专用集成电路,可编程门阵列(PGA),现场可编程门阵列(FPGA)等。It should be understood that various parts of the present invention may be implemented in hardware, software, firmware or a combination thereof. In the above-described embodiments, various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented by any one or a combination of the following techniques known in the art: Discrete logic circuits, application specific integrated circuits with suitable combinational logic gates, Programmable Gate Arrays (PGA), Field Programmable Gate Arrays (FPGA), etc.
在本说明书的描述中,参考术语“一个实施例”、“一些实施例”、“示例”、“具体示例”、或“一些示例”等的描述意指结合该实施例或示例描述的具体特征、结构、材料或者特点包含于本发明的至少一个实施例或示例中。在本说明书中,对上述术语的示意性表述不一定指的是相同的实施例或示例。而且,描述的具体特征、结构、材料或者特点可以在任何的一个或多个实施例或示例中以合适的方式结合。In the description of this specification, description with reference to the terms "one embodiment," "some embodiments," "example," "specific example," or "some examples", etc., mean specific features described in connection with the embodiment or example , structure, material or feature is included in at least one embodiment or example of the present invention. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
在本发明的描述中,需要理解的是,术语“中心”、“纵向”、“横向”、“长度”、“宽度”、“厚度”、“上”、“下”、“前”、“后”、“左”、“右”、“竖直”、“水平”、“顶”、“底”“内”、“外”、“顺时针”、“逆时针”、“轴向”、“径向”、“周向”等指示的方位或位置关系为基于附图所示的方位或位置关系,仅是为了便于描述本发明和简化描述,而不是指示或暗示所指的装置或元件必须具有特定的方位、以特定的方位构造和操作,因此不能理解为对本发明的限制。In the description of the present invention, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "upper", "lower", "front", " Rear, Left, Right, Vertical, Horizontal, Top, Bottom, Inner, Outer, Clockwise, Counterclockwise, Axial, The orientations or positional relationships indicated by "radial direction", "circumferential direction", etc. are based on the orientations or positional relationships shown in the accompanying drawings, which are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying the indicated devices or elements. It must have a specific orientation, be constructed and operate in a specific orientation, and therefore should not be construed as a limitation of the present invention.
此外,术语“第一”、“第二”仅用于描述目的,而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括至少一个该特征。在本发明的描述中,“多个”的含义是至少两个,例如两个,三个等,除非另有明确具体的限定。In addition, the terms "first" and "second" are only used for descriptive purposes, and should not be construed as indicating or implying relative importance or implying the number of indicated technical features. Thus, a feature delimited with "first", "second" may expressly or implicitly include at least one of that feature. In the description of the present invention, "plurality" means at least two, such as two, three, etc., unless otherwise expressly and specifically defined.
在本发明中,除非另有明确的规定和限定,术语“安装”、“相连”、“连接”、“固定”等术语应做广义理解,例如,可以是固定连接,也可以是可拆卸连接,或成一体;可以是机械连接,也可以是电连接;可以是直接相连,也可以通过中间媒介间接相连,可以是两个元件内部的连通或两个元件的相互作用关系,除非另有明确的限定。对于本领域的普通技术人员而言,可以根据具体情况理解上述术语在本发明中的具体含义。In the present invention, unless otherwise expressly specified and limited, the terms "installed", "connected", "connected", "fixed" and other terms should be understood in a broad sense, for example, it may be a fixed connection or a detachable connection , or integrated; it can be a mechanical connection or an electrical connection; it can be directly connected or indirectly connected through an intermediate medium, it can be the internal connection of two elements or the interaction relationship between the two elements, unless otherwise specified limit. For those of ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood according to specific situations.
在本发明中,除非另有明确的规定和限定,第一特征在第二特征“上”或“下”可以是第一和第二特征直接接触,或第一和第二特征通过中间媒介间接接触。而且,第一特征在第二特征“之上”、“上方”和“上面”可是第一特征在第二特征正上方或斜上方,或仅仅表示第一特征水平高度高于第二特征。第一特征在第二特征“之下”、“下方”和“下面”可以是第一特征在第二特征正下方或斜下方,或仅仅表示第一特征水平高度小于第二特征。In the present invention, unless otherwise expressly specified and limited, a first feature "on" or "under" a second feature may be in direct contact between the first and second features, or the first and second features indirectly through an intermediary touch. Also, the first feature being "above", "over" and "above" the second feature may mean that the first feature is directly above or obliquely above the second feature, or simply means that the first feature is level higher than the second feature. The first feature being "below", "below" and "below" the second feature may mean that the first feature is directly below or obliquely below the second feature, or simply means that the first feature has a lower level than the second feature.
尽管上面已经示出和描述了本发明的实施例,可以理解的是,上述实施例是示例性的,不能理解为对本发明的限制,本领域的普通技术人员在本发明的范围内可以对上述实施例进行变化、修改、替换和变型。Although the embodiments of the present invention have been shown and described above, it should be understood that the above-mentioned embodiments are exemplary and should not be construed as limiting the present invention. Embodiments are subject to variations, modifications, substitutions and variations.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011374738.6ACN114633756A (en) | 2020-11-30 | 2020-11-30 | Control method for smart wearable device and smart networked vehicle system |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011374738.6ACN114633756A (en) | 2020-11-30 | 2020-11-30 | Control method for smart wearable device and smart networked vehicle system |
| Publication Number | Publication Date |
|---|---|
| CN114633756Atrue CN114633756A (en) | 2022-06-17 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011374738.6APendingCN114633756A (en) | 2020-11-30 | 2020-11-30 | Control method for smart wearable device and smart networked vehicle system |
| Country | Link |
|---|---|
| CN (1) | CN114633756A (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105235470A (en)* | 2015-09-24 | 2016-01-13 | 惠州华阳通用电子有限公司 | Method and system for controlling vehicle air-conditioning with sleep mode |
| US20160169685A1 (en)* | 2014-12-11 | 2016-06-16 | Hyundai Motor Company | Avn terminal and control method thereof, wearable device and control method thereof, and computer readable recording medium |
| CN105700394A (en)* | 2014-12-12 | 2016-06-22 | 福特全球技术公司 | Vehicle Accessory Operation Based on Motion Tracking |
| WO2017215909A1 (en)* | 2016-06-18 | 2017-12-21 | Audi Ag | Method for controlling at least one motor vehicle component as well as a system comprising a motor vehicle and a wearable device |
| DE102018216180A1 (en)* | 2018-09-21 | 2020-03-26 | Volkswagen Aktiengesellschaft | Method for operating an emergency assistance system for a motor vehicle, emergency assistance system and motor vehicle |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20160169685A1 (en)* | 2014-12-11 | 2016-06-16 | Hyundai Motor Company | Avn terminal and control method thereof, wearable device and control method thereof, and computer readable recording medium |
| CN105700394A (en)* | 2014-12-12 | 2016-06-22 | 福特全球技术公司 | Vehicle Accessory Operation Based on Motion Tracking |
| CN105235470A (en)* | 2015-09-24 | 2016-01-13 | 惠州华阳通用电子有限公司 | Method and system for controlling vehicle air-conditioning with sleep mode |
| WO2017215909A1 (en)* | 2016-06-18 | 2017-12-21 | Audi Ag | Method for controlling at least one motor vehicle component as well as a system comprising a motor vehicle and a wearable device |
| DE102018216180A1 (en)* | 2018-09-21 | 2020-03-26 | Volkswagen Aktiengesellschaft | Method for operating an emergency assistance system for a motor vehicle, emergency assistance system and motor vehicle |
| Publication | Publication Date | Title |
|---|---|---|
| US9457816B2 (en) | Controlling access to an in-vehicle human-machine interface | |
| CN107628033B (en) | Navigation based on occupant alertness | |
| CN108281069B (en) | Driver interaction system for vehicle semi-autonomous mode | |
| US20170217445A1 (en) | System for intelligent passenger-vehicle interactions | |
| WO2019073708A1 (en) | Vehicular driving assistance device | |
| JP6062043B2 (en) | Mobile body state notification device, server device, and mobile body state notification method | |
| CN106161081A (en) | The Vehicular system communicated with wearable device | |
| CN104656503A (en) | Wearable computer in an autonomous vehicle | |
| JPWO2019044427A1 (en) | Support method and support system and support device using it | |
| JP2005062911A (en) | Vehicle controller | |
| CN111976626A (en) | Mode control method, device, vehicle and computer readable storage medium | |
| JP2008282022A (en) | Method and apparatus for improving vehicle driver performance | |
| CN109472253B (en) | Driving safety intelligent reminding method and device, intelligent steering wheel and intelligent bracelet | |
| CN109614001B (en) | A control method, control device and control device for touch operation authority of vehicle screen | |
| KR102699141B1 (en) | Vehicle and method for outputting information | |
| US20210001873A1 (en) | Autonomous vehicle driving configuration based on user profile and remote assistance in autonomous vehicle | |
| KR20180052077A (en) | Interaction method between user and autonomous driving system in fully autonomous driving | |
| CN117429452A (en) | Interactive cockpit control method, device, equipment and storage medium | |
| US9815371B2 (en) | Information providing apparatus for vehicle | |
| WO2020079755A1 (en) | Information providing device and information providing method | |
| CN114633756A (en) | Control method for smart wearable device and smart networked vehicle system | |
| CN107395660A (en) | Communication connecting method, device, end user device, system and motor vehicle | |
| KR102777971B1 (en) | Control system and method using gesture in vehicle | |
| CN115116260B (en) | Vehicle driving auxiliary control method and device and vehicle | |
| CN117241197A (en) | System and method for hearing impaired drivers |
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication | Application publication date:20220617 |