CN115237246A - A vehicle-mounted gesture control sunroof system based on semantic recognition and its control method - Google Patents

Abstract

Translated fromChinese

本发明公开了一种基于语义识别的车载手势控制天窗系统及其控制方法，属于汽车天窗技术领域，包括：执行系统、手势识别单元、中央控制器和语音采集装置，所述中央控制器分别与执行系统、手势识别单元和语义识别单元电性连接，所述语音采集装置采用车载麦克风，其用于采集用户语音。本发明提供了一种基于神经网络的车载手势控制天窗系统及其控制方法，用手势滑动代替控制按键，用语音采集装置选择控制控制天窗盖板或天窗遮阳帘开关的功能，使驾驶员无需分心即可轻松控制天窗、阅读灯启闭，实现离屏控制，丰富了天窗操作的方式，迎合了年轻消费者越来越追求新颖、时尚的心理，不仅节省了成本，增加了车内空间，而且可以让内饰造型更加美观。

The invention discloses a vehicle-mounted gesture control sunroof system based on semantic recognition and a control method thereof, belonging to the technical field of auto sunroofs. The execution system, the gesture recognition unit and the semantic recognition unit are electrically connected, and the voice collection device adopts a vehicle-mounted microphone, which is used to collect the user's voice. The invention provides a vehicle-mounted gesture control sunroof system based on a neural network and a control method thereof. The gesture sliding is used to replace the control button, and the voice acquisition device is used to select and control the function of the sunroof cover or the sunroof sunshade switch, so that the driver does not need to It can easily control the opening and closing of the sunroof and reading lights, and realize off-screen control, which enriches the operation of the sunroof, and caters to young consumers who are increasingly pursuing novelty and fashion. It not only saves costs, but also increases the interior space. And it can make the interior look more beautiful.

Description

Translated fromChinese

一种基于语义识别的车载手势控制天窗系统及其控制方法A vehicle-mounted gesture control sunroof system based on semantic recognition and its control method

技术领域technical field

本发明公开了一种基于语义识别的车载手势控制天窗系统及其控制方法，属于汽车天窗技术领域。The invention discloses an in-vehicle gesture control sunroof system based on semantic recognition and a control method thereof, belonging to the technical field of automobile sunroofs.

背景技术Background technique

现有的驱动控制系统多通过按键控制器来获取开关天窗盖板和遮阳帘信号，随着时代与科技发展，常规的按键操作已无法满足客户追求新颖、时尚的心理。且目前市面上控制天窗按键、照明灯开关较小，常需要驾驶员在驾车过程中，抬头确认天窗开关按键的位置后操作，难以在观察路况的同时操作天窗，易驾驶分心发生危险，不利于车辆驾驶安全。The existing drive control system mostly uses the button controller to obtain the signal of opening and closing the sunroof cover and the sunshade. With the development of the times and technology, the conventional button operation can no longer satisfy the customer's pursuit of novelty and fashion. In addition, the control sunroof buttons and light switches on the market are relatively small at present, and the driver often needs to look up and confirm the position of the sunroof switch button while driving. It is difficult to operate the sunroof while observing the road conditions. Conducive to vehicle driving safety.

为解决上述存在的问题，目前通过改变按键控制器的位置或者采用触摸屏方式，但控制方式复杂，占用车内空间且增大了成本。In order to solve the above-mentioned problems, currently, the position of the button controller is changed or a touch screen method is adopted, but the control method is complicated, occupies space in the vehicle and increases the cost.

发明内容SUMMARY OF THE INVENTION

本发明的目的在于解决目前市面上控制天窗系统控制方式复杂、占用车内空间且增大了成本的问题，提出了一种基于语义识别的车载手势控制天窗系统及其控制方法。The purpose of the present invention is to solve the problems of complicated control methods, occupying space in the vehicle and increasing the cost of the current market control sunroof system, and proposes a vehicle-mounted gesture control sunroof system based on semantic recognition and a control method thereof.

本发明所要解决的问题是由以下技术方案实现的：The problem to be solved by this invention is realized by the following technical solutions:

一种基于语义识别的车载手势控制天窗系统，包括：执行系统、手势识别单元、中央控制器和语音采集单元，所述中央控制器分别与执行系统、手势识别单元和语义识别单元电性连接，所述语音采集单元采用车载麦克风，其用于采集用户语音。A vehicle-mounted gesture control sunroof system based on semantic recognition, comprising: an execution system, a gesture recognition unit, a central controller and a voice acquisition unit, wherein the central controller is respectively electrically connected with the execution system, the gesture recognition unit and the semantic recognition unit, The voice collecting unit adopts a vehicle-mounted microphone, which is used to collect the user's voice.

优选的是，所述执行系统包括：天窗盖板驱动控制系统和天窗遮阳帘驱动控制系统，Preferably, the execution system includes: a sunroof cover drive control system and a sunroof sunshade drive control system,

优选的是，所述天窗盖板驱动控制系统包括：Preferably, the sunroof cover drive control system includes:

天窗盖板控制单元，用于控制活动天窗盖板开启与关闭；The sunroof cover control unit is used to control the opening and closing of the movable sunroof cover;

天窗盖板驱动单元，用于驱动活动天窗盖板开启与关闭。The sunroof cover drive unit is used to drive the movable sunroof cover to open and close.

优选的是，所述天窗遮阳帘驱动控制系统包括：Preferably, the sunroof sunshade drive control system includes:

天窗遮阳帘控制单元，用于控制活动天窗遮阳帘开启与关闭；The sunroof sunshade control unit is used to control the opening and closing of the movable sunroof sunshade;

天窗遮阳帘驱动单元，用于驱动活动天窗遮阳帘开启与关闭。The sunroof sunshade drive unit is used to drive the movable sunroof sunshade to open and close.

一种基于语义识别的车载手势控制天窗系统的控制方法，所述方法包括：A control method for a vehicle-mounted gesture control sunroof system based on semantic recognition, the method comprising:

通过所述语音采集单元采集用户语音数据并反馈给中央控制器；Collect user voice data through the voice acquisition unit and feed it back to the central controller;

所述中央控制器获取用户语音数据与初始录入信息进行判断是否相符；The central controller determines whether the user voice data is consistent with the initial input information;

若是，则根据所述用户语音数据调取相应的执行系统信号反馈给手势识别单元；If so, call the corresponding execution system signal according to the user voice data and feed it back to the gesture recognition unit;

所述手势识别单元获取手势动作图像信号并反馈给中央控制器；The gesture recognition unit acquires the gesture action image signal and feeds it back to the central controller;

所述中央控制器根据获取手势动作图像信号生成执行指令发送给相应的执行系统。The central controller generates an execution instruction according to the acquired gesture action image signal and sends it to the corresponding execution system.

优选的是，当所述执行系统信号为天窗盖板信号时，所述中央控制器根据获取手势动作图像信号生成天窗盖板执行指令发送给天窗盖板驱动控制系统，所述天窗盖板控制单元接收到天窗盖板执行指令后发送给天窗盖板驱动单元执行相应操作。Preferably, when the execution system signal is a sunroof cover signal, the central controller generates a sunroof cover execution instruction according to the acquired gesture action image signal and sends it to the sunroof cover drive control system, and the sunroof cover control unit After receiving the sunroof cover execution instruction, it is sent to the sunroof cover drive unit to perform corresponding operations.

优选的是，当所述执行系统信号为天窗遮阳帘信号，所述中央控制器根据获取手势动作图像信号生成天窗遮阳帘执行指令发送给天窗遮阳帘驱动控制系统，所述天窗遮阳帘控制单元接收到天窗遮阳帘执行指令后发送给天窗遮阳帘驱动单元执行相应操作。Preferably, when the execution system signal is a sunroof sunshade signal, the central controller generates a sunroof sunshade execution instruction according to the acquired gesture action image signal and sends it to the sunroof sunshade drive control system, and the sunroof sunshade control unit receives After the sunroof sunshade executes the instruction, it is sent to the sunroof sunshade drive unit to perform the corresponding operation.

优选的是，当所述中央控制器将天窗遮阳帘与初始录入信息进行判断不相符时，生成不执行指令反馈给语音采集单元，所述语音采集单元重新采集用户语音数据。Preferably, when the central controller judges that the sunroof sunshade does not match the initial input information, it generates a non-execution instruction and feeds it back to the voice acquisition unit, and the voice acquisition unit re-collects user voice data.

本发明相对于现有而言具有的有益效果：The beneficial effects that the present invention has relative to the existing:

本发明提供了一种基于神经网络的车载手势控制天窗系统及其控制方法，用手势滑动代替控制按键，用语音采集单元选择控制控制天窗盖板或天窗遮阳帘开关的功能，使驾驶员无需分心即可轻松控制天窗、阅读灯启闭，实现离屏控制，丰富了天窗操作的方式，迎合了年轻消费者越来越追求新颖、时尚的心理，不仅节省了成本，增加了车内空间，而且可以让内饰造型更加美观。The invention provides a vehicle-mounted gesture control sunroof system based on a neural network and a control method thereof. The gesture sliding is used to replace the control button, and the voice acquisition unit is used to select and control the function of the sunroof cover or the sunroof sunshade switch, so that the driver does not need to It can easily control the opening and closing of the sunroof and reading lights, and realize off-screen control, which enriches the operation of the sunroof, and caters to young consumers who are increasingly pursuing novelty and fashion. It not only saves costs, but also increases the interior space. And it can make the interior look more beautiful.

附图说明Description of drawings

图1是本发明一种基于神经网络的车载手势控制天窗系统及其控制方法的电气连接图。FIG. 1 is an electrical connection diagram of a vehicle-mounted gesture control sunroof system based on a neural network and a control method thereof of the present invention.

图2是本发明一种基于神经网络的车载手势控制天窗系统及其控制方法的天窗控制手势的示意图。2 is a schematic diagram of the sunroof control gesture of a vehicle-mounted gesture control sunroof system and a control method thereof based on a neural network of the present invention.

图3是本发明一种基于神经网络的车载手势控制天窗系统的中央控制器的电气连接图。3 is an electrical connection diagram of a central controller of a vehicle-mounted gesture-controlled sunroof system based on a neural network of the present invention.

具体实施方式Detailed ways

以下根据附图1-3对本发明做进一步说明：The present invention will be further described below according to accompanying drawings 1-3:

下面将结合附图对本发明的技术方案进行清楚、完整地描述，显然，所描述的实施例是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。The technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are a part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

在本发明的描述中，需要说明的是，术语“中心”、“上”、“下”、“左”、“右”、“竖直”、“水平”、“内”、“外”等指示的方位或位置关系为基于附图所示的方位或位置关系，仅是为了便于描述本发明和简化描述，而不是指示或暗示所指的装置或元件必须具有特定的方位、以特定的方位构造和操作，因此不能理解为对本发明的限制。In the description of the present invention, it should be noted that the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", etc. The indicated orientation or positional relationship is based on the orientation or positional relationship shown in the accompanying drawings, which is only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the indicated device or element must have a specific orientation or a specific orientation. construction and operation, and therefore should not be construed as limiting the invention.

在本发明的描述中，需要说明的是，除非另有明确的规定和限定，术语“安装”、“相连”、“连接”应做广义理解，例如，可以是固定连接，也可以是可拆卸连接，或一体地连接；可以是机械连接，也可以是电连接；可以是直接相连，也可以通过中间媒介间接相连，可以是两个元件内部的连通。对于本领域的普通技术人员而言，可以具体情况理解上述术语在本发明中的具体含义。In the description of the present invention, it should be noted that the terms "installed", "connected" and "connected" should be understood in a broad sense, unless otherwise expressly specified and limited, for example, it may be a fixed connection or a detachable connection Connection, or integral connection; can be mechanical connection, can also be electrical connection; can be directly connected, can also be indirectly connected through an intermediate medium, can be internal communication between two elements. For those of ordinary skill in the art, the specific meanings of the above terms in the present invention can be understood in specific situations.

如图1所示，本发明第一实施例在现有技术的基础上提供了一种基于语义识别的车载手势控制天窗系统，包括：执行系统、手势识别单元、中央控制器和语音采集单元，中央控制器分别与执行系统、手势识别单元和语义识别单元电性连接，语音采集单元采用车载麦克风，其用于采集用户语音。As shown in FIG. 1 , the first embodiment of the present invention provides a vehicle-mounted gesture control sunroof system based on semantic recognition based on the prior art, including: an execution system, a gesture recognition unit, a central controller and a voice acquisition unit, The central controller is electrically connected with the execution system, the gesture recognition unit and the semantic recognition unit, respectively, and the voice acquisition unit adopts a vehicle-mounted microphone, which is used to collect the user's voice.

执行系统包括：天窗盖板驱动控制系统和天窗遮阳帘驱动控制系统，天窗盖板驱动控制系统包括用来控制活动天窗盖板开启与关闭的天窗盖板控制单元和用来驱动活动天窗盖板开启与关闭的天窗盖板驱动单元，天窗盖板控制单元的信号输入端连接神经网络识别单元，天窗盖板控制单元的信号输出端连接所述天窗盖板驱动单元。The execution system includes: a sunroof cover drive control system and a sunroof sunshade drive control system. The sunroof cover drive control system includes a sunroof cover control unit used to control the opening and closing of the movable sunroof cover, and a sunroof cover used to drive the movable sunroof cover to open. With the closed sunroof cover driving unit, the signal input end of the sunroof cover control unit is connected to the neural network identification unit, and the signal output end of the sunroof cover control unit is connected to the sunroof cover driving unit.

天窗遮阳帘驱动控制系统包括用来控制活动天窗遮阳帘开启与关闭的天窗遮阳帘控制单元和用来驱动活动天窗遮阳帘开启与关闭的天窗遮阳帘驱动单元，天窗遮阳帘控制单元的信号输入端连接神经网络识别单元，天窗遮阳帘控制单元的信号输出端连接天窗遮阳帘驱动单元。The sunroof sunshade drive control system includes a sunroof sunshade control unit used to control the opening and closing of the movable sunroof sunshade, a sunroof sunshade drive unit used to drive the sunroof sunshade to open and close, and the signal input terminal of the sunroof sunshade control unit The neural network identification unit is connected, and the signal output end of the sunroof sunshade control unit is connected to the sunroof sunshade drive unit.

手势识别单元基于手势传感器模块，包括电路板，电路板上固定有一个呈十字状的隔离板，隔离板将电路板分割为四个相对的空间，每个空间内设有至少一个红外发光元件和一个可识别并接收红外发光元件发出的光的接收器,位于同一个空间内的红外发光元件中的至少一个的朝向和位于该空间内的接收器的朝向一致；接收器到电路板的最大距离小于红外发光元件到电路板的最大距离；红外发光元件到电路板的最大距离小于隔离板到电路板的最大距离。使用者在挥动手时，手将红外发光元件发出的光反射至接收器处。手在不同的位置，不同的接收器接收到，根据接收器接收到的时间顺序，可以判断使用者的手势动作。为了使手势识别更精准，隔离板的表面上覆盖有反光膜层，且隔离板越远离电路板，厚度越小。以使隔离板隔出的空间呈喇叭口状，使更多的光进入接收器。为避免手势识别错误，手势传感器模块还包括一信号处理模块，信号处理模块连接红外发光元件和接收器。信号处理模块根据接收器的信号变化，判断手势，信号处理模块在识别到某一符合要求的手势后，如三秒内无其它手势出现，视为手势正确，输出信号给天窗玻璃控制单元，否则视为手势无效，并以最后识别出的手势为标准再进行上述判断。从而避免挥手造成的误开闭。The gesture recognition unit is based on the gesture sensor module, including a circuit board, a cross-shaped isolation plate is fixed on the circuit board, the isolation plate divides the circuit board into four opposite spaces, and each space is provided with at least one infrared light-emitting element and A receiver that can identify and receive the light emitted by the infrared light-emitting element, the orientation of at least one of the infrared light-emitting elements located in the same space is the same as the orientation of the receiver located in the space; the maximum distance from the receiver to the circuit board It is less than the maximum distance from the infrared light-emitting element to the circuit board; the maximum distance from the infrared light-emitting element to the circuit board is less than the maximum distance from the isolation board to the circuit board. When the user waves his hand, the hand reflects the light emitted by the infrared light-emitting element to the receiver. The hands are in different positions and received by different receivers. According to the time sequence received by the receivers, the user's gestures can be judged. In order to make gesture recognition more accurate, the surface of the isolation plate is covered with a reflective film layer, and the further away the isolation plate is from the circuit board, the smaller the thickness. In order to make the space separated by the isolation plate in the shape of a bell mouth, more light can enter the receiver. In order to avoid gesture recognition errors, the gesture sensor module further includes a signal processing module, and the signal processing module is connected to the infrared light-emitting element and the receiver. The signal processing module judges the gesture according to the signal change of the receiver. After the signal processing module recognizes a gesture that meets the requirements, if no other gesture appears within three seconds, the gesture is regarded as correct, and the signal is output to the sunroof glass control unit. The gesture is regarded as invalid, and the above judgment is made based on the last recognized gesture. In order to avoid the wrong opening and closing caused by waving.

上面介绍完一种基于语义识别的车载手势控制天窗系统，下面将上面介绍完控制方法，包括：A vehicle-mounted gesture control sunroof system based on semantic recognition has been introduced above, and the control method will be introduced below, including:

步骤S1，通过语音采集单元采集用户语音数据并反馈给中央控制器；Step S1, collecting user voice data through the voice collecting unit and feeding it back to the central controller;

步骤S2，中央控制器获取用户语音数据与初始录入信息进行判断是否相符；Step S2, the central controller obtains the user's voice data and judges whether it is consistent with the initial input information;

是，则根据所述用户语音数据调取相应的执行系统信号反馈给手势识别单元；If yes, then according to the user voice data, the corresponding execution system signal is called and fed back to the gesture recognition unit;

不是，则生成不执行指令反馈给语音采集单元，所述语音采集单元重新采集用户语音数据。If it is not, then generate a no-execution instruction and feed it back to the voice collecting unit, and the voice collecting unit collects the user voice data again.

步骤S3，手势识别单元获取手势动作图像信号并反馈给中央控制器；Step S3, the gesture recognition unit acquires the gesture action image signal and feeds it back to the central controller;

所述中央控制器根据获取手势动作图像信号生成执行指令发送给相应的执行系统。The central controller generates an execution instruction according to the acquired gesture action image signal and sends it to the corresponding execution system.

当上述执行系统信号为天窗盖板信号时，中央控制器根据获取手势动作图像信号生成天窗盖板执行指令发送给天窗盖板驱动控制系统，天窗盖板控制单元接收到天窗盖板执行指令后发送给天窗盖板驱动单元执行相应操作。When the above-mentioned execution system signal is the sunroof cover signal, the central controller generates the sunroof cover execution instruction according to the acquired gesture action image signal and sends it to the sunroof cover drive control system, and the sunroof cover control unit sends the sunroof cover execution instruction after receiving the sunroof cover execution instruction Perform the appropriate action for the sunroof cover drive unit.

当上述执行系统信号为天窗遮阳帘信号，所述中央控制器根据获取手势动作图像信号生成天窗遮阳帘执行指令发送给天窗遮阳帘驱动控制系统，所述天窗遮阳帘控制单元接收到天窗遮阳帘执行指令后发送给天窗遮阳帘驱动单元执行相应操作。When the above-mentioned execution system signal is a sunroof sunshade signal, the central controller generates a sunroof sunshade execution instruction according to the acquired gesture action image signal and sends it to the sunroof sunshade drive control system, and the sunroof sunshade control unit receives the sunroof sunshade execution instruction After the command, it is sent to the sunroof sunshade drive unit to perform the corresponding operation.

手势动作数据操作逻辑见下表1所示，控制手势不限于左手或右手，本实施例以左手为例，天窗控制手势和遮阳帘控制手势如图2所示。The operation logic of the gesture action data is shown in Table 1 below. The control gesture is not limited to the left hand or the right hand. In this embodiment, the left hand is used as an example. The sunroof control gesture and the sunshade control gesture are shown in FIG. 2 .

表1手势动作数据操作逻辑表Table 1 Gesture action data operation logic table

中央控制器以通用计算设备的形式表现。如图3所示，通常，计算设备100 包括有：处理器101和存储器102。The central controller takes the form of a general-purpose computing device. As shown in FIG. 3 , in general, the computing device 100 includes: aprocessor 101 and amemory 102 .

处理器101可以包括一个或多个处理核心，比如4核心处理器、8核心处理器等。处理器101可以采用DSP(Digital Signal Processing，数字信号处理)、 FPGA(Field－Programmable Gate Array，现场可编程门阵列)、PLA(Programmable Logic Array，可编程逻辑阵列)中的至少一种硬件形式来实现。处理器101也可以包括主处理器和协处理器，主处理器是用于对在唤醒状态下的数据进行处理的处理器，也称CPU(Central ProcessingUnit，中央处理器)；协处理器是用于对在待机状态下的数据进行处理的低功耗处理器。在一些实施例中，处理器101 可以在集成有GPU(Graphics Processing Unit，图像处理器)，GPU用于负责显示屏所需要显示的内容的渲染和绘制。一些实施例中，处理器101还可以包括 AI(Artificial Intelligence，人工智能)处理器，该AI处理器用于处理有关机器学习的计算操作。Theprocessor 101 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and the like. Theprocessor 101 may adopt at least one hardware form among DSP (Digital Signal Processing, digital signal processing), FPGA (Field-Programmable Gate Array, field programmable gate array), PLA (Programmable Logic Array, programmable logic array) accomplish. Theprocessor 101 may also include a main processor and a co-processor. The main processor is a processor used to process data in a wake-up state, and is also called a CPU (Central Processing Unit, central processing unit); A low-power processor for processing data in a standby state. In some embodiments, theprocessor 101 may be integrated with a GPU (Graphics Processing Unit, image processor), and the GPU is used for rendering and drawing the content that needs to be displayed on the display screen. In some embodiments, theprocessor 101 may further include an AI (Artificial Intelligence, artificial intelligence) processor, where the AI processor is used to process computing operations related to machine learning.

存储器102可以包括一个或多个计算机可读存储介质，该计算机可读存储介质可以是有形的和非暂态的。存储器102还可包括高速随机存取存储器，以及非易失性存储器，比如一个或多个磁盘存储设备、闪存存储设备。在一些实施例中，存储器102中的非暂态的计算机可读存储介质用于存储至少一个指令，该至少一个指令用于被处理器101所执行以实现本申请中提供的一种基于语义识别的车载手势控制天窗系统及其控制方法。Memory 102 may include one or more computer-readable storage media, which may be tangible and non-transitory.Memory 102 may also include high-speed random access memory, as well as non-volatile memory, such as one or more disk storage devices, flash storage devices. In some embodiments, a non-transitory computer-readable storage medium inmemory 102 is used to store at least one instruction for execution byprocessor 101 to implement a semantic-based recognition provided in this application A vehicle-mounted gesture-controlled sunroof system and a control method thereof.

在一些实施例中，终端100还可选包括有：外围设备接口103和至少一个外围设备。具体地，外围设备包括：射频电路104、触摸显示屏105、摄像头 106、音频电路107、定位组件108和电源109中的至少一种。In some embodiments, the terminal 100 may optionally further include: aperipheral device interface 103 and at least one peripheral device. Specifically, the peripheral device includes: at least one of aradio frequency circuit 104, atouch display screen 105, acamera 106, anaudio circuit 107, apositioning component 108 and apower supply 109.

外围设备接口103可被用于将I/O(Input/Output，输入/输出)相关的至少一个外围设备连接到处理器101和存储器102。在一些实施例中，处理器101、存储器102和外围设备接口103被集成在同一芯片或电路板上；在一些其他实施例中，处理器101、存储器102和外围设备接口103中的任意一个或两个可以在单独的芯片或电路板上实现，本实施例对此不加以限定。Theperipheral device interface 103 may be used to connect at least one peripheral device related to I/O (Input/Output) to theprocessor 101 and thememory 102 . In some embodiments,processor 101,memory 102, and peripherals interface 103 are integrated on the same chip or circuit board; in some other embodiments, any one ofprocessor 101,memory 102, and peripherals interface 103 or The two can be implemented on a separate chip or circuit board, which is not limited in this embodiment.

射频电路104用于接收和发射RF(Radio Frequency，射频)信号，也称电磁信号。射频电路104通过电磁信号与通信网络以及其他通信设备进行通信。射频电路104将电信号转换为电磁信号进行发送，或者，将接收到的电磁信号转换为电信号。可选地，射频电路104包括：天线系统、RF收发器、一个或多个放大器、调谐器、振荡器、数字信号处理器、编解码芯片组、用户身份模块卡等等。射频电路104可以通过至少一种无线通信协议来与其它终端进行通信。该无线通信协议包括但不限于：万维网、城域网、内联网、各代移动通信网络 (2G、3G、4G及5G)、无线局域网和/或WiFi(Wireless Fidelity，无线保真)网络。在一些实施例中，射频电路104还可以包括NFC(Near Field Communication，近距离无线通信)有关的电路，本申请对此不加以限定。Theradio frequency circuit 104 is used for receiving and transmitting RF (Radio Frequency, radio frequency) signals, also called electromagnetic signals. Theradio frequency circuit 104 communicates with the communication network and other communication devices via electromagnetic signals. Theradio frequency circuit 104 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals into electrical signals. Optionally, theradio frequency circuit 104 includes an antenna system, an RF transceiver, one or more amplifiers, tuners, oscillators, digital signal processors, codec chipsets, subscriber identity module cards, and the like. Theradio frequency circuit 104 may communicate with other terminals through at least one wireless communication protocol. The wireless communication protocol includes but is not limited to: World Wide Web, Metropolitan Area Network, Intranet, various generations of mobile communication networks (2G, 3G, 4G and 5G), wireless local area network and/or WiFi (Wireless Fidelity, Wireless Fidelity) network. In some embodiments, theradio frequency circuit 104 may further include a circuit related to NFC (Near Field Communication, short-range wireless communication), which is not limited in this application.

触摸显示屏105用于显示UI(User Interface，用户界面)。该UI可以包括图形、文本、图标、视频及其它们的任意组合。触摸显示屏105还具有采集在触摸显示屏105的表面或表面上方的触摸信号的能力。该触摸信号可以作为控制信号输入至处理器101进行处理。触摸显示屏105用于提供虚拟按钮和/或虚拟键盘，也称软按钮和/或软键盘。在一些实施例中，触摸显示屏105可以为一个，设置终端100的前面板；在另一些实施例中，触摸显示屏105可以为至少两个，分别设置在终端100的不同表面或呈折叠设计；在再一些实施例中，触摸显示屏105可以是柔性显示屏，设置在终端100的弯曲表面上或折叠面上。甚至，触摸显示屏105还可以设置成非矩形的不规则图形，也即异形屏。触摸显示屏105可以采用LCD(LiquidCrystal Display，液晶显示器)、OLED(Organic Light-Emitting Diode,有机发光二极管)等材质制备。Thetouch screen 105 is used to display a UI (User Interface). The UI can include graphics, text, icons, video, and any combination thereof. Thetouch display 105 also has the ability to acquire touch signals on or over the surface of thetouch display 105 . The touch signal may be input to theprocessor 101 as a control signal for processing. Thetouch screen 105 is used to provide virtual buttons and/or virtual keyboards, also called soft buttons and/or soft keyboards. In some embodiments, there may be onetouch display screen 105, which is provided on the front panel of the terminal 100; in other embodiments, there may be at least two touch display screens 105, which are respectively provided on different surfaces of the terminal 100 or in a folded design. ; In still other embodiments, thetouch display screen 105 may be a flexible display screen, which is arranged on a curved surface or a folding surface of the terminal 100 . Even, thetouch display screen 105 can also be set as a non-rectangular irregular figure, that is, a special-shaped screen. Thetouch display screen 105 can be made of materials such as LCD (Liquid Crystal Display, liquid crystal display), OLED (Organic Light-Emitting Diode, organic light emitting diode).

摄像头组件106用于采集图像或视频。可选地，摄像头组件106包括前置摄像头和后置摄像头。通常，前置摄像头用于实现视频通话或自拍，后置摄像头用于实现照片或视频的拍摄。在一些实施例中，后置摄像头为至少两个，分别为主摄像头、景深摄像头、广角摄像头中的任意一种，以实现主摄像头和景深摄像头融合实现背景虚化功能，主摄像头和广角摄像头融合实现全景拍摄以及VR(Virtual Reality，虚拟现实)拍摄功能。在一些实施例中，摄像头组件106 还可以包括闪光灯。闪光灯可以是单色温闪光灯，也可以是双色温闪光灯。双色温闪光灯是指暖光闪光灯和冷光闪光灯的组合，可以用于不同色温下的光线补偿。Thecamera assembly 106 is used to capture images or video. Optionally, thecamera assembly 106 includes a front camera and a rear camera. Usually, the front camera is used for video calls or selfies, and the rear camera is used for photo or video shooting. In some embodiments, there are at least two rear cameras, which are any one of a main camera, a depth-of-field camera, and a wide-angle camera, so as to realize the fusion of the main camera and the depth-of-field camera to realize the background blur function, and the fusion of the main camera and the wide-angle camera Realize panoramic shooting and VR (Virtual Reality, virtual reality) shooting functions. In some embodiments, thecamera assembly 106 may also include a flash. The flash can be a single color temperature flash or a dual color temperature flash. Dual color temperature flash refers to the combination of warm light flash and cold light flash, which can be used for light compensation under different color temperatures.

音频电路107用于提供用户和终端100之间的音频接口。音频电路107可以包括麦克风和扬声器。麦克风用于采集用户及环境的声波，并将声波转换为电信号输入至处理器101进行处理，或者输入至射频电路104以实现语音通信。出于立体声采集或降噪的目的，麦克风可以为多个，分别设置在终端100的不同部位。麦克风还可以是阵列麦克风或全向采集型麦克风。扬声器则用于将来自处理器101或射频电路104的电信号转换为声波。扬声器可以是传统的薄膜扬声器，也可以是压电陶瓷扬声器。当扬声器是压电陶瓷扬声器时，不仅可以将电信号转换为人类可听见的声波，也可以将电信号转换为人类听不见的声波以进行测距等用途。在一些实施例中，音频电路107还可以包括耳机插孔。Theaudio circuit 107 is used to provide an audio interface between the user and the terminal 100 .Audio circuitry 107 may include a microphone and speakers. The microphone is used to collect the sound waves of the user and the environment, convert the sound waves into electrical signals, and input them to theprocessor 101 for processing, or input them to theradio frequency circuit 104 to realize voice communication. For the purpose of stereo collection or noise reduction, there may be multiple microphones, which are respectively disposed in different parts of the terminal 100 . The microphone may also be an array microphone or an omnidirectional collection microphone. The speaker is used to convert the electrical signal from theprocessor 101 or theradio frequency circuit 104 into sound waves. The loudspeaker can be a traditional thin-film loudspeaker or a piezoelectric ceramic loudspeaker. When the speaker is a piezoelectric ceramic speaker, it can not only convert electrical signals into sound waves audible to humans, but also convert electrical signals into sound waves inaudible to humans for distance measurement and other purposes. In some embodiments, theaudio circuit 107 may also include a headphone jack.

定位组件108用于定位终端100的当前地理位置，以实现导航或LBS (LocationBased Service，基于位置的服务)。定位组件108可以是基于美国的 GPS(GlobalPositioning System，全球定位系统)、中国的北斗系统或俄罗斯的伽利略系统的定位组件。Thepositioning component 108 is used to locate the current geographic location of the terminal 100 to implement navigation or LBS (Location Based Service, location-based service). Thepositioning component 108 may be a positioning component based on the GPS (Global Positioning System, global positioning system) of the United States, the Beidou system of China, or the Galileo system of Russia.

电源109用于为终端100中的各个组件进行供电。电源109可以是交流电、直流电、一次性电池或可充电电池。当电源109包括可充电电池时，该可充电电池可以是有线充电电池或无线充电电池。有线充电电池是通过有线线路充电的电池，无线充电电池是通过无线线圈充电的电池。该可充电电池还可以用于支持快充技术。Thepower supply 109 is used to power various components in the terminal 100 . Thepower source 109 may be alternating current, direct current, disposable batteries or rechargeable batteries. When thepower source 109 includes a rechargeable battery, the rechargeable battery may be a wired rechargeable battery or a wireless rechargeable battery. Wired rechargeable batteries are batteries that are charged through wired lines, and wireless rechargeable batteries are batteries that are charged through wireless coils. The rechargeable battery can also be used to support fast charging technology.

在一些实施例中，终端100还包括有一个或多个传感器110。该一个或多个传感器110包括但不限于：加速度传感器111、陀螺仪传感器112、压力传感器113、指纹传感器114、光学传感器115以及接近传感器116。In some embodiments, the terminal 100 further includes one or more sensors 110 . The one or more sensors 110 include, but are not limited to, an acceleration sensor 111 , a gyro sensor 112 , a pressure sensor 113 , a fingerprint sensor 114 , an optical sensor 115 and a proximity sensor 116 .

加速度传感器111可以检测以终端100建立的坐标系的三个坐标轴上的加速度大小。比如，加速度传感器111可以用于检测重力加速度在三个坐标轴上的分量。处理器101可以根据加速度传感器111采集的重力加速度信号，控制触摸显示屏105以横向视图或纵向视图进行用户界面的显示。加速度传感器111 还可以用于游戏或者用户的运动数据的采集。The acceleration sensor 111 can detect the magnitude of acceleration on the three coordinate axes of the coordinate system established by the terminal 100 . For example, the acceleration sensor 111 can be used to detect the components of the gravitational acceleration on the three coordinate axes. Theprocessor 101 may control thetouch display screen 105 to display the user interface in a landscape view or a portrait view according to the gravitational acceleration signal collected by the acceleration sensor 111 . The acceleration sensor 111 can also be used for game or user movement data collection.

陀螺仪传感器112可以检测终端100的机体方向及转动角度，陀螺仪传感器112可以与加速度传感器111协同采集用户对终端100的3D(3Dimensions，三维)动作。处理器101根据陀螺仪传感器112采集的数据，可以实现如下功能：动作感应(比如根据用户的倾斜操作来改变UI)、拍摄时的图像稳定、游戏控制以及惯性导航。The gyroscope sensor 112 can detect the body direction and rotation angle of the terminal 100 , and the gyroscope sensor 112 can cooperate with the acceleration sensor 111 to collect 3D (3 Dimensions, three-dimensional) actions of the user on the terminal 100 . Theprocessor 101 can implement the following functions according to the data collected by the gyro sensor 112 : motion sensing (such as changing the UI according to the user's tilt operation), image stabilization during shooting, game control, and inertial navigation.

压力传感器113可以设置在终端100的侧边框和/或触摸显示屏105的下层。当压力传感器113设置在终端100的侧边框时，可以检测用户对终端100的握持信号，根据该握持信号进行左右手识别或快捷操作。当压力传感器113设置在触摸显示屏105的下层时，可以根据用户对触摸显示屏105的压力操作，实现对UI界面上的可操作性控件进行控制。可操作性控件包括按钮控件、滚动条控件、图标控件、菜单控件中的至少一种。The pressure sensor 113 may be disposed on the side frame of the terminal 100 and/or the lower layer of thetouch display screen 105 . When the pressure sensor 113 is disposed on the side frame of the terminal 100, it can detect the user's holding signal of the terminal 100, and perform left and right hand identification or quick operation according to the holding signal. When the pressure sensor 113 is disposed on the lower layer of thetouch display screen 105 , the operability controls on the UI interface can be controlled according to the user's pressure operation on thetouch display screen 105 . The operability controls include at least one of button controls, scroll bar controls, icon controls, and menu controls.

指纹传感器114用于采集用户的指纹，以根据采集到的指纹识别用户的身份。在识别出用户的身份为可信身份时，由处理器101授权该用户执行相关的敏感操作，该敏感操作包括解锁屏幕、查看加密信息、下载软件、支付及更改设置等。指纹传感器114可以被设置终端100的正面、背面或侧面。当终端100 上设置有物理按键或厂商Logo时，指纹传感器114可以与物理按键或厂商Logo 集成在一起。The fingerprint sensor 114 is used to collect the user's fingerprint, so as to identify the user's identity according to the collected fingerprint. When the user's identity is identified as a trusted identity, theprocessor 101 authorizes the user to perform relevant sensitive operations, including unlocking the screen, viewing encrypted information, downloading software, paying, and changing settings. The fingerprint sensor 114 may be provided on the front, back or side of the terminal 100 . When the terminal 100 is provided with physical buttons or a manufacturer's logo, the fingerprint sensor 114 may be integrated with the physical buttons or the manufacturer's logo.

光学传感器115用于采集环境光强度。在一个实施例中，处理器101可以根据光学传感器115采集的环境光强度，控制触摸显示屏105的显示亮度。具体地，当环境光强度较高时，调高触摸显示屏105的显示亮度；当环境光强度较低时，调低触摸显示屏105的显示亮度。在另一个实施例中，处理器101还可以根据光学传感器115采集的环境光强度，动态调整摄像头组件106的拍摄参数。The optical sensor 115 is used to collect ambient light intensity. In one embodiment, theprocessor 101 may control the display brightness of thetouch display screen 105 according to the ambient light intensity collected by the optical sensor 115 . Specifically, when the ambient light intensity is high, the display brightness of thetouch display screen 105 is increased; when the ambient light intensity is low, the display brightness of thetouch display screen 105 is decreased. In another embodiment, theprocessor 101 may also dynamically adjust the shooting parameters of thecamera assembly 106 according to the ambient light intensity collected by the optical sensor 115 .

接近传感器116，也称距离传感器，通常设置在终端100的正面。接近传感器116用于采集用户与终端100的正面之间的距离。在一个实施例中，当接近传感器116检测到用户与终端100的正面之间的距离逐渐变小时，由处理器 101控制触摸显示屏105从亮屏状态切换为息屏状态；当接近传感器116检测到用户与终端100的正面之间的距离逐渐变大时，由处理器101控制触摸显示屏105从息屏状态切换为亮屏状态。A proximity sensor 116 , also called a distance sensor, is usually provided on the front of the terminal 100 . The proximity sensor 116 is used to collect the distance between the user and the front of the terminal 100 . In one embodiment, when the proximity sensor 116 detects that the distance between the user and the front of the terminal 100 is gradually decreasing, theprocessor 101 controls thetouch display screen 105 to switch from the bright screen state to the off screen state; when the proximity sensor 116 detects When the distance between the user and the front of the terminal 100 gradually increases, theprocessor 101 controls thetouch display screen 105 to switch from the screen-off state to the screen-on state.

本领域技术人员可以理解，图3中示出的结构并不构成对终端100的限定，可以包括比图示更多或更少的组件，或者组合某些组件，或者采用不同的组件布置。Those skilled in the art can understand that the structure shown in FIG. 3 does not constitute a limitation on the terminal 100, and may include more or less components than the one shown, or combine some components, or adopt different component arrangements.

在示例性实施例中，还提供了一种计算机可读存储介质，其上存储有计算机程序，该程序被处理器执行时实现如本申请所有发明实施例提供的一种基于语义识别的车载手势控制天窗系统及其控制方法。In an exemplary embodiment, a computer-readable storage medium is also provided, on which a computer program is stored, and when the program is executed by a processor, implements a semantic recognition-based vehicle gesture as provided by all the inventive embodiments of the present application A control sunroof system and a control method thereof.

可以采用一个或多个计算机可读的介质的任意组合。计算机可读介质可以是计算机可读信号介质或者计算机可读存储介质。计算机可读存储介质例如可以是——但不限于——电、磁、光、电磁、红外线、或半导体的系统、装置或器件，或者任意以上的组合。计算机可读存储介质的更具体的例子(非穷举的列表)包括：具有一个或多个导线的电连接、便携式计算机磁盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(EPROM或闪存)、光纤、便携式紧凑磁盘只读存储器(CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合。在本文件中，计算机可读存储介质可以是任何包含或存储程序的有形介质，该程序可以被指令执行系统、装置或者器件使用或者与其结合使用。Any combination of one or more computer-readable media may be employed. The computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium. The computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or a combination of any of the above. More specific examples (a non-exhaustive list) of computer readable storage media include: electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), Erasable programmable read only memory (EPROM or flash memory), optical fiber, portable compact disk read only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing. In this document, a computer-readable storage medium can be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.

计算机可读的信号介质可以包括在基带中或者作为载波一部分传播的数据信号，其中承载了计算机可读的程序代码。这种传播的数据信号可以采用多种形式，包括——但不限于——电磁信号、光信号或上述的任意合适的组合。计算机可读的信号介质还可以是计算机可读存储介质以外的任何计算机可读介质，该计算机可读介质可以发送、传播或者传输用于由指令执行系统、装置或者器件使用或者与其结合使用的程序。A computer-readable signal medium may include a propagated data signal in baseband or as part of a carrier wave, with computer-readable program code embodied thereon. Such propagated data signals may take a variety of forms including, but not limited to, electromagnetic signals, optical signals, or any suitable combination of the foregoing. A computer-readable signal medium can also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device .

计算机可读介质上包含的程序代码可以用任何适当的介质传输，包括——但不限于——无线、电线、光缆、RF等等，或者上述的任意合适的组合。Program code embodied on a computer readable medium may be transmitted using any suitable medium including, but not limited to, wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

可以以一种或多种程序设计语言或其组合来编写用于执行本发明操作的计算机程序代码，所述程序设计语言包括面向对象的程序设计语言—诸如Java、 Smalltalk、C++，还包括常规的过程式程序设计语言—诸如“C”语言或类似的程序设计语言。程序代码可以完全地在用户计算机上执行、部分地在用户计算机上执行、作为一个独立的软件包执行、部分在用户计算机上部分在远程计算机上执行、或者完全在远程计算机或服务器上执行。在涉及远程计算机的情形中，远程计算机可以通过任意种类的网络——包括局域网(LAN)或广域网(WAN)—连接到用户计算机，或者，可以连接到外部计算机(例如利用因特网服务提供商来通过因特网连接)。Computer program code for carrying out operations of the present invention may be written in one or more programming languages, including object-oriented programming languages—such as Java, Smalltalk, C++, but also conventional Procedural programming language - such as the "C" language or similar programming language. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer, or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (eg, using an Internet service provider through Internet connection).

尽管本发明的实施方案已公开如上，但其并不仅仅限于说明书和实施方式中所列运用。它完全可以被适用于各种适合本发明的领域。对于熟悉本领域的人员而言，可容易地实现另外的修改。因此在不背离权利要求及等同范围所限定的一般概念下，本发明并不限于特定的细节和这里示出与描述的图例。Although embodiments of the present invention have been disclosed above, they are not limited to the applications set forth in the specification and embodiments. It can be fully adapted to various fields suitable for the present invention. Additional modifications can readily be implemented by those skilled in the art. Therefore, the invention is not to be limited to the specific details and illustrations herein shown and described, without departing from the general concept defined by the appended claims and the scope of equivalents.

Claims (8)

Translated fromChinese

1.一种基于语义识别的车载手势控制天窗系统，其特征在于，包括：执行系统、手势识别单元、中央控制器和语音采集单元，所述中央控制器分别与执行系统、手势识别单元和语义识别单元电性连接，所述语音采集单元采用车载麦克风，其用于采集用户语音。1. a vehicle-mounted gesture control sunroof system based on semantic recognition, is characterized in that, comprises: executive system, gesture recognition unit, central controller and voice acquisition unit, described central controller is respectively with executive system, gesture recognition unit and semantics The identification unit is electrically connected, and the voice collection unit adopts a vehicle-mounted microphone, which is used for collecting the user's voice.2.根据权利要求1所述的一种基于语义识别的车载手势控制天窗系统，其特征在于，所述执行系统包括：天窗盖板驱动控制系统和天窗遮阳帘驱动控制系统。2 . The vehicle-mounted gesture control sunroof system based on semantic recognition according to claim 1 , wherein the execution system comprises: a sunroof cover drive control system and a sunroof sunshade drive control system. 3 .3.根据权利要求3所述的一种基于语义识别的车载手势控制天窗系统，其特征在于，所述天窗盖板驱动控制系统包括：3. The vehicle-mounted gesture control sunroof system based on semantic recognition according to claim 3, wherein the sunroof cover drive control system comprises:天窗盖板控制单元，用于控制活动天窗盖板开启与关闭；The sunroof cover control unit is used to control the opening and closing of the movable sunroof cover;天窗盖板驱动单元，用于驱动活动天窗盖板开启与关闭。The sunroof cover drive unit is used to drive the movable sunroof cover to open and close.4.根据权利要求3所述的一种手势控制天窗系统，其特征在于，所述天窗遮阳帘驱动控制系统包括：4. A gesture-controlled sunroof system according to claim 3, wherein the sunroof sunshade drive control system comprises:天窗遮阳帘控制单元，用于控制活动天窗遮阳帘开启与关闭；The sunroof sunshade control unit is used to control the opening and closing of the movable sunroof sunshade;天窗遮阳帘驱动单元，用于驱动活动天窗遮阳帘开启与关闭。The sunroof sunshade drive unit is used to drive the movable sunroof sunshade to open and close.5.一种基于语义识别的车载手势控制天窗系统的控制方法，其特征在于，所述方法包括：5. A control method for a vehicle-mounted gesture control sunroof system based on semantic recognition, wherein the method comprises:通过所述语音采集单元采集用户语音数据并反馈给中央控制器；Collect user voice data through the voice acquisition unit and feed it back to the central controller;所述中央控制器获取用户语音数据与初始录入信息进行判断是否相符；The central controller determines whether the user voice data is consistent with the initial input information;若是，则根据所述用户语音数据调取相应的执行系统信号反馈给手势识别单元；If so, call the corresponding execution system signal according to the user voice data and feed it back to the gesture recognition unit;所述手势识别单元获取手势动作图像信号并反馈给中央控制器；The gesture recognition unit acquires the gesture action image signal and feeds it back to the central controller;所述中央控制器根据获取手势动作图像信号生成执行指令发送给相应的执行系统。The central controller generates an execution instruction according to the acquired gesture action image signal and sends it to the corresponding execution system.6.根据权利要求5所述的一种基于瞳孔识别的车载手势控制天窗系统的控制方法，其特征在于，6. A kind of control method of vehicle-mounted gesture control sunroof system based on pupil recognition according to claim 5, is characterized in that,当所述执行系统信号为天窗盖板信号时，所述中央控制器根据获取手势动作图像信号生成天窗盖板执行指令发送给天窗盖板驱动控制系统，所述天窗盖板控制单元接收到天窗盖板执行指令后发送给天窗盖板驱动单元执行相应操作。When the execution system signal is a sunroof cover signal, the central controller generates a sunroof cover execution instruction according to the acquired gesture action image signal and sends it to the sunroof cover drive control system, and the sunroof cover control unit receives the sunroof cover. After the panel executes the command, it is sent to the sunroof cover drive unit to perform the corresponding operation.7.根据权利要求5所述的一种基于瞳孔识别的车载手势控制天窗系统的控制方法，其特征在于，7. A kind of control method of vehicle-mounted gesture control sunroof system based on pupil recognition according to claim 5, is characterized in that,当所述执行系统信号为天窗遮阳帘信号，所述中央控制器根据获取手势动作图像信号生成天窗遮阳帘执行指令发送给天窗遮阳帘驱动控制系统，所述天窗遮阳帘控制单元接收到天窗遮阳帘执行指令后发送给天窗遮阳帘驱动单元执行相应操作。When the execution system signal is a sunroof sunshade signal, the central controller generates a sunroof sunshade execution instruction according to the acquired gesture action image signal and sends it to the sunroof sunshade drive control system, and the sunroof sunshade control unit receives the sunroof sunshade. After executing the command, it is sent to the sunroof sunshade drive unit to perform the corresponding operation.8.根据权利要求5所述的一种基于瞳孔识别的车载手势控制天窗系统的控制方法，其特征在于，当所述中央控制器将天窗遮阳帘与初始录入信息进行判断不相符时，生成不执行指令反馈给语音采集单元，所述语音采集单元重新采集用户语音数据。8 . The method for controlling a sunroof system based on pupil recognition by a vehicle-mounted gesture according to claim 5 , wherein when the central controller judges that the sunroof sunshade is inconsistent with the initial input information, it generates an error message. 9 . The execution instruction is fed back to the voice collecting unit, and the voice collecting unit collects the user voice data again.

Images