技术领域technical field
本发明涉及电子设备技术领域，具体涉及一种基于手势识别的电子设备操作方法及电子设备。The present invention relates to the technical field of electronic equipment, in particular to a gesture recognition-based electronic equipment operating method and electronic equipment.
背景技术Background technique
在人类进行信息交互的多种方式中，手势占有相当重要的地位。和语言文字相比，手势的通用性更广，普适性更高。随着移动互联网的崛起，电子设备携带的多种传感器能够为手势识别提供硬件基础，以提供更加友好的人机交互方式。并且，电子设备的全屏操作相对于多窗口操作模式来说，更适合用手势进行操作，因为在固定区域上，手势具备唯一操作特性。Gestures play an important role in the various ways in which human beings interact with information. Compared with language and text, gestures are more versatile and more universal. With the rise of the mobile Internet, a variety of sensors carried by electronic devices can provide a hardware basis for gesture recognition to provide a more friendly way of human-computer interaction. Moreover, compared with the multi-window operation mode, the full-screen operation of the electronic device is more suitable for operation by gestures, because gestures have unique operation characteristics on a fixed area.
从产品角度来看，手势打通了信息层级。由于信息从真实世界映射到电子设备虚拟空间中将会受到物理尺寸的限制，无法一次呈现所有的信息，所以人们依据物理世界的前后左右纬度建立了信息层级和模块，使得电子设备的屏幕得到更大延伸，便于用户在有限的物理空间内输入更多的信息，例如，人们可以通过左右滑动来切换屏幕中不同的页面以及用下拉的方式来呼出下拉菜单等。随着电子设备功能的逐渐增加，如何丰富电子设备的手势交互方式显得尤为重要。From a product perspective, gestures break through the information hierarchy. Since the mapping of information from the real world to the virtual space of electronic devices will be limited by the physical size, it is impossible to present all the information at once. Therefore, people have established information levels and modules based on the front, back, left, and right latitudes of the physical world, making the screens of electronic devices more accurate. The large extension is convenient for users to input more information in a limited physical space. For example, people can switch different pages in the screen by swiping left and right, and call out the drop-down menu by pulling down. With the gradual increase in functions of electronic devices, how to enrich gesture interaction methods of electronic devices is particularly important.
发明内容Contents of the invention
本发明实施例公开了一种电子设备的操作方法及电子设备，能够提高手势交互方式的多样性。The embodiment of the invention discloses an operation method of an electronic device and the electronic device, which can improve the diversity of gesture interaction modes.
本发明实施例第一方面公开了一种基于手势识别的电子设备操作方法，所述方法包括：The first aspect of the embodiment of the present invention discloses a gesture recognition-based electronic device operating method, the method comprising:
所述电子设备获取目标手势轨迹，并确定与所述目标手势轨迹对应的基本信息；其中，所述基本信息至少包括所述目标手势轨迹相对于直线轨迹的偏离方向；The electronic device acquires a target gesture track, and determines basic information corresponding to the target gesture track; wherein, the basic information includes at least a deviation direction of the target gesture track relative to a straight line track;
所述电子设备根据所述基本信息识别用于触发所述目标手势轨迹的操作手；The electronic device identifies the operating hand used to trigger the target gesture trajectory according to the basic information;
所述电子设备根据识别出的所述操作手以及所述目标手势轨迹，生成与所述操作手和所述目标手势轨迹相匹配的操作指令，并执行与所述操作指令相对应的操作，所述操作手包括左手、右手或左右手组合。The electronic device generates an operation instruction matching the operating hand and the target gesture trajectory according to the recognized operating hand and the target gesture trajectory, and executes an operation corresponding to the operation instruction. Said operating hands include left hand, right hand or a combination of left and right hands.
作为一种可选的实施方式，在本发明实施例第一方面中，所述电子设备获取目标手势轨迹，包括：As an optional implementation manner, in the first aspect of the embodiments of the present invention, the acquisition of the target gesture trajectory by the electronic device includes:
所述电子设备检测是否存在针对所述电子设备的触摸屏的用户操作；The electronic device detects whether there is a user operation on the touch screen of the electronic device;
如果检测到所述用户操作，所述电子设备识别所述用户操作在所述电子设备的触摸屏上的二维轨迹，作为目标手势轨迹；If the user operation is detected, the electronic device identifies the two-dimensional trajectory of the user operation on the touch screen of the electronic device as a target gesture trajectory;
如果未检测到所述用户操作，所述电子设备基于机器视觉判断所述电子设备的视觉范围内是否存在目标手，所述目标手与预设手模型相匹配；If the user operation is not detected, the electronic device judges based on machine vision whether there is a target hand within the visual range of the electronic device, and the target hand matches a preset hand model;
如果存在所述目标手，所述电子设备识别所述目标手的动态三维手势，作为目标手势轨迹。If the target hand exists, the electronic device recognizes a dynamic three-dimensional gesture of the target hand as a target gesture trajectory.
作为一种可选的实施方式，在本发明实施例第一方面中，所述电子设备根据所述基本信息识别用于触发所述目标手势轨迹的操作手之前，所述方法还包括：As an optional implementation manner, in the first aspect of the embodiment of the present invention, before the electronic device identifies the operator for triggering the target gesture trajectory according to the basic information, the method further includes:
当所述目标手势轨迹为所述二维轨迹时，所述电子设备采集所述用户操作所对应的目标指纹；When the target gesture trajectory is the two-dimensional trajectory, the electronic device collects a target fingerprint corresponding to the user operation;
所述电子设备判断所述目标指纹是否与预设合法指纹相匹配；The electronic device judges whether the target fingerprint matches a preset legal fingerprint;
如果是，所述电子设备执行所述的根据所述基本信息识别用于触发所述目标手势轨迹的操作手。If yes, the electronic device executes the identifying the operating hand used to trigger the target gesture track according to the basic information.
作为一种可选的实施方式，在本发明实施例第一方面中，所述基本信息还包括所述目标手势轨迹的起始位置；As an optional implementation manner, in the first aspect of the embodiment of the present invention, the basic information further includes the starting position of the target gesture trajectory;
所述电子设备根据所述基本信息识别用于触发所述目标手势轨迹的操作手，包括：The electronic device identifies the operating hand used to trigger the target gesture track according to the basic information, including:
当所述目标手势轨迹为所述二维轨迹时，所述电子设备确定所述起始位置的数量；When the target gesture trajectory is the two-dimensional trajectory, the electronic device determines the number of starting positions;
如果所述起始位置的数量大于或等于两个，所述电子设备判断距离值集合中是否存在大于预设距离的距离值，所述距离值集合由所有所述起始位置中任意两个所述起始位置之间的距离值组成；If the number of the starting positions is greater than or equal to two, the electronic device judges whether there is a distance value greater than a preset distance in the distance value set, and the distance value set is determined by any two of the starting positions. The distance value between the above starting positions;
如果所述距离值集合中存在大于所述预设距离的距离值，所述电子设备确定触发所述目标手势轨迹的操作手为左右手组合；If there is a distance value greater than the preset distance in the distance value set, the electronic device determines that the operating hand that triggers the target gesture trajectory is a combination of left and right hands;
如果所述距离值集合中不存在大于所述预设距离的距离值或如果所述起始位置的数量等于1时，所述电子设备根据所述目标手势轨迹相对于直线轨迹的偏离方向识别用于触发所述目标手势轨迹的操作手，其中，所述目标手势轨迹相对于直线轨迹的偏离方向为左时，所述操作手为左手，所述目标手势轨迹相对于直线轨迹的偏离方向为右时，所述操作手为右手。If there is no distance value greater than the preset distance in the distance value set or if the number of the starting position is equal to 1, the electronic device recognizes the target gesture trajectory according to the deviation direction of the target gesture trajectory relative to the straight trajectory. As for the operating hand that triggers the target gesture track, when the deviation direction of the target gesture track relative to the straight line track is left, the operating hand is the left hand, and the deviation direction of the target gesture track relative to the straight line track is right , the operating hand is the right hand.
作为一种可选的实施方式，在本发明实施例第一方面中，所述电子设备根据所述基本信息识别用于触发所述目标手势轨迹的操作手，包括：As an optional implementation manner, in the first aspect of the embodiments of the present invention, the electronic device identifies the operating hand used to trigger the target gesture trajectory according to the basic information, including:
所述电子设备根据所述目标指纹和所述基本信息识别用于触发所述目标手势轨迹的操作手。The electronic device identifies the operating hand used to trigger the target gesture track according to the target fingerprint and the basic information.
本发明实施例第二方面公开了一种电子设备，所述电子设备包括：The second aspect of the embodiment of the present invention discloses an electronic device, and the electronic device includes:
获取单元，用于获取目标手势轨迹；An acquisition unit, configured to acquire a target gesture trajectory;
确定单元，用于确定与所述目标手势轨迹对应的基本信息；其中，所述基本信息至少包括所述目标手势轨迹相对于直线轨迹的偏离方向；A determination unit, configured to determine basic information corresponding to the target gesture trajectory; wherein the basic information includes at least a deviation direction of the target gesture trajectory relative to a straight line trajectory;
识别单元，用于根据所述基本信息识别用于触发所述目标手势轨迹的操作手；An identification unit, configured to identify the operating hand used to trigger the target gesture trajectory according to the basic information;
生成单元，用于根据识别出的所述操作手以及所述目标手势轨迹，生成与所述操作手和所述目标手势轨迹相匹配的操作指令，并执行与所述操作指令相对应的操作，所述操作手包括左手、右手或左右手组合。a generating unit, configured to generate an operation instruction matching the operating hand and the target gesture trajectory according to the identified operating hand and the target gesture trajectory, and execute an operation corresponding to the operation instruction, The operation hands include left hand, right hand or a combination of left and right hands.
作为一种可选的实施方式，在本发明实施例第二方面中，所述获取单元包括：As an optional implementation manner, in the second aspect of the embodiment of the present invention, the acquiring unit includes:
检测子单元，用于检测是否存在针对所述电子设备的触摸屏的用户操作；A detection subunit, configured to detect whether there is a user operation on the touch screen of the electronic device;
识别子单元，用于在所述检测子单元检测到存在针对所述电子设备的触摸屏的用户操作之后，识别所述用户操作在所述电子设备的触摸屏上的二维轨迹，作为目标手势轨迹；The identification subunit is used to identify the two-dimensional trajectory of the user operation on the touchscreen of the electronic device as the target gesture trajectory after the detection subunit detects that there is a user operation on the touchscreen of the electronic device;
判断子单元，用于在所述检测子单元未检测到存在针对所述电子设备的触摸屏的用户操作之后，基于机器视觉判断所述电子设备的视觉范围内是否存在目标手，所述目标手与预设手模型相匹配；The judging subunit is configured to judge whether there is a target hand within the visual range of the electronic device based on machine vision after the detection subunit does not detect that there is a user operation on the touch screen of the electronic device, and the target hand and Preset hand models to match;
所述识别子单元，还用于在所述判断子单元判断出存在所述目标手之后，识别所述目标手的动态三维手势，作为目标手势轨迹。The recognition subunit is further configured to recognize a dynamic three-dimensional gesture of the target hand as a target gesture trajectory after the determination subunit determines that the target hand exists.
作为一种可选的实施方式，在本发明实施例第二方面中，所述电子设备还包括：As an optional implementation manner, in the second aspect of the embodiment of the present invention, the electronic device further includes:
采集单元，用于在所述识别单元根据所述基本信息识别用于触发所述目标手势轨迹的操作手之前，且当所述目标手势轨迹为所述二维轨迹时，采集所述用户操作所对应的目标指纹；The acquisition unit is configured to collect the user operation information before the identification unit identifies the operating hand used to trigger the target gesture track according to the basic information, and when the target gesture track is the two-dimensional track. The corresponding target fingerprint;
判断单元，用于判断所述目标指纹是否与预设合法指纹相匹配；a judging unit, configured to judge whether the target fingerprint matches a preset legal fingerprint;
所述识别单元，具体用于在所述判断单元判断出所述目标指纹与预设合法指纹相匹配之后，根据所述基本信息识别用于触发所述目标手势轨迹的操作手。The identifying unit is specifically configured to, after the judging unit judges that the target fingerprint matches a preset legal fingerprint, identify the operating hand used to trigger the target gesture track according to the basic information.
作为一种可选的实施方式，在本发明实施例第二方面中，所述基本信息还包括所述目标手势轨迹的起始位置；As an optional implementation manner, in the second aspect of the embodiment of the present invention, the basic information further includes the starting position of the target gesture trajectory;
所述识别单元根据所述基本信息识别用于触发所述目标手势轨迹的操作手的方式具体为：The manner in which the identification unit identifies the operating hand used to trigger the target gesture trajectory according to the basic information is specifically as follows:
当所述目标手势轨迹为所述二维轨迹时，确定所述起始位置的数量；When the target gesture trajectory is the two-dimensional trajectory, determine the number of the starting positions;
在确定出所述起始位置的数量大于或等于两个之后，判断距离值集合中是否存在大于预设距离的距离值，所述距离值集合由所有所述起始位置中任意两个所述起始位置之间的距离值组成；After determining that the number of the starting positions is greater than or equal to two, it is judged whether there is a distance value greater than a preset distance in the distance value set, and the distance value set is described by any two of the starting positions. The distance value between the starting positions consists of;
在判断出所述距离值集合中存在大于所述预设距离的距离值之后，确定触发所述目标手势轨迹的操作手为左右手组合；After judging that there is a distance value greater than the preset distance in the distance value set, it is determined that the operating hand that triggers the target gesture trajectory is a combination of left and right hands;
在确定出的所述起始位置的数量等于1之后，或在判断出所述距离值集合中不存在大于所述预设距离的距离值之后，根据所述目标手势轨迹相对于直线轨迹的偏离方向识别用于触发所述目标手势轨迹的操作手，其中，所述目标手势轨迹相对于直线轨迹的偏离方向为左时，所述操作手为左手，所述目标手势轨迹相对于直线轨迹的偏离方向为右时，所述操作手为右手。After the number of the determined starting positions is equal to 1, or after it is determined that there is no distance value greater than the preset distance in the distance value set, according to the deviation of the target gesture trajectory from the straight line trajectory Direction recognition is used to trigger the operating hand of the target gesture track, wherein, when the deviation direction of the target gesture track relative to the straight track is left, the operating hand is the left hand, and the deviation of the target gesture track relative to the straight track is When the direction is right, the operating hand is the right hand.
作为一种可选的实施方式，在本发明实施例第二方面中，所述识别单元根据所述基本信息识别用于触发所述目标手势轨迹的操作手的方式具体为：As an optional implementation manner, in the second aspect of the embodiment of the present invention, the manner in which the recognition unit recognizes the operating hand used to trigger the target gesture trajectory according to the basic information is specifically:
根据所述目标指纹和所述基本信息识别用于触发所述目标手势轨迹的操作手。An operating hand used to trigger the target gesture trajectory is identified according to the target fingerprint and the basic information.
本发明实施例第三方面公开了一种电子设备，包括：The third aspect of the embodiment of the present invention discloses an electronic device, including:
存储有可执行程序代码的存储器；a memory storing executable program code;
与所述存储器耦合的处理器；a processor coupled to the memory;
所述处理器调用所述存储器中存储的所述可执行程序代码，执行本发明实施例第一方面公开的基于手势识别的电子设备操作方法法。The processor invokes the executable program code stored in the memory to execute the gesture recognition-based electronic device operating method disclosed in the first aspect of the embodiments of the present invention.
本发明实施例第四方面公开了一种计算机可读存储介质，其存储计算机程序，其中，所述计算机程序使得计算机执行本发明实施例第一方面公开的基于手势识别的电子设备操作方法。The fourth aspect of the embodiment of the present invention discloses a computer-readable storage medium, which stores a computer program, wherein the computer program causes the computer to execute the gesture recognition-based electronic device operating method disclosed in the first aspect of the embodiment of the present invention.
本发明实施例第五方面公开了一种计算机程序产品，当所述计算机程序产品在计算机上运行时，使得所述计算机执行第一方面公开的基于手势识别的电子设备操作方法。The fifth aspect of the embodiment of the present invention discloses a computer program product. When the computer program product is run on a computer, the computer is made to execute the gesture recognition-based electronic device operating method disclosed in the first aspect.
与现有技术相比，本发明实施例具有以下有益效果：Compared with the prior art, the embodiments of the present invention have the following beneficial effects:
本发明实施例中，电子设备可以获取目标手势轨迹(例如，向下滑动)，并确定出目标手势轨迹相对于直线轨迹的偏离方向等的基本信息；再根据基本信息确定出该目标手势轨迹是左手画出还是右手画出亦或是左右手共同画出，这样能够增加方案的多样性同时还提高手势的识别准确率；进而，电子设备再将目标手势轨迹确定为对应的操作手的目标手势轨迹并执行相应的指令(例如，如果是左手向下滑动，则下拉菜单；如果是右手向下滑动，则呼出后台应用程序列表)，这样能够在未增加手势复杂程度的情况下提高用户操作任务的效率。综上所述，实施本发明实施例，能够通过提供更多的手势交互方案的方式提高手势交互方式的多样性。In the embodiment of the present invention, the electronic device can obtain the target gesture trajectory (for example, slide down), and determine the basic information such as the deviation direction of the target gesture trajectory relative to the straight line trajectory; and then determine the target gesture trajectory according to the basic information. Draw with the left hand, draw with the right hand, or draw with the left and right hands together, which can increase the diversity of the scheme and improve the accuracy of gesture recognition; furthermore, the electronic device determines the target gesture trajectory as the target gesture trajectory of the corresponding operator And execute the corresponding instructions (for example, if the left hand slides down, then pull down the menu; if the right hand slides down, then call out the background application list), this can improve the efficiency of the user's operation tasks without increasing the complexity of gestures. efficiency. To sum up, implementing the embodiments of the present invention can increase the diversity of gesture interaction modes by providing more gesture interaction solutions.
附图说明Description of drawings
为了更清楚地说明本发明实施例中的技术方案，下面将对实施例中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following will briefly introduce the accompanying drawings that need to be used in the embodiments. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For Those of ordinary skill in the art can also obtain other drawings based on these drawings without making creative efforts.
图1是本发明实施例公开的一种基于手势识别的电子设备操作方法的流程示意图；FIG. 1 is a schematic flowchart of a gesture recognition-based electronic device operating method disclosed in an embodiment of the present invention;
图2是本发明实施例公开的另一种基于手势识别的电子设备操作方法的流程示意图；Fig. 2 is a schematic flowchart of another electronic device operating method based on gesture recognition disclosed by an embodiment of the present invention;
图3是本发明实施例公开的一种电子设备的结构示意图；Fig. 3 is a schematic structural diagram of an electronic device disclosed in an embodiment of the present invention;
图4是本发明实施例公开的另一种电子设备的结构示意图；Fig. 4 is a schematic structural diagram of another electronic device disclosed in an embodiment of the present invention;
图5是本发明实施例公开的又一种电子设备的结构示意图。FIG. 5 is a schematic structural diagram of another electronic device disclosed in an embodiment of the present invention.
具体实施方式Detailed ways
下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.
需要说明的是，本发明实施例及附图中的术语“包括”和“具有”以及它们任何变形，意图在于覆盖不排他的包含。例如包含了一系列步骤或单元的过程、方法、系统、产品或设备没有限定于已列出的步骤或单元，而是可选地还包括没有列出的步骤或单元，或可选地还包括对于这些过程、方法、产品或设备固有的其它步骤或单元。It should be noted that the terms "include" and "have" and any variations thereof in the embodiments of the present invention and drawings are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device comprising a series of steps or units is not limited to the listed steps or units, but optionally also includes unlisted steps or units, or optionally further includes For other steps or units inherent in these processes, methods, products or apparatuses.
本发明实施例公开了一种基于手势识别的电子设备操作方法及电子设备，能够提高手势交互方式的多样性。以下分别进行详细说明。The embodiment of the present invention discloses a gesture recognition-based electronic equipment operation method and electronic equipment, which can improve the diversity of gesture interaction modes. Each will be described in detail below.
实施例一Embodiment one
请参阅图1，图1是本发明实施例公开的一种基于手势识别的电子设备操作方法的流程示意图。如图1所示该基于手势识别的电子设备操作方法可以包括以下步骤：Please refer to FIG. 1 . FIG. 1 is a schematic flowchart of an electronic device operating method based on gesture recognition disclosed by an embodiment of the present invention. As shown in Figure 1, the electronic device operating method based on gesture recognition may include the following steps:
101、电子设备获取目标手势轨迹。101. The electronic device acquires a target gesture trajectory.
本发明实施例中，电子设备可以通过触摸屏、摄像头以及激光传感器中至少一种获取目标手势轨迹，本发明实施例不作限定。目标手势轨迹可以是二维轨迹也可以是三维轨迹，本发明实施例不作限定。In the embodiment of the present invention, the electronic device may obtain the target gesture trajectory through at least one of a touch screen, a camera, and a laser sensor, which is not limited in the embodiment of the present invention. The target gesture trajectory may be a two-dimensional trajectory or a three-dimensional trajectory, which is not limited in this embodiment of the present invention.
102、电子设备确定与目标手势轨迹对应的基本信息；其中，基本信息至少包括目标手势轨迹相对于直线轨迹的偏离方向。102. The electronic device determines basic information corresponding to a target gesture track; wherein, the basic information includes at least a deviation direction of the target gesture track relative to a straight line track.
本发明实施例中，基本信息还可以包括目标手势轨迹的起始位置、终止位置和相对于直线轨迹的偏离程度。其中，人手在屏幕上进行快捷手势操作时受到生理结构的限制，也就是说，如果人手握住电子设备的边缘并通过大拇指在屏幕上划出一条轨迹，这条轨迹则不是直线而是以大拇指与手掌之间的关节点为圆心点在屏幕上画出的一道类似弧线的曲线。电子设备可以通过确定类似弧线的曲线的弧心来确定出目标手势轨迹的操作手(例如，左手)，提高对目标手势轨迹的识别准确度。In the embodiment of the present invention, the basic information may also include the starting position, the ending position and the degree of deviation from the straight line track of the target gesture track. Among them, the human hand is limited by the physiological structure when performing shortcut gestures on the screen. That is to say, if the human hand holds the edge of the electronic device and draws a track on the screen with the thumb, the track is not a straight line but a straight line. The joint point between the thumb and the palm is a curve similar to an arc drawn by the center point on the screen. The electronic device can determine the operating hand (for example, the left hand) of the target gesture track by determining the arc center of a curve similar to an arc, so as to improve the recognition accuracy of the target gesture track.
103、电子设备根据基本信息识别用于触发目标手势轨迹的操作手。103. The electronic device identifies the operating hand used to trigger the target gesture track according to the basic information.
可选的，电子设备根据基本信息识别用于触发目标手势轨迹的操作手的方式具体为：Optionally, the manner in which the electronic device identifies the operating hand used to trigger the target gesture track based on the basic information is specifically as follows:
电子设备可以根据基本信息中目标手势轨迹的起始位置、终止位置以及标手势轨迹相对于直线轨迹的偏离方向，判断目标手势轨迹的弧心在目标手势轨迹的左侧还是右侧；The electronic device can judge whether the arc center of the target gesture track is on the left or the right side of the target gesture track according to the starting position and ending position of the target gesture track in the basic information and the deviation direction of the target gesture track relative to the straight line track;
如果在目标手势轨迹的左侧，电子设备确定操作手为左手；如果在目标手势轨迹的右侧，电子设备确定操作手为右手。If it is on the left side of the target gesture track, the electronic device determines that the operating hand is the left hand; if it is on the right side of the target gesture track, the electronic device determines that the operating hand is the right hand.
可见，实施该可选的实施方式，能够通过对目标手势轨迹弧心的确定，进一步确定出画出目标手势轨迹的操作手，提高了对目标手势轨迹的识别准确性。It can be seen that, by implementing this optional embodiment, by determining the arc center of the target gesture trajectory, the operator who draws the target gesture trajectory can be further determined, and the recognition accuracy of the target gesture trajectory can be improved.
104、电子设备根据识别出的操作手以及目标手势轨迹，生成与操作手和目标手势轨迹相匹配的操作指令，并执行与操作指令相对应的操作，操作手包括左手、右手或左右手组合。104. The electronic device generates an operating instruction matching the operating hand and the target gesture trajectory according to the recognized operating hand and the target gesture trajectory, and executes an operation corresponding to the operating instruction. The operating hand includes a left hand, a right hand, or a combination of left and right hands.
另一种可选的，在步骤104根据识别出的操作手以及目标手势轨迹，生成与操作手和目标手势轨迹相匹配的操作指令之前，以及在步骤103根据基本信息识别用于触发目标手势轨迹的操作手之后，电子设备可以获取当前界面。其中，电子设备根据识别出的操作手以及目标手势轨迹，生成与操作手和目标手势轨迹相匹配的操作指令，可以包括：Alternatively, before step 104 generates an operation instruction that matches the operating hand and the target gesture trajectory based on the identified operating hand and the target gesture trajectory, and in step 103, the target gesture trajectory for triggering the target gesture is identified according to the basic information After the operator, the electronic device can obtain the current interface. Wherein, the electronic device generates an operation instruction matching the operator hand and the target gesture trajectory according to the recognized operator hand and the target gesture trajectory, which may include:
电子设备根据识别出的操作手、目标手势轨迹以及当前界面，生成与操作手、目标手势轨迹和当前界面相匹配的操作指令。The electronic device generates an operation instruction matching the operator hand, the target gesture track, and the current interface according to the recognized operator hand, target gesture track, and current interface.
举例来说，如果当前界面为视频播放界面、操作手为右手以及目标手势轨迹为上滑轨迹，则电子设备生成的操作指令为关闭当前视频的播放界面的关闭指令；For example, if the current interface is a video playback interface, the operating hand is the right hand, and the target gesture track is an upward sliding track, the operation instruction generated by the electronic device is a closing instruction to close the playback interface of the current video;
如果当前界面为视频播放界面、操作手为左手以及目标手势轨迹为上滑轨迹，则电子设备生成的操作指令为播放下一条视频的播放指令；If the current interface is a video playback interface, the operating hand is the left hand, and the target gesture track is an upward sliding track, the operation command generated by the electronic device is a play command for playing the next video;
如果当前界面为电子设备主界面、操作手为右手以及目标手势轨迹为上滑轨迹，则电子设备生成的操作指令为升高音量指令；If the current interface is the main interface of the electronic device, the operating hand is the right hand, and the target gesture track is the upward sliding track, the operation command generated by the electronic device is a volume-up command;
如果当前界面为电子设备主界面、操作手为左手以及目标手势轨迹为上滑轨迹，则电子设备生成的操作指令为呼出后台应用程序指令。If the current interface is the main interface of the electronic device, the operating hand is the left hand, and the target gesture track is the upward sliding track, the operation instruction generated by the electronic device is an instruction to call out the background application program.
可见，实施该另一种可选的实施方式，能够针对相同的手势轨迹结合当前界面的不同以及操作手的不同，生成不同的指令，相对于现有技术中只考虑手势轨迹和当前界面的方式，该可选的实施方式能够在不增加手势复杂程度的情况下，丰富手势交互方案，即由不同操作手触发的一个手势在相同的界面对应着不同的指令。It can be seen that implementing this other optional implementation mode can generate different instructions for the same gesture trajectory combined with the difference of the current interface and the difference of the operator, compared with the way in the prior art that only considers the gesture trajectory and the current interface , this optional implementation can enrich gesture interaction schemes without increasing the complexity of gestures, that is, a gesture triggered by different operators corresponds to different instructions on the same interface.
可见，实施图1所描述的方法，电子设备能够提高对目标手势轨迹的识别准确性；还能够在不增加手势复杂程度的情况下，丰富手势交互方案，即由不同操作手触发的相同手势在相同的界面对应着不同的指令。It can be seen that by implementing the method described in Figure 1, the electronic device can improve the recognition accuracy of the target gesture trajectory; it can also enrich the gesture interaction scheme without increasing the complexity of the gesture, that is, the same gesture triggered by different operators can be The same interface corresponds to different commands.
实施例二Embodiment two
请参阅图2，图2是本发明实施例公开的另一种基于手势识别的电子设备操作方法的流程示意图。如图2所示该基于手势识别的电子设备操作方法可以包括以下步骤：Please refer to FIG. 2 . FIG. 2 is a schematic flowchart of another electronic device operating method based on gesture recognition disclosed by an embodiment of the present invention. As shown in Figure 2, the electronic device operating method based on gesture recognition may include the following steps:
201、电子设备检测是否存在针对电子设备的触摸屏的用户操作，如果是，则执行步骤202，如果否，则执行步骤203。201. The electronic device detects whether there is a user operation on the touch screen of the electronic device, if yes, execute step 202, and if not, execute step 203.
202、电子设备识别用户操作在电子设备的触摸屏上的二维轨迹，作为目标手势轨迹，并执行步骤205。202. The electronic device recognizes the two-dimensional track operated by the user on the touch screen of the electronic device as the target gesture track, and executes step 205.
本发明实施例中，当步骤201的判断结果为是时，以及在执行步骤202之前，该基于手势识别的电子设备操作方法还可以包括以下操作：In the embodiment of the present invention, when the judgment result of step 201 is yes, and before step 202 is performed, the gesture recognition-based electronic device operating method may further include the following operations:
电子设备判断该用户操作是否为针对电子设备的触摸屏上显示的某一操作图标的触控操作，当判断结果为是时，电子设备执行与该某一操作图标对应的操作，如打开即时通讯应用的操作等；当判断结果为否时，触发执行步骤202。这样可以减少电子设备的误判断操作，提高识别目标手势轨迹的准确性。The electronic device judges whether the user operation is a touch operation for a certain operation icon displayed on the touch screen of the electronic device, and when the judgment result is yes, the electronic device performs an operation corresponding to the certain operation icon, such as opening an instant messaging application operations, etc.; when the judgment result is no, trigger the execution of step 202 . In this way, the misjudgment operation of the electronic device can be reduced, and the accuracy of identifying the trajectory of the target gesture can be improved.
203、电子设备基于机器视觉判断电子设备的视觉范围内是否存在目标手，目标手与预设手模型相匹配，如果是，则执行步骤204，如果否，则执行步骤203。203. The electronic device determines whether there is a target hand within the visual range of the electronic device based on machine vision, and the target hand matches the preset hand model. If yes, perform step 204; if not, perform step 203.
本发明实施例中，电子设备基于机器视觉判断电子设备的视觉范围内是否存在目标手时用到的技术可以包括模板匹配技术、统计分析技术以及神经网络技术中至少一种，本发明实施例不作限定。其中，模板匹配技术可以将待识别手势的特征参数与预设的模板特征参数进行比对，根据比对结果完成手势识别工作；统计分析技术可以通过统计样本特征向量来确定用于手势识别的分类器；神经网络技术具有分布性特点以及模式推广能力，能够在手势识别时有效的抗噪声和处理不完整模式。In the embodiment of the present invention, the technology used by the electronic device to determine whether there is a target hand within the visual range of the electronic device based on machine vision may include at least one of template matching technology, statistical analysis technology, and neural network technology. limited. Among them, the template matching technology can compare the characteristic parameters of the gesture to be recognized with the preset template characteristic parameters, and complete the gesture recognition work according to the comparison result; the statistical analysis technology can determine the classification for gesture recognition by statistical sample feature vectors Neural network technology has the characteristics of distribution and the ability to generalize patterns, which can effectively resist noise and deal with incomplete patterns in gesture recognition.
可选的，电子设备基于机器视觉判断电子设备的视觉范围内是否存在目标手的方式具体为：Optionally, the manner in which the electronic device judges whether there is a target hand within the visual range of the electronic device based on machine vision is specifically as follows:
电子设备通过电子设备的摄像头在视觉范围内进行图像采集，得到初始图像；The electronic device collects images within the visual range through the camera of the electronic device to obtain an initial image;
电子设备对初始图像进行图像预处理以得到目标图像；The electronic device performs image preprocessing on the initial image to obtain the target image;
电子设备对目标图像进行手特征提取，并根据对提取到的手特征和预设标准手特征进行比对，再根据比对结果判断电子设备的视觉范围内是否存在目标手。The electronic device extracts hand features from the target image, compares the extracted hand features with preset standard hand features, and then judges whether there is a target hand within the visual range of the electronic device according to the comparison result.
在该可选的实施例中，电子设备对初始图像进行的图像预处理中包括，对初始图像进行手势分割。其中，电子设备可以采用如下三种方法对初始图像进行手势分割：第一，电子设备可以基于对直方图的分割实现对初始图像的手势分割；第二，电子设备可以基于对局部区域(例如，初始图像的边缘)的信息的分割实现对初始图像的手势分割；第三，电子设备可以基于物理特征(例如，基于颜色空间的肤色聚类法)实现对初始图像的手势分割。本发明实施例不作限定。In this optional embodiment, the image preprocessing performed by the electronic device on the initial image includes performing gesture segmentation on the initial image. Among them, the electronic device can use the following three methods to perform gesture segmentation on the initial image: first, the electronic device can implement gesture segmentation on the initial image based on the segmentation of the histogram; edge of the original image) to realize the gesture segmentation of the original image; thirdly, the electronic device can realize the gesture segmentation of the initial image based on physical features (for example, based on the skin color clustering method in color space). The embodiments of the present invention are not limited.
在该可选的实施例中，电子设备对目标图像进行手特征提取得到的手特征可以包括轮廓特征、边缘特征、图像矩特征、图像特征向量以及区域直方图特征中至少一种，本发明实施例不作限定。In this optional embodiment, the hand features extracted by the electronic device from the target image may include at least one of contour features, edge features, image moment features, image feature vectors, and region histogram features. Examples are not limited.
可见，实施该可选的实施方式，能够通过对获取到的初始图像进行处理，以提取到图像中的手的特征，进而实现对手势的识别，能够增加手势识别方案，以及通过对二维手势和三维手势的识别，扩大识别范围。It can be seen that the implementation of this optional embodiment can process the acquired initial image to extract the features of the hand in the image, and then realize the recognition of gestures, which can increase the gesture recognition scheme, and through the recognition of two-dimensional gestures And three-dimensional gesture recognition, expanding the recognition range.
作为另一种可选的实施方式，电子设备可以基于机器视觉判断电子设备的视觉范围内是否存在目标手的方式具体为：As another optional implementation manner, the manner in which the electronic device can judge whether there is a target hand within the visual range of the electronic device based on machine vision is specifically as follows:
电子设备可以根据结构光技术，以及基于机器视觉判断电子设备的视觉范围内是否存在目标手。The electronic device can judge whether there is a target hand within the visual range of the electronic device based on structured light technology and machine vision.
在该另一种可选的实施方式中，电子设备可以利用结构光技术加载一个激光投射器，以及通过在激光投射器外面放一个刻有特定图样的光栅，从而使得激光最终在操作手上的落点产生位移。如果电子设备的视觉范围内存在目标手，且当目标手距离激光投射器比较近的时候，折射而产生的位移就较小；目标手距离激光投射器较远时，折射而产生的位移也就会相应的变大。这时可以使用电子设备的摄像头来检测采集投射到目标手上的图样，并通过图样的位移变化计算出目标手的位置和相对激光投射器的深度信息，进而复原目标手所在的整个三维空间。In another optional implementation, the electronic device can use structured light technology to load a laser projector, and by placing a grating engraved with a specific pattern on the outside of the laser projector, so that the laser is finally on the operator's hand The drop point generates displacement. If there is a target hand within the visual range of the electronic device, and when the target hand is closer to the laser projector, the displacement caused by refraction is smaller; when the target hand is farther away from the laser projector, the displacement caused by refraction is also smaller. will increase accordingly. At this time, the camera of the electronic device can be used to detect and collect the pattern projected on the target hand, and calculate the position of the target hand and the depth information relative to the laser projector through the displacement change of the pattern, and then restore the entire three-dimensional space where the target hand is located.
可见，实施该另一种可选的实施方式，能够通过结合结构光技术和机器视觉实现了对目标手的检测，在该方式中，不仅能够判断电子设备视觉范围内是否存在目标手，还能够确定目标手的位置，提高了对目标手的检测精度。It can be seen that implementing this other optional implementation mode can realize the detection of the target hand by combining structured light technology and machine vision. In this way, it can not only judge whether there is a target hand within the visual range of the electronic device, but also The position of the target hand is determined, and the detection accuracy of the target hand is improved.
作为又一种可选的实施方式，电子设备可以基于机器视觉判断电子设备的视觉范围内是否存在目标手的方式具体为：As yet another optional implementation manner, the manner in which the electronic device can judge whether there is a target hand within the visual range of the electronic device based on machine vision is specifically:
电子设备可以根据光飞时间技术，以及基于机器视觉判断电子设备的视觉范围内是否存在目标手。The electronic device can judge whether there is a target hand within the visual range of the electronic device based on the time-of-flight technology and machine vision.
在该又一种可选的实施方式中，电子设备可以根据光飞时间技术加载一个发光元件，由于发光元件发出的光子在碰到目标手表面后会反射回来，所以，电子设备可以使用一个特别的CMOS传感器来捕捉这些由发光元件发出、又从目标手表面反射回来的光子，就能得到光子的飞行时间。根据光子飞行时间进而可以推算出光子飞行的距离，也就得到了视觉范围内是否存在目标手，以及当目标手存在时，获取目标手的深度信息。In this yet another optional implementation, the electronic device can be loaded with a light-emitting element according to the time-of-flight technology. Since the photons emitted by the light-emitting element will be reflected back after hitting the surface of the target wrist, the electronic device can use a special A CMOS sensor is used to capture the photons emitted by the light-emitting element and reflected from the surface of the target wrist, and the time-of-flight of the photons can be obtained. According to the photon flight time, the distance of the photon flight can be calculated, and whether there is a target hand in the visual range can be obtained, and when the target hand exists, the depth information of the target hand can be obtained.
可见，实施该又一种可选的实施方式，通过光飞时间技术实现了对目标手的检测工作，能够利用光飞时间技术提高对目标手的识别精度。It can be seen that, implementing this yet another optional implementation manner, the detection of the target hand is realized through the light-of-flight technology, and the recognition accuracy of the target hand can be improved by using the light-time-of-flight technology.
作为再一种可选的实施方式，电子设备可以基于机器视觉判断电子设备的视觉范围内是否存在目标手的方式具体为：As yet another optional implementation manner, the manner in which the electronic device can judge whether there is a target hand within the visual range of the electronic device based on machine vision is specifically as follows:
电子设备可以根据多角成像技术，以及基于机器视觉判断电子设备的视觉范围内是否存在目标手。The electronic device can judge whether there is a target hand within the visual range of the electronic device based on the multi-angle imaging technology and machine vision.
在该再一种可选的实施方式中，电子设备可以通过至少两个摄像头同时摄取图像，通过比对不同摄像头在同一时刻获得的图像的差别，使用算法来计算深度信息，从而实现当视觉范围内存在目标手时，目标手的多角度三维成像。In yet another optional implementation, the electronic device can simultaneously capture images through at least two cameras, and use an algorithm to calculate the depth information by comparing the differences between the images obtained by different cameras at the same time, so as to realize when the visual range Multi-angle 3D imaging of the target hand when the target hand is present.
可见，实施该再一种可选的实施方式，能够通过多角度拍摄，实现目标手的影像的精准快速捕捉，提高了对目标手的识别效率。It can be seen that implementing this yet another optional implementation manner can realize accurate and fast capture of the image of the target hand through multi-angle shooting, and improve the recognition efficiency of the target hand.
204、电子设备识别目标手的动态三维手势，作为目标手势轨迹，并执行步骤205。204. The electronic device recognizes the dynamic three-dimensional gesture of the target hand as the target gesture trajectory, and executes step 205.
举例来说，动态三维手势可以是目标手在不接触电子设备的情况下做出从左向右煽动的动作，此时，目标手势轨迹可以是由左到右的一条轨迹(例如，弧线)。For example, a dynamic three-dimensional gesture may be an action in which the target hand incites from left to right without touching the electronic device. At this time, the trajectory of the target gesture may be a trajectory (for example, an arc) from left to right. .
205、电子设备确定与目标手势轨迹对应的基本信息；其中，基本信息至少包括目标手势轨迹相对于直线轨迹的偏离方向。205. The electronic device determines basic information corresponding to the target gesture track; where the basic information includes at least a deviation direction of the target gesture track relative to the straight line track.
本发明实施例中，在确定目标手势轨迹对应的基本信息之后，如果该目标手势轨迹为三维轨迹，则可以直接触发执行步骤208；如果该目标手势轨迹为二维轨迹，则可以直接触发步骤208，也可以直接触发执行步骤206(如图2所示)，本发明实施例不做限定。In the embodiment of the present invention, after determining the basic information corresponding to the target gesture track, if the target gesture track is a three-dimensional track, step 208 may be directly triggered; if the target gesture track is a two-dimensional track, step 208 may be directly triggered , may also directly trigger the execution of step 206 (as shown in FIG. 2 ), which is not limited in this embodiment of the present invention.
206、电子设备采集用户操作所对应的目标指纹。206. The electronic device collects target fingerprints corresponding to user operations.
本发明实施例中，在步骤206采集用户操作所对应的目标指纹之后，执行步骤207判断目标指纹是否与预设合法指纹相匹配的操作。In the embodiment of the present invention, after the target fingerprint corresponding to the user operation is collected in step 206, the operation of judging whether the target fingerprint matches the preset legitimate fingerprint in step 207 is performed.
207、电子设备判断目标指纹是否与预设合法指纹相匹配，如果是，则执行步骤208，如果否，则执行步骤207。207. The electronic device judges whether the target fingerprint matches the preset legitimate fingerprint, if yes, execute step 208, and if not, execute step 207.
本发明实施例中，电子设备可以通过对目标指纹的采集，提高了电子设备中信息的安全性，还能够通过结合目标指纹和目标手势轨迹的基本信息确定操作手，进而提高了目标手势轨迹的识别准确性。In the embodiment of the present invention, the electronic device can improve the security of information in the electronic device by collecting the target fingerprint, and can also determine the operating hand by combining the target fingerprint and the basic information of the target gesture track, thereby improving the accuracy of the target gesture track. recognition accuracy.
可选的，如果电子设备判断出目标指纹与预设合法指纹不匹配，电子设备可以不执行任何操作；也可以进行锁屏，以防止非法用户入侵；还可以通过虹膜识别技术判断当前用户是否为合法用户，如果否，则执行锁屏操作并检测是否存在与电子设备连接的可穿戴设备，如果存在，则向可穿戴设备发送用于提示电子设备被非合法用户使用的提示信息，本发明实施例不作限定。Optionally, if the electronic device judges that the target fingerprint does not match the preset legitimate fingerprint, the electronic device may not perform any operation; it may also lock the screen to prevent unauthorized users from intruding; it may also use iris recognition technology to determine whether the current user is The legal user, if not, performs a screen lock operation and detects whether there is a wearable device connected to the electronic device, and if so, sends a prompt message to the wearable device to prompt that the electronic device is used by an illegal user. The present invention implements Examples are not limited.
可见，执行该可选的实施方式，能够避免电子设备被非法用户使用，提高了电子设备的安全性。It can be seen that the execution of this optional implementation manner can prevent the electronic device from being used by illegal users and improve the security of the electronic device.
在本发明实施例中，该基于手势识别的电子设备操作方法还包括步骤208-步骤209，针对步骤208-步骤209的描述，请参照实施例一中针对步骤103-步骤104的详细描述，本发明实施例不再赘述。In this embodiment of the present invention, the gesture recognition-based electronic device operation method further includes steps 208-209. For the description of steps 208-209, please refer to the detailed description of steps 103-104 in Embodiment 1. This Embodiments of the invention will not be described in detail.
作为一种可选的实施方式，在该基于手势识别的电子设备操作方法中，基本信息还包括目标手势轨迹的起始位置；电子设备根据基本信息识别用于触发目标手势轨迹的操作手，可以包括以下步骤：As an optional implementation, in the gesture recognition-based electronic device operating method, the basic information also includes the starting position of the target gesture track; the electronic device identifies the operating hand used to trigger the target gesture track according to the basic information, and can Include the following steps:
当目标手势轨迹为二维轨迹时，电子设备确定起始位置的数量；When the target gesture trajectory is a two-dimensional trajectory, the electronic device determines the number of starting positions;
如果起始位置的数量大于或等于两个，电子设备判断距离值集合中是否存在大于预设距离的距离值，距离值集合由所有起始位置中任意两个起始位置之间的距离值组成；If the number of starting positions is greater than or equal to two, the electronic device judges whether there is a distance value greater than the preset distance in the distance value set, and the distance value set is composed of the distance values between any two starting positions in all starting positions ;
如果距离值集合中存在大于预设距离的距离值，电子设备确定触发目标手势轨迹的操作手为左右手组合；If there is a distance value greater than the preset distance in the distance value set, the electronic device determines that the operator triggering the target gesture trajectory is a combination of left and right hands;
如果距离值集合中不存在大于预设距离的距离值或如果起始位置的数量等于1时，电子设备根据目标手势轨迹相对于直线轨迹的偏离方向识别用于触发目标手势轨迹的操作手，其中，目标手势轨迹相对于直线轨迹的偏离方向为左时，操作手为左手，目标手势轨迹相对于直线轨迹的偏离方向为右时，操作手为右手。If there is no distance value greater than the preset distance in the distance value set or if the number of starting positions is equal to 1, the electronic device identifies the operating hand used to trigger the target gesture trajectory according to the deviation direction of the target gesture trajectory relative to the straight line trajectory, wherein , when the deviation direction of the target gesture trajectory relative to the straight trajectory is left, the operating hand is the left hand, and when the deviation direction of the target gesture trajectory relative to the straight trajectory is right, the operating hand is the right hand.
可见，实施该可选的实施方式，能够通过对起始位置的数量和起始位置之间距离的检测，更加精准的确定出操作手，以进一步提高对目标手势轨迹的识别准确性。It can be seen that implementing this optional implementation manner can more accurately determine the operator's hand by detecting the number of starting positions and the distance between the starting positions, so as to further improve the recognition accuracy of the target gesture trajectory.
作为另一种可选的实施方式，在该基于手势识别的电子设备操作方法中，电子设备根据基本信息识别用于触发目标手势轨迹的操作手的方式具体为：As another optional implementation manner, in the method for operating an electronic device based on gesture recognition, the manner in which the electronic device identifies the operating hand used to trigger the target gesture track based on basic information is specifically as follows:
电子设备根据目标指纹和基本信息识别用于触发目标手势轨迹的操作手。The electronic device identifies the operating hand used to trigger the target gesture trajectory based on the target fingerprint and basic information.
可见，实施该另一种可选的实施方式，能够通过结合目标指纹和目标手势轨迹的基本信息确定操作手，以提高对目标手势轨迹的识别准确性。It can be seen that, implementing this other optional implementation manner, the operating hand can be determined by combining the basic information of the target fingerprint and the target gesture track, so as to improve the recognition accuracy of the target gesture track.
可见，实施图2所描述的方法，电子设备能够提高对目标手势轨迹的识别准确性；还能够在不增加手势复杂程度的情况下，丰富手势交互方案，即一个手势在不同的界面对应着不同的指令；还能够通过对目标指纹的采集，提高了电子设备中信息的安全性，还能够通过结合目标指纹和目标手势轨迹的基本信息确定操作手，进一步提高了目标手势轨迹的识别准确性。It can be seen that by implementing the method described in Figure 2, the electronic device can improve the recognition accuracy of the target gesture trajectory; it can also enrich the gesture interaction scheme without increasing the complexity of the gesture, that is, a gesture corresponds to different gestures on different interfaces. It can also improve the security of information in the electronic device by collecting the target fingerprint, and can also determine the operator by combining the target fingerprint and the basic information of the target gesture track, further improving the recognition accuracy of the target gesture track.
实施例三Embodiment three
请参阅图3，图3是本发明实施例公开的一种电子设备的结构示意图。如图3所示，该电子设备可以包括：获取单元301、确定单元302、识别单元303以及生成单元304，其中：Please refer to FIG. 3 . FIG. 3 is a schematic structural diagram of an electronic device disclosed in an embodiment of the present invention. As shown in FIG. 3, the electronic device may include: an acquiring unit 301, a determining unit 302, an identifying unit 303, and a generating unit 304, wherein:
获取单元301，用于获取目标手势轨迹。The acquiring unit 301 is configured to acquire a target gesture trajectory.
本发明实施例中，获取单元301可以通过触摸屏、摄像头以及激光传感器中至少一种获取目标手势轨迹，本发明实施例不作限定。目标手势轨迹可以是二维轨迹也可以是三维轨迹，本发明实施例不作限定。In the embodiment of the present invention, the acquiring unit 301 may acquire the trajectory of the target gesture through at least one of a touch screen, a camera, and a laser sensor, which is not limited in this embodiment of the present invention. The target gesture trajectory may be a two-dimensional trajectory or a three-dimensional trajectory, which is not limited in this embodiment of the present invention.
本发明实施例中，在获取单元301获取目标手势轨迹之后，将目标手势轨迹提供给确定单元302和生成单元304。In the embodiment of the present invention, after the acquiring unit 301 acquires the target gesture track, the target gesture track is provided to the determining unit 302 and the generating unit 304 .
确定单元302，用于确定与目标手势轨迹对应的基本信息；其中，基本信息至少包括目标手势轨迹相对于直线轨迹的偏离方向。The determining unit 302 is configured to determine basic information corresponding to the target gesture trajectory; wherein, the basic information includes at least a deviation direction of the target gesture trajectory relative to the straight line trajectory.
本发明实施例中，基本信息还可以包括目标手势轨迹的起始位置、终止位置和相对于直线轨迹的偏离程度。其中，人手在屏幕上进行快捷手势操作时受到生理结构的限制，也就是说，如果人手握住电子设备的边缘并通过大拇指在屏幕上划出一条轨迹，这条轨迹则不是直线而是以大拇指与手掌之间的关节点为圆心点在屏幕上画出的一道类似弧线的曲线。确定单元302可以通过确定类似弧线的曲线的弧心来确定出目标手势轨迹的操作手(例如，左手)，提高对目标手势轨迹的识别准确度。In the embodiment of the present invention, the basic information may also include the starting position, the ending position and the degree of deviation from the straight line track of the target gesture track. Among them, the human hand is limited by the physiological structure when performing shortcut gestures on the screen. That is to say, if the human hand holds the edge of the electronic device and draws a track on the screen with the thumb, the track is not a straight line but a straight line. The joint point between the thumb and the palm is a curve similar to an arc drawn by the center point on the screen. The determining unit 302 can determine the operating hand (for example, the left hand) of the target gesture track by determining an arc center of a curve similar to an arc, so as to improve the recognition accuracy of the target gesture track.
本发明实施例中，在确定单元302确定与目标手势轨迹对应的基本信息之后，将基本信息提供给识别单元303。In the embodiment of the present invention, after the determination unit 302 determines the basic information corresponding to the target gesture trajectory, the basic information is provided to the recognition unit 303 .
识别单元303，用于根据基本信息识别用于触发目标手势轨迹的操作手。The identification unit 303 is configured to identify the operating hand used to trigger the target gesture track according to the basic information.
可选的，识别单元303根据基本信息识别用于触发目标手势轨迹的操作手的方式具体为：Optionally, the manner in which the identification unit 303 identifies the operating hand used to trigger the target gesture track according to the basic information is specifically as follows:
识别单元303可以根据基本信息中目标手势轨迹的起始位置、终止位置以及标手势轨迹相对于直线轨迹的偏离方向，判断目标手势轨迹的弧心在目标手势轨迹的左侧还是右侧；The recognition unit 303 can determine whether the arc center of the target gesture track is on the left or right side of the target gesture track according to the starting position, the ending position of the target gesture track in the basic information, and the deviation direction of the target gesture track relative to the straight line track;
如果在目标手势轨迹的左侧，识别单元303确定操作手为左手；如果在目标手势轨迹的右侧，识别单元303确定操作手为右手。If it is on the left side of the target gesture track, the identification unit 303 determines that the operating hand is the left hand; if it is on the right side of the target gesture track, the identification unit 303 determines that the operating hand is the right hand.
可见，实施该可选的实施方式，能够通过对目标手势轨迹弧心的确定，进一步确定出画出目标手势轨迹的操作手，提高了对目标手势轨迹的识别准确性。It can be seen that, by implementing this optional embodiment, by determining the arc center of the target gesture trajectory, the operator who draws the target gesture trajectory can be further determined, and the recognition accuracy of the target gesture trajectory can be improved.
本发明实施例中，在识别单元303根据基本信息识别用于触发目标手势轨迹的操作手之后，将识别出的操作手提供给生成单元304。In the embodiment of the present invention, after the identifying unit 303 identifies the operating hand used to trigger the target gesture track according to the basic information, the identified operating hand is provided to the generating unit 304 .
生成单元304，用于根据识别出的操作手以及目标手势轨迹，生成与操作手和目标手势轨迹相匹配的操作指令，并执行与操作指令相对应的操作，操作手包括左手、右手或左右手组合。The generation unit 304 is configured to generate an operation instruction matching the operation hand and the target gesture trajectory according to the recognized operation hand and the target gesture trajectory, and perform an operation corresponding to the operation instruction. The operation hand includes a left hand, a right hand, or a combination of left and right hands .
另一种可选的，在生成单元304根据识别出的操作手以及目标手势轨迹，生成与操作手和目标手势轨迹相匹配的操作指令之前，以及在识别单元303根据基本信息识别用于触发目标手势轨迹的操作手之后，生成单元304可以获取当前界面。其中，生成单元304根据识别出的操作手以及目标手势轨迹，生成与操作手和目标手势轨迹相匹配的操作指令，可以包括：Another option is that before the generating unit 304 generates an operation instruction that matches the operating hand and the target gesture trajectory according to the recognized operating hand and the target gesture trajectory, and before the identification unit 303 identifies the triggering target according to the basic information After the hand is operated on the gesture track, the generation unit 304 can acquire the current interface. Wherein, the generating unit 304 generates an operation instruction matching the operating hand and the target gesture trajectory according to the recognized operating hand and the target gesture trajectory, which may include:
生成单元304根据识别出的操作手、目标手势轨迹以及当前界面，生成与操作手、目标手势轨迹和当前界面相匹配的操作指令。The generating unit 304 generates an operation instruction that matches the operating hand, the target gesture track, and the current interface according to the recognized operating hand, the target gesture track, and the current interface.
可见，实施该另一种可选的实施方式，能够针对相同的手势轨迹结合当前界面的不同以及操作手的不同，生成不同的指令，相对于现有技术中只考虑手势轨迹和当前界面的方式，该可选的实施方式能够在不增加手势复杂程度的情况下，丰富手势交互方案，即由不同操作手触发的一个手势在相同的界面对应着不同的指令。It can be seen that implementing this other optional implementation mode can generate different instructions for the same gesture trajectory combined with the difference of the current interface and the difference of the operator, compared with the way in the prior art that only considers the gesture trajectory and the current interface , this optional implementation can enrich gesture interaction schemes without increasing the complexity of gestures, that is, a gesture triggered by different operators corresponds to different instructions on the same interface.
可见，实施图3所描述的电子设备能够提高对目标手势轨迹的识别准确性；还能够在不增加手势复杂程度的情况下，丰富手势交互方案，即由不同操作手触发的相同手势在相同的界面对应着不同的指令。It can be seen that the implementation of the electronic device described in Figure 3 can improve the recognition accuracy of the target gesture trajectory; it can also enrich the gesture interaction scheme without increasing the complexity of the gesture, that is, the same gesture triggered by different operators in the same The interface corresponds to different commands.
实施例四Embodiment Four
请参阅图4，图4是本发明实施例公开的另一种电子设备的结构示意图。其中，图4所示的电子设备是由图3所示的电子设备进行优化得到的。与图3所示的电子设备相比较，获取单元301可以包括检测子单元3011、识别子单元3012以及判断子单元3013。其中：Please refer to FIG. 4 . FIG. 4 is a schematic structural diagram of another electronic device disclosed in an embodiment of the present invention. Wherein, the electronic device shown in FIG. 4 is obtained by optimizing the electronic device shown in FIG. 3 . Compared with the electronic device shown in FIG. 3 , the acquiring unit 301 may include a detecting subunit 3011 , an identifying subunit 3012 and a judging subunit 3013 . in:
检测子单元3011，用于检测是否存在针对电子设备的触摸屏的用户操作。The detection subunit 3011 is configured to detect whether there is a user operation on the touch screen of the electronic device.
识别子单元3012，用于在检测子单元3011检测到存在针对电子设备的触摸屏的用户操作之后，识别用户操作在电子设备的触摸屏上的二维轨迹，作为目标手势轨迹。The identification subunit 3012 is configured to identify the two-dimensional track of the user's operation on the touch screen of the electronic device as the target gesture track after the detection sub-unit 3011 detects that there is a user operation on the touch screen of the electronic device.
判断子单元3013，用于在检测子单元3011未检测到存在针对电子设备的触摸屏的用户操作之后，基于机器视觉判断电子设备的视觉范围内是否存在目标手，目标手与预设手模型相匹配。The judging subunit 3013 is used to judge whether there is a target hand within the visual range of the electronic device based on machine vision after the detection subunit 3011 does not detect that there is a user operation on the touch screen of the electronic device, and the target hand matches the preset hand model .
本发明实施例中，判断子单元3013基于机器视觉判断电子设备的视觉范围内是否存在目标手时用到的技术可以包括模板匹配技术、统计分析技术以及神经网络技术中至少一种，本发明实施例不作限定。其中，模板匹配技术可以将待识别手势的特征参数与预设的模板特征参数进行比对，根据比对结果完成手势识别工作；统计分析技术可以通过统计样本特征向量来确定用于手势识别的分类器；神经网络技术具有分布性特点以及模式推广能力，能够在手势识别时有效的抗噪声和处理不完整模式。In the embodiment of the present invention, the technology used by the judging subunit 3013 to judge whether there is a target hand in the visual range of the electronic device based on machine vision may include at least one of template matching technology, statistical analysis technology and neural network technology. Examples are not limited. Among them, the template matching technology can compare the characteristic parameters of the gesture to be recognized with the preset template characteristic parameters, and complete the gesture recognition work according to the comparison result; the statistical analysis technology can determine the classification for gesture recognition by statistical sample feature vectors Neural network technology has the characteristics of distribution and the ability to generalize patterns, which can effectively resist noise and deal with incomplete patterns in gesture recognition.
可选的，判断子单元3013基于机器视觉判断电子设备的视觉范围内是否存在目标手的方式具体为：Optionally, the judging subunit 3013 judges whether there is a target hand within the visual range of the electronic device based on machine vision, specifically as follows:
判断子单元3013通过电子设备的摄像头在视觉范围内进行图像采集，得到初始图像；The judging subunit 3013 collects images within the visual range through the camera of the electronic device to obtain an initial image;
判断子单元3013对初始图像进行图像预处理以得到目标图像；The judging subunit 3013 performs image preprocessing on the initial image to obtain the target image;
判断子单元3013对目标图像进行手特征提取，并根据对提取到的手特征和预设标准手特征进行比对，再根据比对结果判断电子设备的视觉范围内是否存在目标手。The judging subunit 3013 extracts hand features from the target image, compares the extracted hand features with preset standard hand features, and then judges whether there is a target hand within the visual range of the electronic device according to the comparison result.
在该可选的实施例中，判断子单元3013对初始图像进行的图像预处理中包括，对初始图像进行手势分割。其中，判断子单元3013可以采用如下三种方法对初始图像进行手势分割：第一，判断子单元3013可以基于对直方图的分割实现对初始图像的手势分割；第二，判断子单元3013可以基于对局部区域(例如，初始图像的边缘)的信息的分割实现对初始图像的手势分割；第三，判断子单元3013可以基于物理特征(例如，基于颜色空间的肤色聚类法)实现对初始图像的手势分割。本发明实施例不作限定。In this optional embodiment, the image preprocessing performed by the judging subunit 3013 on the initial image includes performing gesture segmentation on the initial image. Among them, the judging subunit 3013 can adopt the following three methods to perform gesture segmentation on the initial image: first, the judging subunit 3013 can realize the gesture segmentation of the initial image based on the segmentation of the histogram; The segmentation of the information of the local area (for example, the edge of the original image) realizes the gesture segmentation of the original image; third, the judgment subunit 3013 can realize the segmentation of the initial image based on physical features (for example, the skin color clustering method based on color space). gesture segmentation. The embodiments of the present invention are not limited.
在该可选的实施例中，判断子单元3013对目标图像进行手特征提取得到的手特征可以包括轮廓特征、边缘特征、图像矩特征、图像特征向量以及区域直方图特征中至少一种，本发明实施例不作限定。In this optional embodiment, the hand features obtained by the judgment subunit 3013 extracting hand features from the target image may include at least one of contour features, edge features, image moment features, image feature vectors, and region histogram features. The embodiments of the invention are not limited.
可见，实施该可选的实施方式，能够通过对获取到的初始图像进行处理，以提取到图像中的手的特征，进而实现对手势的识别，能够增加手势识别方案，以及通过对二维手势和三维手势的识别，扩大识别范围。It can be seen that the implementation of this optional embodiment can process the acquired initial image to extract the features of the hand in the image, and then realize the recognition of gestures, which can increase the gesture recognition scheme, and through the recognition of two-dimensional gestures And three-dimensional gesture recognition, expanding the recognition range.
作为另一种可选的实施方式，判断子单元3013可以基于机器视觉判断电子设备的视觉范围内是否存在目标手的方式具体为：As another optional implementation manner, the judging subunit 3013 may judge whether there is a target hand within the visual range of the electronic device based on machine vision, specifically as follows:
判断子单元3013可以根据结构光技术，以及基于机器视觉判断电子设备的视觉范围内是否存在目标手。The judging subunit 3013 can judge whether there is a target hand within the visual range of the electronic device based on structured light technology and machine vision.
在该另一种可选的实施方式中，判断子单元3013可以利用结构光技术加载一个激光投射器，以及通过在激光投射器外面放一个刻有特定图样的光栅，从而使得激光最终在操作手上的落点产生位移。如果电子设备的视觉范围内存在目标手，且当目标手距离激光投射器比较近的时候，折射而产生的位移就较小；目标手距离激光投射器较远时，折射而产生的位移也就会相应的变大。这时可以使用电子设备的摄像头来检测采集投射到目标手上的图样，并通过图样的位移变化计算出目标手的位置和相对激光投射器的深度信息，进而复原目标手所在的整个三维空间。In another optional implementation, the judging subunit 3013 can use structured light technology to load a laser projector, and place a grating engraved with a specific pattern on the outside of the laser projector, so that the laser is finally in the hands of the operator. The drop point above produces displacement. If there is a target hand within the visual range of the electronic device, and when the target hand is closer to the laser projector, the displacement caused by refraction is smaller; when the target hand is farther away from the laser projector, the displacement caused by refraction is also smaller. will increase accordingly. At this time, the camera of the electronic device can be used to detect and collect the pattern projected on the target hand, and calculate the position of the target hand and the depth information relative to the laser projector through the displacement change of the pattern, and then restore the entire three-dimensional space where the target hand is located.
可见，实施该另一种可选的实施方式，能够通过结合结构光技术和机器视觉实现了对目标手的检测，在该方式中，不仅能够判断电子设备视觉范围内是否存在目标手，还能够确定目标手的位置，提高了对目标手的检测精度。It can be seen that implementing this other optional implementation mode can realize the detection of the target hand by combining structured light technology and machine vision. In this way, it can not only judge whether there is a target hand within the visual range of the electronic device, but also The position of the target hand is determined, and the detection accuracy of the target hand is improved.
作为又一种可选的实施方式，判断子单元3013可以基于机器视觉判断电子设备的视觉范围内是否存在目标手的方式具体为：As yet another optional implementation manner, the judging subunit 3013 may judge whether there is a target hand within the visual range of the electronic device based on machine vision, specifically as follows:
判断子单元3013可以根据光飞时间技术，以及基于机器视觉判断电子设备的视觉范围内是否存在目标手。The judging subunit 3013 can judge whether there is a target hand within the visual range of the electronic device based on the time-of-flight technology and machine vision.
在该又一种可选的实施方式中，判断子单元3013可以根据光飞时间技术加载一个发光元件，由于发光元件发出的光子在碰到目标手表面后会反射回来，所以，判断子单元3013可以使用一个特别的CMOS传感器来捕捉这些由发光元件发出、又从目标手表面反射回来的光子，就能得到光子的飞行时间。根据光子飞行时间进而可以推算出光子飞行的距离，也就得到了视觉范围内是否存在目标手，以及当目标手存在时，获取目标手的深度信息。In another optional implementation, the judging subunit 3013 can load a light-emitting element according to the light-of-flight technology. Since the photons emitted by the light-emitting element will be reflected back after hitting the surface of the target hand, the judging subunit 3013 A special CMOS sensor can be used to capture these photons emitted by the light-emitting element and reflected from the surface of the target wrist, and the time-of-flight of the photons can be obtained. According to the photon flight time, the distance of the photon flight can be calculated, and whether there is a target hand in the visual range can be obtained, and when the target hand exists, the depth information of the target hand can be obtained.
可见，实施该又一种可选的实施方式，通过光飞时间技术实现了对目标手的检测工作，能够利用光飞时间技术提高对目标手的识别精度。It can be seen that, implementing this yet another optional implementation manner, the detection of the target hand is realized through the light-of-flight technology, and the recognition accuracy of the target hand can be improved by using the light-time-of-flight technology.
作为再一种可选的实施方式，判断子单元3013可以基于机器视觉判断电子设备的视觉范围内是否存在目标手的方式具体为：As yet another optional implementation manner, the judging subunit 3013 may judge whether there is a target hand within the visual range of the electronic device based on machine vision, specifically as follows:
判断子单元3013可以根据多角成像技术，以及基于机器视觉判断电子设备的视觉范围内是否存在目标手。The judging subunit 3013 can judge whether there is a target hand within the visual range of the electronic device based on multi-angle imaging technology and machine vision.
在该再一种可选的实施方式中，判断子单元3013可以通过至少两个摄像头同时摄取图像，通过比对不同摄像头在同一时刻获得的图像的差别，使用算法来计算深度信息，从而实现当视觉范围内存在目标手时，目标手的多角度三维成像。In another optional implementation manner, the judging subunit 3013 can simultaneously capture images through at least two cameras, and use an algorithm to calculate the depth information by comparing the differences between the images obtained by different cameras at the same time, so as to realize when Multi-angle 3D imaging of the target hand when the target hand exists within the visual range.
可见，实施该再一种可选的实施方式，能够通过多角度拍摄，实现目标手的影像的精准快速捕捉，提高了对目标手的识别效率。It can be seen that implementing this yet another optional implementation manner can realize accurate and fast capture of the image of the target hand through multi-angle shooting, and improve the recognition efficiency of the target hand.
本发明实施例中，在判断子单元3013判断出存在目标手之后，触发识别子单元3012执行识别目标手的动态三维手势，作为目标手势轨迹的操作。In the embodiment of the present invention, after the judging subunit 3013 judges that there is a target hand, the trigger recognition subunit 3012 executes the operation of recognizing the dynamic three-dimensional gesture of the target hand as the trajectory of the target gesture.
识别子单元3012，还用于在判断子单元3013判断出存在目标手之后，识别目标手的动态三维手势，作为目标手势轨迹。The identification subunit 3012 is further configured to identify the dynamic three-dimensional gesture of the target hand as the target gesture track after the determination subunit 3013 determines that the target hand exists.
可选的，图4所示的电子设备还可以包括：采集单元305和判断单元306，其中：Optionally, the electronic device shown in FIG. 4 may further include: an acquisition unit 305 and a judging unit 306, wherein:
采集单元305，用于在识别单元303根据基本信息识别用于触发目标手势轨迹的操作手之前，且当获取单元301获取到的目标手势轨迹为二维轨迹时，采集用户操作所对应的目标指纹。The acquisition unit 305 is configured to collect the target fingerprint corresponding to the user operation before the identification unit 303 identifies the operating hand used to trigger the target gesture trajectory according to the basic information, and when the target gesture trajectory acquired by the acquisition unit 301 is a two-dimensional trajectory .
本发明实施例中，在采集单元305采集用户操作所对应的目标指纹之后，将目标指纹提供给判断单元306。In the embodiment of the present invention, after the collection unit 305 collects the target fingerprint corresponding to the user operation, the target fingerprint is provided to the judging unit 306 .
判断单元306，用于判断目标指纹是否与预设合法指纹相匹配。A judging unit 306, configured to judge whether the target fingerprint matches a preset legitimate fingerprint.
本发明实施例中，可以通过对目标指纹的采集，提高了电子设备中信息的安全性，还能够通过结合目标指纹和目标手势轨迹的基本信息确定操作手，进而提高了目标手势轨迹的识别准确性。In the embodiment of the present invention, the security of information in the electronic device can be improved by collecting the target fingerprint, and the operator can also be determined by combining the basic information of the target fingerprint and the target gesture track, thereby improving the accuracy of the recognition of the target gesture track sex.
可选的，如果判断单元306判断出目标指纹与预设合法指纹不匹配，判断单元306可以不执行任何操作；也可以进行锁屏，以防止非法用户入侵；还可以通过虹膜识别技术判断当前用户是否为合法用户，如果否，则执行锁屏操作并检测是否存在与电子设备连接的可穿戴设备，如果存在，则向可穿戴设备发送用于提示电子设备被非合法用户使用的提示信息，本发明实施例不作限定。Optionally, if the judging unit 306 judges that the target fingerprint does not match the preset legitimate fingerprint, the judging unit 306 may not perform any operation; it may also lock the screen to prevent unauthorized users from invading; it may also judge the current user through iris recognition technology. Whether it is a legal user, if not, perform the lock screen operation and detect whether there is a wearable device connected to the electronic device, and if it exists, send a prompt message to the wearable device to prompt that the electronic device is used by an illegal user. The embodiments of the invention are not limited.
可见，执行该可选的实施方式，能够避免电子设备被非法用户使用，提高了电子设备的安全性。It can be seen that the execution of this optional implementation manner can prevent the electronic device from being used by illegal users and improve the security of the electronic device.
识别单元303，具体用于在判断单元306判断出目标指纹与预设合法指纹相匹配之后，根据基本信息识别用于触发目标手势轨迹的操作手。The identification unit 303 is specifically configured to identify the operating hand used to trigger the target gesture trajectory according to the basic information after the determination unit 306 determines that the target fingerprint matches the preset legal fingerprint.
作为一种可选的实施方式，基本信息还包括目标手势轨迹的起始位置；As an optional implementation manner, the basic information also includes the starting position of the target gesture track;
其中，识别单元303根据基本信息识别用于触发目标手势轨迹的操作手的方式具体为：Wherein, the manner in which the recognition unit 303 recognizes the operating hand used to trigger the target gesture trajectory according to the basic information is specifically as follows:
当目标手势轨迹为二维轨迹时，确定起始位置的数量；When the target gesture trajectory is a two-dimensional trajectory, determine the number of starting positions;
在确定出起始位置的数量大于或等于两个之后，判断距离值集合中是否存在大于预设距离的距离值，距离值集合由所有起始位置中任意两个起始位置之间的距离值组成；After determining that the number of starting positions is greater than or equal to two, it is judged whether there is a distance value greater than the preset distance in the distance value set, and the distance value set consists of the distance value between any two starting positions in all starting positions composition;
在判断出距离值集合中存在大于预设距离的距离值之后，确定触发目标手势轨迹的操作手为左右手组合；After judging that there is a distance value greater than the preset distance in the distance value set, it is determined that the operating hand that triggers the target gesture trajectory is a combination of left and right hands;
在确定出的起始位置的数量等于1之后，或在判断出距离值集合中不存在大于预设距离的距离值之后，根据目标手势轨迹相对于直线轨迹的偏离方向识别用于触发目标手势轨迹的操作手，其中，目标手势轨迹相对于直线轨迹的偏离方向为左时，操作手为左手，目标手势轨迹相对于直线轨迹的偏离方向为右时，操作手为右手。After the number of determined starting positions is equal to 1, or after it is determined that there is no distance value greater than the preset distance in the distance value set, identify the target gesture trajectory for triggering according to the deviation direction of the target gesture trajectory relative to the straight line trajectory Wherein, when the deviation direction of the target gesture trajectory relative to the straight trajectory is left, the operator hand is the left hand, and when the deviation direction of the target gesture trajectory relative to the straight trajectory is right, the operator hand is the right hand.
可见，执行该可选的实施方式，能够通过对起始位置的数量和起始位置之间距离的检测，更加精准的确定出操作手，以进一步提高对目标手势轨迹的识别准确性。It can be seen that by implementing this optional implementation manner, the operator can be more accurately determined by detecting the number of starting positions and the distance between the starting positions, so as to further improve the recognition accuracy of the target gesture trajectory.
作为另一种可选的实施方式，识别单元303根据基本信息识别用于触发目标手势轨迹的操作手的方式具体为：根据目标指纹和基本信息识别用于触发目标手势轨迹的操作手。As another optional implementation manner, the manner in which the identifying unit 303 identifies the operating hand used to trigger the target gesture track according to the basic information is specifically: identifying the operating hand used to trigger the target gesture track according to the target fingerprint and the basic information.
可见，执行该另一种可选的实施方式，能够通过结合目标指纹和目标手势轨迹的基本信息确定操作手，以提高对目标手势轨迹的识别准确性。It can be seen that, by implementing another optional implementation manner, the operating hand can be determined by combining the basic information of the target fingerprint and the target gesture track, so as to improve the recognition accuracy of the target gesture track.
可见，实施图4所描述的电子设备能够提高对目标手势轨迹的识别准确性；还能够在不增加手势复杂程度的情况下，丰富手势交互方案，即一个手势在不同的界面对应着不同的指令；还能够通过对目标指纹的采集，提高了电子设备中信息的安全性，还能够通过结合目标指纹和目标手势轨迹的基本信息确定操作手，进一步提高了目标手势轨迹的识别准确性。It can be seen that the implementation of the electronic device described in Figure 4 can improve the recognition accuracy of the target gesture trajectory; it can also enrich the gesture interaction scheme without increasing the complexity of the gesture, that is, a gesture corresponds to different commands on different interfaces It can also improve the security of information in the electronic device by collecting the target fingerprint, and can also determine the operator by combining the basic information of the target fingerprint and the target gesture track, further improving the recognition accuracy of the target gesture track.
实施例五Embodiment five
请参阅图5，图5是本发明实施例公开的又一种电子设备的结构示意图。如图5所示，该电子设备可以包括：Please refer to FIG. 5 . FIG. 5 is a schematic structural diagram of another electronic device disclosed in an embodiment of the present invention. As shown in Figure 5, the electronic equipment may include:
存储有可执行程序代码的存储器501；A memory 501 storing executable program codes;
与存储器501耦合的处理器502；a processor 502 coupled to the memory 501;
其中，处理器502调用存储器501中存储的可执行程序代码，执行图1～图2任意一种基于手势识别的电子设备操作方法。Wherein, the processor 502 invokes the executable program code stored in the memory 501 to execute any one of the electronic device operating methods based on gesture recognition in FIG. 1 to FIG. 2 .
本发明实施例公开一种计算机可读存储介质，其存储计算机程序，其中，该计算机程序使得计算机执行图1～图2任意一种基于手势识别的电子设备操作方法。The embodiment of the present invention discloses a computer-readable storage medium, which stores a computer program, wherein the computer program enables the computer to execute any one of the gesture recognition-based electronic device operation methods shown in FIG. 1 to FIG. 2 .
本领域普通技术人员可以理解上述实施例的各种方法中的全部或部分步骤是可以通过程序来指令相关的硬件来完成，该程序可以存储于一计算机可读存储介质中，存储介质包括只读存储器(Read-Only Memory，ROM)、随机存储器(Random Access Memory，RAM)、可编程只读存储器(Programmable Read-only Memory，PROM)、可擦除可编程只读存储器(Erasable Programmable Read Only Memory，EPROM)、一次可编程只读存储器(One-time Programmable Read-Only Memory，OTPROM)、电子抹除式可复写只读存储器(Electrically-Erasable Programmable Read-Only Memory，EEPROM)、只读光盘(CompactDisc Read-Only Memory，CD-ROM)或其他光盘存储器、磁盘存储器、磁带存储器、或者能够用于携带或存储数据的计算机可读的任何其他介质。Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above-mentioned embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium, and the storage medium includes read-only Memory (Read-Only Memory, ROM), Random Access Memory (Random Access Memory, RAM), Programmable Read-Only Memory (Programmable Read-only Memory, PROM), Erasable Programmable Read-Only Memory (Erasable Programmable Read Only Memory, EPROM), One-time Programmable Read-Only Memory (OTPROM), Electronically Erasable Programmable Read-Only Memory (EEPROM), Compact Disc Read-Only Memory (CompactDisc Read -Only Memory, CD-ROM) or other optical disk storage, magnetic disk storage, tape storage, or any other computer-readable medium that can be used to carry or store data.
在上述实施例中，可全部或部分地通过软件、硬件、固件或其任意组合来实现。当使用软件实现时，可全部或部分地以计算机程序产品的形式实现。所述计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行所述计算机程序指令时，全部或部分地产生按照本申请实施例所述的流程或功能。所述计算机可为通用计算机、专用计算机、计算机网络、或者其他可编程装置。所述计算机指令可以存储在计算机可读存储介质中，或者从一个计算机可读存储介质向另一个计算机可读存储介质传输，例如，所述计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如同轴光缆、光纤、数字用户线)或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心传输。所述计算机可读介质可以是计算机能够存取的任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。所述可用介质可以是磁性介质(磁性介质例如可以是软盘、硬盘、磁带)、光介质(例如光盘)、或半导体介质(例如固态硬盘)等。在上述实施例中，对各个实施例的描述都各有侧重，某个实施例中没有详述的部分，可以参见其他实施例的相关描述。In the above embodiments, all or part may be implemented by software, hardware, firmware or any combination thereof. When implemented using software, it may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the processes or functions according to the embodiments of the present application will be generated in whole or in part. The computer can be a general purpose computer, a special purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website, computer, server or data center Transmission to another website site, computer, server, or data center by wired (eg, coaxial cable, optical fiber, DSL) or wireless (eg, infrared, wireless, microwave, etc.) means. The computer-readable medium may be any available medium that can be accessed by a computer, or a data storage device such as a server or a data center integrated with one or more available media. The available medium may be a magnetic medium (such as a floppy disk, a hard disk, or a magnetic tape), an optical medium (such as an optical disk), or a semiconductor medium (such as a solid-state hard disk). In the foregoing embodiments, the descriptions of each embodiment have their own emphases, and for parts not described in detail in a certain embodiment, reference may be made to relevant descriptions of other embodiments.
在本申请所提供的几个实施例中，应该理解到，所揭露的装置，可以通过其它的方式来实现。例如，以上所描述的装置实施例仅仅是示意性的，例如上述单元的划分，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式，例如多个单元或组件可以结合或者可以集成到另一个系统，或一些特征可以忽略，或不执行。另一点，所显示或者讨论的相互之间的耦合或直接耦合或通信连接可以通过一些接口，装置或单元的间接耦合或通信连接，可以是电性或其它的形式。In the several embodiments provided in this application, it should be understood that the disclosed device may be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the above units is only a logical function division. In actual implementation, there may be other division methods, for example, multiple units or components can be combined or integrated. to another system, or some features may be ignored, or not implemented. In another point, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical or other forms.
上述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可位于一个地方，或者也可以分布到多个网络单元上。可根据实际的需要选择其中的部分或全部单元来实现本实施例方案的目的。The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, located in one place, or distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
另外，在本申请各实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现，也可以采用软件功能单元的形式实现。In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.
上述集成的单元若以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可获取的存储器。基于这样的理解，本申请的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或者部分，可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储器中，包括若干请求用以使得一台计算机设备(可以为个人计算机、服务器或者网络设备等，具体可以是计算机设备中的处理器)执行本申请的各个实施例上述方法的全部或部分步骤。If the above-mentioned integrated units are realized in the form of software function units and sold or used as independent products, they can be stored in a computer-accessible memory. Based on this understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product, and the computer software product is stored in a memory , including several requests to make a computer device (which may be a personal computer, server, or network device, etc., specifically, a processor in the computer device) execute all or part of the steps of the above-mentioned methods in various embodiments of the present application.
以上所述，以上实施例仅用以说明本申请的技术方案而非对其限制；尽管参照前述实施例对本申请进行了详细的说明，然而本领域的普通技术人员应当理解；其依然可以对前述各实施例所记载的技术方案进行修改，或者对其中部分技术特征进行等同替换；而这些修改或者替换，并不使相应技术方案的本质脱离本申请各实施例技术方案的精神和范围。As mentioned above, the above embodiments are only used to illustrate the technical solutions of the present application and not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand; The technical solutions described in each embodiment are modified, or some of the technical features are equivalently replaced; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the various embodiments of the application.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810333928.XACN108594995A (en) | 2018-04-13 | 2018-04-13 | Electronic equipment operation method based on gesture recognition and electronic equipment |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810333928.XACN108594995A (en) | 2018-04-13 | 2018-04-13 | Electronic equipment operation method based on gesture recognition and electronic equipment |
| Publication Number | Publication Date |
|---|---|
| CN108594995Atrue CN108594995A (en) | 2018-09-28 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810333928.XAPendingCN108594995A (en) | 2018-04-13 | 2018-04-13 | Electronic equipment operation method based on gesture recognition and electronic equipment |
| Country | Link |
|---|---|
| CN (1) | CN108594995A (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110532755A (en)* | 2019-08-09 | 2019-12-03 | 北京三快在线科技有限公司 | A kind of method and device of computer implemented risk identification |
| CN111177677A (en)* | 2018-11-09 | 2020-05-19 | 天梭股份有限公司 | Method for face authentication of watch wearers |
| CN111221406A (en)* | 2018-11-23 | 2020-06-02 | 杭州萤石软件有限公司 | Information interaction method and device |
| WO2021238866A1 (en)* | 2020-05-28 | 2021-12-02 | Oppo广东移动通信有限公司 | Application display method, terminal, and computer readable storage medium |
| CN114167980A (en)* | 2021-11-18 | 2022-03-11 | 深圳市鸿合创新信息技术有限责任公司 | Gesture processing method and device, electronic equipment and readable storage medium |
| CN114168939A (en)* | 2021-11-09 | 2022-03-11 | 北京中交兴路信息科技有限公司 | Method, device, electronic device and medium for identifying user operation behavior |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1942853A (en)* | 2004-05-06 | 2007-04-04 | 苹果电脑有限公司 | multi-touch screen |
| CN102147676A (en)* | 2009-12-28 | 2011-08-10 | 索尼公司 | Operation direction determination apparatus, remote operating system, operation direction determination method and program |
| CN102640102A (en)* | 2009-10-01 | 2012-08-15 | 索尼公司 | Information processing device, information processing method and program |
| WO2012126426A2 (en)* | 2012-05-21 | 2012-09-27 | 华为技术有限公司 | Method and device for contact-free control by hand gesture |
| CN102768595A (en)* | 2011-11-23 | 2012-11-07 | 联想(北京)有限公司 | Method and device for identifying touch operation instructions on touch screen |
| CN102880405A (en)* | 2011-06-29 | 2013-01-16 | 索尼公司 | Information processing apparatus, information processing method, program and remote control system |
| CN103324274A (en)* | 2012-03-22 | 2013-09-25 | 联想(北京)有限公司 | Method and device for man-machine interaction |
| CN103365599A (en)* | 2013-07-31 | 2013-10-23 | 广州市动景计算机科技有限公司 | Mobile terminal operation optimizing method and device based on screen sliding track |
| CN103576910A (en)* | 2012-08-06 | 2014-02-12 | 联想(北京)有限公司 | Information processing method and electronic device |
| CN103677438A (en)* | 2012-09-10 | 2014-03-26 | 联想(北京)有限公司 | Data processing method and electronic device |
| CN104133635A (en)* | 2014-07-23 | 2014-11-05 | 百度在线网络技术（北京）有限公司 | Method and device for judging handheld state of terminal |
| CN104781769A (en)* | 2013-03-11 | 2015-07-15 | 夏普株式会社 | Portable device |
| CN104932825A (en)* | 2015-06-15 | 2015-09-23 | 金陵科技学院 | Method for automatically sensing left hand/right hand to operate mobile phone and determining moving thermal region of thumb |
| CN105224085A (en)* | 2015-09-30 | 2016-01-06 | 宇龙计算机通信科技(深圳)有限公司 | A kind of handheld device mode of operation recognition methods and handheld device |
| CN105302303A (en)* | 2015-10-15 | 2016-02-03 | 广东欧珀移动通信有限公司 | Game control method and device, and mobile terminal |
| CN105607850A (en)* | 2015-12-17 | 2016-05-25 | 小米科技有限责任公司 | Gripping way determination method and device |
| CN105718186A (en)* | 2014-12-18 | 2016-06-29 | 苹果公司 | Electronic Devices with Hand Detection Circuitry |
| CN105930067A (en)* | 2016-04-19 | 2016-09-07 | 青岛海信移动通信技术股份有限公司 | Page control method and apparatus as well as terminal device |
| CN106062672A (en)* | 2014-02-26 | 2016-10-26 | 微软技术许可有限责任公司 | Device control |
| CN107741781A (en)* | 2017-09-01 | 2018-02-27 | 中国科学院深圳先进技术研究院 | Flight control method and device of unmanned aerial vehicle, unmanned aerial vehicle and storage medium |
| CN107765848A (en)* | 2017-09-04 | 2018-03-06 | 中山大学 | A kind of control method and device of projected image |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1942853A (en)* | 2004-05-06 | 2007-04-04 | 苹果电脑有限公司 | multi-touch screen |
| CN102640102A (en)* | 2009-10-01 | 2012-08-15 | 索尼公司 | Information processing device, information processing method and program |
| CN102147676A (en)* | 2009-12-28 | 2011-08-10 | 索尼公司 | Operation direction determination apparatus, remote operating system, operation direction determination method and program |
| CN102880405A (en)* | 2011-06-29 | 2013-01-16 | 索尼公司 | Information processing apparatus, information processing method, program and remote control system |
| CN102768595A (en)* | 2011-11-23 | 2012-11-07 | 联想(北京)有限公司 | Method and device for identifying touch operation instructions on touch screen |
| CN103324274A (en)* | 2012-03-22 | 2013-09-25 | 联想(北京)有限公司 | Method and device for man-machine interaction |
| WO2012126426A2 (en)* | 2012-05-21 | 2012-09-27 | 华为技术有限公司 | Method and device for contact-free control by hand gesture |
| CN103576910A (en)* | 2012-08-06 | 2014-02-12 | 联想(北京)有限公司 | Information processing method and electronic device |
| CN103677438A (en)* | 2012-09-10 | 2014-03-26 | 联想(北京)有限公司 | Data processing method and electronic device |
| CN104781769A (en)* | 2013-03-11 | 2015-07-15 | 夏普株式会社 | Portable device |
| CN103365599A (en)* | 2013-07-31 | 2013-10-23 | 广州市动景计算机科技有限公司 | Mobile terminal operation optimizing method and device based on screen sliding track |
| CN106062672A (en)* | 2014-02-26 | 2016-10-26 | 微软技术许可有限责任公司 | Device control |
| CN104133635A (en)* | 2014-07-23 | 2014-11-05 | 百度在线网络技术（北京）有限公司 | Method and device for judging handheld state of terminal |
| CN105718186A (en)* | 2014-12-18 | 2016-06-29 | 苹果公司 | Electronic Devices with Hand Detection Circuitry |
| CN104932825A (en)* | 2015-06-15 | 2015-09-23 | 金陵科技学院 | Method for automatically sensing left hand/right hand to operate mobile phone and determining moving thermal region of thumb |
| CN105224085A (en)* | 2015-09-30 | 2016-01-06 | 宇龙计算机通信科技(深圳)有限公司 | A kind of handheld device mode of operation recognition methods and handheld device |
| CN105302303A (en)* | 2015-10-15 | 2016-02-03 | 广东欧珀移动通信有限公司 | Game control method and device, and mobile terminal |
| CN105607850A (en)* | 2015-12-17 | 2016-05-25 | 小米科技有限责任公司 | Gripping way determination method and device |
| CN105930067A (en)* | 2016-04-19 | 2016-09-07 | 青岛海信移动通信技术股份有限公司 | Page control method and apparatus as well as terminal device |
| CN107741781A (en)* | 2017-09-01 | 2018-02-27 | 中国科学院深圳先进技术研究院 | Flight control method and device of unmanned aerial vehicle, unmanned aerial vehicle and storage medium |
| CN107765848A (en)* | 2017-09-04 | 2018-03-06 | 中山大学 | A kind of control method and device of projected image |
| Title |
|---|
| 张毅: "《移动机器人技术基础与制作》", 31 January 2013* |
| 张燕翔: "《舞台展演交互式空间增强现实技术》", 28 February 2018* |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111177677A (en)* | 2018-11-09 | 2020-05-19 | 天梭股份有限公司 | Method for face authentication of watch wearers |
| US11977615B2 (en) | 2018-11-09 | 2024-05-07 | Tissot Sa | Method for facial authentication of a wearer of a watch |
| CN111221406A (en)* | 2018-11-23 | 2020-06-02 | 杭州萤石软件有限公司 | Information interaction method and device |
| CN111221406B (en)* | 2018-11-23 | 2023-10-13 | 杭州萤石软件有限公司 | Information interaction method and device |
| CN110532755A (en)* | 2019-08-09 | 2019-12-03 | 北京三快在线科技有限公司 | A kind of method and device of computer implemented risk identification |
| WO2021238866A1 (en)* | 2020-05-28 | 2021-12-02 | Oppo广东移动通信有限公司 | Application display method, terminal, and computer readable storage medium |
| CN114168939A (en)* | 2021-11-09 | 2022-03-11 | 北京中交兴路信息科技有限公司 | Method, device, electronic device and medium for identifying user operation behavior |
| CN114167980A (en)* | 2021-11-18 | 2022-03-11 | 深圳市鸿合创新信息技术有限责任公司 | Gesture processing method and device, electronic equipment and readable storage medium |
| CN114167980B (en)* | 2021-11-18 | 2024-05-07 | 深圳市鸿合创新信息技术有限责任公司 | Gesture processing method, gesture processing device, electronic equipment and readable storage medium |
| Publication | Publication Date | Title |
|---|---|---|
| CN108594995A (en) | Electronic equipment operation method based on gesture recognition and electronic equipment | |
| US11294470B2 (en) | Human-to-computer natural three-dimensional hand gesture based navigation method | |
| CN107643828B (en) | Vehicle and method of controlling vehicle | |
| JP6360050B2 (en) | Method and system for simultaneous human-computer gesture-based interaction using unique noteworthy points on the hand | |
| CN101878487B (en) | User interface device, user interface method, and recording medium | |
| CN104956292B (en) | The interaction of multiple perception sensing inputs | |
| CN108845668B (en) | Human-computer interaction system and method | |
| WO2013180151A1 (en) | Position-of-interest detection device, position-of-interest detection method, and position-of-interest detection program | |
| JP7489048B2 (en) | Gesture recognition device, system and program thereof | |
| JP5205187B2 (en) | Input system and input method | |
| US9063573B2 (en) | Method and system for touch-free control of devices | |
| TW201123031A (en) | Robot and method for recognizing human faces and gestures thereof | |
| KR101745651B1 (en) | System and method for recognizing hand gesture | |
| CN102467657A (en) | Gesture recognition system and method | |
| CN106125932A (en) | A method, device, and mobile terminal for identifying target objects in augmented reality | |
| JP5964603B2 (en) | Data input device and display device | |
| CN106951750A (en) | Method for switching modes of mobile terminal and mobile terminal | |
| CN111077997B (en) | Click-to-read control method in click-to-read mode and electronic equipment | |
| JP6230666B2 (en) | Data input device, data input method, and data input program | |
| WO2019095097A1 (en) | Identity authentication method for electronic terminal, and electronic terminal | |
| CN113412501A (en) | Information processing apparatus, information processing method, and recording medium | |
| KR101286750B1 (en) | Password estimation system using gesture. | |
| CN108132711A (en) | Playing progress bar control method and electronic equipment | |
| US20150103205A1 (en) | Method of controlling digital apparatus and image capture method by recognition of hand shape, and apparatus therefor | |
| CN102012769B (en) | Method and device for performing multi-point control on contents on screen by using camera |
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | Application publication date:20180928 | |
| RJ01 | Rejection of invention patent application after publication |