CN102253709A - Gesture judgment method and device - Google Patents

Abstract

The invention relates to a method and a device for judging gestures, which comprise a sensor and a controller for providing touch positions, and a processor for judging gestures according to continuous touch positions. The same gesture can be shared by a plurality of different application programs, and the processor can trigger corresponding commands according to the current foreground application program and the judged gesture.

Description

Translated fromChinese

手势判断的方法与装置Method and device for gesture judgment

技术领域technical field

本发明涉及一种手势判断的方法与装置，特别是涉及一种以相同手势相应不同应用程序的手势判断的方法与装置。The invention relates to a gesture judgment method and device, in particular to a gesture judgment method and device corresponding to different application programs with the same gesture.

背景技术Background technique

触控感应器(touch sensor或touch pad)或手写板(digitizer)可提供物件在其上方的侦测资讯，依据侦测资讯控制器可记录物件的移动路径(motion)，因此可以判断移动轨迹代表的手势(gesture或heuristic)，提供键盘与鼠标外的另一命令输入方式。The touch sensor (touch sensor or touch pad) or the digitizer can provide the detection information of the object above it, and the controller can record the movement path (motion) of the object according to the detection information, so it can determine the representative of the movement trajectory The gesture (gesture or heuristic) provides another command input method besides keyboard and mouse.

在现有技术中，手势大多用来模拟鼠标(mouse)的操作，或在特定应用程序中对应特定命令，例如在影像显示程序中以双指捏或张的手势分别提供缩小或放大的命令。相同的手势在不同的应用程序可能有不同的需求，当应用程序与作业系统都相应相同手势来执行不同命令时，便会有冲突的问题，因此应用程序与作业系统需要避开使用相同的手势。In the prior art, gestures are mostly used to simulate the operation of a mouse, or correspond to specific commands in specific applications, for example, in an image display program, pinch or pinch gestures with two fingers provide commands to zoom out or zoom in, respectively. The same gesture may have different requirements in different applications. When the application and the operating system execute different commands corresponding to the same gesture, there will be conflicts. Therefore, the application and the operating system need to avoid using the same gesture .

由此可见，上述现有技术显然存在有不便与缺陷，而极待加以进一步改进。为了解决上述存在的问题，相关厂商莫不费尽心思来谋求解决之道，但长久以来一直未见适用的设计被发展完成，而一般产品及方法又没有适切的结构及方法能够解决上述问题，此显然是相关业者急欲解决的问题。因此如何能创设一种新的技术，实属当前重要研发课题之一，亦成为当前业界极需改进的目标。This shows that above-mentioned prior art obviously has inconvenience and defective, and extremely waits to be further improved. In order to solve the above-mentioned problems, the relevant manufacturers have tried their best to find a solution, but no suitable design has been developed for a long time, and there is no suitable structure and method for general products and methods to solve the above-mentioned problems. This is obviously a problem that relevant industry players are eager to solve. Therefore, how to create a new technology is one of the important research and development topics at present, and it has also become a goal that the industry needs to improve.

发明内容Contents of the invention

本发明的主要目的在于，克服现有的手势判断的方法和装置，而提供一种新的手势判断的方法和装置，所要解决的技术问题是使其同一手势可共用于多个不同的应用程序，但相应于不同应用程序的不同命令，处理器可依据目前的前景应用程序与判断出来的手势，触发相应的命令，非常适于实用。The main purpose of the present invention is to overcome the existing method and device for gesture judgment, and provide a new method and device for gesture judgment. The technical problem to be solved is to make the same gesture common to multiple different application programs. , but corresponding to different commands of different application programs, the processor can trigger corresponding commands according to the current foreground application program and the judged gesture, which is very suitable for practical use.

本发明的目的及解决其技术问题是采用以下技术方案来实现的。依据本发明提出的手势判断的方法，包括以下步骤：提供一查表的步骤，查表记录至少一手势的例子，以及每一个手势相应的触发，其中任一触发相应一系统或一应用程序的一命令；由一感应器取得一侦测资讯的步骤；依据接收到的侦测资讯判断一个或多个物件靠近或触碰感应器的位置的步骤；依据一个或多个物件靠近或触碰感应器的位置判断出一个或多个物件的移动路径的步骤；匹配一个或多个物件的移动路径与至少一手势的例子，以判断出匹配的手势的步骤；匹配匹配的手势与至少一应用程序相应的触发，以判断出匹配的触发的步骤；以及在匹配的触发被判断出来时触发匹配的触发相应的命令的步骤。The purpose of the present invention and the solution to its technical problems are achieved by adopting the following technical solutions. The method for judging gestures according to the present invention includes the following steps: providing a table look-up step, which records at least one gesture example, and each gesture corresponding trigger, wherein any trigger corresponds to a system or an application program A command; a step of obtaining a detection information from a sensor; a step of judging the position of one or more objects approaching or touching the sensor according to the received detection information; according to one or more objects approaching or touching the sensor The step of determining the moving path of one or more objects based on the location of the device; matching the moving path of one or more objects with at least one gesture instance to determine a matching gesture; matching the matching gesture with at least one application program Corresponding triggers, a step of determining a matching trigger; and a step of triggering a corresponding command of the matching trigger when the matching trigger is determined.

本发明的目的及解决其技术问题还可采用以下技术措施进一步实现。The purpose of the present invention and its technical problems can also be further realized by adopting the following technical measures.

前述的手势判断的方法，其中所述的手势判断的方法还包括在所述匹配的手势与所述至少一应用程序相应的触发没有匹配时，匹配所述匹配的手势与所述系统相应的触发，以判断出所述匹配的触发的步骤。The aforementioned gesture judgment method, wherein the gesture judgment method further includes matching the matched gesture with the corresponding trigger of the system when the matched gesture does not match the corresponding trigger of the at least one application program , to determine the matching trigger step.

前述的手势判断的方法，其中所述的势判断的方法还包括判断目前执行中的前景应用程序的步骤，并且所述至少一应用程序包括所述前景应用程序。In the aforementioned method for gesture judgment, the method for gesture judgment further includes the step of judging the currently executing foreground application, and the at least one application includes the foreground application.

前述的手势判断的方法，其中所述的手势判断的方法还包括依据所述一个或多个物件的移动路径挑选多个应用程序的步骤，并且所述至少一应用程序包括所述被挑选的应用程序。The aforementioned gesture judgment method, wherein the gesture judgment method further includes the step of selecting a plurality of application programs according to the moving path of the one or more objects, and the at least one application program includes the selected application program program.

前述的手势判断的方法，其中所述的应用程序为被排序的应用程序，所述被排序的应用程序是依序匹配所述匹配的手势相应的触发，以最先匹配的触发作为所述匹配的触发。The aforementioned gesture judgment method, wherein the application program is a sorted application program, and the sorted application program matches the corresponding triggers of the matched gestures in sequence, and the first matching trigger is used as the matching trigger.

前述的手势判断的方法，其中所述的手势判断的方法还包括排序所述应用程序并且依据所述被排序的应用程序产生一触发查表的步骤，其中相应多个应用程序的手势在所述触发查表中相应于排序在先的应用程序的触发，并且所述匹配的触发是以所述匹配的手势匹配所述触发查表来判断。The aforementioned gesture judgment method, wherein the gesture judgment method further includes the step of sorting the applications and generating a trigger lookup table according to the sorted applications, wherein the gestures of the corresponding multiple applications are in the The trigger look-up table corresponds to the trigger of the application program that is sorted first, and the matching trigger is determined by matching the matching gesture with the trigger look-up table.

前述的手势判断的方法，其中所述的手势判断的方法还包括显示代表所述触发查表中相应的各手势的图像的步骤，其中所述触发查表是在所述匹配的手势被判断出来前随所述一个或多个物件的移动路径动态产生。The aforementioned gesture judgment method, wherein the gesture judgment method further includes the step of displaying images representing the corresponding gestures in the trigger look-up table, wherein the trigger look-up table is judged after the matching gesture The predecessor is dynamically generated along with the moving path of the one or more objects.

前述的手势判断的方法，其中所述的被挑选的应用程序包含一前景应用程序与至少一背景应用程序时，所述前景应用程序排序先于所述背景应用程序。In the aforementioned method for gesture judgment, wherein when the selected application program includes a foreground application program and at least one background application program, the foreground application program is sorted prior to the background application program.

前述的手势判断的方法，其中所述的被挑选的应用程序是依据所述一个或多个物件的移动路径的起始位置、结束位置或涵盖范围被判断出来。In the aforementioned gesture judgment method, the selected application program is judged according to the start position, end position or coverage of the moving path of the one or more objects.

前述的手势判断的方法，其中所述的手势判断的方法其中所述查表与连续的一个或多个物件靠近或触碰所述感应器的位置是储存于一储存单元。In the aforementioned method of gesture judgment, wherein in the method of gesture judgment, the look-up table and the positions of one or more consecutive objects approaching or touching the sensor are stored in a storage unit.

本发明的目的及解决其技术问题还采用以下技术方案来实现。依据本发明提出的手势判断的装置，其包括：一查表，记录至少一手势的例子，以及每一个手势相应的触发，其中任一触发相应一系统或一应用程序的一命令；一感应器，提供一侦测资讯；一控制器，依据接收到的侦测资讯判断一个或多个物件靠近或触碰感应器的位置；一处理器，其包括：依据一个或多个物件靠近或触碰感应器的位置判断出一个或多个物件的移动路径；匹配一个或多个物件的移动路径与至少一手势的例子，以判断出匹配的手势；匹配所述匹配的手势与至少一应用程序相应的触发，以判断出匹配的触发；以及在匹配的触发被判断出来时触发匹配的触发相应的命令。The purpose of the present invention and the solution to its technical problem also adopt the following technical solutions to achieve. According to the gesture judgment device proposed by the present invention, it includes: a look-up table, recording at least one gesture example, and a corresponding trigger for each gesture, wherein any trigger corresponds to a command of a system or an application program; a sensor , providing a detection information; a controller, judging the position of one or more objects approaching or touching the sensor according to the received detection information; a processor, which includes: according to one or more objects approaching or touching Determine the moving path of one or more objects based on the position of the sensor; match the moving path of one or more objects with at least one gesture instance to determine a matching gesture; match the matching gesture with at least one application program to determine the matching trigger; and when the matching trigger is determined, trigger the corresponding command of the matching trigger.

本发明的目的及解决其技术问题还可采用以下技术措施进一步实现。The purpose of the present invention and its technical problems can also be further realized by adopting the following technical measures.

前述的手势判断装置，其中所述的处理器还包括在所述匹配的手势与所述至少一应用程序相应的触发没有匹配时，匹配所述匹配的手势与所述系统相应的触发，以判断出所述匹配的触发。In the aforementioned gesture judging device, wherein the processor further includes matching the matched gesture with the corresponding trigger of the system when the matched gesture does not match the corresponding trigger of the at least one application program, to judge out the matching trigger.

前述的手势判断装置，其中所述的处理器还包括判断目前执行中的前景应用程序，并且所述至少一应用程序包括所述前景应用程序。In the aforementioned gesture judging device, wherein the processor further includes judging a currently executing foreground application, and the at least one application includes the foreground application.

前述的手势判断装置，其中所述的处理器还包括依据所述一个或多个物件的移动路径挑选多个应用程序，并且所述至少一应用程序包括所述被挑选的应用程序。In the aforementioned device for determining gestures, wherein the processor further includes selecting a plurality of application programs according to the moving paths of the one or more objects, and the at least one application program includes the selected application program.

前述的手势判断装置，其中所述的应用程序为被排序的应用程序，并且所述监视器是依序匹配所述被排序的应用程序与所述匹配的手势相应的触发，以最先匹配的触发作为所述匹配的触发。The aforementioned gesture judging device, wherein the applications are sorted applications, and the monitor matches the triggers of the sorted applications and the matched gestures sequentially, with the first matched trigger as the trigger for the match.

前述的手势判断装置，其中所述的处理器还包括排序所述应用程序并且依据所述被排序的应用程序产生一触发查表，其中相应多个应用程序的手势在所述触发查表中相应于排序在先的应用程序的触发，并且所述匹配的触发是以所述匹配的手势匹配所述触发查表来判断。The aforementioned gesture judging device, wherein the processor further includes sorting the application programs and generating a trigger look-up table according to the sorted application programs, wherein the gestures of corresponding multiple application programs are corresponding in the trigger look-up table The matching trigger is determined by matching the matching gesture with the trigger look-up table.

前述的手势判断装置，其中所述的处理器还包括显示代表所述触发查表中相应的各手势的图像，其中所述触发查表是在所述匹配的手势被判断出来前随所述一个或多个物件的移动路径动态产生。The aforementioned gesture judging device, wherein the processor further includes displaying images representing corresponding gestures in the trigger look-up table, wherein the trigger look-up table is followed by the one gesture before the matching gesture is judged. Or the moving path of multiple objects is generated dynamically.

前述的手势判断装置，其中所述的被挑选的应用程序包含一前景应用程序与至少一背景应用程序时，所述前景应用程序排序先于所述背景应用程序。In the aforementioned gesture judging device, when the selected applications include a foreground application and at least one background application, the foreground application is ranked before the background application.

前述的手势判断装置，其中所述的被挑选的应用程序是依据所述一个或多个物件的移动路径的起始位置、结束位置或涵盖范围被判断出来。In the aforementioned gesture judging device, the selected application is judged according to the starting position, ending position or coverage of the moving path of the one or more objects.

前述的手势判断装置，其中所述的手势判断的装置还包含一储存单元储存所述查表与连续记录一个或多个物件靠近或触碰所述感应器的位置。In the aforementioned gesture judging device, the gesture judging device further includes a storage unit for storing the look-up table and continuously recording the positions of one or more objects approaching or touching the sensor.

本发明与现有技术相比具有明显的优点和有益效果。借由上述技术方案，本发明其至少具有下列优点：同一手势可共用于多个不同的应用程序，但相应于不同应用程序的不同命令，处理器可依据目前的前景应用程序与判断出来的手势，触发相应的命令。Compared with the prior art, the present invention has obvious advantages and beneficial effects. With the above-mentioned technical solution, the present invention has at least the following advantages: the same gesture can be shared by multiple different applications, but corresponding to different commands of different applications, the processor can use the current foreground application and the determined gesture , to trigger the corresponding command.

综上所述，本发明是有关于一种手势判断的方法与装置，包括提供触控位置的感应器与控制器，以及依据连续的触控位置判断出手势的处理器。同一手势可共用于多个不同的应用程序，处理器可依据目前的前景应用程序与判断出来的手势，触发相应的命令。本发明在技术上有显著的进步，并具有明显的积极效果，诚为一新颖、进步、实用的新设计。To sum up, the present invention relates to a method and device for gesture determination, including a sensor and a controller for providing touch positions, and a processor for determining gestures based on continuous touch positions. The same gesture can be shared by multiple different application programs, and the processor can trigger corresponding commands according to the current foreground application program and the determined gesture. The present invention has significant progress in technology, and has obvious positive effects, and is a novel, progressive and practical new design.

上述说明仅是本发明技术方案的概述，为了能够更清楚了解本发明的技术手段，而可依照说明书的内容予以实施，并且为了让本发明的上述和其他目的、特征和优点能够更明显易懂，以下特举较佳实施例，并配合附图，详细说明如下。The above description is only an overview of the technical solution of the present invention. In order to better understand the technical means of the present invention, it can be implemented according to the contents of the description, and in order to make the above and other purposes, features and advantages of the present invention more obvious and understandable , the following preferred embodiments are specifically cited below, and are described in detail as follows in conjunction with the accompanying drawings.

附图说明Description of drawings

图1为本发明提供的一种手势判断的方法的流程示意图。FIG. 1 is a schematic flow chart of a gesture judgment method provided by the present invention.

图2为本发明提供的一种手势判断的装置的功能方块示意图。FIG. 2 is a schematic functional block diagram of a device for gesture judgment provided by the present invention.

图3为本发明的一查表范例示意图。FIG. 3 is a schematic diagram of a look-up table example of the present invention.

图4为本发明的一操作范例示意图。FIG. 4 is a schematic diagram of an operation example of the present invention.

21查表21 check table

211手势211 Gestures

212触发212 trigger

22感应器22 sensors

23移动路径判断程序23 Moving path judgment program

24控制器24 controllers

25手势匹配程序25 gesture matching program

26处理器26 processors

27触发匹配程序27 trigger matching procedure

28储存单元28 storage units

41前景应用程序41 Foreground Apps

42背景应用程序42 Background Apps

43旋钮图像43 knob image

44手势图像44 gesture images

具体实施方式Detailed ways

为更进一步阐述本发明为达成预定发明目的所采取的技术手段及功效，以下结合附图及较佳实施例，对依据本发明提出的手势判断的方法与装置其具体实施方式，详细说明如后。In order to further explain the technical means and effects of the present invention to achieve the intended purpose of the invention, the method and device for gesture judgment according to the present invention will be described in detail below in conjunction with the accompanying drawings and preferred embodiments. .

本发明将详细描述一些实施例如下。然而，除了所揭露的实施例外，本发明也可以广泛地运用在其他的实施例施行。本发明的范围并不受该些实施例的限定，应以其后的权利要求为准。而为提供更清楚的描述及使熟悉该项技艺者能理解本发明的发明内容，图示内各部分并没有依照其相对的尺寸而绘图，某些尺寸与其他相关尺度的比例会被突显而显得夸张，且不相关的细节部分也未完全绘出，以求图示的简洁。The present invention will be described in detail in some embodiments as follows. However, the invention can be broadly implemented in other embodiments than the disclosed ones. The scope of the present invention is not limited by these examples, but should be determined by the following claims. In order to provide a clearer description and enable those skilled in the art to understand the content of the invention, the various parts in the illustrations are not drawn according to their relative sizes, and the ratio of certain sizes to other related dimensions will be highlighted and Exaggerated, and irrelevant details are not fully drawn for simplicity of illustration.

本发明可应用于具有显示器的电子设备上，包括但不限于计算机、手机、可携式电子设备(如PDA)等，电子设备上可运算并显示一个或多个应用程序，电子设备的作业系统与应用程序的运算可以是由一处理器来运算。此外，电子设备更包含一触控装置，包含一感应器，能够提供触控位置的侦测资讯，做为使用者的输入设备，触控装置可以是包括但不限于内嵌或覆盖于显示器，也可以是独立于显示器之外。The present invention can be applied to electronic devices with displays, including but not limited to computers, mobile phones, portable electronic devices (such as PDAs), etc., one or more application programs can be calculated and displayed on the electronic devices, and the operating system of the electronic devices Operations with application programs may be performed by a processor. In addition, the electronic device further includes a touch device, including a sensor, which can provide detection information of the touch position. As an input device for the user, the touch device can include but is not limited to being embedded in or covered with a display, It can also be independent of the display.

请参照图1所示，其为本发明提供的一种手势判断的方法的流程示意图。首先，如步骤110所示，提供一查表(lookup table)，该查表记录至少一手势的态样(pattern)，以及每一个手势相应的触发(trigger)，其中任一(each)触发相应一系统(system)的命令(command)或一应用程序(application)的一命令。Please refer to FIG. 1 , which is a schematic flowchart of a gesture judgment method provided by the present invention. First, as shown instep 110, a lookup table (lookup table) is provided, which records at least one gesture pattern (pattern), and each gesture corresponding trigger (trigger), wherein any (each) triggers a corresponding A command of a system or a command of an application.

请参照图3所示，为本发明的一查表范例示意图。查表21可具有多个手势211(如手势1、手势2、手势3)，以及多个触发212(如触发1、触发2、触发3、触发4、触发5)。每一个手势可以是相应于一个或多个触发(如手势1、手势2)，也可以没有相应任何触发(如手势3)。每一个触发相应系统或应用程序的一命令。Please refer to FIG. 3 , which is a schematic diagram of a look-up table example of the present invention. The look-up table 21 may have multiple gestures 211 (eg gesture 1, gesture 2, gesture 3) and multiple triggers 212 (eg trigger 1, trigger 2, trigger 3, trigger 4, trigger 5). Each gesture may correspond to one or more triggers (such as gesture 1, gesture 2), or may not correspond to any trigger (such as gesture 3). Each triggers a command of the corresponding system or application.

此外，系统的命令可以是模拟其他输出入装置的输出或输入命令，也可以是启动特定程序的命令。因此，相同的手势可以是分别相应系统或不同应用程序的不同命令。本领域技术人员可推知，查表可以是用电路或软体来实施，其相关应用为公知技术，在此不再赘述。In addition, the command of the system may be an output or input command to simulate other input and output devices, or a command to start a specific program. Therefore, the same gesture can be different commands corresponding to the respective systems or different applications. Those skilled in the art can deduce that the look-up table can be implemented by circuits or software, and its related applications are well-known technologies, which will not be repeated here.

再如步骤120所示，由一感应器(sensor)取得一侦测资讯(detectioninformation)。本领域技术人员可推知感应器可以包括但不限于电容式、电阻式、光学式、表面声波式触控感应器，并且侦测资讯包括但不限于以模拟信号、数字信号或数值方式呈现。As shown in step 120, a detection information is obtained from a sensor. Those skilled in the art can deduce that the sensor may include but not limited to capacitive, resistive, optical, surface acoustic wave touch sensors, and the detection information includes but not limited to present in analog signal, digital signal or numerical form.

另外，如步骤130所示，依据接收到的该侦测资讯判断一个或多多个物件(object)靠近或触碰该感应器的位置(position)。包含但不限于在电容式或光学式(如红外线式(IR based)或感像式(camera based))的感测器中，物件在未接触到感应器前，感应器便可以提供物件的侦测资讯，因此没有触碰的侦测资讯与触碰的侦测资讯可以做为不同的应用。In addition, as shown instep 130, the position of one or more objects approaching or touching the sensor is determined according to the received detection information. Including but not limited to capacitive or optical (such as infrared (IR based) or sensory (camera based)) sensors, the sensor can provide object detection before the object touches the sensor. Therefore, the non-touch detection information and the touch detection information can be used as different applications.

再如步骤140所示，依据该一个或多个物件(object)靠近或触碰该感应器的位置判断出(determine)一个或多个物件的移动路径(motion)。本发明的感应器可以是提供一个或多个物件的侦测资讯，因此可连续记录一个或多个物件的侦测资讯来构成一个或多个物件的移动路径。As shown instep 140, the motion of one or more objects is determined according to the position where the one or more objects approach or touch the sensor. The sensor of the present invention can provide detection information of one or more objects, so the detection information of one or more objects can be continuously recorded to form the moving path of one or more objects.

此外，如步骤150所示，匹配(match)该一个或多个物件的移动路径与该至少一手势的例子，以判断出匹配的手势(matched gesture)。在前述手势的例子中，包括但不限于单移动路径或多移动路径的手势的例子。在本发明的一范例中，手势的例子可以是由不同角度的线段所构成，借由匹配物件的移动路径与各手势的例子中各线段出现的顺序，可判断出与物件的移动路径匹配的手势。In addition, as shown instep 150, the moving path of the one or more objects is matched with the at least one gesture instance to determine a matched gesture. Examples of the aforementioned gestures include but are not limited to examples of gestures with a single movement path or multiple movement paths. In an example of the present invention, a gesture instance may be composed of line segments with different angles, and by matching the moving path of the object and the order in which each line segment appears in each gesture instance, it can be determined which matches the moving path of the object gesture.

另外，如步骤160与170所示，匹配该匹配的手势与至少一应用程序相应的触发，以判断出匹配的触发(matched trigger)，并且在该匹配的手势与至少一应用程序相应的触发没有匹配时，匹配该匹配的手势与该系统相应的触发，以判断出该匹配的触发。再者，如步骤180所示，在该匹配的触发被判断出来时触发该匹配的触发相应的命令。In addition, as shown insteps 160 and 170, match the matched gesture with the trigger corresponding to at least one application program to determine the matched trigger (matched trigger), and if the matched gesture does not correspond to the trigger corresponding to the at least one application program When matching, match the matching gesture with the corresponding trigger of the system to determine the matching trigger. Furthermore, as shown instep 180, when the matched trigger is determined, the corresponding command of the matched trigger is triggered.

在本发明的一范例中，前述的至少一应用程序为目前执行中的前景程序，换言之，本发明可判断出目前的执行中的前景程序，并且在查表中查找匹配的手势在目前的执行中的前景程序相应的触发。据此，依据前景程序的不同，匹配的手势相应的触发也不同，也即匹配的手势所触发的命令也不同。当匹配的手势与前景程序相应的触发没有匹配时，再匹配该匹配的手势与系统相应的触发，以判断出前述匹配的触发。In one example of the present invention, the aforementioned at least one application program is the currently executing foreground program. In other words, the present invention can determine the currently executing foreground program, and look up the matching gesture in the current executing program in the look-up table. The foreground program in the corresponding trigger. Accordingly, according to different foreground programs, the corresponding triggers of the matched gestures are also different, that is, the commands triggered by the matched gestures are also different. When the matched gesture does not match the corresponding trigger of the foreground program, then match the matched gesture with the corresponding trigger of the system to determine the matching trigger.

在本发明的另一范例中，是依据一个或多个物件的移动路径挑选多个应用程序，并且前述至少一应用程序包括该些被挑选的应用程序，也即匹配的触发是借由在查表匹配该匹配的手势与该些被挑选的应用程序相应的触发来判断。当匹配的手势与该些被挑选的程序相应的触发没有匹配时，再借由在查表匹配系统相应的触发来判断前述匹配的触发。In another example of the present invention, a plurality of application programs are selected according to the moving paths of one or more objects, and the aforementioned at least one application program includes these selected application programs, that is, the matching is triggered by checking It is judged by matching the matched gesture with the corresponding triggers of the selected applications. When the matched gestures do not match the corresponding triggers of the selected programs, the matching triggers are judged by the corresponding triggers in the table look-up matching system.

前述被挑选的程序可以是依据前述一个或多个物件的移动路径挑选多个应用程序来决定，如依据一个或多个物件的移动路径的起始位置、结束位置或涵盖范围被判断出来。例如，在两物件靠近或触碰感测器时，被挑选的程序包含显示范围包括两物件或至少一物件的位置的应用程序，也可以是被挑选的程序包含显示范围包括两物件的部份或全部移动路径的应用程序。The selected program may be determined by selecting multiple application programs according to the moving path of the one or more objects, for example, it is judged based on the starting position, ending position or coverage of the moving path of the one or more objects. For example, when two objects approach or touch the sensor, the selected program includes an application whose display range includes two objects or the position of at least one object, or the selected program includes a part whose display range includes two objects or all mobile path applications.

据此，在记录移动路径的一开始、过程中或结束时，被挑选的应用程序可能包含一前景程序与至少一应用程序。本发明还包含将被挑选的应用程序排序，使其成为被排序的应用程序，前述匹配的触发的判断是依序匹配被排序的应用程序相应的触发，以最先匹配的触发作为前述匹配的触发。例如，依据应用程序在画面上的堆叠关系排序，先匹配该匹配的手势与前景应用程序相应的触发，当该匹配的手势与前景应用程序相应的触发没有匹配时，再匹配该匹配的手势与下一个背景应用程序相应的触发，依此类推。当该匹配的手势与被排序的应用程序相应的触发都没有匹配时，匹配该匹配的手势与系统相应的触发。Accordingly, the selected application programs may include a foreground program and at least one application program at the beginning, during or at the end of recording the moving path. The present invention also includes sorting the selected application programs so that they become the sorted application programs. The determination of the matching triggers is to match the corresponding triggers of the sorting application programs in sequence, and the first matching trigger is used as the matching trigger. trigger. For example, according to the stacking relationship of the applications on the screen, first match the matched gesture with the corresponding trigger of the foreground application, and then match the matched gesture with the corresponding trigger of the foreground application. The next background application triggers accordingly, and so on. When the matching gesture does not match the corresponding trigger of the sorted application program, match the matching gesture with the corresponding trigger of the system.

在本发明的一范例中，还包括提示可触发的手势，例如显示代表可触发的手势的图像，还可以包括图像相应的命令说明。在本发明的一较佳范例中，是依据前述被排序的应用程序产生一触发查表，其中相应多个应用程序的手势在该触发查表中相应于排序在先的应用程序的触发，并且该匹配的触发是以该匹配的手势匹配该触发查表来判断。例如前景应用程序、背景应用程序与系统都相应到相同的手势，针对这个共同相应的手势，在触发查表中仅有前景应用程序相应该共同相应的手势的触发。因此触发查表中可包含多个应用程序与系统相应的触发，并且与相应的手势一对对应。In an example of the present invention, it also includes prompting a triggerable gesture, for example, displaying an image representing the triggerable gesture, and may also include a command description corresponding to the image. In a preferred example of the present invention, a trigger look-up table is generated according to the aforementioned sorted applications, wherein the gestures of corresponding multiple applications correspond to the triggers of the prior application in the trigger look-up table, and The matching trigger is determined by matching the matching gesture with the trigger look-up table. For example, the foreground application, the background application and the system all respond to the same gesture, and for this common corresponding gesture, only the foreground application corresponding to the common corresponding gesture is triggered in the trigger lookup table. Therefore, the trigger look-up table may contain triggers corresponding to multiple applications and systems, and correspond to corresponding gestures.

此外，触发查表可以是在该匹配的手势被判断出来前随该一个或多个物件的移动路径动态产生。因此，随着移动路径的改变，代表可触发的手势的图像的显示也可能随着改变，也即触发查表的产生是先于匹配手势的判断。In addition, the trigger look-up table may be dynamically generated along with the moving path of the one or more objects before the matching gesture is determined. Therefore, as the moving path changes, the display of the image representing the gesture that can be triggered may also change, that is, the generation of the trigger look-up table is prior to the determination of the matching gesture.

在本发明的一范例中，触发查表的产生是在一系统相应的触发的命令被触发时开始动态产生。例如在一物件或多个物件靠近感应器时触发该触发查表的动态产生，也即在一物件或多个物件靠近感应器时，代表可触发的手势的图像就会被显示，使用者可依据可触发的手势的提示做出一手势，该手势可以是触碰感应器时做出或是在未触碰感应器时做出。In an example of the present invention, the trigger look-up table is generated dynamically when a corresponding trigger command of a system is triggered. For example, when an object or multiple objects are close to the sensor, the dynamic generation of the trigger lookup table is triggered, that is, when one or multiple objects are close to the sensor, an image representing a triggerable gesture will be displayed, and the user can Make a gesture according to the prompt of the triggerable gesture, the gesture can be made while touching the sensor or not touching the sensor.

本领域技术人员可推知，前述应用程序、图像可以是显示于一显示器上，本发明不再赘述。Those skilled in the art can deduce that the above-mentioned application programs and images can be displayed on a display, and the present invention will not repeat them.

请参照图2所示，为本发明的一最佳模式的一种手势判断的装置的功能方块示意图，包括一查表21、一感应器22、一控制器24、一处理器26、一储存单元28。Please refer to Fig. 2, which is a schematic functional block diagram of a gesture judging device of a best mode of the present invention, including a look-up table 21, asensor 22, acontroller 24, aprocessor 26, a storage Unit 28.

查表21可以是如前述步骤110所述，记录至少一手势的例子，以及每一个手势相应的触发，其中任一触发相应一系统或一应用程序的一命令，并且查表21可以是储存于储存单元28中。本领域技术人员可推知，查表可以是用电路或软体来实施，其相关应用为公知技术，在此不再赘述。在本发明的一范例中，每一个手势可以是相应于一个或多个触发，也可以没有相应任何触发。此外，系统的命令可以是模拟其他输出入装置的输出或输入命令，也可以启动特定程序的命令。因此，相同的手势可以是分别相应系统或不同应用程序的不同命令。The look-up table 21 can be an example of recording at least one gesture as described in theaforementioned step 110, and the corresponding trigger of each gesture, any of which triggers a command corresponding to a system or an application program, and the look-up table 21 can be stored in storage unit 28. Those skilled in the art can deduce that the look-up table can be implemented by circuits or software, and its related applications are well-known technologies, which will not be repeated here. In an example of the present invention, each gesture may correspond to one or more triggers, or may not correspond to any trigger. In addition, the command of the system may be an output or input command to simulate other input and output devices, or a command to start a specific program. Therefore, the same gesture can be different commands corresponding to the respective systems or different applications.

此外，感应器22可以是如步骤120所述，提供侦测资讯。本领域技术人员可推知感应器可以包括但不限于电容式、电阻式、光学式、表面声波式触控感应器，并且侦测资讯包括但不限于以模拟信号、数字信号或数值方式呈现。In addition, thesensor 22 may provide detection information as described in step 120 . Those skilled in the art can deduce that the sensor may include but not limited to capacitive, resistive, optical, surface acoustic wave touch sensors, and the detection information includes but not limited to present in analog signal, digital signal or numerical form.

感应器22提供的侦测资讯由控制器24接收，控制器24可以是如步骤130所述，依据接收到的该侦测资讯判断一个或多个物件靠近或触碰该感应器的位置232。包含但不限于在电容式或光学式或感像式的感测器中，物件在未接触到感应器前，感应器便可以提供物件的侦测资讯，因此没有触碰的侦测资讯与触碰的侦测资讯可以做为不同的应用。The detection information provided by thesensor 22 is received by thecontroller 24 , and thecontroller 24 may determine the location 232 of one or more objects approaching or touching the sensor according to the received detection information as described instep 130 . Including but not limited to capacitive or optical or image sensors, the sensor can provide object detection information before the object touches the sensor, so there is no touch detection information and touch The touch detection information can be used for different applications.

前述一个或多个物件靠近或触碰该感应器的位置232可以是由处理器26所接收，处理器26将前述一个或多个物件靠近或触碰该感应器的连续位置232储存于储存单元28中，并且可以是如步骤140所示，依据前述一个或多个物件靠近或触碰该感应器的连续位置232判断出一个或多个物件的移动路径。处理器26可以是执行一移动路径判断程序23来进行移动路径的判断，其中移动路径判断程序23可以是储存在储存单元28中。The position 232 of the one or more objects approaching or touching the sensor may be received by theprocessor 26, and theprocessor 26 stores the continuous positions 232 of the one or more objects approaching or touching the sensor in the storage unit 28 , and as shown instep 140 , the moving path of one or more objects is determined according to the continuous position 232 of the aforementioned one or more objects approaching or touching the sensor. Theprocessor 26 may execute a movement path determination program 23 to determine the movement path, wherein the movement path determination program 23 may be stored in the storage unit 28 .

处理器26还可以是如步骤150所述，匹配一个或多个物件的移动路径与至少一手势的例子，以判断出匹配的手势。在前述手势的例子中，包括但不限于单移动路径或多移动路径的手势的例子。在本发明的一范例中，手势的例子可以是由不同角度的线段所构成，借由匹配物件的移动路径与各手势的例子中各线段出现的顺序，可判断出与物件的移动路径匹配的手势。处理器26可以是执行一手势匹配程序25来进行手势的匹配，其中手势匹配程序25可以是储存在储存单元28中。Theprocessor 26 may also be an example of matching the movement path of one or more objects with at least one gesture as described instep 150 to determine the matched gesture. Examples of the aforementioned gestures include but are not limited to examples of gestures with a single movement path or multiple movement paths. In an example of the present invention, a gesture instance may be composed of line segments with different angles, and by matching the moving path of the object and the order in which each line segment appears in each gesture instance, it can be determined which matches the moving path of the object gesture. Theprocessor 26 may execute a gesture matching program 25 to perform gesture matching, wherein the gesture matching program 25 may be stored in the storage unit 28 .

另外，处理器26还可以是如步骤160与170所述，匹配该匹配的手势与至少一应用程序相应的触发，以判断出匹配的触发，并且在匹配的手势与至少一应用程序相应的触发没有匹配时，匹配该匹配的手势与该系统相应的触发，以判断出该匹配的触发。再者，处理器26还可以是如步骤180所示，在该匹配的触发被判断出来时触发该匹配的触发相应的命令。处理器26可以是执行一触发匹配程序27来进行触发的匹配，其中触发匹配程序27可以是储存在储存单元28中。In addition, theprocessor 26 may also, as described insteps 160 and 170, match the matching gesture with the trigger corresponding to at least one application program to determine the matching trigger, and when the matched gesture corresponds to the trigger corresponding to at least one application program, When there is no match, match the matching gesture with the corresponding trigger of the system to determine the matching trigger. Furthermore, theprocessor 26 may also, as shown instep 180, trigger a command corresponding to the matching trigger when the matching trigger is determined. Theprocessor 26 may execute a trigger matching program 27 to perform trigger matching, wherein the trigger matching program 27 may be stored in the storage unit 28 .

本领域技术人员可推知，在电路设计上，控制器24与处理器26可以是整合于同一电路中，并且移动路径判断程序23、手势匹配程序25、触发匹配程序27可以是整合于同一程序中，本发明对于硬体与软体上设计包括但不限于前述的设计。此外，前述的处理器可以是包含但不限于架设于计算机、手机、可携式数字设备(如个人数位助理(PDA))的处理器。Those skilled in the art can deduce that, in terms of circuit design, thecontroller 24 and theprocessor 26 can be integrated in the same circuit, and the moving path judgment program 23, the gesture matching program 25, and the trigger matching program 27 can be integrated in the same program , the design of the present invention includes but is not limited to the aforementioned designs for hardware and software. In addition, the aforementioned processor may include but is not limited to a processor mounted on a computer, a mobile phone, or a portable digital device (such as a personal digital assistant (PDA)).

如先前所述，处理器26更包括在显示器代表触发查表的各触发的图像。例如图4所示，为一具有显示器的计算机，显示器前方覆盖一透明的触控感测器。当使用者的左手46靠近或触碰前景应用程序41的一旋钮图像43时，相应的触发查表会因此而产生，并且触发查表中的各触发的图像44会被显示在显示器上，提示使用者可向顺时针方向旋转或向逆时针方向旋转。当使用者的右手45向顺时针方向旋转时，处理器26会判断出左手46与右45的移动路径，并据以判断出顺时针旋转的手势，当顺时针旋转的手势与触发查表的一触发匹配时，触发相应的命令，如依右手45的移动路径旋转的角度转动旋转图像43。As previously mentioned, theprocessor 26 further includes an image representing each trigger of the trigger lookup table on the display. For example, as shown in FIG. 4 , it is a computer with a display, and a transparent touch sensor is covered in front of the display. When the user'sleft hand 46 approaches or touches aknob image 43 of theforeground application program 41, the corresponding trigger look-up table will be generated accordingly, and theimages 44 of each trigger in the trigger look-up table will be displayed on the display, prompting The user can rotate clockwise or counterclockwise. When the user'sright hand 45 rotates clockwise, theprocessor 26 can judge the movement path of theleft hand 46 and theright hand 45, and judge the gesture of clockwise rotation accordingly. When a match is triggered, a corresponding command is triggered, such as rotating therotating image 43 according to the rotation angle of the movement path of theright hand 45 .

以上所述，仅是本发明的较佳实施例而已，并非对本发明作任何形式上的限制，虽然本发明已以较佳实施例揭露如上，然而并非用以限定本发明，任何熟悉本专业的技术人员，在不脱离本发明技术方案范围内，当可利用上述揭示的技术内容作出些许更动或修饰为等同变化的等效实施例，但凡是未脱离本发明技术方案的内容，依据本发明的技术实质对以上实施例所作的任何简单修改、等同变化与修饰，均仍属于本发明技术方案的范围内。The above description is only a preferred embodiment of the present invention, and does not limit the present invention in any form. Although the present invention has been disclosed as above with preferred embodiments, it is not intended to limit the present invention. Anyone familiar with this field Those skilled in the art, without departing from the scope of the technical solution of the present invention, can use the technical content disclosed above to make some changes or modify equivalent embodiments with equivalent changes, but all the content that does not depart from the technical solution of the present invention, according to the present invention Any simple modifications, equivalent changes and modifications made to the above embodiments by the technical essence still belong to the scope of the technical solution of the present invention.

Claims (20)

1. the method judged of a gesture is characterized in that: may further comprise the steps:

Provide a step of tabling look-up, the example of at least one gesture of described look-up table, and each gesture relative trigger, an order of a corresponding system of wherein arbitrary triggering or an application program;

Obtain the step of a detecting information by an inductor;

According to the described detecting information that receives judge one or more objects near or touch the step of described position of inductor;

According to described one or more objects near or touch the step that described position of inductor is judged the mobile route of one or more objects;

Mate the mobile route of described one or more objects and the example of described at least one gesture, with the step of the gesture of judging coupling;

Gesture and at least one application program relative trigger of mating described coupling are with the step of the triggering of judging coupling; And

When being judged out, the triggering of described coupling triggers the step of the corresponding described order of triggering of described coupling.

2. the method that gesture according to claim 1 is judged, it is characterized in that: the method that described gesture is judged also is included in the gesture of described coupling and described at least one application program relative trigger when not mating, the gesture and the described system relative trigger of mating described coupling are with the step of the triggering of judging described coupling.

3. the method that gesture according to claim 1 is judged is characterized in that: the method that described gesture is judged also comprises the step of judging present executory prospect application program, and described at least one application program comprises described prospect application program.

4. the method that gesture according to claim 1 is judged, it is characterized in that: the method that described gesture is judged also comprises the step of selecting a plurality of application programs according to the mobile route of described one or more objects, and described at least one application program comprises described selected application program.

5. the method that gesture according to claim 4 is judged, it is characterized in that: wherein said application program is the application program that is sorted, the described application program that is sorted is the gesture relative trigger of mating described coupling in regular turn, with the triggering of coupling at first as the triggering of described coupling.

6. the method that gesture according to claim 4 is judged, it is characterized in that: the method that described gesture is judged also comprises the described application program of ordering and produces the step that a triggering is tabled look-up according to the described application program that is sorted, wherein corresponding to the ordering triggering of application program formerly, and the triggering of the described coupling of coupling is to mate described triggering with the gesture of described coupling to table look-up and judge to the gesture of corresponding a plurality of application programs in described triggering is tabled look-up.

7. the method that gesture according to claim 6 is judged, it is characterized in that: the method that described gesture is judged also comprise show the described triggering of representative table look-up in the step of image of corresponding each gesture, it is that the mobile route with described one or more objects dynamically produces before the gesture of described coupling is judged out that wherein said triggering is tabled look-up.

8. the method that gesture according to claim 4 is judged is characterized in that: when wherein said selected application program comprised a prospect application program and at least one background applications, described prospect application program ordering was prior to described background applications.

9. the method that gesture according to claim 4 is judged is characterized in that: wherein said selected application program is that reference position, end position or the covering scope of the mobile route of the described one or more objects of foundation is judged out.

10. the method that gesture according to claim 1 is judged is characterized in that: the method that described gesture is judged is wherein said table look-up with continuous one or more objects near or to touch described position of inductor be to be stored in a storage element.

11. the device that gesture is judged, it is characterized in that: it comprises:

One tables look-up, and record is the example of gesture at least on the other hand, and each described gesture relative trigger, an order of a corresponding system of wherein arbitrary described triggering or an application program;

One inductor provides a detecting information;

One controller is judged that one or more objects are close or is touched described position of inductor according to the described detecting information that receives;

One processor, it comprises:

According to described one or more objects near or touch the mobile route that described position of inductor is judged one or more objects;

Mate the mobile route of described one or more objects and the example of described at least one gesture, to judge the gesture of coupling;

Gesture and at least one application program relative trigger of mating described coupling are to judge the triggering of coupling; And

When being judged out, the triggering of described coupling triggers the corresponding described order of triggering of described coupling.

12. the device that gesture according to claim 11 is judged, it is characterized in that: wherein said processor also is included in the gesture of described coupling and described at least one application program relative trigger when not mating, the gesture and the described system relative trigger of mating described coupling are to judge the triggering of described coupling.

13. the device that gesture according to claim 11 is judged is characterized in that: wherein said processor also comprises judges present executory prospect application program, and described at least one application program comprises described prospect application program.

14. the device that gesture according to claim 11 is judged, it is characterized in that: wherein said processor also comprises according to the mobile route of described one or more objects selects a plurality of application programs, and described at least one application program comprises described selected application program.

15. the device that gesture according to claim 14 is judged, it is characterized in that: wherein said application program is the application program that is sorted, and described monitor is the gesture relative trigger of mating described application program that is sorted and described coupling in regular turn, with at first the coupling triggering as the coupling described triggering.

16. the device that gesture according to claim 14 is judged, it is characterized in that: described processor also comprises the described application program of ordering and produces a triggering according to the described application program that is sorted tables look-up, wherein corresponding to the ordering triggering of application program formerly, and the described triggering of coupling is to mate described triggering with the gesture of described coupling to table look-up and judge to the gesture of corresponding a plurality of application programs in described triggering is tabled look-up.

17. the device that gesture according to claim 16 is judged, it is characterized in that: described processor also comprise show the described triggering of representative table look-up in the image of corresponding each gesture, it is that the mobile route with described one or more objects dynamically produces before the gesture of described coupling is judged out that wherein said triggering is tabled look-up.

18. the device that gesture according to claim 14 is judged is characterized in that: when wherein said selected application program comprised a prospect application program and at least one background applications, described prospect application program ordering was prior to described background applications.

19. the device that gesture according to claim 14 is judged is characterized in that: wherein said selected application program is that reference position, end position or the covering scope of the mobile route of the described one or more objects of foundation is judged out.

20. the device that gesture according to claim 11 is judged is characterized in that: the device that described gesture is judged also comprise a storage unit stores described table look-up with the one or more objects of continuous recording near or touch described position of inductor.

Images