技术领域technical field
本发明是有关于一种触控检测方法及装置，且特别是有关于一种依照使用者的使用情境来调整触控检测的电子装置及其触控检测方法。The present invention relates to a touch detection method and device, and in particular to an electronic device and a touch detection method for adjusting touch detection according to a user's use situation.
背景技术Background technique
在现今的信息社会中，人类对于消费型的电子装置的依赖性逐渐增加。为了达到更便利、体积更轻巧化以及更人性化的目的，许多产品已由传统的键盘或鼠标转变为使用触控屏幕作为输入装置。一般而言，触控屏幕是将触控面板装设于显示装置上，当使用者的手指或触控笔碰触到触控面板时，触控面板的控制器即会根据触控面板上各个触碰检测单元所检测到的数据，判定使用者的手指或触控笔是否触摸了触控面板，并且判定触控面板上的被触摸位置。In today's information society, human beings are increasingly dependent on consumer electronic devices. In order to achieve more convenience, smaller size, and more user-friendly, many products have changed from traditional keyboards or mice to use touch screens as input devices. Generally speaking, a touch screen is a touch panel installed on a display device. When a user's finger or a stylus touches the touch panel, the controller of the touch panel will The data detected by the touch detection unit determines whether the user's finger or the stylus touches the touch panel, and determines the touched position on the touch panel.
然而，在真实的使用状况中，使用者在使用触控屏幕操控电子装置时，不时会有电子装置的操作系统或应用程序呈现出不如使用者所预期的结果的情况发生。尤其是发生在使用者处于不同的使用情境下，使用者虽然做了相同的碰触动作，但却得到了不同的结果。在现实生活中，使用者常常以各种姿势操控具有触控屏幕的电子装置，像是当使用者躺在床上使用电子装置时，由于使用者的姿势会导致于手指按压触控屏幕的力量不足，使得触控处理器判定使用者的手指并未碰触到屏幕，而产生了误判的结果。However, in a real usage situation, when the user uses the touch screen to control the electronic device, sometimes the operating system or the application program of the electronic device may not perform as expected by the user. Especially when the user is in different usage situations, although the user performs the same touch action, they get different results. In real life, users often manipulate electronic devices with touch screens in various postures. For example, when a user uses an electronic device while lying on a bed, the force of pressing the touch screen with fingers will be insufficient due to the user's posture. , so that the touch processor determines that the user's finger has not touched the screen, resulting in a misjudgment result.
举例来说，图1A与图1B示出为现有电子装置检测触控操作的示意图。请参照图1A，当使用者在电子装置100的触控屏幕110上画了一条直线L后，现有技术中的触控屏幕110的控制器(未示出)会判定检测到8个触控点A1～A8并将这些触控点回报给电子装置的处理器。电子装置的处理器即依据这8个触控点A1～A8的信息，判定使用者在触控屏幕上画了一条从触控点A1到触控点A8的直线L。接着，电子装置再依照此触控操作据以执行相关的动作。For example, FIG. 1A and FIG. 1B show a schematic diagram of detecting a touch operation for a conventional electronic device. Please refer to FIG. 1A, when the user draws a straight line L on the touch screen 110 of the electronic device 100, the controller (not shown) of the touch screen 110 in the prior art will determine that 8 touches have been detected. point A1-A8 and report these touch points to the processor of the electronic device. The processor of the electronic device determines that the user has drawn a straight line L from the touch point A1 to the touch point A8 on the touch screen according to the information of the eight touch points A1 - A8 . Then, the electronic device performs related actions according to the touch operation.
请参照图1B，在某些使用情境(例如躺着)下，因为使用者施力不均，可能发生碰触触控点A5与A6的压力过小的情形。此时，控制器将会过滤掉触控点A5与A6，仅回报触控点A1～A4、A7与A8给电子装置的处理器。电子装置的处理器则依据这6个触控点A1～A4、A7与A8的信息，判定使用者在触控屏幕上分别画了一条从触控点A1到触控点A4的直线K以及从触控点A7到触控点A8的直线J。然而，此判定结果并非使用者实际上在触控屏幕上执行的触控操作，从而使得电子装置执行的动作也不如使用者预期。由此可知，现有的触控检测方式可能会因为使用者的使用情境的不同，而产生误判的结果。Please refer to FIG. 1B , in some usage situations (such as lying down), the pressure on the touch points A5 and A6 may be too small due to the uneven application of force by the user. At this time, the controller will filter out the touch points A5 and A6, and only report the touch points A1-A4, A7 and A8 to the processor of the electronic device. The processor of the electronic device determines that the user draws a straight line K from the touch point A1 to the touch point A4 and a straight line K from the touch point A4 on the touch screen based on the information of the six touch points A1-A4, A7 and A8. A straight line J from the touch point A7 to the touch point A8. However, the determination result is not the touch operation actually performed by the user on the touch screen, so that the action performed by the electronic device is not as expected by the user. It can be seen that the existing touch detection methods may produce misjudgment results due to different usage scenarios of users.
发明内容Contents of the invention
有鉴于此，本发明提出一种电子装置及其触控检测方法，可确保在不同的使用情境中判定使用者触控操作的准确率。In view of this, the present invention proposes an electronic device and a touch detection method thereof, which can ensure the accuracy of determining the user's touch operation in different usage scenarios.
本发明提供一种触控检测方法，适用于具有至少一摄像装置及触控屏幕的电子装置。此方法是先利用摄像装置获取使用者操作触控屏幕的至少一操作图像。之后，辨识操作图像中使用者的特征，据以判断使用者操作触控屏幕的一操作区域，其中触控屏幕被区分为多个操作区域。接着，调整触控屏幕对于此操作区域内检测到的触控点的过滤条件。然后，利用触控屏幕检测使用者在触控屏幕上的触控操作以产生多个触控点，并使用过滤条件过滤这些触控点。The invention provides a touch detection method suitable for an electronic device with at least one camera device and a touch screen. In this method, firstly, the camera device is used to acquire at least one operation image of the user operating the touch screen. Afterwards, the feature of the user in the operation image is recognized to determine an operation area where the user operates the touch screen, wherein the touch screen is divided into a plurality of operation areas. Next, adjust the filter condition of the touch screen for the touch points detected in the operation area. Then, the touch screen is used to detect the user's touch operation on the touch screen to generate multiple touch points, and the touch points are filtered by filter conditions.
本发明提供一种电子装置，其包括触控屏幕、至少一摄像装置以及处理器。其中，触控屏幕包括多个触控检测单元以及控制器。这些触控检测单元检测使用者在触控屏幕上的触控操作以产生多个触控点。控制器使用过滤条件过滤这些触控点。摄像装置获取使用者操作触控屏幕的至少一操作图像。处理器耦接摄像装置及触控屏幕，辨识操作图像中使用者的特征，据以判断使用者操作触控屏幕的一操作区域，其中触控屏幕被区分为多个操作区域，并调整触控屏幕对于操作区域内检测到的触控点的过滤条件。The invention provides an electronic device, which includes a touch screen, at least one camera and a processor. Wherein, the touch screen includes a plurality of touch detection units and a controller. The touch detection units detect the user's touch operation on the touch screen to generate a plurality of touch points. The controller filters these touch points using filter conditions. The camera device acquires at least one operation image of the user operating the touch screen. The processor is coupled to the camera device and the touch screen, and recognizes the characteristics of the user in the operation image, so as to determine an operation area where the user operates the touch screen, wherein the touch screen is divided into multiple operation areas, and adjusts the touch Screen filter conditions for touch points detected in the operation area.
基于上述，本发明的电子装置及其触控检测方法通过辨识使用者操控电子装置时的操作图像，判断使用者操作触控屏幕的操作区域，进而调整触控屏幕对于此操作区域内检测到的触控点的过滤条件。如此一来，可确保触控屏幕在不同的使用情境下仍可准确地检测使用者的触控操作，减少误操作的情形。为让本发明的上述特征和优点能更明显易懂，下文特举实施例，并配合附图作详细说明如下。Based on the above, the electronic device and its touch detection method of the present invention judge the operation area where the user operates the touch screen by identifying the operation image when the user manipulates the electronic device, and then adjust the touch screen for the detected area in this operation area. Filter criteria for touch points. In this way, it can ensure that the touch screen can still accurately detect the user's touch operation in different usage scenarios, reducing the situation of misoperation. In order to make the above-mentioned features and advantages of the present invention more comprehensible, the following specific embodiments are described in detail with reference to the accompanying drawings.
附图说明Description of drawings
图1A示出为现有的电子装置检测触控操作的示意图;FIG. 1A shows a schematic diagram of detecting a touch operation for an existing electronic device;
图1B示出为现有的电子装置检测触控操作的示意图;FIG. 1B shows a schematic diagram of detecting a touch operation for an existing electronic device;
图2A是本发明一实施例所示出的电子装置的方块图;Fig. 2A is a block diagram of an electronic device shown in an embodiment of the present invention;
图2B是本发明一实施例所示出的电子装置的示意图;Fig. 2B is a schematic diagram of an electronic device shown in an embodiment of the present invention;
图3是本发明一实施例所示出的触控检测方法的流程图;Fig. 3 is a flowchart of a touch detection method shown in an embodiment of the present invention;
图4是本发明一实施例所示出的电子装置的方块图;Fig. 4 is a block diagram of an electronic device shown in an embodiment of the present invention;
图5是本发明另一实施例所示出的触控检测方法的流程图;5 is a flowchart of a touch detection method shown in another embodiment of the present invention;
图6A是本发明一实施例所示出的电子装置检测触控操作的示意图;FIG. 6A is a schematic diagram of an electronic device detecting a touch operation shown in an embodiment of the present invention;
图6B是本发明一实施例所示出的电子装置检测触控操作的示意图。FIG. 6B is a schematic diagram of an electronic device detecting a touch operation according to an embodiment of the present invention.
附图标记说明:Explanation of reference signs:
100、200、400:电子装置;100, 200, 400: electronic devices;
110、210、410:触控屏幕;110, 210, 410: touch screen;
211-1～211-N、411-1～411-N:触控检测单元;211-1～211-N, 411-1～411-N: touch detection unit;
212、412:控制器;212, 412: controller;
220、420:摄像装置;220, 420: camera device;
230、430:处理器;230, 430: processor;
210a～210i、410a～410i：操作区域;210a～210i, 410a～410i: operating area;
440:加速度传感器;440: acceleration sensor;
A1～A8:触控点;A1～A8: touch points;
B1～B8:触控点;B1～B8: touch points;
T1、T2:时间;T1, T2: time;
L、K、J、M:直线;L, K, J, M: straight line;
S310～S340:本发明一实施例的触控检测方法各步骤;S310-S340: each step of the touch detection method according to an embodiment of the present invention;
S510～S550:本发明一实施例的触控检测方法各步骤。S510-S550: each step of the touch detection method according to an embodiment of the present invention.
具体实施方式detailed description
在使用者操作触控屏幕的过程中，通常只会专注于触控屏幕上的特定区域，以便在该区域实施触控操作。而在实施触控操作的同时，使用者的视线将会停留在该区域上，或是其手会停留或靠近该区域的上方。本发明即依此操作习惯，通过使用者操作触控屏幕的图像找出使用者在触控屏幕上的专注区域，并检测使用者与触控屏幕之间的相对位置，据以调整触控屏幕对于此操作区域内所检测触控点的过滤条件。由此，可确保触控屏幕在不同的使用情境下仍可准确地检测使用者的触控操作。为了使本发明的内容更为明了，以下列举实施例作为本发明确实能够据以实施的范例。During the process of operating the touch screen, the user usually only focuses on a specific area on the touch screen, so as to implement a touch operation on this area. While implementing the touch operation, the user's line of sight will stay on the area, or his hand will stay on or close to the top of the area. According to this operating habit, the present invention finds the focus area of the user on the touch screen through the image of the user operating the touch screen, and detects the relative position between the user and the touch screen, thereby adjusting the touch screen The filtering condition for the touch points detected in this operating area. Thus, it can be ensured that the touch screen can still accurately detect the user's touch operation under different usage scenarios. In order to make the content of the present invention clearer, the following examples are listed as examples in which the present invention can actually be implemented.
图2A是本发明一实施例所示出的电子装置的方块图。图2B是依照本发明一实施例所示出的电子装置的示意图。请参照图2A与图2B，本实施例的电子装置200例如是笔记本电脑、平板电脑(TabletPC)、个人数字助理(personal digital assistant，PDA)、智能手机、电子书、游戏机等具有触控屏幕的电子装置，本发明并不对此限制。电子装置200包括触控屏幕210、摄像装置220以及处理器230，其功能分述如下:FIG. 2A is a block diagram of an electronic device according to an embodiment of the present invention. FIG. 2B is a schematic diagram of an electronic device according to an embodiment of the invention. Please refer to FIG. 2A and FIG. 2B. The electronic device 200 of this embodiment is, for example, a notebook computer, a tablet computer (TabletPC), a personal digital assistant (personal digital assistant, PDA), a smart phone, an e-book, a game machine, etc., which have a touch screen. electronic devices, the present invention is not limited thereto. The electronic device 200 includes a touch screen 210, a camera 220 and a processor 230, the functions of which are as follows:
触控屏幕210为一种整合触控面板的显示装置，可同时提供显示及输入功能。此显示装置例如是液晶显示器(Liquid Crystal Display，LCD)、发光二极管(Light-EmittingDiode，LED)显示器、场发射显示器(Field Emission Display，FED)或其他种类的显示器，而触控面板的种类例如是电阻式(resistive)触控屏幕或电容式(capacitive)触控屏幕，本发明并不限制于此。需注意的是，如图2B所示，在本实施例中，触控屏幕210可供使用者执行触控操作的区域例如可进一步区分为操作区域210a～210i，但此区分方式以及区分的数量仅为举例说明，本领域技术人员可针对实际的需求而酌予变更，并不限于上述说明。The touch screen 210 is a display device integrated with a touch panel, which can simultaneously provide display and input functions. The display device is, for example, a liquid crystal display (Liquid Crystal Display, LCD), a light-emitting diode (Light-Emitting Diode, LED) display, a field emission display (Field Emission Display, FED) or other types of displays, and the type of the touch panel is, for example, Resistive touch screen or capacitive touch screen, the present invention is not limited thereto. It should be noted that, as shown in FIG. 2B , in this embodiment, the area of the touch screen 210 for the user to perform touch operations can be further divided into operation areas 210 a - 210 i, for example, but the division method and the number of divisions It is only for illustration, and those skilled in the art can make changes according to actual needs, and is not limited to the above description.
此外，触控屏幕210包括多个触控检测单元211-1～211-N以及控制器212，其中N为正整数。触控检测单元211-1～211-N检测使用者在触控屏幕210上的触控操作以产生多个触控点。控制器212例如是具有运算功能的芯片组、微处理器或微控制器(microcontroller，MCU)，其可使用过滤条件过滤由触控检测单元211-1～211-N产生的多个触控点，在此并不限制其种类。In addition, the touch screen 210 includes a plurality of touch detection units 211 - 1 - 211 -N and a controller 212 , wherein N is a positive integer. The touch detection units 211 - 1 - 211 -N detect the user's touch operation on the touch screen 210 to generate a plurality of touch points. The controller 212 is, for example, a chipset with computing functions, a microprocessor or a microcontroller (microcontroller, MCU), which can use filter conditions to filter the multiple touch points generated by the touch detection units 211-1˜211-N. , which is not limited here.
摄像装置220例如是具有电荷耦合器件(Charge Coupled Device，CCD)或互补式金属氧化物半导体(Complementary Metal-Oxide Semiconductor，CMOS)元件的图像传感器，用以获取使用者操作触控屏幕210的操作图像。在本实施例中，如图2B所示，电子装置200包括两个摄像装置220，但摄像装置220的数量及配置可以针对实际的需求而变更，在此不设限。The imaging device 220 is, for example, an image sensor with a charge coupled device (Charge Coupled Device, CCD) or a complementary metal oxide semiconductor (Complementary Metal-Oxide Semiconductor, CMOS). . In this embodiment, as shown in FIG. 2B , the electronic device 200 includes two camera devices 220 , but the number and configuration of the camera devices 220 can be changed according to actual needs, and there is no limit here.
处理器230耦接摄像装置220及触控屏幕210，用以控制电子装置200的整体运作。处理器230例如是中央处理单元(Central Processing Unit，CPU)，或是其他可编程的微处理器(Microprocessor)、数字信号处理器(Digital Signal Processor，DSP)、可编程控制器、特殊应用集成电路(Application Specific Integrated Circuits，ASIC)、可编程逻辑器件(Programmable Logic Device，PLD)或其他具备运算能力的硬件装置。在本实施例中，处理器230可分析摄像装置220获取的图像，并据以调整触控屏幕210的控制器212用以过滤触控点的过滤条件。The processor 230 is coupled to the camera device 220 and the touch screen 210 to control the overall operation of the electronic device 200 . The processor 230 is, for example, a central processing unit (Central Processing Unit, CPU), or other programmable microprocessor (Microprocessor), digital signal processor (Digital Signal Processor, DSP), programmable controller, application-specific integrated circuit (Application Specific Integrated Circuits, ASIC), Programmable Logic Device (Programmable Logic Device, PLD), or other hardware devices with computing capabilities. In this embodiment, the processor 230 can analyze the images captured by the camera device 220 and accordingly adjust the filtering conditions used by the controller 212 of the touch screen 210 to filter the touch points.
图3是本发明一实施例所示出的触控检测方法的流程图。请同时参照图2A、图2B及图3，本实施例的方法适用于上述的电子装置200，以下即搭配电子装置200中的各项元件说明本实施例的触控检测方法的详细步骤。FIG. 3 is a flowchart of a touch detection method according to an embodiment of the present invention. Please refer to FIG. 2A , FIG. 2B and FIG. 3 at the same time. The method of this embodiment is applicable to the above-mentioned electronic device 200 . The detailed steps of the touch detection method of this embodiment will be described below with various components in the electronic device 200 .
首先，处理器230利用摄像装置220获取使用者操作触控屏幕210的操作图像(步骤S310)。一般来说，当使用者通过触控屏幕210操控电子装置200时，触控屏幕210会面向使用者，而使用者的视线会专注在触控屏幕210上，并利用手来碰触触控屏幕210，以达成触控操作电子装置200的目的。此时，配置在电子装置200同一面的摄像装置220即可获取到使用者操作触控屏幕210的操作图像。举例来说，摄像装置220可获取使用者脸部的图像，也可获取到使用者用以碰触电子装置200的手部的图像。Firstly, the processor 230 uses the camera device 220 to acquire an operation image of the user operating the touch screen 210 (step S310 ). Generally speaking, when a user manipulates the electronic device 200 through the touch screen 210, the touch screen 210 will face the user, and the user's eyes will focus on the touch screen 210, and use the hand to touch the touch screen 210 to achieve the purpose of operating the electronic device 200 by touch. At this time, the camera device 220 disposed on the same surface of the electronic device 200 can capture the operation image of the user operating the touch screen 210 . For example, the camera device 220 may obtain an image of the user's face, and may also obtain an image of the user's hand for touching the electronic device 200 .
然后，处理器230辨识操作图像中使用者的特征，据以判断使用者操作触控屏幕210的操作区域(即操作区域210a～210i其中之一)(步骤S320)。详细来说，在摄像装置220获取到使用者的操作图像之后，处理器230通过图像辨识或其他方式来辨识操作图像中使用者的特征，并根据辨识结果判断使用者所要操作的区域。Then, the processor 230 recognizes the features of the user in the operation image, and thus determines the operation area (ie, one of the operation areas 210 a - 210 i ) where the user operates the touch screen 210 (step S320 ). In detail, after the camera device 220 acquires the user's operation image, the processor 230 recognizes the user's features in the operation image through image recognition or other methods, and determines the area to be operated by the user according to the recognition result.
举例来说，在一实施例中，处理器230可辨识操作图像中使用者的双眼，并据以判断双眼的聚焦方向。然后，处理器230再依照聚焦方向判断双眼在触控屏幕210上的聚焦位置，据以判断使用者操作触控屏幕210的操作区域210a～210i其中之一。详细来说，处理器230可通过辨识操作图像中使用者双眼中黑眼球与白眼球的相对位置，来判断出双眼聚焦方向，也就是使用者眼神专注的地方。举例来说，假设处理器230判断使用者双眼聚焦的位置是在图2B中触控屏幕210上A点的位置，则可判断使用者是专注于触控屏幕210上的操作区域210d。For example, in one embodiment, the processor 230 can identify the eyes of the user in the operation image, and judge the focus direction of the eyes accordingly. Then, the processor 230 judges the focus positions of the two eyes on the touch screen 210 according to the focus direction, so as to determine one of the operation areas 210 a - 210 i of the touch screen 210 operated by the user. Specifically, the processor 230 can determine the focus direction of the eyes, that is, where the user's eyes focus, by identifying the relative positions of the black eyeballs and white eyeballs in the user's eyes in the operation image. For example, assuming that the processor 230 determines that the user's eyes focus on the position of point A on the touch screen 210 in FIG. 2B , it can be determined that the user is focusing on the operation area 210 d on the touch screen 210 .
在另一实施例中，处理器230可辨识操作图像中使用者的手部，并据以判断手部在触控屏幕210上方的操作位置。然后，处理器230再依据操作位置在触控屏幕210上的投影位置，判断使用者操作触控屏幕210的操作区域。举例来说，假设手部在触控屏幕210上方的操作位置是投影于触控屏幕210上B点的位置，处理器230便可判断出使用者将对操作区域210c执行触控操作。In another embodiment, the processor 230 can recognize the user's hand in the operation image, and accordingly determine the operating position of the hand above the touch screen 210 . Then, the processor 230 determines the operating area where the user operates the touch screen 210 according to the projected position of the operating position on the touch screen 210 . For example, assuming that the operating position of the hand above the touch screen 210 is projected on the position of point B on the touch screen 210 , the processor 230 can determine that the user will perform a touch operation on the operating area 210 c.
接着，处理器调整触控屏幕210对于所述操作区域内检测到的触控点的过滤条件(步骤S330)。上述过滤条件包括用以判断触控屏幕210检测到的触控点是否有效的触控参数的门限值，而此触控参数包括触控屏幕210检测到触控点的时间长短、电容值或电阻值。其中，不同种类的触控屏幕会依据不同的触控检测方式而有不同的触控参数，像是电阻式触控屏幕会利用使用者碰触触控屏幕而产生的电阻值来判断检测到的触控点是否有效，而电容式触控屏幕会通过使用者碰触触控屏幕而产生的电容值来判断检测到的触控点是否有效。Next, the processor adjusts the filter condition of the touch screen 210 for the detected touch points in the operation area (step S330 ). The above filter conditions include threshold values of touch parameters used to determine whether the touch points detected by the touch screen 210 are valid, and the touch parameters include the length of time the touch screen 210 detects the touch points, capacitance value or resistance. Among them, different types of touch screens will have different touch parameters according to different touch detection methods. For example, resistive touch screens will use the resistance value generated by the user to touch the touch screen to determine the detected Whether the touch point is valid, and the capacitive touch screen will judge whether the detected touch point is valid through the capacitance value generated by the user touching the touch screen.
一般来说，触控装置会具备用以判断因使用者碰触而产生的触控点是否有效的过滤表，此过滤表中包括判断触控点是否有效的触控参数的门限值。举例来说，对于电阻式触控屏幕而言，其过滤表中可包括电阻门限值。进一步来说，电阻式触控屏幕可通过比较使用者碰触屏幕而产生的电阻值与此电阻门限值来据以判断此触控点是否有效。当使用者碰触屏幕而产生的电阻值大于电阻门限值时，电阻式触控屏幕便判定此触控点为有效的触控点。Generally speaking, the touch device will have a filter table for judging whether the touch point generated by the user's touch is valid, and the filter table includes threshold values of touch parameters for judging whether the touch point is valid. For example, for a resistive touch screen, the filter table may include resistance thresholds. Furthermore, the resistive touch screen can determine whether the touch point is valid by comparing the resistance value generated by the user touching the screen with the resistance threshold value. When the resistance generated by the user touching the screen is greater than the resistance threshold value, the resistive touch screen determines that the touch point is a valid touch point.
因此，在本实施例中，处理器230可通过建立或修改触控屏幕210的过滤表，以调整过滤表中用以判断在所述操作区域内检测到的触控点是否有效的触控参数的门限值，其中过滤表记录触控屏幕210用以判断各个操作区域210a～210i内检测到的触控点是否有效的触控参数的门限值。值得一提的是，在其他实施例中，处理器230可以降低过滤表中用以判断操作区域内检测到的触控点是否有效的触控参数的门限值，由此提高触控屏幕210的灵敏度，使得使用者可以通过施力较小的碰触来而达成电子装置200上的触控操作。Therefore, in this embodiment, the processor 230 can establish or modify the filter table of the touch screen 210 to adjust the touch parameters in the filter table for judging whether the touch points detected in the operation area are valid. threshold values, wherein the filter table records the threshold values of touch parameters used by the touch screen 210 to determine whether the touch points detected in each operation area 210a-210i are valid. It is worth mentioning that, in other embodiments, the processor 230 can reduce the threshold value of the touch parameters in the filter table used to determine whether the touch point detected in the operation area is valid, thereby improving the touch screen 210. sensitivity, so that the user can achieve the touch operation on the electronic device 200 by touching with a small force.
最后，触控屏幕210的多个触控检测单元211-1～211-N会检测使用者在触控屏幕210上的触控操作以产生多个触控点，且控制器212会使用过滤条件过滤触控点(步骤S340)。也就是说，控制器212可利用调整后的过滤条件来过滤触控点，判定使用者因碰触触控屏幕210而产生的触控点是否有效，并且回报有效的触控点的信息给处理器230。让处理器230可据以判断使用者的触控操作，并控制电子装置200执行使用者所预期的动作。Finally, the multiple touch detection units 211-1-211-N of the touch screen 210 will detect the user's touch operation on the touch screen 210 to generate multiple touch points, and the controller 212 will use the filter condition Filter touch points (step S340). That is to say, the controller 212 can use the adjusted filter condition to filter the touch points, determine whether the touch points generated by the user touching the touch screen 210 are valid, and report the information of the valid touch points to the processing device 230. Based on this, the processor 230 can judge the user's touch operation, and control the electronic device 200 to execute the action expected by the user.
需说明的是，在本发明的另一实施例中，电子装置可额外配置加速度传感器，以检测使用者与触控屏幕之间的相对位置，并结合加速度传感器所感测的结果及上述所判断的使用者的操作区域，据以调整检测触控点的过滤条件。以下则举另一实施例详细说明。It should be noted that, in another embodiment of the present invention, the electronic device can be additionally equipped with an acceleration sensor to detect the relative position between the user and the touch screen, and combine the results sensed by the acceleration sensor with the above-mentioned judged The user's operation area is used to adjust the filter conditions for detecting touch points. Another embodiment will be described in detail below.
图4是本发明一实施例所示出的电子装置的方块图。请参照图4，本实施例的电子装置400包括触控屏幕410、摄像装置420及处理器430，其耦接关系及功能是与前述实施例中的触控屏幕210、摄像装置220及处理器230相同或相似，在此不赘述。与前述实施例不同的是，本实施例的电子装置400还包括加速度传感器(G-sensor)440，此加速度传感器440可感测电子装置400的倾斜角度。FIG. 4 is a block diagram of an electronic device according to an embodiment of the present invention. Please refer to FIG. 4, the electronic device 400 of this embodiment includes a touch screen 410, a camera 420 and a processor 430, and its coupling relationship and functions are the same as those of the touch screen 210, camera 220 and processor in the foregoing embodiments 230 are the same or similar, and will not be repeated here. Different from the previous embodiments, the electronic device 400 of this embodiment further includes an acceleration sensor (G-sensor) 440 , and the acceleration sensor 440 can sense the tilt angle of the electronic device 400 .
在本实施例中，电子装置400除了可以通过前述方法判定使用者专注于触控屏幕410的操作区域之外，还可以结合加速度传感器440所感测的结果，来调整检测触控点的过滤条件。也就是说，在本发明的方法中除了可以针对触控屏幕410中部分的操作区域进行过滤条件的调整之外，还可以利用加速度传感器所感测到的结果，来调整触控屏幕410对于每个操作区域内用以检测触控点的过滤条件。In this embodiment, the electronic device 400 can adjust the filter condition for detecting touch points in combination with the result sensed by the acceleration sensor 440 in addition to determining the user's focus on the operation area of the touch screen 410 through the aforementioned method. That is to say, in the method of the present invention, in addition to adjusting the filter conditions for some operating areas in the touch screen 410, the results sensed by the acceleration sensor can also be used to adjust the touch screen 410 for each The filter condition used to detect touch points in the operation area.
图5是本发明另一实施例所示出的触控检测方法的流程图。请同时参照图4及图5，本实施例的方法适用于图4的电子装置400。以下即搭配图4中的各项元件，说明本实施例的触控检测方法的详细步骤。FIG. 5 is a flowchart of a touch detection method according to another embodiment of the present invention. Please refer to FIG. 4 and FIG. 5 at the same time. The method of this embodiment is applicable to the electronic device 400 in FIG. 4 . The detailed steps of the touch detection method of this embodiment will be described below in conjunction with various elements in FIG. 4 .
首先，处理器430利用摄像装置420获取使用者操作触控屏幕410的操作图像(步骤S510)，并辨识操作图像中使用者的特征，据以判断使用者操作触控屏幕410的操作区域(步骤S520)。上述步骤S510、S520是与前述实施例中的步骤S310、S320的内容相同或相似，故在此不再赘述。First, the processor 430 utilizes the camera device 420 to acquire an operation image of the user operating the touch screen 410 (step S510), and recognizes the characteristics of the user in the operation image, so as to determine the operation area where the user operates the touch screen 410 (step S510). S520). The above steps S510 and S520 are the same as or similar to the contents of steps S310 and S320 in the foregoing embodiments, so details are not repeated here.
与前述实施例不同的是，本实施例的处理器430在判断使用者操作触控屏幕410的操作区域的同时，还会利用加速度传感器440感测电子装置400的倾斜角度(步骤S530)。据此，处理器430根据倾斜角度以及摄像装置420获取的操作图像，判断电子装置400与使用者之间的相对位置或相对角度(步骤S540)。简言之，处理器430根据电子装置400的倾斜角度，再加上摄像装置420所获取操作图像中使用者眼睛或脸的位置，可据以判断出电子装置400与使用者的相对位置或相对角度。Different from the previous embodiments, the processor 430 of this embodiment also uses the acceleration sensor 440 to sense the tilt angle of the electronic device 400 while determining the operating area of the touch screen 410 operated by the user (step S530 ). Accordingly, the processor 430 determines the relative position or relative angle between the electronic device 400 and the user according to the tilt angle and the operation image captured by the camera device 420 (step S540 ). In short, the processor 430 can determine the relative position or relative position of the electronic device 400 to the user based on the tilt angle of the electronic device 400 and the position of the user's eyes or face in the operation image captured by the camera device 420 . angle.
然后，处理器430根据相对位置或相对角度，调整触控屏幕410对于各个操作区域内检测到的触控点的过滤条件(步骤S550)。由此，在结合加速度传感器440所感测的结果后，控制器412还能因应使用者操控电子装置400的使用情境来调整检测触控点的过滤条件，让使用者可以在不同的使用情境中自如地操控电子装置400。Then, the processor 430 adjusts the filter condition of the touch screen 410 for the touch points detected in each operation area according to the relative position or the relative angle (step S550 ). Therefore, after combining the results sensed by the acceleration sensor 440, the controller 412 can also adjust the filter conditions for detecting touch points according to the usage scenarios in which the user manipulates the electronic device 400, so that the user can freely adjust the touch points in different usage scenarios. Control the electronic device 400 accordingly.
另外，在本发明的另一个实施例中，还可延伸至电子装置通过摄像装置与加速度传感器取得使用者的使用情境信息后，将这些使用者的使用情境信息提供给处理器。让处理器在接收到触控屏幕回报的触控点信息后，结合这些使用情境信息来判断使用者在触控屏幕上执行的触控操作。In addition, in another embodiment of the present invention, it can also be extended to provide the user's usage situation information to the processor after the electronic device obtains the user's usage situation information through the camera device and the acceleration sensor. After receiving the touch point information reported by the touch screen, the processor combines the usage context information to judge the touch operation performed by the user on the touch screen.
举例来说，当使用者处于摇晃(例如在公交车上)的使用情境下，可能因为摇晃而无法平均地施力来执行拖曳操作。因此，当摄像装置与加速度传感器取得的使用情境信息为使用者处于一摇晃的状态中，处理器可以调整判定触控点的过滤条件，使拖曳操作不会因为触碰力量的改变而中断，进而误判为其他的触控操作。基此，电子装置能因应使用者的使用情境，弹性地调整其判定触控操作或触控点的条件，确保在不同的使用情境中判断使用者的触控动作的准确率。For example, when the user is in a shaking situation (such as on a bus), the user may not be able to apply force evenly to perform the dragging operation due to the shaking. Therefore, when the usage situation information obtained by the camera device and the acceleration sensor shows that the user is in a shaking state, the processor can adjust the filter conditions for determining the touch point, so that the drag operation will not be interrupted due to the change of the touch force, and then Misjudged as other touch operation. Based on this, the electronic device can flexibly adjust its conditions for judging touch operations or touch points according to the user's usage scenarios, so as to ensure the accuracy of judging the user's touch actions in different usage scenarios.
图6A与图6B依照本发明一实施例所示出的电子装置检测触控操作的示意图。本实施例是采用如图4所示的电子装置400的配置架构。请参照图6A与图6B，在本实施例中，触控屏幕410可供使用者执行触控操作的区域例如可进一步区分为操作区域410a～410i，但此区分方式以及区分的数量仅为举例说明，本领域技术人员可针对实际的需求而酌予变更，并不限于上述说明。6A and 6B are schematic diagrams showing an electronic device detecting a touch operation according to an embodiment of the present invention. This embodiment adopts the configuration structure of the electronic device 400 as shown in FIG. 4 . Please refer to FIG. 6A and FIG. 6B. In this embodiment, the area of the touch screen 410 for the user to perform touch operations can be further divided into operation areas 410a-410i, for example, but the division method and the number of divisions are just examples. It should be noted that those skilled in the art can make changes according to actual needs, and are not limited to the above descriptions.
当使用者在电子装置400的触控屏幕410的操作区域410e上画一条直线M时，在时间点T1，触控屏幕410的触控检测单元411-1～411-N会检测到触控点B1～B3，而控制器412判定触控点B1～B3为有效的触控点并回报给电子装置400的处理器430。同时，处理器430通过加速度传感器440得知使用者手平持电子装置400，且通过摄像装置420获取的操作图像得知使用者的眼神专注于操作区域410e。When the user draws a straight line M on the operation area 410e of the touch screen 410 of the electronic device 400, at time T1, the touch detection units 411-1˜411-N of the touch screen 410 will detect the touch points. B1-B3, and the controller 412 determines that the touch points B1-B3 are valid touch points and reports back to the processor 430 of the electronic device 400 . At the same time, the processor 430 knows that the user's hand is holding the electronic device 400 through the acceleration sensor 440 , and knows that the user's eyes are focused on the operation area 410 e through the operation image captured by the camera device 420 .
因此，在时间点T2，处理器430调整触控屏幕410对于操作区域410e内用以检测到触控点的过滤条件。举例来说，处理器430可以建立一个新的过滤表或修改既有的过滤表，来调整过滤表中用以判断在操作区域410e内检测触控点是否有效的触控参数的门限值。在上述使用者手平持电子装置400的使用情境中，处理器430可降低过滤表中用以判断操作区域410e内检测到的触控点是否有效的触控参数的门限值，简单来说，提高操作区域410e上的触控灵敏度，让使用者可以用较小的施力来进行触控操作。Therefore, at the time point T2, the processor 430 adjusts the filter condition of the touch screen 410 for detecting touch points in the operation area 410e. For example, the processor 430 can create a new filter table or modify an existing filter table to adjust the threshold value of the touch parameter in the filter table for judging whether the touch point is valid in the operation area 410e. In the above usage scenario where the user holds the electronic device 400 flat, the processor 430 may reduce the threshold value of the touch parameter in the filter table for judging whether the touch point detected in the operation area 410e is valid. , to improve the touch sensitivity on the operation area 410e, so that the user can perform the touch operation with a relatively small force.
接着，控制器412开始使用调整后的过滤条件来继续过滤触控点B4～B8。其中，原本触控点B5与B6可能因使用者碰触压力过小而被判定成无效的触控点，但在处理器430调整过过滤条件之后，控制器会依照新的过滤条件可判定触控点B5与B6为有效的触控点。之后，控制器依序判定触控点B5～B8并回报给电子装置400的处理器430。此时，电子装置400的处理器430依据这8个触控点B1～B8的信息判定使用者在触控屏幕410上画了一条从触控点B1到触控点B8的直线M，从而达到依照使用者意志来操控电子装置的目的。Then, the controller 412 starts to use the adjusted filter condition to continue filtering the touch points B4 - B8 . Among them, the original touch points B5 and B6 may be judged as invalid touch points because the user’s touch pressure is too small, but after the processor 430 adjusts the filter conditions, the controller will determine the touch points according to the new filter conditions. Control points B5 and B6 are valid touch points. Afterwards, the controller sequentially determines the touch points B5 - B8 and reports back to the processor 430 of the electronic device 400 . At this time, the processor 430 of the electronic device 400 determines based on the information of the eight touch points B1-B8 that the user has drawn a straight line M from the touch point B1 to the touch point B8 on the touch screen 410, thereby achieving The purpose of manipulating electronic devices according to the will of the user.
综上所述，本发明的电子装置及其触控检测方法通过辨识使用者专注于触控屏幕上的操作区域，并针对此操作区域调整触控点的过滤条件，可增加触控屏幕检测使用者的触控操作的准确率。此外，本发明的方法还结合加速度传感器的感测结果，弹性地调整触控屏幕整体对于触控点的过滤条件，可确保触控屏幕在不同的使用情境下仍可准确地检测使用者的触控操作。To sum up, the electronic device and its touch detection method of the present invention can increase the use of touch screen detection by identifying the operation area on the touch screen that the user focuses on, and adjusting the filter conditions of the touch points for this operation area. The accuracy of the user's touch operation. In addition, the method of the present invention also combines the sensing results of the acceleration sensor to flexibly adjust the overall filter conditions of the touch screen for touch points, so as to ensure that the touch screen can still accurately detect the user's touch points in different usage scenarios. control operation.
最后应说明的是:以上各实施例仅用以说明本发明的技术方案，而非对其限制;尽管参照前述各实施例对本发明进行了详细的说明，本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改，或者对其中部分或者全部技术特征进行等同替换;而这些修改或者替换，并不使相应技术方案的本质脱离本发明各实施例技术方案的范围。Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present invention, rather than limiting them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: It is still possible to modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements for some or all of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the technical solutions of the various embodiments of the present invention. scope.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310166136.5ACN104142741B (en) | 2013-05-08 | 2013-05-08 | Electronic device and touch detection method thereof |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310166136.5ACN104142741B (en) | 2013-05-08 | 2013-05-08 | Electronic device and touch detection method thereof |
| Publication Number | Publication Date |
|---|---|
| CN104142741A CN104142741A (en) | 2014-11-12 |
| CN104142741Btrue CN104142741B (en) | 2017-04-12 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310166136.5AExpired - Fee RelatedCN104142741B (en) | 2013-05-08 | 2013-05-08 | Electronic device and touch detection method thereof |
| Country | Link |
|---|---|
| CN (1) | CN104142741B (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106066694A (en)* | 2016-05-30 | 2016-11-02 | 维沃移动通信有限公司 | The control method of a kind of touch screen operation response and terminal |
| CN108038405A (en)* | 2017-12-22 | 2018-05-15 | 努比亚技术有限公司 | Barcode scanning light compensation method, mobile terminal and computer-readable recording medium |
| CN111078087A (en)* | 2019-11-25 | 2020-04-28 | 深圳传音控股股份有限公司 | Mobile terminal, control mode switching method, and computer-readable storage medium |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101344816A (en)* | 2008-08-15 | 2009-01-14 | 华南理工大学 | Human-computer interaction method and device based on gaze tracking and gesture recognition |
| CN101661329A (en)* | 2009-09-22 | 2010-03-03 | 北京中星微电子有限公司 | Operating control method and device of intelligent terminal |
| CN102270035A (en)* | 2010-06-04 | 2011-12-07 | 三星电子株式会社 | Apparatus and method for selecting and operating object in non-touch mode |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120120277A1 (en)* | 2010-11-16 | 2012-05-17 | Apple Inc. | Multi-point Touch Focus |
| US8897490B2 (en)* | 2011-03-23 | 2014-11-25 | Arcsoft (Hangzhou) Multimedia Technology Co., Ltd. | Vision-based user interface and related method |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101344816A (en)* | 2008-08-15 | 2009-01-14 | 华南理工大学 | Human-computer interaction method and device based on gaze tracking and gesture recognition |
| CN101661329A (en)* | 2009-09-22 | 2010-03-03 | 北京中星微电子有限公司 | Operating control method and device of intelligent terminal |
| CN102270035A (en)* | 2010-06-04 | 2011-12-07 | 三星电子株式会社 | Apparatus and method for selecting and operating object in non-touch mode |
| Publication number | Publication date |
|---|---|
| CN104142741A (en) | 2014-11-12 |
| Publication | Publication Date | Title |
|---|---|---|
| CN104731496B (en) | Unlocking method and electronic device | |
| CN103902222B (en) | Touch screen sliding adjustment method, adjustment device and touch device | |
| TWI731442B (en) | Electronic apparatus and object information recognition method by using touch data thereof | |
| KR20140022477A (en) | Detection of gesture orientation on repositionable touch surface | |
| CN105353927B (en) | Capacitive touch device and object identification method thereof | |
| CN107066138B (en) | Signal detection method for preventing false touch in touch system | |
| CN104142741B (en) | Electronic device and touch detection method thereof | |
| CN105824560A (en) | Display panel and brightness regulating method thereof as well as display device | |
| CN105278862A (en) | Light-sensation detection-based misoperation prevention method, device and mobile terminal | |
| CN113535057B (en) | A gesture interaction method and terminal device | |
| CN107807747B (en) | Touch system and touch detection method thereof | |
| TWI493406B (en) | Electronic device and touch detection method thereof | |
| CN102722298B (en) | Information processor and information processing method | |
| TWI602098B (en) | Touch Sensor Device And Sensing Method For Touch Point | |
| CN103984431B (en) | Touch device and object judgment method applied to touch device | |
| CN105653101B (en) | Touch point sensing method and optical touch system | |
| JP2015146090A (en) | Handwritten input device and input control program | |
| CN103543884B (en) | Optical touch system and touch object distinguishing method thereof | |
| TWI715252B (en) | Electronic apparatus and object information recognition method by using touch data thereof | |
| CN104035628B (en) | Virtual touch device | |
| US9430143B2 (en) | Screen capturing method and electronic device using the same | |
| US8890847B2 (en) | Optical touch system and touch point calculation method thereof | |
| US10698536B2 (en) | Method of detecting touch position and touch apparatus thereof | |
| CN107402654B (en) | Touch detection method and touch detection system | |
| TWI697827B (en) | Control system and control method thereof |
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | Granted publication date:20170412 | |
| CF01 | Termination of patent right due to non-payment of annual fee |