本發明係關於非接觸式的控制機制，尤指一種依據懸浮物件在電子裝置之非接觸式手勢操作區域內外之間往返的運動資訊來控制電子裝置的方法。The present invention relates to a non-contact control mechanism, and more particularly to a method for controlling an electronic device based on motion information of a suspended object traveling between the inside and the outside of a non-contact gesture operation area of an electronic device.
觸控式電子裝置提供給使用者便利的操控方式，然而，當使用者手持其他物品（例如，文件或飲料）而無法直接觸摸電子裝置，或手上沾粘污垢而不方便觸碰電子裝置時，透過觸碰的方式來操控電子裝置反而會增加使用者的不便。舉例來說，當使用者一邊吃薯條一邊觀看平板電腦所顯示的電子書時，使用者不會希望以油膩的手指來翻閱電子書。The touch-type electronic device provides a convenient control mode for the user. However, when the user holds other items (for example, documents or drinks) and cannot directly touch the electronic device, or the hand is stained with dirt, it is not convenient to touch the electronic device. Controlling the electronic device by touching it may increase the inconvenience of the user. For example, when a user watches an e-book displayed on a tablet while eating French fries, the user does not want to flip through the e-book with greasy fingers.
因此，如何提供使用者一種直覺而無需直接碰觸電子裝置的控制方法，為現今亟需解決的問題。Therefore, how to provide a user with a sense of intuition without directly touching the control method of the electronic device is an urgent problem to be solved today.
有鑑於此，本發明的目的之一在於提供一種依據懸浮物件在電子裝置之非接觸式手勢操作區域內外之間往返的運動資訊來控制電子裝置的方法，來解決上述問題。In view of the above, it is an object of the present invention to provide a method for controlling an electronic device based on motion information of a suspended object traveling between the inside and outside of a non-contact gesture operation area of an electronic device to solve the above problem.
依據本發明之一實施例，其揭示一種電子裝置的控制方法。該電子裝置包含一顯示面，並於靠近該顯示面之處提供一手勢操作區域。該控制方法包含以下步驟：判斷位於該電子裝置周遭之一非接觸物件於該手勢操作區域內與該手勢操作區域外之間移動所產生的一軌跡資訊（例如，物件位置與時間之間的關係，或移動的方向性）；依據該軌跡資訊來辨識該非接觸物件所對應之一非接觸手勢；以及依據該非接觸手勢致使該電子裝置對應執行一特定功能。According to an embodiment of the present invention, a method of controlling an electronic device is disclosed. The electronic device includes a display surface and provides a gesture operation area adjacent to the display surface. The control method includes the following steps: determining a trajectory information (eg, relationship between object position and time) generated by moving one of the non-contact objects around the electronic device between the gesture operation area and the outside of the gesture operation area Or the directionality of the movement; identifying one of the non-contact gestures corresponding to the non-contact object according to the trajectory information; and causing the electronic device to perform a specific function according to the non-contact gesture.
本發明所提供之電子裝置的控制方法不僅可提供非接觸式的人機互動方式，並可滿足使用者執行多元且直覺的非接觸式手勢之需求。The control method of the electronic device provided by the invention not only provides a non-contact human-computer interaction mode, but also satisfies the requirement of the user to perform multiple and intuitive non-contact gestures.
為了提供了直覺且友善的非接觸式人機互動機制，本發明所提供之非接觸式控制方法可判斷懸浮物件於電子裝置之非接觸式手勢操作區域內外之間往返的軌跡資訊（例如，具有物件位置與時間的資訊，或物件移動的方向性），並根據軌跡資訊來定義相對應的懸浮手勢（亦即，未與該電子裝置接觸之非接觸手勢），以致使該電子裝置執行相對應的功能。為了方便說明，以下係以具有可偵測懸浮手勢的多媒體播放裝置來作為範例說明，然而，本發明所提供之非接觸式操控機制也可應用於其他可偵測懸浮手勢的電子裝置。In order to provide an intuitive and friendly non-contact human-computer interaction mechanism, the non-contact control method provided by the present invention can determine the trajectory information of the suspended object between the inside and the outside of the non-contact gesture operation area of the electronic device (for example, having Information about the position and time of the object, or the directionality of the movement of the object), and defining a corresponding hovering gesture (ie, a non-contact gesture that is not in contact with the electronic device) according to the trajectory information, so that the electronic device performs the corresponding operation The function. For convenience of description, the following is a description of a multimedia playback device having a detectable hovering gesture. However, the non-contact manipulation mechanism provided by the present invention is also applicable to other electronic devices capable of detecting a hovering gesture.
請參閱第1圖，其為本發明電子裝置之一實施例的示意圖。於此實施例中，電子裝置100係由一多媒體播放裝置（例如，一影像播放器）來實作之，並可包含一顯示面102。使用者可於電子裝置100/顯示面102的周遭以非接觸手勢來致使電子裝置100執行相對應的功能。舉例來說，電子裝置100可包含一光學感測模組110，其可設置於顯示面102的外圍（或電子裝置100的邊框），並可於顯示面102的前方（朝使用者的方向）提供一非接觸式感測區域WA。因此，當一非接觸物件位於（例如，位於顯示面102前方之使用者的手）非接觸式感測區域WA內時，電子裝置100便可於偵測位於該非接觸物件的一軌跡資訊（例如，移動軌跡或移動方向），並據以執行相對應的功能。Please refer to FIG. 1 , which is a schematic diagram of an embodiment of an electronic device of the present invention. In this embodiment, the electronic device 100 is implemented by a multimedia playback device (for example, an image player) and may include a display surface 102. The user can cause the electronic device 100 to perform a corresponding function in a non-contact gesture around the electronic device 100 / display surface 102 . For example, the electronic device 100 can include an optical sensing module 110 that can be disposed on the periphery of the display surface 102 (or the frame of the electronic device 100) and can be in front of the display surface 102 (in the direction of the user). A non-contact sensing area WA is provided. Therefore, when a non-contact object is located in the non-contact sensing area WA (for example, the user's hand in front of the display surface 102), the electronic device 100 can detect a trajectory information located on the non-contact object (for example, , move the trajectory or move direction) and perform the corresponding function accordingly.
舉例來說（但本發明不限於此），光學感測模組110可發射至少一偵測訊號（光訊號）予該非接觸物件，接收該非接觸物件反射該至少一偵測訊號所產生的複數個反射訊號，進而依據該複數個反射訊號來判斷該非接觸物件的該軌跡資訊（例如，移動軌跡或移動方向）。因此，非接觸式感測區域WA可以是光學感測模組110的照射範圍（例如，光錐）與收光範圍（例如，感測視野）的交集。For example, the optical sensing module 110 can transmit at least one detection signal (optical signal) to the non-contact object, and receive the plurality of detection signals generated by the non-contact object. The reflected signal is further used to determine the trajectory information (eg, the moving trajectory or the moving direction) of the non-contact object according to the plurality of reflected signals. Therefore, the non-contact sensing area WA may be an intersection of an illumination range (eg, a light cone) of the optical sensing module 110 and a light receiving range (eg, a sensing field of view).
第2圖繪示了第1圖所示之光學感測模組110之一實作範例。光學感測模組110可包含一發光源112以及一感測元件114，其中感測元件114可包含複數個感測器（由複數個感測像素/光偵測器P1～P3來實作之）。於此實作範例中，發光源112可發射複數個偵測訊號SS1～SS3（複數個光訊號）至一非接觸物件（使用者的手），而複數個感測像素P1～P3便可分別接收該非接觸物件反射複數個偵測訊號SS1～SS3所產生的複數個反射訊號SR1～SR3，並據以產生複數個偵測結果。由於複數個感測像素P1～P3處於不同位置，因此，當使用者的手處於移動狀態時，複數個感測像素P1～P3所接收的複數個反射訊號SR1～SR3會具有不同的訊號波形，而感測元件114便可對該複數個偵測結果進行運算（例如，互相關處理或計算相位差）以判斷該軌跡資訊（例如，移動的方向、距離與時間）。於一設計變化中，光學感測模組110也可具有定位功能。舉例來說，複數個感測像素P1～P3可定義一幾何平面（複數個感測像素P1～P3並未同時位於同一直線上）。當發光源112發射複數個偵測訊號SS1～SS3時，複數個感測像素P1～P3可分別偵測複數個反射訊號SR1～SR3，並據以產生複數個偵測結果。感測元件114便可對該複數個偵測結果進行運算（例如，三角定位）以得到使用者的手的位置，進而判斷該軌跡資訊（例如，物件位置與時間的關係）。FIG. 2 illustrates an example of an implementation of the optical sensing module 110 shown in FIG. 1. The optical sensing module 110 can include a light source 112 and a sensing component 114. The sensing component 114 can include a plurality of sensors (implemented by a plurality of sensing pixels/photodetectors P1 P P3). ). In this implementation example, the illumination source 112 can transmit a plurality of detection signals SS1 SS SS3 (plurality of optical signals) to a non-contact object (user's hand), and the plurality of sensing pixels P1 to P3 can respectively The plurality of reflection signals SR1 SR SR3 generated by the plurality of detection signals SS1 SS SS3 are received by the non-contact object, and a plurality of detection results are generated accordingly. Since the plurality of sensing pixels P1 - P3 are in different positions, when the user's hand is in the moving state, the plurality of sensing signals SR1 - SR3 received by the plurality of sensing pixels P1 - P3 have different signal waveforms. The sensing component 114 can perform operations (eg, cross-correlation processing or calculate phase difference) on the plurality of detection results to determine the trajectory information (eg, direction, distance, and time of movement). In a design change, the optical sensing module 110 can also have a positioning function. For example, the plurality of sensing pixels P1 - P3 may define a geometric plane (the plurality of sensing pixels P1 - P3 are not simultaneously on the same line). When the illumination source 112 transmits a plurality of detection signals SS1 SS SS3, the plurality of sensing pixels P1 - P3 can detect a plurality of reflection signals SR1 - SR3 respectively, and generate a plurality of detection results accordingly. The sensing component 114 can perform operations (eg, triangulation) on the plurality of detection results to obtain the position of the user's hand, thereby determining the trajectory information (eg, the relationship between the object position and time).
以上光學感測模組110的實作方式係僅供說明之需，並非用來作為本發明之限制。於一實作範例中，光學感測模組110也可由一感測器陣列來實作之。另外，除了將光學感測模組110設置於顯示面102的上方（電子裝置110的上邊框），將光學感測模組110設置於顯示面102的左方、右方、下方或其他地方也是可行的。再者，本發明電子裝置所提供之非接觸式感測區域不一定要位於光學感測模組的正前方。請參閱第3圖，其為本發明電子裝置之另一實施例的示意圖。電子裝置300係基於第1圖所示之電子裝置100的架構，而兩者之間的主要差別在於光學感測模組310所提供之非接觸式感測區域WB可位於（或大致位於）顯示面302的正前方。舉例來說，可利用光學設計（例如，調整光學感測模組內部元件（諸如光學透鏡）的位置）來將調整第2圖所示之感測元件114的感測視野及/或發光源112的照射範圍，以實作出具有非接觸式感測區域WB的光學感測模組310，其中光學感測模組310可採用第2圖的相關段落所述之光學感測機制來運作。如此一來，使用者便可在顯示面302中央的前方進行手勢操作，以符合使用者直覺的操控習慣。The implementation of the above optical sensing module 110 is for illustrative purposes only and is not intended to be a limitation of the present invention. In an implementation example, the optical sensing module 110 can also be implemented by a sensor array. In addition, in addition to the optical sensing module 110 disposed above the display surface 102 (the upper frame of the electronic device 110), the optical sensing module 110 is disposed on the left, right, below, or other places of the display surface 102. feasible. Furthermore, the non-contact sensing area provided by the electronic device of the present invention does not have to be located directly in front of the optical sensing module. Please refer to FIG. 3, which is a schematic diagram of another embodiment of an electronic device of the present invention. The electronic device 300 is based on the architecture of the electronic device 100 shown in FIG. 1 , and the main difference between the two is that the non-contact sensing area WB provided by the optical sensing module 310 can be located (or substantially located). Just in front of face 302. For example, an optical design (eg, adjusting the position of an internal component of the optical sensing module (such as an optical lens)) can be used to adjust the sensed field of view and/or illumination source 112 of the sensing element 114 shown in FIG. The illumination range is implemented to implement an optical sensing module 310 having a non-contact sensing area WB, wherein the optical sensing module 310 can operate using the optical sensing mechanism described in the relevant paragraph of FIG. In this way, the user can perform a gesture operation in front of the center of the display surface 302 to conform to the user's intuitive manipulation habits.
值得注意的是，本發明電子裝置另可於非接觸式感測區域內定義一手勢操作區域，並可依據位於該電子裝置周遭之一非接觸物件於該手勢操作區域內與該手勢操作區域外之間往返的軌跡資訊（例如，移動軌跡或移動方向），來定義直覺的非接觸式手勢。請連同第3圖來參閱第4圖。第4圖為第3圖所示之電子裝置300之前視圖。由第4圖可知，電子裝置300另可於靠近顯示面302之處提供/定義一手勢操作區域GR，如此一來，電子裝置300/光學感測模組310便可判斷使用者的手於手勢操作區域GR內與手勢操作區域GR外之間移動所產生的一軌跡資訊（例如，移動軌跡或移動方向）、依據該軌跡資訊來辨識使用者的手所對應之一非接觸手勢，以及依據該非接觸手勢致使電子裝置300對應執行一特定功能。舉例來說（但本發明不限於此），手勢操作區域GR於顯示面302上的投影可以是（或近似）顯示面302，因此，位於顯示面302前方的使用者便可將「手是否通過顯示面302的邊緣（或電子裝置300的邊框）」作為判斷「手是否進入/離開手勢操作區域GR」的基準。進一步的說明如下。It should be noted that the electronic device of the present invention can define a gesture operation area in the non-contact sensing area, and can be outside the gesture operation area according to one of the non-contact objects located around the electronic device. The trajectory information between the round trip (for example, moving the trajectory or moving direction) to define an intuitive contactless gesture. Please refer to Figure 4 together with Figure 3. Fig. 4 is a front view of the electronic device 300 shown in Fig. 3. As shown in FIG. 4, the electronic device 300 can provide/define a gesture operation area GR near the display surface 302. Thus, the electronic device 300/optical sensing module 310 can determine the user's hand gesture. A track information (for example, a moving track or a moving direction) generated by moving between the operating area GR and the outside of the gesture operating area GR, identifying a non-contact gesture corresponding to the user's hand according to the track information, and according to the non-contact gesture The contact gesture causes the electronic device 300 to perform a particular function. For example (but the invention is not limited thereto), the projection of the gesture operation area GR on the display surface 302 may be (or approximate) the display surface 302, so that the user located in front of the display surface 302 can "take the hand through The edge of the display surface 302 (or the frame of the electronic device 300) is used as a reference for judging whether or not the hand enters/leaves the gesture operation area GR. Further explanation is as follows.
請一併參閱第4圖與第5圖。第5圖為本發明控制電子裝置之一實施例的示意圖。一開始，使用者的手處於手勢操作區域GR內的一起始位置PS1，接下來，使用者的手自起始位置PS1朝顯示面302移動至一中繼位置PI1，其中使用者的手於朝向且垂直於顯示面302的方向所移動的距離超過一預定距離。也就是說，使用者的手所移動的距離（起始位置PS1與中繼位置PI1之間的距離）在顯示面302上通過起始位置PS1的一法線方向上的投影會大於該預定距離。於一實作範例中，使用者的手可直接從起始位置PS1以朝向且垂直於顯示面302的方向移動至中繼位置PI1，使得使用者從顯示面302正前方會看到起始位置PS1與中繼位置PI1於顯示面302上的投影點大致重疊。Please refer to Figure 4 and Figure 5 together. Figure 5 is a schematic diagram of one embodiment of a control electronics device of the present invention. A start, the user's hand is in an initial position within the gesture operation region GR PS1, the next user's hand moved from the start position PS1 toward the display surface 302-1 relay position PI1, wherein the user The distance that the hand moves in a direction that is oriented toward and perpendicular to the display surface 302 exceeds a predetermined distance. That is to say, the distance moved by the user's hand (distance between the starting position PS1 and the relay position PI1 ) on the display surface 302 by the projection in the normal direction of the starting position PS1 is greater than The predetermined distance. In an implementation example, the user's hand can be moved directly from the starting position PS1 in a direction toward and perpendicular to the display surface 302 to the relay position PI1 so that the user can see from the front of the display surface 302. The start position PS1 and the relay position PI1 substantially overlap the projection point on the display surface 302.
在中繼位置PI1停留超過一預定時間之後，使用者的手可自中繼位置PI1以平行於顯示面302的方向移動，於顯示面302的右方離開手勢操作區域GR。當光學感測模組310判斷出上述軌跡資訊時（例如，採用第2圖的相關段落所述之光學感測機制），光學感測模組310（或電子裝置300之一處理電路，未繪示於圖中）便可依據上述軌跡資訊來辨識出使用者係執行一靠近與平移手勢。在辨識出該靠近與平移手勢之後，光學感測模組310（或電子裝置300之該處理電路）便可致使電子裝置300對應執行一特定功能。舉例來說（但本發明不限於此），在電子裝置300處於一文件/網頁/照片瀏覽模式下，第5圖所示之該非接觸手勢可致使電子裝置300對應執行一換頁功能或一頁面捲動功能（例如，顯示畫面往右捲動）。於另一範例中，當電子裝置300係執行一選取指令以選取顯示畫面中的一特定項目（未繪示於第4圖與第5圖）時，第5圖所示之該非接觸手勢可致使電子裝置300刪除該特定項目（例如，將特定項目從顯示畫面右方丟出）。After the relay position PI1 stays for more than a predetermined time, the user's hand can move from the relay position PI1 in a direction parallel to the display surface 302 and away from the gesture operation area GR on the right side of the display surface 302. When the optical sensing module 310 determines the trajectory information (for example, using the optical sensing mechanism described in the related paragraph of FIG. 2), the optical sensing module 310 (or one of the electronic device 300 processing circuits, not drawn) As shown in the figure, the user can recognize that the user performs a close and pan gesture according to the above trajectory information. After the proximity and panning gestures are recognized, the optical sensing module 310 (or the processing circuit of the electronic device 300) can cause the electronic device 300 to perform a specific function. For example (but the invention is not limited thereto), the electronic device 300 is in a file/webpage/photo browsing mode, and the non-contact gesture shown in FIG. 5 may cause the electronic device 300 to perform a page changing function or a page roll. Dynamic function (for example, the display scrolls to the right). In another example, when the electronic device 300 executes a selection command to select a specific item in the display screen (not shown in FIGS. 4 and 5), the non-contact gesture shown in FIG. 5 may cause The electronic device 300 deletes the specific item (for example, throws a specific item from the right of the display screen).
值得注意的是，使用者的手在中繼位置PI1所停留的時間長短可對應不同的特定功能。舉例來說（但本發明不限於此），光學感測模組310另可判斷使用者的手停留在中繼位置PI1的時間是否超過另一預定時間（大於該預定時間）。當使用者的手停留在中繼位置PI1的時間介於該預定時間與該另一預定時間之間時，電子裝置300可根據該靠近與平移手勢執行的一第一特定功能（例如，移動畫面，如同使用滑鼠進行畫面捲動）；當使用者的手停留在中繼位置PI1的時間超過該另一預定時間時，電子裝置300可根據該靠近與平移手勢執行的不同於該第一特定功能的一第二特定功能（例如，移動所選取的項目，如同使用滑鼠進行項目拖曳）。It is worth noting that the length of time that the user's hand stays at the relay position PI1 may correspond to different specific functions. For example (but the invention is not limited thereto), the optical sensing module 310 can further determine whether the time when the user's hand stays at the relay position PI1 exceeds another predetermined time (greater than the predetermined time). When the time when the user's hand stays at the relay position PI1 is between the predetermined time and the other predetermined time, the electronic device 300 may perform a first specific function (eg, moving according to the proximity and pan gesture) The screen is scrolled as if using the mouse; when the user's hand stays at the relay position PI1 for more than the other predetermined time, the electronic device 300 can perform differently according to the proximity and the pan gesture A second specific function of a particular function (eg, moving the selected item as if the item was dragged using a mouse).
另外，為了提昇軌跡偵測的準確性，本發明所提供之電子裝置的控制方法另可包含偵測起始位置的步驟，以防止誤操作。舉例來說，於第5圖所示之實施例中，光學感測模組310可判斷使用者的手停留於一特定位置的時間是否超過一特定時間（例如，根據反射訊號之波形或位置運算結果來判斷）。當判斷出使用者的手停留於該特定位置的時間超過該特定時間時，光學感測模組310才可將該特定位置作為手勢操作的一起始位置（例如，起始位置PS1）。接下來，光學感測模組310便可判斷位於該起始位置之使用者的手於手勢操作區域GR內與手勢操作區域GR外之間移動所產生的軌跡資訊。In addition, in order to improve the accuracy of the track detection, the control method of the electronic device provided by the present invention may further include the step of detecting the starting position to prevent erroneous operations. For example, in the embodiment shown in FIG. 5, the optical sensing module 310 can determine whether the time the user's hand stays at a specific location exceeds a certain time (for example, according to the waveform or position of the reflected signal) The result is judged). When it is determined that the time when the user's hand stays at the specific position exceeds the specific time, the optical sensing module 310 can use the specific position as a starting position of the gesture operation (for example, the starting position PS1 ). Next, the optical sensing module 310 can determine the trajectory information generated by the user's hand located at the initial position between the gesture operation area GR and the outside of the gesture operation area GR.
雖然以上是以手勢操作區域GR（其於顯示面302上的投影大致是顯示面302的大小）來作為範例說明，然而，依實際需求來調整手勢操作區域的大小及/或位置也是可行的。為了便於理解本發明的技術特徵，以下仍是基於第4圖所示之手勢操作區域GR來說明本發明電子裝置的控制機制，但這並非用來作為本發明的限制。Although the above is illustrated by the gesture operation area GR (the projection on the display surface 302 is roughly the size of the display surface 302), it is also feasible to adjust the size and/or position of the gesture operation area according to actual needs. In order to facilitate the understanding of the technical features of the present invention, the control mechanism of the electronic device of the present invention will be described below based on the gesture operation area GR shown in FIG. 4, but this is not intended to be a limitation of the present invention.
請一併參閱與第4圖與第6圖。第6圖為本發明控制電子裝置之另一實施例的示意圖。使用者的手自手勢操作區域GR外之一起始位置PS2以平行於顯示面302的方向移動，於顯示面302的右方進入手勢操作區域GR而抵達位於手勢操作區域GR內的一中繼位置PI2。在中繼位置PI2停留超過一預定時間之後，使用者的手自中繼位置PI2遠離顯示面302，其中使用者的手於遠離且垂直於顯示面302的方向所移動的距離超過一預定距離。也就是說，使用者的手所遠離的距離在顯示面302上通過中繼位置PI2的一法線方向上的投影會大於該預定距離。於一實作範例中，使用者的手可直接從中繼位置PI2以遠離且垂直於顯示面302的方向移動。Please refer to Figure 4 and Figure 6 together. Figure 6 is a schematic view of another embodiment of the control electronics of the present invention. A start position PS2 of the user's hand gesture operation area GR moves in a direction parallel to the display surface 302, enters the gesture operation area GR on the right side of the display surface 302, and reaches a relay located in the gesture operation area GR. Position PI2 . After the relay position PI2 stays for more than a predetermined time, the user's hand moves from the relay position PI2 away from the display surface 302 , wherein the distance the user's hand moves away from and perpendicular to the display surface 302 exceeds a predetermined distance. distance. That is, the distance that the distance the user's hand is away from on the display surface 302 through the relay position PI2 may be greater than the predetermined distance. In an implementation example, the user's hand can be moved away from the relay position PI2 in a direction away from and perpendicular to the display surface 302.
當光學感測模組310判斷出上述軌跡資訊時（例如，採用第2圖的相關段落所述之光學感測機制），光學感測模組310（或電子裝置300之一處理電路，未繪示於圖中）便可依據上述軌跡資訊來辨識出使用者係執行一平移與遠離手勢。在辨識出該平移與遠離手勢之後，光學感測模組310（或電子裝置300之該處理電路）便可致使電子裝置300對應執行一特定功能。舉例來說（但本發明不限於此），第6圖所示之該非接觸手勢可致使電子裝置300對應執行一呼叫快捷選單之功能。When the optical sensing module 310 determines the trajectory information (for example, using the optical sensing mechanism described in the related paragraph of FIG. 2), the optical sensing module 310 (or one of the electronic device 300 processing circuits, not drawn) As shown in the figure, the user can recognize that the user performs a panning and moving gesture according to the above trajectory information. After the panning and moving gestures are recognized, the optical sensing module 310 (or the processing circuit of the electronic device 300) can cause the electronic device 300 to perform a specific function. For example (but the invention is not limited thereto), the non-contact gesture shown in FIG. 6 may cause the electronic device 300 to perform a function of calling a shortcut menu.
相似地，為了提昇軌跡偵測的準確性，第6圖所涉及之電子裝置的控制方法另可包含偵測起始位置的步驟，以防止誤操作。舉例來說，光學感測模組310可判斷使用者的手停留於一特定位置的時間是否超過一特定時間。當判斷出使用者的手停留於該特定位置的時間超過該特定時間時，光學感測模組310才可將該特定位置作為手勢操作的一起始位置（例如，起始位置PS2）。接下來，光學感測模組310便可判斷位於該起始位置之使用者的手於手勢操作區域GR內與手勢操作區域GR外之間移動所產生的軌跡資訊。Similarly, in order to improve the accuracy of the trajectory detection, the control method of the electronic device involved in FIG. 6 may further include a step of detecting the starting position to prevent erroneous operation. For example, the optical sensing module 310 can determine whether the time the user's hand stays at a particular location exceeds a certain time. When it is determined that the time when the user's hand stays at the specific position exceeds the specific time, the optical sensing module 310 can use the specific position as a starting position of the gesture operation (for example, the starting position PS2 ). Next, the optical sensing module 310 can determine the trajectory information generated by the user's hand located at the initial position between the gesture operation area GR and the outside of the gesture operation area GR.
第7圖、第9圖與第11圖繪示了不同平移方向的靠近與平移手勢的示意圖。由於熟習技藝者經由閱讀第1圖～第5圖的相關說明之後，應可了解第7圖、第9圖與第11圖所示之非接觸手勢的操作細節，故進一步的說明在此便不再贅述。第8圖、第10圖與第12圖繪示了不同平移方向的平移與遠離手勢的示意圖。由於熟習技藝者經由閱讀第1圖～第6圖的相關說明之後，應可了解第8圖、第10圖與第12圖所示之非接觸手勢的操作細節，故進一步的說明在此便不再贅述。Figures 7, 9, and 11 illustrate schematic diagrams of proximity and translation gestures for different translational directions. Since the skilled artisan can understand the operation details of the non-contact gestures shown in FIG. 7 , FIG. 9 and FIG. 11 after reading the related descriptions of FIGS. 1 to 5 , further explanation is not given here. Let me repeat. Figures 8, 10 and 12 illustrate schematic diagrams of translation and faraway gestures for different translational directions. Since the skilled artisan can understand the operation details of the non-contact gestures shown in FIG. 8, FIG. 10 and FIG. 12 after reading the related descriptions of FIGS. 1 to 6, the further explanation is not here. Let me repeat.
當使用者的手在一預定時間內於手勢操作區域的同一側進出時，可觸發一非接觸旋轉手勢，並致使電子裝置對應執行一特定功能。請一併參閱第4圖與第13圖。第13圖為本發明控制電子裝置之另一實施例的示意圖。一開始，使用者的手處於手勢操作區域GR外的一起始位置PS3，接下來，使用者的手從手勢操作區域GR（或顯示面302）的右側進入手勢操作區域GR，再從手勢操作區域GR（或顯示面302）的右側離開手勢操作區域GR。當光學感測模組310偵測出上述連串動作係於一預定時間內完成時（例如，採用第2圖的相關段落所述之光學感測機制），光學感測模組310可依據上述軌跡資訊（例如，依據反射訊號之波形變化來判斷之，或採用定位運算方法來判斷之）來辨識出使用者係執行一旋轉手勢。When the user's hand enters and exits on the same side of the gesture operation area for a predetermined time, a non-contact rotation gesture can be triggered and the electronic device is caused to perform a specific function. Please refer to Figure 4 and Figure 13 together. Figure 13 is a schematic view of another embodiment of the control electronics of the present invention. Initially, the user's hand is in a starting position PS3 outside the gesture operating area GR. Next, the user's hand enters the gesture operating area GR from the right side of the gesture operating area GR (or the display surface 302), and then operates from the gesture. The right side of the area GR (or the display surface 302) leaves the gesture operation area GR. When the optical sensing module 310 detects that the series of actions is completed within a predetermined time (for example, using the optical sensing mechanism described in the related paragraph of FIG. 2), the optical sensing module 310 can be configured according to the above The trajectory information (for example, judged according to the waveform change of the reflected signal or determined by the positioning operation method) is used to recognize that the user performs a rotation gesture.
於一實作範例中，手勢操作區域GR可劃分複數個子區域，以判斷使用者的手是否於手勢操作區域GR的同一側進出。請參閱第14圖，其為第13圖所示之電子裝置300之手勢操作區域的一實作範例的示意圖。於此實作範例中，手勢操作區域GR之邊界BD可分為複數個子邊界B1～B4。因此，若使用者的手於一預定時間內完成以下動作：「自手勢操作區域GR外之起始位置PS3經由複數個子邊界B1～B4之中的一子邊界（例如，子邊界B2）進入手勢操作區域GR；在進入手勢操作區域GR之後，經由複數個子邊界B1～B4之中的該子邊界離開手勢操作區域GR」，則光學感測模組310可依據上述軌跡資訊（例如，依據反射訊號之波形變化來判斷之，或採用定位運算方法來判斷之）辨識出使用者係執行一旋轉手勢。In an implementation example, the gesture operation area GR may divide a plurality of sub-areas to determine whether the user's hand enters and exits on the same side of the gesture operation area GR. Please refer to FIG. 14 , which is a schematic diagram of an implementation example of the gesture operation area of the electronic device 300 shown in FIG. 13 . In this implementation example, the boundary BD of the gesture operation area GR may be divided into a plurality of sub-boundaries B1 to B4. Therefore, if the user's hand completes the following actions within a predetermined time: "The starting position PS3 outside the gesture operation area GR enters through one of the plurality of sub-boundaries B1 - B4 (for example, the sub-boundary B2) The gesture operation area GR; after entering the gesture operation area GR, leaving the gesture operation area GR" through the sub-boundary of the plurality of sub-boundaries B1 BB4, the optical sensing module 310 can be based on the trajectory information (for example, according to the reflection The waveform of the signal is changed to determine, or the positioning operation method is used to determine that the user performs a rotation gesture.
於另一實作範例中，本發明電子裝置的控制機制也可以直接根據使用者的手進入與離開手勢操作區域的位置，來判斷使用者的手是否於手勢操作區域的同一側進出。請參閱第15圖，其為第13圖所示之電子裝置300之手勢操作區域的另一實作範例的示意圖。於此實作範例中，手勢操作區域GR具有一邊界BD。若使用者的手於一預定時間內完成以下動作：「自手勢操作區域GR外之一起始位置PS3經由邊界BD上的一第一位置PE進入手勢操作區域GR；在進入手勢操作區域GR之後，經由邊界BD上的一第二位置PL離開手勢操作區域GR，其中第二位置PL與第一位置PE之間的距離小於一預定距離DP」，則光學感測模組310可依據上述軌跡資訊辨識出使用者係執行一旋轉手勢。換言之，在使用者的手是從第一位置PE進入手勢操作區域GR的情形下，只要使用者的手是從以第一位置PE為圓心、預定距離DP為半徑的球體內離開手勢操作區域GR，均可視為於手勢操作區域GR的同一側進出。In another implementation example, the control mechanism of the electronic device of the present invention can also directly determine whether the user's hand enters and exits on the same side of the gesture operation area according to the position of the user's hand entering and leaving the gesture operation area. Please refer to FIG. 15 , which is a schematic diagram of another implementation example of the gesture operation area of the electronic device 300 shown in FIG. 13 . In this implementation example, the gesture operation area GR has a boundary BD. If the user's hand completes the following actions within a predetermined time: "One of the starting positions PS3 outside the gesture operation area GR enters the gesture operation area GR via a first position PE on the boundary BD; in the entering gesture operation area GR Thereafter, the gesture operation area GR is separated from a second position PL on the boundary BD, wherein the distance between the second position PL and the first position PE is less than a predetermined distance DP ′′, then the optical sensing module 310 According to the above trajectory information, the user can recognize that the user performs a rotation gesture. In other words, in the case where the user's hand enters the gesture operation area GR from the first position PE , as long as the user's hand is from the sphere with the first position PE as the center, the predetermined distance DP is the radius of the sphere leaving the gesture The operation area GR can be regarded as entering and leaving on the same side of the gesture operation area GR.
在辨識出該旋轉手勢之後，光學感測模組310（或電子裝置300之一處理電路，未繪示於圖中）便可致使電子裝置300對應執行一特定功能。舉例來說（但本發明不限於此），第13圖所示之該非接觸手勢可致使電子裝置300對應執行一項目旋轉功能或一畫面旋轉功能（例如，旋轉一預定角度）。After the rotation gesture is recognized, the optical sensing module 310 (or one of the processing circuits of the electronic device 300, not shown) can cause the electronic device 300 to perform a specific function. For example (but the invention is not limited thereto), the non-contact gesture shown in FIG. 13 may cause the electronic device 300 to perform an item rotation function or a picture rotation function (for example, rotating a predetermined angle).
值得注意的是，當光學感測模組310所判斷之軌跡資訊指示出使用者的手平行於顯示面302的旋轉方向為一順時針方向時，該旋轉手勢係為一順時針旋轉手勢；以及當光學感測模組310所判斷之軌跡資訊指示出使用者的手平行於顯示面302的旋轉方向為一逆時針方向時，該旋轉手勢係為一逆時針旋轉手勢。於一實作範例中，光學感測模組310可依據使用者的手進入與離開手勢操作區域GR的方向來判斷旋轉手勢的方向性。以第14圖為例，使用者的手以一第一方向DE1進入手勢操作區域GR，以一第二方向DL1離開手勢操作區域GR。由於第一方向DE1旋轉至第二方向DL1的旋轉方向投影於顯示面302上為一逆時針方向（亦即，使用者的手往下迴轉），因此，光學感測模組310所判斷之軌跡資訊係指示出使用者的手平行於顯示面302的旋轉方向為逆時針方向（相對應之旋轉手勢係為一逆時針旋轉手勢）。於第16圖所示之實作範例中，使用者的手以一第一方向DE2進入手勢操作區域GR，以一第二方向DL2離開手勢操作區域GR。由於第一方向DE1旋轉至第二方向DL2的旋轉方向投影於顯示面302上為一順時針方向（亦即，使用者的手往上迴轉），因此，光學感測模組310便所判斷之軌跡資訊係指示出使用者的手平行於顯示面302的旋轉方向為順時針方向（相對應之旋轉手勢係為一順時針旋轉手勢）。It should be noted that when the trajectory information determined by the optical sensing module 310 indicates that the direction of rotation of the user's hand parallel to the display surface 302 is a clockwise direction, the rotation gesture is a clockwise rotation gesture; When the trajectory information determined by the optical sensing module 310 indicates that the direction of rotation of the user's hand parallel to the display surface 302 is a counterclockwise direction, the rotation gesture is a counterclockwise rotation gesture. In an implementation example, the optical sensing module 310 can determine the directionality of the rotation gesture according to the direction in which the user's hand enters and leaves the gesture operation area GR. Taking FIG. 14 as an example, the user's hand enters the gesture operation area GR in a first direction DE1 and leaves the gesture operation area GR in a second direction DL1 . Since the rotation direction of the first direction DE1 to the second direction DL1 is projected on the display surface 302 in a counterclockwise direction (that is, the user's hand is turned down), the optical sensing module 310 determines The trajectory information indicates that the direction of rotation of the user's hand parallel to the display surface 302 is counterclockwise (the corresponding rotation gesture is a counterclockwise rotation gesture). In the implementation example shown in FIG. 16, the user's hand enters the gesture operation area GR in a first direction DE2 and leaves the gesture operation area GR in a second direction DL2 . Since the rotation direction of the first direction DE1 to the second direction DL2 is projected on the display surface 302 in a clockwise direction (that is, the user's hand is turned up), the optical sensing module 310 determines The trajectory information indicates that the direction of rotation of the user's hand parallel to the display surface 302 is clockwise (the corresponding rotation gesture is a clockwise rotation gesture).
於一設計變化中，也可依據光學感測模組所接收之反射訊號的波形變化來判斷使用者的手的旋轉方向。舉例來說，在第13圖所示之光學感測模組310係由第2圖所示之光學感測模組110來實作的情形下，光學感測模組110可依據複數個感測像素P1～P3分別產生之該複數個偵測結果來判斷複數個反射訊號SR1～SR3分別出現波峰的時間點。於第13圖所示之實作範例中，由於使用者的手平行於顯示面302的旋轉方向為逆時針方向，因此複數個反射訊號SR1～SR3的波峰係以一第一預定次序輪流出現（反射訊號SR2的波峰先出現、反射訊號SR1的波峰接著出現、反射訊號SR3的波峰最後出現）。光學感測模組110所判斷之軌跡資訊便可指示出使用者的手平行於顯示面302的旋轉方向為逆時針方向。另外，當複數個反射訊號SR1～SR3的波峰係以不同於該第一預定次序的一第二預定次序輪流出現時（例如，反射訊號SR3先出現、反射訊號SR1接著出現、反射訊號SR2最後出現），光學感測模組110所判斷之軌跡資訊可指示出使用者的手平行於顯示面302的旋轉方向為順時針方向（例如，第16圖所示之實作範例）。In a design change, the direction of rotation of the user's hand can also be determined based on the waveform change of the reflected signal received by the optical sensing module. For example, in the case where the optical sensing module 310 shown in FIG. 13 is implemented by the optical sensing module 110 shown in FIG. 2, the optical sensing module 110 can be based on a plurality of sensing. The plurality of detection results respectively generated by the pixels P1 to P3 determine the time points at which the plurality of reflected signals SR1 to SR3 respectively have peaks. In the implementation example shown in FIG. 13, since the direction of rotation of the user's hand parallel to the display surface 302 is counterclockwise, the peaks of the plurality of reflected signals SR1 to SR3 alternately appear in a first predetermined order ( The peak of the reflected signal SR2 appears first, the peak of the reflected signal SR1 appears, and the peak of the reflected signal SR3 appears last. The trajectory information determined by the optical sensing module 110 can indicate that the direction of rotation of the user's hand parallel to the display surface 302 is counterclockwise. In addition, when the peaks of the plurality of reflected signals SR1 SR SR3 are rotated out in a second predetermined order different from the first predetermined order (eg, the reflected signal SR3 appears first, the reflected signal SR1 appears next, and the reflected signal SR2 appears last). The trajectory information determined by the optical sensing module 110 may indicate that the direction of rotation of the user's hand parallel to the display surface 302 is clockwise (for example, the practical example shown in FIG. 16).
相似地，為了提昇軌跡偵測的準確性，第13圖與第16圖所涉及之電子裝置的控制方法另可包含偵測起始位置的步驟，以防止誤操作。以第13圖為例，光學感測模組310可判斷使用者的手停留於一特定位置的時間是否超過一特定時間。當判斷出使用者的手停留於該特定位置的時間超過該特定時間時，光學感測模組310才可將該特定位置作為手勢操作的一起始位置（例如，起始位置PS3）。接下來，光學感測模組310便可判斷位於該起始位置之使用者的手於手勢操作區域GR內與手勢操作區域GR外之間移動所產生的軌跡資訊。Similarly, in order to improve the accuracy of the trajectory detection, the control method of the electronic device according to FIGS. 13 and 16 may further include a step of detecting the starting position to prevent erroneous operation. Taking FIG. 13 as an example, the optical sensing module 310 can determine whether the time the user's hand stays at a specific location exceeds a certain time. When it is determined that the time when the user's hand stays at the specific position exceeds the specific time, the optical sensing module 310 can use the specific position as a starting position of the gesture operation (for example, the starting position PS3 ). Next, the optical sensing module 310 can determine the trajectory information generated by the user's hand located at the initial position between the gesture operation area GR and the outside of the gesture operation area GR.
第17圖～第22圖繪示了不同旋轉手勢的實作範例示意圖。由於熟習技藝者經由閱讀第1圖～第16圖的相關說明之後，應可了解第17圖～第22圖所示之非接觸手勢的操作細節，故進一步的說明在此便不再贅述。另外，雖然以上係以第3圖所示之電子裝置300（非接觸式感測區域WB位於顯示面302的正前方）來作為範例說明，然而，熟習技藝者應可了解本發明所提供之電子裝置的控制方法也可以應用於第1圖所示之電子裝置100（非接觸式感測區域WA位於光學感測模組110的正前方）之中。17 to 22 illustrate schematic diagrams of practical examples of different rotation gestures. Since the skilled artisan will understand the operation details of the non-contact gestures shown in FIGS. 17 to 22 after reading the related descriptions of FIGS. 1 to 16 , further description will not be repeated here. In addition, although the electronic device 300 shown in FIG. 3 (the non-contact sensing area WB is located directly in front of the display surface 302) is exemplified above, the skilled artisan should be able to understand the electronic provided by the present invention. The control method of the device can also be applied to the electronic device 100 shown in FIG. 1 (the non-contact sensing region WA is located directly in front of the optical sensing module 110).
本發明所提供之電子裝置的控制方法不僅可提供非接觸式的人機互動方式，並可滿足使用者執行多元且直覺的非接觸式手勢之需求。 以上所述僅為本發明之較佳實施例，凡依本發明申請專利範圍所做之均等變化與修飾，皆應屬本發明之涵蓋範圍。The control method of the electronic device provided by the invention not only provides a non-contact human-computer interaction mode, but also satisfies the requirement of the user to perform multiple and intuitive non-contact gestures. The above are only the preferred embodiments of the present invention, and all changes and modifications made to the scope of the present invention should be within the scope of the present invention.
100、300‧‧‧電子裝置
102、302‧‧‧顯示面
110、310‧‧‧光學感測模組
112‧‧‧發光源
114‧‧‧感測器
P1～P3‧‧‧感測像素
WA、WB‧‧‧非接觸式感測區域
GR‧‧‧手勢操作區域
BD‧‧‧邊界
B1～B3‧‧‧子邊界
SS1～SS3‧‧‧偵測訊號
SR1～SR3‧‧‧反射訊號
PS1～PS3‧‧‧起始位置
PI1、PI2‧‧‧中繼位置
PE‧‧‧第一位置
PL‧‧‧第二位置
DP‧‧‧預定距離
DE1、DE2‧‧‧第一方向
DL1、DL2‧‧‧第二方向100, 300‧‧‧ electronic devices
102, 302‧‧‧ display surface
110, 310‧‧‧ Optical sensing module
112‧‧‧Light source
114‧‧‧Sensor
P1～P3‧‧‧ sensing pixels
WA, WB‧‧‧ non-contact sensing area
GR‧‧‧ gesture operation area
BD‧‧ border
B1～B3‧‧‧ sub-boundary
SS1～SS3‧‧‧Detection signal
SR1～SR3‧‧‧Reflective signal
PS1 ~ PS3 ‧‧‧ starting position
PI1 , PI2 ‧‧‧ Relay position
PE ‧‧‧First position
PL ‧‧‧second position
DP ‧‧‧Predetermined distance
DE1 , DE2 ‧‧‧ first direction
DL1 , DL2 ‧‧‧second direction
第1圖為本發明電子裝置之一實施例的示意圖。 第2圖繪示了第1圖所示之光學感測模組之一實作範例。 第3圖為本發明電子裝置之另一實施例的示意圖。 第4圖為第3圖所示之電子裝置之前視圖。 第5圖為本發明控制電子裝置之一實施例的示意圖。 第6圖為本發明控制電子裝置之另一實施例的示意圖。 第7圖為本發明控制電子裝置之另一實施例的示意圖。 第8圖為本發明控制電子裝置之另一實施例的示意圖。 第9圖為本發明控制電子裝置之另一實施例的示意圖。 第10圖為本發明控制電子裝置之另一實施例的示意圖。 第11圖為本發明控制電子裝置之另一實施例的示意圖。 第12圖為本發明控制電子裝置之另一實施例的示意圖。 第13圖為本發明控制電子裝置之另一實施例的示意圖。 第14圖為第13圖所示之電子裝置之手勢操作區域的一實作範例的示意圖。 第15圖為第13圖所示之電子裝置之手勢操作區域的另一實作範例的示意圖。 第16圖為本發明控制電子裝置之另一實施例的示意圖。 第17圖為本發明控制電子裝置之另一實施例的示意圖。 第18圖為本發明控制電子裝置之另一實施例的示意圖。 第19圖為本發明控制電子裝置之另一實施例的示意圖。 第20圖為本發明控制電子裝置之另一實施例的示意圖。 第21圖為本發明控制電子裝置之另一實施例的示意圖。 第22圖為本發明控制電子裝置之另一實施例的示意圖。1 is a schematic view of an embodiment of an electronic device of the present invention. FIG. 2 is a view showing an example of the implementation of the optical sensing module shown in FIG. 1. 3 is a schematic view of another embodiment of an electronic device of the present invention. Fig. 4 is a front view of the electronic device shown in Fig. 3. Figure 5 is a schematic diagram of one embodiment of a control electronics device of the present invention. Figure 6 is a schematic view of another embodiment of the control electronics of the present invention. Figure 7 is a schematic diagram of another embodiment of the control electronics of the present invention. Figure 8 is a schematic illustration of another embodiment of a control electronics device of the present invention. Figure 9 is a schematic view of another embodiment of the control electronics of the present invention. Figure 10 is a schematic illustration of another embodiment of a control electronics device of the present invention. Figure 11 is a schematic view of another embodiment of the control electronics of the present invention. Figure 12 is a schematic view of another embodiment of the control electronics of the present invention. Figure 13 is a schematic view of another embodiment of the control electronics of the present invention. Fig. 14 is a schematic diagram showing an example of a gesture operation area of the electronic device shown in Fig. 13. Fig. 15 is a view showing another embodiment of the gesture operation area of the electronic device shown in Fig. 13. Figure 16 is a schematic view of another embodiment of the control electronics of the present invention. Figure 17 is a schematic view of another embodiment of the control electronics of the present invention. Figure 18 is a schematic view of another embodiment of the control electronics of the present invention. Figure 19 is a schematic diagram of another embodiment of the control electronics of the present invention. Figure 20 is a schematic view of another embodiment of the control electronics of the present invention. Figure 21 is a schematic view of another embodiment of the control electronics of the present invention. Figure 22 is a schematic view of another embodiment of the control electronics of the present invention.
300‧‧‧電子裝置300‧‧‧Electronic devices
302‧‧‧顯示面302‧‧‧ display surface
310‧‧‧光學感測模組310‧‧‧Optical sensing module
WB‧‧‧非接觸式感測區域WB‧‧‧ non-contact sensing area
GR‧‧‧手勢操作區域GR‧‧‧ gesture operation area
PS1、PS2‧‧‧起始位置PS1 , PS2 ‧‧‧ starting position
PI1、PI2‧‧‧中繼位置PI1 , PI2 ‧‧‧ Relay position
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US14/720,983US20150346830A1 (en) | 2014-05-30 | 2015-05-26 | Control method of electronic apparatus having non-contact gesture sensitive region |
| CN201510288115.XACN105183335A (en) | 2014-05-30 | 2015-05-29 | Control method of electronic device |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201462004912P | 2014-05-30 | 2014-05-30 |
| Publication Number | Publication Date |
|---|---|
| TW201545051Atrue TW201545051A (en) | 2015-12-01 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| TW104114390ATW201545051A (en) | 2014-05-30 | 2015-05-06 | Control method of electronic apparatus |
| TW104114376ATWI524262B (en) | 2014-05-30 | 2015-05-06 | Control method of electronic apparatus |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| TW104114376ATWI524262B (en) | 2014-05-30 | 2015-05-06 | Control method of electronic apparatus |
| Country | Link |
|---|---|
| TW (2) | TW201545051A (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI653550B (en) | 2017-07-06 | 2019-03-11 | 鴻海精密工業股份有限公司 | Electronic device and display control method thereof |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI757871B (en)* | 2020-09-16 | 2022-03-11 | 宏碁股份有限公司 | Gesture control method based on image and electronic apparatus using the same |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI653550B (en) | 2017-07-06 | 2019-03-11 | 鴻海精密工業股份有限公司 | Electronic device and display control method thereof |
| Publication number | Publication date |
|---|---|
| TW201545050A (en) | 2015-12-01 |
| TWI524262B (en) | 2016-03-01 |
| Publication | Publication Date | Title |
|---|---|---|
| US11698706B2 (en) | Method and apparatus for displaying application | |
| KR102194272B1 (en) | Enhancing touch inputs with gestures | |
| EP2630563B1 (en) | Apparatus and method for user input for controlling displayed information | |
| US8836645B2 (en) | Touch input interpretation | |
| US20140191998A1 (en) | Non-contact control method of electronic apparatus | |
| US9524097B2 (en) | Touchscreen gestures for selecting a graphical object | |
| JP5856189B2 (en) | Touchless interactive display system | |
| US9639167B2 (en) | Control method of electronic apparatus having non-contact gesture sensitive region | |
| US20160004373A1 (en) | Method for providing auxiliary information and touch control display apparatus using the same | |
| US20140237422A1 (en) | Interpretation of pressure based gesture | |
| US20140237408A1 (en) | Interpretation of pressure based gesture | |
| US8775958B2 (en) | Assigning Z-order to user interface elements | |
| US9417733B2 (en) | Touch method and touch system | |
| US20140123080A1 (en) | Electrical Device, Touch Input Method And Control Method | |
| US9983779B2 (en) | Method of displaying menu based on depth information and space gesture of user | |
| CN110647244A (en) | Terminal and method for controlling the terminal based on space interaction | |
| US9891813B2 (en) | Moving an image displayed on a touchscreen of a device | |
| US9477398B2 (en) | Terminal and method for processing multi-point input | |
| US20150346830A1 (en) | Control method of electronic apparatus having non-contact gesture sensitive region | |
| CN104407786A (en) | Interactive display method, control method and system for implementing holographic image display | |
| US10402080B2 (en) | Information processing apparatus recognizing instruction by touch input, control method thereof, and storage medium | |
| US10042445B1 (en) | Adaptive display of user interface elements based on proximity sensing | |
| WO2012119548A1 (en) | Control method, control device, display device, and electronic device | |
| CN103838507A (en) | Touch-sensing display device and driving method thereof | |
| US20180210597A1 (en) | Information processing device, information processing method, and program |