技术领域technical field
本发明涉及屏幕触控技术，尤其涉及一种应用程序交互控制方法、装置及终端。The present invention relates to screen touch technology, in particular to an application program interaction control method, device and terminal.
背景技术Background technique
在现有技术中，通常会在移动终端屏幕的边框设置一些物理的功能按键，在使用应用程序的过程中，通过这些物理按键可以较为快捷地调控应用程序的一些功能和参数。例如，在相机应用程序下，通过音量增减的物理键可以调节曝光度以及定时快门时间等。In the prior art, some physical function keys are usually arranged on the frame of the mobile terminal screen, and some functions and parameters of the application program can be adjusted and controlled relatively quickly through these physical keys during the use of the application program. For example, under the camera application, the exposure and shutter time can be adjusted through the physical keys of volume increase and decrease.
同时，除了使用物理按键对应用程序进行控制，还可以通过在应用程序的交互界面上采用点击或者滑动操作，以实现对应用程序的一些功能和参数进行调控的目的。At the same time, in addition to using physical buttons to control the application program, some functions and parameters of the application program can also be adjusted by clicking or sliding on the interactive interface of the application program.
但是，随着移动终端的边框越做越窄，出现省去物理按键的移动终端，因此，失去了通过这些物理按键较为快捷地调控应用程序的一些功能和参数这一途径。However, as the frame of the mobile terminal becomes narrower and narrower, a mobile terminal without physical buttons appears, and therefore, the method of quickly controlling some functions and parameters of the application program through these physical buttons is lost.
同时，由于应用程序的功能越来越复杂，相应的交互界面也越来越复杂，每个应用程序的交互界面和交互方式也各不相同。因此，通过在应用程序的交互界面上采用点击或者滑动操作，以实现对应用程序的一些功能和参数进行调控时，实用性较差、操作难度较大，用户体验不佳，还容易造成误触现象的发生。At the same time, as the functions of the application programs become more and more complex, the corresponding interaction interfaces are also more and more complex, and the interaction interfaces and interaction methods of each application program are also different. Therefore, when some functions and parameters of the application are controlled by clicking or sliding on the interactive interface of the application, the practicability is poor, the operation is difficult, the user experience is not good, and it is easy to cause accidental touches. occurrence of the phenomenon.
更进一步地，随着移动终端的屏幕尺寸也在向大的趋势发展，在这种情况下通过物理按键或者应用程序的交互界面对应用程序进行调控可能会有以下不便之处：Further, as the screen size of the mobile terminal is also developing towards a larger trend, in this case, there may be the following inconveniences in controlling the application program through the physical button or the interactive interface of the application program:
屏幕的边框比较窄，一方面，当终端屏幕左右两边的侧边框比较窄时，当用户手握终端进行相应的应用程序交互操作时，手掌容易误触侧边框的屏幕，从而导出误触现象的发生；The border of the screen is relatively narrow. On the one hand, when the side borders on the left and right sides of the terminal screen are relatively narrow, when the user holds the terminal to perform corresponding application interaction operations, the palm of the hand is likely to accidentally touch the screen on the side borders, thereby leading to false touches. occur;
另一方面，当终端屏幕上下两边的顶、底部边框比较窄时，当用户横握终端观看视频，并对播放器程序的音量或者光线进行调节时，手指容易误触及其它的屏幕区域，从而导致误触现象的发生，同时，当下边框过窄，用户在握持终端操作点击屏幕下端按键的过程中，容易使得终端的重心不稳，从而造成终端从手中滑落的危险。On the other hand, when the top and bottom borders on the upper and lower sides of the terminal screen are relatively narrow, when the user holds the terminal horizontally to watch videos and adjust the volume or light of the player program, the fingers are likely to touch other screen areas by mistake, resulting in At the same time, the current frame is too narrow. When the user holds the terminal and clicks the buttons at the bottom of the screen, it is easy to make the center of gravity of the terminal unstable, thus causing the danger of the terminal slipping from the hand.
因此，现有技术中还没有一种完全依靠触控手势对应用程序进行控制操作的方法，同时，现有的触控手势操作局限性较大，在有些应用程序的界面内并不能很好替代物理按键的功能，同时，应用程序本身的交互界面的使用步骤较为复杂，局限性较大。另一方面，现有的触控手势通常定义在全屏幕，因此，当功能较多时，需要为此划分较多的触控手势，从而使得用户的使用难度增强，用户体验较差。Therefore, in the prior art, there is no method for controlling and operating an application program entirely by touch gestures. At the same time, the existing touch gesture operation has relatively large limitations, and cannot be a good replacement in the interface of some application programs. At the same time, the steps to use the interactive interface of the application itself are relatively complicated and have relatively large limitations. On the other hand, the existing touch gestures are usually defined on the full screen. Therefore, when there are many functions, more touch gestures need to be divided for this purpose, which makes it more difficult for the user to use, and the user experience is poor.
发明内容Contents of the invention
有鉴于此，本发明要解决的技术问题是提供一种应用程序交互控制方法、装置及终端，以解决现有技术中还没有一种完全依靠触控手势对应用程序进行控制操作的方法，同时，现有的触控手势操作局限性较大，在有些应用程序的界面内并不能很好替代物理按键的功能，应用程序本身的交互界面的使用步骤较为复杂，局限性较大，另一方面，现有的触控手势通常定义在全屏幕，因此，当功能需求较多时，需要为此划分较多的触控手势，从而使得用户的使用难度增强，用户体验较差的缺陷。In view of this, the technical problem to be solved by the present invention is to provide an application program interaction control method, device and terminal to solve the problem that there is no method in the prior art that completely relies on touch gestures to control and operate applications. , the existing touch gesture operation has relatively large limitations, and in the interface of some application programs, it cannot well replace the function of physical buttons. , the existing touch gestures are usually defined on the full screen, therefore, when there are many functional requirements, more touch gestures need to be divided for this purpose, which makes the user more difficult to use and has the disadvantages of poor user experience.
本发明解决上述技术问题所采用的技术方案如下：The technical solution adopted by the present invention to solve the problems of the technologies described above is as follows:
构造一种应用程序交互控制方法，该方法包括：Construct an application interaction control method, the method includes:
在移动终端边框的触控区获取与应用程序的交互控制接口对应的触控手势；Obtain a touch gesture corresponding to the interactive control interface of the application program in the touch area of the frame of the mobile terminal;
通过交互控制接口响应触控手势，并执行与触控手势对应的交互控制命令。The touch gesture is responded to through the interactive control interface, and the interactive control command corresponding to the touch gesture is executed.
优选地，在移动终端边框的触控区获取与应用程序的交互控制接口对应的触控手势之前包括：Preferably, before the touch area of the frame of the mobile terminal acquires the touch gesture corresponding to the interactive control interface of the application program, it includes:
在屏显范围内识别当前运行的应用程序；Identify currently running applications within the scope of the screen display;
获取应用程序的运行界面，并根据运行界面获取第一交互控制接口；Obtain the running interface of the application program, and obtain the first interactive control interface according to the running interface;
获取应用程序的运行环境，并根据运行环境获取第二交互控制接口。The running environment of the application program is obtained, and the second interactive control interface is obtained according to the running environment.
优选地，在移动终端边框的触控区获取与应用程序的交互控制接口对应的触控手势包括：Preferably, obtaining the touch gesture corresponding to the interactive control interface of the application program in the touch area of the mobile terminal frame includes:
将触控区划分为第一层级触控区和第二层级触控区；Divide the touch area into a first-level touch area and a second-level touch area;
关联第一层级触控区和第一交互控制接口，同时，关联第二层级触控区和第二交互控制接口；Associating the first-level touch area with the first interactive control interface, and at the same time, associating the second-level touch area with the second interactive control interface;
根据第一层级触控区设置应用程序级别的第一触控手势，同时，根据第二层级触控区设置操作系统级别的第二触控手势。The first touch gesture at the application level is set according to the touch area of the first level, and the second touch gesture at the operating system level is set according to the touch area of the second level.
优选地，通过交互控制接口响应触控手势，并执行与触控手势对应的交互控制命令还包括：Preferably, responding to the touch gesture through the interactive control interface, and executing the interactive control command corresponding to the touch gesture also includes:
根据第一层级触控区设置第一优先级，同时，根据第二层级触控区设置第二优先级；Setting the first priority according to the touch area of the first level, and setting the second priority according to the touch area of the second level;
在预设时间内通过触控区内获取触控手势；Obtain touch gestures through the touch area within a preset time;
将触控手势按第一触控手势和第二触控手势进行划分；dividing touch gestures into first touch gestures and second touch gestures;
按第一优先级响应第一层级触控区的第一触控手势，同时，按第二优先级响应第二层级触控区的第二触控手势。Responding to the first touch gesture of the first-level touch area according to the first priority, and responding to the second touch gesture of the second-level touch area according to the second priority.
优选地，通过交互控制接口响应触控手势，并执行与触控手势对应的交互控制命令还包括：Preferably, responding to the touch gesture through the interactive control interface, and executing the interactive control command corresponding to the touch gesture also includes:
根据第一优先级和第二优先级设置第三优先级；Set the third priority according to the first priority and the second priority;
按第三优先级响应第一层级触控区的第一触控手势，同时，按第三优先级响应第二层级触控区的第二触控手势。Responding to the first touch gesture of the first-level touch area according to the third priority, and responding to the second touch gesture of the second-level touch area according to the third priority.
本发明还提出了一种应用程序交互控制装置，该装置包括：The present invention also proposes an application program interaction control device, which includes:
感测模块，用于在移动终端边框的触控区获取与应用程序的交互控制接口对应的触控手势；The sensing module is used to obtain the touch gesture corresponding to the interactive control interface of the application program in the touch area of the frame of the mobile terminal;
控制模块，用于通过交互控制接口响应触控手势，执行与触控手势对应的交互控制命令。The control module is configured to respond to touch gestures through the interactive control interface, and execute interactive control commands corresponding to the touch gestures.
优选地，本装置还包括初始化模块，初始化模块包括应用程序识别单元、第一交互控制接口获取单元以及第二交互控制接口获取单元，其中，Preferably, the device further includes an initialization module, and the initialization module includes an application identification unit, a first interactive control interface acquisition unit, and a second interactive control interface acquisition unit, wherein,
应用程序识别单元用于在屏显范围内识别当前运行的应用程序；The application identification unit is used to identify the currently running application within the scope of the screen display;
第一交互控制接口获取单元用于获取应用程序的运行界面，并根据运行界面获取第一交互控制接口；The first interactive control interface obtaining unit is used to obtain the running interface of the application program, and obtain the first interactive control interface according to the running interface;
第二交互控制接口获取单元用于获取应用程序的运行环境，并根据运行环境获取第二交互控制接口。The second interactive control interface acquiring unit is configured to acquire the running environment of the application program, and acquire the second interactive control interface according to the running environment.
优选地，设置模块包括触控区划分单元、触控区关联单元以及触控手势设置单元，其中，Preferably, the setting module includes a touch area division unit, a touch area association unit, and a touch gesture setting unit, wherein,
触控区划分单元用于将触控区划分为第一层级触控区和第二层级触控区；The touch area division unit is used to divide the touch area into a first-level touch area and a second-level touch area;
触控区关联单元用于关联第一层级触控区和第一交互控制接口，同时，关联第二层级触控区和第二交互控制接口；The touch area association unit is used for associating the touch area of the first level with the first interactive control interface, and at the same time associating the touch area of the second level with the second interactive control interface;
触控手势设置单元用于根据第一层级触控区设置应用程序级别的第一触控手势，同时，根据第二层级触控区设置操作系统级别的第二触控手势。The touch gesture setting unit is used to set the first touch gesture at the application program level according to the touch area of the first level, and set the second touch gesture at the operating system level according to the touch area of the second level.
优选地，设置模块还包括优先级设置单元、触控手势获取单元、触控手势划分单元以及触控手势响应单元，其中，Preferably, the setting module further includes a priority setting unit, a touch gesture acquisition unit, a touch gesture division unit and a touch gesture response unit, wherein,
优先级设置单元用于根据第一层级触控区设置第一优先级，同时，根据第二层级触控区设置第二优先级；The priority setting unit is used to set the first priority according to the touch area of the first level, and set the second priority according to the touch area of the second level;
触控手势获取单元用于在预设时间内通过触控区内获取触控手势；The touch gesture acquisition unit is used to acquire touch gestures in the touch area within a preset time;
触控手势划分单元用于将触控手势按第一触控手势和第二触控手势进行划分；The touch gesture dividing unit is used to divide the touch gesture into the first touch gesture and the second touch gesture;
触控手势响应单元用于按第一优先级响应第一层级触控区的第一触控手势，同时，按第二优先级响应第二层级触控区的第二触控手势；The touch gesture response unit is configured to respond to the first touch gesture of the first-level touch area according to the first priority, and at the same time, respond to the second touch gesture of the second-level touch area according to the second priority;
优先级设置单元还用于根据第一优先级和第二优先级设置第三优先级；The priority setting unit is also used to set a third priority according to the first priority and the second priority;
触控手势响应单元还用于按第三优先级响应第一层级触控区的第一触控手势，同时，按第三优先级响应第二层级触控区的第二触控手势。The touch gesture response unit is further configured to respond to the first touch gesture of the first-level touch area according to the third priority, and at the same time, respond to the second touch gesture of the second-level touch area according to the third priority.
本发明还提出了一种应用程序交互控制终端，该终端包括上述应用程序交互控制装置。The present invention also proposes an application program interaction control terminal, which includes the above application program interaction control device.
实施本发明，通过提取与交互控制接口对应的应用程序的控制命令，实现了以不同的交互控制接口根据相应的按键或者组合的按键等情形，发送相应的应用程序的控制命令。同时，通过划分应用程序的控制命令的类别、划分触控区一级划分优先级等处理操作，使得应用程序的交互控制更符合用户的使用习惯，增强了用户体验。By implementing the present invention, by extracting the control command of the application program corresponding to the interactive control interface, it is realized that the control command of the corresponding application program can be sent according to the corresponding button or combined button with different interactive control interfaces. At the same time, through processing operations such as classifying the control commands of the application program, dividing the touch area and classifying the priority, the interactive control of the application program is more in line with the user's usage habits, and the user experience is enhanced.
附图说明Description of drawings
下面将结合附图及实施例对本发明作进一步说明，附图中：The present invention will be further described below in conjunction with accompanying drawing and embodiment, in the accompanying drawing:
图1是本发明提出的应用程序交互方法的流程图；Fig. 1 is a flow chart of the application program interaction method proposed by the present invention;
图2是本发明第二较佳实施例提出的应用程序交互方法的流程图；Fig. 2 is a flow chart of the application program interaction method proposed by the second preferred embodiment of the present invention;
图3是本发明第三较佳实施例提出的应用程序交互方法的流程图；Fig. 3 is a flow chart of the application program interaction method proposed by the third preferred embodiment of the present invention;
图4是本发明第四较佳实施例提出的应用程序交互方法的流程图；FIG. 4 is a flow chart of an application program interaction method proposed in a fourth preferred embodiment of the present invention;
图5是本发明第五较佳实施例提出的应用程序交互方法的流程图；Fig. 5 is a flowchart of an application program interaction method proposed by a fifth preferred embodiment of the present invention;
图6是本发明提出的应用程序交互装置的结构框图。Fig. 6 is a structural block diagram of the application program interaction device proposed by the present invention.
具体实施方式detailed description
为了使本发明所要解决的技术问题、技术方案及有益效果更加清楚、明白，以下结合附图和实施例，对本发明进行进一步详细说明。应当理解，此处所描述的具体实施例仅仅用以解释本发明，并不用于限定本发明。In order to make the technical problems, technical solutions and beneficial effects to be solved by the present invention clearer and clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.
实施例一Embodiment one
图1是本发明提出的应用程序交互方法的流程图。该方法包括：Fig. 1 is a flow chart of the application interaction method proposed by the present invention. The method includes:
S1，在移动终端边框的触控区获取与应用程序的交互控制接口对应的触控手势。S1. Obtain a touch gesture corresponding to an interactive control interface of an application program in a touch area of a frame of a mobile terminal.
通常而言，移动终端的应用程序的交互界面设置有一个或者多个虚拟交互按键，比如应用程序内的上翻键、下翻键、添加键以及删除键等。本实施例以手机为例，该手机的上翻键N1、下翻键N2设置在屏幕内靠上边框的位置，添加键N3设置在屏幕内靠右边框的位置，删除键N4则设置在屏幕内靠左边框的位置。Generally speaking, the interactive interface of the application program of the mobile terminal is provided with one or more virtual interaction keys, such as an up key, a down key, an add key, and a delete key in the application program. The present embodiment takes a mobile phone as an example. The up-turning key N1 and the down-turning key N2 of the mobile phone are set on the upper frame of the screen, the add key N3 is set on the right frame of the screen, and the delete key N4 is set on the screen. The position inside the left border.
首先，获取该手机上翻键N1、下翻键N2、添加键N3以及删除键N4的交互控制接口。可以理解，该交互控制接口是指基于手机操作系统的应用程序留给该应用程序实用功能的一个调用接口，通过调用基于操作系统的应用程序的交互控制接口而使应用程序去执行该控制命令，以完成相应的功能。Firstly, the interactive control interfaces of the up scroll key N1, down scroll key N2, add key N3 and delete key N4 of the mobile phone are acquired. It can be understood that the interactive control interface refers to a call interface that the application program based on the mobile phone operating system leaves for the utility function of the application program. By calling the interactive control interface of the application program based on the operating system, the application program executes the control command. to complete the corresponding functions.
因此，本步骤首先是获取该手机的应用程序的上翻键N1的交互控制接口、下翻键N2的交互控制接口、添加键N3的交互控制接口以及删除键N4的交互控制接口。Therefore, this step firstly obtains the interactive control interface of the up button N1, the interactive control interface of the down button N2, the interactive control interface of the add button N3 and the interactive control interface of the delete button N4 of the application program of the mobile phone.
进一步地，该手机的应用程序(例如应用程序M)的交互界面内，通过两个或两个以上的虚拟交互按键同时按下以实现相应的功能，例如采用下翻键N2与删除键N4同时按下时触发的是截屏功能。因此，同时获取下翻键N2的交互控制接口与删除键N4的交互控制接口，再根据两者接口的控制命令合成截屏所调用的交互控制接口。Further, in the interactive interface of the application program (such as application program M) of the mobile phone, two or more virtual interaction keys are pressed simultaneously to realize corresponding functions, for example, the down key N2 and the delete key N4 are used simultaneously When pressed, the screenshot function is triggered. Therefore, the interactive control interface of the scroll down key N2 and the interactive control interface of the delete key N4 are acquired at the same time, and then the interactive control interface called by the screenshot is synthesized according to the control commands of the two interfaces.
进一步地，该手机的应用程序M的交互界面内，通过按一定次序按下以实现相应的功能，例如采用下翻键N2与删除键N4分别在一秒内先后按下时触发的是截屏功能。因此，则首先获取下翻键N2的交互控制接口，然后在一秒的时间内检测是否获取到删除键N4的交互控制接口，若是，则根据两者接口的控制命令合成截屏所调用的交互控制接口。Further, in the interactive interface of the application program M of the mobile phone, the corresponding functions are realized by pressing in a certain order, for example, when the down key N2 and the delete key N4 are pressed successively within one second, the screenshot function is triggered . Therefore, first obtain the interactive control interface of the down key N2, and then detect within one second whether the interactive control interface of the delete key N4 is obtained, and if so, synthesize the interactive control called by the screenshot according to the control commands of the two interfaces interface.
进一步地，该手机的应用程序M的交互界面内，通过滑动特定的交互控制虚拟手势，发送特定的应用程序控制命令，同时，不同的交互控制接口还可以根据组合的情形来发送相应的应用程序控制命令。Further, in the interactive interface of the application program M of the mobile phone, a specific application program control command is sent by sliding a specific interactive control virtual gesture, and at the same time, different interactive control interfaces can also send corresponding application programs according to the combined situation control commands.
进一步地，不同的交互控制接口还可以根据组合的时间，例如同一时刻的组合情形和按次序的先后组合情形等因素发送相应的应用程序的控制命令。Furthermore, different interactive control interfaces can also send corresponding application program control commands according to combination time, such as combination situation at the same time and sequential combination situation and other factors.
因此，本实施例是在获取终端的物理按键所对应的功能接口之前，提取与交互控制接口对应的应用程序控制命令，并划分应用程序的控制命令的类别，该类别可以按照控制对象划分、或者按照交互控制接口的组合次序划分等等，可以理解，通过划分应用程序的控制命令的类别，并将同一类别的应用程序的控制命令所对应的触控区域按邻近方位设置，使得触控操作更符合用户的使用习惯，增强用户体验。Therefore, in this embodiment, before obtaining the functional interface corresponding to the physical key of the terminal, the application program control command corresponding to the interactive control interface is extracted, and the category of the control command of the application program is divided. The category can be divided according to the control object, or According to the combination order of the interactive control interface, etc., it can be understood that by dividing the types of control commands of the application program and setting the touch areas corresponding to the control commands of the same type of application program in adjacent directions, the touch operation can be made more convenient. Conform to the user's usage habits and enhance the user experience.
当完成对交互控制接口的获取操作后，然后再根据应用程序的交互控制接口设置相应的触控区和触控手势。具体的设置方式如下所述：After the acquisition operation of the interactive control interface is completed, the corresponding touch area and touch gesture are set according to the interactive control interface of the application program. The specific setting method is as follows:
首先，在预设时间段内记录应用程序的虚拟按键的触发数据。其中，触发数据包括触发场景以及触发频率。First, the trigger data of the virtual keys of the application is recorded within a preset period of time. Wherein, the trigger data includes a trigger scene and a trigger frequency.
由于不同的应用程序的虚拟按键所被使用的场景和频率是不同的，同时，多个应用程序的虚拟按键被使用的次序和频率也是不同的。因此，本步骤是在一段时间内，统计应用程序的虚拟按键的触发数据，获取单个应用程序的虚拟按键的触发场景以及触发频率，以及获取多个应用程序的虚拟按键被连同使用的场景、次序和频率。可以理解，本实施例所提及的触发场景是指基于当前操作系统的应用程序界面的场景，例如，当前操作系统的显示界面以及应用程序的交互操作界面等等。Since the virtual keys of different application programs are used in different scenarios and frequencies, at the same time, the virtual keys of multiple application programs are used in different orders and frequencies. Therefore, this step is to count the trigger data of the virtual keys of the application within a period of time, obtain the triggering scene and trigger frequency of the virtual keys of a single application, and obtain the scenes and order in which the virtual keys of multiple applications are used together and frequency. It can be understood that the triggering scenario mentioned in this embodiment refers to a scenario based on the application program interface of the current operating system, for example, the display interface of the current operating system and the interactive operation interface of the application program, and the like.
然后，通过分析触发数据以及终端的边框结构划分触控区域。Then, the touch area is divided by analyzing the trigger data and the frame structure of the terminal.
一方面，获取并分析各应用程序的虚拟按键的触发场景以及触发频率，另一方面，获取并分析该应用程序的虚拟按键在组合使用时的触发场景以及触发频率。整理上述分析的数据，例如，按应用程序的虚拟按键的使用频率排序或者按应用程序的虚拟按键的使用先后次序的相关性的高低排序。On the one hand, the triggering scene and triggering frequency of the virtual keys of each application are acquired and analyzed; on the other hand, the triggering scene and triggering frequency of the virtual keys of the application in combination are acquired and analyzed. The above-mentioned analyzed data is sorted, for example, sorted by the frequency of use of the virtual keys of the application program or by the high or low correlation of the order of use of the virtual keys of the application program.
然后，分析该手机的边框结构，根据用户选择或者根据使用场景和使用频率划分该手机的边框。划分的方式可以按照使用的频率越高，划分的边框的触控区域越大，或者使得划分的边框的触控区域更接近用户手指最容易按到的区域范围、Then, the frame structure of the mobile phone is analyzed, and the frame of the mobile phone is divided according to the user's selection or according to the usage scenario and frequency of use. The division method can be based on the higher the frequency of use, the larger the touch area of the divided frame, or make the touch area of the divided frame closer to the area where the user's finger is most likely to press,
可以理解，本发明所指的终端的边框可以是屏幕内靠近屏幕边缘的触控面板区域，或者是屏幕外靠近屏幕边缘的终端框架结构的区域，可以理解，当采用后者方案是，需要在该区域内设置相应的触感感应器。It can be understood that the frame of the terminal referred to in the present invention can be the touch panel area within the screen close to the edge of the screen, or the area of the terminal frame structure outside the screen close to the edge of the screen. It can be understood that when the latter solution is adopted, it is necessary to Corresponding touch sensors are arranged in this area.
再次，建立触控手势数据库。通过该触控手势数据库录取触控手势，并将录取的触控手势按手势类型进行划分。Again, build a touch gesture database. The touch gesture database is used to record touch gestures, and the recorded touch gestures are classified according to gesture types.
在手势数据库内，根据触控区域的物理范围选取与物理范围相应的触控手势。分析上述经划分后的触控区域的物理范围，若该物理范围较小，则选择长按或者双击的触控手势，若该物理范围较大，则可以选择拖拽或者滑动的触控手势。In the gesture database, a touch gesture corresponding to the physical range is selected according to the physical range of the touch area. Analyze the physical range of the above-mentioned divided touch area, if the physical range is small, select the touch gesture of long press or double tap, and if the physical range is large, select the touch gesture of dragging or sliding.
最后，关联触控区域与选取的触控手势。建立触控区域与选取的触控手势的关联关系，即使得同一触控手势在不同的触控区域指代的是不同的终端控制命令。Finally, associate the touch area with the selected touch gesture. An association relationship between the touch area and the selected touch gesture is established, that is, the same touch gesture refers to different terminal control commands in different touch areas.
S2，通过交互控制接口响应所述触控手势，并执行与触控手势对应的交互控制命令。S2. Respond to the touch gesture through an interactive control interface, and execute an interactive control command corresponding to the touch gesture.
根据触控手势响应与交互控制接口对应的应用程序的控制命令。如上例所述，首先，将手机上翻键N1、下翻键N2、添加键N3以及删除键N4四个交互控制接口与相应的触控手势关联，然后，根据触控手势的触控区域以及触控手势的类型响应相应的应用程序控制命令。Respond to the control command of the application program corresponding to the interactive control interface according to the touch gesture. As described in the above example, firstly, associate the four interactive control interfaces of the mobile phone up button N1, down button N2, add button N3 and delete button N4 with the corresponding touch gestures, and then, according to the touch area of the touch gesture and Types of touch gestures respond to corresponding application control commands.
本实施例的有益效果在于，通过提取与交互控制接口对应的应用程序的控制命令，使得不同的交互控制接口可以根据相应的按键或者组合的按键等情形，发送相应的应用程序的控制命令。同时，通过划分应用程序的控制命令的类别，使得触控操作更符合用户的使用习惯，增强了用户体验。The beneficial effect of this embodiment is that, by extracting the control command of the application program corresponding to the interactive control interface, different interactive control interfaces can send the control command of the corresponding application program according to the corresponding key or combined key. At the same time, by dividing the categories of the control commands of the application program, the touch operation is more in line with the usage habits of the user, and the user experience is enhanced.
实施例二Embodiment two
图2是本发明第二较佳实施例提出的应用程序交互方法的流程图。Fig. 2 is a flow chart of the application interaction method proposed by the second preferred embodiment of the present invention.
基于上述实施例，根据应用程序的交互控制接口设置相应的触控区和触控手势之前包括：Based on the above-mentioned embodiment, before setting the corresponding touch area and touch gesture according to the interactive control interface of the application program, it includes:
S01，在屏显范围内识别当前运行的应用程序。一种方式是，在移动终端的操作系统进程管理器中检测运行进程的详细信息，并根据该进程获取当前运行的应用程序；另一种方式是通过图像识别技术识别当前屏幕的交互界面，通过该交互界面判断识别与之对应的应用程序。S01, identifying a currently running application within the screen display range. One way is to detect the detailed information of the running process in the operating system process manager of the mobile terminal, and obtain the currently running application program according to the process; the other way is to identify the interactive interface of the current screen through image recognition technology, through The interactive interface determines and identifies the corresponding application program.
S02，获取应用程序的运行界面，并根据运行界面获取第一交互控制接口。本步骤的运行界面是指应用程序在当前交互界面下，显示于触控屏内的属于该应用程序功能范围内的界面。因此，该运行界面排出了操作系统的交互界面。例如，应用程序M的添加键N3以及删除键N4所对应的交互控制接口即为第一交互控制接口。S02. Obtain the running interface of the application program, and obtain the first interactive control interface according to the running interface. The running interface in this step refers to an interface within the functional scope of the application program displayed on the touch screen under the current interactive interface. Therefore, the operating interface excludes the interactive interface of the operating system. For example, the interactive control interface corresponding to the add key N3 and the delete key N4 of the application program M is the first interactive control interface.
S03，获取应用程序的运行环境，并根据运行环境获取第二交互控制接口。本步骤的运行环境是指移动终端的操作系统在当前时刻的交互界面。例如，当应用程序M在运行时，此时操作系统的主屏幕键N5、返回键N6以及多任务切换键N7所对应的交互控制接口即为第二交互控制接口。S03. Obtain the running environment of the application program, and obtain the second interactive control interface according to the running environment. The operating environment in this step refers to the interactive interface of the operating system of the mobile terminal at the current moment. For example, when the application program M is running, the interactive control interface corresponding to the home screen key N5 , the back key N6 and the multitasking switching key N7 of the operating system at this time is the second interactive control interface.
本实施例的有益效果在于，通过获取应用程序的运行界面，并根据运行界面获取第一交互控制接口，获取应用程序的运行环境，并根据运行环境获取第二交互控制接口，使得在对应用程序交互控制时，更能明确区分应用程序内的控制命令和操作系统级别的控制命令，控制逻辑更为清晰、高效。The beneficial effect of this embodiment is that by obtaining the running interface of the application program, and obtaining the first interactive control interface according to the running interface, obtaining the running environment of the application program, and obtaining the second interactive control interface according to the running environment, so that when the application program During interactive control, the control commands in the application program and the control commands at the operating system level can be clearly distinguished, and the control logic is clearer and more efficient.
实施例三Embodiment three
图3是本发明第三较佳实施例提出的应用程序交互方法的流程图。Fig. 3 is a flow chart of the application program interaction method proposed by the third preferred embodiment of the present invention.
基于上述实施例，根据应用程序的交互控制接口设置相应的触控区和触控手势包括：Based on the above-mentioned embodiments, setting the corresponding touch area and touch gesture according to the interactive control interface of the application program includes:
S11，将触控区划分为第一层级触控区和第二层级触控区。在上述实施例一对触控区的划分方法的基础上，本实施例对划分后的触控区再次按照第一层级触控区和第二层级触控区进行划分。S11 , dividing the touch area into a first-level touch area and a second-level touch area. On the basis of the method for dividing a pair of touch areas in the above embodiments, this embodiment divides the divided touch areas again according to the first-level touch area and the second-level touch area.
S12，关联第一层级触控区和第一交互控制接口，同时，关联第二层级触控区和第二交互控制接口。可以理解，针对于应用程序，在第一层级触控区获取触控手势，根据该触控手势触发第一交互控制接口，同理可知，针对于操作系统，在第二层级触控区获取触控手势，根据该触控手势触发第二交互控制接口。S12, associating the first-level touch area with the first interactive control interface, and at the same time, associating the second-level touch area with the second interactive control interface. It can be understood that for the application program, the touch gesture is acquired in the first-level touch area, and the first interactive control interface is triggered according to the touch gesture. Similarly, for the operating system, the touch gesture is acquired in the second-level touch area. control gesture, and trigger the second interactive control interface according to the touch gesture.
S13，根据第一层级触控区设置应用程序级别的第一触控手势，同时，根据第二层级触控区设置操作系统级别的第二触控手势。可以理解，由于划分了第一层级触控区和第二层级触控区，因此，第一触控手势与第二触控手势可以是相同或者不同的，从而使得同一触控手势适用的范围更为广泛，当运行于操作系统的应用程序较多，交互操作界面较为复杂时，保证了使用较少的触控手势，在较多的应用程序以及相应应用程序的交互界面内实现交互控制。S13. Set the first touch gesture at the application program level according to the touch area of the first level, and set the second touch gesture at the operating system level according to the touch area of the second level. It can be understood that since the first-level touch area and the second-level touch area are divided, the first touch gesture and the second touch gesture can be the same or different, so that the applicable range of the same touch gesture is wider. To be more extensive, when there are many applications running on the operating system and the interactive operation interface is relatively complex, it is ensured that fewer touch gestures are used to realize interactive control in more application programs and the corresponding application interface.
本实施例的有益效果在于，通过将触控区划分为第一层级触控区和第二层级触控区，实现了以单一的触控手势调用多个应用程序的交互控制接口，提高了触控手势的利用率，同时，应用程序与操作系统两层级的划分，逻辑清晰，便于用户学习使用，降低了触控手势的学习难度。The beneficial effect of this embodiment is that, by dividing the touch area into a first-level touch area and a second-level touch area, the interactive control interface for invoking multiple application programs with a single touch gesture is realized, and the touch control area is improved. At the same time, the two-level division of application programs and operating systems has a clear logic, which is convenient for users to learn and use, and reduces the difficulty of learning touch gestures.
实施例四Embodiment four
图4是本发明第四较佳实施例提出的应用程序交互方法的流程图。Fig. 4 is a flowchart of an application program interaction method proposed by a fourth preferred embodiment of the present invention.
基于上述实施例，通过交互控制接口响应触控手势，并执行与触控手势对应的交互控制命令还包括：Based on the above embodiments, responding to the touch gesture through the interactive control interface, and executing the interactive control command corresponding to the touch gesture further includes:
S21，根据第一层级触控区设置第一优先级，同时，根据第二层级触控区设置第二优先级。S21. Set a first priority according to the touch area of the first level, and set a second priority according to the touch area of the second level.
例如，在播放器应用程序P内，有快进触控手势P1、快退触控手势P2、暂停播放手势P3以及音量调节手势P4；在拍照应用程序Q内，有拉近焦距的触控手势Q1、拉远焦距的触控手势Q2以及调整延时快门时间的触控手势Q3；在该移动终端的操作系统内，有主屏幕触控手势R1、返回触控手势R2以及多任务切换触控手势R3。For example, in the player application P, there are fast forward touch gestures P1, rewind touch gestures P2, pause playback gesture P3, and volume adjustment gesture P4; in the camera application Q, there are touch gestures for zooming in Q1, the touch gesture Q2 for zooming out and the touch gesture Q3 for adjusting the delayed shutter time; in the operating system of the mobile terminal, there are home screen touch gesture R1, return touch gesture R2 and multitasking switch touch Gesture R3.
其中，快进触控手势P1与拉近焦距的触控手势Q1相同；快退触控手势P2与拉远焦距的触控手势Q2相同；音量调节手势P4与调整延时快门时间的触控手势Q3相同。Among them, the fast-forward touch gesture P1 is the same as the touch gesture Q1 for zooming in; the fast-reverse touch gesture P2 is the same as the touch gesture Q2 for zooming out; the volume adjustment gesture P4 is the same as the touch gesture for adjusting the delayed shutter time Same for Q3.
设置第一优先级，其中，P1优先于Q1，P2优先于Q2，P4优先于Q3，那么，当播放器应用程序P与拍照应用程序Q同时分屏运行时，若检测到快进触控手势P1或拉近焦距的触控手势Q1，则优先响应快进操作；若检测到快退触控手势P2与拉远焦距的触控手势Q2，则优先响应快退操作；若检测到音量调节手势P4与调整延时快门时间的触控手势Q3，则优先响应音量调节。Set the first priority, among them, P1 has priority over Q1, P2 has priority over Q2, and P4 has priority over Q3. Then, when the player application P and the camera application Q are running in split screen at the same time, if the fast forward touch gesture is detected P1 or the touch gesture Q1 for zooming in will give priority to the fast-forward operation; if the touch gesture P2 for rewinding and the touch gesture Q2 for zooming out are detected, the fast-rewind operation will be responded first; if the volume adjustment gesture is detected P4 and touch gesture Q3 to adjust the delayed shutter time give priority to volume adjustment.
可以理解，再按上述方法设置主屏幕触控手势R1、返回触控手势R2以及多任务切换触控手势R3的第二优先级。It can be understood that the second priority of the home screen touch gesture R1 , the return touch gesture R2 and the multitasking switch touch gesture R3 is set according to the above method.
S22，在预设时间内通过触控区内获取触控手势。S22. Acquiring a touch gesture in the touch area within a preset time.
S23，将触控手势按第一触控手势和第二触控手势进行划分。S23. Divide the touch gestures into first touch gestures and second touch gestures.
S24，按第一优先级响应第一层级触控区的第一触控手势，同时，按第二优先级响应第二层级触控区的第二触控手势。S24. Respond to the first touch gesture of the first-level touch area according to the first priority, and at the same time, respond to the second touch gesture of the second-level touch area according to the second priority.
本实施例的有益效果在于，通过在第一层级触控区设置第一优先级，同时，在第二层级触控区设置第二优先级，并根据相应的触控区以及相应的优先级响应相应的触控手势，从而使得触控手势的控制命令更加多样化，避免了在多程序并行运行时，容易造成触控手势对应的控制命令相冲突的缺陷。The beneficial effect of this embodiment is that by setting the first priority in the touch area of the first level, and setting the second priority in the touch area of the second level at the same time, and responding according to the corresponding touch area and the corresponding priority The corresponding touch gestures make the control commands of the touch gestures more diversified, and avoid the defect that the control commands corresponding to the touch gestures tend to conflict when multiple programs run in parallel.
实施例五Embodiment five
图5是本发明第五较佳实施例提出的应用程序交互方法的流程图。Fig. 5 is a flowchart of an application program interaction method proposed by a fifth preferred embodiment of the present invention.
基于上述实施例，通过交互控制接口响应触控手势，并执行与触控手势对应的交互控制命令还包括：Based on the above embodiments, responding to the touch gesture through the interactive control interface, and executing the interactive control command corresponding to the touch gesture further includes:
S25，根据第一优先级和第二优先级设置第三优先级。S25. Set a third priority according to the first priority and the second priority.
S26，按第三优先级响应第一层级触控区的第一触控手势，同时，按第三优先级响应第二层级触控区的第二触控手势。S26. Respond to the first touch gesture of the first-level touch area according to the third priority, and at the same time, respond to the second touch gesture of the second-level touch area according to the third priority.
可以理解，当用户在使用播放器应用程序P观看视频的同时，还在使用拍照应用程序Q录制视频，当需要根据返回触控手势R2返回时，若该返回触控手势R2与应用程序P或者应用程序Q内的某一触控手势相同，则会引起控制命令的冲突。本实施例提出的解决方案是，根据第一优先级和第二优先级设置第三优先级，首先，判断第一优先级和第二优先级，在判断的结果范围内再根据设置的第三优先级进行触控手势的判断。It can be understood that when the user is using the player application P to watch the video, he is also using the camera application Q to record the video. A certain touch gesture in the application program Q is the same, which will cause a conflict of control commands. The solution proposed in this embodiment is to set the third priority according to the first priority and the second priority. First, judge the first priority and the second priority, and then according to the set third priority The priority is used to judge touch gestures.
可以理解，在同一移动终端内，由于运行有不同的应用程序，第一优先级至少有一种，因此，可以根据不同的第一优先级(一个或者多个)与第二优先级共同设置上述的第三优先级。It can be understood that in the same mobile terminal, since there are different application programs running, there is at least one first priority. Therefore, the above-mentioned first priority (one or more) can be set together with the second priority third priority.
本实施例的有益效果在于，通过第一优先级和第二优先级设置第三优先级，并按第三优先级响应第一层级触控区的第一触控手势，同时，按第三优先级响应第二层级触控区的第二触控手势。实现了在多应用程序、多交互界面的环境下，按预先设置的优先级，准确响应用户所需的控制命令。The beneficial effect of this embodiment is that the third priority is set through the first priority and the second priority, and the first touch gesture of the first-level touch area is responded to according to the third priority, and at the same time, the third priority The level responds to the second touch gesture in the touch area of the second level. In the environment of multiple application programs and multiple interactive interfaces, according to the preset priority, it can accurately respond to the control commands required by the user.
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分步骤是可以通过程序来控制相关的硬件完成，所述的程序可以在存储于一计算机可读取存储介质中，所述的存储介质，如ROM/RAM、磁盘、光盘等。Those of ordinary skill in the art can understand that all or part of the steps in the methods of the above embodiments can be implemented by controlling related hardware through a program, and the program can be stored in a computer-readable storage medium, and the storage Media such as ROM/RAM, magnetic disk, optical disk, etc.
实施例六Embodiment six
图6是本发明提出的应用程序交互装置的结构框图。Fig. 6 is a structural block diagram of the application program interaction device proposed by the present invention.
本发明还提出了一种应用程序交互控制装置，该装置包括：The present invention also proposes an application program interaction control device, which includes:
设置模块10，用于根据应用程序的交互控制接口设置相应的触控区和触控手势；The setting module 10 is used to set the corresponding touch area and touch gesture according to the interactive control interface of the application program;
控制模块20，用于通过交互控制接口响应触控手势，执行与触控手势对应的交互控制命令。The control module 20 is configured to respond to the touch gesture through the interactive control interface, and execute an interactive control command corresponding to the touch gesture.
优选地，本装置还包括初始化模块30，初始化模块30包括应用程序识别单元31、第一交互控制接口获取单元32以及第二交互控制接口获取单元33，其中，Preferably, the device further includes an initialization module 30, and the initialization module 30 includes an application identification unit 31, a first interactive control interface acquisition unit 32, and a second interactive control interface acquisition unit 33, wherein,
应用程序识别单元31用于在屏显范围内识别当前运行的应用程序；The application identification unit 31 is used to identify the currently running application within the scope of the screen display;
第一交互控制接口获取单元32用于获取应用程序的运行界面，并根据运行界面获取第一交互控制接口；The first interactive control interface obtaining unit 32 is used to obtain the running interface of the application program, and obtain the first interactive control interface according to the running interface;
第二交互控制接口获取单元33用于获取应用程序的运行环境，并根据运行环境获取第二交互控制接口。The second interactive control interface obtaining unit 33 is configured to obtain the running environment of the application program, and obtain the second interactive control interface according to the running environment.
优选地，设置模块10包括触控区划分单元11、触控区关联单元12以及触控手势设置单元13，其中，Preferably, the setting module 10 includes a touch area division unit 11, a touch area association unit 12, and a touch gesture setting unit 13, wherein,
触控区划分单元11用于将触控区划分为第一层级触控区和第二层级触控区；The touch area division unit 11 is used to divide the touch area into a first-level touch area and a second-level touch area;
触控区关联单元12用于关联第一层级触控区和第一交互控制接口，同时，关联第二层级触控区和第二交互控制接口；The touch area association unit 12 is used for associating the touch area of the first level with the first interactive control interface, and at the same time associating the touch area of the second level with the second interactive control interface;
触控手势设置单元13用于根据第一层级触控区设置应用程序级别的第一触控手势，同时，根据第二层级触控区设置操作系统级别的第二触控手势。The touch gesture setting unit 13 is configured to set the first touch gesture at the application program level according to the touch area of the first level, and set the second touch gesture at the operating system level according to the touch area of the second level.
优选地，设置模块10还包括优先级设置单元14、触控手势获取单元15、触控手势划分单元16以及触控手势响应单元17，其中，Preferably, the setting module 10 further includes a priority setting unit 14, a touch gesture acquisition unit 15, a touch gesture division unit 16, and a touch gesture response unit 17, wherein,
优先级设置单元14用于根据第一层级触控区设置第一优先级，同时，根据第二层级触控区设置第二优先级；The priority setting unit 14 is used to set the first priority according to the touch area of the first level, and set the second priority according to the touch area of the second level;
触控手势获取单元15用于在预设时间内通过触控区内获取触控手势；The touch gesture acquisition unit 15 is used to acquire touch gestures in the touch area within a preset time;
触控手势划分单元16用于将触控手势按第一触控手势和第二触控手势进行划分；The touch gesture dividing unit 16 is used to divide the touch gesture into a first touch gesture and a second touch gesture;
触控手势响应单元17用于按第一优先级响应第一层级触控区的第一触控手势，同时，按第二优先级响应第二层级触控区的第二触控手势；The touch gesture response unit 17 is configured to respond to the first touch gesture of the first-level touch area according to the first priority, and at the same time, respond to the second touch gesture of the second-level touch area according to the second priority;
优先级设置单元14还用于根据第一优先级和第二优先级设置第三优先级；The priority setting unit 14 is also used for setting a third priority according to the first priority and the second priority;
触控手势响应单元17还用于按第三优先级响应第一层级触控区的第一触控手势，同时，按第三优先级响应第二层级触控区的第二触控手势。The touch gesture response unit 17 is further configured to respond to the first touch gesture of the touch area of the first level according to the third priority, and respond to the second touch gesture of the touch area of the second level according to the third priority.
需要说明的是，上述方法实施例中的技术特征在本装置均对应适用，这里不再重述。It should be noted that the technical features in the foregoing method embodiments are correspondingly applicable to this device, and will not be repeated here.
本发明还提出了一种应用程序交互控制终端，该终端包括上述应用程序交互控制装置。The present invention also proposes an application program interaction control terminal, which includes the above application program interaction control device.
实施本发明，通过提取与交互控制接口对应的应用程序的控制命令，实现了以不同的交互控制接口根据相应的按键或者组合的按键等情形，发送相应的应用程序的控制命令。同时，通过划分应用程序的控制命令的类别、划分触控区一级划分优先级等处理操作，使得应用程序的交互控制更符合用户的使用习惯，增强了用户体验。By implementing the present invention, by extracting the control command of the application program corresponding to the interactive control interface, it is realized that the control command of the corresponding application program can be sent according to the corresponding button or combined button with different interactive control interfaces. At the same time, through processing operations such as classifying the control commands of the application program, dividing the touch area and classifying the priority, the interactive control of the application program is more in line with the user's usage habits, and the user experience is enhanced.
该应用程序交互控制装置可以用于移动电话，或者具有应用程序交互控制功能的其他通信终端，例如智能手机等中，可以是运行于这些通信终端内的软件单元，也可以作为独立的挂件集成到这些通信终端中或者运行于这些移动终端的应用系统中。The application program interaction control device can be used in mobile phones, or other communication terminals with application program interaction control functions, such as smart phones, etc., and can be a software unit running in these communication terminals, or can be integrated into the mobile phone as an independent pendant These communication terminals or the application systems running on these mobile terminals.
以上参照附图说明了本发明的优选实施例，并非因此局限本发明的权利范围。本领域技术人员不脱离本发明的范围和实质，可以有多种变型方案实现本发明，比如作为一个实施例的特征可用于另一实施例而得到又一实施例。凡在运用本发明的技术构思之内所作的任何修改、等同替换和改进，均应在本发明的权利范围之内。The preferred embodiments of the present invention have been described above with reference to the accompanying drawings, and the scope of rights of the present invention is not limited thereto. Those skilled in the art can implement the present invention with many variants without departing from the scope and spirit of the present invention, for example, a feature of one embodiment can be used in another embodiment to obtain another embodiment. All modifications, equivalent replacements and improvements made within the technical conception of the application of the present invention shall fall within the scope of rights of the present invention.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410487312.XACN104267902B (en) | 2014-09-22 | 2014-09-22 | Application program interactive control method, device and terminal |
| CN201610086712.9ACN105760102B (en) | 2014-09-22 | 2014-09-22 | Terminal interaction control method and device and application program interaction control method |
| PCT/CN2015/090288WO2016045579A1 (en) | 2014-09-22 | 2015-09-22 | Application interaction control method and apparatus, and terminal |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410487312.XACN104267902B (en) | 2014-09-22 | 2014-09-22 | Application program interactive control method, device and terminal |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610086712.9ADivisionCN105760102B (en) | 2014-09-22 | 2014-09-22 | Terminal interaction control method and device and application program interaction control method |
| Publication Number | Publication Date |
|---|---|
| CN104267902A CN104267902A (en) | 2015-01-07 |
| CN104267902Btrue CN104267902B (en) | 2017-03-08 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410487312.XAActiveCN104267902B (en) | 2014-09-22 | 2014-09-22 | Application program interactive control method, device and terminal |
| Country | Link |
|---|---|
| CN (1) | CN104267902B (en) |
| WO (1) | WO2016045579A1 (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2013169865A2 (en) | 2012-05-09 | 2013-11-14 | Yknots Industries Llc | Device, method, and graphical user interface for moving a user interface object based on an intensity of a press input |
| CN108241465B (en) | 2012-05-09 | 2021-03-09 | 苹果公司 | Method and apparatus for providing haptic feedback for operations performed in a user interface |
| EP3410287B1 (en) | 2012-05-09 | 2022-08-17 | Apple Inc. | Device, method, and graphical user interface for selecting user interface objects |
| EP2847662B1 (en) | 2012-05-09 | 2020-02-19 | Apple Inc. | Device, method, and graphical user interface for providing feedback for changing activation states of a user interface object |
| WO2013169849A2 (en) | 2012-05-09 | 2013-11-14 | Industries Llc Yknots | Device, method, and graphical user interface for displaying user interface objects corresponding to an application |
| WO2013169843A1 (en) | 2012-05-09 | 2013-11-14 | Yknots Industries Llc | Device, method, and graphical user interface for manipulating framed graphical objects |
| CN108958550B (en) | 2012-05-09 | 2021-11-12 | 苹果公司 | Device, method and graphical user interface for displaying additional information in response to user contact |
| CN105264479B (en) | 2012-12-29 | 2018-12-25 | 苹果公司 | Apparatus, method and graphical user interface for navigating a user interface hierarchy |
| WO2014105279A1 (en) | 2012-12-29 | 2014-07-03 | Yknots Industries Llc | Device, method, and graphical user interface for switching between user interfaces |
| CN104267902B (en)* | 2014-09-22 | 2017-03-08 | 努比亚技术有限公司 | Application program interactive control method, device and terminal |
| US9632664B2 (en) | 2015-03-08 | 2017-04-25 | Apple Inc. | Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback |
| US10095396B2 (en) | 2015-03-08 | 2018-10-09 | Apple Inc. | Devices, methods, and graphical user interfaces for interacting with a control object while dragging another object |
| US9639184B2 (en) | 2015-03-19 | 2017-05-02 | Apple Inc. | Touch input cursor manipulation |
| US20170045981A1 (en) | 2015-08-10 | 2017-02-16 | Apple Inc. | Devices and Methods for Processing Touch Inputs Based on Their Intensities |
| US9860451B2 (en) | 2015-06-07 | 2018-01-02 | Apple Inc. | Devices and methods for capturing and interacting with enhanced digital images |
| US9830048B2 (en) | 2015-06-07 | 2017-11-28 | Apple Inc. | Devices and methods for processing touch inputs with instructions in a web page |
| US10346030B2 (en)* | 2015-06-07 | 2019-07-09 | Apple Inc. | Devices and methods for navigating between user interfaces |
| US9880735B2 (en) | 2015-08-10 | 2018-01-30 | Apple Inc. | Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback |
| CN107025033A (en)* | 2016-02-01 | 2017-08-08 | 百度在线网络技术（北京）有限公司 | A kind of method and apparatus for adjusting screen intensity |
| CN106339173A (en)* | 2016-08-31 | 2017-01-18 | 新诺商桥科技(北京)有限公司 | Smart desktop system |
| CN107562262B (en)* | 2017-08-14 | 2020-06-19 | 维沃移动通信有限公司 | Method for responding touch operation, terminal and computer readable storage medium |
| CN107562346A (en)* | 2017-09-06 | 2018-01-09 | 广东欧珀移动通信有限公司 | Terminal control method, device, terminal and computer-readable storage medium |
| CN107729131A (en)* | 2017-09-25 | 2018-02-23 | 努比亚技术有限公司 | A kind of event-handling method, terminal and computer-readable recording medium |
| JP2020536307A (en) | 2017-09-30 | 2020-12-10 | 華為技術有限公司Ｈｕａｗｅｉ Ｔｅｃｈｎｏｌｏｇｉｅｓ Ｃｏ．，Ｌｔｄ． | Task switching method and terminal |
| CN108958071B (en)* | 2018-06-07 | 2019-05-07 | 中兴高能技术有限责任公司 | Pole piece roller compression machine control method, device and computer readable storage medium |
| CN110825217B (en)* | 2018-08-13 | 2023-07-11 | 珠海格力电器股份有限公司 | Household appliance control method and device |
| CN109144392B (en)* | 2018-08-22 | 2021-04-16 | 北京奇艺世纪科技有限公司 | Method and device for processing gesture conflict and electronic equipment |
| CN109697012A (en)* | 2018-12-25 | 2019-04-30 | 华勤通讯技术有限公司 | Control method, smartwatch and the storage medium of smartwatch |
| CN109933199B (en)* | 2019-03-13 | 2022-05-24 | 阿波罗智联(北京)科技有限公司 | Control method and device based on gestures, electronic equipment and storage medium |
| CN110162238A (en)* | 2019-05-23 | 2019-08-23 | 努比亚技术有限公司 | It is a kind of fast to call associated application method and device, mobile terminal and storage medium |
| CN112749046B (en)* | 2019-10-31 | 2023-08-11 | 比亚迪股份有限公司 | MSS system simulation data construction method, device, equipment and storage medium |
| CN112068743A (en)* | 2020-08-26 | 2020-12-11 | 深圳传音控股股份有限公司 | Interaction method, terminal and storage medium |
| CN114756836A (en)* | 2022-04-26 | 2022-07-15 | 上海上讯信息技术股份有限公司 | Global watermark processing method and device based on runtime |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102436347A (en)* | 2011-11-10 | 2012-05-02 | 盛乐信息技术（上海）有限公司 | Application program switching method and touch screen device |
| CN102799340A (en)* | 2011-05-26 | 2012-11-28 | 上海三旗通信科技股份有限公司 | Operation gesture for switching multi-applications to current window and activating multi-applications |
| CN103197885A (en)* | 2013-03-04 | 2013-07-10 | 东莞宇龙通信科技有限公司 | Method for controlling mobile terminal and mobile terminal thereof |
| CN103620542A (en)* | 2013-01-22 | 2014-03-05 | 华为终端有限公司 | A physical key simulating method and apparatus based on a touch screen |
| CN103853481A (en)* | 2012-12-06 | 2014-06-11 | 腾讯科技（深圳）有限公司 | Method and system for simulating touch screen mobile terminal keys |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8373660B2 (en)* | 2003-07-14 | 2013-02-12 | Matt Pallakoff | System and method for a portable multimedia client |
| US9310994B2 (en)* | 2010-02-19 | 2016-04-12 | Microsoft Technology Licensing, Llc | Use of bezel as an input mechanism |
| CN102253709A (en)* | 2010-05-19 | 2011-11-23 | 禾瑞亚科技股份有限公司 | Gesture judgment method and device |
| CN103019554A (en)* | 2011-09-20 | 2013-04-03 | 联想(北京)有限公司 | Command recognition method and electronic device using same |
| CN103324420B (en)* | 2012-03-19 | 2016-12-28 | 联想(北京)有限公司 | Multi-point touchpad input operation identification method and electronic equipment |
| CN103513899A (en)* | 2012-06-21 | 2014-01-15 | 北京睿思汇通移动科技有限公司 | Screen splitting method for mobile terminal browser and browser controlling method |
| CN103870171B (en)* | 2012-12-07 | 2017-07-25 | 联想(北京)有限公司 | Data processing method and device |
| CN103347108A (en)* | 2013-07-05 | 2013-10-09 | 中科创达软件股份有限公司 | Mobile phone with side face provided with programmable rapid touchpad and implementation method |
| CN103605465A (en)* | 2013-12-06 | 2014-02-26 | 上海艾为电子技术有限公司 | Method for controlling handheld equipment and handheld equipment |
| CN103941919A (en)* | 2014-04-23 | 2014-07-23 | 宁波保税区攀峒信息科技有限公司 | Touch event identification mode |
| CN104267902B (en)* | 2014-09-22 | 2017-03-08 | 努比亚技术有限公司 | Application program interactive control method, device and terminal |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102799340A (en)* | 2011-05-26 | 2012-11-28 | 上海三旗通信科技股份有限公司 | Operation gesture for switching multi-applications to current window and activating multi-applications |
| CN102436347A (en)* | 2011-11-10 | 2012-05-02 | 盛乐信息技术（上海）有限公司 | Application program switching method and touch screen device |
| CN103853481A (en)* | 2012-12-06 | 2014-06-11 | 腾讯科技（深圳）有限公司 | Method and system for simulating touch screen mobile terminal keys |
| CN103620542A (en)* | 2013-01-22 | 2014-03-05 | 华为终端有限公司 | A physical key simulating method and apparatus based on a touch screen |
| CN103197885A (en)* | 2013-03-04 | 2013-07-10 | 东莞宇龙通信科技有限公司 | Method for controlling mobile terminal and mobile terminal thereof |
| Publication number | Publication date |
|---|---|
| WO2016045579A1 (en) | 2016-03-31 |
| CN104267902A (en) | 2015-01-07 |
| Publication | Publication Date | Title |
|---|---|---|
| CN104267902B (en) | Application program interactive control method, device and terminal | |
| US11460918B2 (en) | Managing and mapping multi-sided touch | |
| CN105760102B (en) | Terminal interaction control method and device and application program interaction control method | |
| US10082886B2 (en) | Automatic configuration of an input device based on contextual usage | |
| CN105260117B (en) | Application control method and device | |
| US20110126094A1 (en) | Method of modifying commands on a touch screen user interface | |
| CN103324518B (en) | A kind of operation mapping method and device | |
| CN104536666B (en) | A method and device for quickly switching application programs and their interfaces | |
| CN108549522A (en) | It takes pictures setting method, device, mobile terminal and computer readable storage medium | |
| CN104238946B (en) | A kind of touch control method, device and terminal | |
| US10474324B2 (en) | Uninterruptable overlay on a display | |
| JP2015537266A (en) | Interface control method and control apparatus | |
| TW201626204A (en) | Touch control photography method and touch terminal thereof | |
| WO2022179331A1 (en) | Photographing method and apparatus, mobile terminal, and storage medium | |
| CN111857497B (en) | Operation prompt method and electronic device | |
| CN105335061A (en) | Information display method and apparatus and terminal | |
| CN111782113B (en) | Display method, display device and computer-readable storage medium | |
| CN104951293A (en) | A key response method of a mobile terminal and the mobile terminal | |
| CN109144643A (en) | Fingerprint recognition reminding method, device, storage medium and electronic equipment | |
| CN105760092B (en) | A kind of application control method, apparatus and electronic equipment for touch panel device | |
| CN115244503A (en) | Display device | |
| CN105468367A (en) | PPT file playing method and device | |
| HK40023331A (en) | Managing and mapping multi-sided touch |
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | Address after:A District No. 9018 Han innovation building in Nanshan District high tech Zone in Shenzhen city of Guangdong Province, North Central Avenue, 518000 floor 10 Applicant after:Nubian Technologies Ltd. Address before:A District No. 9018 Han innovation building in Nanshan District high tech Zone in Shenzhen city of Guangdong Province, North Central Avenue, 518000 floor 10 Applicant before:Shenzhen ZTE Mobile Tech Co., Ltd. | |
| COR | Change of bibliographic data | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |