技术领域Technical Field
本发明属于移动应用自动化检测领域,尤其涉及一种基于滑动窗口和控件信息的移动应用控件采样方法。The present invention belongs to the field of automatic detection of mobile applications, and in particular relates to a mobile application control sampling method based on sliding windows and control information.
背景技术Background Art
随着互联网的迅猛发展,各种各样的网页和移动端应用的数量爆发式增长。巨大的用户群体和各种各样的移动应用,也对移动应用自动化检测领域发起新的挑战。With the rapid development of the Internet, the number of various web pages and mobile applications has exploded. The huge user base and various mobile applications have also brought new challenges to the field of mobile application automated detection.
目前,有较多的对移动应用进行自动化遍历的方法,它们设计了基于广度优先搜索或深度有线搜索的策略,有的预先的对先源码分析得出页面关系,有的基于页面之间的拓扑关系和页面相似度进行剪枝,但是在控件的采样方法方面却十分欠缺。At present, there are many methods for automatic traversal of mobile applications. They design strategies based on breadth-first search or depth-first search. Some pre-analyze the source code to derive page relationships, and some prune based on the topological relationship and page similarity between pages. However, they are very lacking in the sampling method of controls.
发明内容Summary of the invention
本发明的目的在于针对现有技术的不足,提供一种基于滑动窗口和控件信息的移动应用控件采样方法。The purpose of the present invention is to provide a mobile application control sampling method based on sliding window and control information in view of the deficiencies in the prior art.
本发明的目的是通过以下技术方案来实现的:一种基于滑动窗口和控件信息的移动应用控件采样方法,包括以下步骤:The object of the present invention is achieved through the following technical solution: A mobile application control sampling method based on a sliding window and control information comprises the following steps:
S1:开启手机操作系统自带的屏幕阅读器,开启后通过设备控制模块使得移动应用页面上的控件先后被聚焦;S1: Turn on the screen reader that comes with the mobile phone operating system. After turning it on, the controls on the mobile application page are focused one by one through the device control module.
S2:移动应用页面上的控件被聚焦时,获取当前被聚焦的控件信息;S2: When a control on the mobile application page is focused, obtain the currently focused control information;
S3:将收集到控件信息发送给采样处理模块,采样处理模块将收到的控件信息按时间加入到时序队列中,设备控制模块将使得移动应用页面上的下一个控件被聚焦,直到页面上所有的控件都被聚焦过或者达到最大的聚焦控件数或者达到其他停止条件;S3: Send the collected control information to the sampling processing module, which adds the received control information to the timing queue according to the time. The device control module focuses the next control on the mobile application page until all controls on the page are focused or the maximum number of focused controls is reached or other stop conditions are met;
S4:采样处理模块将以递增的窗口大小扫描控件信息的时序队列,记录下高度相似的窗口,窗口所包含的控件将被标记为“丢弃”;S4: The sampling processing module will scan the time series queue of control information with increasing window size, record highly similar windows, and the controls contained in the windows will be marked as "discarded";
S5:当整个页面的控件遍历完成或达到最大的聚焦控件数或者达到其他停止条件时,分别点击之前未被标记为“丢弃”的控件,至此移动应用页面的控件采样完成。S5: When the traversal of the controls of the entire page is completed or the maximum number of focused controls is reached or other stop conditions are met, the controls that have not been marked as "discarded" are clicked respectively, and the control sampling of the mobile application page is completed.
进一步地,步骤S1中,针对Android,屏幕阅读器选用Talkback,设备控制模块利用系统的无障碍服务;针对iOS,屏幕阅读器选用VoiceOver,设备控制模块选用模拟蓝牙键盘控制;设备控制模块能够实现的控制包括聚焦上/下一个控件、返回、点击进入控件。Furthermore, in step S1, for Android, the screen reader uses Talkback, and the device control module uses the system's accessibility service; for iOS, the screen reader uses VoiceOver, and the device control module uses simulated Bluetooth keyboard control; the controls that the device control module can implement include focusing on the previous/next control, returning, and clicking to enter a control.
进一步地,步骤S2包括:Further, step S2 includes:
S21:对于Android移动应用,通过系统的无障碍服务获取当前被聚焦的控件信息,包括位置、大小、控件标签类型、文本;S21: For Android mobile applications, obtain the currently focused control information through the system's accessibility service, including position, size, control label type, and text;
S22:对于iOS移动应用,对当前手机画面截图并利用计算机视觉的技术手段获取当前被聚焦的控件信息,包括位置、大小、文本。S22: For iOS mobile applications, take a screenshot of the current mobile phone screen and use computer vision technology to obtain the information of the currently focused control, including position, size, and text.
进一步地,步骤S22中,利用计算机视觉算法识别iOS移动应用聚焦控件信息,包括:Furthermore, in step S22, the iOS mobile application focus control information is identified using a computer vision algorithm, including:
先在iOS的“辅助功能→显示与文字大小”中开启“智能反转”、“降低白点值”、“增强对比度”、“降低透明度”,并且在“辅助功能→旁白”中开启“大光标”,以此增强聚焦框的识别效果;在“辅助功能→旁白”中开启“字幕面板”,以此来显示控件的辅助文本;截取手机画面后,利用计算机视觉算法分别识别出聚焦框的位置、大小和辅助文本内容。First, turn on "Smart Invert", "Lower White Point", "Enhance Contrast", and "Reduce Transparency" in "Accessibility → Display & Text Size" of iOS, and turn on "Large Cursor" in "Accessibility → VoiceOver" to enhance the recognition effect of the focus frame; turn on "Subtitle Panel" in "Accessibility → VoiceOver" to display the auxiliary text of the control; after capturing the mobile phone screen, use computer vision algorithms to identify the position, size and auxiliary text content of the focus frame.
进一步地,步骤S4包括:Further, step S4 includes:
先将第一个控件设为“丢弃”,设置初始窗口大小;从队尾第一个控件信息开始以当前的窗口大小取“当前窗口”,然后开始从时序队列的队尾的第二个控件信息开始以当前窗口大小取“比较窗口”往前扫描,直到将队首第一个控件信息纳入“比较窗口”;将“当前窗口”内的各个控件信息和“比较窗口”内的各个控件信息依次计算相似度,相似度大于或等于阈值,就认为两个控件是高度相似的;若两个窗口的各个对应的控件信息都是高度相似的,那么认为这两个窗口是高度相似的,将“当前窗口”所包含的控件标记为“丢弃”;其中“当前窗口”和“比较窗口”大小从初始窗口大小开始递增,直到等于预设的最大窗口大小。First, set the first control to "discard" and set the initial window size; start from the first control information at the end of the queue and take the "current window" with the current window size, then start from the second control information at the end of the time series queue and take the "comparison window" with the current window size and scan forward until the first control information at the head of the queue is included in the "comparison window"; calculate the similarity of each control information in the "current window" and each control information in the "comparison window" in turn, and if the similarity is greater than or equal to the threshold, the two controls are considered to be highly similar; if the corresponding control information of the two windows is highly similar, then the two windows are considered to be highly similar, and the controls contained in the "current window" are marked as "discarded"; the sizes of the "current window" and "comparison window" increase from the initial window size until they are equal to the preset maximum window size.
进一步地,将标记为“丢弃”的窗口保存起来,优先将“当前窗口”和已标记为“丢弃”的窗口比较。Furthermore, the window marked as "discarded" is saved, and the "current window" is preferentially compared with the window marked as "discarded".
进一步地,初始窗口大小设置为2。Furthermore, the initial window size is set to 2.
进一步地,所述计算相似度,包括:Furthermore, the calculating similarity includes:
对于两个窗口中顺序对应的控件信息,初始化相似度为0,分别比较两个控件的宽、高、相对窗口中相邻控件的相对位置、辅助文本以及控件标签类型;其中,辅助文本不为空且一致则令相似度加2,辅助文本都为空则令相似度加1;其中,宽、高、相对位置中每有一个一致,则令相似度加1;其中,控件标签类型一致,则令相似度加1;最后若相似度大于或等于阈值,认为控件高度相似;其中,控件标签类型仅针对Android,iOS不考虑。For the control information of the two windows that correspond in sequence, the similarity is initialized to 0, and the width, height, relative position relative to the adjacent control in the window, auxiliary text and control label type of the two controls are compared respectively; if the auxiliary text is not empty and consistent, the similarity is increased by 2, and if the auxiliary text is empty, the similarity is increased by 1; if any one of the width, height and relative position is consistent, the similarity is increased by 1; if the control label type is consistent, the similarity is increased by 1; finally, if the similarity is greater than or equal to the threshold, the controls are considered to be highly similar; the control label type is only for Android and is not considered for iOS.
进一步地,所述相对窗口中相邻控件的相对位置,根据屏幕坐标计算得出,包括上、下、左、右、左上、左下、右上、右下。Furthermore, the relative positions of adjacent controls in the relative window are calculated based on screen coordinates, including top, bottom, left, right, upper left, lower left, upper right, and lower right.
一种计算机可读存储介质,其上存储有程序,该程序被处理器执行时,实现如权利要求1-9任一项所述基于滑动窗口和控件信息的移动应用控件采样方法。A computer-readable storage medium stores a program thereon, which, when executed by a processor, implements the mobile application control sampling method based on sliding windows and control information as described in any one of claims 1 to 9.
本发明的有益效果是:与目前的基于页面之间的拓扑关系和页面相似度剪枝的策略相比,控件采样应当发生在页面剪枝前,可以在不点击控件进入页面的情况下,直接对控件的点击操作进行取舍判断,大大提高了移动应用遍历的效率,在同样的时间内可以遍历更多的有效页面,可以有效避免重复进入类似的页面,对有瀑布流的页面采样后效果更加显著,即大大提高了页面的有效覆盖率。区别于对单个控件之间的相似度比较,本发明能够减少相似控件的误判,比如两个“确定”按钮很可能点击后进入完全不同的页面,而基于窗口大小至少为2的滑动窗口则可以带来控件上下文的信息,减少误采样的情况;区别于基于纯计算机视觉的相似度比较,本发明还基于控件的辅助文本信息和控件空间相对布局信息,能够提高采样的准确度。The beneficial effects of the present invention are as follows: compared with the current strategy based on the topological relationship between pages and page similarity pruning, control sampling should occur before page pruning, and the click operation of the control can be directly selected and judged without clicking the control to enter the page, which greatly improves the efficiency of mobile application traversal, and can traverse more valid pages in the same time, and can effectively avoid repeated entry into similar pages. The effect is more significant after sampling pages with waterfall flows, that is, the effective coverage of the page is greatly improved. Different from the similarity comparison between single controls, the present invention can reduce the misjudgment of similar controls. For example, two "OK" buttons are likely to enter completely different pages after clicking, and the sliding window based on the window size of at least 2 can bring the information of the control context and reduce the situation of mis-sampling; different from the similarity comparison based on pure computer vision, the present invention is also based on the auxiliary text information of the control and the relative layout information of the control space, which can improve the accuracy of sampling.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
图1是本发明的整体架构示意图;FIG1 is a schematic diagram of the overall structure of the present invention;
图2是本发明的采样算法示意图。FIG. 2 is a schematic diagram of a sampling algorithm of the present invention.
具体实施方法Specific implementation methods
下面结合附图具体说明本发明的技术方案。The technical solution of the present invention is described in detail below with reference to the accompanying drawings.
如图1所示,本发明一种基于滑动窗口和控件信息的移动应用控件采样方法,具体步骤如下:As shown in FIG1 , the present invention provides a method for sampling mobile application controls based on a sliding window and control information, and the specific steps are as follows:
S1:开启手机操作系统自带的屏幕阅读器,开启后通过设备控制模块使得移动应用页面上的控件先后被聚焦。S1: Turn on the screen reader that comes with the mobile phone operating system. After turning it on, the controls on the mobile application page are focused one by one through the device control module.
具体地,屏幕阅读器选用Android的屏幕阅读器为Talkback,或者iOS的屏幕阅读器为VoiceOver;设备控制模块iOS选用模拟蓝牙键盘控制,或者Android利用系统的无障碍服务,能够实现聚焦上/下一个控件、返回、点击进入控件等。Specifically, the screen reader selected is Talkback for Android, or VoiceOver for iOS; the device control module iOS selects simulated Bluetooth keyboard control, or Android uses the system's accessibility service to achieve focusing on the previous/next control, returning, clicking to enter a control, etc.
S2:移动应用的页面上的控件被聚焦时,获取当前被聚焦的控件的大小、位置和文本等信息。S2: When a control on the page of the mobile application is focused, information such as the size, position, and text of the currently focused control is obtained.
S21:对于Android移动应用,通过系统的无障碍服务获取当前被聚焦控件的位置、大小、控件标签类型、文本等信息。S21: For Android mobile applications, obtain information such as the position, size, control label type, and text of the currently focused control through the system's accessibility service.
S22:对于iOS移动应用,对当前手机画面截图并利用计算机视觉的技术手段获取当前被聚焦控件的位置、大小、文本等信息。S22: For iOS mobile applications, a screenshot of the current mobile phone screen is taken and computer vision technology is used to obtain information such as the position, size, and text of the currently focused control.
具体地,利用计算机视觉算法识别iOS移动应用聚焦控件信息的方法,具体为:需要先在iOS的“辅助功能→显示与文字大小”中开启“智能反转”、“降低白点值”、“增强对比度”、“降低透明度”,并且在“辅助功能→旁白”中开启“大光标”,以此增强聚焦框的识别效果;在“辅助功能→旁白”中开启“字幕面板”,以此来显示控件的辅助文本;截取手机画面后,利用计算机视觉算法分别识别出聚焦框的位置、大小和辅助文本内容。Specifically, the method of using computer vision algorithms to identify the focus control information of iOS mobile applications is as follows: you need to first turn on "Smart Invert", "Reduce White Point Value", "Enhance Contrast", and "Reduce Transparency" in "Accessibility → Display and Text Size" of iOS, and turn on "Large Cursor" in "Accessibility → Narration" to enhance the recognition effect of the focus frame; turn on "Subtitle Panel" in "Accessibility → Narration" to display the auxiliary text of the control; after capturing the mobile phone screen, use computer vision algorithms to respectively identify the position, size and auxiliary text content of the focus frame.
S3:将收集到控件信息发送给采样处理模块,采样处理模块将收到的控件信息按时间加入到时序队列中,设备控制模块将使得移动应用页面上的下一个控件被聚焦,直到页面上所有的控件都被聚焦过或者达到最大的聚焦控件数或者达到其他停止条件。S3: The collected control information is sent to the sampling processing module. The sampling processing module adds the received control information to the timing queue according to the time. The device control module makes the next control on the mobile application page focused until all controls on the page are focused or the maximum number of focused controls is reached or other stop conditions are met.
S4:采样处理模块将以递增的窗口大小扫描控件信息的时序队列,记录下高度相似的窗口,窗口所包含的控件将被标记为“丢弃”。S4: The sampling processing module will scan the timing queue of control information with increasing window size, record highly similar windows, and the controls contained in the windows will be marked as "discarded".
具体地,如图2所示,采样处理模块的实施步骤如下:先将第一个控件设为“丢弃”,因为实践经验指出第一个控件往往是“返回”按钮,或者是指向当前页面的按钮;设置初始窗口大小为2;从队尾第一个控件信息开始以当前的窗口大小取“当前窗口”,然后开始从时序队列的队尾的第二个控件信息开始以当前窗口大小取“比较窗口”往前扫描,直到将队首第一个控件信息纳入“比较窗口”;将“当前窗口”内的各个控件信息和左边的“比较窗口”内的各个控件信息依次计算相似度,相似度大于或等于阈值,就认为两个控件是高度相似的;若两个窗口的各个对应的控件信息都是高度相似的,那么认为这两个窗口是高度相似的,将“当前窗口”所包含的控件标记为“丢弃”。其中,“当前窗口”和“比较窗口”大小从初始窗口大小开始递增,直到等于预设的最大窗口大小。优选地,可以将标记为“丢弃”的窗口保存起来,优先将“当前窗口”和已标记为“丢弃”的窗口比较,因为在移动应用页面中结构类似的导航控件组或瀑布流控件组通常是紧接着的,缓存“丢弃”窗口有利于提高采样效率。Specifically, as shown in FIG2 , the implementation steps of the sampling processing module are as follows: first set the first control to “discard”, because practical experience shows that the first control is often a “return” button or a button pointing to the current page; set the initial window size to 2; start from the first control information at the end of the queue to take the “current window” with the current window size, and then start from the second control information at the end of the time series queue to take the “comparison window” with the current window size and scan forward until the first control information at the head of the queue is included in the “comparison window”; calculate the similarity of each control information in the “current window” and each control information in the “comparison window” on the left in turn, and if the similarity is greater than or equal to the threshold, the two controls are considered to be highly similar; if the corresponding control information of the two windows is highly similar, then the two windows are considered to be highly similar, and the controls contained in the “current window” are marked as “discarded”. Among them, the sizes of the “current window” and the “comparison window” increase from the initial window size until they are equal to the preset maximum window size. Preferably, the windows marked as "discarded" can be saved, and the "current window" and the windows marked as "discarded" are preferentially compared, because in the mobile application page, the navigation control groups or waterfall flow control groups with similar structures are usually adjacent, and caching the "discarded" windows is beneficial to improving the sampling efficiency.
具体地,计算相似度的实施步骤如下:对于两个窗口中顺序对应的控件信息,初始化相似度为0,分别比较两个控件的宽、高、相对窗口中相邻控件的相对位置(根据获得的屏幕坐标计算得出,分别有“上”、“下”、“左”、“右”、“左上”、“左下”、“右上”、“右下”)、辅助文本以及控件标签类型(仅Android可以通过无障碍服务获取)。其中,辅助文本不为空且一致则令相似度加2,辅助文本都为空则令相似度加1;其中,宽、高、相对位置中每有一个一致,则令相似度加1;其中,控件标签类型一致,则令相似度加1。最后若相似度大于或等于阈值4,认为控件高度相似。Specifically, the implementation steps for calculating the similarity are as follows: for the control information in the two windows that correspond to each other in sequence, initialize the similarity to 0, and compare the width, height, relative position of the two controls relative to the adjacent controls in the window (calculated based on the obtained screen coordinates, respectively "up", "down", "left", "right", "upper left", "lower left", "upper right", "lower right"), auxiliary text, and control label type (only Android can obtain it through accessibility services). Among them, if the auxiliary text is not empty and consistent, the similarity is increased by 2, and if the auxiliary text is empty, the similarity is increased by 1; among them, if one of the width, height, and relative position is consistent, the similarity is increased by 1; among them, if the control label type is consistent, the similarity is increased by 1. Finally, if the similarity is greater than or equal to the threshold of 4, the controls are considered to be highly similar.
S5:当整个页面的控件遍历完成或达到最大的聚焦控件数或者达到其他停止条件时,接下来,将分别点击之前未被标记为“丢弃”的控件,至此移动应用页面的控件采样完成。S5: When the traversal of the controls of the entire page is completed or the maximum number of focused controls is reached or other stop conditions are met, next, the controls that have not been marked as "discarded" before will be clicked respectively, and the control sampling of the mobile application page is completed.
本发明实施例还提供一种计算机可读存储介质,其上存储有程序,该程序被处理器执行时,实现上述实施例中的基于滑动窗口和控件信息的移动应用控件采样方法。An embodiment of the present invention further provides a computer-readable storage medium on which a program is stored. When the program is executed by a processor, the mobile application control sampling method based on sliding windows and control information in the above embodiment is implemented.
所述计算机可读存储介质可以是前述任一实施例所述的任意具备数据处理能力的设备的内部存储单元,例如硬盘或内存。所述计算机可读存储介质也可以是任意具备数据处理能力的设备,例如所述设备上配备的插接式硬盘、智能存储卡(Smart Media Card,SMC)、SD卡、闪存卡(Flash Card)等。进一步地,所述计算机可读存储介质还可以既包括任意具备数据处理能力的设备的内部存储单元也包括外部存储设备。所述计算机可读存储介质用于存储所述计算机程序以及所述任意具备数据处理能力的设备所需的其他程序和数据,还可以用于暂时地存储已经输出或者将要输出的数据。The computer-readable storage medium may be an internal storage unit of any device with data processing capability described in any of the aforementioned embodiments, such as a hard disk or a memory. The computer-readable storage medium may also be any device with data processing capability, such as a plug-in hard disk, a smart media card (SMC), an SD card, a flash card, etc. equipped on the device. Furthermore, the computer-readable storage medium may also include both an internal storage unit of any device with data processing capability and an external storage device. The computer-readable storage medium is used to store the computer program and other programs and data required by any device with data processing capability, and may also be used to temporarily store data that has been output or is to be output.
本说明书实施例所述的内容仅仅是对发明构思的实现形式的列举,本发明的保护范围不应当被视为仅限于实施例所陈述的具体形式,本发明的保护范围也及于本领域技术人员根据本发明构思所能够想到的等同技术手段。The contents described in the embodiments of this specification are merely an enumeration of the implementation forms of the inventive concept. The protection scope of the present invention should not be regarded as limited to the specific forms described in the embodiments. The protection scope of the present invention also extends to equivalent technical means that can be conceived by those skilled in the art based on the inventive concept.
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210369205.1ACN114840417B (en) | 2022-04-08 | 2022-04-08 | Mobile application control sampling method based on sliding window and control information |
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210369205.1ACN114840417B (en) | 2022-04-08 | 2022-04-08 | Mobile application control sampling method based on sliding window and control information |
Publication Number | Publication Date |
---|---|
CN114840417A CN114840417A (en) | 2022-08-02 |
CN114840417Btrue CN114840417B (en) | 2024-08-13 |
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202210369205.1AActiveCN114840417B (en) | 2022-04-08 | 2022-04-08 | Mobile application control sampling method based on sliding window and control information |
Country | Link |
---|---|
CN (1) | CN114840417B (en) |
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112162930A (en)* | 2020-10-21 | 2021-01-01 | 腾讯科技(深圳)有限公司 | Control identification method, related device, equipment and storage medium |
CN113010136A (en)* | 2021-05-24 | 2021-06-22 | 全时云商务服务股份有限公司 | Method and system for intelligently amplifying shared desktop and readable storage medium |
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10395759B2 (en)* | 2015-05-18 | 2019-08-27 | Regeneron Pharmaceuticals, Inc. | Methods and systems for copy number variant detection |
CN113377899A (en)* | 2020-03-09 | 2021-09-10 | 华为技术有限公司 | Intention recognition method and electronic equipment |
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112162930A (en)* | 2020-10-21 | 2021-01-01 | 腾讯科技(深圳)有限公司 | Control identification method, related device, equipment and storage medium |
CN113010136A (en)* | 2021-05-24 | 2021-06-22 | 全时云商务服务股份有限公司 | Method and system for intelligently amplifying shared desktop and readable storage medium |
Publication number | Publication date |
---|---|
CN114840417A (en) | 2022-08-02 |
Publication | Publication Date | Title |
---|---|---|
WO2021115181A1 (en) | Gesture recognition method, gesture control method, apparatuses, medium and terminal device | |
KR20200120739A (en) | Methods, devices, devices and computer-readable storage media for public handwriting recognition | |
CN110727668B (en) | Data cleaning method and device | |
CN105580384A (en) | Actionable content displayed on a touch screen | |
CN103577843A (en) | Identification method for handwritten character strings in air | |
CN111724336B (en) | Image processing device, image processing method and image processing system | |
CN103065134A (en) | Fingerprint identification device and method with prompt information | |
WO2016101717A1 (en) | Touch interaction-based search method and device | |
KR102440198B1 (en) | VIDEO SEARCH METHOD AND APPARATUS, COMPUTER DEVICE, AND STORAGE MEDIUM | |
CN105117159B (en) | A kind of character processing method and terminal | |
CN103365446A (en) | Handwriting input method and device | |
CN106874947A (en) | Method and apparatus for determining word shape recency | |
WO2021012513A1 (en) | Gesture operation method and apparatus, and computer device | |
CN109948440A (en) | Form image analysis method, device, computer equipment and storage medium | |
CN114565927B (en) | Table recognition method, device, electronic device and storage medium | |
CN118629095B (en) | Dynamic gesture recognition method and device based on attention mechanism | |
CN114840417B (en) | Mobile application control sampling method based on sliding window and control information | |
CN110990238A (en) | Non-invasive visual test script automatic recording method based on video shooting | |
CN118823803A (en) | Hand-drawn graphic recognition method and device, computer program product and electronic device | |
CN112765963B (en) | Sentence word segmentation method, sentence word segmentation device, computer equipment and storage medium | |
CN117854085A (en) | A bill identification method and device | |
CN112765110B (en) | PDF annotation data generation method, device, equipment and storage medium | |
CN113688835A (en) | System based on object detection and OCR and method for extracting information of application fault elastic picture | |
CN110609877B (en) | Picture acquisition method, device, equipment and computer storage medium | |
TW201301148A (en) | Web page browsing controlling system and method |
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |