Movatterモバイル変換


[0]ホーム

URL:


CN102937932A - Automated testing device and method of integrated heterogeneous testing tool - Google Patents

Automated testing device and method of integrated heterogeneous testing tool
Download PDF

Info

Publication number
CN102937932A
CN102937932ACN2011102347925ACN201110234792ACN102937932ACN 102937932 ACN102937932 ACN 102937932ACN 2011102347925 ACN2011102347925 ACN 2011102347925ACN 201110234792 ACN201110234792 ACN 201110234792ACN 102937932 ACN102937932 ACN 102937932A
Authority
CN
China
Prior art keywords
test
tool
automated testing
result
subtask
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2011102347925A
Other languages
Chinese (zh)
Other versions
CN102937932B (en
Inventor
尹祥龙
吴金坛
吕苏
翟威
陆寄豪
吴首阳
宋鑫晶
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Unionpay Co Ltd
Original Assignee
China Unionpay Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Unionpay Co LtdfiledCriticalChina Unionpay Co Ltd
Priority to CN201110234792.5ApriorityCriticalpatent/CN102937932B/en
Publication of CN102937932ApublicationCriticalpatent/CN102937932A/en
Application grantedgrantedCritical
Publication of CN102937932BpublicationCriticalpatent/CN102937932B/en
Activelegal-statusCriticalCurrent
Anticipated expirationlegal-statusCritical

Links

Images

Landscapes

Abstract

Translated fromChinese

本发明提出了一种自动化测试装置及方法,其中,所述自动化测试装置包括:测试用例配置模块,用于根据用户输入而配置测试任务;测试控制模块,用于控制所述测试任务的执行,并生成对应于所述测试任务的最终测试结果;测试工具适配接口,用于基于所述调度指令执行所述测试任务,并将执行结果传送回所述测试控制模块。本发明所公开的自动化测试装置及方法可以集成异构的测试工具,从而能够实现复杂系统的自动化测试,并显著提高和扩展了测试装置的整体性能。

Figure 201110234792

The present invention proposes an automated testing device and method, wherein the automated testing device includes: a test case configuration module for configuring test tasks according to user input; a test control module for controlling the execution of the test tasks, And generate the final test result corresponding to the test task; the test tool adaptation interface is used to execute the test task based on the scheduling instruction, and transmit the execution result back to the test control module. The automatic testing device and method disclosed in the invention can integrate heterogeneous testing tools, thereby realizing automatic testing of complex systems, and remarkably improving and expanding the overall performance of the testing device.

Figure 201110234792

Description

Translated fromChinese
集成异构测试工具的自动化测试装置及方法Automated testing device and method for integrating heterogeneous testing tools

技术领域technical field

本发明涉及自动化测试装置及方法,更具体地,涉及集成异构测试工具的自动化测试装置及方法。The present invention relates to an automatic testing device and method, more specifically, to an automatic testing device and method integrating heterogeneous testing tools.

背景技术Background technique

目前,随着计算机技术的日益发展以及不同领域的业务种类的日益丰富(例如金融交易领域),对复杂系统进行自动化测试的需求日益增长,因此,自动化测试装置及方法变得越来越重要。At present, with the increasing development of computer technology and the increasing variety of businesses in different fields (such as the field of financial transactions), the demand for automated testing of complex systems is increasing. Therefore, automated testing devices and methods are becoming more and more important.

通常,现有的自动化测试装置及方法大体可以分为如下类别:从技术架构的角度而言主要分为商用测试工具、开源测试框架和测试人员编制的轻量级测试脚本;从功能的角度而言主要分为功能测试工具、性能测试工具和安全性测试工具等;从运行平台角度而言主要分为基于Windows操作系统、基于Unix/Linux操作系统等;从被测系统角度而言例如分为Web测试工具、报文测试工具等。Generally, existing automated testing devices and methods can be roughly divided into the following categories: from the perspective of technical architecture, they are mainly divided into commercial testing tools, open source testing frameworks, and lightweight test scripts compiled by testers; It is mainly divided into functional testing tools, performance testing tools and security testing tools, etc.; from the perspective of operating platforms, it is mainly divided into Windows-based operating systems, Unix/Linux operating systems, etc.; from the perspective of the system under test, for example, it is divided into Web testing tools, message testing tools, etc.

然而,上述现有的自动化测试装置及方法存在如下问题:仅能针对特定的被测系统的特定功能进行测试,即不能完成跨平台、跨架构的测试;对于复杂的应用系统而言,仅能完成某一方面的测试;由于测试工具的种类繁多,故难于融合使用且操作复杂。However, the above-mentioned existing automated testing devices and methods have the following problems: they can only be tested for specific functions of a specific system under test, that is, they cannot complete cross-platform and cross-architecture tests; for complex application systems, only Complete a certain aspect of testing; due to the wide variety of testing tools, it is difficult to integrate and use and the operation is complicated.

因此,存在如下需求:提供一种集成异构测试工具的自动化测试装置及方法。Therefore, there is a demand as follows: provide an automatic testing device and method for integrating heterogeneous testing tools.

发明内容Contents of the invention

为了解决上述现有技术方案中所存在的问题,本发明提出了一种集成异构测试工具的自动化测试装置及方法。In order to solve the problems existing in the above-mentioned prior art solutions, the present invention proposes an automatic testing device and method for integrating heterogeneous testing tools.

本发明的目的是通过以下技术方案实现的:The purpose of the present invention is achieved through the following technical solutions:

一种自动化测试装置,其中,所述自动化测试装置包括:An automated testing device, wherein the automated testing device includes:

测试用例配置模块,所述测试用例配置模块用于根据用户输入而配置测试任务;A test case configuration module, the test case configuration module is used to configure test tasks according to user input;

测试控制模块,所述测试控制模块用于基于所述测试任务构造调度指令并将所述调度指令发送到测试工具适配接口,以控制所述测试任务的执行,并生成对应于所述测试任务的最终测试结果;A test control module, the test control module is configured to construct a scheduling instruction based on the test task and send the scheduling instruction to the test tool adaptation interface, so as to control the execution of the test task, and generate a The final test results;

测试工具适配接口,所述测试工具适配接口用于基于所述调度指令执行所述测试任务,并将执行结果传送回所述测试控制模块。A test tool adaptation interface, the test tool adaptation interface is used to execute the test task based on the scheduling instruction, and transmit the execution result back to the test control module.

在上面所公开的方案中,优选地,所述配置测试任务包括配置至少一个测试子任务。In the solution disclosed above, preferably, configuring the test task includes configuring at least one test subtask.

在上面所公开的方案中,可选地,所述配置至少一个测试子任务包括在所述自动化测试装置中配置所述至少一个测试子任务对应的至少一个测试工具接口模板。In the solution disclosed above, optionally, the configuring at least one test subtask includes configuring at least one test tool interface template corresponding to the at least one test subtask in the automated test device.

在上面所公开的方案中,可选地,所述配置至少一个测试子任务包括在测试任务配置服务器上配置所述至少一个测试子任务对应的至少一个测试工具接口模板,并在所述自动化测试装置中配置与所述至少一个测试工具接口模板相关联的测试工具接口模板标识号。In the solution disclosed above, optionally, the configuring at least one test subtask includes configuring at least one test tool interface template corresponding to the at least one test subtask on the test task configuration server, and The test tool interface template identification number associated with the at least one test tool interface template is configured in the device.

在上面所公开的方案中,优选地,所述测试工具接口模板包括测试工具名称字段、测试用例名称字段、测试用例说明字段、测试用例参数字段和期望结果字段。In the solution disclosed above, preferably, the test tool interface template includes a test tool name field, a test case name field, a test case description field, a test case parameter field and an expected result field.

在上面所公开的方案中,优选地,其中配置所述至少一个测试子任务对应的至少一个测试工具接口模板包括根据所述用户输入装填所述测试工具接口模板中的各个字段。In the solution disclosed above, preferably, configuring at least one test tool interface template corresponding to the at least one test subtask includes filling each field in the test tool interface template according to the user input.

在上面所公开的方案中,优选地,所述调度指令包括所述测试任务的配置信息。In the solution disclosed above, preferably, the scheduling instruction includes configuration information of the test task.

在上面所公开的方案中,优选地,所述执行结果包括所述至少一个测试子任务中的任何一个的测试结果信息。In the solution disclosed above, preferably, the execution result includes test result information of any one of the at least one test subtask.

在上面所公开的方案中,优选地,所述测试控制模块进一步包括:In the solution disclosed above, preferably, the test control module further includes:

调度单元,所述调度单元用于构造所述调度指令并将所述调度指令发送到所述测试工具适配接口,从而以并行或串行方式调度所述至少一个测试子任务的执行;a scheduling unit, configured to construct the scheduling instruction and send the scheduling instruction to the test tool adaptation interface, so as to schedule the execution of the at least one test subtask in a parallel or serial manner;

测试结果生成单元,所述测试结果生成单元用于基于所述执行结果记录所述至少一个测试子任务中的每个的所述测试结果信息,并生成对应于所述测试任务的最终测试结果。A test result generation unit configured to record the test result information of each of the at least one test subtask based on the execution result, and generate a final test result corresponding to the test task.

在上面所公开的方案中,优选地,所述测试工具适配接口3进一步包括:In the solution disclosed above, preferably, the test tool adaptation interface 3 further includes:

测试工具注册单元,所述测试工具注册单元用于注册至少一个测试工具,并生成已注册测试工具列表;A test tool registration unit, the test tool registration unit is used to register at least one test tool and generate a list of registered test tools;

初始化单元,所述初始化单元用于基于所述测试任务的配置信息确定所述至少一个测试子任务所对应的至少一个测试工具以及判断所述至少一个测试工具是否已注册,并且如果所述至少一个测试工具中的每个均已注册,则根据预定规则生成对应于所述至少一个测试工具的调用指令,并将所述调用指令传送到测试执行单元,以及如果所述至少一个测试工具中的至少一个未被注册,则向所述调度单元返回指示配置错误的信息;An initialization unit, configured to determine at least one test tool corresponding to the at least one test subtask based on the configuration information of the test task and determine whether the at least one test tool has been registered, and if the at least one Each of the test tools has been registered, then generate a call instruction corresponding to the at least one test tool according to a predetermined rule, and transmit the call instruction to the test execution unit, and if at least one of the at least one test tool If one is not registered, return information indicating a configuration error to the scheduling unit;

测试执行单元,所述测试执行单元用于根据所述调用指令调用所述至少一个测试工具,以执行所述至少一个测试子任务,并监测和获取所述至少一个测试工具输出的测试结果信息,以及将所述测试结果信息传送到结果收集单元;a test execution unit, the test execution unit is configured to call the at least one test tool according to the call instruction to execute the at least one test subtask, and monitor and acquire test result information output by the at least one test tool, and transmitting the test result information to the result collection unit;

结果收集单元,所述结果收集单元将所述测试结果信息与期望结果相比较,并基于比较结果和/或测试失败信息构造执行结果,并将所述执行结果传送到所述测试控制模块。A result collection unit that compares the test result information with an expected result, constructs an execution result based on the comparison result and/or the test failure information, and transmits the execution result to the test control module.

在上面所公开的方案中,优选地,所述预定规则是基于Telnet协议、bat临时文件和Windows API中的一个或多个。In the solution disclosed above, preferably, the predetermined rule is based on one or more of Telnet protocol, bat temporary file and Windows API.

在上面所公开的方案中,优选地,所述调用指令包括Shell命令、cmd命令和Windows API函数中的一个或多个。In the solution disclosed above, preferably, the calling instruction includes one or more of a Shell command, a cmd command and a Windows API function.

在上面所公开的方案中,优选地,所述测试执行单元通过如下方式中的至少一个方式监测和获取所述至少一个测试工具输出的结果数据:读取Telnet协议返回命令中的输出数据、读取cmd命令的返回数据、读取被调用的Windows API函数的输出数据。In the solution disclosed above, preferably, the test execution unit monitors and acquires the result data output by the at least one test tool in at least one of the following ways: read the output data in the Telnet protocol return command, read Get the return data of the cmd command and read the output data of the called Windows API function.

在上面所公开的方案中,优选地,所述测试执行单元进一步包括分别对应于所述至少一个测试工具中的每个的至少一个计时器,并且如果所述至少一个计时器中的任一个超时,则所述测试执行单元向所述结果收集单元发送测试失败信息,所述测试失败信息指示已超时的计时器所对应的测试工具未能成功执行其所对应的测试子任务。In the solution disclosed above, preferably, the test execution unit further includes at least one timer respectively corresponding to each of the at least one test tool, and if any one of the at least one timer times out , the test execution unit sends test failure information to the result collection unit, and the test failure information indicates that the test tool corresponding to the timed-out timer failed to successfully execute its corresponding test subtask.

在上面所公开的方案中,优选地,所述自动化测试装置使用至少两个测试工具,并且所述至少两个测试工具是异构的。In the solution disclosed above, preferably, the automated testing device uses at least two testing tools, and the at least two testing tools are heterogeneous.

本发明的目的还通过以下技术方案实现:The purpose of the present invention is also achieved through the following technical solutions:

一种自动化测试方法,其中,所述自动化测试方法包括如下步骤:An automated testing method, wherein the automated testing method comprises the steps of:

(A1)根据用户输入而配置测试任务;(A1) configuring test tasks according to user input;

(A2)基于所述测试任务构造调度指令并将所述调度指令发送到测试工具适配接口,以控制所述测试任务的执行;(A2) Constructing a scheduling instruction based on the test task and sending the scheduling instruction to the test tool adaptation interface to control the execution of the test task;

(A3)所述测试工具适配接口基于所述调度指令执行所述测试任务,并输出执行结果;(A3) The test tool adaptation interface executes the test task based on the scheduling instruction, and outputs an execution result;

(A4)根据所述执行结果生成对应于所述测试任务的最终测试结果。(A4) Generate a final test result corresponding to the test task according to the execution result.

在上面所公开的方案中,优选地,所述配置测试任务包括配置至少一个测试子任务。In the solution disclosed above, preferably, configuring the test task includes configuring at least one test subtask.

在上面所公开的方案中,优选地,所述配置至少一个测试子任务包括配置所述至少一个测试子任务对应的至少一个测试工具接口模板。In the solutions disclosed above, preferably, the configuring at least one test subtask includes configuring at least one test tool interface template corresponding to the at least one test subtask.

在上面所公开的方案中,优选地,所述测试工具接口模板包括测试工具名称字段、测试用例名称字段、测试用例说明字段、测试用例参数字段和期望结果字段。In the solution disclosed above, preferably, the test tool interface template includes a test tool name field, a test case name field, a test case description field, a test case parameter field and an expected result field.

在上面所公开的方案中,优选地,配置所述至少一个测试子任务对应的至少一个测试工具接口模板包括根据所述用户输入装填所述测试工具接口模板中的各个字段。In the solution disclosed above, preferably, configuring at least one test tool interface template corresponding to the at least one test subtask includes filling each field in the test tool interface template according to the user input.

在上面所公开的方案中,优选地,所述调度指令包括所述测试任务的配置信息。In the solution disclosed above, preferably, the scheduling instruction includes configuration information of the test task.

在上面所公开的方案中,优选地,所述执行结果包括所述至少一个测试子任务中的任何一个的测试结果信息。In the solution disclosed above, preferably, the execution result includes test result information of any one of the at least one test subtask.

在上面所公开的方案中,优选地,所述步骤(A2)进一步包括:构造所述调度指令并将所述调度指令发送到所述测试工具适配接口,从而以并行或串行方式调度所述至少一个测试子任务的执行In the solution disclosed above, preferably, the step (A2) further includes: constructing the scheduling instruction and sending the scheduling instruction to the test tool adaptation interface, so as to schedule all the scheduling instructions in parallel or serially Describe the execution of at least one test subtask

在上面所公开的方案中,优选地,所述步骤(A4)进一步包括:基于所述执行结果记录所述至少一个测试子任务中的每个的所述测试结果信息,并生成对应于所述测试任务的最终测试结果。In the solution disclosed above, preferably, the step (A4) further includes: recording the test result information of each of the at least one test subtask based on the execution result, and generating a corresponding The final test result of the test task.

在上面所公开的方案中,优选地,所述步骤(A3)进一步包括:In the scheme disclosed above, preferably, the step (A3) further includes:

(B1)注册至少一个测试工具,并生成已注册测试工具列表;(B1) register at least one test tool, and generate a list of registered test tools;

(B2)基于所述测试任务的配置信息确定所述至少一个测试子任务所对应的至少一个测试工具以及判断所述至少一个测试工具是否已注册,并且如果所述至少一个测试工具中的每个均已注册,则根据预定规则生成对应于所述至少一个测试工具的调用指令,以及如果所述至少一个测试工具中的至少一个未被注册,则返回指示配置错误的信息;(B2) Determine at least one test tool corresponding to the at least one test subtask based on the configuration information of the test task and determine whether the at least one test tool has been registered, and if each of the at least one test tool have been registered, then generate a call instruction corresponding to the at least one test tool according to a predetermined rule, and if at least one of the at least one test tool is not registered, return information indicating a configuration error;

(B3)根据所述调用指令调用所述至少一个测试工具,以执行所述至少一个测试子任务,并监测和获取所述至少一个测试工具输出的测试结果信息;(B3) calling the at least one test tool according to the call instruction to execute the at least one test subtask, and monitor and acquire test result information output by the at least one test tool;

(B4)将所述测试结果信息与期望结果相比较,并基于比较结果和/或测试失败信息构造执行结果。(B4) Comparing the test result information with an expected result, and constructing an execution result based on the comparison result and/or the test failure information.

在上面所公开的方案中,优选地,所述预定规则是基于Telnet协议、bat临时文件和Windows API中的一个或多个。In the solution disclosed above, preferably, the predetermined rule is based on one or more of Telnet protocol, bat temporary file and Windows API.

在上面所公开的方案中,优选地,所述调用指令包括Shell命令、cmd命令和Windows API函数中的一个或多个。In the solution disclosed above, preferably, the calling instruction includes one or more of a Shell command, a cmd command and a Windows API function.

在上面所公开的方案中,优选地,其中通过如下方式中的至少一个方式监测和获取所述至少一个测试工具输出的结果数据:读取Telnet协议返回命令中的输出数据、读取cmd命令的返回数据、读取被调用的Windows API函数的输出数据。In the solution disclosed above, preferably, the result data output by the at least one test tool is monitored and obtained through at least one of the following methods: reading the output data in the Telnet protocol return command, reading the output data of the cmd command Return data, read the output data of the called Windows API function.

在上面所公开的方案中,优选地,所述步骤(B3)进一步包括:启用分别对应于所述至少一个测试工具中的每个的至少一个计时器,并且如果所述至少一个计时器中的任一个超时,则输出所述测试失败信息,所述测试失败信息指示已超时的计时器所对应的测试工具未能成功执行其所对应的测试子任务。In the solution disclosed above, preferably, the step (B3) further includes: enabling at least one timer respectively corresponding to each of the at least one test tool, and if If any timer is timed out, the test failure information is output, and the test failure information indicates that the test tool corresponding to the timed-out timer failed to successfully execute its corresponding test subtask.

在上面所公开的方案中,优选地,在所述步骤(A3)中使用至少两个测试工具,并且所述至少两个测试工具是异构的。In the solution disclosed above, preferably, at least two test tools are used in the step (A3), and the at least two test tools are heterogeneous.

本发明所公开的集成异构测试工具的自动化测试装置及方法具有如下优点:(1)可以实现复杂系统的自动化测试;(2)由于可以集成异构的测试工具,故可以组合各种测试工具的优点而完成单一测试工具难以完成的测试任务,从而显著提高和扩展了测试装置的整体性能。The automated testing device and method for integrating heterogeneous testing tools disclosed in the present invention have the following advantages: (1) automated testing of complex systems can be realized; (2) various testing tools can be combined due to the ability to integrate heterogeneous testing tools The advantages of the test tool can complete the test tasks that are difficult to complete by a single test tool, thereby significantly improving and expanding the overall performance of the test device.

附图说明Description of drawings

结合附图,本发明的技术特征以及优点将会被本领域技术人员更好地理解,其中:With reference to the accompanying drawings, the technical features and advantages of the present invention will be better understood by those skilled in the art, wherein:

图1为根据本发明的实施例的集成异构测试工具的自动化测试装置的示意性结构图;1 is a schematic structural diagram of an automated testing device integrating heterogeneous testing tools according to an embodiment of the present invention;

图2为根据本发明的实施例的集成异构测试工具的自动化测试方法的流程图。Fig. 2 is a flowchart of an automated testing method for integrating heterogeneous testing tools according to an embodiment of the present invention.

具体实施方式Detailed ways

图1是根据本发明的实施例的集成异构测试工具的自动化测试装置的示意性结构图。如图1所示,本发明所公开的集成异构测试工具的自动化测试装置包括测试用例配置模块1、测试控制模块2和测试工具适配接口3。其中,所述测试用例配置模块1用于根据用户输入而配置测试任务。所述测试控制模块2用于基于所述测试任务构造调度指令并将所述调度指令发送到所述测试工具适配接口3,以控制所述测试任务的执行,并生成对应于所述测试任务的最终测试结果。所述测试工具适配接口3用于基于所述调度指令执行所述测试任务,并将执行结果传送回所述测试控制模块2。Fig. 1 is a schematic structural diagram of an automated testing device integrating heterogeneous testing tools according to an embodiment of the present invention. As shown in FIG. 1 , the automated test device for integrating heterogeneous test tools disclosed in the present invention includes a test case configuration module 1 , a test control module 2 and a test tool adaptation interface 3 . Wherein, the test case configuration module 1 is used to configure test tasks according to user input. The test control module 2 is configured to construct a scheduling instruction based on the test task and send the scheduling instruction to the test tool adaptation interface 3, so as to control the execution of the test task and generate final test results. The test tool adaptation interface 3 is used to execute the test task based on the scheduling instruction, and transmit the execution result back to the test control module 2 .

优选地,在本发明所公开的自动化测试装置中,所述配置测试任务包括配置至少一个测试子任务。Preferably, in the automated testing device disclosed in the present invention, said configuring the testing task includes configuring at least one testing subtask.

可选地,在本发明所公开的自动化测试装置中,所述配置至少一个测试子任务包括在所述自动化测试装置中配置所述至少一个测试子任务对应的至少一个测试工具接口模板。Optionally, in the automated test device disclosed in the present invention, configuring at least one test subtask includes configuring at least one test tool interface template corresponding to the at least one test subtask in the automated test device.

可选地,在本发明所公开的自动化测试装置中,所述配置至少一个测试子任务包括在测试任务配置服务器上配置所述至少一个测试子任务对应的至少一个测试工具接口模板,并在所述自动化测试装置中配置与所述至少一个测试工具接口模板相关联的测试工具接口模板标识号。Optionally, in the automated testing device disclosed in the present invention, configuring at least one test subtask includes configuring at least one test tool interface template corresponding to the at least one test subtask on the test task configuration server, and The test tool interface template identification number associated with the at least one test tool interface template is configured in the automated test device.

示例性地,表1示出了所述测试工具接口模板的字段结构。如表1所示,优选地,在本发明所公开的自动化测试装置中,所述测试工具接口模板包括测试工具名称字段、测试用例名称字段、测试用例说明字段、测试用例参数字段和期望结果字段等。Exemplarily, Table 1 shows the field structure of the test tool interface template. As shown in Table 1, preferably, in the automated testing device disclosed in the present invention, the test tool interface template includes a test tool name field, a test case name field, a test case description field, a test case parameter field and an expected result field wait.

表1Table 1

示例性地,在本发明所公开的自动化测试装置中,配置所述至少一个测试子任务对应的至少一个测试工具接口模板包括根据所述用户输入装填所述测试工具接口模板中的各个字段。Exemplarily, in the automated testing device disclosed in the present invention, configuring at least one test tool interface template corresponding to the at least one test subtask includes filling each field in the test tool interface template according to the user input.

优选地,在本发明所公开的自动化测试装置中,所述调度指令包括所述测试任务的配置信息。Preferably, in the automated testing device disclosed in the present invention, the scheduling instruction includes configuration information of the testing task.

优选地,在本发明所公开的自动化测试装置中,所述执行结果包括所述至少一个测试子任务中的任何一个的测试结果信息。Preferably, in the automated test device disclosed in the present invention, the execution result includes test result information of any one of the at least one test subtask.

如图1所示,在本发明所公开的自动化测试装置中,所述测试控制模块2进一步包括调度单元4和测试结果生成单元5。其中,所述调度单元4用于构造所述调度指令并将所述调度指令发送到所述测试工具适配接口3,从而以并行或串行方式调度所述至少一个测试子任务的执行。所述测试结果生成单元5用于基于所述执行结果记录所述至少一个测试子任务中的每个的所述测试结果信息,并生成对应于所述测试任务的最终测试结果。As shown in FIG. 1 , in the automated testing device disclosed in the present invention, the test control module 2 further includes a scheduling unit 4 and a test result generating unit 5 . Wherein, the scheduling unit 4 is configured to construct the scheduling instruction and send the scheduling instruction to the test tool adaptation interface 3, so as to schedule the execution of the at least one test subtask in a parallel or serial manner. The test result generation unit 5 is configured to record the test result information of each of the at least one test subtask based on the execution result, and generate a final test result corresponding to the test task.

其中,示例性地,在本发明所公开的自动化测试装置中,所述并行方式适用于测试高压力情况下系统的功能可用性,而所述串行方式适用于测试时序约束性的业务流程。Wherein, for example, in the automated testing device disclosed in the present invention, the parallel method is suitable for testing the functional availability of the system under high pressure, and the serial method is suitable for testing the business process with timing constraints.

如图1所示,在本发明所公开的自动化测试装置中,所述测试工具适配接口3进一步包括初始化单元6、测试执行单元7、结果收集单元8和测试工具注册单元9。其中,所述测试工具注册单元9用于注册至少一个测试工具,并生成已注册测试工具列表。所述初始化单元6用于基于所述测试任务的配置信息确定所述至少一个测试子任务所对应的至少一个测试工具以及判断所述至少一个测试工具是否已注册,并且如果所述至少一个测试工具中的每个均已注册,则根据预定规则生成对应于所述至少一个测试工具的调用指令,并将所述调用指令传送到所述测试执行单元7,以及如果所述至少一个测试工具中的至少一个未被注册,则向所述调度单元4返回指示配置错误的信息。所述测试执行单元7用于根据所述调用指令调用所述至少一个测试工具,以执行所述至少一个测试子任务,并监测和获取所述至少一个测试工具输出的测试结果信息,以及将所述测试结果信息传送到所述结果收集单元8。所述结果收集单元8将所述测试结果信息与期望结果相比较(例如,比较特殊关键字),并基于比较结果和/或所述测试失败信息构造执行结果,并将所述执行结果传送到所述测试控制模块2。As shown in FIG. 1 , in the automated testing device disclosed in the present invention, the test tool adaptation interface 3 further includes an initialization unit 6 , a test execution unit 7 , a result collection unit 8 and a test tool registration unit 9 . Wherein, the test tool registration unit 9 is used for registering at least one test tool and generating a list of registered test tools. The initialization unit 6 is configured to determine at least one test tool corresponding to the at least one test subtask based on the configuration information of the test task and determine whether the at least one test tool has been registered, and if the at least one test tool Each of them has been registered, then generate a call instruction corresponding to the at least one test tool according to a predetermined rule, and transmit the call instruction to the test execution unit 7, and if the at least one test tool If at least one is not registered, return information indicating a configuration error to the scheduling unit 4 . The test execution unit 7 is configured to call the at least one test tool according to the call instruction to execute the at least one test subtask, monitor and acquire the test result information output by the at least one test tool, and transfer the The test result information is transmitted to the result collection unit 8. The result collection unit 8 compares the test result information with the expected result (for example, comparing specific keywords), and constructs an execution result based on the comparison result and/or the test failure information, and transmits the execution result to The test control module 2.

示例性地,在本发明所公开的自动化测试装置中,所述预定规则是基于Telnet协议、bat临时文件和Windows API中的一个或多个。Exemplarily, in the automated testing device disclosed in the present invention, the predetermined rule is based on one or more of Telnet protocol, bat temporary file and Windows API.

示例性地,在本发明所公开的自动化测试装置中,所述调用指令包括Shell命令、cmd命令和Windows API函数中的一个或多个。Exemplarily, in the automated testing device disclosed in the present invention, the calling instruction includes one or more of a Shell command, a cmd command and a Windows API function.

示例性地,在本发明所公开的自动化测试装置中,所述测试执行单元7通过如下方式中的至少一个方式监测和获取所述至少一个测试工具输出的结果数据:读取Telnet协议返回命令中的输出数据、读取cmd命令的返回数据、读取被调用的Windows API函数的输出数据。Exemplarily, in the automated testing device disclosed in the present invention, the test execution unit 7 monitors and obtains the result data output by the at least one test tool in at least one of the following ways: read the Telnet protocol return command output data, read the return data of the cmd command, and read the output data of the called Windows API function.

优选地,在本发明所公开的自动化测试装置中,所述测试执行单元7进一步包括分别对应于所述至少一个测试工具中的每个的至少一个计时器,并且如果所述至少一个计时器中的任一个超时,则所述测试执行单元7向所述结果收集单元8发送测试失败信息,所述测试失败信息指示已超时的计时器所对应的测试工具未能成功执行其所对应的测试子任务。Preferably, in the automated testing device disclosed in the present invention, the test execution unit 7 further includes at least one timer respectively corresponding to each of the at least one test tool, and if the at least one timer is If any one of the timers times out, the test execution unit 7 sends test failure information to the result collection unit 8, and the test failure information indicates that the test tool corresponding to the timer that has timed out failed to successfully execute its corresponding test subclass. Task.

示例性地,在本发明所公开的自动化测试装置中,以如下方式生成对应于所述至少一个测试工具的调用指令:(1)如果使用命令行平台(AIX/UNIX/LINUX等)形式的调用方式,则所述测试工具适配接口3被作为telnet协议客户端,从而连接和登录到远程目标测试主机;(2)如果使用Windows的cmd命令形式的调用方式,则生成可执行的bat临时命令脚本;(3)如果使用Windows API形式的调用方式,则构造参数并通过ShellExecute函数调用测试工具。Exemplarily, in the automated testing device disclosed in the present invention, the call instruction corresponding to the at least one test tool is generated in the following manner: (1) if the call in the form of a command line platform (AIX/UNIX/LINUX, etc.) is used mode, then the test tool adaptation interface 3 is used as a telnet protocol client to connect and log in to the remote target test host; (2) if the calling mode of the cmd command form of Windows is used, an executable bat temporary command is generated Script; (3) If the Windows API form is used, construct parameters and call the test tool through the ShellExecute function.

优选地,在本发明所公开的自动化测试装置中,所述自动化测试装置使用至少两个测试工具,并且所述至少两个测试工具是异构的。Preferably, in the automated testing device disclosed in the present invention, the automated testing device uses at least two testing tools, and the at least two testing tools are heterogeneous.

示例性地,在本发明所公开的自动化测试装置中,所述至少一个测试工具包括下列项中的一个或多个:自动化测试工具(用于功能回归测试,例如,被测系统是Windows系统)、Shell脚本(用于功能测试或测试辅助,例如,被测系统是Unix系统)、Python自动化测试工具(用于功能回归测试,例如,被测系统是web系统)和LoadRunner性能测试工具(用于性能测试)。Exemplarily, in the automated testing device disclosed in the present invention, the at least one testing tool includes one or more of the following items: Automated testing tools (for functional regression testing, for example, the system under test is a Windows system), Shell scripts (for functional testing or test assistance, for example, the system under test is a Unix system), Python automated testing tools (for functional regression Test, for example, the system under test is a web system) and the LoadRunner performance testing tool (for performance testing).

如图1所示,本发明所公开的自动化测试装置的基本工作原理如下:所述测试用例配置模块1根据用户输入而配置测试任务;所述测试控制模块2构造调度指令并将所述调度指令发送到所述测试工具适配接口3,以控制所述测试任务的执行,并生成对应于所述测试任务的最终测试结果;所述测试工具适配接口3基于所述调度指令执行所述测试任务,并将执行结果传送回所述测试控制模块2。As shown in Figure 1, the basic working principle of the automated testing device disclosed in the present invention is as follows: the test case configuration module 1 configures test tasks according to user input; sent to the test tool adaptation interface 3 to control the execution of the test task, and generate the final test result corresponding to the test task; the test tool adaptation interface 3 executes the test based on the scheduling instruction task, and send the execution result back to the test control module 2.

图2是根据本发明的实施例的集成异构测试工具的自动化测试方法的流程图。如图2所示,本发明所公开的自动化测试方法包括如下步骤:(A1)根据用户输入而配置测试任务;(A2)基于所述测试任务构造调度指令并将所述调度指令发送到测试工具适配接口,以控制所述测试任务的执行;(A3)所述测试工具适配接口基于所述调度指令执行所述测试任务,并输出执行结果;(A4)根据所述执行结果生成对应于所述测试任务的最终测试结果。Fig. 2 is a flowchart of an automated testing method for integrating heterogeneous testing tools according to an embodiment of the present invention. As shown in Figure 2, the automated testing method disclosed in the present invention includes the following steps: (A1) configuring test tasks according to user input; (A2) constructing scheduling instructions based on the testing tasks and sending the scheduling instructions to the testing tool An adaptation interface to control the execution of the test task; (A3) the test tool adaptation interface executes the test task based on the scheduling instruction, and outputs an execution result; (A4) generates a corresponding The final test result of the test task.

优选地,在本发明所公开的自动化测试方法中,所述配置测试任务包括配置至少一个测试子任务。Preferably, in the automated testing method disclosed in the present invention, configuring the testing task includes configuring at least one testing subtask.

可选地,在本发明所公开的自动化测试方法中,所述配置至少一个测试子任务包括配置所述至少一个测试子任务对应的至少一个测试工具接口模板。Optionally, in the automated testing method disclosed in the present invention, the configuring at least one testing subtask includes configuring at least one testing tool interface template corresponding to the at least one testing subtask.

示例性地,表1示出了所述测试工具接口模板的字段结构。如表1所示,优选地,在本发明所公开的自动化测试方法中,所述测试工具接口模板包括测试工具名称字段、测试用例名称字段、测试用例说明字段、测试用例参数字段和期望结果字段等。Exemplarily, Table 1 shows the field structure of the test tool interface template. As shown in Table 1, preferably, in the automated testing method disclosed in the present invention, the test tool interface template includes a test tool name field, a test case name field, a test case description field, a test case parameter field and an expected result field wait.

示例性地,在本发明所公开的自动化测试方法中,配置所述至少一个测试子任务对应的至少一个测试工具接口模板包括根据所述用户输入装填所述测试工具接口模板中的各个字段。Exemplarily, in the automated testing method disclosed in the present invention, configuring at least one test tool interface template corresponding to the at least one test subtask includes filling each field in the test tool interface template according to the user input.

优选地,在本发明所公开的自动化测试方法中,所述调度指令包括所述测试任务的配置信息。Preferably, in the automated testing method disclosed in the present invention, the scheduling instruction includes configuration information of the testing task.

优选地,在本发明所公开的自动化测试方法中,所述执行结果包括所述至少一个测试子任务中的任何一个的测试结果信息。Preferably, in the automated testing method disclosed in the present invention, the execution result includes test result information of any one of the at least one test subtask.

如图2所示,在本发明所公开的自动化测试方法中,所述步骤(A2)进一步包括:构造所述调度指令并将所述调度指令发送到所述测试工具适配接口,从而以并行或串行方式调度所述至少一个测试子任务的执行As shown in Figure 2, in the automated testing method disclosed in the present invention, the step (A2) further includes: constructing the scheduling instruction and sending the scheduling instruction to the test tool adaptation interface, thereby or serially schedule the execution of the at least one test subtask

如图2所示,在本发明所公开的自动化测试方法中,所述步骤(A4)进一步包括:基于所述执行结果记录所述至少一个测试子任务中的每个的所述测试结果信息,并生成对应于所述测试任务的最终测试结果。As shown in FIG. 2, in the automated testing method disclosed in the present invention, the step (A4) further includes: recording the test result information of each of the at least one test subtask based on the execution result, And generate the final test result corresponding to the test task.

其中,示例性地,在本发明所公开的自动化测试方法中,所述并行方式适用于测试高压力情况下系统的功能可用性,而所述串行方式适用于测试时序约束性的业务流程。Wherein, for example, in the automated testing method disclosed in the present invention, the parallel method is suitable for testing the functional availability of the system under high pressure, and the serial method is suitable for testing the business process with timing constraints.

如图2所示,在本发明所公开的自动化测试方法中,所述步骤(A3)进一步包括:(B1)注册至少一个测试工具,并生成已注册测试工具列表;(B2)基于所述测试任务的配置信息确定所述至少一个测试子任务所对应的至少一个测试工具以及判断所述至少一个测试工具是否已注册,并且如果所述至少一个测试工具中的每个均已注册,则根据预定规则生成对应于所述至少一个测试工具的调用指令,以及如果所述至少一个测试工具中的至少一个未被注册,则返回指示配置错误的信息;(B3)根据所述调用指令调用所述至少一个测试工具,以执行所述至少一个测试子任务,并监测和获取所述至少一个测试工具输出的测试结果信息;(B4)将所述测试结果信息与期望结果相比较(例如,比较特殊关键字),并基于比较结果和/或测试失败信息构造执行结果。As shown in Figure 2, in the automated testing method disclosed in the present invention, the step (A3) further includes: (B1) registering at least one test tool, and generating a list of registered test tools; (B2) based on the test The configuration information of the task determines at least one test tool corresponding to the at least one test subtask and judges whether the at least one test tool is registered, and if each of the at least one test tool is registered, according to the predetermined The rule generates a call instruction corresponding to the at least one test tool, and if at least one of the at least one test tool is not registered, returns information indicating a configuration error; (B3) calling the at least one test tool according to the call instruction A test tool, to execute the at least one test subtask, and monitor and obtain the test result information output by the at least one test tool; (B4) compare the test result information with the expected result (for example, compare specific key word), and constructs an execution result based on the comparison results and/or test failure information.

示例性地,在本发明所公开的自动化测试方法中,所述预定规则是基于Telnet协议、bat临时文件和Windows API中的一个或多个。Exemplarily, in the automated testing method disclosed in the present invention, the predetermined rule is based on one or more of Telnet protocol, bat temporary file and Windows API.

示例性地,在本发明所公开的自动化测试方法中,所述调用指令包括Shell命令、cmd命令和Windows API函数中的一个或多个。Exemplarily, in the automated testing method disclosed in the present invention, the calling instruction includes one or more of a Shell command, a cmd command and a Windows API function.

示例性地,在本发明所公开的自动化测试方法中,通过如下方式中的至少一个方式监测和获取所述至少一个测试工具输出的结果数据:读取Telnet协议返回命令中的输出数据、读取cmd命令的返回数据、读取被调用的Windows API函数的输出数据。Exemplarily, in the automated testing method disclosed in the present invention, the result data output by the at least one test tool is monitored and acquired through at least one of the following methods: reading the output data in the Telnet protocol return command, reading The return data of the cmd command, read the output data of the called Windows API function.

优选地,在本发明所公开的自动化测试方法中,所述步骤(B3)进一步包括:启用分别对应于所述至少一个测试工具中的每个的至少一个计时器,并且如果所述至少一个计时器中的任一个超时,则输出所述测试失败信息,所述测试失败信息指示已超时的计时器所对应的测试工具未能成功执行其所对应的测试子任务。Preferably, in the automated testing method disclosed in the present invention, the step (B3) further includes: enabling at least one timer respectively corresponding to each of the at least one testing tool, and if the at least one timer If any of the timers times out, the test failure information is output, and the test failure information indicates that the test tool corresponding to the timed-out timer failed to successfully execute its corresponding test subtask.

示例性地,在本发明所公开的自动化测试方法中,以如下方式生成对应于所述至少一个测试工具的调用指令:(1)如果使用命令行平台(AIX/UNIX/LINUX等)形式的调用方式,则所述测试工具适配接口3被作为telnet协议客户端,从而连接和登录到远程目标测试主机;(2)如果使用Windows的cmd命令形式的调用方式,则生成可执行的bat临时命令脚本;(3)如果使用Windows API形式的调用方式,则构造参数并通过ShellExecute函数调用测试工具。Exemplarily, in the automated testing method disclosed in the present invention, the call instruction corresponding to the at least one test tool is generated in the following manner: (1) if the call in the form of a command line platform (AIX/UNIX/LINUX, etc.) is used mode, then the test tool adaptation interface 3 is used as a telnet protocol client to connect and log in to the remote target test host; (2) if the calling mode of the cmd command form of Windows is used, an executable bat temporary command is generated Script; (3) If using the calling method of Windows API, construct parameters and call the test tool through the ShellExecute function.

优选地,在本发明所公开的自动化测试方法中,在所述步骤(A3)中使用至少两个测试工具,并且所述至少两个测试工具是异构的。Preferably, in the automated testing method disclosed in the present invention, at least two testing tools are used in the step (A3), and the at least two testing tools are heterogeneous.

示例性地,在本发明所公开的自动化测试方法中,所述至少一个测试工具包括下列项中的一个或多个:HP QTP自动化测试工具(用于功能回归测试,例如,被测系统是Windows系统)、Shell脚本(用于功能测试或测试辅助,例如,被测系统是Unix系统)、Python自动化测试工具(用于功能回归测试,例如,被测系统是web系统)和LoadRunner性能测试工具(用于性能测试)。Exemplarily, in the automated testing method disclosed in the present invention, described at least one testing tool comprises one or more in the following items: HP QTP automated testing tool (for functional regression testing, for example, the system under test is Windows system), Shell script (for functional testing or test assistance, for example, the system under test is a Unix system), Python automated testing tool (for functional regression testing, for example, the system under test is a web system) and LoadRunner performance testing tool ( for performance testing).

尽管本发明是通过上述的优选实施方式进行描述的,但是其实现形式并不局限于上述的实施方式。应该认识到:在不脱离本发明主旨和范围的情况下,本领域技术人员可以对本发明做出不同的变化和修改。Although the present invention has been described through the above-mentioned preferred embodiments, its implementation forms are not limited to the above-mentioned embodiments. It should be appreciated that those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention.

Claims (30)

Translated fromChinese
1.一种自动化测试装置,其中,所述自动化测试装置包括:1. An automated testing device, wherein the automated testing device comprises:测试用例配置模块,所述测试用例配置模块用于根据用户输入而配置测试任务;A test case configuration module, the test case configuration module is used to configure test tasks according to user input;测试控制模块,所述测试控制模块用于基于所述测试任务构造调度指令并将所述调度指令发送到测试工具适配接口,以控制所述测试任务的执行,并生成对应于所述测试任务的最终测试结果;A test control module, the test control module is configured to construct a scheduling instruction based on the test task and send the scheduling instruction to the test tool adaptation interface, so as to control the execution of the test task, and generate a The final test results;测试工具适配接口,所述测试工具适配接口用于基于所述调度指令执行所述测试任务,并将执行结果传送回所述测试控制模块。A test tool adaptation interface, the test tool adaptation interface is used to execute the test task based on the scheduling instruction, and transmit the execution result back to the test control module.2.根据权利要求1所述的自动化测试装置,其特征在于,所述配置测试任务包括配置至少一个测试子任务。2. The automated testing device according to claim 1, wherein said configuring the testing task comprises configuring at least one testing subtask.3.根据权利要求2所述的自动化测试装置,其特征在于,所述配置至少一个测试子任务包括在所述自动化测试装置中配置所述至少一个测试子任务对应的至少一个测试工具接口模板。3. The automated testing device according to claim 2, wherein the configuring at least one testing subtask comprises configuring at least one testing tool interface template corresponding to the at least one testing subtask in the automated testing device.4.根据权利要求2所述的自动化测试装置,其特征在于,所述配置至少一个测试子任务包括在测试任务配置服务器上配置所述至少一个测试子任务对应的至少一个测试工具接口模板,并在所述自动化测试装置中配置与所述至少一个测试工具接口模板相关联的测试工具接口模板标识号。4. The automated testing device according to claim 2, wherein the configuration of at least one test subtask comprises configuring at least one test tool interface template corresponding to the at least one test subtask on the test task configuration server, and A test tool interface template identification number associated with the at least one test tool interface template is configured in the automated test device.5.根据权利要求3所述的自动化测试装置,其特征在于,所述测试工具接口模板包括测试工具名称字段、测试用例名称字段、测试用例说明字段、测试用例参数字段和期望结果字段。5. The automated testing device according to claim 3, wherein the test tool interface template includes a test tool name field, a test case name field, a test case description field, a test case parameter field and an expected result field.6.根据权利要求5所述的自动化测试装置,其特征在于,其中配置所述至少一个测试子任务对应的至少一个测试工具接口模板包括根据所述用户输入装填所述测试工具接口模板中的各个字段。6. The automated testing device according to claim 5, wherein configuring at least one test tool interface template corresponding to the at least one test subtask comprises filling each of the test tool interface templates according to the user input. field.7.根据权利要求6所述的自动化测试装置,其特征在于,所述调度指令包括所述测试任务的配置信息。7. The automated testing device according to claim 6, wherein the scheduling instruction includes configuration information of the testing task.8.根据权利要求7所述的自动化测试装置,其特征在于,所述执行结果包括所述至少一个测试子任务中的任何一个的测试结果信息。8. The automated testing device according to claim 7, wherein the execution result comprises test result information of any one of the at least one test subtask.9.根据权利要求8所述的自动化测试装置,其特征在于,所述测试控制模块进一步包括:9. The automated testing device according to claim 8, wherein the test control module further comprises:调度单元,所述调度单元用于构造所述调度指令并将所述调度指令发送到所述测试工具适配接口,从而以并行或串行方式调度所述至少一个测试子任务的执行;a scheduling unit, configured to construct the scheduling instruction and send the scheduling instruction to the test tool adaptation interface, so as to schedule the execution of the at least one test subtask in a parallel or serial manner;测试结果生成单元,所述测试结果生成单元用于基于所述执行结果记录所述至少一个测试子任务中的每个的所述测试结果信息,并生成对应于所述测试任务的最终测试结果。A test result generation unit configured to record the test result information of each of the at least one test subtask based on the execution result, and generate a final test result corresponding to the test task.10.根据权利要求9所述的自动化测试装置,其特征在于,所述测试工具适配接口3进一步包括:10. The automated testing device according to claim 9, wherein the test tool adapter interface 3 further comprises:测试工具注册单元,所述测试工具注册单元用于注册至少一个测试工具,并生成已注册测试工具列表;A test tool registration unit, the test tool registration unit is used to register at least one test tool and generate a list of registered test tools;初始化单元,所述初始化单元用于基于所述测试任务的配置信息确定所述至少一个测试子任务所对应的至少一个测试工具以及判断所述至少一个测试工具是否已注册,并且如果所述至少一个测试工具中的每个均已注册,则根据预定规则生成对应于所述至少一个测试工具的调用指令,并将所述调用指令传送到测试执行单元,以及如果所述至少一个测试工具中的至少一个未被注册,则向所述调度单元返回指示配置错误的信息;An initialization unit, configured to determine at least one test tool corresponding to the at least one test subtask based on the configuration information of the test task and determine whether the at least one test tool has been registered, and if the at least one Each of the test tools has been registered, then generate a call instruction corresponding to the at least one test tool according to a predetermined rule, and transmit the call instruction to the test execution unit, and if at least one of the at least one test tool If one is not registered, return information indicating a configuration error to the scheduling unit;测试执行单元,所述测试执行单元用于根据所述调用指令调用所述至少一个测试工具,以执行所述至少一个测试子任务,并监测和获取所述至少一个测试工具输出的测试结果信息,以及将所述测试结果信息传送到结果收集单元;a test execution unit, the test execution unit is configured to call the at least one test tool according to the call instruction to execute the at least one test subtask, and monitor and acquire test result information output by the at least one test tool, and transmitting the test result information to the result collection unit;结果收集单元,所述结果收集单元将所述测试结果信息与期望结果相比较,并基于比较结果和/或测试失败信息构造执行结果,并将所述执行结果传送到所述测试控制模块。A result collection unit that compares the test result information with an expected result, constructs an execution result based on the comparison result and/or the test failure information, and transmits the execution result to the test control module.11.根据权利要求10所述的自动化测试装置,其特征在于,所述预定规则是基于Telnet协议、bat临时文件和Windows API中的一个或多个。11. automated testing device according to claim 10, is characterized in that, described predetermined rule is based on one or more in Telnet protocol, bat temporary file and Windows API.12.根据权利要求11所述的自动化测试装置,其特征在于,所述调用指令包括Shell命令、cmd命令和Windows API函数中的一个或多个。12. The automated testing device according to claim 11, wherein the calling instruction comprises one or more of a Shell command, a cmd command and a Windows API function.13.根据权利要求12所述的自动化测试装置,其特征在于,所述测试执行单元通过如下方式中的至少一个方式监测和获取所述至少一个测试工具输出的结果数据:读取Telnet协议返回命令中的输出数据、读取cmd命令的返回数据、读取被调用的Windows API函数的输出数据。13. The automated testing device according to claim 12, wherein the test execution unit monitors and obtains the result data of the at least one test tool output by at least one of the following modes: reading the Telnet protocol return command Output data in, read the return data of the cmd command, and read the output data of the called Windows API function.14.根据权利要求13所述的自动化测试装置,其特征在于,所述测试执行单元进一步包括分别对应于所述至少一个测试工具中的每个的至少一个计时器,并且如果所述至少一个计时器中的任一个超时,则所述测试执行单元向所述结果收集单元发送测试失败信息,所述测试失败信息指示已超时的计时器所对应的测试工具未能成功执行其所对应的测试子任务。14. The automated testing device according to claim 13, wherein the test execution unit further comprises at least one timer respectively corresponding to each of the at least one test tool, and if the at least one timer If any one of the timers times out, the test execution unit sends test failure information to the result collection unit, and the test failure information indicates that the test tool corresponding to the timer that has timed out failed to successfully execute its corresponding test subclass. Task.15.根据权利要求14所述的自动化测试装置,其特征在于,所述自动化测试装置使用至少两个测试工具,并且所述至少两个测试工具是异构的。15. The automated testing device according to claim 14, wherein the automated testing device uses at least two test tools, and the at least two test tools are heterogeneous.16.一种自动化测试方法,其中,所述自动化测试方法包括如下步骤:16. An automated testing method, wherein the automated testing method comprises the steps of:(A1)根据用户输入而配置测试任务;(A1) configuring test tasks according to user input;(A2)基于所述测试任务构造调度指令并将所述调度指令发送到测试工具适配接口,以控制所述测试任务的执行;(A2) Constructing a scheduling instruction based on the test task and sending the scheduling instruction to the test tool adaptation interface to control the execution of the test task;(A3)所述测试工具适配接口基于所述调度指令执行所述测试任务,并输出执行结果;(A3) The test tool adaptation interface executes the test task based on the scheduling instruction, and outputs an execution result;(A4)根据所述执行结果生成对应于所述测试任务的最终测试结果。(A4) Generate a final test result corresponding to the test task according to the execution result.17.根据权利要求16所述的自动化测试方法,其特征在于,所述配置测试任务包括配置至少一个测试子任务。17. The automated testing method according to claim 16, wherein said configuring the testing task comprises configuring at least one testing subtask.18.根据权利要求17所述的自动化测试方法,其特征在于,所述配置至少一个测试子任务包括配置所述至少一个测试子任务对应的至少一个测试工具接口模板。18. The automated testing method according to claim 17, wherein the configuring at least one testing subtask comprises configuring at least one testing tool interface template corresponding to the at least one testing subtask.19.根据权利要求18所述的自动化测试方法,其特征在于,所述测试工具接口模板包括测试工具名称字段、测试用例名称字段、测试用例说明字段、测试用例参数字段和期望结果字段。19. The automated testing method according to claim 18, wherein the test tool interface template includes a test tool name field, a test case name field, a test case description field, a test case parameter field and an expected result field.20.根据权利要求19所述的自动化测试方法,其特征在于,配置所述至少一个测试子任务对应的至少一个测试工具接口模板包括根据所述用户输入装填所述测试工具接口模板中的各个字段。20. The automated testing method according to claim 19, wherein configuring at least one test tool interface template corresponding to the at least one test subtask comprises filling each field in the test tool interface template according to the user input .21.根据权利要求20所述的自动化测试方法,其特征在于,所述调度指令包括所述测试任务的配置信息。21. The automated testing method according to claim 20, wherein the scheduling instruction includes configuration information of the testing task.22.根据权利要求21所述的自动化测试方法,其特征在于,所述执行结果包括所述至少一个测试子任务中的任何一个的测试结果信息。22. The automated testing method according to claim 21, wherein the execution result comprises test result information of any one of the at least one test subtask.23.根据权利要求22所述的自动化测试方法,其特征在于,所述步骤(A2)进一步包括:构造所述调度指令并将所述调度指令发送到所述测试工具适配接口,从而以并行或串行方式调度所述至少一个测试子任务的执行23. The automated testing method according to claim 22, wherein the step (A2) further comprises: constructing the scheduling instruction and sending the scheduling instruction to the test tool adaptation interface, so that or serially schedule the execution of the at least one test subtask24.根据权利要求23所述的自动化测试方法,其特征在于,所述步骤(A4)进一步包括:基于所述执行结果记录所述至少一个测试子任务中的每个的所述测试结果信息,并生成对应于所述测试任务的最终测试结果。24. The automated testing method according to claim 23, wherein the step (A4) further comprises: recording the test result information of each of the at least one test subtask based on the execution result, And generate the final test result corresponding to the test task.25.根据权利要求24所述的自动化测试方法,其特征在于,所述步骤(A3)进一步包括:25. The automated testing method according to claim 24, wherein said step (A3) further comprises:(B1)注册至少一个测试工具,并生成已注册测试工具列表;(B1) register at least one test tool, and generate a list of registered test tools;(B2)基于所述测试任务的配置信息确定所述至少一个测试子任务所对应的至少一个测试工具以及判断所述至少一个测试工具是否已注册,并且如果所述至少一个测试工具中的每个均已注册,则根据预定规则生成对应于所述至少一个测试工具的调用指令,以及如果所述至少一个测试工具中的至少一个未被注册,则返回指示配置错误的信息;(B2) Determine at least one test tool corresponding to the at least one test subtask based on the configuration information of the test task and determine whether the at least one test tool has been registered, and if each of the at least one test tool have been registered, then generate a call instruction corresponding to the at least one test tool according to a predetermined rule, and if at least one of the at least one test tool is not registered, return information indicating a configuration error;(B3)根据所述调用指令调用所述至少一个测试工具,以执行所述至少一个测试子任务,并监测和获取所述至少一个测试工具输出的测试结果信息;(B3) calling the at least one test tool according to the call instruction to execute the at least one test subtask, and monitor and acquire test result information output by the at least one test tool;(B4)将所述测试结果信息与期望结果相比较,并基于比较结果和/或测试失败信息构造执行结果。(B4) Comparing the test result information with an expected result, and constructing an execution result based on the comparison result and/or the test failure information.26.根据权利要求25所述的自动化测试方法,其特征在于,所述预定规则是基于Telnet协议、bat临时文件和Windows API中的一个或多个。26. The automated testing method according to claim 25, wherein the predetermined rule is based on one or more of Telnet protocol, bat temporary file and Windows API.27.根据权利要求26所述的自动化测试方法,其特征在于,所述调用指令包括Shell命令、cmd命令和Windows API函数中的一个或多个。27. The automated testing method according to claim 26, wherein the calling instruction comprises one or more of a Shell command, a cmd command and a Windows API function.28.根据权利要求27所述的自动化测试方法,其特征在于,其中通过如下方式中的至少一个方式监测和获取所述至少一个测试工具输出的结果数据:读取Telnet协议返回命令中的输出数据、读取cmd命令的返回数据、读取被调用的Windows API函数的输出数据。28. The automated testing method according to claim 27, wherein the result data output by the at least one test tool is monitored and obtained by at least one of the following methods: reading the output data in the Telnet protocol return command , Read the return data of the cmd command, and read the output data of the called Windows API function.29.根据权利要求28所述的自动化测试方法,其特征在于,所述步骤(B3)进一步包括:启用分别对应于所述至少一个测试工具中的每个的至少一个计时器,并且如果所述至少一个计时器中的任一个超时,则输出所述测试失败信息,所述测试失败信息指示已超时的计时器所对应的测试工具未能成功执行其所对应的测试子任务。29. The automated testing method according to claim 28, wherein said step (B3) further comprises: enabling at least one timer respectively corresponding to each of said at least one testing tool, and if said When any one of the at least one timer times out, the test failure information is output, and the test failure information indicates that the test tool corresponding to the timer that has timed out failed to successfully execute its corresponding test subtask.30.根据权利要求29所述的自动化测试方法,其特征在于,在所述步骤(A3)中使用至少两个测试工具,并且所述至少两个测试工具是异构的。30. The automated testing method according to claim 29, characterized in that at least two testing tools are used in the step (A3), and the at least two testing tools are heterogeneous.
CN201110234792.5A2011-08-162011-08-16The automatic test device of integrated isomery testing tool and methodActiveCN102937932B (en)

Priority Applications (1)

Application NumberPriority DateFiling DateTitle
CN201110234792.5ACN102937932B (en)2011-08-162011-08-16The automatic test device of integrated isomery testing tool and method

Applications Claiming Priority (1)

Application NumberPriority DateFiling DateTitle
CN201110234792.5ACN102937932B (en)2011-08-162011-08-16The automatic test device of integrated isomery testing tool and method

Publications (2)

Publication NumberPublication Date
CN102937932Atrue CN102937932A (en)2013-02-20
CN102937932B CN102937932B (en)2015-08-19

Family

ID=47696831

Family Applications (1)

Application NumberTitlePriority DateFiling Date
CN201110234792.5AActiveCN102937932B (en)2011-08-162011-08-16The automatic test device of integrated isomery testing tool and method

Country Status (1)

CountryLink
CN (1)CN102937932B (en)

Cited By (22)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN103684919A (en)*2013-12-182014-03-26南京理工大学连云港研究院Ubiquitous network performance monitoring system
CN104317713A (en)*2014-10-272015-01-28北京锐安科技有限公司Automatic testing tool and method on basis of templates
CN104679658A (en)*2015-03-172015-06-03百度在线网络技术(北京)有限公司Test method and test system for WEB pages
CN104850495A (en)*2015-05-142015-08-19曙光信息产业(北京)有限公司Automatic detection method and device
CN104850491A (en)*2014-02-192015-08-19深圳中兴网信科技有限公司Software test method, equipment and system
CN105243015A (en)*2015-09-252016-01-13惠州Tcl移动通信有限公司Automated software test method and system
CN105374131A (en)*2015-10-282016-03-02深圳怡化电脑股份有限公司Method and device for automatic testing
CN105405221A (en)*2015-10-282016-03-16深圳怡化电脑股份有限公司Method and device for automated test
CN105405220A (en)*2015-10-282016-03-16深圳怡化电脑股份有限公司Method and device for automated test
CN105468519A (en)*2015-11-172016-04-06中国建设银行股份有限公司Performance-testing tool control method and device
CN105679375A (en)*2015-12-312016-06-15浪潮(北京)电子信息产业有限公司Automatic test system of storage equipment, and method thereof
CN105808437A (en)*2016-03-092016-07-27广州彩瞳网络技术有限公司Automation testing method and system based on test case data table
CN106775979A (en)*2016-12-132017-05-31郑州云海信息技术有限公司Scheduler call method and system
CN107729237A (en)*2017-10-092018-02-23郑州云海信息技术有限公司A kind of method, apparatus of software performance test, computer installation and storage medium
CN107967158A (en)*2016-10-142018-04-27希捷科技有限公司Active drive api
CN107992418A (en)*2017-12-052018-05-04郑州云海信息技术有限公司A kind of method and system for improving software test stability
CN108809755A (en)*2018-05-182018-11-13烽火通信科技股份有限公司The home gateway automatic test approach and system of compatible command row and WEB interface
CN112597043A (en)*2020-12-282021-04-02深圳供电局有限公司Software testing method and device, computer equipment and storage medium
CN114416458A (en)*2022-03-302022-04-29航天中认软件测评科技(北京)有限责任公司 Test method, device, equipment and storage medium
CN115080403A (en)*2022-06-222022-09-20京东科技信息技术有限公司 Templated use case testing system, method, medium and device
CN115623077A (en)*2022-10-182023-01-17开元华创科技(集团)有限公司Autonomous controllable test system
CN120086148A (en)*2025-04-302025-06-03湖南泛联新安信息科技有限公司 Implementation method and system for adapting existing fuzz testing engine to parallel architecture

Citations (3)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN101082876A (en)*2006-05-302007-12-05四川华智信息技术有限公司Software automatically evaluating tool bag
CN101145993A (en)*2007-10-112008-03-19中兴通讯股份有限公司A multi-point access interface test method and its test system
CN101212362A (en)*2006-12-262008-07-02中兴通讯股份有限公司Automatic testing device and method incorporating a variety of testing tools

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN101082876A (en)*2006-05-302007-12-05四川华智信息技术有限公司Software automatically evaluating tool bag
CN101212362A (en)*2006-12-262008-07-02中兴通讯股份有限公司Automatic testing device and method incorporating a variety of testing tools
CN101145993A (en)*2007-10-112008-03-19中兴通讯股份有限公司A multi-point access interface test method and its test system

Cited By (29)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN103684919A (en)*2013-12-182014-03-26南京理工大学连云港研究院Ubiquitous network performance monitoring system
CN104850491A (en)*2014-02-192015-08-19深圳中兴网信科技有限公司Software test method, equipment and system
CN104317713A (en)*2014-10-272015-01-28北京锐安科技有限公司Automatic testing tool and method on basis of templates
CN104679658B (en)*2015-03-172018-11-13百度在线网络技术(北京)有限公司The test method and system of WEB page
CN104679658A (en)*2015-03-172015-06-03百度在线网络技术(北京)有限公司Test method and test system for WEB pages
CN104850495A (en)*2015-05-142015-08-19曙光信息产业(北京)有限公司Automatic detection method and device
CN105243015A (en)*2015-09-252016-01-13惠州Tcl移动通信有限公司Automated software test method and system
CN105374131A (en)*2015-10-282016-03-02深圳怡化电脑股份有限公司Method and device for automatic testing
CN105405220A (en)*2015-10-282016-03-16深圳怡化电脑股份有限公司Method and device for automated test
CN105405221A (en)*2015-10-282016-03-16深圳怡化电脑股份有限公司Method and device for automated test
CN105468519A (en)*2015-11-172016-04-06中国建设银行股份有限公司Performance-testing tool control method and device
CN105679375A (en)*2015-12-312016-06-15浪潮(北京)电子信息产业有限公司Automatic test system of storage equipment, and method thereof
CN105808437A (en)*2016-03-092016-07-27广州彩瞳网络技术有限公司Automation testing method and system based on test case data table
CN105808437B (en)*2016-03-092020-05-12广州优视网络科技有限公司Automatic test method and system based on test case data sheet
CN107967158A (en)*2016-10-142018-04-27希捷科技有限公司Active drive api
CN107967158B (en)*2016-10-142020-12-25希捷科技有限公司Active drive API
US11119797B2 (en)2016-10-142021-09-14Seagate Technology LlcActive drive API
US10936350B2 (en)2016-10-142021-03-02Seagate Technology LlcActive drive API
CN106775979A (en)*2016-12-132017-05-31郑州云海信息技术有限公司Scheduler call method and system
CN107729237A (en)*2017-10-092018-02-23郑州云海信息技术有限公司A kind of method, apparatus of software performance test, computer installation and storage medium
CN107992418A (en)*2017-12-052018-05-04郑州云海信息技术有限公司A kind of method and system for improving software test stability
CN108809755B (en)*2018-05-182020-10-30烽火通信科技股份有限公司Automatic testing method and system for home gateway compatible with command line and WEB interface
CN108809755A (en)*2018-05-182018-11-13烽火通信科技股份有限公司The home gateway automatic test approach and system of compatible command row and WEB interface
CN112597043A (en)*2020-12-282021-04-02深圳供电局有限公司Software testing method and device, computer equipment and storage medium
CN114416458A (en)*2022-03-302022-04-29航天中认软件测评科技(北京)有限责任公司 Test method, device, equipment and storage medium
CN115080403A (en)*2022-06-222022-09-20京东科技信息技术有限公司 Templated use case testing system, method, medium and device
CN115623077A (en)*2022-10-182023-01-17开元华创科技(集团)有限公司Autonomous controllable test system
CN115623077B (en)*2022-10-182023-08-18开元华创科技(集团)有限公司Autonomous controllable test system
CN120086148A (en)*2025-04-302025-06-03湖南泛联新安信息科技有限公司 Implementation method and system for adapting existing fuzz testing engine to parallel architecture

Also Published As

Publication numberPublication date
CN102937932B (en)2015-08-19

Similar Documents

PublicationPublication DateTitle
CN102937932B (en)The automatic test device of integrated isomery testing tool and method
WO2019085079A1 (en)Interface test method and apparatus, computer device and storage medium
WO2019085073A1 (en)Interface test method and apparatus, computer device, and storage medium
CN105786495B (en)Software delivery system and method, software development delivery system
US20110035724A1 (en)Software application recreation
CN102035896B (en)TTCN-3-based distributed testing framework applicable to software system
CN105446933B (en)debugging system and debugging method of multi-core processor
CN105868149B (en)Serial port information transmission method and device
CN103336705A (en)Automatic transcoding and semantic adaptation between scripting and workflow systems
CN115454869B (en)Interface automation test method, device, equipment and storage medium
CN102799519A (en)Automatic test method for cluster file system
TWI598819B (en)Computer system and method for testing hardware device based on virtual machine
CN103530225A (en)Automatic compilation testing method and automatic compilation testing platform for realizing same
CN109032867A (en)A kind of method for diagnosing faults, device and equipment
CN103488513B (en)Equipment plug and play general drive method
US7657789B1 (en)Multi-machine testing system and method for testing software
CN111948526A (en)Test and measurement system for parallel waveform analysis
US8099628B2 (en)Software problem identification tool
TWI393003B (en)Remote hardware inspection system and method
CN107544830A (en)A kind of method and device of automatic installation database
CN113741948A (en)Code branch management method, device, equipment and storage medium
CN109783295A (en)Test macro self-test method for producing software and device based on configuration
CN117194135A (en)Verification method, system and computer equipment of universal asynchronous receiving and transmitting device
CN114019230B (en)Intelligent electric energy meter design method and system
CN110543415A (en) A computer software technology development and debugging system

Legal Events

DateCodeTitleDescription
C06Publication
PB01Publication
C10Entry into substantive examination
SE01Entry into force of request for substantive examination
C14Grant of patent or utility model
GR01Patent grant

[8]ページ先頭

©2009-2025 Movatter.jp