





技术领域technical field
本发明涉及服务器技术领域,尤其涉及服务器虚拟化技术领域,具体涉及一种测试方法、系统、存储介质及设备。The present invention relates to the technical field of servers, in particular to the technical field of server virtualization, and in particular to a testing method, system, storage medium and equipment.
背景技术Background technique
服务器虚拟化技术是一种“软件定义”技术,通过软件定义虚构出各种硬件,从而实现在一个硬件平台中同时独立的虚拟若干主机(云服务器)。云服务器使用独立的CPU、硬盘、内存、I/O、网卡等硬件设备。同时虚拟机上可以安装不同的操作系统,用来满足不同用户的不同需求。Server virtualization technology is a "software-defined" technology that virtualizes various hardware through software definition, so as to realize simultaneous and independent virtualization of several hosts (cloud servers) on a hardware platform. The cloud server uses independent hardware devices such as CPU, hard disk, memory, I/O, and network card. At the same time, different operating systems can be installed on the virtual machine to meet different needs of different users.
为了满足各种需求,自动化的用例测试是一种大的趋势。通过编写自动化测试用例并持续的运行,能够很好的替代之前项目中的测试所需的人力,并且良好的测试用例同时能规避人工测试引入的不确定因素(如人为失误)等,从而能稳定的保障相关的项目/产品的交付质量。现有的自动化用例管理框架比较多,如cucumber,TestNG等,但是都是比较通用的自动化测试用例管理框架,距离真正的在业务上的实践应用尚有一定的距离。In order to meet various needs, automated use case testing is a big trend. By writing automated test cases and running them continuously, it can well replace the manpower required for testing in previous projects, and good test cases can also avoid uncertain factors (such as human error) introduced by manual testing, etc., so as to be stable Guarantee the delivery quality of related projects/products. There are many existing automated test case management frameworks, such as cucumber, TestNG, etc., but they are all relatively general automated test case management frameworks, and there is still a certain distance from the real practical application in business.
然而,在实际的用例运行中,现有的用例测试的方法中仍然存在着一些不足和缺陷例如以下几个方面:However, in the actual use case operation, there are still some deficiencies and defects in the existing use case testing methods, such as the following aspects:
1、测试用例管理方面,自定义监听器方法主要集中在测试结果收集和测试结果展示,缺少详尽失败类和失败用例的处理;1. In terms of test case management, the custom listener method mainly focuses on test result collection and test result display, lacking detailed failure classes and handling of failure cases;
2、一些测试框架对用例失败时的测试环境无法动态保存和复现恢复以及运行时上下文日志;2. Some test frameworks cannot dynamically save, reproduce and restore the test environment and run-time context logs when the use case fails;
3、测试用例存在依赖关系,在被依赖用例失败后往往跳过后续用例的执行;3. There is a dependency relationship between test cases, and the execution of subsequent use cases is often skipped after the dependent use case fails;
4、测试类存在资源失败,运行环境影响后续测试用例结果;4. There are resource failures in the test class, and the running environment affects the results of subsequent test cases;
5、测试用例失败定位无用例运行时状态,无法复现代码运行时步骤。5. The test case fails to locate the runtime state of no use case, and the code runtime steps cannot be reproduced.
因此,针对现有技术中的上述缺点、问题,需要提出一种改进的用例测试方法,从而优化基于云平台的测试,进一步提高测试过程的智能程度、完善测试机制、增强并改善用例的测试效率。Therefore, in view of the above-mentioned shortcomings and problems in the prior art, it is necessary to propose an improved use case testing method, thereby optimizing the test based on the cloud platform, further improving the intelligence of the testing process, improving the testing mechanism, enhancing and improving the test efficiency of the use case .
发明内容Contents of the invention
有鉴于此,本发明的目的在于提出一种改进的基于云平台的用例测试方法、系统、存储介质及设备,从而解决现有技术中存在的前述不足和缺陷带来的一系列问题。In view of this, the object of the present invention is to propose an improved cloud platform-based use case testing method, system, storage medium and equipment, thereby solving a series of problems caused by the aforementioned deficiencies and defects in the prior art.
基于上述目的,一方面,本发明提供了一种测试方法,用于基于云平台的用例测试,其中该方法包括以下步骤:Based on the above purpose, on the one hand, the present invention provides a test method for use case testing based on cloud platform, wherein the method comprises the following steps:
通过配置的监听器对测试类解析执行前测试环境要求、获取测试后环境参数并将运行过程中的测试类环境标签及测试结果发送给调度装置;Analyze the pre-execution test environment requirements for the test class through the configured listener, obtain the post-test environment parameters, and send the test class environment label and test results during the running process to the scheduling device;
利用用例管理装置对用例进行测试前实现,并通过注解定义测试用例之间的执行顺序和依赖关系以及定义测试类环境标签;Use the use case management device to implement the use cases before testing, and define the execution sequence and dependencies between test cases and define the test class environment labels through annotations;
利用所述调度装置基于所述环境标签分配测试环境并从测试装置中锁定相应的执行测试环境,进而执行用例测试;Using the scheduling device to allocate a test environment based on the environment label and lock the corresponding execution test environment from the test device, and then execute the use case test;
利用所述调度装置根据所述监听器获得的测试用例执行状态对测试结果进行解析以决策后续的执行并通知日志装置收集测试环境信息以创建运行日志;Utilize the scheduling device to analyze the test result according to the test case execution state obtained by the listener to decide the subsequent execution and notify the log device to collect test environment information to create a running log;
通过所述测试装置对已用测试环境进行标签管理并对测试用例失败的环境实时快照、备份,以保存测试现场。Label management is performed on the used test environment through the test device, and real-time snapshots and backups are taken of the environment where the test case fails, so as to save the test site.
在根据本发明的基于云平台的用例测试方法的一些实施例中,该通过配置的监听器对测试类解析执行前测试环境要求、获取测试后环境参数并将运行过程中的测试类环境标签及测试结果发送给调度装置进一步包括:In some embodiments of the cloud platform-based use case testing method according to the present invention, the configured listener analyzes the test environment requirements before the test class is executed, obtains the post-test environment parameters, and uses the test class environment tags and Sending the test result to the scheduling device further includes:
所述监听器配置为ITestListener监听模式及IMethodInterceptor监听模式,其中所述ITestListener监听模式在测试类开始执行前解析测试环境要求,获取测试环境后进行环境检测,执行结束后发送结果给调度装置,并且所述IMethodInterceptor监听模式将每个测试用例方案结果通知调度装置并定义失败用例的后续操作。The listener is configured as an ITestListener listening mode and an IMethodInterceptor listening mode, wherein the ITestListener listening mode parses the test environment requirements before the test class starts to execute, performs environment detection after obtaining the test environment, and sends the result to the scheduling device after execution, and the The IMethodInterceptor listening mode notifies the scheduler of the scenario results for each test case and defines the follow-up actions for failed cases.
在根据本发明的基于云平台的用例测试方法的一些实施例中,所述利用所述调度装置根据所述监听器获得的测试用例执行状态对测试结果进行解析以决策后续的执行并通知日志装置收集测试环境信息以创建运行日志进一步包括:In some embodiments of the use case testing method based on the cloud platform according to the present invention, the use of the scheduling device to analyze the test results according to the test case execution status obtained by the listener to determine the subsequent execution and notify the log device Collecting test environment information to create run logs further includes:
所述调度装置获取所述监听器返回的测试类结果并解析,得出环境处理方式,决策通过软件开发工具包SDK对相应的测试环境进行销毁、保存或者继续使用。The dispatching device obtains and analyzes the test result returned by the listener, obtains an environment processing method, and decides to destroy, save or continue to use the corresponding test environment through the software development kit SDK.
在根据本发明的基于云平台的用例测试方法的一些实施例中,所述利用所述调度装置根据所述监听器获得的测试用例执行状态对测试结果进行解析以决策后续的执行并通知日志装置收集测试环境信息以创建运行日志进一步包括:In some embodiments of the use case testing method based on the cloud platform according to the present invention, the use of the scheduling device to analyze the test results according to the test case execution status obtained by the listener to determine the subsequent execution and notify the log device Collecting test environment information to create run logs further includes:
所述调度装置获取所述监听器测试用例执行结果并解析,判断失败用例依赖关系以及用例对环境影响,决策对失败用例执行的后续操作。The dispatching device obtains and analyzes the execution results of the listener test cases, judges the dependencies of the failed use cases and the influence of the use cases on the environment, and decides the follow-up operations for the failed use cases.
在根据本发明的基于云平台的用例测试方法的一些实施例中,所述利用所述调度装置根据所述监听器获得的测试用例执行状态对测试结果进行解析以决策后续的执行并通知日志装置收集测试环境信息以创建运行日志进一步包括:In some embodiments of the use case testing method based on the cloud platform according to the present invention, the use of the scheduling device to analyze the test results according to the test case execution status obtained by the listener to determine the subsequent execution and notify the log device Collecting test environment information to create run logs further includes:
响应于测试用例失败,所述调度装置通知所述日志装置收集测试环境信息,通过软件开发工具包SDK定位并获取环境需要的所有日志信息以创建运行日志。In response to a failure of a test case, the scheduling device notifies the log device to collect test environment information, and locates and obtains all log information required by the environment through a software development kit SDK to create a running log.
在根据本发明的基于云平台的用例测试方法的一些实施例中,所述利用用例管理装置对用例进行测试前实现,并通过注解定义测试用例之间的执行顺序和依赖关系以及定义测试类环境标签进一步包括:In some embodiments of the use case testing method based on the cloud platform according to the present invention, the use case management device is used to implement the use case before testing, and the execution sequence and dependency between the test cases are defined through annotations and the test class environment is defined Labels further include:
利用所述用例管理装置对用例进行编码实现并调试;Use the use case management device to implement and debug the use case;
通过TestNG配置文件配置运行粒度以及线程数量。Configure the running granularity and number of threads through the TestNG configuration file.
在根据本发明的基于云平台的用例测试方法的一些实施例中,所述利用用例管理装置对用例进行测试前实现,并通过注解定义测试用例之间的执行顺序和依赖关系以及定义测试类环境标签进一步包括:In some embodiments of the use case testing method based on the cloud platform according to the present invention, the use case management device is used to implement the use case before testing, and the execution sequence and dependency between the test cases are defined through annotations and the test class environment is defined Labels further include:
通过TestNG注解定义测试类环境标签,所述测试类环境标签包括环境的功能标签、规模标签以及其他标签。The test class environment tags are defined through TestNG annotations, and the test class environment tags include environment function tags, scale tags and other tags.
在根据本发明的基于云平台的用例测试方法的一些实施例中,所述利用所述调度装置根据所述监听器获得的测试用例执行状态对测试结果进行解析以决策后续的执行并通知日志装置收集测试环境信息以创建运行日志进一步包括:In some embodiments of the use case testing method based on the cloud platform according to the present invention, the use of the scheduling device to analyze the test results according to the test case execution status obtained by the listener to determine the subsequent execution and notify the log device Collecting test environment information to create run logs further includes:
所述日志装置通过软件开发工具包SDK获取测试环境的运行日志,保存所述运行日志并反馈给所述监听器。The log device obtains the operation log of the test environment through the software development kit SDK, saves the operation log and feeds it back to the listener.
在根据本发明的基于云平台的用例测试方法的一些实施例中,所述利用所述调度装置根据所述监听器获得的测试用例执行状态对测试结果进行解析以决策后续的执行并通知日志装置收集测试环境信息以创建运行日志进一步包括:In some embodiments of the use case testing method based on the cloud platform according to the present invention, the use of the scheduling device to analyze the test results according to the test case execution status obtained by the listener to determine the subsequent execution and notify the log device Collecting test environment information to create run logs further includes:
所述监听器获取所述运行日志并进行转存和通知。The listener obtains the running log and performs dumping and notification.
本发明的另一方面,还提供了一种基于云平台的用例测试系统,其中包括:Another aspect of the present invention also provides a cloud platform-based use case testing system, including:
测试监听模块,所述测试监听模块配置为通过配置的监听器对测试类解析执行前测试环境要求、获取测试后环境参数并将运行过程中的测试类环境标签及测试结果发送给调度装置;A test monitoring module, the test monitoring module is configured to analyze the test environment requirements before the execution of the test class through the configured listener, obtain the environment parameters after the test and send the test class environment label and test results during the operation to the scheduling device;
用例管理模块,所述用例管理模块配置为利用用例管理装置对用例进行测试前实现,并通过注解定义测试用例之间的执行顺序和依赖关系以及定义测试类环境标签;Use case management module, the use case management module is configured to utilize the use case management device to implement the use case before testing, and define the execution sequence and dependency relationship between the test cases and define the test class environment label through annotations;
执行测试模块,所述执行测试模块配置为利用所述调度装置基于所述环境标签分配测试环境并从测试装置中锁定相应的执行测试环境,进而执行用例测试;An execution test module configured to use the scheduling device to allocate a test environment based on the environment label and lock the corresponding execution test environment from the test device, and then execute the use case test;
智能调度模块,所述智能调度模块配置为利用所述调度装置根据所述监听器获得的测试用例执行状态对测试结果进行解析以决策后续的执行并通知日志装置收集测试环境信息以创建运行日志;An intelligent scheduling module, the intelligent scheduling module is configured to use the scheduling device to analyze the test results according to the execution state of the test case obtained by the listener to determine subsequent execution and notify the log device to collect test environment information to create a running log;
现场保存模块,所述现场保存模块配置为通过所述测试装置对已用测试环境进行标签管理并对测试用例失败的环境实时快照、备份,以保存测试现场。A scene saving module, the scene saving module is configured to carry out tag management on the used test environment through the test device and take a real-time snapshot and backup of the environment where the test case fails, so as to save the test site.
在根据本发明的基于云平台的用例测试系统的一些实施例中,所述测试监听模块进一步配置为:In some embodiments of the use case testing system based on cloud platform according to the present invention, the test monitoring module is further configured as:
所述监听器配置为ITestListener监听模式及IMethodInterceptor监听模式,其中所述ITestListener监听模式在测试类开始执行前解析测试环境要求,获取测试环境后进行环境检测,执行结束后发送结果给调度装置,并且所述IMethodInterceptor监听模式将每个测试用例方案结果通知调度装置并定义失败用例的后续操作。The listener is configured as an ITestListener listening mode and an IMethodInterceptor listening mode, wherein the ITestListener listening mode parses the test environment requirements before the test class starts to execute, performs environment detection after obtaining the test environment, and sends the result to the scheduling device after execution, and the The IMethodInterceptor listening mode notifies the scheduler of the scenario results for each test case and defines the follow-up actions for failed cases.
在根据本发明的基于云平台的用例测试系统的一些实施例中,所述智能调度模块进一步配置为:In some embodiments of the use case testing system based on cloud platform according to the present invention, the intelligent scheduling module is further configured as:
所述调度装置获取所述监听器返回的测试类结果并解析,得出环境处理方式,决策通过软件开发工具包SDK对相应的测试环境进行销毁、保存或者继续使用。The dispatching device obtains and analyzes the test result returned by the listener, obtains an environment processing method, and decides to destroy, save or continue to use the corresponding test environment through the software development kit SDK.
在根据本发明的基于云平台的用例测试系统的一些实施例中,所述智能调度模块进一步配置为:In some embodiments of the use case testing system based on cloud platform according to the present invention, the intelligent scheduling module is further configured as:
所述调度装置获取所述监听器测试用例执行结果并解析,判断失败用例依赖关系以及用例对环境影响,决策对失败用例执行的后续操作。The dispatching device obtains and analyzes the execution results of the listener test cases, judges the dependencies of the failed use cases and the influence of the use cases on the environment, and decides the follow-up operations for the failed use cases.
在根据本发明的基于云平台的用例测试系统的一些实施例中,所述智能调度模块进一步配置为:In some embodiments of the use case testing system based on cloud platform according to the present invention, the intelligent scheduling module is further configured as:
响应于测试用例失败,所述调度装置通知所述日志装置收集测试环境信息,通过软件开发工具包SDK定位并获取环境需要的所有日志信息以创建运行日志。In response to a failure of a test case, the scheduling device notifies the log device to collect test environment information, and locates and obtains all log information required by the environment through a software development kit SDK to create a running log.
在根据本发明的基于云平台的用例测试系统的一些实施例中,所述用例管理模块进一步配置为:In some embodiments of the use case testing system based on cloud platform according to the present invention, the use case management module is further configured as:
利用所述用例管理装置对用例进行编码实现并调试;Use the use case management device to implement and debug the use case;
通过TestNG配置文件配置运行粒度以及线程数量。Configure the running granularity and number of threads through the TestNG configuration file.
在根据本发明的基于云平台的用例测试系统的一些实施例中,所述用例管理模块进一步配置为:In some embodiments of the use case testing system based on cloud platform according to the present invention, the use case management module is further configured as:
通过TestNG注解定义测试类环境标签,所述测试类环境标签包括环境的功能标签、规模标签以及其他标签。The test class environment tags are defined through TestNG annotations, and the test class environment tags include environment function tags, scale tags and other tags.
在根据本发明的基于云平台的用例测试系统的一些实施例中,所述智能调度模块进一步配置为:In some embodiments of the use case testing system based on cloud platform according to the present invention, the intelligent scheduling module is further configured as:
所述日志装置通过软件开发工具包SDK获取测试环境的运行日志,保存所述运行日志并反馈给所述监听器。The log device obtains the operation log of the test environment through the software development kit SDK, saves the operation log and feeds it back to the listener.
在根据本发明的基于云平台的用例测试系统的一些实施例中,所述智能调度模块进一步配置为:In some embodiments of the use case testing system based on cloud platform according to the present invention, the intelligent scheduling module is further configured as:
所述监听器获取所述运行日志并进行转存和通知。The listener obtains the running log and performs dumping and notification.
本发明的再一方面,还提供了一种计算机可读存储介质,存储有计算机程序指令,该计算机程序指令被执行时实现上述任一项根据本发明的测试方法。In yet another aspect of the present invention, a computer-readable storage medium is provided, storing computer program instructions, and when the computer program instructions are executed, any one of the above-mentioned testing methods according to the present invention is implemented.
本发明的又一方面,还提供了一种计算机设备,包括存储器和处理器,该存储器中存储有计算机程序,该计算机程序被处理器执行时执行上述任一项根据本发明的测试方法。In yet another aspect of the present invention, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, any one of the above-mentioned testing methods according to the present invention is executed.
本发明至少具有以下有益技术效果:基于本发明提出了一种基于云计算平台、通过软件开发工具包SDK接口操作云服务器,结合TestNG自定义监听器智能获取测试环境,对测试环境进行智能保存和创建,完善测试类和测试用例预处理机制,根据测试类和测试用例函数结果自动匹配操作,能够有效提高用例通过率,保存失败环境信息,通过恢复快照收集日志来加速分析,优化了基于云平台的测试,进一步提高了测试过程的智能程度、完善了测试机制、增强并改善了用例的测试效率。The present invention has at least the following beneficial technical effects: based on the present invention, a cloud computing platform based cloud server is provided through the software development kit SDK interface, combined with the TestNG self-defined listener to intelligently obtain the test environment, and the test environment is intelligently preserved and stored. Create and improve the test class and test case preprocessing mechanism, and automatically match the operation according to the test class and test case function results, which can effectively improve the pass rate of the test case, save the failure environment information, and accelerate the analysis by collecting logs through recovery snapshots, and optimize the cloud-based platform The test further improves the intelligence of the test process, improves the test mechanism, and enhances and improves the test efficiency of use cases.
附图说明Description of drawings
为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的实施例。In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention, and those skilled in the art can obtain other embodiments according to these drawings without any creative effort.
在图中:In the picture:
图1示出了根据本发明的基于云平台的用例测试方法的实施例的组件构成示意图;Fig. 1 shows the component composition schematic diagram of the embodiment of the use case testing method based on the cloud platform according to the present invention;
图2示出了根据本发明的基于云平台的用例测试方法的实施例的示意性框图;Fig. 2 shows the schematic block diagram of the embodiment of the use case testing method based on the cloud platform according to the present invention;
图3示出了根据本发明的基于云平台的用例测试方法的实施例的调度装置处理流程示意图;3 shows a schematic diagram of the processing flow of the scheduling device according to an embodiment of the cloud platform-based use case testing method of the present invention;
图4示出了根据本发明的基于云平台的用例测试系统的实施例的示意性框图;Fig. 4 shows a schematic block diagram of an embodiment of a use case testing system based on a cloud platform according to the present invention;
图5示出了根据本发明的实现基于云平台的用例测试方法的计算机可读存储介质的实施例的示意图;5 shows a schematic diagram of an embodiment of a computer-readable storage medium for implementing a cloud platform-based use case testing method according to the present invention;
图6示出了根据本发明的实现基于云平台的用例测试方法的计算机设备的实施例的硬件结构示意图。FIG. 6 shows a schematic diagram of the hardware structure of an embodiment of a computer device for implementing a cloud platform-based use case testing method according to the present invention.
具体实施方式Detailed ways
为使本发明的目的、技术方案和优点更加清楚明白,以下结合具体实施例,并参照附图,对本发明实施例进一步详细说明。In order to make the object, technical solution and advantages of the present invention clearer, the embodiments of the present invention will be further described in detail below in conjunction with specific embodiments and with reference to the accompanying drawings.
下面以一些测试框架为例,具体说明根据本发明的测试方法、系统、存储介质及设备。Taking some test frameworks as examples, the test method, system, storage medium and equipment according to the present invention will be described in detail below.
例如,TestNG是一个基于JUnit和NUnit的测试框架,同时引入了一些新的功能,使其功能更强大,使用更方便。TestNG消除了大部分的旧框架的限制,使开发人员能够编写更加灵活和强大的测试。因为它在很大程度上借鉴了Java注解(JDK5.0引入的)来定义测试,它也可以显示如何使用这个新功能在真实的Java语言生产环境中。For example, TestNG is a testing framework based on JUnit and NUnit, while introducing some new features to make it more powerful and easier to use. TestNG removes most of the limitations of older frameworks, enabling developers to write more flexible and powerful tests. Because it borrows heavily from Java annotations (introduced in JDK 5.0) to define tests, it can also show how to use this new feature in a real Java language production environment.
TestNG的监听器可以定制额外的功能,用于测试方法运行的行为、报表以及通知功能,用户通过创建接口的实现类,并把实现类加入TestNG配置文件,TestNG便会在测试运行的不同时刻调用这些类中的接口方法。但它仍然存在现有技术中前述的问题。为了解决现有技术中存在的上述问题,根据本发明提出了基于云平台、尤其利用云平台接口的智能用例测试方法。该方法通过根据本发明的组件实现。图1示出了根据本发明的基于云平台的用例测试方法的实施例的组件构成示意图,其中包括用例管理装置、监听装置、调度装置、测试装置和日志装置。测试用例编写后,使用TestNG管理测试用例代码,包括测试用例的顺序优先级、测试用例的依赖关系,TestNG配置文件,从而形成完备的用例管理装置。对TestNG框架自定义监听器类的实现,包括测试套件、测试类、测试方法等,从而实现类、方法的预处理,并将方法依赖和方法结果通知的监听装置,以及接收日志装置结果进行用例失败后处理。监听装置发送通知给调度装置,调度装置根据消息智能选择测试装置以及对测试装置进行预处理,同时对测试后处理通知给收集装置。日志装置在用例执行失败后对测试装置日志收集和保存,日志装置反馈结果给监听装置。TestNG's listener can customize additional functions for test method running behavior, reports, and notification functions. By creating an interface implementation class and adding the implementation class to the TestNG configuration file, TestNG will call it at different times during the test run. Interface methods in these classes. But it still has the aforementioned problems in the prior art. In order to solve the above-mentioned problems existing in the prior art, according to the present invention, an intelligent use case testing method based on a cloud platform, especially using a cloud platform interface is proposed. The method is implemented by means of the components according to the invention. Fig. 1 shows a schematic diagram of components of an embodiment of a cloud platform-based use case testing method according to the present invention, which includes a use case management device, a monitoring device, a scheduling device, a testing device and a logging device. After the test case is written, use TestNG to manage the test case code, including the sequence priority of the test case, the dependency of the test case, and the TestNG configuration file, thus forming a complete use case management device. The implementation of the TestNG framework custom listener class, including test suites, test classes, test methods, etc., so as to realize the preprocessing of classes and methods, and the listening device that notifies method dependencies and method results, and receives log device results for use cases Handle after failure. The monitoring device sends a notification to the dispatching device, and the dispatching device intelligently selects the test device according to the message and preprocesses the test device, and at the same time notifies the collection device of post-test processing. The log device collects and saves the test device logs after the execution of the use case fails, and the log device feeds back the results to the listening device.
简单地说,本发明的构思基于以下几点:Briefly, the idea of the present invention is based on the following points:
1) TestNG管理测试用例,注解指定用例执行顺序和依赖关系,配置文件配置监听;1) TestNG manages test cases, annotates the execution order and dependencies of specified use cases, and configures monitoring in configuration files;
2)监听装置对测试、方法的预处理和执行结果发送通知,执行结果后处理;2) The monitoring device sends notifications to the test, method preprocessing and execution results, and performs post-processing of the execution results;
3)调度装置配置为智能调度匹配装置,包括对测试装置执行前抉择;用例失败环境智能恢复;失败用例自动拉起;3) The scheduling device is configured as an intelligent scheduling matching device, including the pre-execution decision on the test device; intelligent recovery of the use case failure environment; automatic pull-up of failed use cases;
4)测试装置对云平台云服务器进行智能操作,包括生命周期管理;快照、备份创建;快照、备份恢复等;4) The test device performs intelligent operations on the cloud server of the cloud platform, including lifecycle management; snapshot and backup creation; snapshot and backup recovery, etc.;
5)监听装置在用例失败后通知调度装置,调度装置对测试环境反馈,日志装置收集测试环境的日志信息,对执行记录和定位日志进行收集保存。5) The listening device notifies the scheduling device after the use case fails, the scheduling device feeds back the test environment, the log device collects the log information of the test environment, and collects and saves the execution record and location log.
为此,本发明的第一方面,提供了一种基于云平台的用例测试方法100。图2示出了根据本发明的基于云平台的用例测试方法的实施例的示意性框图。在如图2所示的实施例中,该方法包括:To this end, the first aspect of the present invention provides a cloud platform-based use
步骤S110:通过配置的监听器对测试类解析执行前测试环境要求、获取测试后环境参数并将运行过程中的测试类环境标签及测试结果发送给调度装置;Step S110: Analyzing the pre-execution test environment requirements for the test class through the configured listener, obtaining the post-test environment parameters, and sending the test class environment label and test results during the running process to the scheduling device;
步骤S120:利用用例管理装置对用例进行测试前实现,并通过注解定义测试用例之间的执行顺序和依赖关系以及定义测试类环境标签;Step S120: use the use case management device to implement the use cases before testing, and define the execution order and dependencies between test cases and define the test class environment labels through annotations;
步骤S130:利用所述调度装置基于所述环境标签分配测试环境并从测试装置中锁定相应的执行测试环境,进而执行用例测试;Step S130: use the scheduling device to allocate a test environment based on the environment label and lock the corresponding execution test environment from the test device, and then execute the use case test;
步骤S140:利用所述调度装置根据所述监听器获得的测试用例执行状态对测试结果进行解析以决策后续的执行并通知日志装置收集测试环境信息以创建运行日志;Step S140: using the scheduling device to analyze the test results according to the execution status of the test case obtained by the listener to determine the subsequent execution and notify the log device to collect test environment information to create a running log;
步骤S150:通过所述测试装置对已用测试环境进行标签管理并对测试用例失败的环境实时快照、备份,以保存测试现场。Step S150: use the test device to manage the used test environment by label, and take a real-time snapshot and backup of the environment where the test case failed, so as to save the test site.
首先,根据本发明,优选基于TestNG配置自定义的监听器,其中通过该TestNG配置的监听器对测试类进行执行前测试环境要求解析,并获取测试后环境参数,此外还将运行过程中的测试类环境标签以及测试后的测试结果发送给调度装置。优选地,监听器还在测试结束时获取测试结果,对失败用例进行日志收集和失败用例提取。例如,监听器获取测试类、单个方法的结果、方法间依赖关系并且通知调度装置。First of all, according to the present invention, it is preferred to configure a custom listener based on TestNG, wherein the listener configured by the TestNG analyzes the requirements of the test environment before the execution of the test class, and obtains the environment parameters after the test. In addition, the test in the running process The class environment label and the test result after the test are sent to the scheduling device. Preferably, the listener also obtains test results at the end of the test, collects logs and extracts failed cases. For example, listeners capture test classes, results of individual methods, inter-method dependencies and notify the dispatcher.
随后在步骤S120中利用用例管理装置对用例进行测试前实现。同时,通过注解定义测试用例之间的执行顺序和依赖关系,并且定义测试类环境标签。优选地,测试前实现至少包括测试前需要进行的准备工作,例如编码及调试等。另外,通过注解,用例管理装置还定义了测试用例之间的执行顺序和依赖关系,该依赖关系优选还包括用例对环境的依赖关系等。Then in step S120, use the use case management device to implement pre-test implementation of the use case. At the same time, the execution sequence and dependencies between test cases are defined through annotations, and the test class environment tags are defined. Preferably, the pre-test implementation at least includes the preparatory work required before the test, such as coding and debugging. In addition, through annotations, the use case management device also defines the execution order and dependencies between test cases, and the dependencies preferably include the dependencies of use cases on the environment and the like.
在此基础上,在步骤S130中同样利用调度装置,基于在步骤S120中定义的环境标签分配测试环境。然后据此,从测试装置中锁定相应的执行测试环境,进而执行用例测试。即,调度装置获取监听器返回测试类所需环境标签,并且通知测试装置匹配最合适的测试环境。调度装置从测试装置测试环境池自动锁定最优执行测试环境。同时,测试装置对已有的测试环境进行标签管理,匹配合适的测试环境给测试类。然后进行用例测试的执行。On this basis, in step S130, the scheduling device is also used to assign a test environment based on the environment label defined in step S120. Then, according to this, the corresponding execution test environment is locked from the test device, and then the use case test is executed. That is, the scheduling device obtains the environment tag required by the listener to return the test class, and notifies the testing device to match the most suitable test environment. The scheduling device automatically locks the optimal execution test environment from the test device test environment pool. At the same time, the test device performs label management on the existing test environment, and matches the appropriate test environment to the test class. Then execute the use case test.
也就是说,调度装置对有依赖和无依赖的类分类,智能化决策失败用例重新运行和测试环境保存等后续操作的执行。That is to say, the scheduling device classifies dependent and non-dependent classes, executes follow-up operations such as intelligent decision-making failure case re-running and test environment preservation.
随后,在步骤S140中又利用该调度装置根据步骤S110中配置的监听器获得的测试用例执行状态,从而对测试结果进行解析,进而决策后续的执行。此外,在步骤S140中还通知日志装置收集测试环境信息,以创建运行日志,用于对测试进行记录。Subsequently, in step S140, the scheduling device is used to analyze the test result based on the execution state of the test case obtained by the listener configured in step S110, and then to decide on the subsequent execution. In addition, in step S140, the log device is also notified to collect test environment information to create a running log for recording the test.
最后在步骤S150中通过测试装置对已经使用过的测试环境进行标签管理,并对测试用例失败的测试环境进行实时快照、备份,从而保存测试现场。也就是说,除了对已有的测试环境进行标签管理,匹配合适的测试环境给测试类以外,测试装置还对测试用例失败的测试环境进行实时快照、备份,从而可以有效保存测试现场,以供随后的分析、调试及处理等,进而进一步完善测试机制、增强并改善用例的测试效率。Finally, in step S150, label management is performed on the used test environment through the test device, and a real-time snapshot and backup are performed on the test environment where the test case fails, so as to save the test site. That is to say, in addition to label management of the existing test environment and matching the appropriate test environment to the test class, the test device also takes real-time snapshots and backups of the test environment where the test case fails, so that the test site can be effectively saved for future use. Subsequent analysis, debugging and processing, etc., further improve the test mechanism, enhance and improve the test efficiency of use cases.
在根据本发明的基于云平台的用例测试方法100的一些实施例中,步骤S110:通过配置的监听器对测试类解析执行前测试环境要求、获取测试后环境参数并将运行过程中的测试类环境标签及测试结果发送给调度装置进一步包括:所述监听器配置为ITestListener监听模式及IMethodInterceptor监听模式,其中所述ITestListener监听模式在测试类开始执行前解析测试环境要求,获取测试环境后进行环境检测,执行结束后发送结果给调度装置,并且所述IMethodInterceptor监听模式将每个测试用例方案结果通知调度装置并定义失败用例的后续操作。In some embodiments of the cloud platform-based use
具体地说,在步骤S110中基于TestNG进行自定义配置以实现不同粒度的监听器。一方面,实现ITestListener自定义监听器,在测试类开始执行前解析测试环境要求,获取测试环境后进行环境检测,执行结束后发送结果给调度装置。另一方面,实现IMethodInterceptor自定义监听器,将每个测试用例方案结果通知调度装置并定义失败用例的后续操作,包括但不限于再次执行、保存环境、匹配新的测试环境等。Specifically, in step S110, custom configuration is performed based on TestNG to implement listeners of different granularities. On the one hand, implement the ITestListener custom listener, analyze the test environment requirements before the test class starts to execute, obtain the test environment and perform environment detection, and send the result to the scheduling device after execution. On the other hand, implement the IMethodInterceptor custom listener, notify the scheduling device of the result of each test case plan and define the follow-up operations of the failed case, including but not limited to re-execution, saving the environment, matching a new test environment, etc.
如前所述,根据本发明提出了基于调度装置的智能调度处理,图3示出了根据本发明的基于云平台的用例测试方法的实施例的调度装置处理流程示意图,其中示出了根据用例对测试环境的依赖关系、用例测试成败等条件进行的智能的测试后用例处理。总的来说,根据本发明的调度装置负责分配测试环境、用例结果接收和处理、失败用例环境信息反馈等。As mentioned above, according to the present invention, an intelligent scheduling process based on a scheduling device is proposed. FIG. Intelligent post-test use case processing for conditions such as test environment dependencies, use case test success or failure, etc. In general, the scheduling device according to the present invention is responsible for allocating test environments, receiving and processing use case results, feeding back environment information of failed use cases, and the like.
在根据本发明的基于云平台的用例测试方法100的一些实施例中,步骤S140:利用所述调度装置根据所述监听器获得的测试用例执行状态对测试结果进行解析以决策后续的执行并通知日志装置收集测试环境信息以创建运行日志进一步包括:所述调度装置获取所述监听器返回的测试类结果并解析,得出环境处理方式,决策通过软件开发工具包SDK对相应的测试环境进行销毁、保存或者继续使用。软件开发工具包(SDK,SoftwareDevelopment Kit)是一些被软件工程师用于为特定的软件包、软件框架、硬件平台、操作系统等创建应用软件的开发工具的集合。服务器虚拟化软件对外提供SDK,通过SDK,可以对云服务器进行操作,包括不限于云服务器创建、克隆、快照、备份、恢复快照、恢复备份等,其中也包括云服务器的生命周期管理。也就是说,调度装置获取步骤S110中自定义配置的监听器返回的测试类结果,对测试结果解析,得出环境处理方式,自动决策通过软件开发工具包SDK对测试环境进行销毁、保存或者继续使用。In some embodiments of the use
此外,在根据本发明的基于云平台的用例测试方法100的一些实施例中,步骤S140:利用所述调度装置根据所述监听器获得的测试用例执行状态对测试结果进行解析以决策后续的执行并通知日志装置收集测试环境信息以创建运行日志进一步包括:所述调度装置获取所述监听器测试用例执行结果并解析,判断失败用例依赖关系以及用例对环境影响,决策对失败用例执行的所述后续操作。具体地说,调度装置获取步骤S110中自定义配置的监听器返回的测试用例执行结果,对测试结果进行解析,判断失败用例依赖关系以及用例对环境影响,自动决策对失败用例执行何种后续操作。In addition, in some embodiments of the use
另外,在根据本发明的基于云平台的用例测试方法100的一些实施例中,步骤S140:利用所述调度装置根据所述监听器获得的测试用例执行状态对测试结果进行解析以决策后续的执行并通知日志装置收集测试环境信息以创建运行日志进一步包括:响应于测试用例失败,所述调度装置通知所述日志装置收集测试环境信息,通过软件开发工具包SDK定位并获取环境需要的所有日志信息以创建运行日志。也就是说,当测试用例失败时,调度装置通知日志装置收集测试环境信息,通过软件开发工具包SDK获取环境需要定位的所有日志信息,协助快速定位。In addition, in some embodiments of the use
进一步地,在根据本发明的基于云平台的用例测试方法100的一些实施例中,步骤S120:利用用例管理装置对用例进行测试前实现,并通过注解定义测试用例之间的执行顺序和依赖关系以及定义测试类环境标签进一步包括:利用所述用例管理装置对用例进行编码实现并调试;通过TestNG配置文件配置运行粒度以及线程数量。具体地说,用例管理装置基于TestNG执行用例自动化编码实现并实现调试通过。此外,TestNG配置文件配置运行粒度以及线程数量,另外,TestNG配置文件还配置需要运行的测试用例。Further, in some embodiments of the cloud platform-based use
此外,在根据本发明的基于云平台的用例测试方法100的一些实施例中,步骤S120:利用用例管理装置对用例进行测试前实现,并通过注解定义测试用例之间的执行顺序和依赖关系以及定义测试类环境标签进一步包括:通过TestNG注解定义测试类环境标签,所述测试类环境标签包括环境的功能标签、规模标签以及其他标签。也就是说,测试类通过TestNG注解定义测试类环境标签,所定义的测试类环境标签至少包括环境的功能标签、规模标签以及其他标签。In addition, in some embodiments of the use
在根据本发明的基于云平台的用例测试方法100的一些实施例中,步骤S140:利用所述调度装置根据所述监听器获得的测试用例执行状态对测试结果进行解析以决策后续的执行并通知日志装置收集测试环境信息以创建运行日志进一步包括:所述日志装置通过软件开发工具包SDK获取测试环境的运行日志,保存所述运行日志并反馈给所述监听器。进一步地,步骤S140还包括:所述监听器获取所述运行日志并进行转存和通知。也就是说在此,日志装置一方面能够通过软件开发工具包SDK接口获取测试环境的运行日志,另一方面保存运行日志,并且反馈给监听器。监听装置获取日志装置反馈的运行日志后进行转存和通知。In some embodiments of the use
综合根据本发明的前述实施例,本发明基于TestNG自定义监听器以测试类为单位获取测试环境,测试类和测试方法结果作为输入,结合监听器结果处理方式,形成智能调度装置,调度装置能够通过SDK直接对测试环境操作,可以创建新测试环境,收集测试环境日志,由此完善测试类和测试用例预处理机制,根据测试类和测试用例函数结果自动匹配操作,能够有效提高用例通过率,保存失败环境信息,通过恢复快照收集日志来加速分析,优化了基于云平台的测试,进一步提高了测试过程的智能程度、完善了测试机制、增强并改善了用例的测试效率。Comprehensively according to the foregoing embodiments of the present invention, the present invention is based on the TestNG self-defined listener to obtain the test environment in units of test classes, the test class and test method results as input, combined with the listener result processing method to form an intelligent scheduling device, the scheduling device can By directly operating the test environment through the SDK, you can create a new test environment and collect test environment logs, thereby improving the test class and test case preprocessing mechanism, and automatically matching operations according to the test class and test case function results, which can effectively improve the pass rate of test cases. Save failure environment information, collect logs by restoring snapshots to speed up analysis, optimize cloud-based testing, further improve the intelligence of the testing process, improve the testing mechanism, and enhance and improve the testing efficiency of use cases.
本发明的第二方面,还提供了一种基于云平台的用例测试系统200。图4示出了根据本发明的基于云平台的用例测试系统200的实施例的示意性框图。如图4所示,该系统包括:The second aspect of the present invention also provides a use
测试监听模块210,所述测试监听模块210配置为通过配置的监听器对测试类解析执行前测试环境要求、获取测试后环境参数并将运行过程中的测试类环境标签及测试结果发送给调度装置;The
用例管理模块220,所述用例管理模块220配置为利用用例管理装置对用例进行测试前实现,并通过注解定义测试用例之间的执行顺序和依赖关系以及定义测试类环境标签;The use
执行测试模块230,所述执行测试模块230配置为利用所述调度装置基于所述环境标签分配测试环境并从测试装置中锁定相应的执行测试环境,进而执行用例测试;
智能调度模块240,所述智能调度模块240配置为利用所述调度装置根据所述监听器获得的测试用例执行状态对测试结果进行解析以决策后续的执行并通知日志装置收集测试环境信息以创建运行日志;
现场保存模块250,所述现场保存模块250配置为通过所述测试装置对已用测试环境进行标签管理并对测试用例失败的环境实时快照、备份,以保存测试现场。The
在根据本发明的基于云平台的用例测试系统200的一些实施例中,所述测试监听模块210进一步配置为:所述监听器配置为ITestListener监听模式及IMethodInterceptor监听模式,其中所述ITestListener监听模式在测试类开始执行前解析测试环境要求,获取测试环境后进行环境检测,执行结束后发送结果给调度装置,并且所述IMethodInterceptor监听模式将每个测试用例方案结果通知调度装置并定义失败用例的后续操作。In some embodiments of the use
在根据本发明的基于云平台的用例测试系统200的一些实施例中,所述智能调度模块240进一步配置为:所述调度装置获取所述监听器返回的测试类结果并解析,得出环境处理方式,决策通过软件开发工具包SDK对相应的测试环境进行销毁、保存或者继续使用。In some embodiments of the cloud platform-based use
在根据本发明的基于云平台的用例测试系统200的一些实施例中,所述智能调度模块240进一步配置为:所述调度装置获取所述监听器测试用例执行结果并解析,判断失败用例依赖关系以及用例对环境影响,决策对失败用例执行的所述后续操作。In some embodiments of the use
在根据本发明的基于云平台的用例测试系统200的一些实施例中,所述智能调度模块240进一步配置为:响应于测试用例失败,所述调度装置通知所述日志装置收集测试环境信息,通过软件开发工具包SDK定位并获取环境需要的所有日志信息以创建运行日志。In some embodiments of the use
在根据本发明的基于云平台的用例测试系统200的一些实施例中,所述用例管理模块220进一步配置为:利用所述用例管理装置对用例进行编码实现并调试;通过TestNG配置文件配置运行粒度以及线程数量。In some embodiments of the use
在根据本发明的基于云平台的用例测试系统200的一些实施例中,所述用例管理模块220进一步配置为:通过TestNG注解定义测试类环境标签,所述测试类环境标签包括环境的功能标签、规模标签以及其他标签。In some embodiments of the use
在根据本发明的基于云平台的用例测试系统200的一些实施例中,所述智能调度模块240进一步配置为:所述日志装置通过软件开发工具包SDK获取测试环境的运行日志,保存所述运行日志并反馈给所述监听器。In some embodiments of the cloud platform-based use
在根据本发明的基于云平台的用例测试系统200的一些实施例中,所述智能调度模块240进一步配置为:所述监听器获取所述运行日志并进行转存和通知。In some embodiments of the use
本发明实施例的第三个方面,还提供了一种计算机可读存储介质,图5示出了根据本发明实施例提供的基于云平台的用例测试方法的计算机可读存储介质的示意图。如图5所示,计算机可读存储介质300存储有计算机程序指令310,该计算机程序指令310可以被处理器执行。该计算机程序指令310被执行时实现上述任意一项实施例的方法。The third aspect of the embodiment of the present invention also provides a computer-readable storage medium. FIG. 5 shows a schematic diagram of a computer-readable storage medium according to the cloud platform-based use case testing method provided by the embodiment of the present invention. As shown in FIG. 5 , the computer-
应当理解,在相互不冲突的情况下,以上针对根据本发明的基于云平台的用例测试方法阐述的所有实施方式、特征和优势同样地适用于根据本发明的基于云平台的用例测试系统和存储介质。It should be understood that, under the condition of not conflicting with each other, all the implementation modes, features and advantages set forth above for the use case testing method based on the cloud platform of the present invention are equally applicable to the use case testing system and storage system based on the cloud platform of the present invention medium.
本发明实施例的第四个方面,还提供了一种计算机设备400,包括存储器420和处理器410,该存储器中存储有计算机程序,该计算机程序被该处理器执行时实现上述任意一项实施例的方法。The fourth aspect of the embodiments of the present invention also provides a
如图6所示,为本发明提供的执行基于云平台的用例测试方法的计算机设备的一个实施例的硬件结构示意图。以如图6所示的计算机设备400为例,在该计算机设备中包括一个处理器410以及一个存储器420,并还可以包括:输入装置430和输出装置440。处理器410、存储器420、输入装置430和输出装置440可以通过总线或者其他方式连接,图6中以通过总线连接为例。输入装置430可接收输入的数字或字符信息,以及产生与基于云平台的用例测试有关的信号输入。输出装置440可包括显示屏等显示设备。As shown in FIG. 6 , it is a schematic diagram of the hardware structure of an embodiment of a computer device for executing the cloud platform-based use case testing method provided by the present invention. Taking the
存储器420作为一种非易失性计算机可读存储介质,可用于存储非易失性软件程序、非易失性计算机可执行程序以及模块,如本申请实施例中的资源监控方法对应的程序指令/模块。存储器420可以包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需要的应用程序;存储数据区可存储资源监控方法的使用所创建的数据等。此外,存储器420可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件、闪存器件、或其他非易失性固态存储器件。在一些实施例中,存储器420可选包括相对于处理器410远程设置的存储器,这些远程存储器可以通过网络连接至本地模块。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。The memory 420, as a non-volatile computer-readable storage medium, can be used to store non-volatile software programs, non-volatile computer-executable programs and modules, such as program instructions corresponding to the resource monitoring method in the embodiment of the present application /module. The memory 420 may include a program storage area and a data storage area, wherein the program storage area may store an operating system and an application program required by at least one function; the data storage area may store data created by using the resource monitoring method, and the like. In addition, the memory 420 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage devices. In some embodiments, the memory 420 may optionally include memory located remotely relative to the
处理器410通过运行存储在存储器420中的非易失性软件程序、指令以及模块,从而执行服务器的各种功能应用以及数据处理,即实现上述方法实施例的方法。The
最后需要说明的是,本文的计算机可读存储介质(例如,存储器)可以是易失性存储器或非易失性存储器,或者可以包括易失性存储器和非易失性存储器两者。作为例子而非限制性的,非易失性存储器可以包括只读存储器(ROM)、可编程ROM(PROM)、电可编程ROM(EPROM)、电可擦写可编程ROM(EEPROM)或快闪存储器。易失性存储器可以包括随机存取存储器(RAM),该RAM可以充当外部高速缓存存储器。作为例子而非限制性的,RAM 可以以多种形式获得,比如同步RAM(DRAM)、动态RAM(DRAM)、同步DRAM(SDRAM)、双数据速率SDRAM(DDRSDRAM)、增强SDRAM(ESDRAM)、同步链路DRAM(SLDRAM)、以及直接Rambus RAM(DRRAM)。所公开的方面的存储设备意在包括但不限于这些和其它合适类型的存储器。Finally, it should be noted that the computer-readable storage medium (eg, memory) herein may be a volatile memory or a nonvolatile memory, or may include both volatile memory and nonvolatile memory. By way of example and not limitation, nonvolatile memory can include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM), which can act as external cache memory. By way of example and not limitation, RAM is available in many forms such as Synchronous RAM (DRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), and Direct Rambus RAM (DRRAM). Storage devices of the disclosed aspects are intended to include, but are not limited to, these and other suitable types of memory.
本领域技术人员还将明白的是,结合这里的公开所描述的各种示例性逻辑块、模块、电路和算法步骤可以被实现为电子硬件、计算机软件或两者的组合。为了清楚地说明硬件和软件的这种可互换性,已经就各种示意性组件、方块、模块、电路和步骤的功能对其进行了一般性的描述。这种功能是被实现为软件还是被实现为硬件取决于具体应用以及施加给整个系统的设计约束。本领域技术人员可以针对每种具体应用以各种方式来实现的功能,但是这种实现决定不应被解释为导致脱离本发明实施例公开的范围。Those of skill would also appreciate that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the disclosure herein may be implemented as electronic hardware, computer software, or combinations of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described generally in terms of their functionality. Whether such functionality is implemented as software or as hardware depends upon the particular application and design constraints imposed on the overall system. Those skilled in the art may implement the functions in various ways for each specific application, but such implementation decisions should not be interpreted as causing a departure from the scope disclosed in the embodiments of the present invention.
结合这里的公开所描述的各种示例性逻辑块、模块和电路可以利用被设计成用于执行这里功能的下列部件来实现或执行:通用处理器、数字信号处理器(DSP)、专用集成电路(ASIC)、现场可编程门阵列(FPGA)或其它可编程逻辑器件、分立门或晶体管逻辑、分立的硬件组件或者这些部件的任何组合。通用处理器可以是微处理器,但是可替换地,处理器可以是任何传统处理器、控制器、微控制器或状态机。处理器也可以被实现为计算设备的组合,例如,DSP和微处理器的组合、多个微处理器、一个或多个微处理器结合DSP和/或任何其它这种配置。The various exemplary logical blocks, modules, and circuits described in connection with the disclosure herein can be implemented or performed using the following components designed to perform the functions herein: general purpose processors, digital signal processors (DSPs), application specific integrated circuits (ASIC), field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination of these. A general-purpose processor may be a microprocessor, but in the alternative, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be implemented as a combination of computing devices, eg, a combination of a DSP and a microprocessor, multiple microprocessors, one or more microprocessors in conjunction with a DSP, and/or any other such configuration.
以上是本发明公开的示例性实施例,但是应当注意,在不背离权利要求限定的本发明实施例公开的范围的前提下,可以进行多种改变和修改。根据这里描述的公开实施例的方法权利要求的功能、步骤和/或动作不需以任何特定顺序执行。此外,尽管本发明实施例公开的元素可以以个体形式描述或要求,但除非明确限制为单数,也可以理解为多个。The above are the exemplary embodiments disclosed in the present invention, but it should be noted that various changes and modifications can be made without departing from the scope of the disclosed embodiments of the present invention defined in the claims. The functions, steps and/or actions of the method claims in accordance with the disclosed embodiments described herein need not be performed in any particular order. In addition, although the elements disclosed in the embodiments of the present invention may be described or required in an individual form, they may also be understood as a plurality unless explicitly limited to a singular number.
应当理解的是,在本文中使用的,除非上下文清楚地支持例外情况,单数形式“一个”旨在也包括复数形式。还应当理解的是,在本文中使用的“和/或”是指包括一个或者一个以上相关联地列出的项目的任意和所有可能组合。上述本发明实施例公开实施例序号仅仅为了描述,不代表实施例的优劣。It should be understood that as used herein, the singular form "a" and "an" are intended to include the plural forms as well, unless the context clearly supports an exception. It should also be understood that "and/or" as used herein is meant to include any and all possible combinations of one or more of the associated listed items. The serial numbers of the embodiments disclosed in the above-mentioned embodiments of the present invention are only for description, and do not represent the advantages and disadvantages of the embodiments.
所属领域的普通技术人员应当理解:以上任何实施例的讨论仅为示例性的,并非旨在暗示本发明实施例公开的范围(包括权利要求)被限于这些例子;在本发明实施例的思路下,以上实施例或者不同实施例中的技术特征之间也可以进行组合,并存在如上的本发明实施例的不同方面的许多其它变化,为了简明它们没有在细节中提供。因此,凡在本发明实施例的精神和原则之内,所做的任何省略、修改、等同替换、改进等,均应包含在本发明实施例的保护范围之内。Those of ordinary skill in the art should understand that: the discussion of any of the above embodiments is exemplary only, and is not intended to imply that the disclosed scope (including claims) of the embodiments of the present invention is limited to these examples; under the idea of the embodiments of the present invention , the technical features in the above embodiments or different embodiments can also be combined, and there are many other changes in different aspects of the above embodiments of the present invention, which are not provided in details for the sake of brevity. Therefore, within the spirit and principle of the embodiments of the present invention, any omissions, modifications, equivalent replacements, improvements, etc., shall be included in the protection scope of the embodiments of the present invention.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211647189.4ACN115629997B (en) | 2022-12-21 | 2022-12-21 | A testing method, system, storage medium and equipment |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211647189.4ACN115629997B (en) | 2022-12-21 | 2022-12-21 | A testing method, system, storage medium and equipment |
| Publication Number | Publication Date |
|---|---|
| CN115629997Atrue CN115629997A (en) | 2023-01-20 |
| CN115629997B CN115629997B (en) | 2023-03-21 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211647189.4AActiveCN115629997B (en) | 2022-12-21 | 2022-12-21 | A testing method, system, storage medium and equipment |
| Country | Link |
|---|---|
| CN (1) | CN115629997B (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116991710A (en)* | 2023-06-27 | 2023-11-03 | 珠海妙存科技有限公司 | Automatic test method and system, electronic equipment and storage medium thereof |
| CN119807047A (en)* | 2024-12-16 | 2025-04-11 | 苏州元脑智能科技有限公司 | Method and device for determining target thread, storage medium, and electronic device |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100180260A1 (en)* | 2009-01-10 | 2010-07-15 | TestingCzars Software Solutions Private Limited | Method and system for performing an automated quality assurance testing |
| CN101882107A (en)* | 2010-06-28 | 2010-11-10 | 山东中创软件商用中间件股份有限公司 | Method and device for automatically testing WEB (World Wide Web) application |
| CN103577907A (en)* | 2012-07-24 | 2014-02-12 | 阿里巴巴集团控股有限公司 | Continuous integration testing method and system |
| CN114116496A (en)* | 2021-11-30 | 2022-03-01 | 中国平安人寿保险股份有限公司 | Automated testing methods, devices, equipment and media |
| CN115422052A (en)* | 2022-08-29 | 2022-12-02 | 武汉中海庭数据技术有限公司 | Vehicle navigation app test system and method |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100180260A1 (en)* | 2009-01-10 | 2010-07-15 | TestingCzars Software Solutions Private Limited | Method and system for performing an automated quality assurance testing |
| CN101882107A (en)* | 2010-06-28 | 2010-11-10 | 山东中创软件商用中间件股份有限公司 | Method and device for automatically testing WEB (World Wide Web) application |
| CN103577907A (en)* | 2012-07-24 | 2014-02-12 | 阿里巴巴集团控股有限公司 | Continuous integration testing method and system |
| CN114116496A (en)* | 2021-11-30 | 2022-03-01 | 中国平安人寿保险股份有限公司 | Automated testing methods, devices, equipment and media |
| CN115422052A (en)* | 2022-08-29 | 2022-12-02 | 武汉中海庭数据技术有限公司 | Vehicle navigation app test system and method |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116991710A (en)* | 2023-06-27 | 2023-11-03 | 珠海妙存科技有限公司 | Automatic test method and system, electronic equipment and storage medium thereof |
| CN116991710B (en)* | 2023-06-27 | 2024-04-09 | 珠海妙存科技有限公司 | Automatic test method and system, electronic equipment and storage medium thereof |
| CN119807047A (en)* | 2024-12-16 | 2025-04-11 | 苏州元脑智能科技有限公司 | Method and device for determining target thread, storage medium, and electronic device |
| Publication number | Publication date |
|---|---|
| CN115629997B (en) | 2023-03-21 |
| Publication | Publication Date | Title |
|---|---|---|
| KR102493449B1 (en) | Edge computing test methods, devices, electronic devices and computer-readable media | |
| CN115629997B (en) | A testing method, system, storage medium and equipment | |
| CN110750592B (en) | Data synchronization method, device and terminal equipment | |
| CN107105009B (en) | Job scheduling method and device for butting workflow engine based on Kubernetes system | |
| US9697104B2 (en) | End-to end tracing and logging | |
| CN111124702B (en) | Performance data acquisition method, device and computer readable storage medium | |
| US20120246624A1 (en) | Debugger-set identifying breakpoints after coroutine yield points | |
| US10339039B2 (en) | Virtual service interface | |
| CN114880159B (en) | Data processing method, device, equipment and storage medium | |
| US11422920B2 (en) | Debugging multiple instances of code using thread patterns | |
| US9852051B2 (en) | Second failure data capture in co-operating multi-image systems | |
| CN113656149A (en) | Application processing method and device and related equipment | |
| CN107124335A (en) | One kind is based on cloud sea operating system platform test method and system | |
| CN113094238A (en) | Method and device for monitoring abnormity of business system | |
| CN108446224B (en) | Performance analysis method of application program on mobile terminal and storage medium | |
| CN103019809B (en) | Business processing device and method, and business processing control device | |
| CN112148348B (en) | Task processing method, device and storage medium | |
| CN118779232A (en) | Test case execution method, device and server | |
| CN116383025A (en) | Performance test method, device, equipment and medium based on Jmeter | |
| US20230088318A1 (en) | Remotely healing crashed processes | |
| CN116150020A (en) | Test case conversion method and device | |
| CN116467188A (en) | Universal local reproduction system and method under multi-environment scene | |
| CN112925700A (en) | Program debugging method, device and system and embedded equipment | |
| US11157388B1 (en) | Trace identification based on wait chain coverage analysis | |
| CN114356643B (en) | A method for automatically discovering mission failure and recovery in a remote sensing satellite processing system |
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address | Address after:215000 Building 9, No.1 guanpu Road, Guoxiang street, Wuzhong Economic Development Zone, Suzhou City, Jiangsu Province Patentee after:Suzhou Yuannao Intelligent Technology Co.,Ltd. Country or region after:China Address before:215000 Building 9, No.1 guanpu Road, Guoxiang street, Wuzhong Economic Development Zone, Suzhou City, Jiangsu Province Patentee before:SUZHOU LANGCHAO INTELLIGENT TECHNOLOGY Co.,Ltd. Country or region before:China |