技术领域technical field
本发明涉及网络(WEB)测试技术领域，特别是涉及一种网络WEB页面的测试方法及装置。The invention relates to the technical field of network (WEB) testing, in particular to a testing method and device for a network WEB page.
背景技术Background technique
为了保证WEB页面的功能完备，避免在运行过程中出现故障，需要对开发好的WEB页面进行多种测试，包括功能测试、压力测试和安全测试等。In order to ensure that the functions of the WEB pages are complete and avoid failures during operation, it is necessary to conduct various tests on the developed WEB pages, including functional tests, stress tests, and security tests.
但是，由于WEB页面的测试效果与执行人员的测试水平密切相关，而对于大部分的WEB开发人员对测试相关的专业知识了解较少，导致WEB开发人员仅能对WEB页面做简单的手工测试，且测试效率低，测试效果差。However, because the test effect of web pages is closely related to the testing level of the executives, and most web developers know little about testing-related expertise, web developers can only do simple manual testing of web pages. And the test efficiency is low, and the test effect is poor.
发明内容Contents of the invention
本发明实施例的目的在于提供一种WEB页面的测试方法及装置，能够提高WEB页面的测试效率，使测试效果更佳。具体技术方案如下：The purpose of the embodiments of the present invention is to provide a method and device for testing a WEB page, which can improve the test efficiency of the WEB page and make the test effect better. The specific technical scheme is as follows:
本发明实施例提供了一种网络WEB页面的测试方法，所述方法包括：The embodiment of the present invention provides a kind of testing method of network WEB page, and described method comprises:
获取待测试WEB页面的测试内容数据；Obtain the test content data of the WEB page to be tested;
根据所述测试内容数据和预设的测试用例模板，生成与所述测试内容数据对应的测试用例，所述测试用例模板中的测试用例包括功能测试用例、压力测试用例和安全测试用例；Generate a test case corresponding to the test content data according to the test content data and a preset test case template, the test case in the test case template includes a functional test case, a stress test case and a security test case;
执行所述测试用例，对所述待测试WEB页面进行测试。Execute the test case to test the WEB page to be tested.
可选的，所述测试内容数据包括：待测试WEB页面接口的访问地址；Optionally, the test content data includes: the access address of the WEB page interface to be tested;
所述功能测试用例，包括：采用超文本传输协议http方式和安全套接字层超文本传输协议https方式访问待测试WEB页面，以及采用获取get方式和传送post方式，从待测试WEB页面向预设服务器提交数据；The functional test case includes: using the hypertext transfer protocol http mode and the secure socket layer hypertext transfer protocol https mode to access the WEB page to be tested, and adopting the get method and the transmission post method, from the WEB page to be tested to the pre-tested WEB page Set the server to submit data;
所述压力测试用例，包括：采用预设的高访问频率，访问待测试WEB页面；The stress test case includes: using a preset high access frequency to access the WEB page to be tested;
所述安全测试用例，包括：待测试WEB页面接收包含预设的安全关键字的恶意报文。The security test case includes: the WEB page to be tested receives a malicious message containing a preset security keyword.
可选的，所述执行所述测试用例的步骤，包括：Optionally, the step of executing the test case includes:
通过所述待测试WEB页面接口的访问地址，分别采用http方式和https方式访问所述待测试WEB页面；Through the access address of the WEB page interface to be tested, the http mode and https mode are used to access the WEB page to be tested respectively;
获取所述采用http方式和https方式访问所述待测试WEB页面对应的测试结果；Obtain the test results corresponding to the WEB page to be tested by accessing the WEB page to be tested by means of http and https;
通过所述待测试WEB页面接口的访问地址，采用get方式从预设服务器获取数据至所述待测试WEB页面，以及采用post方式从所述待测试WEB页面向所述预设服务器提交数据；Through the access address of the interface of the WEB page to be tested, the get method is used to obtain data from the preset server to the WEB page to be tested, and the post method is used to submit data from the WEB page to be tested to the preset server;
获取所述采用get方式从预设服务器获取数据至所述待测试WEB页面，以及采用post方式从所述待测试WEB页面向所述预设服务器提交数据对应的测试结果。Obtaining the test results corresponding to the data obtained from the preset server to the WEB page to be tested by using the get method, and the data corresponding to the submitted WEB page to the preset server by the post method.
可选的，所述执行所述测试用例的步骤，包括：Optionally, the step of executing the test case includes:
通过所述待测试WEB页面接口的访问地址，采用预设的高访问频率，访问所述待测试WEB页面；Accessing the WEB page to be tested by using the preset high access frequency through the access address of the WEB page interface to be tested;
获取所述访问所述待测试WEB页面对应的测试结果。Obtain the test result corresponding to the access to the WEB page to be tested.
可选的，所述执行所述测试用例的步骤，包括：Optionally, the step of executing the test case includes:
在所述待测试WEB页面中设置安全关键字，所述安全关键字用于过滤包含所述关键字的恶意报文；Security keywords are set in the WEB page to be tested, and the security keywords are used to filter malicious messages containing the keywords;
通过所述待测试WEB页面接口的访问地址，接收包含所述安全关键字的恶意报文；Receive the malicious message containing the security keyword through the access address of the WEB page interface to be tested;
获取所述待测试WEB页面接收包含所述安全关键字的恶意报文对应的测试结果。Obtain a test result corresponding to the malicious message containing the security keyword received by the WEB page to be tested.
本发明实施例还提供了一种网络WEB页面的测试装置，所述装置包括：The embodiment of the present invention also provides a kind of testing device of network WEB page, and described device comprises:
获取单元，用于获取待测试WEB页面的测试内容数据；An acquisition unit, configured to acquire the test content data of the WEB page to be tested;
生成单元，用于根据所述测试内容数据和预设的测试用例模板，生成与所述测试内容数据对应的测试用例，所述测试用例模板中的测试用例包括功能测试用例、压力测试用例和安全测试用例；A generating unit, configured to generate a test case corresponding to the test content data according to the test content data and a preset test case template, and the test cases in the test case template include a functional test case, a stress test case and a security test case. test case;
执行单元，用于执行所述测试用例，对所述待测试WEB页面进行测试。The execution unit is configured to execute the test case and test the WEB page to be tested.
可选的，所述测试内容数据包括：待测试WEB页面接口的访问地址；Optionally, the test content data includes: the access address of the WEB page interface to be tested;
所述功能测试用例，包括：采用超文本传输协议http方式和安全套接字层超文本传输协议https方式访问待测试WEB页面，以及采用获取get方式和传送post方式，从待测试WEB页面向预设服务器提交数据；The functional test case includes: using the hypertext transfer protocol http mode and the secure socket layer hypertext transfer protocol https mode to access the WEB page to be tested, and adopting the get method and the transmission post method, from the WEB page to be tested to the pre-tested WEB page Set the server to submit data;
所述压力测试用例，包括：采用预设的高访问频率，访问待测试WEB页面；The stress test case includes: using a preset high access frequency to access the WEB page to be tested;
所述安全测试用例，包括：待测试WEB页面接收包含预设的安全关键字的恶意报文。The security test case includes: the WEB page to be tested receives a malicious message containing a preset security keyword.
可选的，执行单元，具体用于通过所述待测试WEB页面接口的访问地址，分别采用http方式和https方式访问所述待测试WEB页面；Optionally, the execution unit is specifically used to access the WEB page to be tested by using http and https respectively through the access address of the interface of the WEB page to be tested;
获取所述采用http方式和https方式访问所述待测试WEB页面对应的测试结果；Obtain the test results corresponding to the WEB page to be tested by accessing the WEB page to be tested by means of http and https;
通过所述待测试WEB页面接口的访问地址，采用get方式从预设服务器获取数据至所述待测试WEB页面，以及采用post方式从所述待测试WEB页面向所述预设服务器提交数据；Through the access address of the interface of the WEB page to be tested, the get method is used to obtain data from the preset server to the WEB page to be tested, and the post method is used to submit data from the WEB page to be tested to the preset server;
获取所述采用get方式从预设服务器获取数据至所述待测试WEB页面，以及采用post方式从所述待测试WEB页面向所述预设服务器提交数据对应的测试结果。Obtaining the test results corresponding to the data obtained from the preset server to the WEB page to be tested by using the get method, and the data corresponding to the submitted WEB page to the preset server by the post method.
可选的，执行单元，具体用于通过所述待测试WEB页面接口的访问地址，采用预设的高访问频率，访问所述待测试WEB页面；Optionally, the execution unit is specifically configured to access the WEB page to be tested by using a preset high access frequency through the access address of the WEB page interface to be tested;
获取所述访问所述待测试WEB页面对应的测试结果。Obtain the test result corresponding to the access to the WEB page to be tested.
可选的，执行单元，具体用于在所述待测试WEB页面中设置安全关键字，所述安全关键字用于过滤包含所述关键字的恶意报文；Optionally, the execution unit is specifically configured to set a security keyword in the WEB page to be tested, and the security keyword is used to filter malicious messages containing the keyword;
通过所述待测试WEB页面接口的访问地址，接收包含所述安全关键字的恶意报文；Receive the malicious message containing the security keyword through the access address of the WEB page interface to be tested;
获取所述待测试WEB页面接收包含所述安全关键字的恶意报文对应的测试结果。Obtain a test result corresponding to the malicious message containing the security keyword received by the WEB page to be tested.
本发明实施例提供的一种WEB页面的测试方法，首先，获取待测试WEB页面的测试内容数据；然后，根据测试内容数据和预设的测试用例模板，生成与测试内容数据对应的测试用例，测试用例模板中的测试用例包括功能测试用例、压力测试用例和安全测试用例；最后，执行测试用例，对待测试WEB页面进行测试。A kind of testing method of WEB page that the embodiment of the present invention provides, at first, obtain the test content data of WEB page to be tested; Then, according to test content data and preset test case template, generate the test case corresponding to test content data, The test cases in the test case template include functional test cases, stress test cases and security test cases; finally, execute the test cases to test the WEB pages to be tested.
可见，本发明实施例所述的网络WEB页面的测试方法及装置，无需依赖于测试人员的专业知识，即使WEB开发人员不具备测试的专业知识，也能够使用本发明实施例所述的WEB页面的测试方法，生成多方面的测试用户，进而根据测试用户对WEB页面进行全面的测试，提高了WEB页面的测试效率，得到了更佳的测试效果。当然，实施本发明的任一产品或方法必不一定需要同时达到以上所述的所有优点。It can be seen that the method and device for testing network WEB pages described in the embodiments of the present invention do not need to rely on the professional knowledge of testers. The test method generates multiple test users, and then conducts a comprehensive test on the WEB pages according to the test users, which improves the test efficiency of the WEB pages and obtains better test results. Of course, implementing any product or method of the present invention does not necessarily need to achieve all the above-mentioned advantages at the same time.
附图说明Description of drawings
为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present invention. Those skilled in the art can also obtain other drawings based on these drawings without creative work.
图1为本发明实施例的WEB页面的测试方法的一种流程图；Fig. 1 is a kind of flowchart of the test method of the WEB page of the embodiment of the present invention;
图2为本发明实施例的WEB页面的测试方法的又一种流程图；Fig. 2 is another kind of flowchart of the testing method of the WEB page of the embodiment of the present invention;
图3为本发明实施例中步骤203的一种具体流程图；FIG. 3 is a specific flowchart of step 203 in the embodiment of the present invention;
图4为本发明实施例中步骤203的又一种具体流程图；FIG. 4 is another specific flowchart of step 203 in the embodiment of the present invention;
图5为本发明实施例中步骤203的另一种具体流程图；FIG. 5 is another specific flowchart of step 203 in the embodiment of the present invention;
图6为本发明实施例的WEB页面的测试装置的结构图；Fig. 6 is the structural diagram of the testing device of the WEB page of the embodiment of the present invention;
图7为本发明实施例的电子设备的结构图。FIG. 7 is a structural diagram of an electronic device according to an embodiment of the present invention.
具体实施方式detailed description
下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.
为了保证WEB页面的功能完备，避免在运行过程中出现故障，需要对开发好的WEB页面进行多种测试，包括功能测试、压力测试和安全测试等。In order to ensure that the functions of the WEB pages are complete and avoid failures during operation, it is necessary to conduct various tests on the developed WEB pages, including functional tests, stress tests, and security tests.
但是，由于WEB页面的测试效果与执行人员的测试水平密切相关，而对于大部分的WEB开发人员对测试相关的专业知识了解较少，导致WEB开发人员仅能对WEB页面做简单的手工测试，且测试效率低，测试效果差。However, because the test effect of web pages is closely related to the testing level of the executives, and most web developers know little about testing-related expertise, web developers can only do simple manual testing of web pages. And the test efficiency is low, and the test effect is poor.
为了解决上述问题，本发明实施例提供了一种网络WEB页面的测试方法。参考图1，图1为本发明实施例的WEB页面的测试方法的一种流程图，包括如下步骤：In order to solve the above problems, an embodiment of the present invention provides a method for testing a network WEB page. With reference to Fig. 1, Fig. 1 is a kind of flowchart of the test method of the WEB page of the embodiment of the present invention, comprises the steps:
步骤101，获取待测试WEB页面的测试内容数据。Step 101, acquire test content data of the WEB page to be tested.
在本步骤中，获取待测试WEB页面的测试内容数据，以便使用获取到的测试内容数据，对待测试WEB页面进行测试。In this step, the test content data of the WEB page to be tested is obtained, so that the WEB page to be tested can be tested by using the obtained test content data.
可选的，测试内容数据包括：待测试WEB页面接口的访问地址。Optionally, the test content data includes: the access address of the WEB page interface to be tested.
具体的，获取到待测试WEB页面接口的访问地址，这样，就可以根据上述访问地址访问该待测试WEB页面。Specifically, the access address of the interface of the WEB page to be tested is obtained, so that the WEB page to be tested can be accessed according to the above access address.
步骤102，根据测试内容数据和预设的测试用例模板，生成与测试内容数据对应的测试用例。Step 102, generating a test case corresponding to the test content data according to the test content data and the preset test case template.
其中，测试用例模板中的测试用例包括功能测试用例、压力测试用例和安全测试用例。Wherein, the test cases in the test case template include functional test cases, stress test cases and security test cases.
在本步骤中，根据步骤101获取的待测试WEB页面的测试内容数据和预设的测试用例模板，生成与待测试WEB页面的测试内容数据对应的测试用例，以便通过执行生成的测试用例，对待测试WEB页面进行测试。In this step, according to the test content data of the WEB page to be tested obtained in step 101 and the preset test case template, generate a test case corresponding to the test content data of the WEB page to be tested, so that by executing the test case generated, treat Test the WEB page for testing.
由于测试用例模板中的测试用例包括功能测试用例、压力测试用例和安全测试用例，因此，生成的测试用例包括功能测试用例、压力测试用例和安全测试用例。Since the test cases in the test case template include functional test cases, stress test cases and security test cases, the generated test cases include functional test cases, stress test cases and security test cases.
具体的，功能测试用例包括测试在一般场景下，待测试WEB页面的各项功能是否能够正常运行；压力测试包括当待测试WEB页面的各项数值处于极端值时，测试待测试WEB页面是否能够正常运行；安全测试用例包括当待测试WEB页面受到恶意报文攻击时，是否能够过滤恶意报文。Specifically, the function test case includes testing whether the various functions of the WEB page to be tested can operate normally in general scenarios; Normal operation; security test cases include whether malicious messages can be filtered when the WEB page to be tested is attacked by malicious messages.
步骤103，执行测试用例，对待测试WEB页面进行测试。Step 103, execute the test case, and test the WEB page to be tested.
在本步骤中，执行步骤102生成的多个测试用例，对待测试WEB页面进行测试，不仅保证在一般场景下，待测试WEB页面的各项功能能够正常运行，而且确保当待测试WEB页面的各项数值处于极端值，或者受到恶意报文攻击时，待测试WEB页面的各项功能仍能够正常运行。In this step, execute the multiple test cases generated in step 102 to test the WEB page to be tested, not only to ensure that in general scenarios, each function of the WEB page to be tested can run normally, but also to ensure that each function of the WEB page to be tested When the value of the item is at an extreme value, or is attacked by a malicious message, the functions of the WEB page to be tested can still operate normally.
可见，本发明实施例所述的WEB页面的测试方法，无需依赖于测试人员的专业知识，即使WEB开发人员不具备测试的专业知识，也能够使用本发明实施例所述的WEB页面的测试方法，生成多方面的测试用户，进而根据测试用户对WEB页面进行全面的测试，提高了WEB页面的测试效率，得到了更佳的测试效果。It can be seen that the testing method of the WEB page described in the embodiment of the present invention does not need to rely on the professional knowledge of the tester, even if the WEB developer does not have the professional knowledge of testing, the testing method of the WEB page described in the embodiment of the present invention can also be used , generate multiple test users, and then carry out a comprehensive test on the WEB pages according to the test users, which improves the test efficiency of the WEB pages and obtains better test results.
本发明的一种实现方式中，功能测试用例，包括：采用超文本传输协议http方式和安全套接字层超文本传输协议https方式访问待测试WEB页面，以及采用获取get方式和传送post方式，从待测试WEB页面向预设服务器提交数据；压力测试用例，包括：采用预设的高访问频率，访问待测试WEB页面；安全测试用例，包括：待测试WEB页面接收包含预设的安全关键字的恶意报文。In an implementation of the present invention, the function test case includes: using the hypertext transfer protocol http mode and the secure socket layer hypertext transfer protocol https mode to access the WEB page to be tested, and adopting the get mode and the transmission post mode, Submit data from the WEB page to be tested to the preset server; stress test cases include: access to the WEB page to be tested with a preset high access frequency; security test cases include: the WEB page to be tested receives preset security keywords malicious messages.
参考图2，图2为本发明实施例的WEB页面的测试方法的又一种流程图，包括如下步骤：With reference to Fig. 2, Fig. 2 is another kind of flowchart of the test method of the WEB page of the embodiment of the present invention, comprises the steps:
步骤201，获取待测试WEB页面的测试内容数据。Step 201, acquire test content data of the WEB page to be tested.
本步骤的详细过程和技术效果可以参考图1所示的WEB页面的测试方法中的步骤101，在此不再赘述。For the detailed process and technical effect of this step, reference may be made to step 101 in the method for testing a WEB page shown in FIG. 1 , which will not be repeated here.
步骤202，根据测试内容数据和预设的测试用例模板，生成与测试内容数据对应的功能测试用例、压力测试用例和安全测试用例。Step 202: Generate functional test cases, stress test cases and security test cases corresponding to the test content data according to the test content data and the preset test case template.
在本步骤中，根据步骤201获取的待测试WEB页面的测试内容数据和预设的测试用例模板，成与测试内容数据对应的功能测试用例、压力测试用例和安全测试用例，以便通过执行生成的测试用例，对待测试WEB页面进行测试。In this step, according to the test content data of the WEB page to be tested and the preset test case template obtained in step 201, a functional test case, a stress test case and a security test case corresponding to the test content data are formed, so that by executing the generated Test case, to test the WEB page to be tested.
步骤203，分别执行功能测试用例、压力测试用例和安全测试用例，对待测试WEB页面进行测试。Step 203, respectively execute the functional test case, the stress test case and the security test case to test the WEB page to be tested.
在本步骤中，执行步骤202生成的功能测试用例、压力测试用例和安全测试用例，对待测试WEB页面进行测试，不仅保证在一般场景下，待测试WEB页面的各项功能能够正常运行，而且确保当待测试WEB页面的各项数值处于极端值，或者受到恶意报文攻击时，待测试WEB页面的各项功能仍能够正常运行。In this step, execute the functional test case, stress test case and security test case generated in step 202 to test the WEB page to be tested, not only to ensure that in general scenarios, each function of the WEB page to be tested can run normally, but also to ensure that When the various values of the WEB page to be tested are at extreme values, or are attacked by malicious messages, the various functions of the WEB page to be tested can still operate normally.
可选的，执行功能测试用例的步骤，包括如图3至图5所示的子步骤。Optionally, the steps of executing the functional test case include sub-steps as shown in FIG. 3 to FIG. 5 .
具体的，首先，参考图3，图3为本发明实施例中步骤203的一种具体流程图，包括如下子步骤：Specifically, first, refer to FIG. 3, which is a specific flowchart of step 203 in the embodiment of the present invention, including the following sub-steps:
子步骤11，通过待测试WEB页面接口的访问地址，分别采用http方式和https方式，访问待测试WEB页面。Sub-step 11, through the access address of the interface of the WEB page to be tested, access the WEB page to be tested by using http and https respectively.
在本步骤中，分别采用http方式和https方式，通过访问地址访问待测试WEB页面，以测试待测试WEB页面的http功能和https功能是否正常。In this step, the http method and the https method are adopted respectively, and the WEB page to be tested is accessed through the access address to test whether the http function and the https function of the WEB page to be tested are normal.
比如，待测试WEB页面接口的访问地址是：http://218.24.176.101:8030/EnterpriseApp/PublicInterface/EnterpriseService.asmx；For example, the access address of the WEB page interface to be tested is: http://218.24.176.101:8030/EnterpriseApp/PublicInterface/EnterpriseService.asmx;
那么，可以采用http方式，如http://218.24.176.101:8030/EnterpriseApp/PublicInterface/EnterpriseService.asmx，访问待测试WEB页面，也可以采用https方式，如https://218.24.176.101:8030/EnterpriseApp/PublicInterface/EnterpriseService.asmx，访问待测试WEB页面。Then, you can use http method, such as http://218.24.176.101:8030/EnterpriseApp/PublicInterface/EnterpriseService.asmx, to access the WEB page to be tested, or use https method, such as https://218.24.176.101:8030/EnterpriseApp /PublicInterface/EnterpriseService.asmx, access the WEB page to be tested.
子步骤12，获取采用http方式和https方式访问待测试WEB页面对应的测试结果；Sub-step 12, obtain the test results corresponding to accessing the WEB page to be tested by means of http and https;
在本步骤中，获取子步骤11中采用http方式和https方式访问待测试WEB页面的测试结果，若测试结果为成功，则待测试WEB页面中采用http方式和https方式访问页面的功能正常，若测试结果为失败，则说明待测试WEB页面中采用http方式和https方式访问页面的功能存在错误，需要进一步排查修正。In this step, obtain the test result of using the http mode and the https mode to access the WEB page to be tested in the sub-step 11, if the test result is successful, then the function of using the http mode and the https mode to access the page in the WEB page to be tested is normal, if If the test result is a failure, it means that there is an error in the function of accessing the page using the http method and https method in the WEB page to be tested, and further investigation and correction are required.
子步骤13，通过待测试WEB页面接口的访问地址，采用get方式从预设服务器获取数据至待测试WEB页面，以及采用post方式从待测试WEB页面向预设服务器提交数据；Sub-step 13, through the access address of the WEB page interface to be tested, the get method is used to obtain data from the preset server to the WEB page to be tested, and the post method is used to submit data from the WEB page to be tested to the preset server;
在本步骤中，通过待测试WEB页面接口的访问地址，采用get方式从预设服务器获取数据至待测试WEB页面，并且，采用post方式从待测试WEB页面向预设服务器提交数据，以测试待测试WEB页面的get功能和post功能是否正常。In this step, through the access address of the WEB page interface to be tested, the get method is used to obtain data from the preset server to the WEB page to be tested, and the post method is used to submit data from the WEB page to be tested to the preset server to test the WEB page to be tested. Test whether the get function and post function of the WEB page are normal.
比如，待测试WEB页面接口的访问地址是：http://218.24.176.101:8030/EnterpriseApp/PublicInterface/EnterpriseService.asmx；For example, the access address of the WEB page interface to be tested is: http://218.24.176.101:8030/EnterpriseApp/PublicInterface/EnterpriseService.asmx;
那么，可以采用get方式，从预设服务器下载视频数据至http://218.24.176.101:8030/EnterpriseApp/PublicInterface/EnterpriseService.asmx，也可以采用post方式，将保存在http://218.24.176.101:8030/EnterpriseApp/PublicInterface/EnterpriseService.asmx中的图片数据上传至预设服务器。Then, you can use the get method to download video data from the default server to http://218.24.176.101:8030/EnterpriseApp/PublicInterface/EnterpriseService.asmx, or you can use the post method to save it at http://218.24.176.101: The image data in 8030/EnterpriseApp/PublicInterface/EnterpriseService.asmx is uploaded to the default server.
子步骤14，获取采用get方式从预设服务器获取数据至待测试WEB页面，以及采用post方式从待测试WEB页面向预设服务器提交数据对应的测试结果。Sub-step 14, obtain the test result corresponding to the data obtained from the preset server to the WEB page to be tested by the get method, and the data submitted from the WEB page to be tested to the preset server by the post method.
在本步骤中，获取子步骤13中采用get方式从预设服务器获取数据至待测试WEB页面，以及采用post方式从待测试WEB页面向预设服务器提交数据的测试结果，若测试结果为成功，则说明待测试WEB页面中有关采用get方式和post方式获取或提交数据的处理功能正常，若测试结果为失败，则说明待测试WEB页面中有关采用get方式和post方式获取或提交数据的处理功能存在错误，需要进一步排查修正。In this step, obtain the test result of obtaining data from the preset server to the WEB page to be tested by using the get method in the sub-step 13, and submitting the data from the WEB page to be tested by the post method to the preset server. If the test result is successful, It means that the processing function of the WEB page to be tested related to obtaining or submitting data by means of get and post is normal. If the test result is a failure, it means that the processing function of the WEB page to be tested is related to obtaining or submitting data by means of get and post There are errors that need further investigation and correction.
需要说明的是，本发明实施例不限制子步骤11和子步骤12，与子步骤13和子步骤14的执行顺序，也就是说，可以先执行子步骤11和子步骤12，再执行子步骤13和子步骤14，当然，也可以先执行子步骤13和子步骤14，再执行子步骤11和子步骤12。It should be noted that the embodiment of the present invention does not limit the execution sequence of substep 11 and substep 12, and substep 13 and substep 14, that is to say, substep 11 and substep 12 can be executed first, and then substep 13 and substep can be executed 14. Of course, sub-step 13 and sub-step 14 may also be performed first, and then sub-step 11 and sub-step 12 may be performed.
这样，完成了待测试WEB页面的功能测试，保证待测试WEB页面的基本功能正常。In this way, the functional test of the WEB page to be tested is completed, ensuring that the basic functions of the WEB page to be tested are normal.
接下来，参考图4，图4为本发明实施例中步骤203的又一种具体流程图，包括如下子步骤：Next, referring to FIG. 4, FIG. 4 is another specific flowchart of step 203 in the embodiment of the present invention, including the following sub-steps:
子步骤21，通过待测试WEB页面接口的访问地址，采用预设的高访问频率，访问待测试WEB页面；Sub-step 21, accessing the WEB page to be tested by using the preset high access frequency through the access address of the WEB page interface to be tested;
在本步骤中，采用预设的高访问频率，通过访问地址访问待测试WEB页面以测试待测试WEB页面是否能够承受高频率的访问。In this step, a preset high access frequency is used to access the WEB page to be tested through the access address to test whether the WEB page to be tested can withstand high-frequency access.
比如，预设的高访问频率为10000次/秒，待测试WEB页面接口的访问地址是：http://218.24.176.101:8030/EnterpriseApp/PublicInterface/EnterpriseService.asmx；那么，采用10000次/秒的访问频率，通过http://218.24.176.101:8030/EnterpriseApp/PublicInterface/EnterpriseService.asmx访问待测试WEB页面。For example, the preset high access frequency is 10,000 times/second, and the access address of the WEB page interface to be tested is: http://218.24.176.101:8030/EnterpriseApp/PublicInterface/EnterpriseService.asmx; then, use 10,000 times/second Access frequency, access the WEB page to be tested through http://218.24.176.101:8030/EnterpriseApp/PublicInterface/EnterpriseService.asmx.
子步骤22，获取访问待测试WEB页面对应的测试结果。Sub-step 22, obtain the test result corresponding to the access to the WEB page to be tested.
在本步骤中，获取子步骤22中采用预设的高访问频率，通过访问地址访问待测试WEB页面的测试结果，若测试结果为成功，则说明待测试WEB页面中高频访问的功能正常，若测试结果为失败，则说明待测试WEB页面中高频访问的功能存在错误，需要进一步排查修正。In this step, obtain the preset high access frequency in sub-step 22, and access the test result of the WEB page to be tested by the access address. If the test result is successful, it means that the high-frequency access function of the WEB page to be tested is normal. If If the test result is a failure, it means that there is an error in the frequently accessed function of the WEB page to be tested, and further investigation and correction is required.
这样，完成了待测试WEB页面的压力测试，保证待测试WEB页面能够承受高频率的访问。In this way, the stress test of the WEB page to be tested is completed, ensuring that the WEB page to be tested can withstand high-frequency visits.
最后，参考图5，图5为本发明实施例中步骤203的另一种具体流程图，包括如下子步骤：Finally, referring to FIG. 5, FIG. 5 is another specific flowchart of step 203 in the embodiment of the present invention, including the following sub-steps:
子步骤31，在待测试WEB页面中设置安全关键字。Sub-step 31, setting security keywords in the WEB page to be tested.
其中，安全关键字用于过滤包含关键字的恶意报文。Among them, the security keyword is used to filter malicious packets containing keywords.
在本步骤中，首先，在待测试WEB中设置安全关键字，以过滤包含该安全关键字的恶意报文，提高WEB页面的安全防御性能。In this step, firstly, a security keyword is set in the WEB to be tested to filter malicious messages containing the security keyword and improve the security defense performance of the WEB page.
在具体实施中，安全关键字可以是敏感代码及标签。In a specific implementation, the security keywords may be sensitive codes and labels.
子步骤32，通过待测试WEB页面接口的访问地址，接收包含安全关键字的恶意报文；Sub-step 32, through the access address of the WEB page interface to be tested, receive the malicious message containing the security keyword;
在本步骤中，待测试WEB页面，接收包含已设置的安全关键字的恶意报文，以观察待测试WEB页面是否能够过滤该恶意报文。In this step, the WEB page to be tested receives a malicious message containing the set security keyword to observe whether the WEB page to be tested can filter the malicious message.
具体的，可以使用结构化查询语言(Structured Query Language，SQL)注入的方式，使待测试WEB页面接收包含安全关键字的恶意报文。需要说明的是，使用SQL注入的方式使待测试WEB页面接收包含安全关键字的恶意报文的具体方法可以参考现有技术，在此不再赘述。Specifically, structured query language (Structured Query Language, SQL) injection may be used to make the WEB page to be tested receive malicious messages containing security keywords. It should be noted that the specific method of using SQL injection to make the WEB page to be tested receive malicious messages containing security keywords can refer to the prior art, and will not be repeated here.
子步骤33，获取待测试WEB页面接收包含安全关键字的恶意报文对应的测试结果。Sub-step 33, obtaining the test result corresponding to the malicious message containing the security keyword received by the WEB page to be tested.
在本步骤中，获取待测试WEB页面接收包含安全关键字的恶意报文对应的测试结果，确定待测试WEB页面是否过滤掉该恶意报文；若为是，则说明待测试WEB页面中根据安全关键字过滤报文的功能正常，若为否，则说明待测试WEB页面中根据安全关键字过滤报文的功能存在错误，需要进一步排查修正。In this step, obtain the test result corresponding to the malicious message received by the WEB page to be tested that contains the security keyword, and determine whether the WEB page to be tested filters out the malicious message; The function of filtering packets by keywords is normal. If it is not, it means that there is an error in the function of filtering packets based on security keywords in the web page to be tested, and further investigation and correction is required.
这样，完成了待测试WEB页面的安全测试，保证待测试WEB页面的安全防御性能可靠。In this way, the security test of the WEB page to be tested is completed, and the security defense performance of the WEB page to be tested is guaranteed to be reliable.
本发明实施例还提供了一种网络WEB页面的测试装置。参考图6，图6为本发明实施例的WEB页面的测试装置的结构图，包括如下单元：The embodiment of the invention also provides a testing device for a network WEB page. With reference to Fig. 6, Fig. 6 is the structural diagram of the testing device of the WEB page of the embodiment of the present invention, comprises following unit:
获取单元601，用于获取待测试WEB页面的测试内容数据；An acquisition unit 601, configured to acquire test content data of the WEB page to be tested;
生成单元602，用于根据测试内容数据和预设的测试用例模板，生成与测试内容数据对应的测试用例，测试用例模板中的测试用例包括功能测试用例、压力测试用例和安全测试用例；The generation unit 602 is used to generate test cases corresponding to the test content data according to the test content data and the preset test case template, and the test cases in the test case template include functional test cases, stress test cases and security test cases;
执行单元603，用于执行测试用例，对待测试WEB页面进行测试。The execution unit 603 is configured to execute the test case to test the WEB page to be tested.
可选的，测试内容数据包括：待测试WEB页面接口的访问地址；Optionally, the test content data includes: the access address of the WEB page interface to be tested;
功能测试用例，包括：采用预设的超文本传输协议http方式和预设的安全套接字层超文本传输协议https方式访问待测试WEB页面，以及采用预设的获取get方式和预设的传送post方式，从待测试WEB页面向预设服务器提交数据；Functional test cases, including: using the preset hypertext transfer protocol http method and the preset secure socket layer hypertext transfer protocol https method to access the WEB page to be tested, and using the preset get method and preset transmission Post mode, submit data from the WEB page to be tested to the preset server;
压力测试用例，包括：采用高访问频率访问待测试WEB页面；Stress test cases, including: using high access frequency to access the WEB page to be tested;
安全测试用例，包括：待测试WEB页面接收包含预设的安全关键字的恶意报文。The security test case includes: the WEB page to be tested receives a malicious message containing a preset security keyword.
可选的，执行单元，具体用于通过待测试WEB页面接口的访问地址，采用预设的http方式和预设的https方式，访问待测试WEB页面；Optionally, the execution unit is specifically used to access the WEB page to be tested by using the preset http method and the preset https method through the access address of the WEB page interface to be tested;
判断访问待测试WEB页面是否成功；若为是，则执行成功；Judging whether the access to the WEB page to be tested is successful; if yes, the execution is successful;
通过待测试WEB页面接口的访问地址，采用预设的get方式和预设的post方式，从待测试WEB页面向预设服务器提交数据；Through the access address of the WEB page interface to be tested, the preset get method and the preset post method are used to submit data from the WEB page to be tested to the preset server;
判断从待测试WEB页面向预设服务器提交数据是否成功；若为是，则执行成功。Judging whether the submission of data from the WEB page to be tested to the preset server is successful; if yes, the execution is successful.
可选的，执行单元，具体用于通过待测试WEB页面接口的访问地址，采用预设的高访问频率，访问待测试WEB页面；Optionally, the execution unit is specifically used to access the WEB page to be tested by using a preset high access frequency through the access address of the WEB page interface to be tested;
判断访问待测试WEB页面是否成功；若为是，则执行成功。It is judged whether the access to the WEB page to be tested is successful; if yes, the execution is successful.
可选的，执行单元，具体用于在待测试WEB页面中设置安全关键字，安全关键字用于过滤包含关键字的恶意报文；Optionally, the execution unit is specifically used to set security keywords in the WEB page to be tested, and the security keywords are used to filter malicious messages containing keywords;
通过待测试WEB页面接口的访问地址，接收包含安全关键字的恶意报文；Receive malicious messages containing security keywords through the access address of the WEB page interface to be tested;
判断待测试WEB页面是否过滤掉恶意报文，若为是，则执行成功。Determine whether the WEB page to be tested filters out malicious messages, and if yes, the execution is successful.
可见，本发明实施例的WEB页面的测试装置，无需依赖于测试人员的专业知识，即使WEB开发人员不具备测试的专业知识，也能够使用本发明实施例的WEB页面的测试方法，生成多方面的测试用户，进而根据测试用户对WEB页面进行全面的测试，提高了WEB页面的测试效率，得到了更佳的测试效果。It can be seen that the testing device of the WEB page in the embodiment of the present invention does not need to rely on the professional knowledge of the tester, even if the WEB developer does not have the professional knowledge of testing, he can also use the testing method of the WEB page in the embodiment of the present invention to generate multiple aspects. test users, and then conduct a comprehensive test on the WEB pages according to the test users, which improves the test efficiency of the WEB pages and obtains better test results.
本发明实施例又提供了一种电子设备，参考图7，图7为本发明实施例的电子设备的结构图。如图7所示，包括处理器701、通信接口702、存储器703和通信总线704，其中，处理器701，通信接口702，存储器703通过通信总线704完成相互间的通信，An embodiment of the present invention further provides an electronic device. Referring to FIG. 7 , FIG. 7 is a structural diagram of the electronic device according to an embodiment of the present invention. As shown in FIG. 7 , it includes a processor 701, a communication interface 702, a memory 703, and a communication bus 704, wherein the processor 701, the communication interface 702, and the memory 703 complete mutual communication through the communication bus 704,
存储器703，用于存放计算机程序；Memory 703, used to store computer programs;
处理器701，用于执行存储器703上所存放的程序时，实现如下步骤：When the processor 701 is used to execute the program stored on the memory 703, the following steps are implemented:
获取待测试WEB页面的测试内容数据；Obtain the test content data of the WEB page to be tested;
根据测试内容数据和预设的测试用例模板，生成与测试内容数据对应的测试用例，测试用例模板中的测试用例包括功能测试用例、压力测试用例和安全测试用例；Generate test cases corresponding to the test content data according to the test content data and the preset test case template. The test cases in the test case template include functional test cases, stress test cases and security test cases;
执行测试用例，对待测试WEB页面进行测试。Execute the test case to test the WEB page to be tested.
上述电子设备提到的通信总线可以是外设部件互连标准(Peripheral ComponentInterconnect，PCI)总线或扩展工业标准结构(Extended Industry StandardArchitecture，EISA)总线等。该通信总线可以分为地址总线、数据总线、控制总线等。为便于表示，图中仅用一条粗线表示，但并不表示仅有一根总线或一种类型的总线。The communication bus mentioned in the above electronic device may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus or the like. The communication bus can be divided into an address bus, a data bus, a control bus, and the like. For ease of representation, only one thick line is used in the figure, but it does not mean that there is only one bus or one type of bus.
通信接口用于上述电子设备与其他设备之间的通信。The communication interface is used for communication between the electronic device and other devices.
存储器可以包括随机存取存储器(Random Access Memory，RAM)，也可以包括非易失性存储器(Non-Volatile Memory，NVM)，例如至少一个磁盘存储器。可选的，存储器还可以是至少一个位于远离前述处理器的存储装置。The memory may include a random access memory (Random Access Memory, RAM), and may also include a non-volatile memory (Non-Volatile Memory, NVM), such as at least one disk memory. Optionally, the memory may also be at least one storage device located far away from the aforementioned processor.
上述的处理器可以是通用处理器，包括中央处理器(Central Processing Unit，CPU)、网络处理器(Network Processor，NP)等；还可以是数字信号处理器(Digital SignalProcessing，DSP)、专用集成电路(Application Specific Integrated Circuit，ASIC)、现场可编程门阵列(Field-Programmable Gate Array，FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件。Above-mentioned processor can be general-purpose processor, comprises central processing unit (Central Processing Unit, CPU), network processor (Network Processor, NP) etc.; Can also be Digital Signal Processor (Digital Signal Processing, DSP), ASIC (Application Specific Integrated Circuit, ASIC), Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.
可见，本发明实施例所述的电子设备，无需依赖于测试人员的专业知识，即使WEB开发人员不具备测试的专业知识，也能够使用本发明实施例所述的WEB页面的测试方法，生成多方面的测试用户，进而根据测试用户对WEB页面进行全面的测试，提高了WEB页面的测试效率，得到了更佳的测试效果。It can be seen that the electronic device described in the embodiment of the present invention does not need to rely on the professional knowledge of the tester. Even if the WEB developer does not have the professional knowledge of testing, he can use the testing method of the WEB page described in the embodiment of the present invention to generate multiple According to the test users in all aspects, and then conduct a comprehensive test on the WEB pages according to the test users, which improves the test efficiency of the WEB pages and obtains better test results.
本发明实施例再提供了一种计算机可读存储介质，该计算机可读存储介质中存储有指令，当其在计算机上运行时，使得计算机执行上述实施例中任一的网络WEB页面的测试方法。The embodiment of the present invention further provides a computer-readable storage medium, and instructions are stored in the computer-readable storage medium, and when it is run on a computer, the computer is made to execute any method for testing a network WEB page in any of the above-mentioned embodiments. .
需要说明的是，在本文中，诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来，而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括所述要素的过程、方法、物品或者设备中还存在另外的相同要素。It should be noted that in this article, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply that there is a relationship between these entities or operations. any such actual relationship or order exists between them. Furthermore, the term "comprises", "comprises" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article, or apparatus comprising a set of elements includes not only those elements, but also includes elements not expressly listed. other elements of or also include elements inherent in such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article or apparatus comprising said element.
本说明书中的各个实施例均采用相关的方式描述，各个实施例之间相同相似的部分互相参见即可，每个实施例重点说明的都是与其他实施例的不同之处。尤其，对于系统实施例而言，由于其基本相似于方法实施例，所以描述的比较简单，相关之处参见方法实施例的部分说明即可。Each embodiment in this specification is described in a related manner, the same and similar parts of each embodiment can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and for relevant parts, refer to part of the description of the method embodiment.
以上所述仅为本发明的较佳实施例而已，并非用于限定本发明的保护范围。凡在本发明的精神和原则之内所作的任何修改、等同替换、改进等，均包含在本发明的保护范围内。The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the protection scope of the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principles of the present invention are included in the protection scope of the present invention.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710928277.4ACN107682224B (en) | 2017-10-09 | 2017-10-09 | A kind of testing method and device of network WEB page |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710928277.4ACN107682224B (en) | 2017-10-09 | 2017-10-09 | A kind of testing method and device of network WEB page |
| Publication Number | Publication Date |
|---|---|
| CN107682224Atrue CN107682224A (en) | 2018-02-09 |
| CN107682224B CN107682224B (en) | 2021-02-26 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710928277.4AExpired - Fee RelatedCN107682224B (en) | 2017-10-09 | 2017-10-09 | A kind of testing method and device of network WEB page |
| Country | Link |
|---|---|
| CN (1) | CN107682224B (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111193770A (en)* | 2019-11-28 | 2020-05-22 | 哈尔滨工业大学（威海） | A method for automatically generating large-scale HTTPS connections |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101217425A (en)* | 2008-01-04 | 2008-07-09 | 中兴通讯股份有限公司 | Web testing method and device |
| CN104618178A (en)* | 2014-12-29 | 2015-05-13 | 北京奇虎科技有限公司 | Website bug online evaluation method and device |
| CN104679658A (en)* | 2015-03-17 | 2015-06-03 | 百度在线网络技术（北京）有限公司 | Test method and test system for WEB pages |
| US20170284025A1 (en)* | 2016-04-04 | 2017-10-05 | The Procter & Gamble Company | Fibrous Structures Different Fibrous Elements |
| US10489581B2 (en)* | 2016-03-08 | 2019-11-26 | Palo Alto Networks, Inc. | Cookies watermarking in malware analysis |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101217425A (en)* | 2008-01-04 | 2008-07-09 | 中兴通讯股份有限公司 | Web testing method and device |
| CN104618178A (en)* | 2014-12-29 | 2015-05-13 | 北京奇虎科技有限公司 | Website bug online evaluation method and device |
| CN104679658A (en)* | 2015-03-17 | 2015-06-03 | 百度在线网络技术（北京）有限公司 | Test method and test system for WEB pages |
| US10489581B2 (en)* | 2016-03-08 | 2019-11-26 | Palo Alto Networks, Inc. | Cookies watermarking in malware analysis |
| US20170284025A1 (en)* | 2016-04-04 | 2017-10-05 | The Procter & Gamble Company | Fibrous Structures Different Fibrous Elements |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111193770A (en)* | 2019-11-28 | 2020-05-22 | 哈尔滨工业大学（威海） | A method for automatically generating large-scale HTTPS connections |
| Publication number | Publication date |
|---|---|
| CN107682224B (en) | 2021-02-26 |
| Publication | Publication Date | Title |
|---|---|---|
| US9264443B2 (en) | Browser based method of assessing web application vulnerability | |
| WO2020000706A1 (en) | Database comparison-based interface testing method and system, device and storage medium | |
| CN112199300B (en) | Interface testing method and device, electronic equipment and storage medium | |
| CN105190548A (en) | Automated Risk Analysis for Software | |
| US10705949B2 (en) | Evaluation of library test suites using mutation testing | |
| CN108923997B (en) | A python-based cloud service node automatic testing method and device | |
| CN109739700B (en) | Interface testing method and device | |
| CN111797026A (en) | Test case generation method, device, computer equipment and storage medium | |
| CN111694572A (en) | Code format conversion method, device, computer equipment and storage medium | |
| US20130067439A1 (en) | Injecting faults into program for testing | |
| CN111309593A (en) | JSON interface verification method, device and equipment and computer readable storage medium | |
| CN107729238A (en) | A kind of plug-in unit adjustment method, system, device and computer-readable recording medium | |
| CN111858584A (en) | Metadata management method, system and storage medium | |
| CN104965781A (en) | Method and apparatus for generating test case | |
| WO2015073469A1 (en) | Functional validation of software | |
| CN114116510A (en) | A kind of interface parameter verification method and device | |
| CN109542785B (en) | A kind of invalid bug determination method and device | |
| CN112631894B (en) | Code detection method, device, storage medium and computer equipment | |
| CN105183641B (en) | The data consistency verification method and system of a kind of kernel module | |
| CN107682224A (en) | The method of testing and device of a kind of network web page | |
| CN113407449A (en) | Interface testing method and device | |
| CN113448835A (en) | Static resource testing method and device, electronic equipment and storage medium | |
| CN110908725B (en) | Application program starting method and device, electronic equipment and readable medium | |
| CN117687920A (en) | Interface testing method and device, storage medium and electronic equipment | |
| US9760567B1 (en) | Method and apparatus for using a common dialect for testing on multiple execution interfaces |
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | Granted publication date:20210226 |