CN114297961A - A chip test case processing method and related device - Google Patents
A chip test case processing method and related deviceDownload PDFInfo
- Publication number
- CN114297961A CN114297961ACN202111445180.0ACN202111445180ACN114297961ACN 114297961 ACN114297961 ACN 114297961ACN 202111445180 ACN202111445180 ACN 202111445180ACN 114297961 ACN114297961 ACN 114297961A
- Authority
- CN
- China
- Prior art keywords
- simulation
- test case
- data
- chip
- verification plan
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012360testing methodMethods0.000titleclaimsabstractdescription175
- 238000003672processing methodMethods0.000titleclaimsabstractdescription15
- 238000004088simulationMethods0.000claimsabstractdescription215
- 238000012795verificationMethods0.000claimsabstractdescription71
- 238000012545processingMethods0.000claimsabstractdescription28
- 238000000034methodMethods0.000claimsdescription56
- 238000007726management methodMethods0.000claimsdescription45
- 230000008569processEffects0.000claimsdescription31
- 238000004590computer programMethods0.000claimsdescription12
- 238000004458analytical methodMethods0.000claimsdescription11
- 238000012986modificationMethods0.000claimsdescription11
- 230000004048modificationEffects0.000claimsdescription11
- 238000001914filtrationMethods0.000claimsdescription9
- 238000013523data managementMethods0.000claimsdescription4
- 238000009434installationMethods0.000claimsdescription4
- 230000000694effectsEffects0.000abstractdescription10
- 230000009286beneficial effectEffects0.000abstractdescription2
- 230000006870functionEffects0.000description12
- 230000008676importEffects0.000description4
- 230000000007visual effectEffects0.000description3
- 230000008859changeEffects0.000description2
- 238000013461designMethods0.000description2
- 238000010586diagramMethods0.000description2
- 230000003749cleanlinessEffects0.000description1
- 238000012938design processMethods0.000description1
- 238000011161developmentMethods0.000description1
- 230000005284excitationEffects0.000description1
- 238000004519manufacturing processMethods0.000description1
- 230000000750progressive effectEffects0.000description1
- 238000012552reviewMethods0.000description1
Images
Landscapes
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
Description
Translated fromChinese技术领域technical field
本申请涉及芯片制造技术领域，特别涉及一种芯片测试用例处理方法、芯片测试用例处理装置、服务器以及计算机可读存储介质。The present application relates to the technical field of chip manufacturing, and in particular, to a chip test case processing method, a chip test case processing device, a server, and a computer-readable storage medium.
背景技术Background technique
随着芯片基础的不断发展，在芯片设计过程中需要对芯片进行验证，以提高芯片的可行性。With the continuous development of the chip foundation, the chip needs to be verified in the chip design process to improve the feasibility of the chip.
相关技术中，技术人员一般是简单的采用脚本语言管理测试用例，然而，芯片功能的复杂度不同，测试用例数目也不尽相同。功能简单的芯片，其测试用例集小，直接采用脚本语言管理影响不大。当芯片功能增加，规模变大，直接采用脚本语言的可读性较差，人员的流动、版本的更迭都会产生较大的影响，降低了对芯片测试用例进行管理的效率和效果。In the related art, technicians generally simply use a scripting language to manage test cases. However, the complexity of chip functions is different, and the number of test cases is also different. Chips with simple functions have a small set of test cases, and the direct use of scripting language management has little impact. When the chip function increases and the scale becomes larger, the readability of directly using the scripting language is poor, and the flow of personnel and the change of versions will have a greater impact, reducing the efficiency and effect of managing chip test cases.
因此，如何提高对芯片测试用例进行管理的效率和效果是本领域技术人员关注的重点问题。Therefore, how to improve the efficiency and effect of managing chip test cases is a key issue concerned by those skilled in the art.
发明内容SUMMARY OF THE INVENTION
本申请的目的是提供一种芯片测试用例处理方法、芯片测试用例处理装置、服务器以及计算机可读存储介质，以提高对芯片测试用例进行管理的效率和效果。The purpose of the present application is to provide a chip test case processing method, a chip test case processing device, a server and a computer-readable storage medium, so as to improve the efficiency and effect of managing chip test cases.
为解决上述技术问题，本申请提供一种芯片测试用例处理方法，包括：In order to solve the above technical problems, the present application provides a method for processing chip test cases, including:
基于预设格式和接收到的测试用例定义数据进行结构验证计划生成处理，得到结构验证计划文件；Based on the preset format and the received test case definition data, the structure verification plan is generated and processed, and the structure verification plan file is obtained;
基于所述结构验证计划文件对接收到的测试用例数据执行管理操作，得到仿真数据；其中，所述管理操作包括用例过滤、仿真选项定义，仿真选项修改、回归测试以及数据查看；Perform management operations on the received test case data based on the structural verification plan file to obtain simulation data; wherein, the management operations include use case filtering, simulation option definition, simulation option modification, regression testing, and data viewing;
基于预设仿真流程和所述仿真数据执行芯片仿真操作，得到仿真结果。The chip simulation operation is performed based on the preset simulation process and the simulation data to obtain simulation results.
可选的，基于预设格式和接收到的测试用例定义数据进行结构验证计划生成处理，得到结构验证计划文件，包括：Optionally, the structure verification plan generation process is performed based on the preset format and the received test case definition data to obtain the structure verification plan file, including:
将接收到的测试用例信息、测试用例属性信息作为所述测试用例定义数据；Use the received test case information and test case attribute information as the test case definition data;
基于所述预设格式将所述测试用例定义数据写入初始结构验证计划文件中，得到所述结构验证计划文件。Write the test case definition data into an initial structure verification plan file based on the preset format to obtain the structure verification plan file.
可选的，基于所述结构验证计划文件对接收到的测试用例数据执行管理操作，得到仿真数据，包括：Optionally, perform a management operation on the received test case data based on the structural verification plan file to obtain simulation data, including:
按照预设规则将所述结构验证计划文件对应的测试用例数据进行保存，得到测试用例文件夹；Save the test case data corresponding to the structural verification plan file according to the preset rules to obtain a test case folder;
对所述测试用例文件夹执行所述管理操作，得到所述仿真数据。The management operation is performed on the test case folder to obtain the simulation data.
可选的，基于预设仿真流程和所述仿真数据执行芯片仿真操作，得到仿真结果，包括：Optionally, a chip simulation operation is performed based on a preset simulation process and the simulation data to obtain a simulation result, including:
将所述仿真数据导入到仿真工具；importing the simulation data into a simulation tool;
控制所述仿真工具基于所述仿真数据中的配置信息执行仿真操作，得到仿真结果。The simulation tool is controlled to perform a simulation operation based on the configuration information in the simulation data, and a simulation result is obtained.
可选的，基于预设仿真流程和所述仿真数据执行芯片仿真操作，得到仿真结果，包括：Optionally, a chip simulation operation is performed based on a preset simulation process and the simulation data to obtain a simulation result, including:
通过UI界面接收测试用例操作指令；Receive test case operation instructions through the UI interface;
基于所述测试用例操作指令对所述仿真数据执行操作，得到待仿真数据；Perform operations on the simulation data based on the test case operation instructions to obtain data to be simulated;
当通过所述UI界面接收到执行指令时，基于所述执行指令对应的待仿真数据执行仿真操作，得到所述仿真结果。When an execution instruction is received through the UI interface, a simulation operation is performed based on the data to be simulated corresponding to the execution instruction to obtain the simulation result.
可选的，所述预设仿真流程，包括：环境安装操作、仿真指令执行操作、仿真结果分析操作。Optionally, the preset simulation process includes: an environment installation operation, a simulation instruction execution operation, and a simulation result analysis operation.
可选的，还包括：Optionally, also include:
基于预设检索指令对所述仿真结果进行分析，得到分析结果。The simulation result is analyzed based on the preset retrieval instruction to obtain the analysis result.
本申请还提供一种芯片测试用例处理装置，包括：The application also provides a chip test case processing device, including:
测试数据接收模块，用于基于预设格式和接收到的测试用例定义数据进行结构验证计划生成处理，得到结构验证计划文件；The test data receiving module is used to generate and process the structure verification plan based on the preset format and the received test case definition data, and obtain the structure verification plan file;
测试数据管理模块，用于基于所述结构验证计划文件对接收到的测试用例数据执行管理操作，得到仿真数据；其中，所述管理操作包括用例过滤、仿真选项定义，仿真选项修改、回归测试以及数据查看；A test data management module, configured to perform management operations on the received test case data based on the structural verification plan file to obtain simulation data; wherein the management operations include use case filtering, simulation option definition, simulation option modification, regression testing, and data viewing;
芯片仿真模块，用于基于预设仿真流程和所述仿真数据执行芯片仿真操作，得到仿真结果。The chip emulation module is used for performing chip emulation operations based on the preset emulation process and the emulation data to obtain emulation results.
本申请还提供一种服务器，包括：The application also provides a server, including:
存储器，用于存储计算机程序；memory for storing computer programs;
处理器，用于执行所述计算机程序时实现如上所述的芯片测试用例处理方法的步骤。The processor is configured to implement the steps of the above-mentioned chip test case processing method when executing the computer program.
本申请还提供一种计算机可读存储介质，所述计算机可读存储介质上存储有计算机程序，所述计算机程序被处理器执行时实现如上所述的芯片测试用例处理方法的步骤。The present application also provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the above-mentioned method for processing a chip test case are implemented.
本申请所提供的一种芯片测试用例处理方法，包括：基于预设格式和接收到的测试用例定义数据进行结构验证计划生成处理，得到结构验证计划文件；基于所述结构验证计划文件对接收到的测试用例数据执行管理操作，得到仿真数据；其中，所述管理操作包括用例过滤、仿真选项定义，仿真选项修改、回归测试以及数据查看；基于预设仿真流程和所述仿真数据执行芯片仿真操作，得到仿真结果。A method for processing a chip test case provided by the present application includes: performing a structure verification plan generation process based on a preset format and received test case definition data to obtain a structure verification plan file; Perform management operations on the test case data to obtain simulation data; wherein, the management operations include use case filtering, simulation option definition, simulation option modification, regression testing, and data viewing; chip simulation operations are performed based on the preset simulation process and the simulation data. , get the simulation results.
通过接收到的测试用例定义数据生成对应的结构验证计划文件，在此基础上，基于所述结构验证计划文件对接收到的测试用例数据执行管理操作，得到仿真数据，而不是通过人工的方式对测试用例进行管理，最后基于预设仿真流程和所述仿真数据执行芯片仿真操作，得到仿真结果，提高了对芯片测试用例进行管理的效率和效果。The corresponding structural verification plan file is generated by the received test case definition data, and on this basis, the management operation is performed on the received test case data based on the structural verification plan file to obtain the simulation data, instead of manually The test cases are managed, and finally the chip simulation operation is performed based on the preset simulation process and the simulation data, and the simulation results are obtained, which improves the efficiency and effect of managing the chip test cases.
本申请还提供一种芯片测试用例处理装置、服务器以及计算机可读存储介质，具有以上有益效果，在此不做赘述。The present application also provides a chip test case processing device, a server, and a computer-readable storage medium, which have the above beneficial effects, and will not be repeated here.
附图说明Description of drawings
为了更清楚地说明本申请实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本申请的实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据提供的附图获得其他的附图。In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the accompanying drawings required for the description of the embodiments or the prior art. Obviously, the drawings in the following description are only It is an embodiment of the present application. For those of ordinary skill in the art, other drawings can also be obtained according to the provided drawings without any creative effort.
图1为本申请实施例所提供的一种芯片测试用例处理方法的流程图；FIG. 1 is a flowchart of a method for processing a chip test case provided by an embodiment of the present application;
图2为本申请实施例所提供的一种芯片测试用例处理装置的结构示意图。FIG. 2 is a schematic structural diagram of a device for processing a chip test case provided by an embodiment of the present application.
具体实施方式Detailed ways
本申请的核心是提供一种芯片测试用例处理方法、芯片测试用例处理装置、服务器以及计算机可读存储介质，以提高对芯片测试用例进行管理的效率和效果。The core of the present application is to provide a chip test case processing method, a chip test case processing device, a server, and a computer-readable storage medium, so as to improve the efficiency and effect of chip test case management.
为使本申请实施例的目的、技术方案和优点更加清楚，下面将结合本申请实施例中的附图，对本申请实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例是本申请一部分实施例，而不是全部的实施例。基于本申请中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本申请保护的范围。In order to make the purposes, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments It is a part of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.
相关技术中，技术人员一般是简单的采用脚本语言管理测试用例，然而，芯片功能的复杂度不同，测试用例数目也不尽相同。功能简单的芯片，其测试用例集小，直接采用脚本语言管理影响不大。当芯片功能增加，规模变大，直接采用脚本语言的可读性较差，人员的流动、版本的更迭都会产生较大的影响，降低了对芯片测试用例进行管理的效率和效果。In the related art, technicians generally simply use a scripting language to manage test cases. However, the complexity of chip functions is different, and the number of test cases is also different. Chips with simple functions have a small set of test cases, and the direct use of scripting language management has little impact. When the chip function increases and the scale becomes larger, the readability of directly using the scripting language is poor, and the flow of personnel and the change of versions will have a greater impact, reducing the efficiency and effect of managing chip test cases.
因此，本申请提供一种芯片测试用例处理方法，通过接收到的测试用例定义数据生成对应的结构验证计划文件，在此基础上，基于所述结构验证计划文件对接收到的测试用例数据执行管理操作，得到仿真数据，而不是通过人工的方式对测试用例进行管理，最后基于预设仿真流程和所述仿真数据执行芯片仿真操作，得到仿真结果，提高了对芯片测试用例进行管理的效率和效果。Therefore, the present application provides a chip test case processing method, which generates a corresponding structural verification plan file based on the received test case definition data, and on this basis, performs management on the received test case data based on the structural verification plan file. operation, obtain simulation data, instead of manually managing test cases, and finally perform chip simulation operations based on the preset simulation process and the simulation data to obtain simulation results, which improves the efficiency and effect of chip test case management .
以下通过一个实施例，对本申请提供的一种芯片测试用例处理方法进行说明。The following describes a method for processing a chip test case provided by the present application through an embodiment.
请参考图1，图1为本申请实施例所提供的一种芯片测试用例处理方法的流程图。Please refer to FIG. 1 , which is a flowchart of a method for processing a chip test case provided by an embodiment of the present application.
本实施例中，该方法可以包括：In this embodiment, the method may include:
S101，基于预设格式和接收到的测试用例定义数据进行结构验证计划生成处理，得到结构验证计划文件；S101, performing a structure verification plan generation process based on the preset format and the received test case definition data to obtain a structure verification plan file;
可见，本步骤旨在基于预设格式和接收到的测试用例定义数据进行结构性验证计划生成处理，得到对应的结构验证计划文件。其中，该结构验证计划文件用于对测试用例的管理和使用过程进行控制。也就是，本实施例中为了实现对芯片测试用例进行自动化的处理和管理，而不是通过手动的方式进行处理。因此，需要基于结构验证计划文件实现对应的自动化的操作。It can be seen that this step aims to generate a structural verification plan based on the preset format and the received test case definition data, and obtain a corresponding structural verification plan file. Among them, the structure verification plan file is used to control the management and use process of test cases. That is, in this embodiment, in order to realize the automatic processing and management of the chip test case, the processing is not performed manually. Therefore, corresponding automated operations need to be implemented based on the structural verification plan file.
其中，预设格式是指该结构验证计划文件进行构建的一定的格式，以便计算机可以按照该预设格式获取和识别到该文件中的内容。The preset format refers to a certain format in which the structural verification plan file is constructed, so that the computer can acquire and recognize the content in the file according to the preset format.
其中，测试用例定义数据是技术人员或用户输入的对应的用于对结构验证计划文件中对于测试用例进行定义和属性定义的数据。Wherein, the test case definition data is corresponding data input by a technician or a user and used to define test cases and attribute definitions in the structural verification plan file.
进一步的，本步骤可以包括：Further, this step may include:
步骤1，将接收到的测试用例信息、测试用例属性信息作为测试用例定义数据；Step 1, use the received test case information and test case attribute information as test case definition data;
步骤2，基于预设格式将测试用例定义数据写入初始结构验证计划文件中，得到结构验证计划文件。Step 2: Write the test case definition data into the initial structural verification plan file based on the preset format to obtain the structural verification plan file.
可见，本可选方案中主要是说明如何获取到结构验证计划文件。本可选方案中，将接收到的测试用例信息、测试用例属性信息作为测试用例定义数据，基于预设格式将测试用例定义数据写入初始结构验证计划文件中，得到结构验证计划文件。It can be seen that this optional solution mainly describes how to obtain the structural verification plan file. In this optional solution, the received test case information and test case attribute information are used as test case definition data, and the test case definition data is written into the initial structural verification plan file based on a preset format to obtain the structural verification plan file.
S102，基于结构验证计划文件对接收到的测试用例数据执行管理操作，得到仿真数据；其中，管理操作包括用例过滤、仿真选项定义，仿真选项修改、回归测试以及数据查看；S102, perform a management operation on the received test case data based on the structural verification plan file to obtain simulation data; wherein, the management operation includes use case filtering, simulation option definition, simulation option modification, regression testing, and data viewing;
在S101的基础上，本步骤旨在基于结构验证计划文件对接收到的测试用例数据执行管理操作，得到仿真数据；其中，管理操作包括用例过滤、仿真选项定义，仿真选项修改、回归测试以及数据查看。On the basis of S101, this step aims to perform management operations on the received test case data based on the structural verification plan file to obtain simulation data; the management operations include use case filtering, simulation option definition, simulation option modification, regression testing and data Check.
可见，本步骤旨在获取到结构验证计划文件的基础上，基于结构验证计划文件中对于测试用例的配置信息对测试用例进行相应的配置操作，得到对应的仿真数据。It can be seen that the purpose of this step is to perform corresponding configuration operations on the test case based on the configuration information for the test case in the structural verification plan file on the basis of obtaining the structural verification plan file to obtain corresponding simulation data.
进一步的，本步骤可以包括：Further, this step may include:
步骤1，按照预设规则将结构验证计划文件对应的测试用例数据进行保存，得到测试用例文件夹；Step 1, save the test case data corresponding to the structure verification plan file according to the preset rules, and obtain the test case folder;
步骤2，对测试用例文件夹执行管理操作，得到仿真数据。Step 2, perform management operations on the test case folder to obtain simulation data.
可见，本可选方案中主要是说明如何获取到仿真数据。本可选方案中，按照预设规则将结构验证计划文件对应的测试用例数据进行保存，得到测试用例文件夹，对测试用例文件夹执行管理操作，得到仿真数据。It can be seen that this optional solution mainly describes how to obtain the simulation data. In this optional solution, the test case data corresponding to the structure verification plan file is saved according to the preset rules to obtain a test case folder, and a management operation is performed on the test case folder to obtain the simulation data.
S103，基于预设仿真流程和仿真数据执行芯片仿真操作，得到仿真结果。S103, a chip simulation operation is performed based on a preset simulation process and simulation data to obtain a simulation result.
在S102的基础上，本步骤旨在基于预设仿真流程和仿真数据执行芯片仿真操作，得到仿真结果。On the basis of S102, this step aims to perform a chip simulation operation based on a preset simulation process and simulation data to obtain a simulation result.
可见，本步骤在获取到对应的仿真数据的基础上可以基于对应的仿真工具执行该仿真操作，得到该仿真结果。其中，仿真数据包括了对应仿真工具进行控制的仿真命令。It can be seen that in this step, the simulation operation can be performed based on the corresponding simulation tool on the basis of obtaining the corresponding simulation data to obtain the simulation result. The simulation data includes simulation commands for controlling the corresponding simulation tools.
进一步的，本步骤可以包括：Further, this step may include:
步骤1，将仿真数据导入到仿真工具；Step 1, import the simulation data into the simulation tool;
步骤2，控制仿真工具基于仿真数据中的配置信息执行仿真操作，得到仿真结果。Step 2, the simulation tool is controlled to perform a simulation operation based on the configuration information in the simulation data, and a simulation result is obtained.
可见，本可选方案中主要是说明如何后台执行仿真操作。本可选方案中，将仿真数据导入到仿真工具，控制仿真工具基于仿真数据中的配置信息执行仿真操作，得到仿真结果。其中，仿真工具可以采用现有技术提供的任意一种仿真工具。相应的，选择对应的仿真工具需要选择对应的仿真命令。It can be seen that this optional solution mainly describes how to perform the simulation operation in the background. In this optional solution, the simulation data is imported into the simulation tool, and the simulation tool is controlled to perform a simulation operation based on the configuration information in the simulation data to obtain a simulation result. The simulation tool may use any simulation tool provided in the prior art. Correspondingly, selecting a corresponding simulation tool requires selecting a corresponding simulation command.
进一步的，本步骤可以包括：Further, this step may include:
步骤1，通过UI界面接收测试用例操作指令；Step 1: Receive test case operation instructions through the UI interface;
步骤2，基于测试用例操作指令对仿真数据执行操作，得到待仿真数据；Step 2, performing operations on the simulation data based on the test case operation instructions to obtain the data to be simulated;
步骤3，当通过UI界面接收到执行指令时，基于执行指令对应的待仿真数据执行仿真操作，得到仿真结果。Step 3: When an execution instruction is received through the UI interface, a simulation operation is performed based on the to-be-simulated data corresponding to the execution instruction, and a simulation result is obtained.
可见，本可选方案中主要是说明如何通过UI界面可视化地执行仿真操作。本可选方案中，通过UI界面接收测试用例操作指令，基于测试用例操作指令对仿真数据执行操作，得到待仿真数据，当通过UI界面接收到执行指令时，基于执行指令对应的待仿真数据执行仿真操作，得到仿真结果。其中，通过对应的UI界面技术人员可以输入对应的控制信息或者是控制选项，以便对仿真的过程进行控制，以便提高进行控制的有效性。It can be seen that this optional solution mainly describes how to visually perform the simulation operation through the UI interface. In this optional solution, the test case operation instruction is received through the UI interface, and the simulation data is operated based on the test case operation instruction to obtain the data to be simulated. When the execution instruction is received through the UI interface, the execution instruction is executed based on the to-be-simulated data corresponding to the execution instruction Simulate the operation and get the simulation result. The technicians can input corresponding control information or control options through the corresponding UI interface, so as to control the simulation process, so as to improve the effectiveness of the control.
进一步的，本步骤可以包括：Further, this step may include:
预设仿真流程，包括：环境安装操作、仿真指令执行操作、仿真结果分析操作。The preset simulation process includes: environment installation operation, simulation instruction execution operation, and simulation result analysis operation.
可见，本可选方案中主要是说明什么是预设仿真流程。本可选方案中，该预设仿真流程，包括：环境安装操作、仿真指令执行操作、仿真结果分析操作。It can be seen that this optional solution mainly describes what is the preset simulation process. In this optional solution, the preset simulation process includes: environment installation operation, simulation instruction execution operation, and simulation result analysis operation.
进一步的，本实施例还可以包括：Further, this embodiment may also include:
基于预设检索指令对仿真结果进行分析，得到分析结果。The simulation results are analyzed based on the preset retrieval instructions, and the analysis results are obtained.
可见，本可选方案中主要是说明如何分析得到分析结果。本可选方案中，基于预设检索指令对仿真结果进行分析，得到分析结果。It can be seen that this optional solution mainly describes how to analyze and obtain the analysis result. In this optional solution, the simulation result is analyzed based on the preset retrieval instruction to obtain the analysis result.
综上，本实施例通过接收到的测试用例定义数据生成对应的结构验证计划文件，在此基础上，基于结构验证计划文件对接收到的测试用例数据执行管理操作，得到仿真数据，而不是通过人工的方式对测试用例进行管理，最后基于预设仿真流程和仿真数据执行芯片仿真操作，得到仿真结果，提高了对芯片测试用例进行管理的效率和效果。To sum up, in this embodiment, a corresponding structural verification plan file is generated by using the received test case definition data. The test cases are managed manually, and finally the chip simulation operation is performed based on the preset simulation process and simulation data, and the simulation results are obtained, which improves the efficiency and effect of the management of the chip test cases.
以下通过一个具体的实施例，对本申请提供的一种芯片测试用例处理方法做进一步说明。A method for processing a chip test case provided by the present application will be further described below through a specific embodiment.
本实施例中，为了便于功能实现，实现便利的操作性和管理的高效率，提高收敛速度，使用结构化验证方法，在唯一原始输入文件中定义测试用例的各种属性。用户可根据验证计划，在其中定义所需的测试用例，并根据需要自行添加用例对应属性，以用于用例管理及仿真。输入文件须符合一定的格式定义要求，可用多种语言来实现。其的格式定义可以如下：In this embodiment, in order to facilitate function realization, realize convenient operability and high management efficiency, and improve the convergence speed, a structured verification method is used to define various attributes of the test case in a unique original input file. According to the verification plan, users can define the required test cases in it, and add the corresponding attributes of the use cases according to their own needs for use case management and simulation. The input file must meet certain format definition requirements and can be implemented in multiple languages. Its format definition can be as follows:
针对验证时对芯片中不同模块的划分，本方法同样支持多个输入文件的嵌套管理，在顶层文件中导入子文件即可，方便用例划分管理。For the division of different modules in the chip during verification, this method also supports nested management of multiple input files, and it is sufficient to import sub-files in the top-level file, which is convenient for use case division management.
进一步的，对测试用例进行管理。Further, the test cases are managed.
为了用例管理的简便，提高管理效率，本实施例对用例文件存放层次做出定义，规定所有用例单独成立文件夹，统一放在tc文件夹内对应模块文件夹下，该结构可由工具自动生成。针对不同用例的仿真选项不同问题，每条用例文件夹下会存在一个对应仿真配置文件，同样可由工具自动生成，并可由用户配置。同样，为了工作目录的整洁，本方法将仿真路径统一规定在simulation文件夹下，其路径管理与上述用例路径类似。In order to simplify the use case management and improve the management efficiency, this embodiment defines the storage level of the use case files, and stipulates that all use cases have separate folders and are placed under the corresponding module folder in the tc folder. The structure can be automatically generated by the tool. For different simulation options for different use cases, there will be a corresponding simulation configuration file under each use case folder, which can also be automatically generated by the tool and configured by the user. Similarly, for the cleanliness of the working directory, this method uniformly specifies the simulation path under the simulation folder, and its path management is similar to the above use case path.
另外，由于芯片设计规模越来越大，采用随机化来保证激励集的完整性。为了适配需求，对于需要random的测试用例，本专利采用的方法是：源用例不变，在HVP(Hierarchical Verification Plan，结构验证计划)中将其“random”属性设为相应随机次数number，工具将会在数据库中将其复制number份，并加上相应后缀，于不同目录下并行仿真。In addition, due to the increasing scale of chip designs, randomization is used to ensure the integrity of the excitation set. In order to adapt to the requirements, for the test cases that need random, the method adopted in this patent is: the source use case remains unchanged, and its "random" attribute is set to the corresponding random number in the HVP (Hierarchical Verification Plan, structural verification plan), the tool It will be copied number copies in the database, and the corresponding suffix will be added, and the simulation will be performed in parallel in different directories.
进一步的，本实施例可以基于PyQt5搭建可视化操作界面，在工具UI界面中导入所需HVP文件即可对测试用例进行管理。其原理为通过Python软件，从HVP文件中提取每一个测试用例的所有属性，包括用例所属VO、优先级(priority)、负责人(owner)等等相关信息，生成数据库，并在UI界面中对导入的测试用例进行相应功能操作。Further, in this embodiment, a visual operation interface can be built based on PyQt5, and test cases can be managed by importing the required HVP file in the tool UI interface. The principle is to extract all the attributes of each test case from the HVP file through Python software, including the VO, priority, owner and other related information of the use case, generate a database, and compare it in the UI interface. The imported test cases perform corresponding functional operations.
本实施例的管理功能可以包括：测试用例的过滤分类，仿真选项的定义、修改，回归测试，仿真文件的查看，仿真结果的分析及报告。The management functions of this embodiment may include: filtering and classifying test cases, defining and modifying simulation options, regression testing, viewing simulation files, and analyzing and reporting simulation results.
为了用例状态及验证进度的追。在回归测试时，工具会将结果保存下来，并根据每次回归测试的结果，总结生成可视化的回归报告，标记出覆盖率、用例通过率等。可以清晰的展示出验证进展，方便验证经理把控验证进度。To track the use case status and verification progress. During the regression test, the tool will save the results, and based on the results of each regression test, summarize and generate a visual regression report, marking the coverage rate, use case pass rate, etc. The verification progress can be clearly displayed, which is convenient for the verification manager to control the verification progress.
为了方便仿真管理，实现不同仿真软件及软硬件协同仿真的兼容，本实施例定义了三个仿真步骤：pre，run，post。在仿真时，三个步骤按照顺序依次执行。同样，规定了仿真过程中的仿真状态：pending、running、post process、pass、fail等来表征回归过程中测试用例的状态与结果。In order to facilitate simulation management and achieve compatibility of different simulation software and software-hardware co-simulation, this embodiment defines three simulation steps: pre, run, and post. During simulation, the three steps are executed in sequence. Similarly, the simulation state in the simulation process is specified: pending, running, post process, pass, fail, etc. to characterize the state and result of the test case in the regression process.
对上述三个仿真步骤，本方法采用YAML(Yet Another Markup Language，另一种标记语言)文件格式规定其所做内容进行了如下定义：For the above three simulation steps, the method adopts the YAML (Yet Another Markup Language, another markup language) file format to specify the content it does and defines as follows:
Pre：该步骤进行相应仿真工具的安装，环境的配置，并准备仿真所需文件。可执行用户自定义指令。Pre: This step is to install the corresponding simulation tools, configure the environment, and prepare the files required for simulation. User-defined commands can be executed.
run：该步骤执行仿真命令。run: This step executes the simulation command.
post：该步骤进行仿真结果的分析。可执行用户自定义命令。post: This step analyzes the simulation results. User-defined commands can be executed.
其实现方式多种多样，YAML语法为例的一种实现如下，也可采用其它语言进行实现。There are various ways of implementation. One implementation of YAML syntax as an example is as follows, and other languages can also be used for implementation.
基于上述三个仿真步骤，本实施例规定了两种用例仿真的方法，包括：batch模式与UI(User Interface，用户界面)仿真。Based on the above three simulation steps, this embodiment specifies two methods for use case simulation, including: batch mode and UI (User Interface, user interface) simulation.
其中，Batch模式即不使用UI界面，一次导入所有需运行的用例管理文件，工具将按照上述步骤，按照配置，持续对文件中定义的所有测试用例进行仿真，直至所有用例仿真结束，进行结果分析及收集，最后邮件通知验证经理及相关负责人。适用于版本更迭时的回归测试，可用性检查等场景。Among them, Batch mode does not use the UI interface, and imports all the use case management files that need to be run at one time. The tool will follow the above steps and configuration, and continue to simulate all the test cases defined in the file until the simulation of all use cases ends, and analyze the results. and collection, and finally notify the verification manager and relevant responsible persons by email. It is suitable for scenarios such as regression testing and usability checking during version changes.
其中，UI仿真将会调用工具的UI界面，在UI界面中实现了上述管理方法中规定的功能。可进行用例的分类管理，状态追踪，用例仿真调试，回归测试等。适用于测试用例的调试，VO、用例、覆盖率的review等场景。并可进行仿真结果的分析与保存，形成excel表格等形式的可视化文件及根据特定文件反标仿真结果等功能。The UI simulation will call the UI interface of the tool, and the functions specified in the above management method are implemented in the UI interface. Use case classification management, status tracking, use case simulation debugging, regression testing, etc. It is suitable for test case debugging, VO, use case, coverage review and other scenarios. It can analyze and save the simulation results, form visual files in the form of excel tables, and reverse the simulation results according to specific files.
以下为UI界面中用例仿真调试功能的步骤，可以包括：The following are the steps of the use case simulation debugging function in the UI interface, which can include:
仿真选项修改：选中对应用例，点击set_tc，即可对该用例的仿真选项及在HVP文件中的对应属性进行添加、修改。Modification of simulation options: Select the application case and click set_tc to add and modify the simulation options of the use case and the corresponding attributes in the HVP file.
提交仿真：选中对应测试用例，点击submit(可多选与反选)，工具即会在后台调用相应仿真工具进行仿真。Submit simulation: Select the corresponding test case, click submit (multiple selection and inverse selection), and the tool will call the corresponding simulation tool in the background to simulate.
中止仿真：选中对应测试用例，点击kill，工具将会结束该任务。Abort simulation: Select the corresponding test case, click kill, and the tool will end the task.
状态显示：UI界面中仿真过程中实时显示上述规定的用例仿真状态及时间等信息。Status display: In the UI interface, the simulation status and time of the use case specified above are displayed in real time during the simulation process.
除此之外，还有重新分析日志分件(redo post)，结果反标(reload result)等功能。In addition, there are functions such as re-analyzing log parts (redo post) and reloading results.
在仿真运行结束后，本实施例将会对用户定义的日志文件及关键词进行检索，根据检索结果判断测试用例是否通过。若用例通过，保存状态及覆盖率文件；若用例失败，则保留仿真结果，删除其对应覆盖率文件，不参与覆盖率收集；并触发邮件系统，将用例仿真失败原因通知对应责任人。After the simulation operation ends, the present embodiment will search the log files and keywords defined by the user, and judge whether the test case passes or not according to the search results. If the use case passes, save the status and coverage files; if the use case fails, keep the simulation results, delete the corresponding coverage files, and do not participate in coverage collection; and trigger the email system to notify the corresponding responsible person of the reason for the use case simulation failure.
可见，本实施例通过接收到的测试用例定义数据生成对应的结构验证计划文件，在此基础上，基于结构验证计划文件对接收到的测试用例数据执行管理操作，得到仿真数据，而不是通过人工的方式对测试用例进行管理，最后基于预设仿真流程和仿真数据执行芯片仿真操作，得到仿真结果，提高了对芯片测试用例进行管理的效率和效果。It can be seen that in this embodiment, a corresponding structural verification plan file is generated by the received test case definition data. The test case is managed in a way, and finally the chip simulation operation is performed based on the preset simulation process and simulation data, and the simulation result is obtained, which improves the efficiency and effect of the management of the chip test case.
下面对本申请实施例提供的芯片测试用例处理装置进行介绍，下文描述的芯片测试用例处理装置与上文描述的芯片测试用例处理方法可相互对应参照。The following describes the chip test case processing apparatus provided by the embodiments of the present application. The chip test case processing apparatus described below and the chip test case processing method described above may refer to each other correspondingly.
请参考图2，图2为本申请实施例所提供的一种芯片测试用例处理装置的结构示意图。Please refer to FIG. 2 , which is a schematic structural diagram of an apparatus for processing a chip test case provided by an embodiment of the present application.
本实施例中，该装置可以包括：In this embodiment, the device may include:
测试数据接收模块100，用于基于预设格式和接收到的测试用例定义数据进行结构验证计划生成处理，得到结构验证计划文件；The test
测试数据管理模块200，用于基于结构验证计划文件对接收到的测试用例数据执行管理操作，得到仿真数据；其中，管理操作包括用例过滤、仿真选项定义，仿真选项修改、回归测试以及数据查看；The test
芯片仿真模块300，用于基于预设仿真流程和仿真数据执行芯片仿真操作，得到仿真结果。The
可选的，该测试数据接收模块100，具体用于将接收到的测试用例信息、测试用例属性信息作为测试用例定义数据；基于预设格式将测试用例定义数据写入初始结构验证计划文件中，得到结构验证计划文件。Optionally, the test
可选的，该测试数据管理模块200，具体用于按照预设规则将结构验证计划文件对应的测试用例数据进行保存，得到测试用例文件夹；对测试用例文件夹执行管理操作，得到仿真数据。Optionally, the test
可选的，该芯片仿真模块300，具体用于将仿真数据导入到仿真工具；控制仿真工具基于仿真数据中的配置信息执行仿真操作，得到仿真结果。Optionally, the
可选的，该芯片仿真模块300，具体用于通过UI界面接收测试用例操作指令；基于测试用例操作指令对仿真数据执行操作，得到待仿真数据；当通过UI界面接收到执行指令时，基于执行指令对应的待仿真数据执行仿真操作，得到仿真结果。Optionally, the
可选的，该装置还可以包括：Optionally, the device may also include:
结果分析模块，用于基于预设检索指令对仿真结果进行分析，得到分析结果。The result analysis module is used to analyze the simulation result based on the preset retrieval instruction to obtain the analysis result.
本申请实施例还提供一种服务器，包括：The embodiment of the present application also provides a server, including:
存储器，用于存储计算机程序；memory for storing computer programs;
处理器，用于执行所述计算机程序时实现如以上实施例所述的芯片测试用例处理方法的步骤。The processor is configured to implement the steps of the chip test case processing method described in the above embodiments when executing the computer program.
本申请实施例还提供一种计算机可读存储介质，所述计算机可读存储介质上存储有计算机程序，所述计算机程序被处理器执行时实现如以上实施例所述的芯片测试用例处理方法的步骤。Embodiments of the present application further provide a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the method for processing a chip test case described in the above embodiment is implemented. step.
说明书中各个实施例采用递进的方式描述，每个实施例重点说明的都是与其他实施例的不同之处，各个实施例之间相同相似部分互相参见即可。对于实施例公开的装置而言，由于其与实施例公开的方法相对应，所以描述的比较简单，相关之处参见方法部分说明即可。The various embodiments in the specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments, and the same and similar parts between the various embodiments can be referred to each other. As for the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant part can be referred to the description of the method.
专业人员还可以进一步意识到，结合本文中所公开的实施例描述的各示例的单元及算法步骤，能够以电子硬件、计算机软件或者二者的结合来实现，为了清楚地说明硬件和软件的可互换性，在上述说明中已经按照功能一般性地描述了各示例的组成及步骤。这些功能究竟以硬件还是软件方式来执行，取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能，但是这种实现不应认为超出本申请的范围。Professionals may further realize that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two, in order to clearly illustrate the possibilities of hardware and software. Interchangeability, the above description has generally described the components and steps of each example in terms of functionality. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each particular application, but such implementations should not be considered beyond the scope of this application.
结合本文中所公开的实施例描述的方法或算法的步骤可以直接用硬件、处理器执行的软件模块，或者二者的结合来实施。软件模块可以置于随机存储器(RAM)、内存、只读存储器(ROM)、电可编程ROM、电可擦除可编程ROM、寄存器、硬盘、可移动磁盘、CD-ROM、或技术领域内所公知的任意其它形式的存储介质中。The steps of a method or algorithm described in conjunction with the embodiments disclosed herein may be directly implemented in hardware, a software module executed by a processor, or a combination of the two. A software module can be placed in random access memory (RAM), internal memory, read only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, removable disk, CD-ROM, or any other in the technical field. in any other known form of storage medium.
以上对本申请所提供的一种芯片测试用例处理方法、芯片测试用例处理装置、服务器以及计算机可读存储介质进行了详细介绍。本文中应用了具体个例对本申请的原理及实施方式进行了阐述，以上实施例的说明只是用于帮助理解本申请的方法及其核心思想。应当指出，对于本技术领域的普通技术人员来说，在不脱离本申请原理的前提下，还可以对本申请进行若干改进和修饰，这些改进和修饰也落入本申请权利要求的保护范围内。A method for processing a chip test case, an apparatus for processing a chip test case, a server, and a computer-readable storage medium provided by the present application have been described above in detail. Specific examples are used herein to illustrate the principles and implementations of the present application, and the descriptions of the above embodiments are only used to help understand the methods and core ideas of the present application. It should be pointed out that for those of ordinary skill in the art, without departing from the principles of the present application, several improvements and modifications can also be made to the present application, and these improvements and modifications also fall within the protection scope of the claims of the present application.
Claims (10)
Translated fromChinesePriority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111445180.0ACN114297961A (en) | 2021-11-30 | 2021-11-30 | A chip test case processing method and related device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111445180.0ACN114297961A (en) | 2021-11-30 | 2021-11-30 | A chip test case processing method and related device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114297961Atrue CN114297961A (en) | 2022-04-08 |
Family
ID=80966064
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111445180.0APendingCN114297961A (en) | 2021-11-30 | 2021-11-30 | A chip test case processing method and related device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114297961A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114781324A (en)* | 2022-04-27 | 2022-07-22 | 山东云海国创云计算装备产业创新中心有限公司 | A system verification simulation method, system, device and medium |
| CN114781311A (en)* | 2022-04-29 | 2022-07-22 | 上海概伦电子股份有限公司 | Method and device for processing semiconductor device model test data |
| CN114817015A (en)* | 2022-04-14 | 2022-07-29 | 芯天下技术股份有限公司 | Test case coverage rate statistical method and device, electronic equipment and storage medium |
| CN115186454A (en)* | 2022-06-23 | 2022-10-14 | 北京控制工程研究所 | Large-batch simulation management method for spacecraft control system |
| CN115600528A (en)* | 2022-09-16 | 2023-01-13 | 北京物芯科技有限责任公司（Cn） | Simulation verification control method and device, computing equipment and storage medium |
| CN115983191A (en)* | 2022-11-28 | 2023-04-18 | 海光集成电路设计(北京)有限公司 | Test point verification method and related device |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102156784A (en)* | 2011-04-18 | 2011-08-17 | 烽火通信科技股份有限公司 | Verifying environment patterned chip verifying method and device |
| CN102331967A (en)* | 2011-06-15 | 2012-01-25 | 烽火通信科技股份有限公司 | Method for managing chip verification test cases |
| CN111832236A (en)* | 2020-06-29 | 2020-10-27 | 山东云海国创云计算装备产业创新中心有限公司 | A chip regression test method, system, electronic device and storage medium |
| CN111859830A (en)* | 2020-06-30 | 2020-10-30 | 山东云海国创云计算装备产业创新中心有限公司 | Verification plan and report generation method, device, equipment and storage medium |
| CN112131827A (en)* | 2020-09-11 | 2020-12-25 | 山东云海国创云计算装备产业创新中心有限公司 | A chip testing method, system, device and storage medium |
| CN112527587A (en)* | 2020-12-03 | 2021-03-19 | 深圳大普微电子科技有限公司 | Verification progress determining method, device, equipment and readable storage medium |
| CN113434387A (en)* | 2021-06-01 | 2021-09-24 | 中国航空工业集团公司沈阳飞机设计研究所 | Script-driven-based automatic testing tool and system |
- 2021
- 2021-11-30CNCN202111445180.0Apatent/CN114297961A/enactivePending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102156784A (en)* | 2011-04-18 | 2011-08-17 | 烽火通信科技股份有限公司 | Verifying environment patterned chip verifying method and device |
| CN102331967A (en)* | 2011-06-15 | 2012-01-25 | 烽火通信科技股份有限公司 | Method for managing chip verification test cases |
| CN111832236A (en)* | 2020-06-29 | 2020-10-27 | 山东云海国创云计算装备产业创新中心有限公司 | A chip regression test method, system, electronic device and storage medium |
| CN111859830A (en)* | 2020-06-30 | 2020-10-30 | 山东云海国创云计算装备产业创新中心有限公司 | Verification plan and report generation method, device, equipment and storage medium |
| CN112131827A (en)* | 2020-09-11 | 2020-12-25 | 山东云海国创云计算装备产业创新中心有限公司 | A chip testing method, system, device and storage medium |
| CN112527587A (en)* | 2020-12-03 | 2021-03-19 | 深圳大普微电子科技有限公司 | Verification progress determining method, device, equipment and readable storage medium |
| CN113434387A (en)* | 2021-06-01 | 2021-09-24 | 中国航空工业集团公司沈阳飞机设计研究所 | Script-driven-based automatic testing tool and system |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114817015A (en)* | 2022-04-14 | 2022-07-29 | 芯天下技术股份有限公司 | Test case coverage rate statistical method and device, electronic equipment and storage medium |
| CN114781324A (en)* | 2022-04-27 | 2022-07-22 | 山东云海国创云计算装备产业创新中心有限公司 | A system verification simulation method, system, device and medium |
| CN114781311A (en)* | 2022-04-29 | 2022-07-22 | 上海概伦电子股份有限公司 | Method and device for processing semiconductor device model test data |
| CN115186454A (en)* | 2022-06-23 | 2022-10-14 | 北京控制工程研究所 | Large-batch simulation management method for spacecraft control system |
| CN115600528A (en)* | 2022-09-16 | 2023-01-13 | 北京物芯科技有限责任公司（Cn） | Simulation verification control method and device, computing equipment and storage medium |
| CN115983191A (en)* | 2022-11-28 | 2023-04-18 | 海光集成电路设计(北京)有限公司 | Test point verification method and related device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114297961A (en) | A chip test case processing method and related device | |
| CN111832236A (en) | A chip regression test method, system, electronic device and storage medium | |
| CN109739766B (en) | System and method for rapidly building FPGA digital simulation model | |
| US10162612B2 (en) | Method and apparatus for inventory analysis | |
| CN108345532A (en) | A kind of automatic test cases generation method and device | |
| CN104794048B (en) | A kind of UI automated testing methods and system | |
| CN107562626A (en) | A kind of method that encapsulation Selenium and Sikuli realizes Web automatic tests | |
| CN112463586B (en) | Method and medium for automatically generating application program interface test case | |
| US20140101097A1 (en) | Template based database analyzer | |
| CN111026670B (en) | Test case generation method, test case generation device and storage medium | |
| CN107729238A (en) | A kind of plug-in unit adjustment method, system, device and computer-readable recording medium | |
| Remenska et al. | Using model checking to analyze the system behavior of the LHC production grid | |
| CN112506778A (en) | WEB user interface automatic test method, device, equipment and storage medium | |
| US8850407B2 (en) | Test script generation | |
| CN107391378A (en) | The generation method and device of a kind of test script | |
| CN117493188A (en) | Interface testing methods and devices, electronic equipment and storage media | |
| CN118467032A (en) | Automated UI interaction exploration method based on multimodal large model | |
| CN118779228A (en) | Vehicle OTA platform testing method, device, electronic equipment and storage medium | |
| CN103714066B (en) | Template-based database analyzer | |
| CN114896824B (en) | Joint simulation integration test verification method and device, readable storage medium and equipment | |
| CN116974826A (en) | Information processing method, device, equipment and medium for configuration items | |
| CN112799638B (en) | Non-invasive rapid development method, platform, terminal and storage medium | |
| CN108829968A (en) | Circuit diagram checking method based on Python spread function | |
| CN114625810A (en) | Sqlite 3-based equipment management system and data access control method | |
| CN114185796A (en) | Unit test case automatic generation method, device, device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |