技术领域Technical Field
本发明涉及半导体技术领域，尤其涉及一种测试向量管理系统及测试向量管理方法。The present invention relates to the field of semiconductor technology, and in particular to a test vector management system and a test vector management method.
背景技术Background Art
目前，在芯片ATE(Automatic Test Equipment，自动测试设备，用于测试芯片的自动化设备)测试领域，随着超大规模数字集成电路的发展，DFT(Design For Test，用于为了芯片测试而设计的电路)工程师递交给ATE测试工程师的测试向量组数越来越多。为了提高数字芯片的总体涵盖率，ATE测试向量产生的方法也多种多样。对于一个典型的大规模SOC芯片(System On Chip，片上系统，一般指涵盖处理单元、输入输出单元、储存单元的芯片)来说，其涉及的ATE测试向量大约总数有200～300多组。在实际的新项目验证当中，ATE测试向量一次性通过的概率并不高，DFT和ATE测试工程师需要不断地除错、验证、修改后经过多轮的迭代，才能够将这几百组向量验证通过。At present, in the field of chip ATE (Automatic Test Equipment, automatic test equipment, automated equipment for testing chips) testing, with the development of ultra-large-scale digital integrated circuits, the number of test vector groups submitted by DFT (Design For Test, circuits designed for chip testing) engineers to ATE test engineers is increasing. In order to improve the overall coverage of digital chips, there are also various methods for generating ATE test vectors. For a typical large-scale SOC chip (System On Chip, generally refers to a chip covering processing units, input and output units, and storage units), the total number of ATE test vectors involved is about 200 to 300 groups. In the actual verification of new projects, the probability of ATE test vectors passing at one time is not high. DFT and ATE test engineers need to continuously debug, verify, and modify after multiple rounds of iterations before they can verify these hundreds of vectors.
对于ATE测试向量的追溯和管理，目前采用的普遍做法是采用手动人工管理的办法。当DFT工程师有新的测试向量递送时，工程师会直接通过电子邮件或电话告知ATE测试工程师其测试向量的路径、以及文件名及其依赖的设计文件，ATE测试工程师根据DFT工程师给出的路径获取测试向量和相应文件，然后进行一对一向量编译，上机验证。如此一来，在整个项目周期，累计的向量总数目可能将达到上千组，这将耗费DFT和ATE测试工程师非常多的时间和精力，而且在管理这些向量文件时，也经常会出现纰漏。The common practice for tracing and managing ATE test vectors is to use manual management. When a DFT engineer has a new test vector to deliver, the engineer will directly inform the ATE test engineer of the path, file name and dependent design files of the test vector via email or phone. The ATE test engineer obtains the test vector and corresponding files according to the path given by the DFT engineer, and then performs one-to-one vector compilation and on-machine verification. In this way, the total number of accumulated vectors may reach thousands of groups throughout the project cycle, which will consume a lot of time and energy of DFT and ATE test engineers, and there will often be omissions when managing these vector files.
发明内容Summary of the invention
本发明提供了一种测试向量管理系统及测试向量管理方法，简化DFT测试工程师和ATE测试工程师的操作流程，减少DFT测试工程师和ATE测试工程师对测试向量管理的工作量，节省DFT和ATE测试工程师的时间和精力，降低了沟通成本，提高了工作效率；同时防止出现重复操作及操作纰漏现象。The present invention provides a test vector management system and a test vector management method, which simplify the operation process of DFT test engineers and ATE test engineers, reduce the workload of DFT test engineers and ATE test engineers on test vector management, save the time and energy of DFT and ATE test engineers, reduce communication costs, and improve work efficiency; at the same time, it prevents repeated operations and operational omissions.
第一方面，本发明提供了一种测试向量管理系统，该测试向量管理系统包括：向量递交模块、数据库模块、向量处理模块、向量验证模块、验证结果接收模块。其中，向量递交模块用于接收递交的测试向量、和每个测试向量的设计依赖文件，还用于给递交的每个测试向量分配唯一的ID(Identity Document，标识码)。数据库模块，用于关联式存储向量递交模块接收的每个测试向量、该测试向量的ID和设计依赖文件。向量处理模块用于接收对目标ID的测试向量进行转换编译的转换编译指令，并根据转换编译指令，对目标ID的测试向量进行转换编译生成转换编译测试向量；且数据库模块还用于关联式存储转换编译测试向量和目标ID。向量验证模块用于接收对目标ID的测试向量进行验证的验证指令，并根据验证指令，将目标ID的转换编译测试向量转发给测试设备。验证结果接收模块用于接收目标ID的测试向量的验证结果；且数据库模块还用于关联式存储验证结果和目标ID。In the first aspect, the present invention provides a test vector management system, which includes: a vector submission module, a database module, a vector processing module, a vector verification module, and a verification result receiving module. Among them, the vector submission module is used to receive the submitted test vector and the design dependency file of each test vector, and is also used to assign a unique ID (Identity Document, identification code) to each submitted test vector. The database module is used to associatively store each test vector received by the vector submission module, the ID of the test vector and the design dependency file. The vector processing module is used to receive a conversion compilation instruction for converting and compiling the test vector of the target ID, and according to the conversion compilation instruction, the test vector of the target ID is converted and compiled to generate a conversion compiled test vector; and the database module is also used to associatively store the conversion compiled test vector and the target ID. The vector verification module is used to receive a verification instruction for verifying the test vector of the target ID, and according to the verification instruction, the conversion compiled test vector of the target ID is forwarded to the test equipment. The verification result receiving module is used to receive the verification result of the test vector of the target ID; and the database module is also used to associatively store the verification result and the target ID.
在上述的方案中，通过设计一种专门的测试向量管理系统，DFT测试工程师在设计好测试向量之后，直接递交到测试向量管理系统，由测试向量管理系统来接收并存储DFT测试工程师递交的每个测试向量。ATE测试工程师通过登录测试向量管理系统即可对目标测试向量进行转换编译，并通过在登录管理系统即可将转换编译测试向量转发给测试设备，以对目标测试向量进行验证。在ATE测试工程师验证目标测试向量得到验证结果之后，将验证结果上传到测试向量管理系统，由DFT测试工程师登录测试向量管理系统即可查看每个测试向量的验证结果，以在某测试向量的验证结果为不通过时，对该测试向量进行修改并将修改后的测试向量再次递交到测试向量管理系统。在上述过程中，DFT测试工程师和ATE测试工程师仅面对一个测试向量管理系统即可，能够实现测试向量的递交验证等全程自动化管理，简化DFT测试工程师和ATE测试工程师的操作流程，大大减少了DFT测试工程师和ATE测试工程师对测试向量管理的工作量，节省DFT和ATE测试工程师的时间和精力，降低了沟通成本，提高了工作效率。且向量递交模块能够对DFT测试工程师递交的每个测试向量分配唯一的ID，通过唯一ID区分不同类型的测试向量、以及相同类型但不同版本的测试向量，能够防止不同测试向量的混淆，防止出现重复操作及操作纰漏现象。In the above scheme, by designing a special test vector management system, after designing the test vector, the DFT test engineer directly submits it to the test vector management system, and the test vector management system receives and stores each test vector submitted by the DFT test engineer. The ATE test engineer can convert and compile the target test vector by logging into the test vector management system, and forward the converted and compiled test vector to the test equipment by logging into the management system to verify the target test vector. After the ATE test engineer verifies the target test vector and obtains the verification result, the verification result is uploaded to the test vector management system, and the DFT test engineer logs into the test vector management system to view the verification result of each test vector, so that when the verification result of a certain test vector fails, the test vector is modified and the modified test vector is submitted to the test vector management system again. In the above process, the DFT test engineer and the ATE test engineer only need to face one test vector management system, which can realize the full-process automated management of the submission and verification of the test vector, simplify the operation process of the DFT test engineer and the ATE test engineer, greatly reduce the workload of the DFT test engineer and the ATE test engineer for the test vector management, save the time and energy of the DFT and ATE test engineers, reduce the communication cost, and improve the work efficiency. The vector submission module can assign a unique ID to each test vector submitted by the DFT test engineer. The unique ID can be used to distinguish different types of test vectors and test vectors of the same type but different versions, thereby preventing confusion between different test vectors and preventing repeated operations and operational errors.
在一个具体的实施方式中，该测试向量管理系统还包括向量列表模块，用于接收创建的向量列表，并将向量列表存储到数据库模块中。其中，向量列表中包含有多个数据列，每个测试向量对应一个数据列；数据库模块用于将每个测试向量及其ID、设计依赖文件、转换编译测试向量和验证结果，存储到每个测试向量对应的数据列中。通过预先由一方测试工程师建立向量列表，从而能够将递交的每个测试向量及其相关的测试向量信息存储到对应的数据列中，以便于对测试向量文件进行组织归类，以便于管理大量的测试向量，防止出现测试向量漏测或重复测试现象。In a specific embodiment, the test vector management system also includes a vector list module, which is used to receive the created vector list and store the vector list in the database module. The vector list contains multiple data columns, and each test vector corresponds to a data column; the database module is used to store each test vector and its ID, design dependency file, conversion and compilation test vector and verification result in the data column corresponding to each test vector. By establishing a vector list in advance by a test engineer on one side, each submitted test vector and its related test vector information can be stored in the corresponding data column, so as to organize and classify the test vector files, so as to manage a large number of test vectors and prevent the occurrence of test vector omissions or repeated tests.
在一个具体的实施方式中，该测试向量管理系统还包括关联信息记录模块，关联信息记录模块用于收集每个测试向量的关联信息；其中，关联信息包括每个测试向量的递交工程师名称、递交日期、递交路径、递交文件列表、使用的EDA(Electronic DesignAutomation，电子设计自动化)工具名称、版本号中的至少一种信息。数据库模块还用于将每个测试向量的关联信息存储到该测试向量对应的数据列中。通过收集并存储每个测试向量的关联信息，便于了解每个测试向量在不同阶段的具体历史操作信息，便于追溯及还原。In a specific embodiment, the test vector management system also includes an associated information recording module, which is used to collect associated information of each test vector; wherein the associated information includes at least one of the name of the submitting engineer, the submission date, the submission path, the submission file list, the name of the EDA (Electronic Design Automation) tool used, and the version number of each test vector. The database module is also used to store the associated information of each test vector in the data column corresponding to the test vector. By collecting and storing the associated information of each test vector, it is easy to understand the specific historical operation information of each test vector at different stages, which is convenient for tracing and restoration.
在一个具体的实施方式中，该测试向量管理系统还包括向量访问及数据统计模块，向量访问及数据统计模块用于接收统计目标类型数据的统计指令。向量访问及数据统计模块还用于根据统计指令和向量列表，生成目标类型数据。使管理者和项目经理能够随时通过测试向量管理系统查看DFT和ATE测试工程师的测试向量递交进度、递交质量、验证进度等，便于统计Time-to-Pass(每个测试向量的递交到验证通过的时间周期)等关键工作指标，有利于找到项目的瓶颈，利于后续结合统计的目标类型数据进行工作总结及改善。In a specific embodiment, the test vector management system also includes a vector access and data statistics module, which is used to receive statistical instructions for statistical target type data. The vector access and data statistics module is also used to generate target type data according to statistical instructions and vector lists. It enables managers and project managers to view the test vector submission progress, submission quality, verification progress, etc. of DFT and ATE test engineers through the test vector management system at any time, which is convenient for counting key work indicators such as Time-to-Pass (the time period from submission of each test vector to verification), which is conducive to finding the bottleneck of the project and facilitating subsequent work summary and improvement in combination with statistical target type data.
在一个具体的实施方式中，该目标类型数据为测试向量的Time-to-Pass的周期、涵盖率或测试向量所针对的缺陷类型，以便于自动统计出已导入测试向量的进度信息、质量信息及所针对的缺陷类型信息。In a specific implementation, the target type data is the Time-to-Pass cycle, coverage, or defect type targeted by the test vector, so as to automatically generate statistics on the progress information, quality information, and targeted defect type information of the imported test vector.
在一个具体的实施方式中，该测试向量管理系统还包括数据锁定模块，数据锁定模块用于锁定存储在数据库模块中的每个测试向量。确保任何人无法修改每个测试向量递交时的原始内容，实现全程管控，保证工作质量。In a specific embodiment, the test vector management system further includes a data locking module, which is used to lock each test vector stored in the database module, ensuring that no one can modify the original content of each test vector when it is submitted, achieving full-process control and ensuring work quality.
在一个具体的实施方式中，该测试向量管理系统还包括邮件通知模块，邮件通知模块用于在完成关联式存储每个测试向量、该测试向量的ID和设计依赖文件之后，向第一预设邮箱组发送通知邮件；邮件通知模块还用于在完成关联式存储转换编译测试向量和目标ID之后，向第二预设邮箱组发送通知邮件；邮件通知模块还用于在完成关联式存储验证结果和目标ID之后，向第三预设邮箱组发送通知邮件。以在每个流程节点完成之后，通过邮件通知方式通知下一流程的相关人员进行操作。In a specific embodiment, the test vector management system also includes an email notification module, which is used to send a notification email to the first preset mailbox group after completing the associative storage of each test vector, the ID of the test vector and the design dependency file; the email notification module is also used to send a notification email to the second preset mailbox group after completing the associative storage conversion compilation test vector and target ID; the email notification module is also used to send a notification email to the third preset mailbox group after completing the associative storage verification result and target ID. After each process node is completed, the relevant personnel of the next process are notified by email notification to perform operations.
第二方面，本发明还提供了一种测试向量管理方法，该测试向量管理方法包括：接收递交的测试向量、以及每个测试向量的设计依赖文件；给递交的每个测试向量分配唯一的ID；关联式存储每个测试向量、该测试向量的ID和设计依赖文件；接收对目标ID的测试向量进行转换编译的转换编译指令；根据转换编译指令，对目标ID的测试向量进行转换编译生成转换编译测试向量，并关联式存储转换编译测试向量和目标ID；接收对目标ID的测试向量进行验证的验证指令；根据验证指令，将目标ID的转换编译测试向量转发给测试设备；接收目标ID的测试向量的验证结果，并关联式存储验证结果和目标ID。In a second aspect, the present invention also provides a test vector management method, which includes: receiving submitted test vectors and design dependency files of each test vector; assigning a unique ID to each submitted test vector; associatively storing each test vector, the ID of the test vector and the design dependency files; receiving a conversion compilation instruction for converting and compiling the test vector of the target ID; according to the conversion compilation instruction, converting and compiling the test vector of the target ID to generate a conversion compiled test vector, and associatively storing the conversion compiled test vector and the target ID; receiving a verification instruction for verifying the test vector of the target ID; according to the verification instruction, forwarding the conversion compiled test vector of the target ID to a test device; receiving a verification result of the test vector of the target ID, and associatively storing the verification result and the target ID.
在上述的方案中，通过设计一种专门的测试向量管理系统，DFT测试工程师在设计好测试向量之后，直接递交到测试向量管理系统，由测试向量管理系统来接收并存储DFT测试工程师递交的每个测试向量。ATE测试工程师通过登录测试向量管理系统即可对目标测试向量进行转换编译，并通过在登录管理系统即可将转换编译测试向量转发给测试设备，以对目标测试向量进行验证。在ATE测试工程师验证目标测试向量得到验证结果之后，将验证结果上传到测试向量管理系统，由DFT测试工程师登录测试向量管理系统即可查看每个测试向量的验证结果，以在某测试向量的验证结果为不通过时，对该测试向量进行修改并将修改后的测试向量再次递交到测试向量管理系统。在上述过程中，DFT测试工程师和ATE测试工程师仅面对一个测试向量管理系统即可，能够实现测试向量的递交验证等全程自动化管理，简化DFT测试工程师和ATE测试工程师的操作流程，大大减少了DFT测试工程师和ATE测试工程师对测试向量管理的工作量，节省DFT和ATE测试工程师的时间和精力，降低了沟通成本，提高了工作效率。且向量递交模块能够对DFT测试工程师递交的每个测试向量分配唯一的ID，通过唯一ID区分不同类型的测试向量、以及相同类型但不同版本的测试向量，能够防止不同测试向量的混淆。In the above scheme, by designing a special test vector management system, after designing the test vector, the DFT test engineer directly submits it to the test vector management system, and the test vector management system receives and stores each test vector submitted by the DFT test engineer. The ATE test engineer can convert and compile the target test vector by logging into the test vector management system, and forward the converted and compiled test vector to the test equipment by logging into the management system to verify the target test vector. After the ATE test engineer verifies the target test vector and obtains the verification result, the verification result is uploaded to the test vector management system, and the DFT test engineer logs into the test vector management system to view the verification result of each test vector, so that when the verification result of a certain test vector fails, the test vector is modified and the modified test vector is submitted to the test vector management system again. In the above process, the DFT test engineer and the ATE test engineer only need to face one test vector management system, which can realize the full-process automated management of the submission and verification of the test vector, simplify the operation process of the DFT test engineer and the ATE test engineer, greatly reduce the workload of the DFT test engineer and the ATE test engineer for the test vector management, save the time and energy of the DFT and ATE test engineers, reduce the communication cost, and improve the work efficiency. The vector submission module can assign a unique ID to each test vector submitted by the DFT test engineer, and distinguish different types of test vectors and test vectors of the same type but different versions through the unique ID, thereby preventing confusion between different test vectors.
在一个具体的实施方式中，在接收递交的测试向量、以及每个测试向量的设计依赖文件之前，该管理方法还包括：接收创建的向量列表，并存储向量列表；其中，向量列表中包含有多个数据列，每个测试向量对应一个数据列。关联式存储每个测试向量、该测试向量的ID和设计依赖文件具体为：将每个测试向量、该测试向量的ID和设计依赖文件，存储到每个测试向量对应的数据列中。关联式存储转换编译测试向量和目标ID具体为：将转换编译测试向量存储到目标ID对应的数据列中。关联式存储验证结果和目标ID具体为：将验证结果存储到目标ID对应的数据列中。通过预先由一方测试工程师建立向量列表，从而能够将递交的每个测试向量及其相关的测试向量信息存储到对应的数据列中，以便于对测试向量文件进行组织归类，以便于管理大量的测试向量，防止出现测试向量漏测或重复测试现象。In a specific embodiment, before receiving the submitted test vectors and the design dependency files of each test vector, the management method also includes: receiving a created vector list and storing the vector list; wherein the vector list contains multiple data columns, and each test vector corresponds to a data column. The associative storage of each test vector, the ID of the test vector and the design dependency file is specifically: storing each test vector, the ID of the test vector and the design dependency file in the data column corresponding to each test vector. The associative storage of the converted compiled test vector and the target ID is specifically: storing the converted compiled test vector in the data column corresponding to the target ID. The associative storage of the verification result and the target ID is specifically: storing the verification result in the data column corresponding to the target ID. By establishing a vector list in advance by a test engineer on one side, each submitted test vector and its related test vector information can be stored in the corresponding data column, so as to facilitate the organization and classification of the test vector files, so as to facilitate the management of a large number of test vectors and prevent the occurrence of test vector omissions or repeated tests.
在一个具体的实施方式中，该测试向量管理方法还包括：在接收递交的测试向量、以及每个测试向量的设计依赖文件的同时，还收集每个测试向量的关联信息，其中，关联信息包括每个测试向量的递交工程师名称、递交日期、递交路径、递交文件列表、使用的EDA工具名称、版本号中的至少一种信息；将每个测试向量的关联信息存储到该测试向量对应的数据列中。通过收集并存储每个测试向量的关联信息，便于了解每个测试向量在不同阶段的具体历史操作信息，便于追溯及还原。In a specific embodiment, the test vector management method further includes: while receiving the submitted test vectors and the design dependency files of each test vector, the associated information of each test vector is also collected, wherein the associated information includes at least one of the name of the submitting engineer, the submission date, the submission path, the submission file list, the name of the EDA tool used, and the version number of each test vector; and the associated information of each test vector is stored in the data column corresponding to the test vector. By collecting and storing the associated information of each test vector, it is easy to understand the specific historical operation information of each test vector at different stages, and to facilitate tracing and restoration.
在一个具体的实施方式中，该测试向量管理方法还包括：接收统计目标类型数据的统计指令；根据统计指令和向量列表，生成目标类型数据。使管理者和项目经理能够随时通过测试向量管理系统查看DFT和ATE测试工程师的测试向量递交进度、递交质量、验证进度等，便于统计Time-to-Pass等关键工作指标，有利于找到项目的瓶颈，利于后续结合统计的目标类型数据进行工作总结及改善。In a specific implementation, the test vector management method further includes: receiving a statistical instruction for statistical target type data; generating target type data according to the statistical instruction and the vector list. This enables managers and project managers to view the test vector submission progress, submission quality, verification progress, etc. of DFT and ATE test engineers at any time through the test vector management system, which is convenient for statistically analyzing key work indicators such as Time-to-Pass, which is conducive to finding the bottleneck of the project, and is conducive to subsequent work summary and improvement in combination with the statistical target type data.
在一个具体的实施方式中，该目标类型数据为测试向量的Time-to-Pass的周期、涵盖率或测试向量所针对的缺陷类型，以便于自动统计出已导入测试向量的进度信息、质量信息及所针对的缺陷类型信息。In a specific implementation, the target type data is the Time-to-Pass cycle, coverage, or defect type targeted by the test vector, so as to automatically generate statistics on the progress information, quality information, and targeted defect type information of the imported test vector.
在一个具体的实施方式中，关联式存储每个测试向量、该测试向量的ID、以及该测试向量的设计依赖文件包括：锁定存储的每个测试向量。确保任何人无法修改每个测试向量递交时的原始内容，实现全程管控，保证工作质量。In a specific implementation, associatively storing each test vector, the ID of the test vector, and the design dependency file of the test vector includes: locking each stored test vector to ensure that no one can modify the original content of each test vector when it is submitted, so as to achieve full-process control and ensure work quality.
在一个具体的实施方式中，该测试向量管理方法还包括：在完成关联式存储每个测试向量、该测试向量的ID和设计依赖文件之后，向第一预设邮箱组发送通知邮件。在完成关联式存储转换编译测试向量和目标ID之后，向第二预设邮箱组发送通知邮件。在完成关联式存储验证结果和目标ID之后，向第三预设邮箱组发送通知邮件。以在每个流程节点完成之后，通过邮件通知方式通知下一流程的相关人员进行操作。In a specific embodiment, the test vector management method also includes: after completing the associative storage of each test vector, the ID of the test vector and the design dependency file, sending a notification email to the first preset mailbox group. After completing the associative storage conversion and compilation of the test vector and the target ID, sending a notification email to the second preset mailbox group. After completing the associative storage of the verification result and the target ID, sending a notification email to the third preset mailbox group. After each process node is completed, the relevant personnel of the next process are notified by email notification to perform the operation.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
图1为本发明实施例提供的一种测试向量管理系统的框图；FIG1 is a block diagram of a test vector management system provided by an embodiment of the present invention;
图2为本发明实施例提供的另一种测试向量管理系统的框图；FIG2 is a block diagram of another test vector management system provided by an embodiment of the present invention;
图3为本发明实施例提供的另一种测试向量管理系统的框图；FIG3 is a block diagram of another test vector management system provided by an embodiment of the present invention;
图4为本发明实施例提供的另一种测试向量管理系统的框图；FIG4 is a block diagram of another test vector management system provided by an embodiment of the present invention;
图5为本发明实施例提供的另一种测试向量管理系统的框图；5 is a block diagram of another test vector management system provided by an embodiment of the present invention;
图6为本发明实施例提供的另一种测试向量管理系统的框图；6 is a block diagram of another test vector management system provided by an embodiment of the present invention;
图7为本发明实施例提供的一种不同流程节点操作的示意图；FIG7 is a schematic diagram of different process node operations provided by an embodiment of the present invention;
图8为本发明实施例提供的一种不同模块工作的流程示意图；FIG8 is a schematic diagram of a process flow of different modules provided by an embodiment of the present invention;
图9为本发明实施例提供的一种测试向量管理方法的流程图。FIG. 9 is a flow chart of a test vector management method provided by an embodiment of the present invention.
附图标记：Reference numerals:
11-向量递交模块12-数据库模块13-向量处理模块11-Vector submission module 12-Database module 13-Vector processing module
14-向量验证模块15-验证结果接收模块14- Vector verification module 15- Verification result receiving module
21-向量列表模块22-数据锁定模块21-Vector list module 22-Data lock module
23-关联信息记录模块24-邮件通知模块23-Related information recording module 24-Email notification module
25-向量访问及数据统计模块25-Vector access and data statistics module
具体实施方式DETAILED DESCRIPTION
为使本发明实施例的目的、技术方案和优点更加清楚，下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
为了方便理解本发明实施例提供的测试向量管理系统，下面首先说明一下本发明实施例提供的测试向量管理系统的应用场景，该测试向量管理系统应用于DFT测试工程师初始设计测试向量和ATE测试工程师验证设计的每个测试向量的过程中，以对测试向量进行管理。下面结合附图对该测试向量管理系统进行详细的叙述。In order to facilitate understanding of the test vector management system provided by the embodiment of the present invention, the application scenario of the test vector management system provided by the embodiment of the present invention is first described below. The test vector management system is applied to the process of DFT test engineers initially designing test vectors and ATE test engineers verifying each designed test vector to manage the test vectors. The test vector management system is described in detail below in conjunction with the accompanying drawings.
参考图1，本发明实施例提供的测试向量管理系统包括：向量递交模块11、数据库模块12、向量处理模块13、向量验证模块14、验证结果接收模块15。其中，向量递交模块11用于接收递交的测试向量、和每个测试向量的设计依赖文件，还用于给递交的每个测试向量分配唯一的ID。数据库模块12，用于关联式存储向量递交模块11接收的每个测试向量、该测试向量的ID和设计依赖文件。向量处理模块13用于接收对目标ID的测试向量进行转换编译的转换编译指令，并根据转换编译指令，对目标ID的测试向量进行转换编译生成转换编译测试向量；且数据库模块12还用于关联式存储转换编译测试向量和目标ID。向量验证模块14用于接收对目标ID的测试向量进行验证的验证指令，并根据验证指令，将目标ID的转换编译测试向量转发给测试设备。验证结果接收模块15用于接收目标ID的测试向量的验证结果；且数据库模块12还用于关联式存储验证结果和目标ID。With reference to FIG1 , the test vector management system provided by the embodiment of the present invention includes: a vector submission module 11, a database module 12, a vector processing module 13, a vector verification module 14, and a verification result receiving module 15. The vector submission module 11 is used to receive the submitted test vector and the design dependency file of each test vector, and is also used to assign a unique ID to each submitted test vector. The database module 12 is used to associatively store each test vector, the ID of the test vector, and the design dependency file received by the vector submission module 11. The vector processing module 13 is used to receive a conversion compilation instruction for converting and compiling the test vector of the target ID, and convert and compile the test vector of the target ID to generate a conversion compilation test vector according to the conversion compilation instruction; and the database module 12 is also used to associatively store the conversion compilation test vector and the target ID. The vector verification module 14 is used to receive a verification instruction for verifying the test vector of the target ID, and forward the conversion compilation test vector of the target ID to the test device according to the verification instruction. The verification result receiving module 15 is used to receive the verification result of the test vector of the target ID; and the database module 12 is also used to associatively store the verification result and the target ID.
在上述的方案中，通过设计一种专门的测试向量管理系统，DFT测试工程师在设计好测试向量之后，直接递交到测试向量管理系统，由测试向量管理系统来接收并存储DFT测试工程师递交的每个测试向量。ATE测试工程师通过登录测试向量管理系统即可对目标测试向量进行转换编译，并通过在登录管理系统即可将转换编译测试向量转发给测试设备，以对目标测试向量进行验证。在ATE测试工程师验证目标测试向量得到验证结果之后，将验证结果上传到测试向量管理系统，由DFT测试工程师登录测试向量管理系统即可查看每个测试向量的验证结果，以在某测试向量的验证结果为不通过时，对该测试向量进行修改并将修改后的测试向量再次递交到测试向量管理系统。在上述过程中，DFT测试工程师和ATE测试工程师仅面对一个测试向量管理系统即可，能够实现测试向量的递交验证等全程自动化管理，简化DFT测试工程师和ATE测试工程师的操作流程，大大减少了DFT测试工程师和ATE测试工程师对测试向量管理的工作量，节省DFT和ATE测试工程师的时间和精力，降低了沟通成本，提高了工作效率。且向量递交模块11能够对DFT测试工程师递交的每个测试向量分配唯一的ID，通过唯一ID区分不同类型的测试向量、以及相同类型但不同版本的测试向量，能够防止不同测试向量的混淆，防止出现重复操作及操作纰漏现象。下面结合附图对上述各个模块进行详细的介绍。In the above scheme, by designing a special test vector management system, after designing the test vector, the DFT test engineer directly submits it to the test vector management system, and the test vector management system receives and stores each test vector submitted by the DFT test engineer. The ATE test engineer can convert and compile the target test vector by logging into the test vector management system, and forward the converted and compiled test vector to the test equipment by logging into the management system to verify the target test vector. After the ATE test engineer verifies the target test vector and obtains the verification result, the verification result is uploaded to the test vector management system, and the DFT test engineer logs into the test vector management system to view the verification result of each test vector, so that when the verification result of a certain test vector fails, the test vector is modified and the modified test vector is submitted to the test vector management system again. In the above process, the DFT test engineer and the ATE test engineer only need to face one test vector management system, which can realize the full-process automated management of the submission and verification of the test vector, simplify the operation process of the DFT test engineer and the ATE test engineer, greatly reduce the workload of the DFT test engineer and the ATE test engineer for the test vector management, save the time and energy of the DFT and ATE test engineers, reduce the communication cost, and improve the work efficiency. The vector submission module 11 can assign a unique ID to each test vector submitted by the DFT test engineer, and distinguish different types of test vectors and test vectors of the same type but different versions through the unique ID, so as to prevent confusion of different test vectors and prevent repeated operations and operational errors. The above modules are described in detail below with reference to the accompanying drawings.
参考图1、图7及图8，在设置向量递交模块11时，可以将向量递交模块11的部分功能嵌入到图形用户界面中，在DFT测试工程师设计好每个测试向量之后，通过诸如笔记本电脑、台式电脑、智能手机、平板电脑、工控机等的终端设备登录图形用户界面，打开向量递交模块11的图形窗口，通过将每个测试向量及其设计依赖文件上传到向量递交模块11的图形窗口内，实现每个测试向量的递交。需要解释的是，每个测试向量的设计依赖文件是指该测试向量对应的部分设计电路，其英文名称为Flat Model。在向量递交模块11接收到递交的测试向量、和每个测试向量的设计依赖文件之后，向量递交模块11还需要给递交的每个测试向量分配唯一的ID，该唯一的ID贯穿该测试向量的转换、编译、验证、查询统计等过程，作为每个测试向量除按照类型命名的测试向量名称之外的另一个测试向量标识，作为区分不同类型的测试向量。当然，在DFT测试工程师根据对初始提交的测试向量的验证结果，对初始提交的测试向量进行修改，得到修改版的测试向量，该修改版的测试向量与初始递交的测试向量的名称相同。在将该修改版的测试向量进行再次递交时，向量递交模块11同样会给该修改版的测试向量分配另一个新的唯一的ID，作为区分不同版本的测试向量。对应的，在针对前次修改版的测试向量再次修改得到另一个修改版的测试向量时，在向向量递交模块11递交另一个新的修改版的测试向量时，向量递交模块11依然会给该另一个修改版的测试向量分配唯一的ID，通过每个测试向量的唯一ID，能够区分不同修改版的测试向量。Referring to FIG. 1 , FIG. 7 and FIG. 8 , when setting the vector submission module 11, some functions of the vector submission module 11 can be embedded in the graphical user interface. After the DFT test engineer designs each test vector, he logs in to the graphical user interface through a terminal device such as a laptop, desktop computer, smart phone, tablet computer, industrial computer, etc., opens the graphic window of the vector submission module 11, and uploads each test vector and its design dependency file to the graphic window of the vector submission module 11 to realize the submission of each test vector. It should be explained that the design dependency file of each test vector refers to the part of the design circuit corresponding to the test vector, and its English name is Flat Model. After the vector submission module 11 receives the submitted test vector and the design dependency file of each test vector, the vector submission module 11 also needs to assign a unique ID to each submitted test vector. The unique ID runs through the conversion, compilation, verification, query statistics and other processes of the test vector, as another test vector identifier for each test vector in addition to the test vector name named according to the type, as a test vector to distinguish different types of test vectors. Of course, the DFT test engineer modifies the initially submitted test vector according to the verification result of the initially submitted test vector to obtain a modified version of the test vector, and the name of the modified version of the test vector is the same as that of the initially submitted test vector. When the modified version of the test vector is submitted again, the vector submission module 11 will also assign another new unique ID to the modified version of the test vector as a way to distinguish different versions of the test vector. Correspondingly, when the previously modified version of the test vector is modified again to obtain another modified version of the test vector, when another new modified version of the test vector is submitted to the vector submission module 11, the vector submission module 11 will still assign a unique ID to the other modified version of the test vector. Through the unique ID of each test vector, different modified versions of the test vector can be distinguished.
如图1所示，数据库模块12作为数据存储模块，其与向量递交模块11连接，以接收向量递交模块11接收的测试向量及其设计依赖文件、以及分配的唯一ID信息，并采用关联式存储的方式存储向量递交模块11接收的每个测试向量、该测试向量的ID和设计依赖文件。具体设置数据库模块12时，数据库模块12可以包括诸如硬盘、磁盘等的存储器，还包括存储控制器，来控制向存储器中写入需要存储的数据、以及从存储器中读取数据。As shown in FIG1 , the database module 12 is a data storage module, which is connected to the vector submission module 11 to receive the test vectors received by the vector submission module 11 and their design dependency files, as well as the assigned unique ID information, and uses an associative storage method to store each test vector, the ID of the test vector and the design dependency file received by the vector submission module 11. When the database module 12 is specifically set, the database module 12 may include a memory such as a hard disk, a magnetic disk, etc., and also includes a storage controller to control writing data to be stored in the memory and reading data from the memory.
在关联式存储每个测试向量及其设计依赖文件和ID时，参考图2及图8，该测试向量管理系统还可以包括一个向量列表模块21，向量列表模块21用于接收创建的向量列表，并将向量列表存储到数据库模块12中。具体应用时，当有新的产品项目导入时，预先由DFT测试工程师针对该新的产品项目设计一个ATE测试向量递交计划表，并将该ATE测试向量递交计划表传送给ATE测试工程师，ATE测试工程师会根据该新的产品项目名称来分类。具体的，根据预先由DFT测试工程师提供的ATE测试向量递交计划表、不同的ATE测试向量类型、不同的ATE测试向量所针对的测试模块，创建针对该产品项目的所有测试向量的向量列表，并将所创建的向量列表通过诸如笔记本电脑、台式电脑、智能手机、平板电脑、工控机等的终端设备登录图形用户界面，打开图形用户界面中的向量列表模块21窗口，将向量列表上传到测试向量管理模块中。由向量列表模块21将该向量列表存储到数据库模块12中，以等待DFT测试工程师针对每个测试向量的递交。其中，该向量列表中包含有多个数据列，每个测试向量均对应一个数据列，当然，一个数据列可以对应至少一个测试向量。具体的，一个测试向量仅对应一个数据列，但是一个数据列可以对应的测试向量个数可以为1个、2个、3个、4个等至少1个。可以使一个数据列存储一种测试类型的所有测试向量，或者一个数据列存储相同测试向量名称但由于修改从而版本不同的测试向量，以便于在每个数据列中存储一种测试类型或相同测试向量名称的测试向量。When each test vector and its design dependent file and ID are stored in an associative manner, referring to FIG2 and FIG8, the test vector management system may also include a vector list module 21, which is used to receive the created vector list and store the vector list in the database module 12. In specific application, when a new product project is imported, a DFT test engineer designs an ATE test vector submission plan table for the new product project in advance, and transmits the ATE test vector submission plan table to the ATE test engineer, who will classify it according to the name of the new product project. Specifically, according to the ATE test vector submission plan table provided in advance by the DFT test engineer, different ATE test vector types, and different ATE test vectors for the test modules, a vector list of all test vectors for the product project is created, and the created vector list is logged into the graphical user interface through a terminal device such as a laptop, a desktop computer, a smart phone, a tablet computer, an industrial computer, etc., and the vector list module 21 window in the graphical user interface is opened to upload the vector list to the test vector management module. The vector list module 21 stores the vector list in the database module 12 to wait for the DFT test engineer to submit each test vector. The vector list includes multiple data columns, each test vector corresponds to a data column, and of course, a data column can correspond to at least one test vector. Specifically, a test vector corresponds to only one data column, but the number of test vectors that a data column can correspond to can be 1, 2, 3, 4, or at least 1. A data column can store all test vectors of a test type, or a data column can store test vectors with the same test vector name but different versions due to modification, so as to store test vectors of a test type or the same test vector name in each data column.
在DFT测试工程师通过向量递交模块11完成至少一个测试向量的递交之后，数据库模块12具体关联存储每个测试向量及其ID和设计依赖文件等相关文件时，数据库模块12将每个测试向量及其ID、设计依赖文件、转换编译测试向量和验证结果，存储到每个测试向量对应的数据列中，使每个数据列中存储的数据都具有关联性，便于后续查询统计。通过预先由一方测试工程师建立向量列表，从而能够将递交的每个测试向量及其相关的测试向量信息存储到对应的数据列中，以便于对测试向量文件进行组织归类，以便于管理大量的测试向量，防止出现测试向量漏测或重复测试现象。After the DFT test engineer completes the submission of at least one test vector through the vector submission module 11, the database module 12 specifically associates and stores each test vector and its ID and related files such as design dependency files, and the database module 12 stores each test vector and its ID, design dependency files, conversion and compilation test vectors and verification results in the data column corresponding to each test vector, so that the data stored in each data column are associated, which is convenient for subsequent query statistics. By establishing a vector list in advance by a test engineer on one side, each submitted test vector and its related test vector information can be stored in the corresponding data column, so as to organize and classify the test vector files, so as to manage a large number of test vectors and prevent the phenomenon of test vector omission or repeated testing.
另外，参考图3，该测试向量管理系统还可以包括一个数据锁定模块22，在数据库模块12存储递交的每个测试向量之后，数据锁定模块22锁定存储在数据库模块12中的每个测试向量，确保任何人无法修改每个测试向量递交时的原始内容，实现全程管控，保证工作质量。In addition, referring to Figure 3, the test vector management system can also include a data locking module 22. After the database module 12 stores each submitted test vector, the data locking module 22 locks each test vector stored in the database module 12 to ensure that no one can modify the original content of each test vector when it is submitted, thereby achieving full-process control and ensuring work quality.
如图4所示，该测试向量管理系统还可以包括一个关联信息记录模块23，关联信息记录模块23用于收集每个测试向量的关联信息。其中，关联信息可以包括每个测试向量的递交工程师名称、递交日期、递交路径、递交文件列表、使用的EDA工具名称、版本号中的至少一种信息。其中的递交文件列表是指每次递交的测试向量的测试向量名称列表等，其中的版本号是指同一测试向量名称，但未经过修改或经过至少一次修改的不同版本的测试向量。参考图4，且关联信息记录模块23还与数据库模块12连接，使数据库模块12将每个测试向量的关联信息存储到该测试向量对应的数据列中。通过收集并存储每个测试向量的关联信息，便于了解每个测试向量在不同阶段的具体历史操作信息，便于追溯及还原。例如方便追溯到每个测试向量的递交时间、递交工程师、验证结果、测试向量失败原因及迭代次数等信息。As shown in FIG4 , the test vector management system may further include an associated information recording module 23, which is used to collect associated information of each test vector. Among them, the associated information may include at least one of the name of the submitting engineer, the submission date, the submission path, the submission file list, the name of the EDA tool used, and the version number of each test vector. The submission file list refers to the test vector name list of the test vector submitted each time, etc., and the version number refers to the same test vector name, but different versions of the test vector that have not been modified or have been modified at least once. Referring to FIG4 , the associated information recording module 23 is also connected to the database module 12, so that the database module 12 stores the associated information of each test vector in the data column corresponding to the test vector. By collecting and storing the associated information of each test vector, it is easy to understand the specific historical operation information of each test vector at different stages, which is convenient for tracing and restoring. For example, it is convenient to trace back to the submission time, submission engineer, verification result, test vector failure reason and number of iterations of each test vector.
参考图5及图8，该测试向量管理系统还可以包括邮件通知模块24，邮件通知模块24用于在完成关联式存储每个测试向量、该测试向量的ID和设计依赖文件之后，向第一预设邮箱组发送通知邮件。其中，该第一预设邮箱组至少包括ATE测试工程师的邮箱，以便于在DFT测试工程师递交测试向量，并将递交的测试向量关联式存储到数据库模块12之后，通过邮件通知模块24向ATE测试工程师已经完成前述工作，使ATE测试工程师对每个测试向量进行处理和验证。在完成一个流程节点之后，自动发送电子邮件通知相关的工程师，以便进行下一个工作流程。Referring to FIG. 5 and FIG. 8 , the test vector management system may further include an email notification module 24, which is used to send a notification email to a first preset mailbox group after completing the associative storage of each test vector, the ID of the test vector, and the design dependency file. The first preset mailbox group includes at least the mailbox of the ATE test engineer, so that after the DFT test engineer submits the test vector and stores the submitted test vector in the database module 12 in an associative manner, the email notification module 24 notifies the ATE test engineer that the above work has been completed, so that the ATE test engineer processes and verifies each test vector. After completing a process node, an email is automatically sent to notify the relevant engineer so as to proceed to the next workflow.
如图1、图7及图8所示，在ATE测试工程师对DFT测试工程师上传的每个测试向量进行验证之前，ATE测试工程师需要对每个测试向量进行转换、分拆、编译等处理操作，以使测试向量能够在不同类型的ATE测试设备上进行运行。在ATE测试工程师具体处理每个测试向量时，ATE测试工程师同样能够通过在诸如笔记本电脑、台式电脑、智能手机、平板电脑、工控机等的终端设备登录图形用户界面，打开图形用户界面中的向量处理模块13窗口，向向量处理模块13输入对目标ID的测试向量进行转换编译的转换编译指令，以控制对测试向量进行转换、分拆、编译等操作。且向量处理模块13也与数据库模块12连接，在向量处理模块13接收到对目标ID的测试向量进行转换编译的转换编译指令之后，能够根据转换编译指令，从数据库模块12中调出相应的目标ID的测试向量，并对目标ID的测试向量进行转换编译，生成转换编译测试向量。在向量处理模块13生成转换编译测试向量之后，能够将转换编译测试向量传输给数据库模块12，由数据库模块12关联式存储转换编译测试向量和目标ID。具体关联存储的方式，可以如前所述的将转换编译测试向量存储到目标ID所在的数据列中。As shown in Figures 1, 7 and 8, before the ATE test engineer verifies each test vector uploaded by the DFT test engineer, the ATE test engineer needs to perform processing operations such as conversion, splitting, and compilation on each test vector so that the test vector can be run on different types of ATE test equipment. When the ATE test engineer specifically processes each test vector, the ATE test engineer can also log in to the graphical user interface through a terminal device such as a laptop, desktop computer, smart phone, tablet computer, industrial computer, etc., open the vector processing module 13 window in the graphical user interface, and input the conversion compilation instruction for converting and compiling the test vector of the target ID to the vector processing module 13 to control the conversion, splitting, and compilation operations on the test vector. The vector processing module 13 is also connected to the database module 12. After the vector processing module 13 receives the conversion compilation instruction for converting and compiling the test vector of the target ID, it can call out the test vector of the corresponding target ID from the database module 12 according to the conversion compilation instruction, and convert and compile the test vector of the target ID to generate a conversion compilation test vector. After the vector processing module 13 generates the conversion compiled test vector, it can transmit the conversion compiled test vector to the database module 12, and the database module 12 stores the conversion compiled test vector and the target ID in an associative manner. The specific associative storage method can be as described above, storing the conversion compiled test vector in the data column where the target ID is located.
另外，如图8所示，如上所述的邮件通知模块24还可以在完成关联式存储转换编译测试向量和目标ID之后，向第二预设邮箱组发送通知邮件。此时的第二预设邮箱组可以至少包括DFT测试工程师和ATE测试工程师，以便于DFT测试工程师和ATE测试工程师了解每个测试向量的工作进程。In addition, as shown in FIG8 , the email notification module 24 described above can also send a notification email to the second preset mailbox group after completing the associative storage conversion compilation test vector and target ID. At this time, the second preset mailbox group can at least include DFT test engineers and ATE test engineers, so that the DFT test engineers and ATE test engineers can understand the working progress of each test vector.
继续参考图1，之后ATE测试工程师可以对每个测试向量进行验证，以检验DFT测试工程师提交的测试向量能够通过测试。在ATE测试工程师进行验证时，同样能够通过终端设备登录图形用户界面，选中向量图形用户界面中的向量验证模块14窗口，以输入对目标ID的测试向量进行验证的验证指令。向量验证模块14同样与数据库模块12连接，在向量验证模块14接收到对目标ID的测试向量进行验证的验证指令之后，能够根据验证指令，从数据库模块12中调取相应的目标ID的转换编译向量，并将目标ID的转换编译测试向量转发给测试设备，由测试设备来运行目标ID的转换编译测试向量，以验证是否能够通过测试。在测试设备运行目标ID的转换编译测试向量之后，能够生成验证通过或验证不通过的验证结果，且验证结果还包括在验证不通过时的向量错误信息，以便于DFT测试工程师能够根据向量错误信息对之前递交的目标ID的测试向量进行修改。Continuing to refer to FIG. 1, the ATE test engineer can then verify each test vector to check whether the test vector submitted by the DFT test engineer can pass the test. When the ATE test engineer performs verification, he can also log in to the graphical user interface through the terminal device, select the vector verification module 14 window in the vector graphical user interface, and enter the verification instruction for verifying the test vector of the target ID. The vector verification module 14 is also connected to the database module 12. After the vector verification module 14 receives the verification instruction for verifying the test vector of the target ID, it can retrieve the conversion compilation vector of the corresponding target ID from the database module 12 according to the verification instruction, and forward the conversion compilation test vector of the target ID to the test device, and the test device runs the conversion compilation test vector of the target ID to verify whether it can pass the test. After the test device runs the conversion compilation test vector of the target ID, it can generate a verification result of passing or failing the verification, and the verification result also includes the vector error information when the verification fails, so that the DFT test engineer can modify the test vector of the target ID submitted before according to the vector error information.
如图1及图7所示，在ATE测试工程师拿到目标ID的测试向量的验证结果之后，可以通过登录图形用户界面，打开验证结果接收模块15，将目标ID的测试向量的验证结果输入到验证结果接收模块15中。且验证结果接收模块15同样与数据库模块12连接，以在验证结果接收模块15接收到目标ID的测试向量的验证结果之后，将验证结果传输给数据库模块12，由数据库模块12关联式存储验证结果和目标ID。As shown in FIG. 1 and FIG. 7 , after the ATE test engineer obtains the verification result of the test vector of the target ID, he can log in to the graphical user interface, open the verification result receiving module 15, and input the verification result of the test vector of the target ID into the verification result receiving module 15. The verification result receiving module 15 is also connected to the database module 12, so that after the verification result receiving module 15 receives the verification result of the test vector of the target ID, the verification result is transmitted to the database module 12, and the database module 12 stores the verification result and the target ID in an associative manner.
此外，如图8所示，如上所述的邮件通知模块24还可以在完成关联式存储验证结果和目标ID之后，向第三预设邮箱组发送通知邮件。第三预设邮箱组可以至少包括DFT测试工程师，以提醒DFT测试工程师及时查看验证结果信息，并进行相应的修改等操作。通过设置邮件通知模块24，以在每个流程节点完成之后，通过邮件通知方式通知下一流程的相关人员进行操作。In addition, as shown in FIG8 , the email notification module 24 described above can also send a notification email to a third preset mailbox group after completing the associated storage verification result and target ID. The third preset mailbox group can include at least a DFT test engineer to remind the DFT test engineer to check the verification result information in time and make corresponding modifications. By setting the email notification module 24, after each process node is completed, the relevant personnel of the next process can be notified by email notification to perform operations.
参考图6，该测试向量管理系统还可以包括向量访问及数据统计模块25，使用户能够通过向量访问及数据统计模块25查看每个测试向量的状态信息、进度信息等。具体的，用户可以登录图形用户界面，打开向量访问及数据统计模块25窗口，向其内输入统计目标类型数据的统计指令。向量访问及数据统计模块25与数据库模块12连接，以在向量访问及数据统计模块25接收到统计目标类型数据的统计指令之后，根据统计指令和向量列表，生成目标类型数据。以便于利用统计学帮助管理者更好的优化工作流程，使管理者和项目经理能够随时通过测试向量管理系统查看DFT和ATE测试工程师的测试向量递交进度、递交质量、验证进度等，便于统计Time-to-Pass等关键工作指标，有利于找到项目的瓶颈，利于后续结合统计的目标类型数据进行工作总结及改善。Referring to Fig. 6, the test vector management system may also include a vector access and data statistics module 25, so that the user can view the status information, progress information, etc. of each test vector through the vector access and data statistics module 25. Specifically, the user can log in to the graphical user interface, open the vector access and data statistics module 25 window, and input the statistical instructions of the statistical target type data therein. The vector access and data statistics module 25 is connected to the database module 12, so that after the vector access and data statistics module 25 receives the statistical instructions of the statistical target type data, the target type data is generated according to the statistical instructions and the vector list. In order to use statistics to help managers better optimize the workflow, managers and project managers can view the test vector submission progress, submission quality, verification progress, etc. of DFT and ATE test engineers at any time through the test vector management system, which is convenient for statistical time-to-pass and other key work indicators, which is conducive to finding the bottleneck of the project and is conducive to subsequent work summary and improvement in combination with the statistical target type data.
在具体查询与统计过程中，该目标类型数据可以为测试向量的Time-to-Pass的周期，即向量访问及数据统计模块25能够根据存储在数据库模块12中的历史数据，自动统计出每个测试向量的Time-to-Pass的周期，以获取每个测试向量从递交到验证通过的时间长度，获取已导入测试向量的进度信息。In the specific query and statistical process, the target type data can be the Time-to-Pass period of the test vector, that is, the vector access and data statistics module 25 can automatically count the Time-to-Pass period of each test vector based on the historical data stored in the database module 12, so as to obtain the length of time from submission to verification of each test vector, and obtain the progress information of the imported test vector.
当然，该目标类型数据还可以为测试向量的涵盖率，即向量访问及数据统计模块25还可以根据统计指令自动统计出每个测试向量的涵盖率(Coverage)是多少，其中的涵盖率是指诸如但不限于SOC芯片等芯片上的缺陷被检出的概率，还可以泛指为已导入测试向量数量和总测试向量数量之比。涵盖率是标识芯片ATE测试向量质量的关键性指标。测试向量涵盖率越高，则芯片上能够被检出缺陷的概率越多，芯片出货的质量也就越高；测量向量涵盖率越低，则芯片上能够被检测出缺陷的概率越低，芯片出货的质量也就越低。以便于自动统计出已导入测试向量的质量信息。Of course, the target type data can also be the coverage of the test vector, that is, the vector access and data statistics module 25 can also automatically count the coverage of each test vector according to the statistical instruction, where the coverage refers to the probability of defects on chips such as but not limited to SOC chips being detected, and can also be generally referred to as the ratio of the number of imported test vectors to the total number of test vectors. Coverage is a key indicator of the quality of the chip ATE test vector. The higher the test vector coverage, the more probabilities that defects can be detected on the chip, and the higher the quality of the chip shipment; the lower the measurement vector coverage, the lower the probability that defects can be detected on the chip, and the lower the quality of the chip shipment. In order to automatically count the quality information of the imported test vectors.
再者，该目标类型数据还可以为测试向量所针对的缺陷类型，即向量访问及数据统计模块25还可以统计出已导入的每个测试向量所针对的缺陷类型，并对不同测试向量所针对的缺陷类型进行归类。在芯片制造过程中，由于各种因素，制造出的芯片会一定概率地出现不同类型的缺陷，该缺陷类型可能为诸如芯片上的某个门电路输入/输出短路、输入/输出短接地、短接电源、寄存器传输时序延迟等。EDA工具会针对每种缺陷生成专门的测试向量，如Stuck-At Fault(固定故障)缺陷测试向量、Transition Delay Fault(跳变时延故障)缺陷测试向量、Path DelayFault(路径延时故障)缺陷测试向量等。芯片上的每一种缺陷需要由针对该缺陷的测试向量类型来检测。故而，在统计过程中，向量访问及数据统计模块25可以针对不同测量向量所针对的缺陷类型，统计出每个测试向量所针对的缺陷类型，并针对不同的缺陷类型对测试向量进行归类。Furthermore, the target type data can also be the defect type targeted by the test vector, that is, the vector access and data statistics module 25 can also count the defect type targeted by each imported test vector, and classify the defect types targeted by different test vectors. In the chip manufacturing process, due to various factors, the manufactured chips will have different types of defects with a certain probability. The defect type may be such as a gate circuit input/output short circuit, input/output short grounding, short power supply, register transfer timing delay, etc. on the chip. The EDA tool will generate a special test vector for each defect, such as a Stuck-At Fault defect test vector, a Transition Delay Fault defect test vector, a Path Delay Fault defect test vector, etc. Each defect on the chip needs to be detected by a test vector type targeted at the defect. Therefore, in the statistical process, the vector access and data statistics module 25 can count the defect type targeted by each test vector for the defect type targeted by different measurement vectors, and classify the test vectors for different defect types.
应当理解的是，向量访问及数据统计模块25除了统计上述示出的每个测试向量的Time-to-Pass的周期、涵盖率、以及测试向量所针对的缺陷类型等信息之外，还可以统计其他的关键工作指标数据。It should be understood that the vector access and data statistics module 25 can count other key work indicator data in addition to the Time-to-Pass cycle, coverage, and defect type targeted by the test vector of each test vector shown above.
通过设计一种专门的测试向量管理系统，DFT测试工程师在设计好测试向量之后，直接递交到测试向量管理系统，由测试向量管理系统来接收并存储DFT测试工程师递交的每个测试向量。ATE测试工程师通过登录测试向量管理系统即可对目标测试向量进行转换编译，并通过在登录管理系统即可将转换编译测试向量转发给测试设备，以对目标测试向量进行验证。在ATE测试工程师验证目标测试向量得到验证结果之后，将验证结果上传到测试向量管理系统，由DFT测试工程师登录测试向量管理系统即可查看每个测试向量的验证结果，以在某测试向量的验证结果为不通过时，对该测试向量进行修改并将修改后的测试向量再次递交到测试向量管理系统。在上述过程中，统一化和标准化大规模数字集成电路芯片ATE测试向量的导入的工作流程，大大提高工作质量和效率，DFT测试工程师和ATE测试工程师仅面对一个测试向量管理系统即可，能够实现测试向量的递交验证等全程自动化管理，简化DFT测试工程师和ATE测试工程师的操作流程，大大减少了DFT测试工程师和ATE测试工程师对测试向量管理的工作量，节省DFT和ATE测试工程师的时间和精力，降低了沟通成本，提高了工作效率。且向量递交模块11能够对DFT测试工程师递交的每个测试向量分配唯一的ID，通过唯一ID区分不同类型的测试向量、以及相同类型但不同版本的测试向量，能够防止不同测试向量的混淆。By designing a special test vector management system, after designing the test vector, the DFT test engineer directly submits it to the test vector management system, and the test vector management system receives and stores each test vector submitted by the DFT test engineer. The ATE test engineer can convert and compile the target test vector by logging into the test vector management system, and forward the converted and compiled test vector to the test equipment by logging into the management system to verify the target test vector. After the ATE test engineer verifies the target test vector and obtains the verification result, the verification result is uploaded to the test vector management system. The DFT test engineer can log into the test vector management system to view the verification result of each test vector, so that when the verification result of a test vector fails, the test vector can be modified and the modified test vector can be submitted to the test vector management system again. In the above process, the workflow of importing ATE test vectors for large-scale digital integrated circuit chips is unified and standardized, which greatly improves the work quality and efficiency. DFT test engineers and ATE test engineers only need to face one test vector management system, which can realize the full-process automated management of test vector submission verification, simplify the operation process of DFT test engineers and ATE test engineers, greatly reduce the workload of DFT test engineers and ATE test engineers for test vector management, save the time and energy of DFT and ATE test engineers, reduce communication costs, and improve work efficiency. In addition, the vector submission module 11 can assign a unique ID to each test vector submitted by the DFT test engineer, distinguish different types of test vectors, and test vectors of the same type but different versions through the unique ID, which can prevent confusion between different test vectors.
另外，本发明实施例还提供了一种测试向量管理方法，参考图9，该测试向量管理方法包括：In addition, an embodiment of the present invention further provides a test vector management method. Referring to FIG. 9 , the test vector management method includes:
Step10：接收递交的测试向量、以及每个测试向量的设计依赖文件；Step 10: Receive the submitted test vectors and the design dependency files of each test vector;
Step20：给递交的每个测试向量分配唯一的ID；Step 20: Assign a unique ID to each submitted test vector;
Step30：关联式存储每个测试向量、该测试向量的ID和设计依赖文件；Step 30: Store each test vector, its ID and design dependency file in an associative manner;
Step40：接收对目标ID的测试向量进行转换编译的转换编译指令；Step 40: receiving a conversion compilation instruction for converting and compiling the test vector of the target ID;
Step50：根据转换编译指令，对目标ID的测试向量进行转换编译生成转换编译测试向量，并关联式存储转换编译测试向量和目标ID；Step 50: According to the conversion compilation instruction, the test vector of the target ID is converted and compiled to generate a conversion compilation test vector, and the conversion compilation test vector and the target ID are stored in an associative manner;
Step60：接收对目标ID的测试向量进行验证的验证指令；根据验证指令，将目标ID的转换编译测试向量转发给测试设备；Step 60: receiving a verification instruction for verifying the test vector of the target ID; forwarding the converted compiled test vector of the target ID to the test equipment according to the verification instruction;
Step70：接收目标ID的测试向量的验证结果，并关联式存储验证结果和目标ID。Step 70: Receive the verification result of the test vector of the target ID, and store the verification result and the target ID in an associated manner.
在上述的方案中，通过设计一种专门的测试向量管理系统，DFT测试工程师在设计好测试向量之后，直接递交到测试向量管理系统，由测试向量管理系统来接收并存储DFT测试工程师递交的每个测试向量。ATE测试工程师通过登录测试向量管理系统即可对目标测试向量进行转换编译，并通过在登录管理系统即可将转换编译测试向量转发给测试设备，以对目标测试向量进行验证。在ATE测试工程师验证目标测试向量得到验证结果之后，将验证结果上传到测试向量管理系统，由DFT测试工程师登录测试向量管理系统即可查看每个测试向量的验证结果，以在某测试向量的验证结果为不通过时，对该测试向量进行修改并将修改后的测试向量再次递交到测试向量管理系统。在上述过程中，DFT测试工程师和ATE测试工程师仅面对一个测试向量管理系统即可，能够实现测试向量的递交验证等全程自动化管理，简化DFT测试工程师和ATE测试工程师的操作流程，大大减少了DFT测试工程师和ATE测试工程师对测试向量管理的工作量，节省DFT和ATE测试工程师的时间和精力，降低了沟通成本，提高了工作效率。且向量递交模块能够对DFT测试工程师递交的每个测试向量分配唯一的ID，通过唯一ID区分不同类型的测试向量、以及相同类型但不同版本的测试向量，能够防止不同测试向量的混淆。In the above scheme, by designing a special test vector management system, after designing the test vector, the DFT test engineer directly submits it to the test vector management system, and the test vector management system receives and stores each test vector submitted by the DFT test engineer. The ATE test engineer can convert and compile the target test vector by logging into the test vector management system, and forward the converted and compiled test vector to the test equipment by logging into the management system to verify the target test vector. After the ATE test engineer verifies the target test vector and obtains the verification result, the verification result is uploaded to the test vector management system, and the DFT test engineer logs into the test vector management system to view the verification result of each test vector, so that when the verification result of a certain test vector fails, the test vector is modified and the modified test vector is submitted to the test vector management system again. In the above process, the DFT test engineer and the ATE test engineer only need to face one test vector management system, which can realize the full-process automated management of the submission and verification of the test vector, simplify the operation process of the DFT test engineer and the ATE test engineer, greatly reduce the workload of the DFT test engineer and the ATE test engineer for the test vector management, save the time and energy of the DFT and ATE test engineers, reduce the communication cost, and improve the work efficiency. The vector submission module can assign a unique ID to each test vector submitted by the DFT test engineer, and distinguish different types of test vectors and test vectors of the same type but different versions through the unique ID, thereby preventing confusion between different test vectors.
另外，如前述测试向量管理系统中的对应描述所示，在接收递交的测试向量、以及每个测试向量的设计依赖文件之前，该管理方法还可以包括：接收创建的向量列表，并存储向量列表；其中，向量列表中包含有多个数据列，每个测试向量对应一个数据列。对应的，后续关联式存储每个测试向量、该测试向量的ID和设计依赖文件具体为：将每个测试向量、该测试向量的ID和设计依赖文件，存储到每个测试向量对应的数据列中。后续关联式存储转换编译测试向量和目标ID具体为：将转换编译测试向量存储到目标ID对应的数据列中。后续关联式存储验证结果和目标ID具体为：将验证结果存储到目标ID对应的数据列中。通过预先由一方测试工程师建立向量列表，从而能够将递交的每个测试向量及其相关的测试向量信息存储到对应的数据列中，以便于对测试向量文件进行组织归类，以便于管理大量的测试向量，防止出现测试向量漏测或重复测试现象。In addition, as shown in the corresponding description in the aforementioned test vector management system, before receiving the submitted test vectors and the design dependency files of each test vector, the management method may also include: receiving a created vector list and storing the vector list; wherein the vector list contains multiple data columns, and each test vector corresponds to a data column. Correspondingly, the subsequent associative storage of each test vector, the ID of the test vector and the design dependency file is specifically: storing each test vector, the ID of the test vector and the design dependency file in the data column corresponding to each test vector. The subsequent associative storage of the converted compiled test vector and the target ID is specifically: storing the converted compiled test vector in the data column corresponding to the target ID. The subsequent associative storage of the verification result and the target ID is specifically: storing the verification result in the data column corresponding to the target ID. By establishing a vector list in advance by a test engineer on one side, each submitted test vector and its related test vector information can be stored in the corresponding data column, so as to facilitate the organization and classification of the test vector files, so as to facilitate the management of a large number of test vectors, and prevent the occurrence of test vector omissions or repeated tests.
再者，该测试向量管理方法还可以包括：在接收递交的测试向量、以及每个测试向量的设计依赖文件的同时，还收集每个测试向量的关联信息，其中，关联信息包括每个测试向量的递交工程师名称、递交日期、递交路径、递交文件列表、使用的EDA工具名称、版本号中的至少一种信息；将每个测试向量的关联信息存储到该测试向量对应的数据列中。通过收集并存储每个测试向量的关联信息，便于了解每个测试向量在不同阶段的具体历史操作信息，便于追溯及还原。具体的实现方式如前述测试向量管理系统中的对应描述所示，在此不再赘述。Furthermore, the test vector management method may also include: while receiving the submitted test vectors and the design dependency files of each test vector, it also collects the associated information of each test vector, wherein the associated information includes at least one of the name of the submitting engineer, the submission date, the submission path, the submission file list, the name of the EDA tool used, and the version number of each test vector; and storing the associated information of each test vector in the data column corresponding to the test vector. By collecting and storing the associated information of each test vector, it is easy to understand the specific historical operation information of each test vector at different stages, which is convenient for tracing and restoration. The specific implementation method is shown in the corresponding description in the aforementioned test vector management system, and will not be repeated here.
另外，关联式存储每个测试向量、该测试向量的ID、以及该测试向量的设计依赖文件还可以包括：锁定存储的每个测试向量。确保任何人无法修改每个测试向量递交时的原始内容，实现全程管控，保证工作质量。In addition, associatively storing each test vector, the ID of the test vector, and the design dependent file of the test vector may also include: locking each stored test vector to ensure that no one can modify the original content of each test vector when it is submitted, so as to achieve full-process control and ensure work quality.
如前述测试向量管理系统所述，在完成关联式存储每个测试向量、该测试向量的ID和设计依赖文件之后，该测试向量管理方法还可以包括：向第一预设邮箱组发送通知邮件，以在每个流程节点完成之后，通过邮件通知方式通知下一流程的相关人员进行操作。在完成关联式存储转换编译测试向量和目标ID之后，该测试向量管理方法还可以包括：向第二预设邮箱组发送通知邮件，以在每个流程节点完成之后，通过邮件通知方式通知下一流程的相关人员进行操作。在完成关联式存储验证结果和目标ID之后，该测试向量管理方法还可以包括：向第三预设邮箱组发送通知邮件，以在每个流程节点完成之后，通过邮件通知方式通知下一流程的相关人员进行操作。As described in the aforementioned test vector management system, after completing the associative storage of each test vector, the ID of the test vector and the design dependency file, the test vector management method may also include: sending a notification email to the first preset mailbox group, so as to notify the relevant personnel of the next process to perform operations by email notification after each process node is completed. After completing the associative storage conversion and compilation of the test vector and the target ID, the test vector management method may also include: sending a notification email to the second preset mailbox group, so as to notify the relevant personnel of the next process to perform operations by email notification after each process node is completed. After completing the associative storage of the verification results and the target ID, the test vector management method may also include: sending a notification email to the third preset mailbox group, so as to notify the relevant personnel of the next process to perform operations by email notification after each process node is completed.
此外，该测试向量管理方法还可以包括：接收统计目标类型数据的统计指令；根据统计指令和向量列表，生成目标类型数据。使管理者和项目经理能够随时通过测试向量管理系统查看DFT和ATE测试工程师的测试向量递交进度、递交质量、验证进度等，便于统计Time-to-Pass等关键工作指标，有利于找到项目的瓶颈，利于后续结合统计的目标类型数据进行工作总结及改善。该目标类型数据可以为测试向量的Time-to-Pass的周期、涵盖率或测试向量所针对的缺陷类型，以便于自动统计出已导入测试向量的进度信息、质量信息及所针对的缺陷类型信息，以便于自动统计出已导入测试向量的进度信息、质量信息及所针对的缺陷类型信息。具体的实现方式参考前述测试向量管理系统中的对应描述，在此不再赘述。In addition, the test vector management method may also include: receiving a statistical instruction for statistical target type data; generating target type data according to the statistical instruction and the vector list. It enables managers and project managers to view the test vector submission progress, submission quality, verification progress, etc. of DFT and ATE test engineers at any time through the test vector management system, which is convenient for counting key work indicators such as Time-to-Pass, which is conducive to finding the bottleneck of the project, and is conducive to subsequent work summary and improvement in combination with the statistical target type data. The target type data can be the Time-to-Pass cycle, coverage rate or defect type targeted by the test vector, so as to automatically count the progress information, quality information and defect type information of the imported test vector, so as to automatically count the progress information, quality information and defect type information of the imported test vector. The specific implementation method refers to the corresponding description in the aforementioned test vector management system, which will not be repeated here.
以上所述，仅为本发明的具体实施方式，但本发明的保护范围并不局限于此，任何熟悉本技术领域的技术人员在本发明揭露的技术范围内，可轻易想到的变化或替换，都应涵盖在本发明的保护范围之内。因此，本发明的保护范围应该以权利要求的保护范围为准。The above is only a specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any changes or substitutions that can be easily thought of by a person skilled in the art within the technical scope disclosed by the present invention should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111208045.4ACN113900874B (en) | 2021-10-18 | 2021-10-18 | Test vector management system and test vector management method |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111208045.4ACN113900874B (en) | 2021-10-18 | 2021-10-18 | Test vector management system and test vector management method |
| Publication Number | Publication Date |
|---|---|
| CN113900874A CN113900874A (en) | 2022-01-07 |
| CN113900874Btrue CN113900874B (en) | 2024-09-24 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111208045.4AActiveCN113900874B (en) | 2021-10-18 | 2021-10-18 | Test vector management system and test vector management method |
| Country | Link |
|---|---|
| CN (1) | CN113900874B (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102331970A (en)* | 2011-07-28 | 2012-01-25 | 北京航空航天大学 | Automated test resource management method and platform for security-critical systems |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8538414B1 (en)* | 2007-07-17 | 2013-09-17 | Google Inc. | Mobile interaction with software test cases |
| CN104407971B (en)* | 2014-11-18 | 2017-04-12 | 中国电子科技集团公司第十研究所 | Method for automatically testing embedded software |
| CN104391794A (en)* | 2014-12-03 | 2015-03-04 | 浪潮集团有限公司 | Automatic testing method for multiple scripts |
| CN104601403A (en)* | 2015-01-07 | 2015-05-06 | 上海瀚之友信息技术服务有限公司 | Automatic test system |
| US9952965B2 (en)* | 2015-08-06 | 2018-04-24 | International Business Machines Corporation | Test self-verification with integrated transparent self-diagnose |
| CN107908566A (en)* | 2017-11-27 | 2018-04-13 | 平安科技（深圳）有限公司 | Automatic test management method, device, terminal device and storage medium |
| CN108038052A (en)* | 2017-11-27 | 2018-05-15 | 平安科技（深圳）有限公司 | Automatic test management method, device, terminal device and storage medium |
| CN109086213B (en)* | 2018-09-10 | 2023-06-06 | 一汽解放汽车有限公司 | Commercial vehicle network test management system and method based on distributed system |
| CN109857632B (en)* | 2018-12-06 | 2022-04-15 | 东软集团股份有限公司 | Test method, test device, terminal equipment and readable storage medium |
| CN110309051B (en)* | 2019-05-22 | 2022-09-30 | 深圳壹账通智能科技有限公司 | Method, system, equipment and storage medium for managing test cases |
| CN113466675B (en)* | 2021-05-26 | 2022-06-21 | 中国电子科技集团公司第五十四研究所 | Test vector generation method |
| CN113204495A (en)* | 2021-05-31 | 2021-08-03 | 广州方硅信息技术有限公司 | Automatic testing method and device based on B/S architecture, storage medium and equipment |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102331970A (en)* | 2011-07-28 | 2012-01-25 | 北京航空航天大学 | Automated test resource management method and platform for security-critical systems |
| Publication number | Publication date |
|---|---|
| CN113900874A (en) | 2022-01-07 |
| Publication | Publication Date | Title |
|---|---|---|
| CN110737584A (en) | Service data testing method and device based on block chain and computer equipment | |
| CN108170566A (en) | Product failure information processing method, system, equipment and collaboration platform | |
| CN114429256A (en) | Data monitoring method, device, electronic device and storage medium | |
| CN112988555A (en) | Interface test method, device, equipment and storage medium | |
| CN114996127A (en) | Intelligent test method and system for solid state disk firmware module | |
| CN100407878C (en) | A method and device for checking consistency | |
| CN116228263A (en) | An integrated automatic debugging method, system and storage medium for production testing applied to a fusion terminal | |
| CN105893685A (en) | VLSI (very Large Scale integration) formalization verification platform and method | |
| CN106294128A (en) | A kind of automated testing method deriving report data and device | |
| CN113900874B (en) | Test vector management system and test vector management method | |
| CN119292847A (en) | A method, device, electronic device and storage medium for generating wafer test results | |
| CN111797084B (en) | Method and system for data coding standard implementation inspection based on weapon equipment test process | |
| CN118860725A (en) | Method and device for generating diagnosis results, storage medium, electronic device and computer program product | |
| US6675323B2 (en) | Incremental fault dictionary | |
| CN112783767A (en) | Method, device, equipment and storage medium for realizing control of test case management | |
| CN116090380B (en) | Automatic method and device for verifying digital integrated circuit, storage medium and terminal | |
| CN117370202A (en) | Method, device, equipment and storage medium for testing full link of multiple bins | |
| CN115757090A (en) | Software testing system, method, device and medium | |
| CN112699022B (en) | Method and system for real-time efficient automatic contract testing | |
| CN111008113B (en) | A SAS-Expander Test Method and Tool | |
| CN100432954C (en) | Inlaid system detection method and system | |
| CN105809577A (en) | Classification processing method of power plant information data on basis of rules and modules | |
| CN112559331A (en) | Test method and device | |
| CN118839668B (en) | A test result format conversion method and computing device | |
| CN115102843B (en) | A server serial number acquisition method, device and computer equipment |
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |