CN114330221B - Scoreboard implementation method, scoreboard, electronic device and storage medium - Google Patents

Abstract

The disclosure provides a score board implementation method, a score board, an electronic device and a storage medium, and relates to the field of artificial intelligence such as artificial intelligence chips, cloud computing and intelligent voice, wherein the method comprises the following steps: determining a current verification environment, wherein the current verification environment is one of M preset verification environments, and M is a positive integer greater than one; and acquiring the expected value and the result information according to the acquisition mode corresponding to the current verification environment, and comparing the acquired expected value with the result information. By applying the scheme disclosed by the disclosure, the waste of resources and the like can be reduced.

Description

Translated fromChinese

计分板实现方法、计分板、电子设备及存储介质Scoreboard implementation method, scoreboard, electronic device and storage medium

技术领域technical field

本公开涉及人工智能技术领域，特别涉及人工智能芯片、云计算及智能语音等领域的计分板实现方法、计分板、电子设备及存储介质。The present disclosure relates to the technical field of artificial intelligence, and in particular, to a scoreboard implementation method, scoreboard, electronic device, and storage medium in the fields of artificial intelligence chips, cloud computing, and intelligent voice.

背景技术Background technique

模块级验证(也可称为IP验证)和片上系统(SOC，System-on-Chip)验证是集成电路芯片(IC，Integrated Circuit)验证中的两种重要验证，所述集成电路芯片可为智能语音芯片等。Module-level verification (also known as IP verification) and System-on-Chip (SOC, System-on-Chip) verification are two important verifications in integrated circuit chip (IC, Integrated Circuit) verification, which can be intelligent voice chip, etc.

其中，模块级验证主要用于实现模块级功能验证，SOC验证主要用于实现模块间连通性验证。模块级验证的数据源通常为输入的序列(sequence)，SOC验证的数据源通常为中央处理单元(CPU，Central Processing Unit)或数字信号处理器(DSP，Digital SignalProcessing)下发的数据指令。Among them, module-level verification is mainly used to realize module-level function verification, and SOC verification is mainly used to realize inter-module connectivity verification. The data source for module-level verification is usually an input sequence, and the data source for SOC verification is usually a data instruction issued by a central processing unit (CPU, Central Processing Unit) or a digital signal processor (DSP, Digital Signal Processing).

由于数据源不同，因此模块级验证中的计分板(scoreboard)和SOC验证中的计分板需要分别独立开发，从而造成了资源的浪费。Due to different data sources, the scoreboard in module-level verification and the scoreboard in SOC verification need to be developed independently, resulting in a waste of resources.

发明内容SUMMARY OF THE INVENTION

本公开提供了计分板实现方法、计分板、电子设备及存储介质。The present disclosure provides a scoreboard implementation method, a scoreboard, an electronic device, and a storage medium.

一种计分板实现方法，包括：A scoreboard implementation method, comprising:

确定当前所处的验证环境，所述当前所处的验证环境为预定的M种验证环境中的一种，M为大于一的正整数；Determine the current verification environment, where the current verification environment is one of the predetermined M types of verification environments, where M is a positive integer greater than one;

按照所述当前所处的验证环境对应的获取方式，获取期望值及结果信息，并将所述期望值与所述结果信息进行比对。According to the acquisition method corresponding to the current verification environment, the expected value and the result information are acquired, and the expected value is compared with the result information.

一种计分板，包括：第一处理模块以及第二处理模块；A scoreboard, comprising: a first processing module and a second processing module;

所述第一处理模块，用于确定当前所处的验证环境，所述当前所处的验证环境为预定的M种验证环境中的一种，M为大于一的正整数；The first processing module is used to determine the current verification environment, where the current verification environment is one of the predetermined M types of verification environments, where M is a positive integer greater than one;

所述第二处理模块，用于按照所述当前所处的验证环境对应的获取方式，获取期望值及结果信息，并将所述期望值与所述结果信息进行比对。The second processing module is configured to acquire the expected value and the result information according to the acquisition mode corresponding to the current verification environment, and compare the expected value with the result information.

一种电子设备，包括：An electronic device comprising:

至少一个处理器；以及at least one processor; and

与所述至少一个处理器通信连接的存储器；其中，a memory communicatively coupled to the at least one processor; wherein,

所述存储器存储有可被所述至少一个处理器执行的指令，所述指令被所述至少一个处理器执行，以使所述至少一个处理器能够执行如以上所述的方法。The memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method as described above.

一种存储有计算机指令的非瞬时计算机可读存储介质，所述计算机指令用于使计算机执行如以上所述的方法。A non-transitory computer readable storage medium storing computer instructions for causing a computer to perform the method as described above.

一种计算机程序产品，包括计算机程序/指令，所述计算机程序/指令被处理器执行时实现如以上所述的方法。A computer program product comprising computer programs/instructions which, when executed by a processor, implement the method as described above.

上述公开中的一个实施例具有如下优点或有益效果：可实现计分板在不同验证环境下的复用，从而减少了资源的浪费，并有效地降低了开发成本及提升了验证效率等。One embodiment of the above disclosure has the following advantages or beneficial effects: multiplexing of scoreboards in different verification environments can be achieved, thereby reducing waste of resources, effectively reducing development costs, and improving verification efficiency.

应当理解，本部分所描述的内容并非旨在标识本公开的实施例的关键或重要特征，也不用于限制本公开的范围。本公开的其它特征将通过以下的说明书而变得容易理解。It should be understood that what is described in this section is not intended to identify key or critical features of embodiments of the disclosure, nor is it intended to limit the scope of the disclosure. Other features of the present disclosure will become readily understood from the following description.

附图说明Description of drawings

附图用于更好地理解本方案，不构成对本公开的限定。其中：The accompanying drawings are used for better understanding of the present solution, and do not constitute a limitation to the present disclosure. in:

图1为本公开所述计分板实现方法实施例的流程图；1 is a flowchart of an embodiment of a method for implementing a scoreboard according to the present disclosure;

图2为现有模块级验证环境下计分板的工作方式示意图；FIG. 2 is a schematic diagram of the working mode of the scoreboard under the existing module-level verification environment;

图3为现有SOC验证环境下计分板的工作方式示意图；FIG. 3 is a schematic diagram of the working mode of the scoreboard in the existing SOC verification environment;

图4为本公开所述模块级验证环境下计分板的工作方式示意图；4 is a schematic diagram of the working mode of the scoreboard in the module-level verification environment described in the present disclosure;

图5为本公开所述SOC验证环境下计分板的工作方式示意图；5 is a schematic diagram of the working mode of the scoreboard in the SOC verification environment described in the present disclosure;

图6为本公开所述计分板实施例600的组成结构示意图；FIG. 6 is a schematic diagram of the composition and structure of anembodiment 600 of the scoreboard described in the present disclosure;

图7示出了可以用来实施本公开的实施例的电子设备700的示意性框图。FIG. 7 shows a schematic block diagram of anelectronic device 700 that may be used to implement embodiments of the present disclosure.

具体实施方式Detailed ways

以下结合附图对本公开的示范性实施例做出说明，其中包括本公开实施例的各种细节以助于理解，应当将它们认为仅仅是示范性的。因此，本领域普通技术人员应当认识到，可以对这里描述的实施例做出各种改变和修改，而不会背离本公开的范围和精神。同样，为了清楚和简明，以下的描述中省略了对公知功能和结构的描述。Exemplary embodiments of the present disclosure are described below with reference to the accompanying drawings, which include various details of the embodiments of the present disclosure to facilitate understanding and should be considered as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present disclosure. Also, descriptions of well-known functions and constructions are omitted from the following description for clarity and conciseness.

另外，应理解，本文中术语“和/或”，仅仅是一种描述关联对象的关联关系，表示可以存在三种关系，例如，A和/或B，可以表示：单独存在A，同时存在A和B，单独存在B这三种情况。另外，本文中字符“/”，一般表示前后关联对象是一种“或”的关系。In addition, it should be understood that the term "and/or" in this document is only an association relationship for describing associated objects, indicating that there can be three kinds of relationships, for example, A and/or B, which can mean that A exists alone, and A exists at the same time and B, there are three cases of B alone. In addition, the character "/" in this document generally indicates that the related objects are an "or" relationship.

图1为本公开所述计分板实现方法实施例的流程图。如图1所示，包括以下具体实现方式。FIG. 1 is a flowchart of an embodiment of a method for implementing a scoreboard according to the present disclosure. As shown in Figure 1, the following specific implementations are included.

在步骤101中，确定当前所处的验证环境，当前所处的验证环境为预定的M种验证环境中的一种，M为大于一的正整数。Instep 101, the current verification environment is determined, and the current verification environment is one of the predetermined M types of verification environments, where M is a positive integer greater than one.

在步骤102中，按照当前所处的验证环境对应的获取方式，获取期望值及结果信息，并将所述期望值与所述结果信息进行比对。Instep 102, the expected value and the result information are acquired according to the acquisition method corresponding to the current verification environment, and the expected value is compared with the result information.

可以看出，采用上述方法实施例所述方案，可实现计分板在不同验证环境下的复用，从而减少了资源的浪费，并有效地降低了开发成本及提升了验证效率等。It can be seen that, by adopting the solutions described in the above method embodiments, the multiplexing of the scoreboard in different verification environments can be realized, thereby reducing the waste of resources, effectively reducing the development cost and improving the verification efficiency.

本公开的一个实施例中，所述M种验证环境可包括：模块级验证环境以及SOC验证环境。In an embodiment of the present disclosure, the M verification environments may include: a module-level verification environment and an SOC verification environment.

图2为现有模块级验证环境下计分板的工作方式示意图。如图2所示，在该验证环境下，计分板可从输入的sequence中获取源数据，并可将获取到的源数据发送给被测设备(DUT，Device Under Test)对应的仿真模型(cmodel)，进而可从仿真模型获取生成的期望值，即获取仿真模型计算出的参考结果，另外，还可利用第二监控器(monitor)从被测设备的输出总线中获取结果信息，进一步地，可将期望值与结果信息进行比对，根据比对结果确定验证是否通过等。FIG. 2 is a schematic diagram of the working mode of the scoreboard in the existing module-level verification environment. As shown in Figure 2, in this verification environment, the scoreboard can obtain source data from the input sequence, and can send the obtained source data to the simulation model (DUT, Device Under Test) corresponding to the device under test (DUT). cmodel), and then the expected value generated from the simulation model can be obtained, that is, the reference result calculated by the simulation model can be obtained. In addition, the second monitor (monitor) can also be used to obtain the result information from the output bus of the device under test, and further, The expected value can be compared with the result information, and whether the verification is passed or not can be determined according to the comparison result.

图3为现有SOC验证环境下计分板的工作方式示意图。如图3所示，在该验证环境下，计分板可利用第一监控器从被测设备的输入总线中获取源数据，并可将获取到的源数据发送给仿真模型，进而可从仿真模型获取生成的期望值，另外，还可利用第二监控器从被测设备的输出总线中获取结果信息，进一步地，可将期望值与结果信息进行比对，根据比对结果确定验证是否通过等。FIG. 3 is a schematic diagram of the working mode of the scoreboard in the existing SOC verification environment. As shown in Figure 3, in this verification environment, the scoreboard can use the first monitor to obtain source data from the input bus of the device under test, and can send the obtained source data to the simulation model, which can then be obtained from the simulation model. The model obtains the generated expected value. In addition, the second monitor can be used to obtain the result information from the output bus of the device under test. Further, the expected value can be compared with the result information, and whether the verification is passed or not can be determined according to the comparison result.

如前所述，由于数据源不同，因此模块级验证中的计分板和SOC验证中的计分板需要分别独立开发，从而造成了资源的浪费。而采用本公开所述方案后，可实现计分板在模块级验证环境和SOC验证环境下的复用，从而减少了资源的浪费，并有效地降低了开发成本及提升了验证效率等。As mentioned above, due to different data sources, the scoreboard in module-level verification and the scoreboard in SOC verification need to be developed independently, resulting in a waste of resources. After adopting the solution of the present disclosure, the multiplexing of the scoreboard in the module-level verification environment and the SOC verification environment can be realized, thereby reducing the waste of resources, effectively reducing the development cost and improving the verification efficiency.

相应地，对于本公开所述方案中的计分板来说，需要首先确定出当前所处的验证环境。如何确定出当前所处的验证环境不作限制，比如，可设置一个片上系统标示(soc_flag)控制开关，通过监控该控制开关可确定出当前所处的验证环境。Correspondingly, for the scoreboard in the solution described in the present disclosure, the current verification environment needs to be determined first. How to determine the current verification environment is not limited. For example, an on-chip system flag (soc_flag) control switch can be set, and the current verification environment can be determined by monitoring the control switch.

之后，计分板可按照当前所处的验证环境对应的获取方式，获取期望值及结果信息，进而可将获取到的期望值与结果信息进行比对等。After that, the scoreboard can obtain the expected value and the result information according to the obtaining method corresponding to the current verification environment, and then can compare the obtained expected value with the result information.

本公开的一个实施例中，若当前所处的验证环境为模块级验证环境，那么可按照以下方式获取期望值及结果信息：从被测设备的输入总线中获取第一源数据，并从输入的sequence中获取第二源数据，若第一源数据与第二源数据一致，则将第一源数据或第二源数据作为待处理源数据，根据待处理源数据确定出期望值，并从被测设备的输出总线中获取结果信息。In an embodiment of the present disclosure, if the current verification environment is a module-level verification environment, the expected value and result information can be obtained in the following manner: the first source data is obtained from the input bus of the device under test, and the input data is obtained from the input bus. The second source data is obtained in the sequence. If the first source data is consistent with the second source data, the first source data or the second source data is used as the source data to be processed, the expected value is determined according to the source data to be processed, and the measured value is obtained from the source data to be processed. The result information is obtained from the output bus of the device.

由于SOC验证环境中没有sequence提供源数据，需要从被测设备的输入总线中获取源数据，因此为实现计分板在模块级验证环境和SOC验证环境下的复用，需要对模块级验证环境中的计分板增加从被测设备的输入总线中获取源数据的操作。Since there is no sequence to provide source data in the SOC verification environment, the source data needs to be obtained from the input bus of the device under test. Therefore, in order to realize the reuse of the scoreboard in the module-level verification environment and the SOC verification environment, it is necessary to verify the module-level verification environment. The scoreboard in adds operations to obtain source data from the input bus of the device under test.

这样，计分板将获取到两路源数据，分别为从被测设备的输入总线中获取的源数据以及从sequence中获取的源数据，为便于区分，分别将从被测设备的输入总线中获取的源数据以及从sequence中获取的源数据称为第一源数据和第二源数据。In this way, the scoreboard will acquire two sources of source data, namely, the source data obtained from the input bus of the device under test and the source data obtained from the sequence. The acquired source data and the source data acquired from the sequence are called the first source data and the second source data.

本公开的一个实施例中，具体地，可利用第一监控器从被测设备的输入总线中获取第一源数据，并可利用第二监控器从被测设备输出总线中获取结果信息，另外，还可在第一源数据与第二源数据一致时，将第一源数据或第二源数据发送给被测设备对应的仿真模型，进而可获取仿真模型返回的期望值。In one embodiment of the present disclosure, specifically, the first monitor can be used to obtain the first source data from the input bus of the device under test, and the second monitor can be used to obtain the result information from the output bus of the device under test. , and when the first source data is consistent with the second source data, the first source data or the second source data can be sent to the simulation model corresponding to the device under test, and then the expected value returned by the simulation model can be obtained.

可以看出，本公开所述方案可兼容现有的实现方式，从而进一步降低了开发成本等。It can be seen that the solutions described in the present disclosure are compatible with existing implementations, thereby further reducing development costs and the like.

结合上述介绍，图4为本公开所述模块级验证环境下计分板的工作方式示意图。Combined with the above introduction, FIG. 4 is a schematic diagram of the working mode of the scoreboard in the module-level verification environment described in the present disclosure.

如图4所示，可利用第一监控器从被测设备的输入总线中获取第一源数据，并可从sequence中获取第二源数据。As shown in FIG. 4 , the first monitor can be used to obtain the first source data from the input bus of the device under test, and the second source data can be obtained from the sequence.

如图4所示，可将第一源数据与第二源数据进行比较，若两者一致，那么可将第一源数据或第二源数据作为待处理数据，进行后续处理，若两者不一致，那么说明从sequence发出到第一监控器采集的过程中存在错误，相应地，可进行报错处理等。As shown in FIG. 4 , the first source data and the second source data can be compared. If the two are consistent, the first source data or the second source data can be used as the data to be processed for subsequent processing. If the two are inconsistent , then it means that there is an error in the process from the sequence sent to the first monitor to collect, and accordingly, error reporting can be processed.

如图4所示，针对待处理数据，可将其发送给仿真模型进行期望值的计算，并可获取仿真模型返回的期望值。As shown in Figure 4, for the data to be processed, it can be sent to the simulation model to calculate the expected value, and the expected value returned by the simulation model can be obtained.

如图4所示，还可通过第二监控器从被测设备的输出总线中获取结果信息，进而可将结果信息与期望值进行比较等。As shown in FIG. 4 , the result information can also be obtained from the output bus of the device under test through the second monitor, and then the result information can be compared with the expected value and so on.

本公开的一个实施例中，若当前所处的验证环境为SOC验证环境，那么可按照以下方式获取期望值及结果信息：从被测设备的输入总线中获取第一源数据，将第一源数据作为待处理源数据，根据待处理源数据确定出期望值，并从被测设备的输出总线中获取结果信息。In an embodiment of the present disclosure, if the current verification environment is the SOC verification environment, the expected value and result information can be obtained in the following manner: first source data is obtained from the input bus of the device under test, and the first source data is As the source data to be processed, the expected value is determined according to the source data to be processed, and the result information is obtained from the output bus of the device under test.

本公开的一个实施例中，具体地，可利用第一监控器从被测设备的输入总线中获取第一源数据，并可利用第二监控器从被测设备输出总线中获取结果信息，另外，还可将第一源数据发送给被测设备对应的仿真模型，进而可获取仿真模型返回的期望值。In one embodiment of the present disclosure, specifically, the first monitor can be used to obtain the first source data from the input bus of the device under test, and the second monitor can be used to obtain the result information from the output bus of the device under test. , the first source data can also be sent to the simulation model corresponding to the device under test, and then the expected value returned by the simulation model can be obtained.

结合上述介绍，图5为本公开所述SOC验证环境下计分板的工作方式示意图。In combination with the above introduction, FIG. 5 is a schematic diagram of the working mode of the scoreboard in the SOC verification environment described in the present disclosure.

如图5所示，可利用第一监控器从被测设备的输入总线中获取第一源数据，并可将第一源数据作为待处理数据。As shown in FIG. 5 , the first monitor can be used to obtain the first source data from the input bus of the device under test, and the first source data can be used as the data to be processed.

如图5所示，针对待处理数据，可将其发送给仿真模型进行期望值的计算，并可获取仿真模型返回的期望值。As shown in Figure 5, for the data to be processed, it can be sent to the simulation model to calculate the expected value, and the expected value returned by the simulation model can be obtained.

如图5所示，还可通过第二监控器从被测设备的输出总线中获取结果信息，进而可将结果信息与期望值进行比较。As shown in FIG. 5 , the result information can also be obtained from the output bus of the device under test through the second monitor, and then the result information can be compared with the expected value.

在SOC验证环境中，通常会包括多个被测设备，每个被测设备对应的计分板均可通过上述方式集成到SOC验证环境中完成复用。In the SOC verification environment, multiple devices under test are usually included, and the scoreboard corresponding to each device under test can be integrated into the SOC verification environment in the above-mentioned manner to complete the reuse.

如图5所示，假设共包括两个被测设备，分别为图5中所示的被测设备1和被测设备2，被测设备1和被测设备2对应的计分板按照同样的方式进行工作。As shown in Figure 5, it is assumed that there are two devices under test, namely, the device under test 1 and the device under test 2 shown in way to work.

需要说明的是，对于前述的方法实施例，为了简单描述，将其表述为一系列的动作组合，但是本领域技术人员应该知悉，本公开并不受所描述的动作顺序的限制，因为依据本公开，某些步骤可以采用其它顺序或者同时进行。其次，本领域技术人员也应该知悉，说明书中所描述的实施例均属于优选实施例，所涉及的动作和模块并不一定是本公开所必须的。It should be noted that, for the purpose of simple description, the foregoing method embodiments are expressed as a series of action combinations, but those skilled in the art should know that the present disclosure is not limited by the described action sequence, because according to this It is disclosed that certain steps may be performed in other orders or concurrently. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present disclosure.

以上是关于方法实施例的介绍，以下通过装置实施例，对本公开所述方案进行进一步说明。The above is an introduction to the method embodiments, and the solutions described in the present disclosure will be further described below through the device embodiments.

图6为本公开所述计分板实施例600的组成结构示意图。如图6所示，包括：第一处理模块601以及第二处理模块602。FIG. 6 is a schematic diagram of the composition and structure of anembodiment 600 of the scoreboard described in the present disclosure. As shown in FIG. 6 , it includes: afirst processing module 601 and asecond processing module 602 .

第一处理模块601，用于确定当前所处的验证环境，当前所处的验证环境为预定的M种验证环境中的一种，M为大于一的正整数。Thefirst processing module 601 is configured to determine the current verification environment, where the current verification environment is one of M predetermined verification environments, where M is a positive integer greater than one.

第二处理模块602，用于按照当前所处的验证环境对应的获取方式，获取期望值及结果信息，并将获取到的期望值与结果信息进行比对。Thesecond processing module 602 is configured to acquire the expected value and the result information according to the acquisition method corresponding to the current verification environment, and compare the acquired expected value with the result information.

可以看出，采用上述装置实施例所述方案，可实现计分板在不同验证环境下的复用，从而减少了资源的浪费，并有效地降低了开发成本及提升了验证效率等。It can be seen that by adopting the solutions described in the above device embodiments, the multiplexing of the scoreboard in different verification environments can be realized, thereby reducing the waste of resources, effectively reducing the development cost and improving the verification efficiency.

本公开的一个实施例中，所述M种验证环境可包括：模块级验证环境以及SOC验证环境。In an embodiment of the present disclosure, the M verification environments may include: a module-level verification environment and an SOC verification environment.

相应地，第一处理模块601需要首先确定出当前所处的验证环境，如何确定出当前所处的验证环境不作限制。Correspondingly, thefirst processing module 601 needs to first determine the current verification environment, and how to determine the current verification environment is not limited.

之后，第二处理模块602可按照当前所处的验证环境对应的获取方式，获取期望值及结果信息，进而可将获取到的期望值与结果信息进行比对等。After that, thesecond processing module 602 can obtain the expected value and the result information according to the obtaining method corresponding to the current verification environment, and then can compare the obtained expected value with the result information.

本公开的一个实施例中，若当前所处的验证环境为模块级验证环境，那么第二处理模块602可按照以下方式获取期望值及结果信息：从被测设备的输入总线中获取第一源数据，并从输入的sequence中获取第二源数据，若第一源数据与第二源数据一致，则将第一源数据或第二源数据作为待处理源数据，根据待处理源数据确定出期望值，并从被测设备的输出总线中获取结果信息。In an embodiment of the present disclosure, if the current verification environment is a module-level verification environment, thesecond processing module 602 can obtain the expected value and result information in the following manner: obtain the first source data from the input bus of the device under test , and obtain the second source data from the input sequence. If the first source data is consistent with the second source data, the first source data or the second source data is used as the source data to be processed, and the expected value is determined according to the source data to be processed. , and get the result information from the output bus of the device under test.

也就是说，第二处理模块602将获取到两路源数据，分别为从被测设备的输入总线中获取的源数据以及从sequence中获取的源数据，为便于区分，分别将从被测设备的输入总线中获取的源数据以及从sequence中获取的源数据称为第一源数据和第二源数据。That is to say, thesecond processing module 602 will obtain two sources of source data, namely the source data obtained from the input bus of the device under test and the source data obtained from the sequence. The source data obtained from the input bus and the source data obtained from the sequence are called the first source data and the second source data.

本公开的一个实施例中，具体地，第二处理模块602可利用第一监控器从被测设备的输入总线中获取第一源数据，并可利用第二监控器从被测设备输出总线中获取结果信息，另外，还可在第一源数据与第二源数据一致时，将第一源数据或第二源数据发送给被测设备对应的仿真模型，进而可获取仿真模型返回的期望值。In an embodiment of the present disclosure, specifically, thesecond processing module 602 can use the first monitor to obtain the first source data from the input bus of the device under test, and can use the second monitor to obtain the first source data from the output bus of the device under test Obtain the result information. In addition, when the first source data is consistent with the second source data, the first source data or the second source data can be sent to the simulation model corresponding to the device under test, and then the expected value returned by the simulation model can be obtained.

本公开的一个实施例中，若当前所处的验证环境为SOC验证环境，那么第二处理模块602可按照以下方式获取期望值及结果信息：从被测设备的输入总线中获取第一源数据，将第一源数据作为待处理源数据，根据待处理源数据确定出期望值，并从被测设备的输出总线中获取结果信息。In an embodiment of the present disclosure, if the current verification environment is the SOC verification environment, thesecond processing module 602 may obtain the expected value and result information in the following manner: obtaining the first source data from the input bus of the device under test, Taking the first source data as the source data to be processed, the expected value is determined according to the source data to be processed, and the result information is obtained from the output bus of the device under test.

本公开的一个实施例中，具体地，第二处理模块602可利用第一监控器从被测设备的输入总线中获取第一源数据，并可利用第二监控器从被测设备输出总线中获取结果信息，另外，还可将第一源数据发送给被测设备对应的仿真模型，进而可获取仿真模型返回的期望值。In an embodiment of the present disclosure, specifically, thesecond processing module 602 can use the first monitor to obtain the first source data from the input bus of the device under test, and can use the second monitor to obtain the first source data from the output bus of the device under test The result information is obtained, and in addition, the first source data can be sent to the simulation model corresponding to the device under test, and then the expected value returned by the simulation model can be obtained.

图6所示装置实施例的具体工作流程可参照前述方法实施例中的相关说明。For the specific workflow of the apparatus embodiment shown in FIG. 6, reference may be made to the relevant descriptions in the foregoing method embodiments.

本公开所述方案可应用于人工智能领域，特别涉及人工智能芯片、云计算及智能语音等领域。人工智能是研究使计算机来模拟人的某些思维过程和智能行为(如学习、推理、思考、规划等)的学科，既有硬件层面的技术也有软件层面的技术，人工智能硬件技术一般包括如传感器、专用人工智能芯片、云计算、分布式存储、大数据处理等技术，人工智能软件技术主要包括计算机视觉技术、语音识别技术、自然语言处理技术以及机器学习/深度学习、大数据处理技术、知识图谱技术等几大方向。The solutions described in the present disclosure can be applied to the field of artificial intelligence, especially to the fields of artificial intelligence chips, cloud computing, and intelligent voice. Artificial intelligence is the study of making computers to simulate certain thinking processes and intelligent behaviors of people (such as learning, reasoning, thinking, planning, etc.). There are both hardware-level technologies and software-level technologies. AI hardware technologies generally include Sensors, special artificial intelligence chips, cloud computing, distributed storage, big data processing and other technologies, artificial intelligence software technologies mainly include computer vision technology, speech recognition technology, natural language processing technology and machine learning/deep learning, big data processing technology, Knowledge graph technology and other major directions.

另外，本公开的技术方案中，所涉及的用户个人信息的收集、存储、使用、加工、传输、提供和公开等处理，均符合相关法律法规的规定，且不违背公序良俗。In addition, in the technical solution of the present disclosure, the collection, storage, use, processing, transmission, provision and disclosure of the user's personal information involved are all in compliance with the relevant laws and regulations, and do not violate public order and good customs.

根据本公开的实施例，本公开还提供了一种电子设备、一种可读存储介质和一种计算机程序产品。According to embodiments of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium, and a computer program product.

图7示出了可以用来实施本公开的实施例的电子设备700的示意性框图。电子设备旨在表示各种形式的数字计算机，诸如，膝上型计算机、台式计算机、工作台、服务器、刀片式服务器、大型计算机、和其它适合的计算机。电子设备还可以表示各种形式的移动装置，诸如，个人数字助理、蜂窝电话、智能电话、可穿戴设备和其它类似的计算装置。本文所示的部件、它们的连接和关系、以及它们的功能仅仅作为示例，并且不意在限制本文中描述的和/或者要求的本公开的实现。FIG. 7 shows a schematic block diagram of anelectronic device 700 that may be used to implement embodiments of the present disclosure. Electronic devices are intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, servers, blade servers, mainframe computers, and other suitable computers. Electronic devices may also represent various forms of mobile devices, such as personal digital assistants, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are by way of example only, and are not intended to limit implementations of the disclosure described and/or claimed herein.

如图7所示，设备700包括计算单元701，其可以根据存储在只读存储器(ROM)702中的计算机程序或者从存储单元708加载到随机访问存储器(RAM)703中的计算机程序，来执行各种适当的动作和处理。在RAM 703中，还可存储设备700操作所需的各种程序和数据。计算单元701、ROM 702以及RAM 703通过总线704彼此相连。输入/输出(I/O)接口705也连接至总线704。As shown in FIG. 7 , thedevice 700 includes acomputing unit 701 that can be executed according to a computer program stored in a read only memory (ROM) 702 or loaded into a random access memory (RAM) 703 from astorage unit 708 Various appropriate actions and handling. In theRAM 703, various programs and data necessary for the operation of thedevice 700 can also be stored. Thecomputing unit 701 , theROM 702 , and theRAM 703 are connected to each other through abus 704 . An input/output (I/O)interface 705 is also connected tobus 704 .

设备700中的多个部件连接至I/O接口705，包括：输入单元706，例如键盘、鼠标等；输出单元707，例如各种类型的显示器、扬声器等；存储单元708，例如磁盘、光盘等；以及通信单元709，例如网卡、调制解调器、无线通信收发机等。通信单元709允许设备700通过诸如因特网的计算机网络和/或各种电信网络与其他设备交换信息/数据。Various components in thedevice 700 are connected to the I/O interface 705, including: aninput unit 706, such as a keyboard, mouse, etc.; anoutput unit 707, such as various types of displays, speakers, etc.; astorage unit 708, such as a magnetic disk, an optical disk, etc. ; and acommunication unit 709, such as a network card, a modem, a wireless communication transceiver, and the like. Thecommunication unit 709 allows thedevice 700 to exchange information/data with other devices through a computer network such as the Internet and/or various telecommunication networks.

计算单元701可以是各种具有处理和计算能力的通用和/或专用处理组件。计算单元701的一些示例包括但不限于中央处理单元(CPU)、图形处理单元(GPU)、各种专用的人工智能(AI)计算芯片、各种运行机器学习模型算法的计算单元、数字信号处理器(DSP)、以及任何适当的处理器、控制器、微控制器等。计算单元701执行上文所描述的各个方法和处理，例如本公开所述的方法。例如，在一些实施例中，本公开所述的方法可被实现为计算机软件程序，其被有形地包含于机器可读介质，例如存储单元708。在一些实施例中，计算机程序的部分或者全部可以经由ROM 702和/或通信单元709而被载入和/或安装到设备700上。当计算机程序加载到RAM 703并由计算单元701执行时，可以执行本公开所述的方法的一个或多个步骤。备选地，在其他实施例中，计算单元701可以通过其他任何适当的方式(例如，借助于固件)而被配置为执行本公开所述的方法。Computing unit 701 may be various general-purpose and/or special-purpose processing components with processing and computing capabilities. Some examples of computingunits 701 include, but are not limited to, central processing units (CPUs), graphics processing units (GPUs), various specialized artificial intelligence (AI) computing chips, various computing units that run machine learning model algorithms, digital signal processing processor (DSP), and any suitable processor, controller, microcontroller, etc. Thecomputing unit 701 performs the various methods and processes described above, such as the methods described in this disclosure. For example, in some embodiments, the methods described in this disclosure may be implemented as a computer software program tangibly embodied on a machine-readable medium, such asstorage unit 708 . In some embodiments, part or all of the computer program may be loaded and/or installed ondevice 700 viaROM 702 and/orcommunication unit 709 . When a computer program is loaded intoRAM 703 and executed by computingunit 701, one or more steps of the methods described in this disclosure may be performed. Alternatively, in other embodiments, thecomputing unit 701 may be configured by any other suitable means (eg, by means of firmware) to perform the methods described in this disclosure.

本文中以上描述的系统和技术的各种实施方式可以在数字电子电路系统、集成电路系统、场可编程门阵列(FPGA)、专用集成电路(ASIC)、专用标准产品(ASSP)、SOC、复杂可编程逻辑设备(CPLD)、计算机硬件、固件、软件、和/或它们的组合中实现。这些各种实施方式可以包括：实施在一个或者多个计算机程序中，该一个或者多个计算机程序可在包括至少一个可编程处理器的可编程系统上执行和/或解释，该可编程处理器可以是专用或者通用可编程处理器，可以从存储系统、至少一个输入装置、和至少一个输出装置接收数据和指令，并且将数据和指令传输至该存储系统、该至少一个输入装置、和该至少一个输出装置。Various implementations of the systems and techniques described herein above may be implemented in digital electronic circuitry, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), SOCs, complex Implemented in programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include being implemented in one or more computer programs executable and/or interpretable on a programmable system including at least one programmable processor that The processor, which may be a special purpose or general-purpose programmable processor, may receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device an output device.

用于实施本公开的方法的程序代码可以采用一个或多个编程语言的任何组合来编写。这些程序代码可以提供给通用计算机、专用计算机或其他可编程数据处理装置的处理器或控制器，使得程序代码当由处理器或控制器执行时使流程图和/或框图中所规定的功能/操作被实施。程序代码可以完全在机器上执行、部分地在机器上执行，作为独立软件包部分地在机器上执行且部分地在远程机器上执行或完全在远程机器或服务器上执行。Program code for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, special purpose computer or other programmable data processing apparatus, such that the program code, when executed by the processor or controller, performs the functions/functions specified in the flowcharts and/or block diagrams. Action is implemented. The program code may execute entirely on the machine, partly on the machine, partly on the machine and partly on a remote machine as a stand-alone software package or entirely on the remote machine or server.

在本公开的上下文中，机器可读介质可以是有形的介质，其可以包含或存储以供指令执行系统、装置或设备使用或与指令执行系统、装置或设备结合地使用的程序。机器可读介质可以是机器可读信号介质或机器可读储存介质。机器可读介质可以包括但不限于电子的、磁性的、光学的、电磁的、红外的、或半导体系统、装置或设备，或者上述内容的任何合适组合。机器可读存储介质的更具体示例会包括基于一个或多个线的电气连接、便携式计算机盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦除可编程只读存储器(EPROM或快闪存储器)、光纤、便捷式紧凑盘只读存储器(CD-ROM)、光学储存设备、磁储存设备、或上述内容的任何合适组合。In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in connection with the instruction execution system, apparatus or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. Machine-readable media may include, but are not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media would include one or more wire-based electrical connections, portable computer disks, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory), fiber optics, compact disk read only memory (CD-ROM), optical storage, magnetic storage, or any suitable combination of the foregoing.

为了提供与用户的交互，可以在计算机上实施此处描述的系统和技术，该计算机具有：用于向用户显示信息的显示装置(例如，CRT(阴极射线管)或者LCD(液晶显示器)监视器)；以及键盘和指向装置(例如，鼠标或者轨迹球)，用户可以通过该键盘和该指向装置来将输入提供给计算机。其它种类的装置还可以用于提供与用户的交互；例如，提供给用户的反馈可以是任何形式的传感反馈(例如，视觉反馈、听觉反馈、或者触觉反馈)；并且可以用任何形式(包括声输入、语音输入或者、触觉输入)来接收来自用户的输入。To provide interaction with a user, the systems and techniques described herein may be implemented on a computer having a display device (eg, a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user ); and a keyboard and pointing device (eg, a mouse or trackball) through which a user can provide input to the computer. Other kinds of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (eg, visual feedback, auditory feedback, or tactile feedback); and can be in any form (including acoustic input, voice input, or tactile input) to receive input from the user.

可以将此处描述的系统和技术实施在包括后台部件的计算系统(例如，作为数据服务器)、或者包括中间件部件的计算系统(例如，应用服务器)、或者包括前端部件的计算系统(例如，具有图形用户界面或者网络浏览器的用户计算机，用户可以通过该图形用户界面或者该网络浏览器来与此处描述的系统和技术的实施方式交互)、或者包括这种后台部件、中间件部件、或者前端部件的任何组合的计算系统中。可以通过任何形式或者介质的数字数据通信(例如，通信网络)来将系统的部件相互连接。通信网络的示例包括：局域网(LAN)、广域网(WAN)和互联网。The systems and techniques described herein may be implemented on a computing system that includes back-end components (eg, as a data server), or a computing system that includes middleware components (eg, an application server), or a computing system that includes front-end components (eg, a user's computer having a graphical user interface or web browser through which a user may interact with implementations of the systems and techniques described herein), or including such backend components, middleware components, Or any combination of front-end components in a computing system. The components of the system may be interconnected by any form or medium of digital data communication (eg, a communication network). Examples of communication networks include: Local Area Networks (LANs), Wide Area Networks (WANs), and the Internet.

计算机系统可以包括客户端和服务器。客户端和服务器一般远离彼此并且通常通过通信网络进行交互。通过在相应的计算机上运行并且彼此具有客户端-服务器关系的计算机程序来产生客户端和服务器的关系。服务器可以是云服务器，也可以为分布式系统的服务器，或者是结合了区块链的服务器。A computer system can include clients and servers. Clients and servers are generally remote from each other and usually interact through a communication network. The relationship of client and server arises by computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, a distributed system server, or a server combined with blockchain.

应该理解，可以使用上面所示的各种形式的流程，重新排序、增加或删除步骤。例如，本发公开中记载的各步骤可以并行地执行也可以顺序地执行也可以不同的次序执行，只要能够实现本公开公开的技术方案所期望的结果，本文在此不进行限制。It should be understood that steps may be reordered, added or deleted using the various forms of flow shown above. For example, the steps described in the present disclosure can be executed in parallel, sequentially, or in different orders. As long as the desired results of the technical solutions disclosed in the present disclosure can be achieved, there is no limitation herein.

上述具体实施方式，并不构成对本公开保护范围的限制。本领域技术人员应该明白的是，根据设计要求和其他因素，可以进行各种修改、组合、子组合和替代。任何在本公开的精神和原则之内所作的修改、等同替换和改进等，均应包含在本公开保护范围之内。The above-mentioned specific embodiments do not constitute a limitation on the protection scope of the present disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may occur depending on design requirements and other factors. Any modifications, equivalent replacements, and improvements made within the spirit and principles of the present disclosure should be included within the protection scope of the present disclosure.

Claims (8)

1. A score board implementation method comprises the following steps:

determining a current verification environment, wherein the current verification environment is one of M preset verification environments, and M is a positive integer greater than one;

acquiring an expected value and result information according to an acquisition mode corresponding to the verification environment where the verification environment is located currently, and comparing the expected value with the result information;

wherein the obtaining of the expected value and the result information according to the obtaining mode corresponding to the verification environment where the current verification environment is located includes:

if the current verification environment is the module-level verification environment, performing the following processing:

acquiring first source data from an input bus of the tested device, and acquiring second source data from the input sequence information;

and if the first source data is consistent with the second source data, taking the first source data or the second source data as source data to be processed, determining the expected value according to the source data to be processed, and acquiring the result information from an output bus of the tested equipment.

2. The method of claim 1, wherein the obtaining the expected value and the result information according to the obtaining manner corresponding to the verification environment where the current location exists further comprises:

if the verification environment is the system-on-chip verification environment, performing the following processing:

acquiring first source data from an input bus of a device to be tested;

and taking the first source data as source data to be processed, determining the expected value according to the source data to be processed, and acquiring the result information from an output bus of the tested equipment.

3. The method of claim 1 or 2,

the acquiring a first source data from an input bus of the device under test includes: obtaining the first source data from the input bus using a first monitor;

the obtaining the result information from the output bus of the device under test comprises: obtaining the result information from the output bus by a second monitor;

the determining the expected value according to the to-be-processed source data includes: and sending the source data to be processed to a simulation model corresponding to the tested device, and acquiring the expected value returned by the simulation model and generated according to the source data to be processed.

4. A scoreboard, comprising: the device comprises a first processing module and a second processing module;

the first processing module is configured to determine a current verification environment, where the current verification environment is one of M predetermined verification environments, and M is a positive integer greater than one;

the second processing module is used for acquiring an expected value and result information according to an acquisition mode corresponding to the current verification environment, and comparing the expected value with the result information;

wherein, if the verification environment at present is a module-level verification environment, the second processing module performs the following processing: acquiring first source data from an input bus of the tested device, and acquiring second source data from the input sequence information; and if the first source data is consistent with the second source data, taking the first source data or the second source data as source data to be processed, determining the expected value according to the source data to be processed, and acquiring the result information from an output bus of the tested equipment.

5. The scoreboard of claim 4, wherein,

if the verification environment where the current verification environment is located is a system-on-chip verification environment, the second processing module performs the following processing: acquiring first source data from an input bus of a device to be tested; and taking the first source data as source data to be processed, determining the expected value according to the source data to be processed, and acquiring the result information from an output bus of the tested equipment.

6. The scoreboard of claim 4 or 5,

the second processing module acquires the first source data from the input bus by using the first monitor, acquires the result information from the output bus by using the second monitor, sends the source data to be processed to the simulation model corresponding to the tested device, and acquires the expected value, which is returned by the simulation model and generated according to the source data to be processed, of the simulation model.

7. An electronic device, comprising:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-3.

8. A non-transitory computer readable storage medium having stored thereon computer instructions for causing a computer to perform the method of any one of claims 1-3.

Images