本申请涉及数据处理领域，具体而言，涉及一种虚拟资源的数据处理方法及装置、存储介质、处理器。The present application relates to the field of data processing, specifically, to a data processing method and device for virtual resources, a storage medium, and a processor.
随着云计算的发展，各种异构虚拟资源（包括处理器、内存、机型等不一致）层出不穷。With the development of cloud computing, various heterogeneous virtual resources (including inconsistent processors, memory, machine models, etc.) emerge in an endless stream.
如何解决因系统异常导致异构虚拟资源被挤占、无法及时释放导致资源利用率低、运维成本高、故障处理难，是亟待解决的一个问题。How to solve the problem that heterogeneous virtual resources are occupied due to system abnormalities and cannot be released in time, resulting in low resource utilization, high operation and maintenance costs, and difficult troubleshooting, is an issue that needs to be solved urgently.
为了解决上述问题，现有技术中存在异构多云的运维管理方法及混合云平台，通过获取云资源的异常信息，确定至少一个与之关联的异常事件和其匹配的处理规则，根据处理规则进行故障处理；但是，仍然存在如下缺陷：异常事件关系挖掘具有较高时间复杂度，实现较为复杂；不支持异构云资源的批量计算处理。In order to solve the above problems, there are heterogeneous multi-cloud operation and maintenance management methods and hybrid cloud platforms in the existing technology. By obtaining the abnormal information of cloud resources, at least one abnormal event associated with it and its matching processing rules are determined, and according to the processing rules Perform fault handling; however, there are still the following defects: abnormal event relationship mining has high time complexity and is complicated to implement; it does not support batch computing processing of heterogeneous cloud resources.
针对相关技术中因系统异常导致异构虚拟资源被挤占，致使资源利用率低的问题，目前尚未提出有效的解决方案。In related technologies, no effective solution has yet been proposed for the problem that heterogeneous virtual resources are occupied due to system abnormalities, resulting in low resource utilization.
本申请的主要目的在于提供一种虚拟资源的数据处理方法及系统，以解决相关技术中因系统异常导致异构虚拟资源被挤占，致使资源利用率低的问题。The main purpose of this application is to provide a data processing method and system for virtual resources to solve the problem in related technologies that heterogeneous virtual resources are occupied due to system abnormalities, resulting in low resource utilization.
为了实现上述目的，根据本申请的一个方面，提供了一种虚拟资源的数据处理方法，包括：确定目标系统产生的异常事件的属性信息，其中，所述属性信息包括所述异常事件占用的虚拟资源；根据所述属性信息生成对应的待处理任务，其中，所述待处理任务包括对所述虚拟资源的处理逻辑；通过执行所述待处理任务，对所述异常事件的虚拟资源进行处理。In order to achieve the above object, according to one aspect of the present application, a data processing method for virtual resources is provided, including: determining attribute information of an abnormal event generated by the target system, wherein the attribute information includes the virtual resource occupied by the abnormal event. Resources; generate corresponding to-be-processed tasks according to the attribute information, wherein the to-be-processed tasks include processing logic for the virtual resources; and process the virtual resources of the abnormal events by executing the to-be-processed tasks.
可选的，确定目标系统产生的异常事件的属性信息包括：在所述目标系统产生异常的情况下，获取异常编码；根据所述异常编码在预设的异常事件集合中查找，确定所述异常编码对应的异常事件；根据所述异常事件生成异常事件实例；根据所述异常事件实例确定所述异常事件的属性信息。Optionally, determining the attribute information of the abnormal event generated by the target system includes: when the target system generates an abnormality, obtain an abnormality code; search in a preset abnormal event set according to the abnormality code to determine the abnormality Encoding the corresponding abnormal event; generating an abnormal event instance according to the abnormal event; and determining attribute information of the abnormal event according to the abnormal event instance.
可选的，根据所述属性信息生成对应的待处理任务包括：调用封装接口对所述属性信息进行封装，生成对应的待处理任务；所述方法还包括：将所述待处理任务写入任务集合，其中，所述任务集合用于对所述任务集合中的待处理任务进行执行和状态记录。Optionally, generating a corresponding task to be processed according to the attribute information includes: calling an encapsulation interface to encapsulate the attribute information and generating a corresponding task to be processed; the method further includes: writing the task to be processed into a task A set, wherein the task set is used to execute and record the status of the tasks to be processed in the task set.
可选的，通过执行所述待处理任务，对所述异常事件的虚拟资源进行处理包括：定时获取需要批量处理的多个待处理任务，其中，所述多个待处理任务为至少一个异常事件的虚拟资源的处理任务，所述多个待处理任务对应的虚拟资源的类型相同；将所述多个待处理任务通过对应的处理平台进行批量处理，其中，所述处理平台用于对同一类型的虚拟资源进行处理。Optionally, by executing the to-be-processed tasks, processing the virtual resources of the abnormal event includes: regularly acquiring multiple to-be-processed tasks that need to be processed in batches, wherein the multiple to-be-processed tasks are at least one abnormal event. The processing tasks of virtual resources, the virtual resources corresponding to the multiple to-be-processed tasks are of the same type; the multiple to-be-processed tasks are batch processed through the corresponding processing platform, wherein the processing platform is used to process the same type of virtual resources. Virtual resources are processed.
可选的，将所述多个待处理任务通过对应的处理平台进行批量处理之后，所述方法还包括：接收所述处理平台发送的对所述多个待处理任务的处理结果信息，其中，所述处理结果信息包括目标待处理任务处理成功或处理失败；在所述目标待处理任务处理成功的情况下，更改所述目标待处理任务的状态为第一状态；在所述目标待处理任务处理失败的情况下，记录所述目标待处理任务的失败次数，在所述失败次数达到预设次数的情况下，更改所述目标待处理任务的状态为第二状态；其中，所述多个待处理任务的状态为待处理，或者处理失败且处理失败次数未达到预设次数。Optionally, after the multiple to-be-processed tasks are batch-processed through the corresponding processing platform, the method further includes: receiving processing result information for the multiple to-be-processed tasks sent by the processing platform, wherein, The processing result information includes successful or failed processing of the target task to be processed; when the target task to be processed is successfully processed, the status of the target task to be processed is changed to the first state; when the target task to be processed is In the case of processing failure, record the number of failures of the target to-be-processed task, and when the number of failures reaches a preset number of times, change the state of the target to-be-processed task to the second state; wherein, the plurality of The status of the pending task is pending, or the processing failed and the number of processing failures did not reach the preset number.
可选的，将所述多个待处理任务通过对应的处理平台进行批量处理包括：确定用于与所述处理平台进行数据传输的数据接口是否支持批量传输；在所述数据接口支持批量传输的情况下，通过所述数据接口将所述多个待处理任务传输至所述处理平台进行批量处理；在所述数据接口不支持批量传输的情况下，通过多线程将所述多个待处理任务传输至所述处理平台进行批量处理。Optionally, batch processing the multiple to-be-processed tasks through the corresponding processing platform includes: determining whether the data interface used for data transmission with the processing platform supports batch transmission; In this case, the multiple to-be-processed tasks are transferred to the processing platform through the data interface for batch processing; in the case where the data interface does not support batch transmission, the multiple to-be-processed tasks are transferred to the processing platform through multi-threading. Transfer to the processing platform for batch processing.
可选的，通过所述数据接口将所述多个待处理任务传输至所述处理平台进行批量处理包括：将所述多个待处理任务聚合成任务数组；根据所述任务数组生成对应的虚拟资源处理指令；将所述虚拟资源处理指令发送给所述处理平台，其中，所述处理平台根据所述虚拟资源处理指令对所述多个待处理任务的虚拟资源进行批量处理。Optionally, transmitting the multiple to-be-processed tasks to the processing platform for batch processing through the data interface includes: aggregating the multiple to-be-processed tasks into a task array; and generating corresponding virtual tasks according to the task array. Resource processing instructions; sending the virtual resource processing instructions to the processing platform, wherein the processing platform performs batch processing on the virtual resources of the plurality of tasks to be processed according to the virtual resource processing instructions.
为了实现上述目的，根据本申请的另一方面，提供了一种虚拟资源的数据处理装置。该装置包括：确定模块，用于确定目标系统产生的异常事件的属性信息，其中，所述属性信息包括所述异常事件占用的虚拟资源；生成模块，用于根据所述属性信息生成对应的待处理任务，其中，所述待处理任务包括对所述虚拟资源的处理逻辑；处理模块，用于通过执行所述待处理任务，对所述异常事件的虚拟资源进行处理。In order to achieve the above object, according to another aspect of the present application, a data processing apparatus for virtual resources is provided. The device includes: a determining module, used to determine attribute information of abnormal events generated by the target system, wherein the attribute information includes virtual resources occupied by the abnormal events; and a generating module, used to generate corresponding to-be-received data based on the attribute information. Processing tasks, wherein the to-be-processed tasks include processing logic for the virtual resources; and a processing module, configured to process the virtual resources of the abnormal events by executing the to-be-processed tasks.
根据本申请的另一方面，还提供了一种计算机可读存储介质，所述处存储介质用于存储程序，其中，所述程序执行上述中任意一项所述的虚拟资源的数据处理方法。According to another aspect of the present application, a computer-readable storage medium is also provided, the storage medium being used to store a program, wherein the program executes any one of the above virtual resource data processing methods.
根据本申请的另一方面，还提供了一种电子设备，包括一个或多个处理器和存储器，所述存储器用于存储一个或多个程序，其中，当所述一个或多个程序被所述一个或多个处理器执行时，使得所述一个或多个处理器实现上述中任意一项所述的虚拟资源的数据处理方法。According to another aspect of the present application, an electronic device is also provided, including one or more processors and a memory, the memory being used to store one or more programs, wherein when the one or more programs are When the one or more processors execute, the one or more processors implement the data processing method for virtual resources described in any one of the above.
通过本申请，确定目标系统产生的异常事件的属性信息，其中，属性信息包括异常事件占用的虚拟资源；根据属性信息生成对应的待处理任务，其中，待处理任务包括对虚拟资源的处理逻辑；通过执行待处理任务，对异常事件的虚拟资源进行处理。根据异常事件的虚拟资源属性信息生成待处理任务，通过对待处理任务的执行，来实现对异常事件的虚拟资源的处理，实现了提高系统发生异常事件时，对其虚拟资源释放的效率和准确率，进而提高系统的资源利用率的技术效果，进而解决了相关技术中因系统异常导致异构虚拟资源被挤占，致使资源利用率低的问题。Through this application, the attribute information of the abnormal event generated by the target system is determined, where the attribute information includes the virtual resources occupied by the abnormal event; corresponding to-be-processed tasks are generated based on the attribute information, where the to-be-processed tasks include processing logic for the virtual resources; Process the virtual resources of abnormal events by executing pending tasks. To-be-processed tasks are generated based on the virtual resource attribute information of abnormal events. Through the execution of the to-be-processed tasks, the virtual resources of abnormal events are processed, thereby improving the efficiency and accuracy of releasing virtual resources when abnormal events occur in the system. , thereby improving the technical effect of system resource utilization, thereby solving the problem in related technologies that heterogeneous virtual resources are occupied due to system abnormalities, resulting in low resource utilization.
构成本申请的一部分的附图用来提供对本申请的进一步理解，本申请的示意性实施例及其说明用于解释本申请，并不构成对本申请的不当限定。在附图中：The drawings that form a part of this application are used to provide a further understanding of this application. The illustrative embodiments and descriptions of this application are used to explain this application and do not constitute an improper limitation of this application. In the attached picture:
图1是根据本申请实施例提供的一种虚拟资源的数据处理方法的流程图；Figure 1 is a flow chart of a data processing method for virtual resources provided according to an embodiment of the present application;
图2是根据本申请实施方式提供的系统异常识别的流程图；Figure 2 is a flow chart of system anomaly identification provided according to the embodiment of the present application;
图3是根据本申请实施方式提供的任务处理的流程图；Figure 3 is a flow chart of task processing provided according to an embodiment of the present application;
图4是根据本申请实施方式提供的资源批量处理的流程图；Figure 4 is a flow chart of resource batch processing provided according to the embodiment of the present application;
图5是根据本申请实施例提供的一种虚拟资源的数据处理装置的示意图；Figure 5 is a schematic diagram of a data processing device for virtual resources provided according to an embodiment of the present application;
图6是根据本申请实施例提供的一种电子设备的示意图。Figure 6 is a schematic diagram of an electronic device provided according to an embodiment of the present application.
需要说明的是，在不冲突的情况下，本申请中的实施例及实施例中的特征可以相互组合。下面将参考附图并结合实施例来详细说明本申请。It should be noted that, as long as there is no conflict, the embodiments and features in the embodiments of this application can be combined with each other. The present application will be described in detail below with reference to the accompanying drawings and embodiments.
为了使本技术领域的人员更好地理解本申请方案，下面将结合本申请实施例中的附图，对本申请实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本申请一部分的实施例，而不是全部的实施例。基于本申请中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都应当属于本申请保护的范围。In order to enable those in the technical field to better understand the solutions of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only These are part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative efforts should fall within the scope of protection of this application.
需要说明的是，本申请的说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别类似的对象，而不必用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换，以便这里描述的本申请的实施例。此外，术语“包括”和“具有”以及他们的任何变形，意图在于覆盖不排他的包含，例如，包含了一系列步骤或单元的过程、方法、系统、产品或设备不必限于清楚地列出的那些步骤或单元，而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它步骤或单元。It should be noted that the terms "first", "second", etc. in the description and claims of this application and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that data so used may be interchanged where appropriate for the embodiments of the application described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, e.g., a process, method, system, product, or apparatus that encompasses a series of steps or units and need not be limited to those explicitly listed. Those steps or elements may instead include other steps or elements not expressly listed or inherent to the process, method, product or apparatus.
需要说明的是，本公开所涉及的相关信息（包括但不限于用户设备信息、用户个人信息等）和数据（包括但不限于用于展示的数据、分析的数据等），均为经用户授权或者经过各方充分授权的信息和数据。例如，本系统和相关用户或机构间设置有接口，在获取相关信息之前，需要通过接口向前述的用户或机构发送获取请求，并在接收到前述的用户或机构反馈的同意信息后，获取相关信息。It should be noted that the relevant information (including but not limited to user equipment information, user personal information, etc.) and data (including but not limited to data for display, analysis data, etc.) involved in this disclosure are authorized by the user. Or information and data fully authorized by all parties. For example, there is an interface between this system and relevant users or institutions. Before obtaining relevant information, it is necessary to send an acquisition request to the aforementioned users or institutions through the interface, and after receiving the consent information fed back by the aforementioned users or institutions, obtain the relevant information. information.
下面结合优选的实施步骤对本发明进行说明，图1是根据本申请实施例提供的一种虚拟资源的数据处理方法的流程图，如图1所示，该方法包括如下步骤：The present invention will be described below with reference to preferred implementation steps. Figure 1 is a flow chart of a data processing method for virtual resources provided according to an embodiment of the present application. As shown in Figure 1, the method includes the following steps:
步骤S101，确定目标系统产生的异常事件的属性信息，其中，属性信息包括异常事件占用的虚拟资源；Step S101, determine the attribute information of the abnormal event generated by the target system, where the attribute information includes the virtual resources occupied by the abnormal event;
步骤S102，根据属性信息生成对应的待处理任务，其中，待处理任务包括对虚拟资源的处理逻辑；Step S102: Generate corresponding tasks to be processed according to the attribute information, where the tasks to be processed include processing logic for virtual resources;
步骤S103，通过执行待处理任务，对异常事件的虚拟资源进行处理。Step S103: Process virtual resources of abnormal events by executing pending tasks.
通过上述步骤，确定目标系统产生的异常事件的属性信息，其中，属性信息包括异常事件占用的虚拟资源；根据属性信息生成对应的待处理任务，其中，待处理任务包括对虚拟资源的处理逻辑；通过执行待处理任务，对异常事件的虚拟资源进行处理。根据异常事件的虚拟资源属性信息生成待处理任务，通过对待处理任务的执行，来实现对异常事件的虚拟资源的处理，实现了提高系统发生异常事件时，对其虚拟资源释放的效率和准确率，进而提高系统的资源利用率的技术效果，进而解决了相关技术中因系统异常导致异构虚拟资源被挤占，致使资源利用率低的问题。Through the above steps, the attribute information of the abnormal event generated by the target system is determined, where the attribute information includes the virtual resources occupied by the abnormal event; the corresponding to-be-processed task is generated according to the attribute information, where the to-be-processed task includes the processing logic for the virtual resource; Process the virtual resources of abnormal events by executing pending tasks. To-be-processed tasks are generated based on the virtual resource attribute information of abnormal events. Through the execution of the to-be-processed tasks, the virtual resources of abnormal events are processed, thereby improving the efficiency and accuracy of releasing virtual resources when abnormal events occur in the system. , thereby improving the technical effect of system resource utilization, thereby solving the problem in related technologies that heterogeneous virtual resources are occupied due to system abnormalities, resulting in low resource utilization.
上述步骤的执行主体可以云计算系统的服务器，或者云计算系统之外的第三方设备，用于对云计算系统进行资源协调管理。上述目标系统可以为云计算系统，系统中的处理器、内存、机型不一致，会导致系统中存在各种异构虚拟资源，虚拟资源的处理往往涉及到不同的硬件，种类繁多，难以统一处理。尤其在系统发生异常时，会导致其对应的虚拟资源无法处理，进而导致虚拟资源的浪费。本实施例中，上述步骤的执行主体为云计算系统内部的任务处理引擎，其作用是将虚拟资源的处理转化为待处理任务进行执行，来实现对虚拟资源进行处理的目的。The execution subject of the above steps can be a server of the cloud computing system or a third-party device outside the cloud computing system, which is used for resource coordination and management of the cloud computing system. The above target system can be a cloud computing system. The processor, memory, and machine model in the system are inconsistent, which will lead to the existence of various heterogeneous virtual resources in the system. The processing of virtual resources often involves different hardware, and there are many types, making it difficult to process them uniformly. . Especially when an abnormality occurs in the system, the corresponding virtual resources cannot be processed, resulting in a waste of virtual resources. In this embodiment, the execution subject of the above steps is the task processing engine inside the cloud computing system, and its function is to convert the processing of virtual resources into tasks to be processed for execution, so as to achieve the purpose of processing virtual resources.
既然虚拟资源的浪费是由于系统异常引起的，因此，就需要在系统发生异常事件时，及时准确的识别出来。可选的，本实施例中，确定目标系统产生的异常事件的属性信息包括：在目标系统产生异常的情况下，获取异常编码；根据异常编码在预设的异常事件集合中查找，确定异常编码对应的异常事件；根据异常事件生成异常事件实例；根据异常事件实例确定异常事件的属性信息。Since the waste of virtual resources is caused by system abnormalities, it is necessary to promptly and accurately identify abnormal events in the system. Optionally, in this embodiment, determining the attribute information of the abnormal event generated by the target system includes: obtaining the abnormal code when the target system generates an abnormality; searching in the preset abnormal event collection according to the abnormal code to determine the abnormal code The corresponding abnormal event; generate an abnormal event instance based on the abnormal event; determine the attribute information of the abnormal event based on the abnormal event instance.
上述异常编码是系统在发生异常时，会自动产生对应的异常编码以记录异常发生的时间，位置和具体的情况，其作用相当于异常日志。根据异常编码，在预设的异常事件集合中查找，确定异常编码对应的异常事件。该异常事件集合中包括了异常编码以及异常编码对应的异常事件。在根据异常编码进行查找时，按照预设的逻辑进行查找，例如，通过关键字进行查找，还可以通过聚类，或者机器学习的方式进行分类，确定异常编码对应的类别，进而根据类别对应的异常事件确定异常编码对应的异常事件。其目的是为了确定其对应的异常事件，进而根据异常事件进行处理，得到包括占用的虚拟资源的属性信息，进而对占用的虚拟资源进行释放，来实现对虚拟资源的处理。The above exception code is that when an exception occurs, the system will automatically generate the corresponding exception code to record the time, location and specific circumstances of the exception. Its function is equivalent to an exception log. According to the abnormal code, search in the preset abnormal event collection to determine the abnormal event corresponding to the abnormal code. The abnormal event set includes abnormal codes and abnormal events corresponding to the abnormal codes. When searching based on abnormal coding, search according to preset logic, for example, search by keywords, or classify by clustering or machine learning to determine the category corresponding to the abnormal coding, and then according to the category corresponding Abnormal event determines the abnormal event corresponding to the abnormal code. The purpose is to determine the corresponding abnormal event, process it according to the abnormal event, obtain attribute information including the occupied virtual resources, and then release the occupied virtual resources to realize the processing of the virtual resources.
在根据属性信息进行虚拟资源处理时。先根据属性信息生成对应的待处理任务，任务处理引擎就可以对待处理任务进行执行，来实现待处理任务对虚拟资源的处理。可选的，根据属性信息生成对应的待处理任务包括：调用封装接口对属性信息进行封装，生成对应的待处理任务；方法还包括：将待处理任务写入任务集合，其中，任务集合用于对任务集合中的待处理任务进行执行和状态记录。When performing virtual resource processing based on attribute information. First, the corresponding to-be-processed task is generated based on the attribute information, and then the task processing engine can execute the to-be-processed task to realize the processing of virtual resources by the to-be-processed task. Optionally, generating corresponding to-be-processed tasks according to the attribute information includes: calling an encapsulation interface to encapsulate the attribute information and generating corresponding to-be-processed tasks; the method also includes: writing the to-be-processed tasks into a task set, where the task set is used to Execute and record the status of pending tasks in the task collection.
在得到上述属性信息之后，通过封装接口对属性信息进行封装，生成待处理任务，并将待处理任务写入任务集合，以便任务引擎按照处理策略进行任务处理。进而实现对虚拟资源的处理。After obtaining the above attribute information, the attribute information is encapsulated through the encapsulation interface, a task to be processed is generated, and the task to be processed is written into the task collection so that the task engine can process the task according to the processing strategy. Then realize the processing of virtual resources.
可选的，通过执行待处理任务，对异常事件的虚拟资源进行处理包括：定时获取需要批量处理的多个待处理任务，其中，多个待处理任务为至少一个异常事件的虚拟资源的处理任务，多个待处理任务对应的虚拟资源的类型相同；将多个待处理任务通过对应的处理平台进行批量处理，其中，处理平台用于对同一类型的虚拟资源进行处理。Optionally, processing virtual resources of abnormal events by executing pending tasks includes: regularly acquiring multiple pending tasks that need to be processed in batches, where the multiple pending tasks are processing tasks for virtual resources of at least one abnormal event. , the virtual resources corresponding to the multiple to-be-processed tasks are of the same type; the multiple to-be-processed tasks are processed in batches through the corresponding processing platform, where the processing platform is used to process the same type of virtual resources.
具体的，在执行待处理任务，对异常事件的虚拟资源进行处理时，采取批量处理的方式。先定时获取需要批量处理的多个待处理任务，将多个待处理任务通过对应的处理平台进行批量处理。处理平台用于对同一类型的虚拟资源进行处理，多个待处理任务为至少一个异常事件的虚拟资源的处理任务，多个待处理任务对应的虚拟资源的类型相同，这样才能批量处理。Specifically, when executing pending tasks and processing virtual resources of abnormal events, batch processing is adopted. First, multiple pending tasks that need to be processed in batches are obtained regularly, and the multiple pending tasks are processed in batches through the corresponding processing platform. The processing platform is used to process virtual resources of the same type. Multiple to-be-processed tasks are virtual resource processing tasks for at least one exception event. The virtual resources corresponding to multiple to-be-processed tasks are of the same type, so that they can be processed in batches.
通过批量处理的方式，提高待处理任务的处理效率，进而提高虚拟资源的处理效率。Through batch processing, the processing efficiency of pending tasks is improved, thereby improving the processing efficiency of virtual resources.
可选的，将多个待处理任务通过对应的处理平台进行批量处理之后，方法还包括：接收处理平台发送的对多个待处理任务的处理结果信息，其中，处理结果信息包括目标待处理任务处理成功或处理失败；在目标待处理任务处理成功的情况下，更改目标待处理任务的状态为第一状态；在目标待处理任务处理失败的情况下，记录目标待处理任务的失败次数，在失败次数达到预设次数的情况下，更改目标待处理任务的状态为第二状态；其中，多个待处理任务的状态为待处理，或者处理失败且处理失败次数未达到预设次数。Optionally, after the multiple pending tasks are batch-processed through the corresponding processing platform, the method also includes: receiving processing result information for the multiple pending tasks sent by the processing platform, where the processing result information includes the target pending task. The processing is successful or the processing fails; if the target pending task is processed successfully, the status of the target pending task is changed to the first state; if the target pending task fails, the number of failures of the target pending task is recorded. When the number of failures reaches the preset number, the status of the target pending task is changed to the second state; in which, the status of multiple pending tasks is pending, or the processing fails and the number of processing failures does not reach the preset number.
对于批量处理的结果，考虑到处理平台的处理能力，提供了一种失败重试机制，也即是在待处理任务的处理结果信息为处理失败的情况下，更新任务状态为失败，并记录失败次数，直至预设次数之后，仍然处理失败，则将该待处理任务失败的消息进行发送。或者在对处理失败的任务重新进行处理后，处理成功了，则更改任务状态为成功。由此可知，上述第一状态为成功状态，第二状态为最终的失败状态，与正常的失败状态可以相同，但是若该失败状态的次数以达到预设次数，将最终的失败状态作为处理结果反馈给用户。For batch processing results, taking into account the processing capabilities of the processing platform, a failure retry mechanism is provided, that is, when the processing result information of the task to be processed is a processing failure, the task status is updated to fail and the failure is recorded. times, and if the processing still fails after the preset number of times, a message indicating that the pending task failed will be sent. Or after the failed task is reprocessed and the task is successfully processed, the task status is changed to successful. It can be seen that the above-mentioned first state is a success state, and the second state is the final failure state, which can be the same as the normal failure state. However, if the number of times of the failure state reaches the preset number, the final failure state will be used as the processing result. Feedback to users.
可选的，将多个待处理任务通过对应的处理平台进行批量处理包括：确定用于与处理平台进行数据传输的数据接口是否支持批量传输；在数据接口支持批量传输的情况下，通过数据接口将多个待处理任务传输至该处理平台进行批量处理；在数据接口不支持批量传输的情况下，通过多线程将多个待处理任务传输至该处理平台进行批量处理。Optionally, batch processing of multiple to-be-processed tasks through the corresponding processing platform includes: determining whether the data interface used for data transmission with the processing platform supports batch transmission; if the data interface supports batch transmission, through the data interface Transmit multiple pending tasks to the processing platform for batch processing; when the data interface does not support batch transmission, multiple pending tasks are transmitted to the processing platform for batch processing through multi-threading.
在批量处理的过程中，不仅需要处理平台进行批量处理，而且需要向处理凭他批量发送待处理任务这样才能最大程度提高待处理任务批量处理的效率。需要说明的是，处理平台批量处理任务的方式可以设置多个虚拟处理模块，并行处理，或者采用其他的方式进行批量处理。而批量传输就需要确定上述执行主体，也即是任务处理引擎与处理平台的数据接口是否支持批量传输，若支持，则通过数据接口进行批量传输。若不支持，则需要任务处理引擎采用多线程并发传输的方式，尽可能快的将多个待处理任务发送给处理平台，来尽可能的保证快速准确的将待处理任务发送给处理平台，一共处理平台批量处理。In the process of batch processing, not only does the processing platform need to perform batch processing, but also the tasks to be processed need to be sent to the processing platform in batches. This can maximize the efficiency of batch processing of tasks to be processed. It should be noted that the way to handle batch processing tasks on the platform can be to set up multiple virtual processing modules for parallel processing, or to use other methods for batch processing. For batch transmission, it is necessary to determine whether the above-mentioned execution subject, that is, the data interface between the task processing engine and the processing platform supports batch transmission. If so, batch transmission will be performed through the data interface. If it is not supported, the task processing engine needs to use multi-threaded concurrent transmission to send multiple pending tasks to the processing platform as quickly as possible to ensure that the pending tasks are sent to the processing platform as quickly and accurately as possible. Processing platform for batch processing.
可选的，通过数据接口将多个待处理任务传输至处理平台进行批量处理包括：将多个待处理任务聚合成任务数组；根据任务数组生成对应的虚拟资源处理指令；将虚拟资源处理指令发送给处理平台，其中，处理平台根据虚拟资源处理指令对多个待处理任务的虚拟资源进行批量处理。Optionally, transmitting multiple pending tasks to the processing platform through the data interface for batch processing includes: aggregating multiple pending tasks into a task array; generating corresponding virtual resource processing instructions based on the task array; and sending the virtual resource processing instructions. A processing platform is provided, wherein the processing platform performs batch processing on virtual resources of multiple tasks to be processed according to virtual resource processing instructions.
具体的，若处理平台支持批量处理，则聚合待处理任务中的虚拟资源实例形成实例数组入参，异步发送资源处理指令，对待处理任务的虚拟资源进行处理。Specifically, if the processing platform supports batch processing, the virtual resource instances in the tasks to be processed are aggregated to form an instance array input parameter, and resource processing instructions are sent asynchronously to process the virtual resources of the tasks to be processed.
需要说明的是，在附图的流程图示出的步骤可以在诸如一组计算机可执行指令的计算机系统中执行，并且，虽然在流程图中示出了逻辑顺序，但是在某些情况下，可以以不同于此处的顺序执行所示出或描述的步骤。It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions, and, although a logical sequence is shown in the flowchart, in some cases, The steps shown or described may be performed in a different order than here.
需要说明的是，本申请还提供了一种可选的实施方式，下面对该实施方式进行详细说明。It should be noted that this application also provides an optional implementation, and this implementation will be described in detail below.
本实施方式提供了一种消耗型异构虚拟资源多维动态撤销方法。采用异常识别分拣机制，多维度识别异常并动态获取合适的资源预处理方案，极大程度免去运维人员投入大量精力分析异常数据，有效降低人工运维成本。还采用了多任务批量处理机制，任务处理引擎配合定时作业调度模块，通过多云适配层接口统一转换处理，实现对虚拟资源的批量调度。多任务调度有效降低因网络通信问题导致接口调用失败的几率，同时降低系统主流程业务的线程压力。具体如下：This implementation mode provides a multi-dimensional dynamic revocation method of consumable heterogeneous virtual resources. The anomaly recognition and sorting mechanism is adopted to identify anomalies in multiple dimensions and dynamically obtain appropriate resource preprocessing solutions, which greatly eliminates the need for operation and maintenance personnel to invest a lot of energy in analyzing abnormal data, effectively reducing manual operation and maintenance costs. A multi-task batch processing mechanism is also adopted. The task processing engine cooperates with the scheduled job scheduling module to perform unified conversion processing through the multi-cloud adaptation layer interface to achieve batch scheduling of virtual resources. Multi-task scheduling effectively reduces the probability of interface call failure due to network communication problems, and also reduces the thread pressure of the system's main process business. details as follows:
1. 异常识别分拣，图2是根据本申请实施方式提供的系统异常识别的流程图，如图2所示，具体步骤如下。1. Abnormal identification and sorting. Figure 2 is a flow chart of system abnormal identification provided according to the embodiment of this application. As shown in Figure 2, the specific steps are as follows.
I、系统异常触发异常识别分拣机制，获取系统异常产生的异常编码；I. System exceptions trigger the exception identification and sorting mechanism to obtain the exception codes generated by system exceptions;
II、异常处理器根据异常编码与预设的异常规则集，从异常事件集中匹配合适的异常事件：II. The exception processor matches appropriate exception events from the exception event set based on the exception coding and the preset exception rule set:
其中i=1,2,3,...,nwhere i=1,2,3,...,n
上述公式中的函数为异常处理器匹配与解析逻辑；函数为回调函数。The function in the above formula is the exception handler matching and parsing logic; the function is the callback function.
III、事件监听器监听发布的异常事件，生成异常事件实例；III. The event listener monitors the published abnormal events and generates exception event instances;
IV、异常事件实例提取关联的云资源实例关键信息，封装任务单元发送至任务处理引擎。IV. The abnormal event instance extracts the key information of the associated cloud resource instance, encapsulates the task unit and sends it to the task processing engine.
2. 任务处理引擎，图3是根据本申请实施方式提供的任务处理的流程图，如图3所示，具体内容如下。2. Task processing engine, Figure 3 is a flow chart of task processing provided according to the implementation of this application, as shown in Figure 3, the specific content is as follows.
I、本实施方式的系统调用任务处理引擎的任务单元封装接口，封装诸如计算资源、存储资源、网络资源等云资源目标实例, 关键信息，生成对应类型的任务单元 并写入任务数据集 ；I. The system of this embodiment calls the task unit encapsulation interface of the task processing engine, encapsulates cloud resource target instances and key information such as computing resources, storage resources, network resources, etc., generates task units of the corresponding type and writes them into the task data set;
II、任务处理引擎维护任务单元的生命周期，根据任务执行情况实时更新任务数集中任务的状态及重试次数；II. The task processing engine maintains the life cycle of the task unit and updates the status and retry times of tasks in the task number set in real time according to the task execution status;
III、定时作业按预设间隔定时调度任务单元，调用任务处理引擎多线程执行对应任务单元的任务处理逻辑。III. The scheduled job schedules task units at preset intervals and calls the task processing engine multi-thread to execute the task processing logic of the corresponding task unit.
3. 云资源批量处理，图4是根据本申请实施方式提供的资源批量处理的流程图，如图4所示，具体步骤如下。3. Batch processing of cloud resources. Figure 4 is a flow chart of batch processing of resources provided according to the implementation of this application. As shown in Figure 4, the specific steps are as follows.
I、定时作业调度扫描符合要求的任务单元，状态为待处理或失败且失败次数小于阈值；I. Scheduled job scheduling scans task units that meet the requirements, the status is pending or failed and the number of failures is less than the threshold;
II、通过多云适配接口层，适配异构多云环境。判断对接的云管平台是否支持批量处理，若是：II. Adapt to heterogeneous multi-cloud environments through the multi-cloud adaptation interface layer. Determine whether the connected cloud management platform supports batch processing, if so:
1. 聚合任务单元中的虚拟资源实例形成实例数组入参，异步发送资源处理指令；1. Aggregate the virtual resource instances in the task unit to form an instance array as input parameters, and send resource processing instructions asynchronously;
2. 否则，启用线程池多线程批量发送资源处理指令。2. Otherwise, enable the thread pool multi-thread to send resource processing instructions in batches.
III、若接收到云管平台处理成功信息，更新对应任务状态为已完成；否则更新状态为失败并更新失败次数。III. If successful processing information from the cloud management platform is received, the corresponding task status is updated to completed; otherwise, the update status is failed and the number of failures is updated.
本实施方式可以有效提升故障处理效率：因系统各类异常导致的虚拟资源占用自动故障处理，可极大减少人工运维成本，提升云计算系统云资源利用率。还可以统一管控异构云资源：实现了计算资源、存储资源、网络资源等多种异构云资源的统一撤销处理，基本涵盖了云计算相关业务的绝大多数场景，适用性与实用性广泛。实现异构云资源的批量处理：采用定时作业调度技术，配合任务处理引擎，实现虚拟资源的统一采集。通过多云适配层接口统一转换处理，云管平台接收协同执行资源处理操作。批量处理机制极大降低了因网络通信问题导致的接口调用失败几率，同时降低了系统主流程业务的线程压力。This implementation method can effectively improve the efficiency of fault handling: automatic fault handling of virtual resource occupation caused by various system abnormalities can greatly reduce manual operation and maintenance costs and improve cloud resource utilization of the cloud computing system. It can also manage and control heterogeneous cloud resources in a unified way: it realizes the unified withdrawal processing of various heterogeneous cloud resources such as computing resources, storage resources, network resources, etc., basically covering most scenarios of cloud computing-related business, and has wide applicability and practicality. . Achieve batch processing of heterogeneous cloud resources: Use scheduled job scheduling technology and cooperate with the task processing engine to achieve unified collection of virtual resources. Through the multi-cloud adaptation layer interface, the conversion processing is unified, and the cloud management platform receives and collaboratively executes resource processing operations. The batch processing mechanism greatly reduces the probability of interface call failure due to network communication problems, and at the same time reduces the thread pressure of the system's main process business.
需要说明的是，在具体实施时可以主要包括以下步骤：It should be noted that the specific implementation can mainly include the following steps:
1. 系统异常触发本实施方式的异常识别分拣机制，获取所述异常的异常编码；1. System anomalies trigger the anomaly identification and sorting mechanism of this implementation to obtain the anomaly code of the anomaly;
2. 异常处理器根据异常编码与预设的异常规则集，从异常事件集中匹配合适的异常事件；事件监听器监听发布的异常事件，生成异常事件实例；所述异常事件实例解析系统异常数据，提取关联的虚拟资源实例关键信息发送至任务处理引擎；2. The exception processor matches appropriate exception events from the exception event set based on the exception coding and the preset exception rule set; the event listener monitors the published exception events and generates exception event instances; the exception event instances parse the system exception data, Extract the key information of the associated virtual resource instance and send it to the task processing engine;
3. 定时作业调度模块按预设时间定时扫描，获取所述任务记录中包含的资源实例关键信息，封装为待处理任务单元；3. The scheduled job scheduling module scans regularly according to the preset time, obtains the key information of the resource instance contained in the task record, and encapsulates it into a task unit to be processed;
4. 经由多云适配层统一转换处理，向云管平台发起云资源批量处理请求指令；4. Through the unified conversion processing of the multi-cloud adaptation layer, initiate cloud resource batch processing request instructions to the cloud management platform;
5. 若接收到云管平台返回的资源处理成功消息，任务处理引擎将关联的任务单元标记为已完成；5. If the resource processing success message returned by the cloud management platform is received, the task processing engine will mark the associated task unit as completed;
6. 否则，任务处理引擎将关联的任务单元标记为失败，并更新失败重试次数，在预设失败重试次数阈值内，等待步骤4处理。6. Otherwise, the task processing engine marks the associated task unit as failed and updates the number of failed retries. Within the preset threshold of failed retries, wait for step 4 to be processed.
本实施方式具有异常识别分拣机制：自动化解析系统异常信息，提取异常信息包含的虚拟资源实例关键信息。无需运维人员介入，极大降低人工运维成本。支持资源回收失败重试：任务处理引擎通过设置失败重试次数，配合定时作业定时调度，极大减少任务单元因网络欠佳、服务器调用异常导致的偶发性执行失败次数。支持多云异构场景：本实施方式通过多云适配层，实现对多云异构环境的抽象处理，达到灵活对接不同基础云设施管理平台，实现多云异构场景资源自动回收目的。支持批量处理：通过定时作业调度一个批次的待处理任务单元，调用云管平台资源处理接口，实现云资源的批量回收，极大提升系统云资源的利用率。海域异常识别分拣、定时作业调度、任务处理引擎和批量处理相结合的技术能极大提升云计算系统虚拟资源的利用率；能够在不需要人工运维介入的情况下，多维动态实现虚拟资源的异常撤销处理。This implementation has an exception identification and sorting mechanism: it automatically parses system exception information and extracts key information about virtual resource instances contained in the exception information. No operation and maintenance personnel are required to intervene, greatly reducing manual operation and maintenance costs. Support resource recovery failure retries: The task processing engine greatly reduces the number of sporadic execution failures of task units caused by poor network conditions and abnormal server calls by setting the number of failed retries and cooperating with scheduled job scheduling. Support multi-cloud heterogeneous scenarios: This implementation implements abstract processing of multi-cloud heterogeneous environments through the multi-cloud adaptation layer, achieves flexible connection with different basic cloud facility management platforms, and achieves automatic recycling of resources in multi-cloud heterogeneous scenarios. Support batch processing: schedule a batch of task units to be processed through scheduled jobs, and call the resource processing interface of the cloud management platform to realize batch recycling of cloud resources, greatly improving the utilization of the system's cloud resources. Technology that combines sea area anomaly identification and sorting, scheduled job scheduling, task processing engines and batch processing can greatly improve the utilization of virtual resources in cloud computing systems; it can dynamically realize multi-dimensional virtual resources without the need for manual operation and maintenance intervention. Exception cancellation handling.
本申请实施例还提供了一种虚拟资源的数据处理装置，需要说明的是，本申请实施例的虚拟资源的数据处理装置可以用于执行本申请实施例所提供的用于虚拟资源的数据处理方法。以下对本申请实施例提供的虚拟资源的数据处理装置进行介绍。The embodiments of the present application also provide a data processing device for virtual resources. It should be noted that the data processing device for virtual resources in the embodiments of the present application can be used to perform the data processing for virtual resources provided by the embodiments of the present application. method. The following is an introduction to the data processing apparatus for virtual resources provided by embodiments of the present application.
图5是根据本申请实施例提供的一种虚拟资源的数据处理装置的示意图，如图5所示，该装置包括：确定模块52，生成模块54，处理模块56，下面对该装置进行详细说明。Figure 5 is a schematic diagram of a data processing device for virtual resources provided according to an embodiment of the present application. As shown in Figure 5, the device includes: a determination module 52, a generation module 54, and a processing module 56. The device will be described in detail below. illustrate.
确定模块52，用于确定目标系统产生的异常事件的属性信息，其中，属性信息包括异常事件占用的虚拟资源；生成模块54，与上述确定模块52相连，用于根据属性信息生成对应的待处理任务，其中，待处理任务包括对虚拟资源的处理逻辑；处理模块56，与上述生成模块54相连，用于通过执行待处理任务，对异常事件的虚拟资源进行处理。The determination module 52 is used to determine the attribute information of the abnormal event generated by the target system, where the attribute information includes the virtual resources occupied by the abnormal event; the generation module 54 is connected to the above-mentioned determination module 52 and is used to generate the corresponding to-be-processed data based on the attribute information. Tasks, where the tasks to be processed include processing logic for virtual resources; the processing module 56 is connected to the above-mentioned generation module 54 and is used to process virtual resources of abnormal events by executing tasks to be processed.
本申请实施例提供的虚拟资源的数据处理装置，确定目标系统产生的异常事件的属性信息，其中，属性信息包括异常事件占用的虚拟资源；根据属性信息生成对应的待处理任务，其中，待处理任务包括对虚拟资源的处理逻辑；通过执行待处理任务，对异常事件的虚拟资源进行处理。根据异常事件的虚拟资源属性信息生成待处理任务，通过对待处理任务的执行，来实现对异常事件的虚拟资源的处理，实现了提高系统发生异常事件时，对其虚拟资源释放的效率和准确率，进而提高系统的资源利用率的技术效果，进而解决了相关技术中因系统异常导致异构虚拟资源被挤占，致使资源利用率低的问题。The virtual resource data processing device provided by the embodiment of the present application determines the attribute information of the abnormal event generated by the target system, where the attribute information includes the virtual resource occupied by the abnormal event; and generates a corresponding to-be-processed task based on the attribute information, where the to-be-processed Tasks include processing logic for virtual resources; virtual resources for abnormal events are processed by executing pending tasks. To-be-processed tasks are generated based on the virtual resource attribute information of abnormal events. Through the execution of the to-be-processed tasks, the virtual resources of abnormal events are processed, thereby improving the efficiency and accuracy of releasing virtual resources when abnormal events occur in the system. , thereby improving the technical effect of system resource utilization, thereby solving the problem in related technologies that heterogeneous virtual resources are occupied due to system abnormalities, resulting in low resource utilization.
虚拟资源的数据处理装置包括处理器和存储器，上述确定模块52，生成模块54，处理模块56等均作为程序单元存储在存储器中，由处理器执行存储在存储器中的上述程序单元来实现相应的功能。The data processing device of virtual resources includes a processor and a memory. The above-mentioned determination module 52, generation module 54, processing module 56, etc. are all stored in the memory as program units. The processor executes the above-mentioned program units stored in the memory to implement the corresponding Function.
处理器中包含内核，由内核去存储器中调取相应的程序单元。内核可以设置一个或以上，通过调整内核参数来解决了相关技术中因系统异常导致异构虚拟资源被挤占，致使资源利用率低的问题。The processor contains a core, which retrieves the corresponding program unit from the memory. One or more kernels can be set. By adjusting kernel parameters, the problem in related technologies that heterogeneous virtual resources are occupied due to system abnormalities, resulting in low resource utilization, is solved.
存储器可能包括计算机可读介质中的非永久性存储器，随机存取存储器(RAM)和/或非易失性内存等形式，如只读存储器(ROM)或闪存(flash RAM)，存储器包括至少一个存储芯片。Memory may include non-permanent memory in computer-readable media, random access memory (RAM) and/or non-volatile memory, such as read-only memory (ROM) or flash memory (flash RAM). The memory includes at least one memory chip.
本发明实施例提供了一种计算机可读存储介质，其上存储有程序，该程序被处理器执行时实现虚拟资源的数据处理方法。Embodiments of the present invention provide a computer-readable storage medium on which a program is stored. When the program is executed by a processor, a data processing method for virtual resources is implemented.
本发明实施例提供了一种处理器，处理器用于运行程序，其中，程序运行时执行虚拟资源的数据处理方法。Embodiments of the present invention provide a processor, which is used to run a program. When the program is running, a data processing method for virtual resources is executed.
图6是根据本申请实施例提供的一种电子设备的示意图，如图6所示，本申请实施例提供了一种电子设备60，设备包括处理器、存储器及存储在存储器上并可在处理器上运行的程序，处理器执行程序时实现上述任一项方法的步骤。Figure 6 is a schematic diagram of an electronic device provided according to an embodiment of the present application. As shown in Figure 6, an embodiment of the present application provides an electronic device 60. The device includes a processor, a memory, and a device that is stored in the memory and can be processed A program runs on a processor, and the processor implements the steps of any of the above methods when executing the program.
本申请中的设备可以是服务器、PC、PAD、手机等。The devices in this application can be servers, PCs, PADs, mobile phones, etc.
本申请还提供了一种计算机程序产品，当在虚拟资源的数据处理设备上执行时，适于执行初始化有上述任一方法步骤的程序。The present application also provides a computer program product, which, when executed on a data processing device of a virtual resource, is suitable for executing a program initialized with any of the above method steps.
本领域内的技术人员应明白，本申请的实施例可提供为方法、系统、或计算机程序产品。因此，本申请可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且，本申请可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质（包括但不限于磁盘存储器、CD-ROM、光学存储器等）上实施的计算机程序产品的形式。Those skilled in the art will understand that embodiments of the present application may be provided as methods, systems, or computer program products. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment that combines software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
本申请是参照根据本申请实施例的方法、设备（系统）、和计算机程序产品的流程图和／或方框图来描述的。应理解可由计算机程序指令实现流程图和／或方框图中的每一流程和／或方框、以及流程图和／或方框图中的流程和／或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程虚拟资源的数据处理设备的处理器以产生一个机器，使得通过计算机或其他可编程虚拟资源的数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和／或方框图一个方框或多个方框中指定的功能的装置。The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each process and/or block in the flowchart illustrations and/or block diagrams, and combinations of processes and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other data processing device with programmable virtual resources to produce a machine that enables processing by the computer or other data processing device with programmable virtual resources. The instructions executed by the processor produce means for implementing the functions specified in the process or processes of the flow diagrams and/or the block or blocks of the block diagrams.
这些计算机程序指令也可存储在能引导计算机或其他可编程虚拟资源的数据处理设备以特定方式工作的计算机可读存储器中，使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品，该指令装置实现在流程图一个流程或多个流程和／或方框图一个方框或多个方框中指定的功能。These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other data processing apparatus of a programmable virtual resource to operate in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including the instructions means , the instruction device implements the functions specified in one process or multiple processes in the flow chart and/or one block or multiple blocks in the block diagram.
这些计算机程序指令也可装载到计算机或其他可编程虚拟资源的数据处理设备上，使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理，从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和／或方框图一个方框或多个方框中指定的功能的步骤。These computer program instructions may also be loaded onto a computer or other data processing device of a programmable virtual resource, causing a series of operating steps to be performed on the computer or other programmable device to produce a computer-implemented process, thereby causing the computer or other programmable device to The instructions executed on provide steps for implementing the functions specified in a process or processes of the flow diagrams and/or a block or blocks of the block diagrams.
在一个典型的配置中，计算设备包括一个或多个处理器 (CPU)、输入/输出接口、网络接口和内存。In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
存储器可能包括计算机可读介质中的非永久性存储器，随机存取存储器(RAM)和/或非易失性内存等形式，如只读存储器(ROM)或闪存(flash RAM)。存储器是计算机可读介质的示例。Memory may include non-volatile memory in computer-readable media, random access memory (RAM) and/or non-volatile memory in the form of read-only memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.
计算机可读介质包括永久性和非永久性、可移动和非可移动媒体可以由任何方法或技术来实现信息存储。信息可以是计算机可读指令、数据结构、程序的模块或其他数据。计算机的存储介质的例子包括，但不限于相变内存 (PRAM)、静态随机存取存储器 (SRAM)、动态随机存取存储器 (DRAM)、其他类型的随机存取存储器 (RAM)、只读存储器 (ROM)、电可擦除可编程只读存储器 (EEPROM)、快闪记忆体或其他内存技术、只读光盘只读存储器 (CD-ROM)、数字多功能光盘 (DVD) 或其他光学存储、磁盒式磁带，磁带磁盘存储或其他磁性存储设备或任何其他非传输介质，可用于存储可以被计算设备访问的信息。按照本文中的界定，计算机可读介质不包括暂存电脑可读媒体 (transitory media)，如调制的数据信号和载波。Computer-readable media includes both persistent and non-volatile, removable and non-removable media that can be implemented by any method or technology for storage of information. Information may be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase change memory(PRAM), static random access memory (SRAM), dynamic random access memory(DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, CD-ROM (CD-ROM), digital versatile disc(DVD) or other optical storage, magnetic cassettes, tape disk storage or other magnetic storage devices or any other non-transmission medium that may be used to store information that can be accessed by a computing device. As defined in this article, computer-readable media does not include temporary computer-readable media(transitory media), such as modulated data signals and carrier waves.
还需要说明的是，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、商品或者设备不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、商品或者设备所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括要素的过程、方法、商品或者设备中还存在另外的相同要素。It should also be noted that the terms "comprises," "comprises," or any other variation thereof are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that includes a list of elements not only includes those elements, but also includes Other elements are not expressly listed or are inherent to the process, method, article or equipment. Without further limitation, an element qualified by the statement "comprises a..." does not exclude the presence of additional identical elements in the process, method, good, or device that includes the element.
本领域技术人员应明白，本申请的实施例可提供为方法、系统或计算机程序产品。因此，本申请可采用完全硬件实施例、完全软件实施例或结合软件和硬件方面的实施例的形式。而且，本申请可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质（包括但不限于磁盘存储器、CD-ROM、光学存储器等）上实施的计算机程序产品的形式。Those skilled in the art will understand that embodiments of the present application may be provided as methods, systems or computer program products. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
以上仅为本申请的实施例而已，并不用于限制本申请。对于本领域技术人员来说，本申请可以有各种更改和变化。凡在本申请的精神和原理之内所作的任何修改、等同替换、改进等，均应包含在本申请的权利要求范围之内。The above are only examples of the present application and are not used to limit the present application. To those skilled in the art, various modifications and variations may be made to this application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of this application shall be included in the scope of the claims of this application.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210909019.2 | 2022-07-29 | ||
| CN202210909019.2ACN115454618A (en) | 2022-07-29 | 2022-07-29 | Data processing method and device for virtual resources, storage medium and processor |
| Publication Number | Publication Date |
|---|---|
| WO2024021498A1true WO2024021498A1 (en) | 2024-02-01 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2022/141904CeasedWO2024021498A1 (en) | 2022-07-29 | 2022-12-26 | Data processing method and apparatus for virtual resource, storage medium, and processor |
| Country | Link |
|---|---|
| CN (1) | CN115454618A (en) |
| WO (1) | WO2024021498A1 (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN118869791A (en)* | 2024-05-11 | 2024-10-29 | 腾讯科技（深圳）有限公司 | Business allocation method, device, product, storage medium and equipment |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115454618A (en)* | 2022-07-29 | 2022-12-09 | 天翼云科技有限公司 | Data processing method and device for virtual resources, storage medium and processor |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106817243A (en)* | 2015-12-01 | 2017-06-09 | 广达电脑股份有限公司 | Management system and management method for server resources |
| US20180060112A1 (en)* | 2016-01-14 | 2018-03-01 | International Business Machines Corporation | Method and apparatus for resolving contention at the hypervisor level |
| CN113656209A (en)* | 2021-08-18 | 2021-11-16 | 深圳市腾讯计算机系统有限公司 | Resource processing method, device, equipment and storage medium |
| CN115454618A (en)* | 2022-07-29 | 2022-12-09 | 天翼云科技有限公司 | Data processing method and device for virtual resources, storage medium and processor |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110502891B (en)* | 2019-08-08 | 2021-06-15 | 北京字节跳动网络技术有限公司 | Method, device, medium and electronic equipment for acquiring process memory leakage |
| CN110442404B (en)* | 2019-08-13 | 2022-07-05 | 武汉斗鱼鱼乐网络科技有限公司 | Object release method, device, equipment and storage medium |
| CN114648349A (en)* | 2020-12-21 | 2022-06-21 | 北京达佳互联信息技术有限公司 | Method, device, electronic device and storage medium for using virtual resources |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106817243A (en)* | 2015-12-01 | 2017-06-09 | 广达电脑股份有限公司 | Management system and management method for server resources |
| US20180060112A1 (en)* | 2016-01-14 | 2018-03-01 | International Business Machines Corporation | Method and apparatus for resolving contention at the hypervisor level |
| CN113656209A (en)* | 2021-08-18 | 2021-11-16 | 深圳市腾讯计算机系统有限公司 | Resource processing method, device, equipment and storage medium |
| CN115454618A (en)* | 2022-07-29 | 2022-12-09 | 天翼云科技有限公司 | Data processing method and device for virtual resources, storage medium and processor |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN118869791A (en)* | 2024-05-11 | 2024-10-29 | 腾讯科技（深圳）有限公司 | Business allocation method, device, product, storage medium and equipment |
| Publication number | Publication date |
|---|---|
| CN115454618A (en) | 2022-12-09 |
| Publication | Publication Date | Title |
|---|---|---|
| US11544137B2 (en) | Data processing platform monitoring | |
| CN107105009B (en) | Job scheduling method and device for butting workflow engine based on Kubernetes system | |
| CN104794194B (en) | A kind of distributed heterogeneous concurrent computational system towards large scale multimedia retrieval | |
| WO2024021498A1 (en) | Data processing method and apparatus for virtual resource, storage medium, and processor | |
| WO2021159638A1 (en) | Method, apparatus and device for scheduling cluster queue resources, and storage medium | |
| WO2021129116A1 (en) | Neural network processor and control method therefor | |
| US12014216B2 (en) | Method for platform-based scheduling of job flow | |
| WO2024012003A9 (en) | Data processing method and apparatus, and device, storage medium and program product | |
| CN120186142B (en) | MCP protocol-based cross-environment AI task collaborative execution method, device and storage medium | |
| CN113849287A (en) | Processing method, device, electronic device and storage medium for algorithm service | |
| CN114840318A (en) | A scheduling method for multiple processes to preempt hardware key encryption and decryption resources | |
| US20210373945A1 (en) | Method and device for processing distributed data solving problem of manual intervention by data analysts | |
| CA3202557C (en) | A data distribution method, apparatus, device and storage medium | |
| CN117311937A (en) | Distributed task scheduling method and device, electronic equipment and storage medium | |
| CN114398179B (en) | Method and device for acquiring tracking identifier, server and storage medium | |
| CN116346823A (en) | A large data heterogeneous task scheduling method and system based on message queue | |
| CN114510396A (en) | Private cloud inspection method, device and computer readable medium | |
| CN110928659B (en) | Numerical value pool system remote multi-platform access method with self-adaptive function | |
| CN118585297A (en) | A task execution method and related equipment | |
| CN118689591A (en) | Method, apparatus, medium and program product for processing computing tasks | |
| CN117455160A (en) | Production scheduling methods and related equipment | |
| CN115794432A (en) | Data distribution docking system and method | |
| CN116521593A (en) | Communication method, system and related equipment of baseboard management controller | |
| CN115460265A (en) | Interface calling method, device, equipment and medium | |
| CN115499493A (en) | Asynchronous transaction processing method and device, storage medium and computer equipment |
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application | Ref document number:22952927 Country of ref document:EP Kind code of ref document:A1 | |
| NENP | Non-entry into the national phase | Ref country code:DE | |
| 122 | Ep: pct application non-entry in european phase | Ref document number:22952927 Country of ref document:EP Kind code of ref document:A1 |