





技术领域technical field
本申请涉及数据处理领域,具体而言,涉及一种虚拟资源的数据处理方法及装置、存储介质、处理器。The present application relates to the field of data processing, in particular, to a data processing method and device, a storage medium, and a processor for virtual resources.
背景技术Background technique
随着云计算的发展,各种异构虚拟资源(包括处理器、内存、机型等不一致)层出不穷,如何解决因系统异常导致异构虚拟资源被挤占、无法及时释放导致资源利用率低、运维成本高、故障处理难,是亟待解决的一个问题。With the development of cloud computing, various heterogeneous virtual resources (including inconsistencies such as processors, memory, and models) emerge in endlessly. High maintenance costs and difficult troubleshooting are problems that need to be solved urgently.
为了解决上述问题,现有技术中存在异构多云的运维管理方法及混合云平台,通过获取云资源的异常信息,确定至少一个与之关联的异常事件和其匹配的处理规则,根据处理规则进行故障处理;但是,仍然存在如下缺陷:异常事件关系挖掘具有较高时间复杂度,实现较为复杂;不支持异构云资源的批量计算处理。In order to solve the above problems, there are heterogeneous multi-cloud operation and maintenance management methods and hybrid cloud platforms in the prior art. By obtaining the abnormal information of cloud resources, at least one associated abnormal event and its matching processing rules are determined. According to the processing rules Fault processing; however, there are still the following defects: abnormal event relationship mining has a high time complexity, and the implementation is relatively complicated; it does not support batch computing processing of heterogeneous cloud resources.
针对相关技术中因系统异常导致异构虚拟资源被挤占,致使资源利用率低的问题,目前尚未提出有效的解决方案。Aiming at the problem in related technologies that heterogeneous virtual resources are occupied due to system abnormalities, resulting in low resource utilization, no effective solution has been proposed yet.
发明内容Contents of the invention
本申请的主要目的在于提供一种虚拟资源的数据处理方法及系统,以解决相关技术中因系统异常导致异构虚拟资源被挤占,致使资源利用率低的问题。The main purpose of the present application is to provide a data processing method and system for virtual resources, so as to solve the problem in related technologies that heterogeneous virtual resources are occupied due to system abnormalities, resulting in low resource utilization.
为了实现上述目的,根据本申请的一个方面,提供了一种虚拟资源的数据处理方法,包括:确定目标系统产生的异常事件的属性信息,其中,所述属性信息包括所述异常事件占用的虚拟资源;根据所述属性信息生成对应的待处理任务,其中,所述待处理任务包括对所述虚拟资源的处理逻辑;通过执行所述待处理任务,对所述异常事件的虚拟资源进行处理。In order to achieve the above object, according to one aspect of the present application, a data processing method for virtual resources is provided, including: determining the attribute information of the abnormal event generated by the target system, wherein the attribute information includes the virtual resources occupied by the abnormal event resources; generating a corresponding task to be processed according to the attribute information, wherein the task to be processed includes processing logic for the virtual resource; by executing the task to be processed, the virtual resource of the abnormal event is processed.
可选的,确定目标系统产生的异常事件的属性信息包括:在所述目标系统产生异常的情况下,获取异常编码;根据所述异常编码在预设的异常事件集合中查找,确定所述异常编码对应的异常事件;根据所述异常事件生成异常事件实例;根据所述异常事件实例确定所述异常事件的属性信息。Optionally, determining the attribute information of the abnormal event generated by the target system includes: obtaining an abnormality code when the target system generates an abnormality; searching in a preset abnormal event set according to the abnormality code, and determining the abnormality Encoding the corresponding abnormal event; generating an abnormal event instance according to the abnormal event; determining attribute information of the abnormal event according to the abnormal event instance.
可选的,根据所述属性信息生成对应的待处理任务包括:调用封装接口对所述属性信息进行封装,生成对应的待处理任务;所述方法还包括:将所述待处理任务写入任务集合,其中,所述任务集合用于对所述任务集合中的待处理任务进行执行和状态记录。Optionally, generating a corresponding task to be processed according to the attribute information includes: calling an encapsulation interface to encapsulate the attribute information, and generating a corresponding task to be processed; the method further includes: writing the task to be processed into a task A collection, wherein the task collection is used to execute and record the state of the tasks to be processed in the task collection.
可选的,通过执行所述待处理任务,对所述异常事件的虚拟资源进行处理包括:定时获取需要批量处理的多个待处理任务,其中,所述多个待处理任务为至少一个异常事件的虚拟资源的处理任务,所述多个待处理任务对应的虚拟资源的类型相同;将所述多个待处理任务通过对应的处理平台进行批量处理,其中,所述处理平台用于对同一类型的虚拟资源进行处理。Optionally, processing the virtual resource of the abnormal event by executing the task to be processed includes: regularly acquiring multiple tasks to be processed that need to be processed in batches, wherein the multiple tasks to be processed are at least one abnormal event The virtual resource processing tasks of the plurality of tasks to be processed are of the same type; the plurality of tasks to be processed are processed in batches through the corresponding processing platform, wherein the processing platform is used to process the same type of virtual resources virtual resources for processing.
可选的,将所述多个待处理任务通过对应的处理平台进行批量处理之后,所述方法还包括:接收所述处理平台发送的对所述多个待处理任务的处理结果信息,其中,所述处理结果信息包括目标待处理任务处理成功或处理失败;在所述目标待处理任务处理成功的情况下,更改所述目标待处理任务的状态为第一状态;在所述目标待处理任务处理失败的情况下,记录所述目标待处理任务的失败次数,在所述失败次数达到预设次数的情况下,更改所述目标待处理任务的状态为第二状态;其中,所述多个待处理任务的状态为待处理,或者处理失败且处理失败次数未达到预设次数。Optionally, after batch-processing the plurality of tasks to be processed through the corresponding processing platform, the method further includes: receiving processing result information of the plurality of tasks to be processed sent by the processing platform, wherein, The processing result information includes the processing success or processing failure of the target pending task; if the processing of the target pending task is successful, change the state of the target pending task to the first state; In the case of a processing failure, recording the number of failures of the target pending task, and changing the state of the target pending task to a second state when the number of failures reaches a preset number of times; wherein, the plurality of The status of the pending task is pending, or the processing fails and the number of processing failures does not reach the preset number of times.
可选的,将所述多个待处理任务通过对应的处理平台进行批量处理包括:确定用于与所述处理平台进行数据传输的数据接口是否支持批量传输;在所述数据接口支持批量传输的情况下,通过所述数据接口将所述多个待处理任务传输至所述处理平台进行批量处理;在所述数据接口不支持批量传输的情况下,通过多线程将所述多个待处理任务传输至所述处理平台进行批量处理。Optionally, performing batch processing on the plurality of tasks to be processed through the corresponding processing platform includes: determining whether the data interface used for data transmission with the processing platform supports batch transfer; In this case, the multiple tasks to be processed are transmitted to the processing platform through the data interface for batch processing; when the data interface does not support batch transmission, the multiple tasks to be processed are transmitted through multithreading Transfer to the processing platform for batch processing.
可选的,通过所述数据接口将所述多个待处理任务传输至所述处理平台进行批量处理包括:将所述多个待处理任务聚合成任务数组;根据所述任务数组生成对应的虚拟资源处理指令;将所述虚拟资源处理指令发送给所述处理平台,其中,所述处理平台根据所述虚拟资源处理指令对所述多个待处理任务的虚拟资源进行批量处理。Optionally, transmitting the multiple pending tasks to the processing platform for batch processing through the data interface includes: aggregating the multiple pending tasks into a task array; generating corresponding virtual A resource processing instruction: sending the virtual resource processing instruction to the processing platform, wherein the processing platform performs batch processing on the virtual resources of the plurality of tasks to be processed according to the virtual resource processing instruction.
为了实现上述目的,根据本申请的另一方面,提供了一种虚拟资源的数据处理装置。该装置包括:确定模块,用于确定目标系统产生的异常事件的属性信息,其中,所述属性信息包括所述异常事件占用的虚拟资源;生成模块,用于根据所述属性信息生成对应的待处理任务,其中,所述待处理任务包括对所述虚拟资源的处理逻辑;处理模块,用于通过执行所述待处理任务,对所述异常事件的虚拟资源进行处理。In order to achieve the above purpose, according to another aspect of the present application, a data processing device for virtual resources is provided. The device includes: a determining module, configured to determine the attribute information of the abnormal event generated by the target system, wherein the attribute information includes the virtual resource occupied by the abnormal event; a generating module, configured to generate the corresponding pending event according to the attribute information Processing tasks, wherein the task to be processed includes processing logic for the virtual resource; a processing module is configured to process the virtual resource of the abnormal event by executing the task to be processed.
根据本申请的另一方面,还提供了一种计算机可读存储介质,所述处存储介质用于存储程序,其中,所述程序执行上述中任意一项所述的虚拟资源的数据处理方法。According to another aspect of the present application, there is also provided a computer-readable storage medium for storing a program, wherein the program executes the data processing method for virtual resources described in any one of the above.
根据本申请的另一方面,还提供了一种电子设备,包括一个或多个处理器和存储器,所述存储器用于存储一个或多个程序,其中,当所述一个或多个程序被所述一个或多个处理器执行时,使得所述一个或多个处理器实现上述中任意一项所述的虚拟资源的数据处理方法。According to another aspect of the present application, there is also provided an electronic device, including one or more processors and a memory, the memory is used to store one or more programs, wherein, when the one or more programs are executed When the one or more processors are executed, the one or more processors implement the data processing method for virtual resources described in any one of the above.
通过本申请,确定目标系统产生的异常事件的属性信息,其中,属性信息包括异常事件占用的虚拟资源;根据属性信息生成对应的待处理任务,其中,待处理任务包括对虚拟资源的处理逻辑;通过执行待处理任务,对异常事件的虚拟资源进行处理。根据异常事件的虚拟资源属性信息生成待处理任务,通过对待处理任务的执行,来实现对异常事件的虚拟资源的处理,实现了提高系统发生异常事件时,对其虚拟资源释放的效率和准确率,进而提高系统的资源利用率的技术效果,进而解决了相关技术中因系统异常导致异构虚拟资源被挤占,致使资源利用率低的问题。Through this application, determine the attribute information of the abnormal event generated by the target system, wherein the attribute information includes the virtual resource occupied by the abnormal event; generate a corresponding task to be processed according to the attribute information, wherein the task to be processed includes the processing logic for the virtual resource; The virtual resources of abnormal events are processed by executing pending tasks. Generate tasks to be processed according to the attribute information of the virtual resources of the abnormal event, and realize the processing of the virtual resources of the abnormal event through the execution of the task to be processed, so as to improve the efficiency and accuracy of the release of the virtual resources when the abnormal event occurs in the system , thereby improving the technical effect of resource utilization of the system, and further solving the problem in related technologies that heterogeneous virtual resources are occupied due to system abnormalities, resulting in low resource utilization.
附图说明Description of drawings
构成本申请的一部分的附图用来提供对本申请的进一步理解,本申请的示意性实施例及其说明用于解释本申请,并不构成对本申请的不当限定。在附图中:The drawings constituting a part of the application are used to provide further understanding of the application, and the schematic embodiments and descriptions of the application are used to explain the application, and do not constitute an improper limitation to the application. In the attached picture:
图1是根据本申请实施例提供的一种虚拟资源的数据处理方法的流程图;FIG. 1 is a flow chart of a data processing method for virtual resources provided according to an embodiment of the present application;
图2是根据本申请实施方式提供的系统异常识别的流程图;FIG. 2 is a flow chart of system abnormality identification provided according to an embodiment of the present application;
图3是根据本申请实施方式提供的任务处理的流程图;FIG. 3 is a flow chart of task processing provided according to an embodiment of the present application;
图4是根据本申请实施方式提供的资源批量处理的流程图;FIG. 4 is a flow chart of resource batch processing provided according to an embodiment of the present application;
图5是根据本申请实施例提供的一种虚拟资源的数据处理装置的示意图;FIG. 5 is a schematic diagram of a virtual resource data processing device provided according to an embodiment of the present application;
图6是根据本申请实施例提供的一种电子设备的示意图。Fig. 6 is a schematic diagram of an electronic device provided according to an embodiment of the present application.
具体实施方式detailed description
需要说明的是,在不冲突的情况下,本申请中的实施例及实施例中的特征可以相互组合。下面将参考附图并结合实施例来详细说明本申请。It should be noted that, in the case of no conflict, the embodiments in the present application and the features in the embodiments can be combined with each other. The present application will be described in detail below with reference to the accompanying drawings and embodiments.
为了使本技术领域的人员更好地理解本申请方案,下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本申请一部分的实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都应当属于本申请保护的范围。In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiment of the application will be clearly and completely described below in conjunction with the accompanying drawings in the embodiment of the application. Obviously, the described embodiment is only It is an embodiment of a part of the application, but not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without creative efforts shall fall within the scope of protection of this application.
需要说明的是,本申请的说明书和权利要求书及上述附图中的术语“第一”、“第二”等是用于区别类似的对象,而不必用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换,以便这里描述的本申请的实施例。此外,术语“包括”和“具有”以及他们的任何变形,意图在于覆盖不排他的包含,例如,包含了一系列步骤或单元的过程、方法、系统、产品或设备不必限于清楚地列出的那些步骤或单元,而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它步骤或单元。It should be noted that the terms "first" and "second" in the description and claims of the present application and the above drawings are used to distinguish similar objects, but not necessarily used to describe a specific sequence or sequence. It should be understood that the data so used may be interchanged under appropriate circumstances for the embodiments of the application described herein. Furthermore, the terms "comprising" and "having", as well as any variations thereof, are intended to cover a non-exclusive inclusion, for example, a process, method, system, product or device comprising a sequence of steps or elements is not necessarily limited to the expressly listed instead, may include other steps or elements not explicitly listed or inherent to the process, method, product or apparatus.
需要说明的是,本公开所涉及的相关信息(包括但不限于用户设备信息、用户个人信息等)和数据(包括但不限于用于展示的数据、分析的数据等),均为经用户授权或者经过各方充分授权的信息和数据。例如,本系统和相关用户或机构间设置有接口,在获取相关信息之前,需要通过接口向前述的用户或机构发送获取请求,并在接收到前述的用户或机构反馈的同意信息后,获取相关信息。It should be noted that the relevant information (including but not limited to user equipment information, user personal information, etc.) and data (including but not limited to data for display, data for analysis, etc.) involved in this disclosure are authorized by the user. Or information and data fully authorized by the parties. For example, there is an interface between this system and relevant users or institutions. Before obtaining relevant information, it is necessary to send an acquisition request to the aforementioned user or institution through the interface, and obtain relevant information after receiving the consent information fed back by the aforementioned user or institution. information.
实施例Example
下面结合优选的实施步骤对本发明进行说明,图1是根据本申请实施例提供的一种虚拟资源的数据处理方法的流程图,如图1所示,该方法包括如下步骤:The present invention will be described below in conjunction with preferred implementation steps. FIG. 1 is a flow chart of a data processing method for virtual resources provided according to an embodiment of the present application. As shown in FIG. 1 , the method includes the following steps:
步骤S101,确定目标系统产生的异常事件的属性信息,其中,属性信息包括异常事件占用的虚拟资源;Step S101, determining the attribute information of the abnormal event generated by the target system, wherein the attribute information includes virtual resources occupied by the abnormal event;
步骤S102,根据属性信息生成对应的待处理任务,其中,待处理任务包括对虚拟资源的处理逻辑;Step S102, generating corresponding tasks to be processed according to the attribute information, wherein the tasks to be processed include processing logic for virtual resources;
步骤S103,通过执行待处理任务,对异常事件的虚拟资源进行处理。Step S103, process the virtual resource of the abnormal event by executing the task to be processed.
通过上述步骤,确定目标系统产生的异常事件的属性信息,其中,属性信息包括异常事件占用的虚拟资源;根据属性信息生成对应的待处理任务,其中,待处理任务包括对虚拟资源的处理逻辑;通过执行待处理任务,对异常事件的虚拟资源进行处理。根据异常事件的虚拟资源属性信息生成待处理任务,通过对待处理任务的执行,来实现对异常事件的虚拟资源的处理,实现了提高系统发生异常事件时,对其虚拟资源释放的效率和准确率,进而提高系统的资源利用率的技术效果,进而解决了相关技术中因系统异常导致异构虚拟资源被挤占,致使资源利用率低的问题。Through the above steps, determine the attribute information of the abnormal event generated by the target system, wherein the attribute information includes the virtual resource occupied by the abnormal event; generate a corresponding task to be processed according to the attribute information, wherein the task to be processed includes processing logic for the virtual resource; The virtual resources of abnormal events are processed by executing pending tasks. Generate tasks to be processed according to the attribute information of the virtual resources of the abnormal event, and realize the processing of the virtual resources of the abnormal event through the execution of the task to be processed, so as to improve the efficiency and accuracy of the release of the virtual resources when the abnormal event occurs in the system , thereby improving the technical effect of resource utilization of the system, and further solving the problem in related technologies that heterogeneous virtual resources are occupied due to system abnormalities, resulting in low resource utilization.
上述步骤的执行主体可以云计算系统的服务器,或者云计算系统之外的第三方设备,用于对云计算系统进行资源协调管理。上述目标系统可以为云计算系统,系统中的处理器、内存、机型不一致,会导致系统中存在各种异构虚拟资源,虚拟资源的处理往往涉及到不同的硬件,种类繁多,难以统一处理。尤其在系统发生异常时,会导致其对应的虚拟资源无法处理,进而导致虚拟资源的浪费。本实施例中,上述步骤的执行主体为云计算系统内部的任务处理引擎,其作用是将虚拟资源的处理转化为待处理任务进行执行,来实现对虚拟资源进行处理的目的。The executor of the above steps can be a server of the cloud computing system, or a third-party device outside the cloud computing system, which is used to coordinate and manage the resources of the cloud computing system. The above-mentioned target system can be a cloud computing system. Inconsistencies in processors, memory, and models in the system will lead to various heterogeneous virtual resources in the system. The processing of virtual resources often involves different hardware, and there are many types, so it is difficult to handle them uniformly. . Especially when an abnormality occurs in the system, the corresponding virtual resources cannot be processed, thereby resulting in a waste of virtual resources. In this embodiment, the execution subject of the above steps is the task processing engine inside the cloud computing system, and its function is to convert the processing of virtual resources into tasks to be processed for execution, so as to realize the purpose of processing virtual resources.
既然虚拟资源的浪费是由于系统异常引起的,因此,就需要在系统发生异常事件时,及时准确的识别出来。可选的,本实施例中,确定目标系统产生的异常事件的属性信息包括:在目标系统产生异常的情况下,获取异常编码;根据异常编码在预设的异常事件集合中查找,确定异常编码对应的异常事件;根据异常事件生成异常事件实例;根据异常事件实例确定异常事件的属性信息。Since the waste of virtual resources is caused by system abnormalities, it is necessary to identify them timely and accurately when abnormal events occur in the system. Optionally, in this embodiment, determining the attribute information of the abnormal event generated by the target system includes: obtaining an abnormal code when an abnormal event occurs in the target system; searching in a preset abnormal event set according to the abnormal code to determine the abnormal code The corresponding abnormal event; generating an abnormal event instance according to the abnormal event; determining the attribute information of the abnormal event according to the abnormal event instance.
上述异常编码是系统在发生异常时,会自动产生对应的异常编码以记录异常发生的时间,位置和具体的情况,其作用相当于异常日志。根据异常编码,在预设的异常事件集合中查找,确定异常编码对应的异常事件。该异常事件集合中包括了异常编码以及异常编码对应的异常事件。在根据异常编码进行查找时,按照预设的逻辑进行查找,例如,通过关键字进行查找,还可以通过聚类,或者机器学习的方式进行分类,确定异常编码对应的类别,进而根据类别对应的异常事件确定异常编码对应的异常事件。其目的是为了确定其对应的异常事件,进而根据异常事件进行处理,得到包括占用的虚拟资源的属性信息,进而对占用的虚拟资源进行释放,来实现对虚拟资源的处理。The above abnormal code is that when an abnormality occurs, the system will automatically generate a corresponding abnormal code to record the time, location and specific situation of the abnormality, and its function is equivalent to the abnormal log. According to the abnormal code, search in the preset abnormal event set to determine the abnormal event corresponding to the abnormal code. The abnormal event set includes abnormal codes and abnormal events corresponding to the abnormal codes. When searching according to the abnormal code, search according to the preset logic, for example, search by keyword, or classify by clustering or machine learning to determine the category corresponding to the abnormal code, and then according to the corresponding category The exception event determines the exception event corresponding to the exception code. Its purpose is to determine the corresponding abnormal event, and then process according to the abnormal event, obtain the attribute information including the occupied virtual resource, and then release the occupied virtual resource to realize the processing of the virtual resource.
在根据属性信息进行虚拟资源处理时。先根据属性信息生成对应的待处理任务,任务处理引擎就可以对待处理任务进行执行,来实现待处理任务对虚拟资源的处理。可选的,根据属性信息生成对应的待处理任务包括:调用封装接口对属性信息进行封装,生成对应的待处理任务;方法还包括:将待处理任务写入任务集合,其中,任务集合用于对任务集合中的待处理任务进行执行和状态记录。When processing virtual resources based on attribute information. First, the corresponding task to be processed is generated according to the attribute information, and the task processing engine can execute the task to be processed, so as to realize the processing of the virtual resource by the task to be processed. Optionally, generating corresponding pending tasks according to the attribute information includes: calling the encapsulation interface to encapsulate the attribute information, and generating corresponding pending tasks; the method also includes: writing the pending tasks into a task set, wherein the task set is used for Execute and record the status of pending tasks in the task collection.
在得到上述属性信息之后,通过封装接口对属性信息进行封装,生成待处理任务,并将待处理任务写入任务集合,以便任务引擎按照处理策略进行任务处理。进而实现对虚拟资源的处理。After the above attribute information is obtained, the attribute information is encapsulated through the encapsulation interface to generate pending tasks and write the pending tasks into the task set so that the task engine can process the tasks according to the processing strategy. And then realize the processing of the virtual resources.
可选的,通过执行待处理任务,对异常事件的虚拟资源进行处理包括:定时获取需要批量处理的多个待处理任务,其中,多个待处理任务为至少一个异常事件的虚拟资源的处理任务,多个待处理任务对应的虚拟资源的类型相同;将多个待处理任务通过对应的处理平台进行批量处理,其中,处理平台用于对同一类型的虚拟资源进行处理。Optionally, processing the virtual resource of the abnormal event by executing the task to be processed includes: regularly obtaining multiple pending tasks that need to be processed in batches, wherein the multiple pending tasks are processing tasks of at least one virtual resource of the abnormal event , the types of virtual resources corresponding to the multiple pending tasks are the same; the multiple pending tasks are processed in batches through corresponding processing platforms, wherein the processing platforms are used to process virtual resources of the same type.
具体的,在执行待处理任务,对异常事件的虚拟资源进行处理时,采取批量处理的方式。先定时获取需要批量处理的多个待处理任务,将多个待处理任务通过对应的处理平台进行批量处理。处理平台用于对同一类型的虚拟资源进行处理,多个待处理任务为至少一个异常事件的虚拟资源的处理任务,多个待处理任务对应的虚拟资源的类型相同,这样才能批量处理。Specifically, when performing tasks to be processed and processing virtual resources of abnormal events, batch processing is adopted. First, obtain multiple pending tasks that need to be processed in batches at regular intervals, and process multiple pending tasks in batches through the corresponding processing platform. The processing platform is used to process virtual resources of the same type. Multiple tasks to be processed are processing tasks of virtual resources with at least one abnormal event. The types of virtual resources corresponding to multiple tasks to be processed are the same, so that they can be processed in batches.
通过批量处理的方式,提高待处理任务的处理效率,进而提高虚拟资源的处理效率。Through batch processing, the processing efficiency of tasks to be processed is improved, thereby improving the processing efficiency of virtual resources.
可选的,将多个待处理任务通过对应的处理平台进行批量处理之后,方法还包括:接收处理平台发送的对多个待处理任务的处理结果信息,其中,处理结果信息包括目标待处理任务处理成功或处理失败;在目标待处理任务处理成功的情况下,更改目标待处理任务的状态为第一状态;在目标待处理任务处理失败的情况下,记录目标待处理任务的失败次数,在失败次数达到预设次数的情况下,更改目标待处理任务的状态为第二状态;其中,多个待处理任务的状态为待处理,或者处理失败且处理失败次数未达到预设次数。Optionally, after batch processing the multiple pending tasks through the corresponding processing platform, the method further includes: receiving the processing result information of the multiple pending tasks sent by the processing platform, wherein the processing result information includes the target pending task The processing is successful or the processing fails; in the case that the target pending task is successfully processed, the state of the target pending task is changed to the first state; in the case of the target pending task processing failure, the number of failures of the target pending task is recorded. When the number of failures reaches the preset number of times, the status of the target pending task is changed to the second status; wherein, the status of multiple pending tasks is pending, or the processing fails and the number of processing failures does not reach the preset number of times.
对于批量处理的结果,考虑到处理平台的处理能力,提供了一种失败重试机制,也即是在待处理任务的处理结果信息为处理失败的情况下,更新任务状态为失败,并记录失败次数,直至预设次数之后,仍然处理失败,则将该待处理任务失败的消息进行发送。或者在对处理失败的任务重新进行处理后,处理成功了,则更改任务状态为成功。由此可知,上述第一状态为成功状态,第二状态为最终的失败状态,与正常的失败状态可以相同,但是若该失败状态的次数以达到预设次数,将最终的失败状态作为处理结果反馈给用户。For the results of batch processing, considering the processing capability of the processing platform, a failure retry mechanism is provided, that is, when the processing result information of the pending task is processing failure, update the task status to fail and record the failure times, until the preset number of times, if the processing still fails, a message that the task to be processed fails is sent. Or after reprocessing the failed task, if the processing succeeds, the task status is changed to success. It can be seen that the above-mentioned first state is the successful state, and the second state is the final failure state, which can be the same as the normal failure state, but if the number of times of the failure state reaches the preset number of times, the final failure state is taken as the processing result Feedback to users.
可选的,将多个待处理任务通过对应的处理平台进行批量处理包括:确定用于与处理平台进行数据传输的数据接口是否支持批量传输;在数据接口支持批量传输的情况下,通过数据接口将多个待处理任务传输至该处理平台进行批量处理;在数据接口不支持批量传输的情况下,通过多线程将多个待处理任务传输至该处理平台进行批量处理。Optionally, performing batch processing of multiple tasks to be processed through the corresponding processing platform includes: determining whether the data interface used for data transmission with the processing platform supports batch transfer; Multiple pending tasks are transmitted to the processing platform for batch processing; when the data interface does not support batch transmission, multiple pending tasks are transmitted to the processing platform for batch processing through multithreading.
在批量处理的过程中,不仅需要处理平台进行批量处理,而且需要向处理凭他批量发送待处理任务这样才能最大程度提高待处理任务批量处理的效率。需要说明的是,处理平台批量处理任务的方式可以设置多个虚拟处理模块,并行处理,或者采用其他的方式进行批量处理。而批量传输就需要确定上述执行主体,也即是任务处理引擎与处理平台的数据接口是否支持批量传输,若支持,则通过数据接口进行批量传输。若不支持,则需要任务处理引擎采用多线程并发传输的方式,尽可能快的将多个待处理任务发送给处理平台,来尽可能的保证快速准确的将待处理任务发送给处理平台,一共处理平台批量处理。In the process of batch processing, not only the processing platform needs to perform batch processing, but also batches of pending tasks need to be sent to the processing platform so as to maximize the efficiency of batch processing of pending tasks. It should be noted that, the batch processing method of the processing platform can set multiple virtual processing modules for parallel processing, or use other methods for batch processing. For batch transfer, it is necessary to determine whether the above-mentioned execution subject, that is, whether the data interface between the task processing engine and the processing platform supports batch transfer, and if so, perform batch transfer through the data interface. If it is not supported, the task processing engine needs to use multi-threaded concurrent transmission to send multiple pending tasks to the processing platform as quickly as possible to ensure that the pending tasks are sent to the processing platform as quickly and accurately as possible. Processing platform batch processing.
可选的,通过数据接口将多个待处理任务传输至处理平台进行批量处理包括:将多个待处理任务聚合成任务数组;根据任务数组生成对应的虚拟资源处理指令;将虚拟资源处理指令发送给处理平台,其中,处理平台根据虚拟资源处理指令对多个待处理任务的虚拟资源进行批量处理。Optionally, transferring multiple pending tasks to the processing platform for batch processing through the data interface includes: aggregating multiple pending tasks into a task array; generating corresponding virtual resource processing instructions according to the task array; sending the virtual resource processing instructions to A processing platform is provided, wherein the processing platform performs batch processing on the virtual resources of multiple tasks to be processed according to the virtual resource processing instruction.
具体的,若处理平台支持批量处理,则聚合待处理任务中的虚拟资源实例形成实例数组入参φ={v1,v2,...,vn},异步发送资源处理指令,对待处理任务的虚拟资源进行处理。Specifically, if the processing platform supports batch processing, aggregate the virtual resource instances in the tasks to be processed to form an instance array input parameter φ={v1 ,v2 ,...,vn }, send resource processing instructions asynchronously, and The task's virtual resources are processed.
需要说明的是,在附图的流程图示出的步骤可以在诸如一组计算机可执行指令的计算机系统中执行,并且,虽然在流程图中示出了逻辑顺序,但是在某些情况下,可以以不同于此处的顺序执行所示出或描述的步骤。It should be noted that the steps shown in the flowcharts of the accompanying drawings may be performed in a computer system, such as a set of computer-executable instructions, and that although a logical order is shown in the flowcharts, in some cases, The steps shown or described may be performed in an order different than here.
需要说明的是,本申请还提供了一种可选的实施方式,下面对该实施方式进行详细说明。It should be noted that the present application also provides an optional implementation manner, which will be described in detail below.
本实施方式提供了一种消耗型异构虚拟资源多维动态撤销方法。采用异常识别分拣机制,多维度识别异常并动态获取合适的资源预处理方案,极大程度免去运维人员投入大量精力分析异常数据,有效降低人工运维成本。还采用了多任务批量处理机制,任务处理引擎配合定时作业调度模块,通过多云适配层接口统一转换处理,实现对虚拟资源的批量调度。多任务调度有效降低因网络通信问题导致接口调用失败的几率,同时降低系统主流程业务的线程压力。具体如下:This embodiment provides a method for multi-dimensional dynamic revocation of consumable heterogeneous virtual resources. The abnormal identification and sorting mechanism is adopted to identify abnormalities in multiple dimensions and dynamically obtain appropriate resource preprocessing solutions, which greatly saves operation and maintenance personnel from investing a lot of energy in analyzing abnormal data and effectively reduces manual operation and maintenance costs. A multi-task batch processing mechanism is also adopted. The task processing engine cooperates with the scheduled job scheduling module to perform unified conversion and processing through the multi-cloud adaptation layer interface to realize batch scheduling of virtual resources. Multi-task scheduling effectively reduces the probability of interface call failure due to network communication problems, and at the same time reduces the thread pressure of the system's main process business. details as follows:
1.异常识别分拣,图2是根据本申请实施方式提供的系统异常识别的流程图,如图2所示,具体步骤如下。1. Abnormality identification and sorting, Fig. 2 is a flow chart of system anomaly identification provided according to the embodiment of the present application, as shown in Fig. 2 , the specific steps are as follows.
I、系统异常触发异常识别分拣机制,获取系统异常产生的异常编码;I. System abnormality triggers the abnormal identification and sorting mechanism to obtain the abnormal code generated by the system abnormality;
II、异常处理器根据异常编码code与预设的异常规则集R,从异常事件集中匹配合适的异常事件ev:II. The exception handler matches the appropriate exception event ev from the exception event set according to the exception code code and the preset exception rule set R:
上述公式中的Event函数为异常处理器匹配与解析逻辑;Handle函数为回调函数。The Event function in the above formula is the exception handler matching and parsing logic; the Handle function is the callback function.
III、事件监听器监听发布的异常事件,生成异常事件实例;III. The event listener monitors the published abnormal events and generates an abnormal event instance;
IV、异常事件实例提取关联的云资源实例关键信息,封装任务单元发送至任务处理引擎。IV. The abnormal event instance extracts the key information of the associated cloud resource instance, encapsulates the task unit and sends it to the task processing engine.
2.任务处理引擎,图3是根据本申请实施方式提供的任务处理的流程图,如图3所示,具体内容如下。2. Task processing engine, FIG. 3 is a flow chart of task processing provided according to an embodiment of the present application, as shown in FIG. 3 , and the specific content is as follows.
I、本实施方式的系统调用任务处理引擎的任务单元封装接口,封装诸如计算资源、存储资源、网络资源等云资源目标实例,关键信息,生成对应类型的任务单元并写入任务数据集;1. The system of this embodiment calls the task unit encapsulation interface of the task processing engine, encapsulates cloud resource target instances such as computing resources, storage resources, network resources, and key information, generates corresponding types of task units and writes them into the task data set;
II、任务处理引擎维护任务单元的生命周期,根据任务执行情况实时更新任务数集中任务的状态及重试次数;II. The task processing engine maintains the life cycle of the task unit, and updates the status and retry times of the tasks in the task data set in real time according to the task execution status;
III、定时作业按预设间隔定时调度任务单元,调用任务处理引擎多线程执行对应任务单元的任务处理逻辑。III. Scheduled jobs regularly schedule task units at preset intervals, and call the task processing engine to execute the task processing logic of the corresponding task units in multiple threads.
3.云资源批量处理,图4是根据本申请实施方式提供的资源批量处理的流程图,如图4所示,具体步骤如下。3. Cloud resource batch processing, FIG. 4 is a flow chart of resource batch processing provided according to the embodiment of the present application, as shown in FIG. 4 , and the specific steps are as follows.
I、定时作业调度扫描符合要求的任务单元,状态为待处理或失败且失败次数小于阈值;I. Scheduled job scheduling scans the task units that meet the requirements, the status is pending or failed and the number of failures is less than the threshold;
II、通过多云适配接口层,适配异构多云环境。判断对接的云管平台是否支持批量处理,若是:II. Adapt to the heterogeneous multi-cloud environment through the multi-cloud adaptation interface layer. Determine whether the connected cloud management platform supports batch processing, if:
1.聚合任务单元中的虚拟资源实例形成实例数组入参,异步发送资源处理指令;1. Aggregate the virtual resource instances in the task unit to form an instance array input parameter, and send resource processing instructions asynchronously;
2.否则,启用线程池多线程批量发送资源处理指令。2. Otherwise, enable thread pool multithreading to send resource processing instructions in batches.
III、若接收到云管平台处理成功信息,更新对应任务状态为已完成;否则更新状态为失败并更新失败次数。III. If the cloud management platform processing success message is received, update the status of the corresponding task as completed; otherwise, update the status as failed and update the number of failures.
本实施方式可以有效提升故障处理效率:因系统各类异常导致的虚拟资源占用自动故障处理,可极大减少人工运维成本,提升云计算系统云资源利用率。还可以统一管控异构云资源:实现了计算资源、存储资源、网络资源等多种异构云资源的统一撤销处理,基本涵盖了云计算相关业务的绝大多数场景,适用性与实用性广泛。实现异构云资源的批量处理:采用定时作业调度技术,配合任务处理引擎,实现虚拟资源的统一采集。通过多云适配层接口统一转换处理,云管平台接收协同执行资源处理操作。批量处理机制极大降低了因网络通信问题导致的接口调用失败几率,同时降低了系统主流程业务的线程压力。This implementation mode can effectively improve fault handling efficiency: automatic fault handling of virtual resource occupation caused by various system abnormalities can greatly reduce manual operation and maintenance costs, and improve cloud resource utilization of cloud computing systems. It can also manage and control heterogeneous cloud resources in a unified way: it realizes unified revocation processing of various heterogeneous cloud resources such as computing resources, storage resources, and network resources, basically covering most scenarios of cloud computing-related businesses, and has wide applicability and practicability . Realize batch processing of heterogeneous cloud resources: use timing job scheduling technology and cooperate with task processing engine to realize unified collection of virtual resources. Through the unified transformation and processing of the multi-cloud adaptation layer interface, the cloud management platform receives and coordinates the execution of resource processing operations. The batch processing mechanism greatly reduces the probability of interface call failure caused by network communication problems, and at the same time reduces the thread pressure of the system's main process business.
需要说明的是,在具体实施时可以主要包括以下步骤:It should be noted that the specific implementation may mainly include the following steps:
1.系统异常触发本实施方式的异常识别分拣机制,获取所述异常的异常编码;1. The system abnormality triggers the abnormality identification and sorting mechanism of this embodiment, and obtains the abnormality code of the abnormality;
2.异常处理器根据异常编码与预设的异常规则集,从异常事件集中匹配合适的异常事件;事件监听器监听发布的异常事件,生成异常事件实例;所述异常事件实例解析系统异常数据,提取关联的虚拟资源实例关键信息发送至任务处理引擎;2. The exception handler matches the appropriate exception event from the exception event set according to the exception code and the preset exception rule set; the event listener listens to the published exception event and generates an exception event instance; the exception event instance parses the system exception data, Extract the key information of the associated virtual resource instance and send it to the task processing engine;
3.定时作业调度模块按预设时间定时扫描,获取所述任务记录中包含的资源实例关键信息,封装为待处理任务单元;3. The scheduled job scheduling module scans regularly according to the preset time, obtains the key information of the resource instance contained in the task record, and encapsulates it as a task unit to be processed;
4.经由多云适配层统一转换处理,向云管平台发起云资源批量处理请求指令;4. Initiate a cloud resource batch processing request command to the cloud management platform through the unified conversion and processing of the multi-cloud adaptation layer;
5.若接收到云管平台返回的资源处理成功消息,任务处理引擎将关联的任务单元标记为已完成;5. If the resource processing success message returned by the cloud management platform is received, the task processing engine marks the associated task unit as completed;
6.否则,任务处理引擎将关联的任务单元标记为失败,并更新失败重试次数,在预设失败重试次数阈值内,等待步骤4处理。6. Otherwise, the task processing engine marks the associated task unit as failed, and updates the number of failed retries, and waits for processing in step 4 within the preset threshold of failed retries.
本实施方式具有异常识别分拣机制:自动化解析系统异常信息,提取异常信息包含的虚拟资源实例关键信息。无需运维人员介入,极大降低人工运维成本。支持资源回收失败重试:任务处理引擎通过设置失败重试次数,配合定时作业定时调度,极大减少任务单元因网络欠佳、服务器调用异常导致的偶发性执行失败次数。支持多云异构场景:本实施方式通过多云适配层,实现对多云异构环境的抽象处理,达到灵活对接不同基础云设施管理平台,实现多云异构场景资源自动回收目的。支持批量处理:通过定时作业调度一个批次的待处理任务单元,调用云管平台资源处理接口,实现云资源的批量回收,极大提升系统云资源的利用率。海域异常识别分拣、定时作业调度、任务处理引擎和批量处理相结合的技术能极大提升云计算系统虚拟资源的利用率;能够在不需要人工运维介入的情况下,多维动态实现虚拟资源的异常撤销处理。This embodiment has an exception identification and sorting mechanism: automatically analyze the system exception information, and extract the key information of the virtual resource instance contained in the exception information. There is no need for operation and maintenance personnel to intervene, which greatly reduces the cost of manual operation and maintenance. Support resource recovery failure retry: The task processing engine can greatly reduce the number of sporadic execution failures of task units caused by poor network and abnormal server calls by setting the number of failed retries and cooperating with scheduled job scheduling. Support multi-cloud heterogeneous scenarios: This implementation mode realizes the abstract processing of multi-cloud heterogeneous environments through the multi-cloud adaptation layer, achieves flexible connection with different basic cloud facility management platforms, and realizes the purpose of automatic recycling of resources in multi-cloud heterogeneous scenarios. Support batch processing: schedule a batch of pending task units through scheduled jobs, call the resource processing interface of the cloud management platform, realize batch recovery of cloud resources, and greatly improve the utilization rate of system cloud resources. The combination of sea area exception identification and sorting, scheduled job scheduling, task processing engine and batch processing can greatly improve the utilization rate of virtual resources in cloud computing systems; it can realize multi-dimensional and dynamic virtual resources without manual operation and maintenance intervention exception undo handling.
本申请实施例还提供了一种虚拟资源的数据处理装置,需要说明的是,本申请实施例的虚拟资源的数据处理装置可以用于执行本申请实施例所提供的用于虚拟资源的数据处理方法。以下对本申请实施例提供的虚拟资源的数据处理装置进行介绍。The embodiment of the present application also provides a data processing device for virtual resources. It should be noted that the data processing device for virtual resources in the embodiment of the present application can be used to perform the data processing for virtual resources provided by the embodiment of the present application method. The data processing apparatus for virtual resources provided by the embodiment of the present application is introduced below.
图5是根据本申请实施例提供的一种虚拟资源的数据处理装置的示意图,如图5所示,该装置包括:确定模块52,生成模块54,处理模块56,下面对该装置进行详细说明。Fig. 5 is a schematic diagram of a virtual resource data processing device provided according to an embodiment of the present application. As shown in Fig. 5, the device includes: a determination module 52, a generation module 54, and a processing module 56. The device will be described in detail below illustrate.
确定模块52,用于确定目标系统产生的异常事件的属性信息,其中,属性信息包括异常事件占用的虚拟资源;生成模块54,与上述确定模块52相连,用于根据属性信息生成对应的待处理任务,其中,待处理任务包括对虚拟资源的处理逻辑;处理模块56,与上述生成模块54相连,用于通过执行待处理任务,对异常事件的虚拟资源进行处理。The determining module 52 is used to determine the attribute information of the abnormal event generated by the target system, wherein the attribute information includes the virtual resource occupied by the abnormal event; the generating module 54 is connected to the above-mentioned determining module 52 and used to generate the corresponding pending event according to the attribute information. Tasks, wherein the tasks to be processed include processing logic for virtual resources; the processing module 56 is connected to the generation module 54 and is used to process the virtual resources of abnormal events by executing the tasks to be processed.
本申请实施例提供的虚拟资源的数据处理装置,确定目标系统产生的异常事件的属性信息,其中,属性信息包括异常事件占用的虚拟资源;根据属性信息生成对应的待处理任务,其中,待处理任务包括对虚拟资源的处理逻辑;通过执行待处理任务,对异常事件的虚拟资源进行处理。根据异常事件的虚拟资源属性信息生成待处理任务,通过对待处理任务的执行,来实现对异常事件的虚拟资源的处理,实现了提高系统发生异常事件时,对其虚拟资源释放的效率和准确率,进而提高系统的资源利用率的技术效果,进而解决了相关技术中因系统异常导致异构虚拟资源被挤占,致使资源利用率低的问题。The data processing device for virtual resources provided by the embodiment of the present application determines the attribute information of the abnormal event generated by the target system, wherein the attribute information includes the virtual resource occupied by the abnormal event; generates a corresponding pending task according to the attribute information, wherein the pending The task includes the processing logic of the virtual resource; by executing the task to be processed, the virtual resource of the abnormal event is processed. Generate tasks to be processed according to the attribute information of the virtual resources of the abnormal event, and realize the processing of the virtual resources of the abnormal event through the execution of the task to be processed, so as to improve the efficiency and accuracy of the release of the virtual resources when the abnormal event occurs in the system , thereby improving the technical effect of resource utilization of the system, and further solving the problem in related technologies that heterogeneous virtual resources are occupied due to system abnormalities, resulting in low resource utilization.
虚拟资源的数据处理装置包括处理器和存储器,上述确定模块52,生成模块54,处理模块56等均作为程序单元存储在存储器中,由处理器执行存储在存储器中的上述程序单元来实现相应的功能。The data processing device for virtual resources includes a processor and a memory. The above-mentioned determining module 52, generating module 54, and processing module 56 are all stored in the memory as program units, and the processor executes the above-mentioned program units stored in the memory to realize corresponding Function.
处理器中包含内核,由内核去存储器中调取相应的程序单元。内核可以设置一个或以上,通过调整内核参数来解决了相关技术中因系统异常导致异构虚拟资源被挤占,致使资源利用率低的问题。The processor includes a kernel, and the kernel fetches corresponding program units from the memory. One or more kernels can be set, and by adjusting kernel parameters, the problem in related technologies that heterogeneous virtual resources are occupied due to system abnormalities, resulting in low resource utilization, is solved.
存储器可能包括计算机可读介质中的非永久性存储器,随机存取存储器(RAM)和/或非易失性内存等形式,如只读存储器(ROM)或闪存(flash RAM),存储器包括至少一个存储芯片。Memory may include non-permanent memory in computer-readable media, random access memory (RAM) and/or non-volatile memory, such as read-only memory (ROM) or flash memory (flash RAM), memory includes at least one memory chip.
本发明实施例提供了一种计算机可读存储介质,其上存储有程序,该程序被处理器执行时实现虚拟资源的数据处理方法。An embodiment of the present invention provides a computer-readable storage medium on which a program is stored, and when the program is executed by a processor, a data processing method for a virtual resource is realized.
本发明实施例提供了一种处理器,处理器用于运行程序,其中,程序运行时执行虚拟资源的数据处理方法。An embodiment of the present invention provides a processor, and the processor is used to run a program, wherein a data processing method of a virtual resource is executed when the program is running.
图6是根据本申请实施例提供的一种电子设备的示意图,如图6所示,本申请实施例提供了一种电子设备60,设备包括处理器、存储器及存储在存储器上并可在处理器上运行的程序,处理器执行程序时实现上述任一项方法的步骤。Fig. 6 is a schematic diagram of an electronic device provided according to an embodiment of the present application. As shown in Fig. 6, an embodiment of the present application provides an
本申请中的设备可以是服务器、PC、PAD、手机等。The devices in this application can be servers, PCs, PADs, mobile phones, etc.
本申请还提供了一种计算机程序产品,当在虚拟资源的数据处理设备上执行时,适于执行初始化有上述任一方法步骤的程序。The present application also provides a computer program product, which is adapted to execute a program initialized with any of the above method steps when executed on a data processing device of a virtual resource.
本领域内的技术人员应明白,本申请的实施例可提供为方法、系统、或计算机程序产品。因此,本申请可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面的实施例的形式。而且,本申请可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。Those skilled in the art should understand that the embodiments of the present application may be provided as methods, systems, or computer program products. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
本申请是参照根据本申请实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程虚拟资源的数据处理设备的处理器以产生一个机器,使得通过计算机或其他可编程虚拟资源的数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。The present application is described with reference to flowcharts and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the present application. It should be understood that each procedure and/or block in the flowchart and/or block diagram, and a combination of procedures and/or blocks in the flowchart and/or block diagram can be realized by computer program instructions. These computer program instructions may be provided to a processor of a general-purpose computer, special purpose computer, embedded processor, or other programmable virtual resource data processing device to produce a machine such that processing by the computer or other programmable virtual resource data processing device The instructions executed by the device generate means for realizing the functions specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram.
这些计算机程序指令也可存储在能引导计算机或其他可编程虚拟资源的数据处理设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。These computer program instructions may also be stored in a computer readable memory capable of directing a computer or other programmable virtual resource data processing device to operate in a specific manner such that the instructions stored in the computer readable memory produce an article of manufacture comprising instruction means , the instruction means realizes the functions specified in one or more procedures of the flow chart and/or one or more blocks of the block diagram.
这些计算机程序指令也可装载到计算机或其他可编程虚拟资源的数据处理设备上,使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理,从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。These computer program instructions can also be loaded onto a computer or other programmable virtual resource data processing device, so that a series of operational steps are performed on the computer or other programmable device to produce a computer-implemented process, so that the computer or other programmable device The instructions executed above provide steps for implementing the functions specified in one or more procedures of the flowchart and/or one or more blocks of the block diagram.
在一个典型的配置中,计算设备包括一个或多个处理器(CPU)、输入/输出接口、网络接口和内存。In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
存储器可能包括计算机可读介质中的非永久性存储器,随机存取存储器(RAM)和/或非易失性内存等形式,如只读存储器(ROM)或闪存(flash RAM)。存储器是计算机可读介质的示例。Memory may include non-permanent storage in computer readable media, in the form of random access memory (RAM) and/or nonvolatile memory such as read only memory (ROM) or flash RAM. The memory is an example of a computer readable medium.
计算机可读介质包括永久性和非永久性、可移动和非可移动媒体可以由任何方法或技术来实现信息存储。信息可以是计算机可读指令、数据结构、程序的模块或其他数据。计算机的存储介质的例子包括,但不限于相变内存(PRAM)、静态随机存取存储器(SRAM)、动态随机存取存储器(DRAM)、其他类型的随机存取存储器(RAM)、只读存储器(ROM)、电可擦除可编程只读存储器(EEPROM)、快闪记忆体或其他内存技术、只读光盘只读存储器(CD-ROM)、数字多功能光盘(DVD)或其他光学存储、磁盒式磁带,磁带磁盘存储或其他磁性存储设备或任何其他非传输介质,可用于存储可以被计算设备访问的信息。按照本文中的界定,计算机可读介质不包括暂存电脑可读媒体(transitory media),如调制的数据信号和载波。Computer-readable media, including both permanent and non-permanent, removable and non-removable media, can be implemented by any method or technology for storage of information. Information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Flash memory or other memory technology, Compact Disc Read-Only Memory (CD-ROM), Digital Versatile Disc (DVD) or other optical storage, Magnetic tape cartridge, tape disk storage or other magnetic storage device or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media excludes transitory computer-readable media, such as modulated data signals and carrier waves.
还需要说明的是,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、商品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、商品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括要素的过程、方法、商品或者设备中还存在另外的相同要素。It should also be noted that the term "comprises", "comprises" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article, or apparatus comprising a set of elements includes not only those elements, but also includes Other elements not expressly listed, or elements inherent in the process, method, commodity, or apparatus are also included. Without further limitations, an element defined by the phrase "comprising a ..." does not preclude the presence of additional identical elements in the process, method, article, or apparatus that includes the element.
本领域技术人员应明白,本申请的实施例可提供为方法、系统或计算机程序产品。因此,本申请可采用完全硬件实施例、完全软件实施例或结合软件和硬件方面的实施例的形式。而且,本申请可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。Those skilled in the art should understand that the embodiments of the present application may be provided as methods, systems or computer program products. Accordingly, the present application can take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
以上仅为本申请的实施例而已,并不用于限制本申请。对于本领域技术人员来说,本申请可以有各种更改和变化。凡在本申请的精神和原理之内所作的任何修改、等同替换、改进等,均应包含在本申请的权利要求范围之内。The above are only examples of the present application, and are not intended to limit the present application. For those skilled in the art, various modifications and changes may occur in this application. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included within the scope of the claims of the present application.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210909019.2ACN115454618A (en) | 2022-07-29 | 2022-07-29 | Data processing method and device for virtual resources, storage medium and processor |
| PCT/CN2022/141904WO2024021498A1 (en) | 2022-07-29 | 2022-12-26 | Data processing method and apparatus for virtual resource, storage medium, and processor |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210909019.2ACN115454618A (en) | 2022-07-29 | 2022-07-29 | Data processing method and device for virtual resources, storage medium and processor |
| Publication Number | Publication Date |
|---|---|
| CN115454618Atrue CN115454618A (en) | 2022-12-09 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210909019.2APendingCN115454618A (en) | 2022-07-29 | 2022-07-29 | Data processing method and device for virtual resources, storage medium and processor |
| Country | Link |
|---|---|
| CN (1) | CN115454618A (en) |
| WO (1) | WO2024021498A1 (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2024021498A1 (en)* | 2022-07-29 | 2024-02-01 | 天翼云科技有限公司 | Data processing method and apparatus for virtual resource, storage medium, and processor |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN118869791B (en)* | 2024-05-11 | 2025-06-24 | 腾讯科技(深圳)有限公司 | Business allocation method, device, product, storage medium and equipment |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106817243A (en)* | 2015-12-01 | 2017-06-09 | 广达电脑股份有限公司 | Management system and management method for server resources |
| CN110442404A (en)* | 2019-08-13 | 2019-11-12 | 武汉斗鱼鱼乐网络科技有限公司 | A kind of object method for releasing, device, equipment and storage medium |
| CN110502891A (en)* | 2019-08-08 | 2019-11-26 | 北京字节跳动网络技术有限公司 | A kind of method, apparatus, medium and electronic equipment obtaining proceeding internal memory leakage |
| CN113656209A (en)* | 2021-08-18 | 2021-11-16 | 深圳市腾讯计算机系统有限公司 | Resource processing method, device, equipment and storage medium |
| CN114648349A (en)* | 2020-12-21 | 2022-06-21 | 北京达佳互联信息技术有限公司 | Method, device, electronic device and storage medium for using virtual resources |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9858107B2 (en)* | 2016-01-14 | 2018-01-02 | International Business Machines Corporation | Method and apparatus for resolving contention at the hypervisor level |
| CN115454618A (en)* | 2022-07-29 | 2022-12-09 | 天翼云科技有限公司 | Data processing method and device for virtual resources, storage medium and processor |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106817243A (en)* | 2015-12-01 | 2017-06-09 | 广达电脑股份有限公司 | Management system and management method for server resources |
| CN110502891A (en)* | 2019-08-08 | 2019-11-26 | 北京字节跳动网络技术有限公司 | A kind of method, apparatus, medium and electronic equipment obtaining proceeding internal memory leakage |
| CN110442404A (en)* | 2019-08-13 | 2019-11-12 | 武汉斗鱼鱼乐网络科技有限公司 | A kind of object method for releasing, device, equipment and storage medium |
| CN114648349A (en)* | 2020-12-21 | 2022-06-21 | 北京达佳互联信息技术有限公司 | Method, device, electronic device and storage medium for using virtual resources |
| CN113656209A (en)* | 2021-08-18 | 2021-11-16 | 深圳市腾讯计算机系统有限公司 | Resource processing method, device, equipment and storage medium |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2024021498A1 (en)* | 2022-07-29 | 2024-02-01 | 天翼云科技有限公司 | Data processing method and apparatus for virtual resource, storage medium, and processor |
| Publication number | Publication date |
|---|---|
| WO2024021498A1 (en) | 2024-02-01 |
| Publication | Publication Date | Title |
|---|---|---|
| JP7551745B2 (en) | ML-based event handling | |
| US9582312B1 (en) | Execution context trace for asynchronous tasks | |
| US10073683B2 (en) | System and method for providing software build violation detection and self-healing | |
| CN107729139B (en) | Method and device for concurrently acquiring resources | |
| US11544137B2 (en) | Data processing platform monitoring | |
| US9535754B1 (en) | Dynamic provisioning of computing resources | |
| US20210334130A1 (en) | Node-local-unscheduler for scheduling remediation | |
| CN115454618A (en) | Data processing method and device for virtual resources, storage medium and processor | |
| CN107105009A (en) | Job scheduling method and device based on Kubernetes system docking workflow engines | |
| CN116643950B (en) | FaaS-based cloud native application automatic operation and maintenance method | |
| WO2020253045A1 (en) | Configured supplementary processing method and device for data of which forwarding has abnormality, and readable storage medium | |
| CN113849287A (en) | Processing method, device, electronic device and storage medium for algorithm service | |
| CN112313627B (en) | Mapping mechanism of event to serverless function workflow instance | |
| WO2025025492A1 (en) | Container migration method and apparatus for container cluster management system, device, and medium | |
| CN120186142B (en) | MCP protocol-based cross-environment AI task collaborative execution method, device and storage medium | |
| CN111124685A (en) | Big data processing method and device, electronic equipment and storage medium | |
| CN114398179B (en) | Method and device for acquiring tracking identifier, server and storage medium | |
| US9659041B2 (en) | Model for capturing audit trail data with reduced probability of loss of critical data | |
| CN115982049A (en) | Abnormal detection method, device and computer equipment in performance testing | |
| CN114510396A (en) | Private cloud inspection method, device and computer readable medium | |
| CN114327835A (en) | Distributed task scheduling method and device, processor and electronic equipment | |
| CN111628924A (en) | Method, system, storage medium and electronic device for sending e-mail | |
| CN118535301A (en) | Task scheduling method and device, storage medium and electronic device | |
| CN113760491A (en) | Task scheduling system, method, equipment and storage medium | |
| CN118585297A (en) | A task execution method and related equipment |
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |