技术领域Technical Field
本申请涉及大数据处理领域,尤其涉及一种基于流计算的流程指标计算方法及其相关设备。The present application relates to the field of big data processing, and in particular to a process indicator calculation method based on stream computing and related equipment.
背景技术Background technique
面向集团企业的统一流程管理平台会产生海量的流程数据,因为支撑了多达数十个各个业务域的系统,工作流系统会实时地吐出新数据。针对此类海量实时的流式工作流数据,大型企事业单位需要一套流程指标计算系统,可以使央企、国企、电信电力等企事业单位及时地发现流程风险并做出正确反应。The unified process management platform for group enterprises will generate massive process data, because it supports as many as dozens of systems in various business domains, and the workflow system will spit out new data in real time. In response to this massive real-time streaming workflow data, large enterprises and institutions need a process indicator calculation system that can enable central enterprises, state-owned enterprises, telecommunications and power enterprises and institutions to promptly discover process risks and make correct responses.
现有的方案都是基于SQL和数据库进行流程指标计算,但是在处理大规模数据分析时,由于数据仓库存储的是历史的、大量的静态数据,随着数据量的增长,频繁的大规模数据读取可能会导致磁盘I/O成为SQL查询的性能瓶颈,进而导致指标计算的效率出现明显下降。Existing solutions are all based on SQL and databases to calculate process indicators. However, when processing large-scale data analysis, since the data warehouse stores historical, large amounts of static data, as the amount of data grows, frequent large-scale data reading may cause disk I/O to become a performance bottleneck for SQL queries, which in turn leads to a significant decrease in the efficiency of indicator calculation.
发明内容Summary of the invention
本申请的主要目的在于提供一种基于流计算的流程指标计算方法及其相关设备,旨在解决指标计算的效率较低的问题。The main purpose of this application is to provide a process indicator calculation method based on stream computing and related equipment, aiming to solve the problem of low efficiency of indicator calculation.
为实现上述目的,本申请提供一种基于流计算的流程指标计算方法,应用于流程指标计算节点,所述基于流计算的流程指标计算方法包括以下步骤:To achieve the above object, the present application provides a process indicator calculation method based on stream computing, which is applied to a process indicator calculation node. The process indicator calculation method based on stream computing includes the following steps:
接收流程事件分发节点基于事件类型分配的流程事件;其中,所述事件类型是由所述流程事件分发节点确定的;Receiving a process event assigned by a process event distribution node based on an event type; wherein the event type is determined by the process event distribution node;
基于流计算方式计算所述流程事件的相关指标,得到流程指标计算结果。Based on the flow calculation method, the relevant indicators of the process event are calculated to obtain the process indicator calculation result.
可选地,所述基于流计算方式计算所述流程事件的相关指标,得到流程指标计算结果的步骤,包括:Optionally, the step of calculating the relevant indicators of the process event based on the flow computing method to obtain the process indicator calculation result includes:
基于流计算方式,通过复杂事件处理引擎计算所述流程事件的相关指标,得到流程指标计算结果。Based on the flow computing method, the relevant indicators of the process events are calculated by the complex event processing engine to obtain the process indicator calculation results.
可选地,所述基于流计算方式计算所述流程事件的相关指标,得到流程指标计算结果的步骤之后,包括:Optionally, after the step of calculating the relevant indicators of the process event based on the flow computing method to obtain the process indicator calculation result, the following steps are included:
将所述流程指标计算结果发送给流程指标存储节点,以供所述流程指标存储节点存储所述流程指标计算结果。The process indicator calculation result is sent to the process indicator storage node so that the process indicator storage node stores the process indicator calculation result.
可选地,应用于流程指标定义节点,所述基于流计算的流程指标计算方法还包括以下步骤:Optionally, applied to a process indicator definition node, the process indicator calculation method based on stream computing further includes the following steps:
确定指标公式中各个数据项的数据项类型;Determine the data item type of each data item in the indicator formula;
根据所述数据项类型,对所述指标公式进行相应处理,得到处理结果;According to the data item type, the indicator formula is processed accordingly to obtain a processing result;
将所述处理结果发送给流程指标计算节点,以供所述流程指标计算节点基于所述处理结果计算流程事件的相关指标,并得到流程指标计算结果。The processing result is sent to a process indicator calculation node, so that the process indicator calculation node calculates relevant indicators of the process event based on the processing result and obtains the process indicator calculation result.
可选地,所述数据项类型包括计算因子、预定义函数和其他指标,所述根据所述数据项类型,对所述指标公式进行相应处理,得到处理结果的步骤,包括:Optionally, the data item type includes calculation factors, predefined functions and other indicators, and the step of processing the indicator formula accordingly according to the data item type to obtain the processing result includes:
若所述数据项类型为计算因子,则对所述计算因子进行解析执行,得到解析执行结果;If the data item type is a calculation factor, the calculation factor is parsed and executed to obtain a parsing and execution result;
若所述数据项类型为预定义函数,则将所述预定义函数转化为流程指标计算节点可识别的目标函数;If the data item type is a predefined function, converting the predefined function into an objective function that can be recognized by the process indicator calculation node;
若所述数据项类型为其他指标,则判断指标最新值是否已生成,并根据判断结果返回错误信息或获取指标最新值。If the data item type is other indicators, it is determined whether the latest value of the indicator has been generated, and an error message is returned or the latest value of the indicator is obtained according to the determination result.
可选地,应用于流程引擎,所述基于流计算的流程指标计算方法还包括以下步骤:Optionally, when applied to a process engine, the process indicator calculation method based on flow computing further includes the following steps:
采集流程数据,并通过流程状态变更监听器确定所述流程数据中的变更数据;Collecting process data, and determining changed data in the process data through a process state change listener;
将所述变更数据组合为流程事件,并将所述流程事件发送给流程事件分发节点,以供所述流程事件分发节点基于事件类型分配所述流程事件。The change data are combined into a process event, and the process event is sent to a process event distribution node, so that the process event distribution node distributes the process event based on an event type.
此外,为实现上述目的,本申请还提供一种基于流计算的流程指标计算装置,所述基于流计算的流程指标计算装置包括:In addition, to achieve the above purpose, the present application also provides a process indicator calculation device based on flow computing, and the process indicator calculation device based on flow computing includes:
接收模块,用于接收流程事件分发节点基于事件类型分配的流程事件;其中,所述事件类型是由所述流程事件分发节点确定的;A receiving module, used for receiving a process event assigned by a process event distribution node based on an event type; wherein the event type is determined by the process event distribution node;
计算模块,用于基于流计算方式计算所述流程事件的相关指标,得到流程指标计算结果。The calculation module is used to calculate the relevant indicators of the process event based on the flow calculation method to obtain the process indicator calculation result.
此外,为实现上述目的,本申请还提供一种基于流计算的流程指标计算设备,所述设备包括:存储器、处理器及存储在所述存储器上并可在所述处理器上运行的基于流计算的流程指标计算程序,所述基于流计算的流程指标计算程序配置为实现所述的基于流计算的流程指标计算方法的步骤。In addition, to achieve the above-mentioned purpose, the present application also provides a process indicator calculation device based on stream computing, the device comprising: a memory, a processor, and a process indicator calculation program based on stream computing stored in the memory and executable on the processor, the process indicator calculation program based on stream computing being configured to implement the steps of the process indicator calculation method based on stream computing.
此外,为实现上述目的,本申请还提供一种存储介质,所述存储介质上存储有基于流计算的流程指标计算程序,所述基于流计算的流程指标计算程序被处理器执行时实现所述的基于流计算的流程指标计算方法的步骤。In addition, to achieve the above-mentioned purpose, the present application also provides a storage medium, on which a process indicator calculation program based on stream computing is stored. When the process indicator calculation program based on stream computing is executed by a processor, the steps of the process indicator calculation method based on stream computing are implemented.
此外,为实现上述目的,本申请还提供一种计算机程序产品,所述计算机程序产品包括基于流计算的流程指标计算程序,所述基于流计算的流程指标计算程序被处理器执行时实现所述的基于流计算的流程指标计算方法的步骤。In addition, to achieve the above-mentioned purpose, the present application also provides a computer program product, which includes a process indicator calculation program based on stream computing, and when the process indicator calculation program based on stream computing is executed by a processor, it implements the steps of the process indicator calculation method based on stream computing.
本申请提供了一种基于流计算的流程指标计算方法及其相关设备,与相关技术中基于SQL和数据库进行流程指标计算,但是在处理大规模数据分析时,由于数据仓库存储的是历史的、大量的静态数据,随着数据量的增长,频繁的大规模数据读取可能会导致磁盘I/O成为SQL查询的性能瓶颈,进而导致指标计算的效率出现明显下降相比,在本申请中,应用于流程指标计算节点,接收流程事件分发节点基于事件类型分配的流程事件;其中,所述事件类型是由所述流程事件分发节点确定的;基于流计算方式计算所述流程事件的相关指标,得到流程指标计算结果。可以理解,在本申请中,接收流程事件分发节点分配的流程事件,并结合流计算方式计算流程事件的相关指标,通过分布式流程指标计算框架结合流计算的方式,降低从数据摄入到结果产出的延迟时间,实现实时监控、实时分析和实时决策,从而提高指标计算的效率。The present application provides a process indicator calculation method based on stream computing and its related equipment, which is compared with the process indicator calculation based on SQL and database in the related technology, but when processing large-scale data analysis, because the data warehouse stores historical and large amounts of static data, as the amount of data increases, frequent large-scale data reading may cause disk I/O to become the performance bottleneck of SQL query, thereby causing the efficiency of indicator calculation to decrease significantly. In the present application, it is applied to the process indicator calculation node, and the process event assigned by the process event distribution node based on the event type is received; wherein the event type is determined by the process event distribution node; the relevant indicators of the process event are calculated based on the stream computing method to obtain the process indicator calculation result. It can be understood that in the present application, the process event assigned by the process event distribution node is received, and the relevant indicators of the process event are calculated in combination with the stream computing method. Through the distributed process indicator calculation framework combined with the stream computing method, the delay time from data intake to result output is reduced, and real-time monitoring, real-time analysis and real-time decision-making are realized, thereby improving the efficiency of indicator calculation.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
图1为本申请基于流计算的流程指标计算方法第一实施例的第一流程示意图;FIG1 is a schematic diagram of a first process flow of a first embodiment of a process indicator calculation method based on flow computing of the present application;
图2为本申请基于流计算的流程指标计算方法第一实施例的第一逻辑架构图;FIG2 is a first logical architecture diagram of a first embodiment of a process indicator calculation method based on flow computing of the present application;
图3为本申请基于流计算的流程指标计算方法第二实施例的第二流程示意图;FIG3 is a schematic diagram of a second process flow of a second embodiment of a process indicator calculation method based on flow computing of the present application;
图4为本申请基于流计算的流程指标计算方法第二实施例的第二逻辑架构图;FIG4 is a second logical architecture diagram of the second embodiment of the process indicator calculation method based on flow computing of the present application;
图5为本申请基于流计算的流程指标计算方法第三实施例的第三流程示意图;FIG5 is a schematic diagram of a third process flow of a third embodiment of a process indicator calculation method based on flow computing of the present application;
图6为本申请基于流计算的流程指标计算装置的结构框图;FIG6 is a structural block diagram of a process index calculation device based on flow calculation in the present application;
图7为本申请实施例方案涉及的硬件运行环境的结构示意图。FIG. 7 is a schematic diagram of the structure of the hardware operating environment involved in the embodiment of the present application.
本申请目的的实现、功能特点及优点将结合实施例,参照附图做进一步说明。The realization of the purpose, functional features and advantages of this application will be further explained in conjunction with embodiments and with reference to the accompanying drawings.
具体实施方式Detailed ways
应当理解,此处所描述的具体实施例仅仅用以解释本申请,并不用于限定本申请。It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
参照图1,图1为本申请基于流计算的流程指标计算方法第一实施例的第一流程示意图。Refer to FIG. 1 , which is a first flow chart of a first embodiment of a process indicator calculation method based on flow computing of the present application.
在第一实施例中,应用于流程指标计算节点,所述基于流计算的流程指标计算方法包括以下步骤:In a first embodiment, the process indicator calculation method based on flow calculation is applied to a process indicator calculation node, and includes the following steps:
步骤S10,接收流程事件分发节点基于事件类型分配的流程事件;其中,所述事件类型是由所述流程事件分发节点确定的;Step S10, receiving a process event assigned by a process event distribution node based on an event type; wherein the event type is determined by the process event distribution node;
步骤S20,基于流计算方式计算所述流程事件的相关指标,得到流程指标计算结果。Step S20, calculating the relevant indicators of the process event based on the flow calculation method to obtain the process indicator calculation result.
本实施例旨在:接收流程事件分发节点分配的流程事件,并结合流计算方式计算流程事件的相关指标,可以通过多种适配器接入海量的数据流,在一个分布式集群中并行计算,低延迟地吐出运算结果,实现实时监控、实时分析和实时决策,从而提高指标计算的效率。This embodiment aims to: receive process events assigned by process event distribution nodes, and calculate relevant indicators of process events in combination with stream computing methods, access massive data streams through multiple adapters, perform parallel computing in a distributed cluster, and spit out calculation results with low latency, thereby achieving real-time monitoring, real-time analysis and real-time decision-making, thereby improving the efficiency of indicator calculation.
以下阐述具体的步骤:The specific steps are described below:
步骤S10,接收流程事件分发节点基于事件类型分配的流程事件;其中,所述事件类型是由所述流程事件分发节点确定的;Step S10, receiving a process event assigned by a process event distribution node based on an event type; wherein the event type is determined by the process event distribution node;
需要说明的是,本实施例的执行主体为基于流计算的流程指标计算装置,所述基于流计算的流程指标计算装置可以是从属于其中一个流程指标计算节点,所述流程指标计算节点可以是从属于基于流计算的流程指标计算设备,所述基于流计算的流程指标计算设备上还设置有流程事件分发节点。It should be noted that the execution subject of this embodiment is a process indicator calculation device based on flow computing, and the process indicator calculation device based on flow computing may be subordinate to one of the process indicator calculation nodes, and the process indicator calculation node may be subordinate to a process indicator calculation device based on flow computing, and the process indicator calculation device based on flow computing is also provided with a process event distribution node.
需要说明的是,流程事件分发节点的初始化操作需要加载事件类型、EPL指标计算列表、事件类型与EPL指标计算语句的关系映射表以及EPL指标计算语句与流程指标计算节点的关系表。EPL指标计算列表中的每条语句均包含EPL唯一标识和EPL指标计算语句,一个事件类型可以对应到多个EPL指标计算语句,一个EPL指标计算语句中也可以包含多个事件类型。It should be noted that the initialization operation of the process event distribution node needs to load the event type, the EPL indicator calculation list, the relationship mapping table between the event type and the EPL indicator calculation statement, and the relationship table between the EPL indicator calculation statement and the process indicator calculation node. Each statement in the EPL indicator calculation list contains the EPL unique identifier and the EPL indicator calculation statement. One event type can correspond to multiple EPL indicator calculation statements, and one EPL indicator calculation statement can also contain multiple event types.
可以理解的是,流程事件分发节点接收到来自流程引擎实时发送的流程事件后,先确定该流程事件的类型,再根据事件类型从映射表找到对应的指标计算语句,再根据指标计算语句与指标计算节点的关系表找到该EPL语句所处的流程指标计算节点,最后将流程事件分发到目标流程指标计算节点。It can be understood that after the process event distribution node receives the process event sent in real time from the process engine, it first determines the type of the process event, then finds the corresponding indicator calculation statement from the mapping table according to the event type, and then finds the process indicator calculation node where the EPL statement is located according to the relationship table between the indicator calculation statement and the indicator calculation node, and finally distributes the process event to the target process indicator calculation node.
在具体实施中,在流程事件分发节点将流程事件分发到目标流程指标计算节点后,所述基于流计算的流程指标计算装置接收流程事件分发节点分配的流程事件,并对流程事件的报文进行反序列化得到Java对象,再从事件对象中获取流程事件的类型,根据事件类型判断本节点的EPL指标计算语句是否包含该事件类型,如果不包含则丢弃,包含则进行后续指标计算。In a specific implementation, after the process event distribution node distributes the process event to the target process indicator calculation node, the process indicator calculation device based on flow computing receives the process event assigned by the process event distribution node, deserializes the message of the process event to obtain a Java object, and then obtains the type of the process event from the event object, and determines whether the EPL indicator calculation statement of this node contains the event type according to the event type. If not, it is discarded; if it is contained, subsequent indicator calculation is performed.
步骤S20,基于流计算方式计算所述流程事件的相关指标,得到流程指标计算结果。Step S20, calculating the relevant indicators of the process event based on the flow calculation method to obtain the process indicator calculation result.
需要说明的是,所述流计算是一种数据处理范式,主要用于实时或接近实时地分析和处理连续不断生成的数据流,适用于需要快速响应、无法等待批量处理的情境。It should be noted that stream computing is a data processing paradigm that is mainly used to analyze and process continuously generated data streams in real time or near real time. It is suitable for situations that require fast response and cannot wait for batch processing.
可以理解的是,所述基于流计算的流程指标计算装置基于流计算方式计算流程事件的相关指标,得到流程指标计算结果。It can be understood that the process indicator calculation device based on flow computing calculates the relevant indicators of the process event based on the flow computing method to obtain the process indicator calculation result.
在具体实施中,所述流程事件的相关指标是指在业务流程执行过程中,针对特定流程事件产生的、能够反映该事件对业务流程效率、效果、合规性、风险控制等因素产生影响的一系列量化或可衡量的数据。例如:效率指标(包括处理时间、事件响应时间和循环周期时间)、质量指标(包括错误率、完成率和合规性指标)、以及成本指标(包括单个事件处理成本和平均成本节省/增加);通过以上指标以及其他定制化的流程相关指标,企业可以更好地量化和评估其业务流程的效果,发现瓶颈,指导持续改进,并做出有效的管理决策。In specific implementation, the process event related indicators refer to a series of quantitative or measurable data generated for specific process events during the execution of business processes, which can reflect the impact of the event on factors such as business process efficiency, effectiveness, compliance, and risk control. For example: efficiency indicators (including processing time, event response time, and cycle time), quality indicators (including error rate, completion rate, and compliance indicators), and cost indicators (including single event processing cost and average cost savings/increase); through the above indicators and other customized process-related indicators, enterprises can better quantify and evaluate the effectiveness of their business processes, discover bottlenecks, guide continuous improvement, and make effective management decisions.
在本实施例中,所述基于流计算的流程指标计算装置依赖流程指标计算节点内部的复杂事件处理引擎,可以通过声明式的事件处理语句来处理流程事件。In this embodiment, the process indicator calculation device based on stream computing relies on a complex event processing engine inside a process indicator calculation node, and can process process events through declarative event processing statements.
具体地,所述步骤S20,还包括步骤S21:Specifically, the step S20 further includes step S21:
步骤S21,基于流计算方式,通过复杂事件处理引擎计算所述流程事件的相关指标,得到流程指标计算结果。Step S21, based on the flow computing method, the complex event processing engine calculates the relevant indicators of the process event to obtain the process indicator calculation result.
在具体实施中,所述复杂事件处理引擎支持事件流处理语言,可以使用声明式的开发方式,不必根据业务逻辑进行硬编码。所述复杂事件处理引擎定位在具体进行流数据处理时所需的各类功能和算法的引擎,提供技术手段处理事件间的关系,比如时间顺序关系,聚合关系,层次关系,依赖关系,因果关系。In specific implementation, the complex event processing engine supports event stream processing language, and can use a declarative development method without hard coding according to business logic. The complex event processing engine is positioned as an engine for various functions and algorithms required for specific stream data processing, and provides technical means to process the relationship between events, such as time sequence relationship, aggregation relationship, hierarchical relationship, dependency relationship, and causal relationship.
在具体实施中,所述复杂事件处理引擎对当前主流的开源复杂事件处理引擎Esper进行封装。Esper提供了功能丰富的EPL持续查询语言,能够根据事件的关系进行关联和计算,最大限度的避免对流处理逻辑做硬编码。基于该指标计算系统,过去依赖SQL计算的复杂指标只需定义几条EPL语句就可以在复杂事件处理引擎和流计算架构的支撑下进行海量流数据的实时持续计算。In the specific implementation, the complex event processing engine encapsulates the current mainstream open source complex event processing engine Esper. Esper provides a feature-rich EPL continuous query language that can associate and calculate based on the relationship between events, and avoid hard coding of stream processing logic to the greatest extent. Based on this indicator calculation system, complex indicators that used to rely on SQL calculations only need to define a few EPL statements to perform real-time continuous calculations of massive stream data under the support of the complex event processing engine and stream computing architecture.
在本实施例中,所述基于流计算的流程指标计算装置依赖流程指标计算节点内部的复杂事件处理引擎,实时地将流程指标计算结果发送到流程指标存储节点中。In this embodiment, the process indicator calculation device based on stream computing relies on the complex event processing engine inside the process indicator calculation node to send the process indicator calculation result to the process indicator storage node in real time.
具体地,所述步骤S20之后,还包括步骤t1:Specifically, after step S20, step t1 is further included:
步骤t1,将所述流程指标计算结果发送给流程指标存储节点,以供所述流程指标存储节点存储所述流程指标计算结果。Step t1, sending the process indicator calculation result to a process indicator storage node, so that the process indicator storage node stores the process indicator calculation result.
在具体实施中,所述流程指标存储节点可以是内存数据库,所述流程指标存储节点存储接收到的流程指标计算结果。In a specific implementation, the process indicator storage node may be a memory database, and the process indicator storage node stores the received process indicator calculation results.
在本实施例中,流程指标计算框架基于内存进行实时计算以满足低延迟的需求,可以在其中定义多个数据流,每个流都是一种流程事件的数据类型,在流定义之上配置事件流处理语句并依靠复杂事件处理引擎进行流程事件的过滤、关联、聚合,从而计算出流程指标。对于多层次的复合指标或运算环节较多的情况,可定义拓扑计算图并提交给指标计算系统,框架会把拓扑图中的计算环节分配给多个受控的节点,以便利用更多的CPU和内存。In this embodiment, the process indicator calculation framework performs real-time calculations based on memory to meet the requirements of low latency. Multiple data streams can be defined in it, each of which is a data type of a process event. Event stream processing statements are configured on the stream definition and the complex event processing engine is used to filter, associate, and aggregate process events to calculate process indicators. For multi-level composite indicators or situations with many calculation links, a topology calculation graph can be defined and submitted to the indicator calculation system. The framework will assign the calculation links in the topology graph to multiple controlled nodes to utilize more CPU and memory.
在本实施例中,参照图2,流程指标计算框架包括流程引擎、流程事件分发节点、多个流程指标计算节点以及流程指标存储节点,流程指标计算节点内嵌着复杂事件处理引擎。流程事件分发节点接收流程引擎实时发送的流程事件,在对接收到的流程事件进行分类后,流程事件分发节点将分类后的流程事件分配至对应的流程指标计算节点,流程指标计算节点依赖于内部的复杂事件处理引擎对流程事件的相关指标进行计算,得到流程指标计算结果,并将流程指标计算结果发送至流程指标存储节点。在指标定义发生变更的情况下,流程指标定义节点将变更后的指标定义推送至所有流程指标计算节点。In this embodiment, referring to FIG2 , the process indicator calculation framework includes a process engine, a process event distribution node, a plurality of process indicator calculation nodes and a process indicator storage node, and the process indicator calculation node is embedded with a complex event processing engine. The process event distribution node receives the process events sent by the process engine in real time. After classifying the received process events, the process event distribution node distributes the classified process events to the corresponding process indicator calculation nodes. The process indicator calculation nodes rely on the internal complex event processing engine to calculate the relevant indicators of the process events, obtain the process indicator calculation results, and send the process indicator calculation results to the process indicator storage node. In the case of changes in the indicator definition, the process indicator definition node pushes the changed indicator definition to all process indicator calculation nodes.
在本实施例中,与相关技术中基于SQL和数据库进行流程指标计算,但是在处理大规模数据分析时,由于数据仓库存储的是历史的、大量的静态数据,随着数据量的增长,频繁的大规模数据读取可能会导致磁盘I/O成为SQL查询的性能瓶颈,进而导致指标计算的效率出现明显下降相比,在本实施例中,应用于流程指标计算节点,接收流程事件分发节点基于事件类型分配的流程事件;其中,所述事件类型是由所述流程事件分发节点确定的;基于流计算方式计算所述流程事件的相关指标,得到流程指标计算结果。即在本实施例中,接收流程事件分发节点分配的流程事件,并结合流计算方式计算流程事件的相关指标,通过分布式流程指标计算框架结合流计算的方式,降低从数据摄入到结果产出的延迟时间,实现实时监控、实时分析和实时决策,从而提高指标计算的效率。In this embodiment, compared with the related art that processes indicators are calculated based on SQL and database, when processing large-scale data analysis, since the data warehouse stores historical and large amounts of static data, as the amount of data increases, frequent large-scale data reading may cause disk I/O to become a performance bottleneck for SQL queries, thereby causing a significant decrease in the efficiency of indicator calculation. In this embodiment, a process indicator calculation node is applied to receive process events assigned by a process event distribution node based on event types; wherein the event type is determined by the process event distribution node; and the relevant indicators of the process events are calculated based on a stream computing method to obtain process indicator calculation results. That is, in this embodiment, a process event assigned by a process event distribution node is received, and the relevant indicators of the process event are calculated in combination with a stream computing method. Through a distributed process indicator calculation framework combined with a stream computing method, the delay time from data intake to result output is reduced, and real-time monitoring, real-time analysis, and real-time decision-making are achieved, thereby improving the efficiency of indicator calculation.
进一步地,参照图3,基于上述实施例,提供本申请的第二实施例,在本实施例中,应用于流程指标定义节点,所述基于流计算的流程指标计算方法还包括以下步骤:Further, referring to FIG. 3 , based on the above embodiment, a second embodiment of the present application is provided. In this embodiment, the process indicator calculation method based on flow computing is applied to the process indicator definition node, and further includes the following steps:
步骤A10,确定指标公式中各个数据项的数据项类型;Step A10, determining the data item type of each data item in the indicator formula;
需要说明的是,所述流程指标定义节点用于指标管理、指标模板管理、计算因子管理和指标发布管理。It should be noted that the process indicator definition node is used for indicator management, indicator template management, calculation factor management and indicator release management.
可以理解的是,指标管理主要是对指标的属性、计算公式、应用维度进行配置,其中计算公式由普通常数、计算因子、指标以及算术运算符组成。指标模板管理的主要职责是对指标模板进行管理。计算因子管理的主要职责是对计算因子进行管理。指标发布管理是当指标变更后实时推送到所有的指标计算节点。It is understandable that indicator management mainly configures the attributes, calculation formulas, and application dimensions of indicators, where the calculation formulas are composed of common constants, calculation factors, indicators, and arithmetic operators. The main responsibility of indicator template management is to manage indicator templates. The main responsibility of calculation factor management is to manage calculation factors. Indicator release management is to push indicators to all indicator calculation nodes in real time after they are changed.
在具体实施中,指标模板用于规范指标属性个数、指标属性字典信息,指标模板生成指标定义界面后,所述流程指标定义节点就能够按照统一模板配置指标实例信息。模板除了自身的概要属性,还包含指标属性,指标属性可分为基本属性和扩展属性,基本属性是内置的多类预定义属性,扩展属性描述该模板内置属性不满足业务需求时自定义的扩展属性。新建模板时默认将基本属性复制到新的模板中,模板中的基本属性只能启用或者不启用,启用时指标定义才会有该属性项的配置,扩展属性可以增加和删除,指标定义的属性项信息由启用的基本属性和扩展属性组成。In the specific implementation, the indicator template is used to standardize the number of indicator attributes and indicator attribute dictionary information. After the indicator template generates the indicator definition interface, the process indicator definition node can configure the indicator instance information according to the unified template. In addition to its own summary attributes, the template also contains indicator attributes. Indicator attributes can be divided into basic attributes and extended attributes. Basic attributes are built-in multiple categories of predefined attributes. Extended attributes describe customized extended attributes when the built-in attributes of the template do not meet business needs. When a new template is created, the basic attributes are copied to the new template by default. The basic attributes in the template can only be enabled or disabled. When enabled, the indicator definition will have the configuration of the attribute item. Extended attributes can be added and deleted. The attribute item information of the indicator definition consists of enabled basic attributes and extended attributes.
在具体实施中,在编辑指标公式的过程中,用户可直接输入+、-、*、/这4个运算符和常量,可选择插入预定义函数,还可以选择计算因子和其他指标。对于计算因子中的时间变量,提供界面进行配置;对于计算因子中的其他变量,提供二次扩展开发,扩展类实现指定接口,公式编辑完成后以字符串的形式存储。In the specific implementation, when editing the indicator formula, the user can directly input the four operators +, -, *, / and constants, can choose to insert predefined functions, and can also choose calculation factors and other indicators. For the time variable in the calculation factor, an interface is provided for configuration; for other variables in the calculation factor, secondary extension development is provided, and the extension class implements the specified interface. After the formula is edited, it is stored in the form of a string.
在具体实施中,所述流程指标定义节点确定指标公式中各个数据项的数据项类型,所述数据项类型包括计算因子、预定义函数和其他指标。计算因子(ComputationFactors)是用于复杂度量或数据分析中的一种中间层概念,它代表了在计算某个指标时的一个或多个基础操作单元。在业务分析、性能监控、数据统计等领域,计算因子通常指预先定义好的、具有一定逻辑计算能力的实体,它可以是一个简单的数学函数,也可以是一个复杂的表达式,或者是依据特定业务规则执行的脚本片段。预定义函数(PredefinedFunctions)是一组由语言本身或其标准库提供的、可以直接调用的函数。它们具有固定的语法结构和功能,旨在简化开发者的工作,提高程序设计效率。其他指标(OtherIndicators)指的是除当前正在定义或计算的指标外,已经存在的、可用于进一步计算或参考的相关指标。比如,在商业智能(BI)系统中,一个复杂的KPI(关键绩效指标)可能需要基于若干个基础指标进行计算得出,如利润率指标可能依赖于收入和成本这两个独立的底层指标。在构建指标公式时,可以直接引用这些“其他指标”的值来进行复合计算。这样做的好处是可以减少重复计算,增强指标间的关联性,并且使得整个指标体系更为透明和易于管理。In a specific implementation, the process indicator definition node determines the data item type of each data item in the indicator formula, and the data item type includes calculation factors, predefined functions and other indicators. Computation Factors is an intermediate layer concept used in complex metrics or data analysis, which represents one or more basic operation units when calculating a certain indicator. In the fields of business analysis, performance monitoring, data statistics, etc., calculation factors usually refer to predefined entities with certain logical calculation capabilities. It can be a simple mathematical function, a complex expression, or a script fragment executed according to specific business rules. Predefined functions are a set of functions that can be directly called by the language itself or its standard library. They have fixed grammatical structures and functions, aiming to simplify the work of developers and improve program design efficiency. Other indicators refer to related indicators that already exist and can be used for further calculation or reference in addition to the indicators currently being defined or calculated. For example, in a business intelligence (BI) system, a complex KPI (key performance indicator) may need to be calculated based on several basic indicators, such as a profit margin indicator that may rely on two independent underlying indicators, revenue and cost. When constructing an indicator formula, you can directly reference the values of these "other indicators" to perform compound calculations. This can reduce repeated calculations, enhance the correlation between indicators, and make the entire indicator system more transparent and easier to manage.
步骤A20,根据所述数据项类型,对所述指标公式进行相应处理,得到处理结果;Step A20, performing corresponding processing on the indicator formula according to the data item type to obtain a processing result;
在具体实施中,如果是计算因子,所述流程指标定义节点就调用计算因子的解析执行过程;如果是其他指标,所述流程指标定义节点先判断指标最新值是否已生成,并根据判断结果返回错误信息或获取指标最新值;如果是函数,所述流程指标定义节点将函数转化成计算引擎能识别的函数,并进行函数计算。In the specific implementation, if it is a calculation factor, the process indicator definition node calls the parsing execution process of the calculation factor; if it is other indicators, the process indicator definition node first determines whether the latest value of the indicator has been generated, and returns an error message or obtains the latest value of the indicator based on the judgment result; if it is a function, the process indicator definition node converts the function into a function that can be recognized by the calculation engine, and performs function calculation.
具体地,所述步骤A20,还包括步骤A21-A23:Specifically, the step A20 further includes steps A21-A23:
步骤A21,若所述数据项类型为计算因子,则对所述计算因子进行解析执行,得到解析执行结果;Step A21, if the data item type is a calculation factor, the calculation factor is parsed and executed to obtain a parsing and execution result;
在具体实施中,计算因子中可包含变量,解析计算因子时要从公式上下文中获得变量的值进行替换。计算因子主要由EPL语句完成,也有部分的计算因子组合为新的计算因子。计算因子可分为算式计算和EPL计算,如果是算式计算,所述流程指标定义节点需要逐个把公式中的计算因子进行嵌套解析执行;如果是EPL计算,所述流程指标定义节点就执行EPL语句,EPL语句的执行结果可以是一个具体数值,也可以是一个集合。In a specific implementation, the calculation factor may contain variables. When parsing the calculation factor, the value of the variable must be obtained from the formula context for replacement. The calculation factor is mainly completed by the EPL statement, and some calculation factors are combined into new calculation factors. The calculation factor can be divided into formula calculation and EPL calculation. If it is a formula calculation, the process indicator definition node needs to nest and parse the calculation factors in the formula one by one; if it is an EPL calculation, the process indicator definition node executes the EPL statement, and the execution result of the EPL statement can be a specific value or a set.
步骤A22,若所述数据项类型为预定义函数,则将所述预定义函数转化为流程指标计算节点可识别的目标函数;Step A22, if the data item type is a predefined function, converting the predefined function into an objective function that can be recognized by the process indicator calculation node;
在具体实施中,所述预定义函数是在编程语言中预先由系统提供的,开发者可以直接调用的函数。它们通常用于执行常见的、具有通用性的操作,如数学计算、字符串处理、数据类型转换等。In a specific implementation, the predefined functions are functions that are provided in advance by the system in a programming language and can be directly called by developers. They are usually used to perform common and general operations, such as mathematical calculations, string processing, data type conversion, etc.
步骤A23,若所述数据项类型为其他指标,则判断指标最新值是否已生成,并根据判断结果返回错误信息或获取指标最新值。Step A23, if the data item type is other indicators, determine whether the latest value of the indicator has been generated, and return an error message or obtain the latest value of the indicator based on the determination result.
在具体实施中,所述流程指标定义节点先判断指标最新值是否已生成,如果未生成返回错误信息并终止公式的解析执行过程,如果已生成就查询指标存储节点获取指标的最新值。In a specific implementation, the process indicator definition node first determines whether the latest indicator value has been generated. If not, an error message is returned and the parsing execution process of the formula is terminated. If it has been generated, the indicator storage node is queried to obtain the latest value of the indicator.
步骤A30,将所述处理结果发送给流程指标计算节点,以供所述流程指标计算节点基于所述处理结果计算流程事件的相关指标,并得到流程指标计算结果。Step A30, sending the processing result to the process indicator calculation node, so that the process indicator calculation node calculates the relevant indicators of the process event based on the processing result and obtains the process indicator calculation result.
在具体实施中,所述流程指标定义节点将处理结果发送给流程指标计算节点,所述流程指标计算节点基于处理结果计算流程事件的相关指标,并得到流程指标计算结果。In a specific implementation, the process indicator definition node sends the processing result to the process indicator calculation node, and the process indicator calculation node calculates the relevant indicators of the process event based on the processing result and obtains the process indicator calculation result.
在本实施例中,参照图4,所述流程指标定义节点判断数据项类型,若为预定义函数,则所述流程指标定义节点将预定义函数转化成计算引擎能识别的函数,并进行函数计算;若为计算因子,则所述流程指标定义节点调用计算因子解析执行过程;若为其他指标,则所述流程指标定义节点判断指标最新值是否已生成,若未生成,则所述流程指标定义节点返回错误信息,若已生成,则所述流程指标定义节点获取指标最新值;所述流程指标定义节点将处理结果发送给流程指标计算节点(即调用计算引擎进行计算);流程指标计算节点完成指标计算后,将流程指标计算结果发送给流程指标存储节点,流程指标存储节点保存流程指标计算结果。In this embodiment, referring to FIG. 4 , the process indicator definition node determines the type of data item. If it is a predefined function, the process indicator definition node converts the predefined function into a function that can be recognized by the computing engine and performs function calculation. If it is a calculation factor, the process indicator definition node calls the calculation factor parsing execution process. If it is other indicators, the process indicator definition node determines whether the latest value of the indicator has been generated. If not, the process indicator definition node returns an error message. If it has been generated, the process indicator definition node obtains the latest value of the indicator. The process indicator definition node sends the processing result to the process indicator calculation node (i.e., calls the computing engine for calculation). After the process indicator calculation node completes the indicator calculation, it sends the process indicator calculation result to the process indicator storage node, and the process indicator storage node saves the process indicator calculation result.
在本实施例中,与相关技术中基于SQL和数据库进行流程指标计算,但是在某些情况下,如果计算可以合理地在应用服务器端完成,那么将所有工作负载都推给数据库服务器可能会导致资源分配不平衡,进而导致指标计算的效率出现明显下降相比,在本实施例中,应用于流程指标定义节点,确定指标公式中各个数据项的数据项类型;根据所述数据项类型,对所述指标公式进行相应处理,得到处理结果;将所述处理结果发送给流程指标计算节点,以供所述流程指标计算节点基于所述处理结果计算流程事件的相关指标,并得到流程指标计算结果。即在本实施例中,流程指标定义节点确定数据项类型,并根据数据项类型,对指标公式进行相应处理,再将处理结果发送给流程指标计算节点,流程指标计算节点基于处理结果计算流程事件的相关指标,通过更贴合工作流领域的数据逻辑与层次关系,使数据处理过程可以联动的触发多项指标的计算,进而提高了计算效率。In this embodiment, compared with the process indicator calculation based on SQL and database in the related art, but in some cases, if the calculation can be reasonably completed on the application server side, then pushing all workloads to the database server may lead to unbalanced resource allocation, thereby causing a significant decrease in the efficiency of indicator calculation, in this embodiment, the process indicator definition node is applied to determine the data item type of each data item in the indicator formula; according to the data item type, the indicator formula is processed accordingly to obtain a processing result; the processing result is sent to the process indicator calculation node, so that the process indicator calculation node calculates the relevant indicators of the process event based on the processing result, and obtains the process indicator calculation result. That is, in this embodiment, the process indicator definition node determines the data item type, and according to the data item type, the indicator formula is processed accordingly, and then the processing result is sent to the process indicator calculation node, and the process indicator calculation node calculates the relevant indicators of the process event based on the processing result, and through the data logic and hierarchical relationship that is more in line with the workflow field, the data processing process can trigger the calculation of multiple indicators in a linked manner, thereby improving the calculation efficiency.
进一步地,参照图5,基于上述实施例,提供本申请的第三实施例,在本实施例中,应用于流程引擎,所述基于流计算的流程指标计算方法还包括以下步骤:Further, referring to FIG. 5 , based on the above embodiment, a third embodiment of the present application is provided. In this embodiment, the process indicator calculation method based on flow computing is applied to a process engine, and further includes the following steps:
步骤B10,采集流程数据,并通过流程状态变更监听器确定所述流程数据中的变更数据;Step B10, collecting process data, and determining the changed data in the process data through a process state change listener;
需要说明的是,所述流程数据包括流程实例数据、活动实例数据、工作项数据、参与者数据、路由数据、相关数据、业务冗余数据等。It should be noted that the process data includes process instance data, activity instance data, work item data, participant data, routing data, related data, business redundancy data, etc.
在具体实施中,集中化流程平台所用的流程状态变更框架嵌入在所述流程引擎中,当所述流程引擎接收并处理一个操作类API时,会开启一个数据库事务,在该事务中会推动流程执行直到流程最终停下来,过程中会完成一系列的流程类操作并记录在缓存日志中,在事务落库时所有流程数据的变更会一次性写入存储。In the specific implementation, the process state change framework used by the centralized process platform is embedded in the process engine. When the process engine receives and processes an operation-type API, a database transaction is started. In this transaction, the process execution is promoted until the process finally stops. During this process, a series of process-type operations are completed and recorded in the cache log. When the transaction is stored in the database, all changes in process data are written to the storage at one time.
步骤B20,将所述变更数据组合为流程事件,并将所述流程事件发送给流程事件分发节点,以供所述流程事件分发节点基于事件类型分配所述流程事件。Step B20: Combining the change data into a process event, and sending the process event to a process event distribution node, so that the process event distribution node distributes the process event based on event type.
需要说明的是,所述流程引擎对于各个层面的流程数据均设置了状态变更监听器,对于这些数据的新增、删除、修改等操作会生成流程事件并实时发送至流程事件分发单元。It should be noted that the process engine sets state change listeners for process data at all levels, and operations such as adding, deleting, and modifying these data will generate process events and send them to the process event distribution unit in real time.
在具体实施中,流程状态变更框架会注册在事务落地后,该框架会遍历流程缓存操作日志,针对每一行数据的新增、每一个字段的修改,每一次数据的删除都会触发监听器,监听器会将变更前后的流程数据组合为事件并根据租户对应的监听器实现类做出对应的处理。In the specific implementation, the process state change framework will be registered after the transaction is implemented. The framework will traverse the process cache operation log. For each row of data added, each field modified, and each data deleted, the listener will be triggered. The listener will combine the process data before and after the change into an event and make corresponding processing according to the listener implementation class corresponding to the tenant.
在具体实施中,所述流程引擎针对各层次的流程数据的增删改操作,均通过状态变更框架生成流程事件,并根据对应租户的个性化触发机制进行推送,推送支持多租户,可以为每个租户配置一个推送实现类,根据任务记录的租户id属性选择特定的实现类进行推送。In the specific implementation, the process engine generates process events through the state change framework for the addition, deletion and modification operations of process data at each level, and pushes them according to the personalized trigger mechanism of the corresponding tenant. The push supports multiple tenants, and a push implementation class can be configured for each tenant. A specific implementation class is selected for push based on the tenant id attribute of the task record.
在本实施例中,与相关技术中基于SQL和数据库进行流程指标计算,但对于实时性要求较高的场景,如果计算密集型任务都在数据库中完成,可能会影响到其他关键查询的响应速度相比,在本实施例中,应用于流程引擎,采集流程数据,并通过流程状态变更监听器确定所述流程数据中的变更数据;将所述变更数据组合为流程事件,并将所述流程事件发送给流程事件分发节点,以供所述流程事件分发节点基于事件类型分配所述流程事件。即在本实施例中,流程引擎通过流程状态变更监听器确定流程数据中的变更数据,并将变更数据组合为流程事件,再将流程事件发送给流程事件分发节点,流程事件分发节点基于事件类型分配流程事件,通过设置状态变更监听器对各个层面的流程数据进行监控,可以在流程调度的事务执行过程中实时捕获到数据实体的状态变化,从而提升了数据处理效率和系统的响应速度。In this embodiment, compared with the related art that calculates process indicators based on SQL and database, but for scenarios with high real-time requirements, if all computationally intensive tasks are completed in the database, it may affect the response speed of other key queries. In this embodiment, it is applied to the process engine, collects process data, and determines the change data in the process data through the process state change listener; combines the change data into process events, and sends the process events to the process event distribution node, so that the process event distribution node can distribute the process events based on the event type. That is, in this embodiment, the process engine determines the change data in the process data through the process state change listener, and combines the change data into process events, and then sends the process events to the process event distribution node. The process event distribution node distributes process events based on the event type, and monitors the process data at all levels by setting the state change listener. The state changes of data entities can be captured in real time during the transaction execution of process scheduling, thereby improving data processing efficiency and system response speed.
此外,本申请实施例还提出一种基于流计算的流程指标计算装置,参照图6,所述基于流计算的流程指标计算装置包括:In addition, the embodiment of the present application further proposes a process indicator calculation device based on flow computing. Referring to FIG. 6 , the process indicator calculation device based on flow computing includes:
接收模块10,用于接收流程事件分发节点基于事件类型分配的流程事件;其中,所述事件类型是由所述流程事件分发节点确定的;A receiving module 10, configured to receive a process event assigned by a process event distribution node based on an event type; wherein the event type is determined by the process event distribution node;
计算模块20,用于基于流计算方式计算所述流程事件的相关指标,得到流程指标计算结果。The calculation module 20 is used to calculate the relevant indicators of the process event based on the flow calculation method to obtain the process indicator calculation result.
可选地,所述计算模块,还包括:Optionally, the calculation module further includes:
计算单元,用于基于流计算方式,通过复杂事件处理引擎计算所述流程事件的相关指标,得到流程指标计算结果。The calculation unit is used to calculate the relevant indicators of the process event through a complex event processing engine based on a flow calculation method to obtain a process indicator calculation result.
可选地,所述基于流计算的流程指标计算装置,还包括:Optionally, the process indicator calculation device based on flow computing further includes:
发送模块,用于将所述流程指标计算结果发送给流程指标存储节点,以供所述流程指标存储节点存储所述流程指标计算结果。The sending module is used to send the process indicator calculation result to the process indicator storage node so that the process indicator storage node can store the process indicator calculation result.
在本实施例中,应用于流程指标计算节点,接收流程事件分发节点基于事件类型分配的流程事件;其中,所述事件类型是由所述流程事件分发节点确定的;基于流计算方式计算所述流程事件的相关指标,得到流程指标计算结果。即在本实施例中,接收流程事件分发节点分配的流程事件,并结合流计算方式计算流程事件的相关指标,通过分布式流程指标计算框架结合流计算的方式,降低从数据摄入到结果产出的延迟时间,实现实时监控、实时分析和实时决策,从而提高指标计算的效率。In this embodiment, the process indicator calculation node is applied to receive the process event assigned by the process event distribution node based on the event type; wherein the event type is determined by the process event distribution node; and the relevant indicators of the process event are calculated based on the stream computing method to obtain the process indicator calculation result. That is, in this embodiment, the process event assigned by the process event distribution node is received, and the relevant indicators of the process event are calculated in combination with the stream computing method. Through the distributed process indicator calculation framework combined with the stream computing method, the delay time from data intake to result output is reduced, and real-time monitoring, real-time analysis and real-time decision-making are realized, thereby improving the efficiency of indicator calculation.
本申请基于流计算的流程指标计算装置的具体实施方式与上述基于流计算的流程指标计算方法各实施例基本相同,在此不再赘述。The specific implementation of the process indicator calculation device based on flow computing in the present application is basically the same as the various embodiments of the process indicator calculation method based on flow computing mentioned above, and will not be repeated here.
参照图7,图7为本申请实施例方案涉及的硬件运行环境的基于流计算的流程指标计算设备结构示意图。Refer to Figure 7, which is a schematic diagram of the structure of a process indicator calculation device based on stream computing in the hardware operating environment involved in the embodiment of the present application.
如图7所示,该基于流计算的流程指标计算设备可以包括:处理器1001,例如中央处理器(Central Processing Unit,CPU),通信总线1002,用户接口1003,网络接口1004,存储器1005。其中,通信总线1002用于实现这些组件之间的连接通信。用户接口1003可以包括显示屏(Display)、输入单元比如键盘(Keyboard),可选用户接口1003还可以包括标准的有线接口、无线接口。网络接口1004可选的可以包括标准的有线接口、无线接口(如无线保真(WIreless-FIdelity,WI-FI)接口)。存储器1005可以是高速的随机存取存储器(RandomAccess Memory,RAM)存储器,也可以是稳定的非易失性存储器(Non-Volatile Memory,NVM),例如磁盘存储器。存储器1005可选的还可以是独立于前述处理器1001的存储装置。As shown in FIG7 , the process indicator calculation device based on flow computing may include: a processor 1001, such as a central processing unit (CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Among them, the communication bus 1002 is used to realize the connection and communication between these components. The user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a wireless fidelity (WIreless-FIdelity, WI-FI) interface). The memory 1005 may be a high-speed random access memory (Random Access Memory, RAM) memory, or a stable non-volatile memory (Non-Volatile Memory, NVM), such as a disk memory. The memory 1005 may also be a storage device independent of the aforementioned processor 1001.
本领域技术人员可以理解,图7中示出的结构并不构成对基于流计算的流程指标计算设备的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。Those skilled in the art will appreciate that the structure shown in FIG. 7 does not constitute a limitation on the process indicator calculation device based on flow calculation, and may include more or fewer components than shown in the figure, or a combination of certain components, or a different arrangement of components.
如图7所示,作为一种计算机存储介质的存储器1005中可以包括操作系统、网络通信模块、用户接口模块以及基于流计算的流程指标计算程序。As shown in FIG. 7 , the memory 1005 as a computer storage medium may include an operating system, a network communication module, a user interface module, and a process indicator calculation program based on flow computing.
其中,操作系统是管理和控制基于流计算的流程指标计算设备与软件资源的程序,支持网络通信模块、用户接口模块、基于流计算的流程指标计算程序以及其他程序或软件的运行,网络通信模块用于管理和控制网络接口1004;用户接口模块用于管理和控制用户接口1003。Among them, the operating system is a program that manages and controls the process indicator calculation equipment and software resources based on flow computing, supports the operation of the network communication module, the user interface module, the process indicator calculation program based on flow computing and other programs or software. The network communication module is used to manage and control the network interface 1004; the user interface module is used to manage and control the user interface 1003.
在图7所示的基于流计算的流程指标计算设备中,所述基于流计算的流程指标计算设备通过处理器1001调用存储器1005中存储的基于流计算的流程指标计算程序,实现上述任一项所述的基于流计算的流程指标计算方法的步骤。In the process indicator calculation device based on stream computing shown in Figure 7, the process indicator calculation device based on stream computing calls the process indicator calculation program based on stream computing stored in the memory 1005 through the processor 1001 to implement the steps of the process indicator calculation method based on stream computing described in any of the above items.
本申请基于流计算的流程指标计算设备具体实施方式与上述基于流计算的流程指标计算方法各实施例基本相同,在此不再赘述。The specific implementation of the process indicator calculation device based on stream computing in the present application is basically the same as the various embodiments of the process indicator calculation method based on stream computing described above, and will not be repeated here.
此外,本发明实施例还提出一种存储介质,本申请实施例提供了一种存储介质,且所述存储介质存储有一个或者一个以上程序,所述一个或者一个以上程序还可被一个或者一个以上的处理器执行以用于实现上述任一项所述的基于流计算的流程指标计算方法的步骤。In addition, an embodiment of the present invention also proposes a storage medium. An embodiment of the present application provides a storage medium, and the storage medium stores one or more programs. The one or more programs can also be executed by one or more processors to implement the steps of the process indicator calculation method based on flow computing described in any of the above items.
本申请存储介质具体实施方式与上述基于流计算的流程指标计算方法各实施例基本相同,在此不再赘述。The specific implementation method of the storage medium of the present application is basically the same as the embodiments of the process indicator calculation method based on flow computing described above, and will not be repeated here.
此外,本发明实施例还提出一种计算机程序产品,包括基于流计算的流程指标计算程序,所述基于流计算的流程指标计算程序被处理器执行时实现如上所述的基于流计算的流程指标计算方法的步骤。In addition, an embodiment of the present invention further proposes a computer program product, including a process indicator calculation program based on stream computing, which implements the steps of the process indicator calculation method based on stream computing as described above when executed by a processor.
本发明计算机程序产品具体实施方式与上述基于流计算的流程指标计算方法各实施例基本相同,在此不再赘述。The specific implementation manner of the computer program product of the present invention is basically the same as the various embodiments of the process indicator calculation method based on flow computing described above, and will not be described in detail here.
需要说明的是,在本文中,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者系统不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者系统所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括该要素的过程、方法、物品或者系统中还存在另外的相同要素。It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or system including the element.
上述本申请实施例序号仅仅为了描述,不代表实施例的优劣。The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在如上所述的一个存储介质(如ROM/RAM、磁碟、光盘)中,包括若干指令用以使得一台终端设备(可以是手机,计算机,服务器,或者网络设备等)执行本申请各个实施例所述的方法。Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) as described above, including a number of instructions for a terminal device (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods described in each embodiment of the present application.
以上仅为本申请的优选实施例,并非因此限制本申请的专利范围,凡是利用本申请说明书及附图内容所作的等效结构或等效流程变换,或直接或间接运用在其他相关的技术领域,均同理包括在本申请的专利保护范围内。The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410458964.4ACN118377615A (en) | 2024-04-16 | 2024-04-16 | Process indicator calculation method based on flow computing and related equipment |
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410458964.4ACN118377615A (en) | 2024-04-16 | 2024-04-16 | Process indicator calculation method based on flow computing and related equipment |
| Publication Number | Publication Date |
|---|---|
| CN118377615Atrue CN118377615A (en) | 2024-07-23 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202410458964.4APendingCN118377615A (en) | 2024-04-16 | 2024-04-16 | Process indicator calculation method based on flow computing and related equipment |
| Country | Link |
|---|---|
| CN (1) | CN118377615A (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114240122A (en)* | 2021-12-07 | 2022-03-25 | 阿里巴巴(中国)有限公司 | Data processing method and device, electronic equipment and storage medium |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114240122A (en)* | 2021-12-07 | 2022-03-25 | 阿里巴巴(中国)有限公司 | Data processing method and device, electronic equipment and storage medium |
| CN114240122B (en)* | 2021-12-07 | 2025-09-12 | 阿里巴巴(中国)有限公司 | Data processing method, device, electronic device and storage medium |
| Publication | Publication Date | Title |
|---|---|---|
| US12204593B2 (en) | Data search and analysis for distributed data systems | |
| US11704313B1 (en) | Parallel branch operation using intermediary nodes | |
| US11055352B1 (en) | Engine independent query plan optimization | |
| US11182353B2 (en) | Stored-procedure execution method and device, and system | |
| CN111061788B (en) | A multi-source heterogeneous data conversion and integration system based on cloud architecture and its implementation method | |
| CN111966692A (en) | Data processing method, medium, device and computing equipment for data warehouse | |
| US10909114B1 (en) | Predicting partitions of a database table for processing a database query | |
| US10924334B1 (en) | Monitoring distributed systems with auto-remediation | |
| US10885050B2 (en) | Altering in-flight streamed data from a relational database | |
| CN112631754A (en) | Data processing method, data processing device, storage medium and electronic device | |
| CN118377615A (en) | Process indicator calculation method based on flow computing and related equipment | |
| WO2025001967A1 (en) | Method and apparatus for acquiring lineage data, computer device, and readable storage medium | |
| Theeten et al. | Chive: Bandwidth optimized continuous querying in distributed clouds | |
| CN118708608A (en) | Processing engine selection method, device, computer equipment, and storage medium | |
| CN117376092A (en) | Fault root cause positioning method, device, equipment and storage medium | |
| CN118014426A (en) | Method and device for obtaining process quality measurement system | |
| CN117112697A (en) | Data management method and related device | |
| CN118606326A (en) | Dynamic and automated management methods, products, media and equipment for the entire data life cycle | |
| CN114238406A (en) | Directional forwarding method and system for distributed database gateway | |
| CN120744193A (en) | Multi-dimensional index calculation method based on graph database | |
| CN120561151A (en) | EBPF-based database query optimization method, eBPF-based database query optimization device, eBPF-based database query optimization equipment and medium |
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |