Movatterモバイル変換


[0]ホーム

URL:


CN116902041A - Interface data processing method and device, electronic equipment and medium - Google Patents

Interface data processing method and device, electronic equipment and medium
Download PDF

Info

Publication number
CN116902041A
CN116902041ACN202310721086.6ACN202310721086ACN116902041ACN 116902041 ACN116902041 ACN 116902041ACN 202310721086 ACN202310721086 ACN 202310721086ACN 116902041 ACN116902041 ACN 116902041A
Authority
CN
China
Prior art keywords
state information
target
current state
target device
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310721086.6A
Other languages
Chinese (zh)
Inventor
胡旭
邱锡宏
安宝钰
骆正新
袁重阳
杨艳京
孙凯迪
蔚彦昭
叶伟
于磊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
CRSC Urban Rail Transit Technology Co Ltd
Original Assignee
CRSC Urban Rail Transit Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by CRSC Urban Rail Transit Technology Co LtdfiledCriticalCRSC Urban Rail Transit Technology Co Ltd
Priority to CN202310721086.6ApriorityCriticalpatent/CN116902041A/en
Publication of CN116902041ApublicationCriticalpatent/CN116902041A/en
Pendinglegal-statusCriticalCurrent

Links

Classifications

Landscapes

Abstract

The invention provides an interface data processing method, an interface data processing device, electronic equipment and a medium. The method comprises the following steps: determining all target parameters of a target device, wherein the target parameters are used for indicating parameters related to state calculation of the target device; determining current state information of a first virtual device corresponding to the target device based on at least part of target parameters when the at least part of target parameters exist in a state dictionary corresponding to the target device, wherein the state dictionary is constructed based on the interface data after serialization processing; and determining the current state information of the target device based on the current state information of the first virtual device. The interface data processing method, the device, the electronic equipment and the medium provided by the invention can improve the processing efficiency of the interface data.

Description

Translated fromChinese
接口数据处理方法、装置、电子设备及介质Interface data processing method, device, electronic equipment and medium

技术领域Technical Field

本发明涉及轨道交通技术领域,尤其涉及一种接口数据处理方法、装置、电子设备及介质。The present invention relates to the field of rail transit technology, and in particular to an interface data processing method, device, electronic equipment and medium.

背景技术Background Art

智能运维系统是信号系统设备状态监测和全生命周期管理的重要设备。智能运维系统利用云平台、大数据处理和通信技术,完成对信号系统所有设备的状态集中监视、故障处置、分析预测及生产管理。智能运维系统的接口程序需要实时处理大量输入数据,并计算用户关注的设备状态信息。由于设备的状态与多个接口数据相关,且转换规则可变化,需要用户配置指定。The intelligent operation and maintenance system is an important device for signal system equipment status monitoring and full life cycle management. The intelligent operation and maintenance system uses cloud platforms, big data processing and communication technologies to complete centralized status monitoring, fault handling, analysis and prediction, and production management of all equipment in the signal system. The interface program of the intelligent operation and maintenance system needs to process a large amount of input data in real time and calculate the equipment status information that users are concerned about. Since the status of the equipment is related to multiple interface data and the conversion rules can change, users need to configure and specify them.

常规的接口转换程序需要针对转换规则编写对应的转换模块,而且对输入数据的格式要求很严格。常规的接口转换程序开发过程很长,由于需要转换的设备很多,转换规则不确定等原因会造成接口转换程序频繁修改适配,不能快速响应用户的需求变化,导致接口数据处理效率受到影响。Conventional interface conversion programs require the writing of corresponding conversion modules based on conversion rules, and have strict requirements on the format of input data. Conventional interface conversion program development process is very long. Due to the large number of devices that need to be converted and the uncertainty of conversion rules, the interface conversion program will be frequently modified and adapted, and cannot quickly respond to changes in user needs, resulting in the interface data processing efficiency being affected.

发明内容Summary of the invention

本发明提供一种接口数据处理方法、装置、电子设备及介质,用以解决现有技术中接口转换程序不稳定导致接口数据处理效率受影响的技术问题。The present invention provides an interface data processing method, device, electronic equipment and medium, which are used to solve the technical problem in the prior art that the interface data processing efficiency is affected due to the instability of the interface conversion program.

本发明提供一种接口数据处理方法,包括:The present invention provides an interface data processing method, comprising:

确定目标设备的所有目标参数,所述目标参数用于指示与所述目标设备的状态计算相关的参数;Determine all target parameters of a target device, where the target parameters are used to indicate parameters related to state calculation of the target device;

在所述目标设备对应的状态字典中存在至少部分目标参数的情况下,基于所述至少部分目标参数,确定所述目标设备对应的第一虚拟设备的当前状态信息,所述状态字典基于序列化处理后的接口数据构建;In a case where at least part of the target parameters exist in a state dictionary corresponding to the target device, determining current state information of a first virtual device corresponding to the target device based on the at least part of the target parameters, the state dictionary being constructed based on the serialized interface data;

基于所述第一虚拟设备的当前状态信息,确定所述目标设备的当前状态信息。Based on the current state information of the first virtual device, the current state information of the target device is determined.

在一些实施例中,所述基于所述至少部分目标参数,确定所述目标设备对应的第一虚拟设备的当前状态信息之后,所述方法还包括:In some embodiments, after determining the current state information of the first virtual device corresponding to the target device based on the at least part of the target parameters, the method further includes:

在第一时刻与第二时刻之间的时长不超过第一时长的情况下,确定所述第一虚拟设备的当前状态信息为有效信息,所述第二时刻早于所述第一时刻,所述第一时刻为所述第一虚拟设备的当前状态信息的更新时刻,所述第二时刻为所述第一虚拟设备的上一状态信息的更新时刻;In the case where the duration between the first moment and the second moment does not exceed the first duration, determining that the current state information of the first virtual device is valid information, the second moment is earlier than the first moment, the first moment is the update time of the current state information of the first virtual device, and the second moment is the update time of the previous state information of the first virtual device;

将所述第一虚拟设备的上一状态信息更新为所述虚拟设备的当前状态信息。The previous state information of the first virtual device is updated as the current state information of the virtual device.

在一些实施例中,所述基于所述第一虚拟设备的当前状态信息,确定所述目标设备的当前状态信息,包括:In some embodiments, determining the current state information of the target device based on the current state information of the first virtual device includes:

基于所述第一虚拟设备的当前状态信息,确定所述目标设备的中间状态信息;Determining intermediate state information of the target device based on current state information of the first virtual device;

基于所述所有目标参数中除所述至少部分目标参数之外的参数,确定所述目标设备对应的第二虚拟设备的当前状态信息;Determine current state information of a second virtual device corresponding to the target device based on parameters other than the at least part of the target parameters among all the target parameters;

基于所述中间状态信息和所述第二虚拟设备的当前状态信息,确定所述目标设备的当前状态信息。Based on the intermediate state information and the current state information of the second virtual device, the current state information of the target device is determined.

在一些实施例中,所述基于所述第一虚拟设备的当前状态信息,确定所述目标设备的当前状态信息之后,所述方法还包括:In some embodiments, after determining the current state information of the target device based on the current state information of the first virtual device, the method further includes:

在第三时刻与第四时刻之间的时长不超过第二时长的情况下,确定所述目标设备的当前状态信息为有效信息,所述第四时刻早于所述第三时刻,所述第三时刻为所述目标设备的当前状态信息的更新时刻,所述第四时刻为所述目标设备的上一状态信息的更新时刻;In a case where the duration between the third moment and the fourth moment does not exceed the second duration, determining that the current state information of the target device is valid information, the fourth moment is earlier than the third moment, the third moment is the update time of the current state information of the target device, and the fourth moment is the update time of the previous state information of the target device;

将所述目标设备的上一状态信息更新为所述目标设备的当前状态信息。The previous state information of the target device is updated as the current state information of the target device.

在一些实施例中,所述基于所述第一虚拟设备的当前状态信息,确定所述目标设备的当前状态信息之后,所述方法还包括:In some embodiments, after determining the current state information of the target device based on the current state information of the first virtual device, the method further includes:

基于所述目标设备的当前状态信息,更新所述状态字典。The state dictionary is updated based on the current state information of the target device.

在一些实施例中,所述基于所述第一虚拟设备的当前状态信息,确定所述目标设备的当前状态信息之后,所述方法还包括:In some embodiments, after determining the current state information of the target device based on the current state information of the first virtual device, the method further includes:

基于所述目标设备的当前状态信息和所述目标设备的上一状态信息,判断所述目标设备的状态信息是否变化;Based on the current state information of the target device and the previous state information of the target device, determining whether the state information of the target device has changed;

在所述目标设备的状态信息变化的情况下,确定设备变化信息和报警信息中的一种或多种信息。When the state information of the target device changes, one or more of device change information and alarm information is determined.

本发明还提供一种接口数据处理装置,包括:The present invention also provides an interface data processing device, comprising:

第一确定模块,用于确定目标设备的所有目标参数,所述目标参数用于指示与所述目标设备的状态计算相关的参数;A first determination module, used to determine all target parameters of a target device, wherein the target parameters are used to indicate parameters related to the state calculation of the target device;

第二确定模块,用于在所述目标设备对应的状态字典中存在至少部分目标参数的情况下,基于所述至少部分目标参数,确定所述目标设备对应的第一虚拟设备的当前状态信息,所述状态字典基于序列化处理后的接口数据构建;a second determination module, configured to determine, when at least part of the target parameters exist in a state dictionary corresponding to the target device, current state information of a first virtual device corresponding to the target device based on the at least part of the target parameters, the state dictionary being constructed based on the serialized interface data;

第三确定模块,用于基于所述第一虚拟设备的当前状态信息,确定所述目标设备的当前状态信息。The third determination module is used to determine the current state information of the target device based on the current state information of the first virtual device.

本发明还提供一种电子设备,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,所述处理器执行所述程序时实现如上述任一种所述接口数据处理方法。The present invention also provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, any of the above-mentioned interface data processing methods is implemented.

本发明还提供一种非暂态计算机可读存储介质,其上存储有计算机程序,该计算机程序被处理器执行时实现如上述任一种所述接口数据处理方法。The present invention also provides a non-transitory computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the interface data processing method described in any one of the above methods is implemented.

本发明还提供一种计算机程序产品,包括计算机程序,所述计算机程序被处理器执行时实现如上述任一种所述接口数据处理方法。The present invention also provides a computer program product, comprising a computer program, wherein when the computer program is executed by a processor, the interface data processing method described above is implemented.

本发明提供的接口数据处理方法、装置、电子设备及介质,通过将接口数据转换为状态字典,可以快速获取与目标设备状态计算的至少部分参数,极大提高接口数据处理的效率,进而可以根据至少部分目标参数,确定对应的第一虚拟设备的状态信息,再计算目标设备的状态信息,实现设备状态的分层计算,可以以较小的内存开销,有效处理变化类大数据接口的数据;分层计算设备状态也极大地简化了设备状态计算规则编制的难度。The interface data processing method, device, electronic device and medium provided by the present invention can quickly obtain at least part of the parameters for target device state calculation by converting interface data into a state dictionary, greatly improving the efficiency of interface data processing, and then can determine the state information of the corresponding first virtual device based on at least part of the target parameters, and then calculate the state information of the target device to achieve hierarchical calculation of the device state, which can effectively process the data of the changing big data interface with a small memory overhead; hierarchical calculation of device state also greatly simplifies the difficulty of compiling device state calculation rules.

附图说明BRIEF DESCRIPTION OF THE DRAWINGS

为了更清楚地说明本发明或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作一简单地介绍,显而易见地,下面描述中的附图是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the present invention or the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

图1是本发明提供的接口数据处理方法的流程示意图之一;FIG1 is a flow chart of a method for processing interface data provided by the present invention;

图2是本发明提供的接口数据处理方法的流程示意图之二;FIG2 is a second flow chart of the interface data processing method provided by the present invention;

图3是本发明提供的接口数据处理装置的结构示意图;3 is a schematic diagram of the structure of the interface data processing device provided by the present invention;

图4是本发明提供的电子设备的结构示意图。FIG. 4 is a schematic diagram of the structure of an electronic device provided by the present invention.

具体实施方式DETAILED DESCRIPTION

为使本发明的目的、技术方案和优点更加清楚,下面将结合本发明中的附图,对本发明中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。In order to make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be clearly and completely described below in conjunction with the drawings of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

下面结合附图描述本发明的接口数据处理方法、装置、电子设备及介质。The interface data processing method, device, electronic device and medium of the present invention are described below with reference to the accompanying drawings.

相关技术中,智能运维系统中的接口转换程序需要实时解析列车自动监控系统(Automatic Train Supervision,ATS)接口接收的大量接口数据,并按照用户需求实时计算大量设备的状态信息,并将设备的状态信息和报警信息发送给前端程序显示给用户。同时需要实时记录接收数据和发送数据,方便后期分析接口故障。接口转换程序对运行的实时性和稳定性均有要求,接口转换程序处理数据的速度必须很快而且需要做好错误防护。In the related technology, the interface conversion program in the intelligent operation and maintenance system needs to parse a large amount of interface data received by the Automatic Train Supervision (ATS) interface in real time, calculate the status information of a large amount of equipment in real time according to user needs, and send the status information and alarm information of the equipment to the front-end program for display to the user. At the same time, it is necessary to record the received data and the sent data in real time to facilitate the later analysis of interface failures. The interface conversion program has requirements for both real-time and stability of operation. The interface conversion program must process data very quickly and needs to be error-proof.

图1是本发明提供的接口数据处理方法的流程示意图之一。参照图1,本发明提供的接口数据处理方法包括:步骤110、步骤120和步骤130。Fig. 1 is a schematic diagram of a flow chart of the interface data processing method provided by the present invention. Referring to Fig. 1 , the interface data processing method provided by the present invention includes: step 110, step 120 and step 130.

步骤110、确定目标设备的所有目标参数,目标参数用于指示与目标设备的状态计算相关的参数;Step 110: determine all target parameters of the target device, where the target parameters are used to indicate parameters related to the state calculation of the target device;

步骤120、在目标设备对应的状态字典中存在至少部分目标参数的情况下,基于至少部分目标参数,确定目标设备对应的第一虚拟设备的当前状态信息,状态字典基于序列化处理后的接口数据构建;Step 120: if at least part of the target parameters exist in the state dictionary corresponding to the target device, determine the current state information of the first virtual device corresponding to the target device based on at least part of the target parameters, the state dictionary being constructed based on the serialized interface data;

步骤130、基于第一虚拟设备的当前状态信息,确定目标设备的当前状态信息。Step 130: Determine current state information of the target device based on the current state information of the first virtual device.

需要说明的是,本发明提供的接口数据处理方法的执行主体可以是电子设备、电子设备中的部件、集成电路、或芯片。该电子设备可以是移动电子设备,也可以为非移动电子设备。示例性的,移动电子设备可以为手机、平板电脑、笔记本电脑、掌上电脑、车载电子设备、可穿戴设备、超级移动个人计算机(ultra-mobile personal computer,UMPC)、上网本或者个人数字助理(personal digital assistant,PDA)等,非移动电子设备可以为服务器、网络附属存储器(Network Attached Storage,NAS)、个人计算机(personal computer,PC)、电视机(television,TV)、柜员机或者自助机等,本发明不作具体限定。It should be noted that the execution subject of the interface data processing method provided by the present invention can be an electronic device, a component in an electronic device, an integrated circuit, or a chip. The electronic device can be a mobile electronic device or a non-mobile electronic device. Exemplarily, the mobile electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), etc. The non-mobile electronic device can be a server, a network attached storage (NAS), a personal computer (PC), a television (TV), a teller machine or a self-service machine, etc., and the present invention does not make specific limitations.

下面以能够运行接口转换程序的计算机来执行本发明提供的接口数据处理方法为例,详细说明本发明的技术方案。The following takes a computer capable of running an interface conversion program to execute the interface data processing method provided by the present invention as an example to describe the technical solution of the present invention in detail.

在实际执行中,数据采集模块与被采集设备之间的通信采用基于传输控制协议(Transmission Control Protocol,TCP)的Client/Server模式,被采集设备为Server(服务器)端,数据采集模块为Client(客户)端。被采集设备根据自身状态变化情况实时向数据采集模块发送状态信息,每隔一段时间固定向数据采集模块发送心跳信息。In actual implementation, the communication between the data acquisition module and the collected device adopts the Client/Server mode based on the Transmission Control Protocol (TCP), with the collected device as the Server and the data acquisition module as the Client. The collected device sends status information to the data acquisition module in real time according to its own state changes, and sends heartbeat information to the data acquisition module at regular intervals.

以数据采集模块为智能运维系统,被采集设备为ATS系统为例来说明本发明提供的接口数据处理方法。The interface data processing method provided by the present invention is illustrated by taking the data acquisition module as an intelligent operation and maintenance system and the acquired device as an ATS system as an example.

按照给定的通信协议,智能运维系统的以太网接口可以接收ATS系统以固定频率发送的数据流,将数据流转换字符流,并按照JS对象标记(JavaScript Object Notation,JSON)数据格式进行存储。其中,该数据流可以是ATS系统维护信息,ATS系统维护信息可以包括ATS系统信息数据、应用数据和报警数据等。具体过程如下:According to the given communication protocol, the Ethernet interface of the intelligent operation and maintenance system can receive the data stream sent by the ATS system at a fixed frequency, convert the data stream into a character stream, and store it in the JS object notation (JSON) data format. Among them, the data stream can be ATS system maintenance information, which can include ATS system information data, application data, and alarm data. The specific process is as follows:

在实际执行中,ATS系统与智能运维系统之间的通信采用基于TCP的C/S模式,且采用统一的信息帧格式。其中,信息帧格式通常包括帧头、帧内容长度、帧内容和帧尾标识等。In actual implementation, the communication between the ATS system and the intelligent operation and maintenance system adopts the TCP-based C/S mode and a unified information frame format, which usually includes a frame header, frame content length, frame content, and frame tail identifier.

在ATS系统与智能运维系统进行接口数据通信时,由于信息帧的长度很大(150KB左右),智能运维系统的以太网接口实际接收到的接口数据存在分包和粘包。When the ATS system communicates interface data with the intelligent operation and maintenance system, since the length of the information frame is very large (about 150KB), the interface data actually received by the Ethernet interface of the intelligent operation and maintenance system is packetized and glued.

智能运维系统的以太网接口按照给定的通信协议解析数据时,首先需要根据帧头、帧长度和帧尾获取数据帧,然后JSON数据格式对接口数据进行序列化处理之后,将序列化处理后的接口数据存入卡夫卡(Kafka)接口。When the Ethernet interface of the intelligent operation and maintenance system parses data according to a given communication protocol, it first needs to obtain the data frame according to the frame header, frame length and frame tail, and then serialize the interface data in JSON data format and store the serialized interface data in the Kafka interface.

其中,卡夫卡是一个可分区的消息系统,获取消息的接口为卡夫卡接口,并将消息以主题(topic)为单位进行归纳。JSON数据格式是一种轻量级的数据交换格式,采用完全独立于编程语言的文本格式来存储和表示数据。Kafka is a partitionable message system. The interface for obtaining messages is the Kafka interface, and messages are summarized in terms of topics. The JSON data format is a lightweight data exchange format that uses a text format that is completely independent of the programming language to store and represent data.

可以理解的是,数据解析是基于通信协议,按照数据的封装结构进行逐层解析成对应的数据结构。每个数据帧包括多个数据包,每个数据包对应多个设备的数据,每个设备数据有多种格式。在实际执行中,解析后的数据量非常大且杂乱,多达上万行,通常想找到目标设备的状态信息是非常困难且耗时的。It is understandable that data parsing is based on the communication protocol, and is parsed layer by layer into corresponding data structures according to the data encapsulation structure. Each data frame includes multiple data packets, each data packet corresponds to the data of multiple devices, and each device data has multiple formats. In actual execution, the amount of data after parsing is very large and messy, up to tens of thousands of lines, and it is usually very difficult and time-consuming to find the status information of the target device.

由于接口数据对应的每一类信号每帧都会有很多条信息,如果没直接翻译信息以JSON格式存储,会得到字典嵌套数列的数据结构。Since each type of signal corresponding to the interface data will have many pieces of information in each frame, if the information is not directly translated and stored in JSON format, a data structure of a dictionary nested series will be obtained.

如下源程序为解析ATS接口数据未转换数列的JSON数据的示例。The following source code is an example of parsing the JSON data of the unconverted array of ATS interface data.

而将接口数据对应的信息直接存入状态字典,这不利于快速读取相应的数据,会造成接口转换程序转换数据耗时过多,所以需要对接口数据进行序列化处理,提取信息的部分内容作为关键字,并将信息的特征值提取,作为键值,从而将信息转换为字典,存入卡夫卡接口。若信息的部分内容包含数列信息,也需要提取关键信息,并将其作为键值转换为字典存储。Directly storing the information corresponding to the interface data in the state dictionary is not conducive to quickly reading the corresponding data, and will cause the interface conversion program to spend too much time converting data. Therefore, it is necessary to serialize the interface data, extract part of the information as keywords, and extract the characteristic value of the information as the key value, so as to convert the information into a dictionary and store it in the Kafka interface. If part of the information contains sequence information, it is also necessary to extract the key information and convert it into a dictionary as a key value for storage.

需要说明的是,状态字典可以以设备名称为键,以设备对应的状态信息为值,即状态值。可以理解的是,设备名称可以根据实际情况设置,在此不作具体限定;例如:可以是某站点-上行线路、某站点-车务终端或某站点-某分机等。状态值可以包括目标参数和目标参数对应的状态信息。状态字典用于指示从接收到的接口数据中解析出来的多个设备的状态相关信息,例如可以是ATS系统相关的所有设备的状态信息。状态字典可以动态实时更新。It should be noted that the status dictionary can use the device name as the key and the status information corresponding to the device as the value, that is, the status value. It is understandable that the device name can be set according to the actual situation and is not specifically limited here; for example: it can be a certain site-uplink line, a certain site-vehicle terminal or a certain site-a certain extension, etc. The status value may include target parameters and status information corresponding to the target parameters. The status dictionary is used to indicate status-related information of multiple devices parsed from the received interface data, for example, it can be status information of all devices related to the ATS system. The status dictionary can be updated dynamically in real time.

目标参数可以根据设备属性和实际需求进行相应设置,目标参数例如可以是:区域编号、车站类型、事件名称或设备事件时间、服务器状态、中央处理器状态等。The target parameters can be set accordingly according to the device attributes and actual needs. The target parameters can be, for example: area number, station type, event name or device event time, server status, CPU status, etc.

目标参数对应的状态信息即可以目标参数进行相应设置,在此不作具体限定,例如:服务器状态对应的状态信息可以是“正常”、“报警”或“未知状态”等,区域编号对应的状态信息即为区域对应的实际编号。The status information corresponding to the target parameters can be set accordingly, without specific limitation here. For example, the status information corresponding to the server status can be "normal", "alarm" or "unknown status", etc. The status information corresponding to the area number is the actual number corresponding to the area.

还可以对状态字典嵌套的信息进行扁平化处理,转换计算时可以快速获取参与计算的目标参数,极大提高接口数据处理的效率。The information nested in the state dictionary can also be flattened, and the target parameters involved in the calculation can be quickly obtained during the conversion calculation, greatly improving the efficiency of interface data processing.

如下源程序为ATS接口数据提取关键信息后,将接口数据数列转换为字典后的JSON数据示例。The following source code is an example of JSON data after extracting key information from the ATS interface data and converting the interface data series into a dictionary.

根据用户实际需求,可以输入设备转换数据表,设备转换数据表用于表示用户配置转换需求的表格数据,可以包括用户关注的设备、设备对应的状态计算规则以及状态计算相关的目标参数。According to the actual needs of the user, a device conversion data table can be input. The device conversion data table is used to represent the tabular data of the user's configuration conversion needs, which may include the device that the user is concerned about, the state calculation rules corresponding to the device, and the target parameters related to the state calculation.

设备转换数据表包括的内容可以如表1或表2所示。The content included in the device conversion data table may be as shown in Table 1 or Table 2.

表1Table 1

表2Table 2

其中,params为参数表;eval为设备状态的计算公式(支持PYTHON所有单行程序语句);dict为计算结果的转换字典;name为虚拟设备的内部名称,方便缓存该虚拟设备的状态值;identify为参数筛选公式,用于单参数取数但实际有多个参数时,确定具体参与计算的状态计算参数的值。Among them, params is the parameter table; eval is the calculation formula of the device status (supporting all single-line program statements of PYTHON); dict is the conversion dictionary of the calculation results; name is the internal name of the virtual device, which is convenient for caching the status value of the virtual device; identify is the parameter screening formula, which is used to determine the value of the specific status calculation parameter involved in the calculation when a single parameter is taken but there are actually multiple parameters.

在实际执行中,可以通过识别设备转换数据表对应的文件,生成设备转换规则对应的JSON文件,然后在进一步读取设备转换规则对应的JSON文件,确定目标设备对应的所有与设备状态计算相关的目标参数以及状态计算规则。设备转换规则可以根据用户需求确定,例如:某个参数阈值超过80%视为设备故障,或者是多个参数均满足条件才认为设备正常运行,在此不作具体限定。In actual implementation, the JSON file corresponding to the device conversion rule can be generated by identifying the file corresponding to the device conversion data table, and then the JSON file corresponding to the device conversion rule can be further read to determine all target parameters and status calculation rules related to the device status calculation corresponding to the target device. The device conversion rule can be determined according to user needs. For example, if a parameter threshold exceeds 80%, it is considered a device failure, or if multiple parameters meet the conditions, the device is considered to be operating normally. No specific restrictions are made here.

在本步骤中,接口转换程序读取到接口传输的信息帧后,并按照字典嵌套的方式进行存储。然后对信息帧对应的状态字典进行扁平化处理以便于读取目标参数,在得到扁平化处理后的状态字典后,基于设备转换数据表,可以确定需要进行状态计算的目标设备,进而在状态字典中获取与目标设备状态计算相关的参数。In this step, the interface conversion program reads the information frame transmitted by the interface and stores it in a dictionary nested manner. Then the state dictionary corresponding to the information frame is flattened to facilitate reading the target parameters. After obtaining the flattened state dictionary, the target device that needs to be calculated can be determined based on the device conversion data table, and then the parameters related to the target device state calculation can be obtained in the state dictionary.

由于ATS的接口数据量很大,接收的实际数据为变化数据,一包数据只有部分类型的信息,另一部分的信息为空,所以计算设备的状态需要缓存中间状态的数据,并进行分层计算。Since the ATS interface has a large amount of data, the actual data received is changing data. A packet of data only contains some types of information, and the other part of the information is empty. Therefore, the state of the computing device needs to cache the intermediate state data and perform hierarchical calculations.

可以理解的是,与目标设备的状态计算有关的所有目标参数有很多,但是不会一次性全部接收到,可能是分批次接收,且不能保证每周期都刷新目标设备对应的目标参数的状态数据,所以只能根据当前接收到的部分数据进行部分更新,没有接收到的数据暂不更新。It is understandable that there are many target parameters related to the status calculation of the target device, but they will not be received all at once. They may be received in batches, and there is no guarantee that the status data of the target parameters corresponding to the target device will be refreshed every cycle. Therefore, only partial updates can be made based on the partial data currently received, and data that has not been received will not be updated for the time being.

接口数据中只存在部分目标参数时,在状态字典中只存在至少部分目标参数的情况下,可以根据至少部分目标参数,可以计算目标设备的中间状态。中间状态可以用于指示目标设备对应的虚拟设备的状态信息。其中,目标设备可以包含多个虚拟设备,具体数量不限(目前工程应用最大为24个)。When only part of the target parameters exist in the interface data, and only at least part of the target parameters exist in the state dictionary, the intermediate state of the target device can be calculated based on at least part of the target parameters. The intermediate state can be used to indicate the state information of the virtual device corresponding to the target device. The target device can include multiple virtual devices, and the specific number is not limited (the maximum number for current engineering applications is 24).

在实际执行中,接口转换程序首先根据从状态字典中获取的至少部分目标参数,计算目标参数对应的第一虚拟设备的设备状态,需要限制参与状态计算的目标参数属于同一个信息类型中。In actual execution, the interface conversion program first calculates the device state of the first virtual device corresponding to the target parameter based on at least part of the target parameter obtained from the state dictionary, and it is necessary to limit the target parameters involved in the state calculation to belong to the same information type.

如果在状态字典中不存在与目标设备状态计算相关的参数,保持对应的虚拟设备的上一状态信息不变。If there are no parameters related to the target device state calculation in the state dictionary, the previous state information of the corresponding virtual device is kept unchanged.

在一个周期内,在得到所有虚拟设备的当前状态信息之后,可以计算聚合设备的当前状态信息,聚合设备即为目标设备。In one cycle, after obtaining the current state information of all virtual devices, the current state information of the aggregate device can be calculated, and the aggregate device is the target device.

如果参与计算的目标参数本次计算时为空,即只有部分目标参数未知或全部目标参数未知的情况下,保持该聚合设备的上一状态信息不变。If the target parameters involved in the calculation are empty during the current calculation, that is, only some of the target parameters are unknown or all of the target parameters are unknown, the previous state information of the aggregation device is kept unchanged.

本发明提供的接口数据处理方法,通过将接口数据转换为状态字典,可以快速获取与目标设备状态计算的至少部分参数,极大提高接口数据处理的效率,进而可以根据至少部分目标参数,确定对应的第一虚拟设备的状态信息,再计算目标设备的状态信息,实现设备状态的分层计算,可以以较小的内存开销,有效处理变化类大数据接口的数据;分层计算设备状态也极大地简化了设备状态计算规则编制的难度。The interface data processing method provided by the present invention can quickly obtain at least part of the parameters for calculating the target device state by converting the interface data into a state dictionary, thereby greatly improving the efficiency of interface data processing. Furthermore, the state information of the corresponding first virtual device can be determined based on at least part of the target parameters, and then the state information of the target device can be calculated to realize hierarchical calculation of the device state. The data of the changing big data interface can be effectively processed with a small memory overhead; hierarchical calculation of the device state also greatly simplifies the difficulty of compiling device state calculation rules.

在一些实施例中,基于至少部分目标参数,确定目标设备对应的第一虚拟设备的当前状态信息之后,接口数据处理方法还包括:In some embodiments, after determining the current state information of the first virtual device corresponding to the target device based on at least part of the target parameters, the interface data processing method further includes:

在第一时刻与第二时刻之间的时长不超过第一时长的情况下,确定第一虚拟设备的当前状态信息为有效信息,第二时刻早于第一时刻,第一时刻为第一虚拟设备的当前状态信息的更新时刻,第二时刻为第一虚拟设备的上一状态信息的更新时刻;When the duration between the first moment and the second moment does not exceed the first duration, determining that the current state information of the first virtual device is valid information, the second moment is earlier than the first moment, the first moment is the update time of the current state information of the first virtual device, and the second moment is the update time of the previous state information of the first virtual device;

将第一虚拟设备的上一状态信息更新为虚拟设备的当前状态信息。The previous state information of the first virtual device is updated as the current state information of the virtual device.

在实际执行中,第一虚拟设备的当前状态信息的更新时刻可以用时间戳表示,第一虚拟设备的上一状态信息的更新时刻同样用时间戳表示。In actual execution, the update time of the current state information of the first virtual device can be represented by a timestamp, and the update time of the previous state information of the first virtual device can also be represented by a timestamp.

在得到第一虚拟设备的当前状态信息之后,可以确定第一虚拟设备的当前状态信息的更新时刻,即获取第一时刻对应的时间戳。After obtaining the current state information of the first virtual device, the update time of the current state information of the first virtual device may be determined, that is, a timestamp corresponding to the first time may be obtained.

然后检测第一时刻对应的时间戳和第二时刻对应的时间戳之间的时长或时间差是否超过预先设置的第一时长。其中,第一时长可以根据实际需求确定,例如可以是1分钟或30秒等,在此不作具体限定。Then, it is detected whether the duration or time difference between the timestamp corresponding to the first moment and the timestamp corresponding to the second moment exceeds a preset first duration. The first duration may be determined according to actual needs, such as 1 minute or 30 seconds, etc., which is not specifically limited here.

如果超过第一时长,说明第一虚拟设备的当前状态信息为无效信息,然后将第一虚拟设备的上一状态信息更新为未知状态;如果没有超过第一时长,说明第一虚拟设备的当前状态信息为有效信息,然后将第一虚拟设备的上一状态信息更新为第一虚拟设备的当前状态信息。If it exceeds the first time length, it means that the current status information of the first virtual device is invalid information, and then the previous status information of the first virtual device is updated to an unknown status; if it does not exceed the first time length, it means that the current status information of the first virtual device is valid information, and then the previous status information of the first virtual device is updated to the current status information of the first virtual device.

本发明提供的接口数据处理方法,通过将第一虚拟设备的当前状态信息的更新时刻与第一虚拟设备的上一状态信息的更新时刻进行校验,在第一时刻与第二时刻之间的时长不超过第一时长的情况下,才会更新第一虚拟设备的上一状态信息,可以保证设备状态信息的时效性,从而避免使用过期的设备状态信息参与状态计算推导出错误的结果。The interface data processing method provided by the present invention verifies the update time of the current status information of the first virtual device with the update time of the previous status information of the first virtual device. The previous status information of the first virtual device will be updated only when the duration between the first moment and the second moment does not exceed the first duration. This can ensure the timeliness of the device status information, thereby avoiding using expired device status information to participate in status calculations to derive erroneous results.

在一些实施例中,基于第一虚拟设备的当前状态信息,确定目标设备的当前状态信息,包括:In some embodiments, determining the current state information of the target device based on the current state information of the first virtual device includes:

基于第一虚拟设备的当前状态信息,确定目标设备的中间状态信息;Determining intermediate state information of the target device based on current state information of the first virtual device;

基于所有目标参数中除至少部分目标参数之外的参数,确定目标设备对应的第二虚拟设备的当前状态信息;Determine current state information of a second virtual device corresponding to the target device based on parameters other than at least some of the target parameters among all the target parameters;

基于中间状态信息和第二虚拟设备的当前状态信息,确定目标设备的当前状态信息。Based on the intermediate state information and the current state information of the second virtual device, current state information of the target device is determined.

可以理解的是,在确定第一虚拟设备的当前状态信息之后,可以确定基于第一虚拟设备的当前状态信息,确定目标设备的中间状态信息。该中间状态信息即为未完成全部状态计算的状态信息。It is understandable that after determining the current state information of the first virtual device, the intermediate state information of the target device can be determined based on the current state information of the first virtual device. The intermediate state information is state information for which all state calculations have not been completed.

目标设备的状态信息可能需要多达24个虚拟设备参与状态计算,一个虚拟设备的状态信息可能需要几个目标参数参与计算,目标设备的状态信息可能还需要其他设备级联计算推导,所以部分目标参数只能计算目标设备的中间状态信息。由于不同的目标参数到达接口的时间可能不同,即在同一时间可能不会一次性接收到全部目标参数,因此,只能用部分目标参数进行计算,其他目标参数需要全部接收到后,才能进行聚合计算,得到目标设备的聚合状态,即最终的状态信息。The state information of the target device may require up to 24 virtual devices to participate in the state calculation. The state information of a virtual device may require several target parameters to participate in the calculation. The state information of the target device may also require other devices to cascade calculation and derivation, so some target parameters can only calculate the intermediate state information of the target device. Since different target parameters may arrive at the interface at different times, that is, all target parameters may not be received at the same time, only some target parameters can be used for calculation. After all other target parameters are received, aggregate calculation can be performed to obtain the aggregate state of the target device, that is, the final state information.

在实际执行中,只有在所有目标参数中除至少部分目标参数之外的参数都获取到的情况下,确定对应的第二虚拟设备的当前状态信息。第二虚拟设备和第二虚拟设备即为目标设备对应的全部虚拟设备。In actual execution, only when all target parameters except at least some of the target parameters are acquired, the current state information of the corresponding second virtual device is determined. The second virtual device and the second virtual device are all virtual devices corresponding to the target device.

在获取全部虚拟设备的当前状态信息的情况下,可以根据目标设备的中间状态信息和第二虚拟设备的当前状态信息,确定目标设备的当前状态信息。In the case of acquiring the current state information of all virtual devices, the current state information of the target device may be determined according to the intermediate state information of the target device and the current state information of the second virtual device.

本发明提供的接口数据处理方法,通过第一虚拟设备的当前状态信息,确定目标设备的中间状态信息,然后确定目标设备对应的第二虚拟设备的当前状态信息,实现了分层计算虚拟设备的状态信息,然后根据目标设备的中间状态信息和第二虚拟设备的当前状态信息,确定了目标设备的状态信息,以较小的内存开销,有效处理变化类大数据的接口数据,分层计算设备状态也极大地简化了设备计算规则编制的难度。The interface data processing method provided by the present invention determines the intermediate state information of the target device through the current state information of the first virtual device, and then determines the current state information of the second virtual device corresponding to the target device, thereby realizing hierarchical calculation of the state information of the virtual device, and then determines the state information of the target device based on the intermediate state information of the target device and the current state information of the second virtual device. With a small memory overhead, the interface data of the changing big data can be effectively processed, and the hierarchical calculation of the device state also greatly simplifies the difficulty of compiling device calculation rules.

在一些实施例中,基于第一虚拟设备的当前状态信息,确定目标设备的当前状态信息之后,接口数据处理方法还包括:In some embodiments, after determining the current state information of the target device based on the current state information of the first virtual device, the interface data processing method further includes:

在第三时刻与第四时刻之间的时长不超过第二时长的情况下,确定目标设备的当前状态信息为有效信息,第四时刻早于第三时刻,第三时刻为目标设备的当前状态信息的更新时刻,第四时刻为目标设备的上一状态信息的更新时刻;When the time between the third moment and the fourth moment does not exceed the second time, it is determined that the current state information of the target device is valid information, the fourth moment is earlier than the third moment, the third moment is the update time of the current state information of the target device, and the fourth moment is the update time of the previous state information of the target device;

将目标设备的上一状态信息更新为目标设备的当前状态信息。Update the previous status information of the target device to the current status information of the target device.

在得到目标设备的当前状态信息之后,可以确定目标设备的当前状态信息的更新时刻,即获取第三时刻对应的时间戳。After obtaining the current state information of the target device, the update time of the current state information of the target device may be determined, that is, the timestamp corresponding to the third time may be obtained.

然后检测第三时刻对应的时间戳和第四时刻对应的时间戳之间的时长或时间差是否超过预先设置的第二时长。其中,第二时长可以根据实际需求确定,例如可以是1分钟或30秒等,在此不作具体限定。Then, it is detected whether the duration or time difference between the timestamp corresponding to the third moment and the timestamp corresponding to the fourth moment exceeds a preset second duration. The second duration can be determined according to actual needs, for example, 1 minute or 30 seconds, etc., which is not specifically limited here.

如果超过第二时长,说明目标设备的当前状态信息为无效信息,然后将目标设备的上一状态信息更新为未知状态;如果没有超过第一时长,说明目标设备的当前状态信息为有效信息,然后将目标设备的上一状态信息更新目标设备的当前状态信息。If it exceeds the second time length, it means that the current status information of the target device is invalid information, and then the previous status information of the target device is updated to an unknown status; if it does not exceed the first time length, it means that the current status information of the target device is valid information, and then the previous status information of the target device is updated to the current status information of the target device.

本发明提供的接口数据处理方法,通过将目标设备的当前状态信息的更新时刻与目标设备的上一状态信息的更新时刻进行校验,在第三时刻与第四时刻之间的时长不超过第二时长的情况下,才会更新目标设备的上一状态信息,可以保证设备状态信息的时效性,从而避免使用过期的设备状态信息参与状态计算推导出错误的结果。The interface data processing method provided by the present invention verifies the update time of the current status information of the target device with the update time of the previous status information of the target device. The previous status information of the target device will be updated only when the duration between the third moment and the fourth moment does not exceed the second duration. This can ensure the timeliness of the device status information, thereby avoiding using expired device status information to participate in status calculations to derive erroneous results.

在一些实施例中,基于第一虚拟设备的当前状态信息,确定目标设备的当前状态信息之后,接口数据处理方法还包括:In some embodiments, after determining the current state information of the target device based on the current state information of the first virtual device, the interface data processing method further includes:

基于目标设备的当前状态信息,更新状态字典。Update the state dictionary based on the current state information of the target device.

可以理解的是,在获取目标设备的当前状态信息之后,可以将标设备的当前状态信息作为最新状态信息,在状态字典中更新所有目标参数的状态值。It is understandable that after obtaining the current state information of the target device, the current state information of the target device can be used as the latest state information to update the state values of all target parameters in the state dictionary.

本发明提供的接口数据处理方法,可以保证状态字典的时效性,提高接口数据处理的准确性。The interface data processing method provided by the present invention can ensure the timeliness of the state dictionary and improve the accuracy of interface data processing.

在一些实施例中,基于第一虚拟设备的当前状态信息,确定目标设备的当前状态信息之后,接口数据处理方法还包括:In some embodiments, after determining the current state information of the target device based on the current state information of the first virtual device, the interface data processing method further includes:

基于目标设备的当前状态信息和目标设备的上一状态信息,判断目标设备的状态信息是否变化;Based on the current status information of the target device and the previous status information of the target device, determining whether the status information of the target device has changed;

在目标设备的状态信息变化的情况下,确定设备变化信息和报警信息中的一种或多种信息。When the state information of the target device changes, one or more of the device change information and the alarm information is determined.

可以理解的是,可以将目标设备的当前状态信息和目标设备的上一状态信息对比,确定目标设备的状态信息的变化情况。It is understandable that the current state information of the target device may be compared with the previous state information of the target device to determine the change in the state information of the target device.

如有目标设备的状态信息变化,则可以确定设备变化信息和报警信息一种或多种信息。If the status information of the target device changes, one or more types of information, including device change information and alarm information, can be determined.

在实际执行中,接口转换程序判断聚合设备(目标设备)的状态值有变化后,生成设备变化信息存入缓存队列中。In actual execution, after the interface conversion program determines that the state value of the aggregation device (target device) has changed, it generates device change information and stores it in the cache queue.

后续将缓存队列中的设备变化信息按约定格式生成JSON信息发送给前端卡夫卡接口,同时根据用户配置要求生成报警信息发送给前端卡夫卡接口。接口程序计算聚合设备的状态值是按数据顺序进行计算的,所以参与聚合设备状态计算的目标参数和目标参数对应的状态信息都可以是聚合设备的状态值。这样,就可以简化复杂设备状态的计算过程,提高接口计算的效率。Subsequently, the device change information in the cache queue is generated into JSON information in the agreed format and sent to the front-end Kafka interface. At the same time, alarm information is generated according to user configuration requirements and sent to the front-end Kafka interface. The interface program calculates the state value of the aggregated device in data order, so the target parameters involved in the calculation of the aggregated device state and the state information corresponding to the target parameters can all be the state value of the aggregated device. In this way, the calculation process of complex device states can be simplified and the efficiency of interface calculation can be improved.

接口转换程序可以读取缓存的设备列表,使用设备的KEY值和设备的序列化值(设备类的内部属性值__dict__)存入REDIS高速缓存数据库中。The interface conversion program can read the cached device list and store it in the REDIS cache database using the device's KEY value and the device's serialized value (the internal attribute value __dict__ of the device class).

设备类对应用户需要显示的单独元素,包含该设备的相关数据:设备的ID号、SN值、KEY值、局码、站码、设备名称、设备类型、设备子类型、设备的状态值、设备的类型值和设备状态最新时间戳。其中,设备状态值通常为一个字典,包含目标被所有相关虚拟设备和本目标设备的状态值。设备ID号为设备的16位数字编码(不同的设备编码不同),KEY值为接口程序标记“state:org:ats:”+设备的ID号。The device class corresponds to a separate element that the user needs to display, and contains the relevant data of the device: device ID number, SN value, KEY value, bureau code, station code, device name, device type, device subtype, device status value, device type value and the latest timestamp of the device status. Among them, the device status value is usually a dictionary, which contains the status values of all related virtual devices and the target device. The device ID number is the 16-digit code of the device (different devices have different codes), and the KEY value is the interface program mark "state:org:ats:" + the device ID number.

由于用户配置转换需求变更导致更新程序或配置等原因,接口转换程序重启载入相关配置后,首先从REDIS高速缓存数据库读取设备状态信息,并反序列化至对应的设备类中。恢复设备状态信息时,还需要检查时间戳判断设备状态是否超过规定的时间,如超时则将对应的设备状态置为未知状态。Due to the change of user configuration conversion requirements, the program or configuration is updated. After the interface conversion program is restarted and the relevant configuration is loaded, the device status information is first read from the REDIS cache database and deserialized to the corresponding device class. When restoring the device status information, it is also necessary to check the timestamp to determine whether the device status exceeds the specified time. If it times out, the corresponding device status is set to an unknown state.

这样就可以有效的避免接口程序升级或修改配置造成错误生成设备状态信息和报警信息。设备状态信息的计算是需要之前的状态信息参与,只要该设备状态信息更新的时间不超标该设备的状态信息就是可信的。例如:由于ATS数据接口能确保1分钟内更新所有信息的状态,所以超时的时间值暂定为3分钟。This can effectively avoid the error in generating device status information and alarm information due to interface program upgrade or configuration modification. The calculation of device status information requires the participation of previous status information. As long as the device status information update time does not exceed the standard, the device status information is reliable. For example: Since the ATS data interface can ensure that all information status is updated within 1 minute, the timeout value is temporarily set to 3 minutes.

接口转换程序读取缓存的变更设备列表,将设备相关信息按照确定的格式生成JSON数据并发送至卡夫卡接口,用于前端设备显示。生成接口所需要的设备信息都已暂存在设备类的成员中,转换信息时需要检查设备的状态是否为未知状态,如果为未知状态需要修改设备的时间戳为接口转换程序的当前时间,否则可直接使用设备状态信息更新时暂存的时间戳。The interface conversion program reads the cached list of changed devices, generates JSON data with the device-related information in a certain format, and sends it to the Kafka interface for front-end device display. The device information required to generate the interface is temporarily stored in the members of the device class. When converting information, it is necessary to check whether the device status is unknown. If it is unknown, the device timestamp needs to be modified to the current time of the interface conversion program. Otherwise, the timestamp temporarily stored when the device status information is updated can be used directly.

报警信息的生成和恢复与设备状态绑定,按照用户配置转换要求生成。通常是设备状态有变化且当前状态为故障或报警,生成报警信息,如果该设备状态有变化且当前状态为正常,如果能查询到缓存的报警信息有这条报警,则处理该报警信息为恢复并从缓存的报警信息列表中删除。报警信息生成或报警信息恢复均按照约定生成对应的JSON数据发送给卡夫卡接口用于前端程序显示。The generation and recovery of alarm information is bound to the device status and is generated according to the user configuration conversion requirements. Usually, the device status changes and the current status is a fault or alarm, and an alarm message is generated. If the device status changes and the current status is normal, if the cached alarm information can be queried with this alarm, the alarm information is processed as recovery and deleted from the cached alarm information list. Alarm information generation or alarm information recovery generates corresponding JSON data according to the agreement and sends it to the Kafka interface for front-end program display.

设备转换JSON配置文件示例如下The following is an example of a device conversion JSON configuration file:

设备状态信息JSON数据示例如下:The following is an example of device status information JSON data:

设备报警信息JSON数据示例如下:The following is an example of the device alarm information JSON data:

{{

"id":"f4227abace0d11ed9bbd4889e79c57b0","id":"f4227abace0d11ed9bbd4889e79c57b0",

"line_code":5,"line_code":5,

"line_name":"5号线","line_name":"Line 5",

"area_type":0,"area_type":0,

"area_code":98","area_code":98",

"area_name":"XXXX站","area_name":"XXXX Station",

"dev_id":"0xffff05000203000b","dev_id":"0xffff05000203000b",

"dev_name":"YGBLZ-app-server-wireA","dev_name":"YGBLZ-app-server-wireA",

"dev_type":"ATS","dev_type":"ATS",

"module_name":"接口单元与非安全网A通信中断”"module_name":"Communication between the interface unit and non-safety network A is interrupted"

"alarm_type":1,"alarm_type":1,

"alarm_subtype":1,"alarm_subtype":1,

"summary_info":"通信故障","summary_info":"Communication failure",

"detail_contentr":"接口单元与非安全网A通信中断","detail_contentr":"Communication between the interface unit and non-safety network A is interrupted",

"sugg_operation":"检查非安全网交换机及对应网线连接、接口单元硬件及进程状态","sugg_operation":"Check the non-safe network switch and corresponding network cable connection, interface unit hardware and process status",

"forward_id":0,"forward_id":0,

"backward_id":0,"backward_id":0,

"alarm_state":1,"alarm_state":1,

"alarm_time":"2023-03-29 16:42:14.353","alarm_time":"2023-03-29 16:42:14.353",

"gmt_create":"2023-03-29 16:44:44.415","gmt_create":"2023-03-29 16:44:44.415",

"recover_mode":0,"recover_mode":0,

"alarm_rate":0,"alarm_rate":0,

"nrecover_time":nul1,"nrecover_time":nul1,

"alarm_level":"二级报警"alarm_level":"Second level alarm

}}

下面结合实际应用场景对本发明提供的接口数据处理方法进行说明。The interface data processing method provided by the present invention is described below in conjunction with actual application scenarios.

接口转换程序已成功运用与某地铁5号线的智能运维系统中,运行稳定可靠,转换数据灵活方便。The interface conversion program has been successfully used in the intelligent operation and maintenance system of a certain subway line 5. It runs stably and reliably, and the data conversion is flexible and convenient.

某地铁5号线智能运维与ATS维护的接口数据量大概为6秒内三帧数据,大概150-180kb,解析后的数据大概有23000-26000行。由于这部分数据是变化数据,大概60秒接口数据能全部更新一遍,所以输入数据估算为23万-26万行的规模。The interface data volume of intelligent operation and maintenance of a subway line 5 and ATS maintenance is about three frames of data within 6 seconds, about 150-180kb, and the parsed data is about 23,000-26,000 rows. Since this part of the data is change data, the interface data can be completely updated in about 60 seconds, so the input data is estimated to be 230,000-260,000 rows.

目前接口需要计算的设备状态有90个左右,部分设备的状态值需要多达24个虚拟设备参与计算,一个虚拟设备的状态可能需要几个参数参与计算,部分设备需要其他设备级联计算推导,所以接口实时计算的数量是比较大的。Currently, there are about 90 device states that need to be calculated by the interface. The state values of some devices require up to 24 virtual devices to participate in the calculation. The state of a virtual device may require several parameters to participate in the calculation. Some devices require cascade calculation and derivation of other devices, so the number of real-time calculations of the interface is relatively large.

接口转换程序使用PYTHON编码,运行在LINUX专用服务器上,已稳定运行半年。通过分析日志文件,解析接口程序取到数据后处理耗时均在10ms内完成,转换接口程序读到数据后处理耗时也均在10ms左右,接口程序还有很大的性能余量。接口程序未取到数据时会等待一小段时间,具体可配置。查看LINUX服务器上接口程序进程的CUP占用率和内存占用率,参数均为0.0%,接口程序的资源占用也非常优秀。The interface conversion program uses PYTHON coding and runs on a dedicated LINUX server. It has been running stably for half a year. By analyzing the log files, the processing time of the parsing interface program after obtaining the data is completed within 10ms, and the processing time of the conversion interface program after reading the data is also around 10ms. The interface program still has a lot of performance margin. When the interface program does not obtain the data, it will wait for a short period of time, which can be configured. Check the CPU occupancy rate and memory occupancy rate of the interface program process on the LINUX server. The parameters are all 0.0%, and the resource occupancy of the interface program is also very good.

后续该接口转换程序还将在多条线路的智能运维系统中使用,为城市轨道交通智能运维奠定了一个坚实的基础。Subsequently, this interface conversion program will also be used in the intelligent operation and maintenance systems of multiple lines, laying a solid foundation for the intelligent operation and maintenance of urban rail transit.

本发明提供的接口数据处理方法,接口数据处理的效率高,能够实时处理大量的接口数据;能支持处理变化类接口输入,适应大数据处理的要求;分层处理设备状态,极大地简化的设备状态规则编写的要求,同时也大大减少了重复计算的可能;设备状态有时效性管理,有效避免使用过期的设备状态参与计算推导出错误的结果;设备状态更新时实时缓存至REDIS高速缓存数据库中,确保接口程序及配置升级时能同步设备的既有状态值。The interface data processing method provided by the present invention has high efficiency in interface data processing and can process a large amount of interface data in real time; it can support processing of change interface input and adapt to the requirements of big data processing; it processes device status in layers, greatly simplifies the requirements for writing device status rules, and also greatly reduces the possibility of repeated calculations; the device status has time-limited management, effectively avoiding the use of expired device status to participate in calculations to derive erroneous results; the device status is cached in real time in the REDIS cache database when it is updated, ensuring that the existing status value of the device can be synchronized when the interface program and configuration are upgraded.

图2是本发明提供的接口数据处理方法的流程示意图之二。参照图2,本发明提供的接口数据处理方法包括:FIG2 is a second flow chart of the interface data processing method provided by the present invention. Referring to FIG2 , the interface data processing method provided by the present invention includes:

步骤1:读取卡夫卡接口获取接口数据;Step 1: Read the Kafka interface to obtain interface data;

步骤2:对接口数据进行扁平化处理,得到处理后的接口数据;Step 2: Flatten the interface data to obtain processed interface data;

步骤3:遍历所有转换规则数据Step 3: Traverse all transformation rule data

步骤4:使用当前转换规则的设备ID找到对应的目标设备;Step 4: Use the device ID of the current conversion rule to find the corresponding target device;

步骤5:使用当前转换规则计算出目标设备的当前状态字典;Step 5: Calculate the current state dictionary of the target device using the current conversion rule;

步骤6:判断目标设备的当前状态字典是否为空,若当前状态字典为空,使用聚合规则计算出当前设备的聚合状态,若聚合状态不为空,将聚合状态存入设备状态字典中;若当前状态字典不为空,则判断设备状态信息是否超时;Step 6: Determine whether the current state dictionary of the target device is empty. If the current state dictionary is empty, use the aggregation rule to calculate the aggregate state of the current device. If the aggregate state is not empty, store the aggregate state in the device state dictionary. If the current state dictionary is not empty, determine whether the device state information has timed out.

步骤7:若未超时,将设备状态信息对应的时间赋值给设备时间;Step 7: If it is not timed out, assign the time corresponding to the device status information to the device time;

步骤8:在设备状态变化的情况下,将设备新状态赋值给目标设备,并将该设备存入更新设备列表中。Step 8: When the device status changes, assign the new device status to the target device and store the device in the updated device list.

本发明提供的接口数据处理方法的关键点在于:The key points of the interface data processing method provided by the present invention are:

一、接口解析数据后将信息按照字典嵌套的方式存储,自动提取信息的部分内容作为键值,将队列中的元素均按字典存入;字典嵌套的信息扁平化后,转换计算时可以快速获取参与计算的参数,极大提高接口数据处理的效率;1. After parsing the data, the interface stores the information in a dictionary-nested manner, automatically extracts part of the information as key values, and stores all elements in the queue in a dictionary. After the dictionary-nested information is flattened, the parameters involved in the calculation can be quickly obtained during the conversion calculation, greatly improving the efficiency of interface data processing.

二、分层计算设备状态并缓存,同时使接口程序以较小的内存开销,有效处理变化类大数据接口的数据;分层计算设备状态也极大地简化了设备计算规则编制的难度;Second, the device status is calculated and cached in layers, which enables the interface program to effectively process the data of the changing big data interface with a small memory overhead; the hierarchical calculation of device status also greatly simplifies the difficulty of compiling device calculation rules;

三、设备状态更新有时间戳记录,每周期均校验设备状态的时效性,如超时则修改设备状态为未知,避免使用过期的设备状态参与计算推导出错误的结果;3. The device status update is recorded with a timestamp. The timeliness of the device status is verified every cycle. If it times out, the device status is modified to unknown to avoid using expired device status to participate in calculations and derive erroneous results;

四、设备的相关状态信息变更时均存入高速缓存REDIS,现场接口程序和配置的变更升级时(接口程序短时间内重启)可读取到缓存的设备状态信息,就不会由于缺少既有设备状态而错误生成的设备状态变化信息和报警信息。4. When the relevant status information of the equipment changes, it is stored in the high-speed cache REDIS. When the on-site interface program and configuration are changed and upgraded (the interface program is restarted in a short time), the cached equipment status information can be read, so the equipment status change information and alarm information will not be erroneously generated due to the lack of existing equipment status.

下面对本发明提供的接口数据处理装置进行描述,下文描述的接口数据处理装置与上文描述的接口数据处理方法可相互对应参照。The interface data processing device provided by the present invention is described below. The interface data processing device described below and the interface data processing method described above can be referenced to each other.

图3为本发明提供的接口数据处理装置的结构示意图。参照图3,本发明提供的接口数据处理装置包括:FIG3 is a schematic diagram of the structure of the interface data processing device provided by the present invention. Referring to FIG3, the interface data processing device provided by the present invention includes:

第一确定模块310,用于确定目标设备的所有目标参数,所述目标参数用于指示与所述目标设备的状态计算相关的参数;A first determination module 310, configured to determine all target parameters of a target device, wherein the target parameters are used to indicate parameters related to the state calculation of the target device;

第二确定模块320,用于在所述目标设备对应的状态字典中存在至少部分目标参数的情况下,基于所述至少部分目标参数,确定所述目标设备对应的第一虚拟设备的当前状态信息,所述状态字典基于序列化处理后的接口数据构建;A second determination module 320 is configured to determine, when at least part of the target parameters exist in a state dictionary corresponding to the target device, current state information of a first virtual device corresponding to the target device based on the at least part of the target parameters, the state dictionary being constructed based on the serialized interface data;

第三确定模块330,用于基于所述第一虚拟设备的当前状态信息,确定所述目标设备的当前状态信息。The third determination module 330 is configured to determine the current state information of the target device based on the current state information of the first virtual device.

本发明提供的接口数据处理装置,通过将接口数据转换为状态字典,可以快速获取与目标设备状态计算的至少部分参数,极大提高接口数据处理的效率,进而可以根据至少部分目标参数,确定对应的第一虚拟设备的状态信息,再计算目标设备的状态信息,实现设备状态的分层计算,可以以较小的内存开销,有效处理变化类大数据接口的数据;分层计算设备状态也极大地简化了设备状态计算规则编制的难度。The interface data processing device provided by the present invention can quickly obtain at least part of the parameters for calculating the target device state by converting the interface data into a state dictionary, thereby greatly improving the efficiency of interface data processing. Furthermore, the state information of the corresponding first virtual device can be determined based on at least part of the target parameters, and then the state information of the target device can be calculated to achieve hierarchical calculation of the device state. The data of the changing big data interface can be effectively processed with a small memory overhead; hierarchical calculation of the device state also greatly simplifies the difficulty of compiling device state calculation rules.

在一些实施例中,所述装置还包括:In some embodiments, the apparatus further comprises:

第一状态更新模块,用于所述基于所述至少部分目标参数,确定所述目标设备对应的第一虚拟设备的当前状态信息之后,在第一时刻与第二时刻之间的时长不超过第一时长的情况下,确定所述第一虚拟设备的当前状态信息为有效信息,所述第二时刻早于所述第一时刻,所述第一时刻为所述第一虚拟设备的当前状态信息的更新时刻,所述第二时刻为所述第一虚拟设备的上一状态信息的更新时刻;A first state updating module, configured to determine, after determining the current state information of the first virtual device corresponding to the target device based on at least part of the target parameters, that the current state information of the first virtual device is valid information if the duration between the first moment and the second moment does not exceed the first duration, the second moment is earlier than the first moment, the first moment is the update moment of the current state information of the first virtual device, and the second moment is the update moment of the previous state information of the first virtual device;

将所述第一虚拟设备的上一状态信息更新为所述虚拟设备的当前状态信息。The previous state information of the first virtual device is updated as the current state information of the virtual device.

在一些实施例中,所述第三确定模块330,具体用于:In some embodiments, the third determination module 330 is specifically configured to:

基于所述第一虚拟设备的当前状态信息,确定所述目标设备的中间状态信息;Determining intermediate state information of the target device based on current state information of the first virtual device;

基于所述所有目标参数中除所述至少部分目标参数之外的参数,确定所述目标设备对应的第二虚拟设备的当前状态信息;Determine current state information of a second virtual device corresponding to the target device based on parameters other than the at least part of the target parameters among all the target parameters;

基于所述中间状态信息和所述第二虚拟设备的当前状态信息,确定所述目标设备的当前状态信息。Based on the intermediate state information and the current state information of the second virtual device, the current state information of the target device is determined.

在一些实施例中,所述装置还包括:In some embodiments, the apparatus further comprises:

第二状态更新模块,用于所述基于所述第一虚拟设备的当前状态信息,确定所述目标设备的当前状态信息之后,在第三时刻与第四时刻之间的时长不超过第二时长的情况下,确定所述目标设备的当前状态信息为有效信息,所述第四时刻早于所述第三时刻,所述第三时刻为所述目标设备的当前状态信息的更新时刻,所述第四时刻为所述目标设备的上一状态信息的更新时刻;A second state updating module is configured to determine, after determining the current state information of the target device based on the current state information of the first virtual device, that the current state information of the target device is valid information if the duration between a third moment and a fourth moment does not exceed a second duration, the fourth moment is earlier than the third moment, the third moment is an update moment of the current state information of the target device, and the fourth moment is an update moment of the previous state information of the target device;

将所述目标设备的上一状态信息更新为所述目标设备的当前状态信息。The previous state information of the target device is updated as the current state information of the target device.

在一些实施例中,所述装置还包括:In some embodiments, the apparatus further comprises:

字典更新模块,用于所述基于所述第一虚拟设备的当前状态信息,确定所述目标设备的当前状态信息之后,基于所述目标设备的当前状态信息,更新所述状态字典。The dictionary updating module is used to update the state dictionary based on the current state information of the target device after determining the current state information of the target device based on the current state information of the first virtual device.

在一些实施例中,所述装置还包括:In some embodiments, the apparatus further comprises:

第四确定模块,用于所述基于所述第一虚拟设备的当前状态信息,确定所述目标设备的当前状态信息之后,基于所述目标设备的当前状态信息和所述目标设备的上一状态信息,判断所述目标设备的状态信息是否变化;A fourth determination module, configured to determine whether the state information of the target device has changed based on the current state information of the target device and the previous state information of the target device after determining the current state information of the target device based on the current state information of the first virtual device;

在所述目标设备的状态信息变化的情况下,确定设备变化信息和报警信息中的一种或多种信息。When the state information of the target device changes, one or more of device change information and alarm information is determined.

图4示例了一种电子设备的实体结构示意图,如图4所示,该电子设备可以包括:处理器(processor)410、通信接口(Communications Interface)420、存储器(memory)430和通信总线440,其中,处理器410,通信接口420,存储器430通过通信总线440完成相互间的通信。处理器410可以调用存储器430中的逻辑指令,以执行接口数据处理方法,该方法包括:FIG4 illustrates a schematic diagram of the physical structure of an electronic device. As shown in FIG4 , the electronic device may include: a processor 410, a communications interface 420, a memory 430, and a communication bus 440, wherein the processor 410, the communications interface 420, and the memory 430 communicate with each other via the communication bus 440. The processor 410 may call the logic instructions in the memory 430 to execute the interface data processing method, which includes:

确定目标设备的所有目标参数,所述目标参数用于指示与所述目标设备的状态计算相关的参数;Determine all target parameters of a target device, where the target parameters are used to indicate parameters related to state calculation of the target device;

在所述目标设备对应的状态字典中存在至少部分目标参数的情况下,基于所述至少部分目标参数,确定所述目标设备对应的第一虚拟设备的当前状态信息,所述状态字典基于序列化处理后的接口数据构建;In a case where at least part of the target parameters exist in a state dictionary corresponding to the target device, determining current state information of a first virtual device corresponding to the target device based on the at least part of the target parameters, the state dictionary being constructed based on the serialized interface data;

基于所述第一虚拟设备的当前状态信息,确定所述目标设备的当前状态信息。Based on the current state information of the first virtual device, the current state information of the target device is determined.

此外,上述的存储器430中的逻辑指令可以通过软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本发明的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本发明各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。In addition, the logic instructions in the above-mentioned memory 430 can be implemented in the form of a software functional unit and can be stored in a computer-readable storage medium when it is sold or used as an independent product. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program codes.

另一方面,本发明还提供一种计算机程序产品,所述计算机程序产品包括计算机程序,计算机程序可存储在非暂态计算机可读存储介质上,所述计算机程序被处理器执行时,计算机能够执行上述各方法所提供的接口数据处理方法,该方法包括:On the other hand, the present invention further provides a computer program product, the computer program product includes a computer program, the computer program can be stored in a non-transitory computer-readable storage medium, when the computer program is executed by a processor, the computer can execute the interface data processing method provided by the above methods, the method includes:

确定目标设备的所有目标参数,所述目标参数用于指示与所述目标设备的状态计算相关的参数;Determine all target parameters of a target device, where the target parameters are used to indicate parameters related to state calculation of the target device;

在所述目标设备对应的状态字典中存在至少部分目标参数的情况下,基于所述至少部分目标参数,确定所述目标设备对应的第一虚拟设备的当前状态信息,所述状态字典基于序列化处理后的接口数据构建;In a case where at least part of the target parameters exist in a state dictionary corresponding to the target device, determining current state information of a first virtual device corresponding to the target device based on the at least part of the target parameters, the state dictionary being constructed based on the serialized interface data;

基于所述第一虚拟设备的当前状态信息,确定所述目标设备的当前状态信息。Based on the current state information of the first virtual device, the current state information of the target device is determined.

又一方面,本发明还提供一种非暂态计算机可读存储介质,其上存储有计算机程序,该计算机程序被处理器执行时实现以执行上述各方法提供的接口数据处理方法,该方法包括:In another aspect, the present invention further provides a non-transitory computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the interface data processing method provided by the above methods is implemented, and the method includes:

确定目标设备的所有目标参数,所述目标参数用于指示与所述目标设备的状态计算相关的参数;Determine all target parameters of a target device, where the target parameters are used to indicate parameters related to state calculation of the target device;

在所述目标设备对应的状态字典中存在至少部分目标参数的情况下,基于所述至少部分目标参数,确定所述目标设备对应的第一虚拟设备的当前状态信息,所述状态字典基于序列化处理后的接口数据构建;In a case where at least part of the target parameters exist in a state dictionary corresponding to the target device, determining current state information of a first virtual device corresponding to the target device based on the at least part of the target parameters, the state dictionary being constructed based on the serialized interface data;

基于所述第一虚拟设备的当前状态信息,确定所述目标设备的当前状态信息。Based on the current state information of the first virtual device, the current state information of the target device is determined.

以上所描述的装置实施例仅仅是示意性的,其中所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。本领域普通技术人员在不付出创造性的劳动的情况下,即可以理解并实施。The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Those of ordinary skill in the art may understand and implement it without creative work.

通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到各实施方式可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件。基于这样的理解,上述技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品可以存储在计算机可读存储介质中,如ROM/RAM、磁碟、光盘等,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行各个实施例或者实施例的某些部分所述的方法。Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM/RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

最后应说明的是:以上实施例仅用以说明本发明的技术方案,而非对其限制;尽管参照前述实施例对本发明进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本发明各实施例技术方案的精神和范围。Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims (10)

CN202310721086.6A2023-06-162023-06-16Interface data processing method and device, electronic equipment and mediumPendingCN116902041A (en)

Priority Applications (1)

Application NumberPriority DateFiling DateTitle
CN202310721086.6ACN116902041A (en)2023-06-162023-06-16Interface data processing method and device, electronic equipment and medium

Applications Claiming Priority (1)

Application NumberPriority DateFiling DateTitle
CN202310721086.6ACN116902041A (en)2023-06-162023-06-16Interface data processing method and device, electronic equipment and medium

Publications (1)

Publication NumberPublication Date
CN116902041Atrue CN116902041A (en)2023-10-20

Family

ID=88361825

Family Applications (1)

Application NumberTitlePriority DateFiling Date
CN202310721086.6APendingCN116902041A (en)2023-06-162023-06-16Interface data processing method and device, electronic equipment and medium

Country Status (1)

CountryLink
CN (1)CN116902041A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN117762060A (en)*2023-11-282024-03-26通号城市轨道交通技术有限公司 Regional controller intelligent operation and maintenance data interface design method and device

Citations (4)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN104798067A (en)*2012-09-182015-07-22株式会社野村综合研究所 Web server system, dictionary system, dictionary calling method, screen control display method, and demonstration application generation method
US20210279254A1 (en)*2019-05-052021-09-09Tencent Technology (Shenzhen) Company LimitedData replication method and apparatus, computer device, and storage medium
US20220019562A1 (en)*2020-07-172022-01-20Alipay (Hangzhou) Information Technology Co., Ltd.Data compression based on key-value store
US20230153287A1 (en)*2021-11-122023-05-18AirMettle, Inc.Partitioning, processing, and protecting compressed data

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN104798067A (en)*2012-09-182015-07-22株式会社野村综合研究所 Web server system, dictionary system, dictionary calling method, screen control display method, and demonstration application generation method
US20210279254A1 (en)*2019-05-052021-09-09Tencent Technology (Shenzhen) Company LimitedData replication method and apparatus, computer device, and storage medium
US20220019562A1 (en)*2020-07-172022-01-20Alipay (Hangzhou) Information Technology Co., Ltd.Data compression based on key-value store
US20230153287A1 (en)*2021-11-122023-05-18AirMettle, Inc.Partitioning, processing, and protecting compressed data

Cited By (1)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN117762060A (en)*2023-11-282024-03-26通号城市轨道交通技术有限公司 Regional controller intelligent operation and maintenance data interface design method and device

Similar Documents

PublicationPublication DateTitle
US10812333B2 (en)Microservice configuration apparatus and method
WO2021151312A1 (en)Method for determining inter-service dependency, and related apparatus
CN114090366B (en) Method, device and system for monitoring data
CN112988485B (en) Simulation test methods and devices for power Internet of Things equipment
CN111966289B (en)Partition optimization method and system based on Kafka cluster
US9590885B1 (en)System and method of calculating and reporting of messages expiring from a queue
US11799750B1 (en)Systems and methods for HPACK table restoration
CN118174449A (en)Adaptation method, system, equipment and medium of electric power Internet of things operation system and electric power system
CN113656239A (en)Monitoring method and device for middleware and computer program product
CN116902041A (en)Interface data processing method and device, electronic equipment and medium
CN113360258A (en)Data processing method and device, electronic equipment and storage medium
CN113656252B (en)Fault positioning method, device, electronic equipment and storage medium
CN115473910A (en) Data management method and device, electronic device and storage medium
CN114612212A (en)Business processing method, device and system based on risk control
CN117632652A (en)Recording system, method, equipment and storage medium of browser
CN114003566B (en)Resource acquisition method, resource acquisition device, storage medium and electronic equipment
CN117544697A (en) A big data access method for earthquake industry protocol adaptation and scheduling
EP4332776A1 (en)Network fault analysis method and apparatus, and device and storage medium
CN115695587A (en)Service data processing system, method, device and storage medium
CN115914376B (en) Internet of Things data processing method, device, equipment and computer-readable storage medium
CN117076185B (en)Server inspection method, device, equipment and medium
CN118869807B (en) A cross-service message conversion method, device, equipment and storage medium
CN118484497A (en)Data synchronization method, device, equipment and medium applied to distributed system
CN114064391A (en)Distributed alarm or event information processing method and device
CN117539719A (en)Application operation monitoring method, device, equipment and medium

Legal Events

DateCodeTitleDescription
PB01Publication
PB01Publication
SE01Entry into force of request for substantive examination
SE01Entry into force of request for substantive examination

[8]ページ先頭

©2009-2025 Movatter.jp