Movatterモバイル変換


[0]ホーム

URL:


CN102301764A - Terminal distribution information acquisition method, data acquisition device and communication system - Google Patents

Terminal distribution information acquisition method, data acquisition device and communication system
Download PDF

Info

Publication number
CN102301764A
CN102301764ACN2011800015266ACN201180001526ACN102301764ACN 102301764 ACN102301764 ACN 102301764ACN 2011800015266 ACN2011800015266 ACN 2011800015266ACN 201180001526 ACN201180001526 ACN 201180001526ACN 102301764 ACN102301764 ACN 102301764A
Authority
CN
China
Prior art keywords
data
message
terminal
distribution information
protocol
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2011800015266A
Other languages
Chinese (zh)
Inventor
布丕库马尔杰恩
王绍宇
陈飞
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co LtdfiledCriticalHuawei Technologies Co Ltd
Publication of CN102301764ApublicationCriticalpatent/CN102301764A/en
Pendinglegal-statusCriticalCurrent

Links

Images

Classifications

Landscapes

Abstract

The invention provides a terminal distribution information acquisition method, a data acquisition device and a communication system, wherein the acquisition method comprises the following steps: sending a request message carrying a pre-analyzed data message to a deep data packet detection device; receiving a response message carrying protocol analysis data returned by the deep data packet detection device, wherein the protocol analysis data comprises a type identifier of a terminal sending the data message, a protocol type of the data message and a service flow value corresponding to the protocol type; and sending a notification message carrying the protocol analysis data to a data aggregation device so that the data processing module generates terminal distribution information of each type of terminal according to the protocol analysis data in an aggregation manner, wherein the terminal distribution information comprises each type of terminal and a flow statistic value corresponding to each type of terminal in a specific time period. According to the technical scheme, the statistical efficiency of terminal distribution information statistics can be improved, and the accuracy of statistical results is improved.

Description

Translated fromChinese
终端分布信息获取方法、数据获取装置以及通信系统Terminal distribution information acquisition method, data acquisition device and communication system

技术领域technical field

本发明涉及通信技术领域,尤其涉及一种终端分布信息获取方法、数据获取装置以及通信系统。The present invention relates to the technical field of communication, and in particular to a terminal distribution information acquisition method, a data acquisition device and a communication system.

背景技术Background technique

深度数据包检测(Deep Packet Inspection,以下简称:DPI)技术不仅能够如同普通报文检测一样,分析出IP数据包中的源地址、目的地址、源端口、目的端口以及协议类型,而且还增加了应用层分析,能够高效的识别出网络上的各种应用及其内容,Deep Packet Inspection (hereinafter referred to as: DPI) technology can not only analyze the source address, destination address, source port, destination port and protocol type in the IP data packet like ordinary packet inspection, but also adds Application layer analysis can efficiently identify various applications and their content on the network,

普通报文检测是通过端口号来识别应用类型的,如检测到端口号为80时,则认为该应用代表着普通上网应用。而当前网络上的一些非法应用会采用隐藏或假冒端口号的方式躲避检测和监管,造成仿冒合法报文的数据流侵蚀着网络。此时普通报文检测方法就无能为力了。DPI技术就是通过对应用流中的数据报文内容进行探测,从而确定数据报文的真正应用。Ordinary message detection identifies the application type through the port number. If the detected port number is 80, it is considered that the application represents a common Internet application. However, some illegal applications on the current network hide or forge port numbers to evade detection and supervision, causing the data flow of counterfeit legal packets to erode the network. At this time, the ordinary packet detection method is powerless. The DPI technology detects the content of the data message in the application flow to determine the real application of the data message.

商业智能(Business Intelligence,以下简称:BI)技术是企业将现有的数据转化为信息和知识的技术,该技术实质上是数据仓库、联机分析处理和数据挖掘等技术的综合运用,能够为企业提供一个实时的数据分析系统,帮助企业提高运营水平。Business intelligence (Business Intelligence, hereinafter referred to as: BI) technology is a technology for enterprises to convert existing data into information and knowledge. Provide a real-time data analysis system to help companies improve their operations.

例如,对于通信运营商和手机终端厂商而言,随着网络技术的不断演进,需要统计指定地区当前流行的手机终端设备,以及该类手机终端设备的网络使用情况,也可称为是对终端分布信息进行统计。现有技术中队上述信息的统计是由通信运营商从网络管理系统,业务运营支撑系统(Business & Operation Support System,以下简称:BOSS)中导出用户话单,或者消费记录后进行人工统计分析的方式获取。现有技术中存在的对手机等终端的分布信息进行统计的方式普遍存在统计效率低的缺陷,同时其统计结果的精度也较低。For example, for communication operators and mobile phone terminal manufacturers, with the continuous evolution of network technology, it is necessary to make statistics on the current popular mobile terminal equipment in designated areas, as well as the network usage of such mobile terminal equipment, which can also be called as "pair terminal". Distribution information for statistics. In the prior art, the statistics of the above-mentioned information of the squadron is carried out by the communication operator from the network management system, the business operation support system (Business & Operation Support System, hereinafter referred to as: BOSS) to export the user bill, or the way of manual statistical analysis after the consumption record Obtain. The method of collecting statistics on the distribution information of terminals such as mobile phones in the prior art generally has the defect of low statistical efficiency, and at the same time, the precision of the statistical results is also low.

发明内容Contents of the invention

本发明实施例提供一种终端分布信息获取方法、数据获取装置以及通信系统,以及数据汇聚装置,用以提高对终端分布信息进行统计时的统计效率,同时提高统计结果的精度。Embodiments of the present invention provide a terminal distribution information acquisition method, a data acquisition device, a communication system, and a data aggregation device, which are used to improve the statistical efficiency of terminal distribution information and improve the accuracy of statistical results.

本发明实施例提供了一种终端分布信息获取方法,包括:An embodiment of the present invention provides a method for acquiring terminal distribution information, including:

向深度数据包检测装置发送携带预解析的数据报文的请求消息,所述请求消息用于指示深度数据包检测装置对所述数据报文进行协议解析;Sending a request message carrying a pre-analyzed data packet to the deep packet inspection device, where the request message is used to instruct the deep packet inspection device to perform protocol analysis on the data packet;

接收所述深度数据包检测装置返回的携带协议解析数据的响应消息,所述协议解析数据包括发送所述数据报文的终端的类型标识、所述数据报文的协议类型以及对应该协议类型的业务流量值;Receiving a response message carrying protocol analysis data returned by the deep packet inspection device, the protocol analysis data including the type identifier of the terminal sending the data message, the protocol type of the data message, and the corresponding protocol type Business flow value;

向数据汇聚装置发送携带所述协议解析数据的通知消息,以使所述数据处理模块根据所述协议解析数据汇聚生成各类型终端的终端分布信息,所述终端分布信息包括各类型终端及其对应的特定时间段内的流量统计值。Sending a notification message carrying the protocol analysis data to the data aggregation device, so that the data processing module generates terminal distribution information of various types of terminals according to the aggregation of the protocol analysis data, and the terminal distribution information includes various types of terminals and their corresponding terminals. Traffic statistics for a specific period of time.

本发明实施例还提供了一种终端分布信息获取方法,包括:The embodiment of the present invention also provides a terminal distribution information acquisition method, including:

接收数据获取装置发送的携带对数据报文解析获得的协议解析数据的通知消息,所述协议解析数据包括发送所述数据报文的终端的类型标识、所述数据报文的协议类型以及对应该协议类型的业务流量值;receiving the notification message sent by the data acquisition device and carrying the protocol analysis data obtained by parsing the data message, the protocol analysis data including the type identifier of the terminal sending the data message, the protocol type of the data message and the corresponding The business flow value of the protocol type;

根据接收到的各个数据获取装置反馈的所述协议解析数据汇聚生成各类型终端的终端分布信息,所述终端分布信息包括各类型终端及其对应的特定时间段内的流量统计值。Terminal distribution information of various types of terminals is aggregated and generated according to the received protocol analysis data fed back by each data acquisition device, and the terminal distribution information includes various types of terminals and their corresponding traffic statistics within a specific time period.

本发明实施例还提供了一种数据获取装置,包括:The embodiment of the present invention also provides a data acquisition device, including:

第一发送模块,用于向深度数据包检测装置发送携带预解析的数据报文的请求消息,所述请求消息用于指示深度数据包检测装置对所述数据报文进行协议解析;The first sending module is configured to send a request message carrying a pre-analyzed data message to the deep data packet inspection device, and the request message is used to instruct the deep data packet inspection device to perform protocol analysis on the data message;

第一接收模块,用于接收所述深度数据包检测装置返回的携带协议解析数据的响应消息,所述协议解析数据包括发送所述数据报文的终端的类型标识、所述数据报文的协议类型以及对应该协议类型的业务流量值;A first receiving module, configured to receive a response message carrying protocol analysis data returned by the deep packet inspection device, the protocol analysis data including the type identifier of the terminal sending the data message, the protocol of the data message type and the service flow value corresponding to the protocol type;

第二发送模块,用于向数据汇聚装置发送携带所述协议解析数据的通知消息,以使所述数据处理模块根据所述协议解析数据汇聚生成各类型终端的终端分布信息。The second sending module is configured to send a notification message carrying the protocol analysis data to the data aggregation device, so that the data processing module aggregates and generates terminal distribution information of various types of terminals according to the protocol analysis data.

本发明实施例还提供了一种数据汇聚装置,包括:The embodiment of the present invention also provides a data aggregation device, including:

第二接收模块,用于接收数据获取装置发送的对数据报文解析获得的携带协议解析数据的通知消息,所述协议解析数据包括发送所述数据报文的终端的类型标识、所述数据报文的协议类型以及对应该协议类型的业务流量值;The second receiving module is configured to receive a notification message carrying protocol analysis data obtained by analyzing the data message sent by the data acquisition device, and the protocol analysis data includes the type identifier of the terminal sending the data message, the data message The protocol type of the document and the service flow value corresponding to the protocol type;

第二获取模块,用于根据各个数据获取装置反馈的所述协议解析数据汇聚生成各类型终端的终端分布信息,所述终端分布信息包括终端类型及其对应的特定时间段内的流量统计值。The second acquisition module is configured to aggregate and generate terminal distribution information of various types of terminals according to the protocol analysis data fed back by each data acquisition device, and the terminal distribution information includes terminal types and corresponding traffic statistics values within a specific time period.

本发明实施例还提供了一种通信系统,包括设置有上述的数据获取装置的服务GRPS支持节点和设置有上述的数据汇聚装置的商务智能系统。An embodiment of the present invention also provides a communication system, including a service GRPS support node provided with the above-mentioned data acquisition device and a business intelligence system provided with the above-mentioned data convergence device.

本发明上述实施例提供的终端分布信息获取方法、数据汇聚装置、数据获取装置以及通信系统,其中可以由数据获取装置将终端发送给服务器的数据报文,发送给DPI装置进行协议解析,以获发送数据报文的终端的类型标识,数据报文的协议类型,以及业务流量值等信息,通过进一步的将上述信息发送给数据汇聚装置进行汇聚,即可统计获得各类型终端及其对应的特定时间段内的流量统计值,能够提高对终端分布信息进行统计时的统计效率,同时提高统计结果的精度。The terminal distribution information acquisition method, data aggregation device, data acquisition device, and communication system provided by the above embodiments of the present invention, wherein the data acquisition device can send the data message sent by the terminal to the server to the DPI device for protocol analysis to obtain The type identification of the terminal sending the data message, the protocol type of the data message, and the service flow value and other information can be statistically obtained by further sending the above information to the data aggregation device for aggregation. The traffic statistical value in the time period can improve the statistical efficiency when collecting statistics on the terminal distribution information, and at the same time improve the accuracy of the statistical results.

附图说明Description of drawings

为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作一简单地介绍,显而易见地,下面描述中的附图是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description These are some embodiments of the present invention. For those skilled in the art, other drawings can also be obtained according to these drawings without any creative effort.

图1为本发明终端分部信息获取方法实施例一的流程示意图;FIG. 1 is a schematic flow diagram ofEmbodiment 1 of a method for obtaining terminal branch information in the present invention;

图2为本发明一具体实施例的流程示意图;Fig. 2 is a schematic flow chart of a specific embodiment of the present invention;

图3为本发明实施例中DPI装置的结构示意图;FIG. 3 is a schematic structural diagram of a DPI device in an embodiment of the present invention;

图4为本发明另一具体实施例的流程示意图;Fig. 4 is a schematic flow chart of another specific embodiment of the present invention;

图5为本发明实施例中IMSI的构成示意图;FIG. 5 is a schematic diagram of the composition of an IMSI in an embodiment of the present invention;

图6为本发明实施例中IMEI的构成示意图;Figure 6 is a schematic diagram of the composition of the IMEI in the embodiment of the present invention;

图7为本发明终端分布信息获取方法实施例二的流程示意图;FIG. 7 is a schematic flowchart ofEmbodiment 2 of the terminal distribution information acquisition method of the present invention;

图8为本发明实施例中数据聚合的示意图;FIG. 8 is a schematic diagram of data aggregation in an embodiment of the present invention;

图9为本发明数据获取装置实施例的结构示意图;Fig. 9 is a schematic structural diagram of an embodiment of the data acquisition device of the present invention;

图10为本发明数据汇聚装置实施例的结构示意图。FIG. 10 is a schematic structural diagram of an embodiment of the data aggregation device of the present invention.

具体实施方式Detailed ways

为使本发明实施例的目的、技术方案和优点更加清楚,下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

本发明实施例提供了一种获取终端分布信息的技术方案,具体的可以是通信系统中设置数据获取装置以及深度数据包检测装置,实时获取各个类型的终端及其对应的业务数据流的大小,具体的可以是将上述装置在网关服务GPRS节点GGSN上,然后将其向数据汇聚装置发送,由数据汇聚装置统计获得终端分布信息。图1为本发明终端分部信息获取方法实施例一的流程示意图,如图1所示,包括如下步骤:The embodiment of the present invention provides a technical solution for acquiring terminal distribution information. Specifically, a data acquisition device and a deep data packet detection device may be set in the communication system to acquire various types of terminals and the size of their corresponding service data streams in real time. Specifically, the above-mentioned device may be installed on the gateway serving GPRS node GGSN, and then sent to the data convergence device, and the data convergence device may obtain terminal distribution information through statistics. Fig. 1 is a schematic flow chart ofEmbodiment 1 of the method for obtaining information on terminal subdivisions of the present invention, as shown in Fig. 1 , including the following steps:

步骤101、向深度数据包检测(Deep Packet Inspection,以下简称:DPI)装置发送携带预解析的数据报文的请求消息,所述请求消息用于指示DPI装置对所述IP数据包进行协议解析;Step 101, sending a request message carrying a pre-analyzed data message to a Deep Packet Inspection (Deep Packet Inspection, hereinafter referred to as: DPI) device, the request message is used to instruct the DPI device to perform protocol analysis on the IP data packet;

步骤102、接收所述D PI装置返回的携带协议解析数据的响应消息,所述协议解析数据包括发送所述数据报文的终端的类型标识、所述数据报文的协议类型以及对应该协议类型的业务流量值;Step 102, receiving the response message carrying the protocol analysis data returned by the DPI device, the protocol analysis data including the type identification of the terminal sending the data message, the protocol type of the data message and the corresponding protocol type business flow value;

步骤103、向数据汇聚装置发送携带所述协议解析数据的通知消息,以使所述数据汇聚装置根据所述协议解析数据汇聚生成各类型终端的终端分布信息,所述终端分布信息包括各类型终端及其对应的特定时间段内的流量统计值。Step 103: Send a notification message carrying the protocol analysis data to the data aggregation device, so that the data aggregation device aggregates and generates terminal distribution information of various types of terminals according to the protocol analysis data, and the terminal distribution information includes various types of terminals and its corresponding traffic statistics in a specific time period.

本发明上述实施例中的步骤,具体的可以是由设置在GGSN中的数据获取装置执行,该数据获取装置将终端发送给服务器的数据报文,发送给DPI装置进行协议解析,以获发送数据报文的终端的类型标识,数据报文的协议类型,以及业务流量值等信息,通过进一步的将上述信息发送给数据汇聚装置进行汇聚,即可统计获得各类型终端及其对应的特定时间段内的流量统计值。The steps in the above-mentioned embodiments of the present invention may specifically be performed by a data acquisition device arranged in the GGSN, and the data acquisition device sends the data message sent by the terminal to the server to the DPI device for protocol analysis to obtain the sent data The type identification of the terminal of the message, the protocol type of the data message, and the service flow value and other information, by further sending the above information to the data aggregation device for aggregation, various types of terminals and their corresponding specific time periods can be statistically obtained Traffic statistics in .

本发明上述实施例中,由于IP数据传输的特性,一个按照协议生成完整的数据报文可能被分为多个数据包传输,即上述预解析的数据报文可能是完整数据报文,或者是非完整数据报文。其中对于完整的数据报文,可以通过深度数据包检测装置一次解析获得协议解析数据,而对数据报文是非完整的数据报文的情况,上述步骤101中可以是至少两次向DPI装置发送携带预解析的非完整数据报文的请求消息,而步骤102可以是接收DPI装置返回的根据至少两个非完整性数据报文进行解析获取的协议解析数据。而上述解析非完整数据报文的情况,具体的可以是在首次向DPI装置发送预解析的数据报文后,DPI装置检测获得部分协议解析数据,将其封装到上下文信息中,DPI装置返回携带上述上下文信息以及指示需要再次进行数据检测信息的响应响应消息,数据获取装置再次发送携带非完整数据报文的请求消息,同时还携带上述的上下文信息,以由DPI装置根据新获得的非完整数据报文进一步进行协议解析,并将前后两次获得的协议解析数据进行合并,直到能够获得完整的协议解析数据为止,否则将持续执行上述的流程。In the above embodiments of the present invention, due to the characteristics of IP data transmission, a complete data message generated according to the protocol may be divided into multiple data packets for transmission, that is, the above-mentioned pre-analyzed data message may be a complete data message, or a non- complete datagram. Wherein for the complete data message, the protocol analysis data can be obtained by analyzing the deep data packet detection device once, and the data message is an incomplete data message, in the above-mentioned step 101, it can be sent to the DPI device at least twice to carry The request message of the pre-parsed incomplete data message, and step 102 may be to receive the protocol analysis data returned by the DPI device and obtained by parsing and obtaining at least two incomplete data messages. In the case of parsing the incomplete data message above, specifically, after the pre-analyzed data message is sent to the DPI device for the first time, the DPI device detects and obtains part of the protocol analysis data, encapsulates it into the context information, and the DPI device returns the carried The above context information and the response message indicating that data detection information needs to be performed again, the data acquisition device sends the request message carrying the incomplete data message again, and also carries the above context information at the same time, so that the DPI device can use the newly obtained incomplete data The message is further subjected to protocol analysis, and the protocol analysis data obtained twice before and after are merged until the complete protocol analysis data can be obtained, otherwise the above process will continue to be executed.

另外,本发明上述实施例中,对于终端的类型标识可以是国际移动设备标识码中的设备型号核准号码,而上述步骤102中数据获取装置在接收到DPI装置返回的携带协议解析数据的响应消息之后,数据获取装置进一步的执行下述步骤:In addition, in the above-mentioned embodiments of the present invention, the type identification of the terminal may be the equipment model approval number in the International Mobile Equipment Identity Code, and in the above-mentioned step 102, the data acquisition device receives the response message carrying the protocol analysis data returned by the DPI device Afterwards, the data acquisition device further performs the following steps:

根据上述设备型号核准号码以及设备型号核准号码与移动终端型号对应关系表,获取对应的移动终端型号。并且向数据汇聚装置发送的通知消息中携带的协议解析数据包括发送上述数据报文的移动终端型号、上述数据报文的协议类型以及对应该协议类型的业务流量值。Acquire the corresponding mobile terminal model according to the above equipment model approval number and the correspondence table between the equipment model approval number and the mobile terminal model. And the protocol analysis data carried in the notification message sent to the data aggregation device includes the mobile terminal model sending the data message, the protocol type of the data message and the service flow value corresponding to the protocol type.

图2为本发明一具体实施例的流程示意图,如上所述的,发送给DPI装置的数据报文可以是完整数据报文,或者是非完整数据报文,本实施例中是针对完整数据报文的情况,如图2所示,包括如下步骤:Fig. 2 is a schematic flow chart of a specific embodiment of the present invention, as mentioned above, the data message sent to the DPI device can be a complete data message, or an incomplete data message, in this embodiment it is aimed at a complete data message The situation, as shown in Figure 2, includes the following steps:

步骤201、移动终端(Mobile Station,以下简称:MS)向服务器发送IP数据包(例如IP Packet1和IP Packet2),上述的IP数据包经过GGSN,且各个IP数据包在GGSN上进行流匹配和重组,对于一个业务流上的IP数据包进行排序,并过滤重复的数据报文,得到TCP数据包(TCP Packet1和TCPPacket2),进一步的,该GGSN上还设置有上述的数据获取装置,该数据获取装置会根据预先配置的规则,选择性的向DPI装置发送请求消息,该请求消息中携带预解析的数据报文(TCP数据包),请求DPI装置进行7层协议解析,具体的本实施例中,可以是GGSN每接收到两个IP数据包,则向DPI装置发送一次请求消息,另外还可以是设定一时间段,例如每分钟发送一次请求消息;Step 201, mobile terminal (Mobile Station, hereinafter referred to as: MS) sends IP packet (such as IP Packet1 and IP Packet2) to server, and above-mentioned IP packet passes through GGSN, and each IP packet carries out flow matching and reorganization on GGSN , sorting the IP packets on a business flow, and filtering repeated data packets to obtain TCP packets (TCP Packet1 and TCP Packet2), further, the GGSN is also provided with the above-mentioned data acquisition device, the data acquisition The device will selectively send a request message to the DPI device according to the pre-configured rules. The request message carries a pre-analyzed data packet (TCP packet) and requests the DPI device to performlayer 7 protocol analysis. Specifically, in this embodiment , it can be that the GGSN sends a request message to the DPI device every time it receives two IP data packets, and can also set a time period, such as sending a request message every minute;

步骤202、DPI装置(DPI Parser)对接收到的TCP数据包进行协议解析,解析前会先识别出7层协议类型,并根据协议类型确定需要解析得到的协议解析数据,上述的协议解析数据可以包括如下的信息中的一项或多项,例如国际移动用户标识码(International Mobile Subscriber IdentificationIMSI)、国际移动设备标识码(International Mobile EquipmentIdentification,以下简称:IMEI)、协议大类(Protocol Category,例如P2P、VOIP等)、协议类型(Protocol,例如BT、eDonkey)、范围的URL名称、业务流量值(可以包括上行业务流量和下行业务流量)等信息,而上述IMET中的TAC标识是与移动终端型号一一对应的,上行业务流量可以具体是针对特定类型终端,在特定协议类上的上行业务流量,而下行业务流量也可以具体是针对特定类型终端,在特定协议类上的下行业务流量。Step 202, the DPI device (DPI Parser) performs protocol analysis on the received TCP packet. Before the analysis, the protocol type oflayer 7 will be identified, and the protocol analysis data that needs to be analyzed is determined according to the protocol type. The above-mentioned protocol analysis data can be Including one or more of the following information, such as International Mobile Subscriber Identification (IMSI), International Mobile Equipment Identification (International Mobile Equipment Identification, hereinafter referred to as: IMEI), protocol category (Protocol Category, such as P2P , VOIP, etc.), protocol type (Protocol, such as BT, eDonkey), URL name of the range, service flow value (can include uplink service flow and downlink service flow), and other information, and the TAC identification in the above-mentioned IMET is related to the mobile terminal model In one-to-one correspondence, the uplink service traffic may specifically be uplink service traffic on a specific type of terminal and on a specific protocol class, and the downlink service traffic may also be specifically on the downlink service traffic on a specific type of terminal and on a specific protocol class.

具体的,如图3所示,DPI装置可以包括解析规则库、预处理模块、解析模块、后处理模块、中间状态存储模块和五元组管理模块,上述的解析规则库中存储有解析规则,具体的该解析规则可以是依据不同协议类型的解析策略,可以保证对不同协议类型的TCP数据包进行解析。预处理模块在接收到封装有一个或多个IP数据包的TCP数据包后,同时从解析协议规则库中获取对应的解析规则,将其发送给解析模块进行解析,获得解析结果,由后处理模块将解析结果返回给数据获取装置,并可以将解析得到的状态信息存储到DPI装置的中间状态存储模块中,再次对IP数据包进行解析时,由预处理模块获取并发送给解析模块解析时参考,另外将上述的状态信息作为上下文信息携带在响应消息中返回给数据获取装置,以由数据获取装置在下一次针对同一业务流进行解析时,将其携带在请求消息中发送给DPI装置,而上述五元组管理模块负责五元组信息的创建、老化、更新和查询。Specifically, as shown in Figure 3, the DPI device may include a parsing rule base, a preprocessing module, a parsing module, a postprocessing module, an intermediate state storage module, and a quintuple management module, and the parsing rules are stored in the above parsing rule base, Specifically, the parsing rule may be a parsing policy based on different protocol types, which can ensure parsing of TCP data packets of different protocol types. After the preprocessing module receives the TCP data packet encapsulated with one or more IP data packets, it simultaneously obtains the corresponding parsing rules from the parsing protocol rule base, sends them to the parsing module for parsing, and obtains parsing results, which are then processed The module returns the analysis results to the data acquisition device, and can store the status information obtained by the analysis in the intermediate state storage module of the DPI device. When the IP data packet is analyzed again, it will be acquired by the preprocessing module and sent to the analysis module for analysis. For reference, in addition, carry the above-mentioned state information as context information in the response message and return it to the data acquisition device, so that the data acquisition device will carry it in the request message and send it to the DPI device when parsing the same service flow next time, and The above-mentioned quintuple management module is responsible for creating, aging, updating and querying quintuple information.

步骤203、GGSN将接收到的协议解析数据进行相应处理,并将处理后的协议解析数据发送给服务器(server)中的数据汇聚装置,该数据汇聚装置可以是具体的这里的处理可以包括是在上述的终端类型标识是IMET中的TAC标识,根据TAC标识与移动终端型号的对应关系,获取移动终端型号,并将其携带在通知消息中发送给服务器。另外对于上述步骤中涉及的上下文信息,可以在需要DPI装置再次对同一业务流的TCP数据包解析时发送给DPI装置,同时在业务流释放时释放内存中的相关上下文信息。Step 203, GGSN processes the received protocol analysis data accordingly, and sends the processed protocol analysis data to the data convergence device in the server (server), the data convergence device can be specific, and the processing here can include The above-mentioned terminal type identifier is the TAC identifier in the IMET. According to the corresponding relationship between the TAC identifier and the mobile terminal model, the mobile terminal model is obtained, and is carried in the notification message and sent to the server. In addition, the context information involved in the above steps can be sent to the DPI device when the DPI device needs to analyze the TCP packet of the same service flow again, and release the relevant context information in the memory when the service flow is released.

步骤204、GGSN根据解析的结果和协议的特性(采用配置的方式)来确定是否将后续的TCP数据包发送给DPI装置进行解析,具体的可以针对步骤201中涉及的配置规则执行,例如图2所示,GGSN对后需接收到的IP数据包(IP Packet3),不发送给DPI进行解析,而是直接发送给服务器处理(server)。Step 204, GGSN determines whether to send subsequent TCP data packets to the DPI device for analysis according to the results of the analysis and the characteristics of the protocol (by means of configuration), specifically for the configuration rules involved instep 201, as shown in Figure 2 As shown, the IP data packet (IP Packet3) to be received by the GGSN is not sent to the DPI for analysis, but is directly sent to the server for processing (server).

上述实施例是针对TCP数据包为完整数据报文的情况的实施例,而针对IP数据包为非完整数据报文的情况,可如图4所示,包括如下的步骤:Above-mentioned embodiment is the embodiment that is the situation of complete data message for TCP data packet, and for the situation that IP data packet is incomplete data message, can as shown in Figure 4, comprise the following steps:

步骤301、与上述步骤201的步骤基本相同,区别在于由于IP分片的特性,GGSN发送给DPI装置的TCP数据包为非完整数据报文。Step 301 is basically the same as theabove step 201, except that due to the characteristics of IP fragmentation, the TCP data packet sent by the GGSN to the DPI device is an incomplete data packet.

步骤302、DPI装置对接收到的非完整数据报文进行解析,由于是非完整数据报文,因此DPI装置无法通过一次解析获得完整的协议解析数据,DPI装置需要进行对非完整数据报文进行解析后缓存必要的信息,生成上下文信息。Step 302, the DPI device parses the received incomplete data message. Since it is an incomplete data message, the DPI device cannot obtain complete protocol analysis data through one analysis, and the DPI device needs to analyze the incomplete data message After the necessary information is cached, context information is generated.

步骤303、DPI装置向GGSN返回响应消息,该响应消息中携带需要继续发送TCP数据包进行解析的指示信息,同时还可以将上述的上下文信息发送给GGSN。GGSN会把之前接收到的IP数据包发送给服务器。Step 303 , the DPI device returns a response message to the GGSN, the response message carries indication information that the TCP data packet needs to be sent for analysis, and at the same time, the above context information can also be sent to the GGSN. GGSN will send the previously received IP data packets to the server.

步骤304、GGSN在接收到后续的IP数据包(IP Packet3)后,会继续将转换得到的TCP数据包发送给DPI装置,由DPI装置进行解析,同时也会将上次解析得到的上下文信息发送给DPI装置。Step 304, after the GGSN receives the subsequent IP packet (IP Packet3), it will continue to send the converted TCP packet to the DPI device, which will be analyzed by the DPI device, and the context information obtained by the last analysis will also be sent. Give the DPI device.

步骤305、DPI装置对接收到的TCP数据包(TCP Packet3)进行解析,同时会将解析得到的信息与上述的上下文信息进行合并,如果已经获得完整的协议解析数据,则会将解析结果返回给GGSN,表明解析成功,同时也可以返回图2所示实施例中的上下文信息,以在解析同一业务流的TCP数据包时参考。Step 305, the DPI device parses the received TCP packet (TCP Packet3), and simultaneously the information obtained by parsing will be merged with the above-mentioned context information, if the complete protocol parsing data has been obtained, the parsing result will be returned to The GGSN indicates that the parsing is successful, and at the same time, the context information in the embodiment shown in FIG. 2 can also be returned for reference when parsing the TCP data packets of the same service flow.

步骤306、GGSN将解析获得的完整的协议解析数据发送给服务器中的数据汇聚装置。另外本实施例中,GGSN也同样会将发送给DPI装置解析的IP数据包(IP Packet1、IP Packet2和IP Packet3)发送给服务器。Instep 306, the GGSN sends the complete protocol analysis data obtained through analysis to the data aggregation device in the server. In addition, in this embodiment, the GGSN will also send the IP data packets (IP Packet1, IP Packet2 and IP Packet3) sent to the DPI device for analysis to the server.

具体的,针对上述的IMSI,其数据结构可以如图5所示,包括移动国家代码(Mobile Country Code,以下简称:MCC)、MCC唯一的标识移动用户所在的国家,由3位组成;MNC用以标识移动用户有效的GSM PLMN代码,由2或3位组成;MNC和MSIN共同组成国家移动用户标识(National MobileSubscriber Identity,以下简称:NMSI)。Specifically, for the above-mentioned IMSI, its data structure can be as shown in Figure 5, including the mobile country code (Mobile Country Code, hereinafter referred to as: MCC), the country where the MCC uniquely identifies the mobile user, and is composed of 3 bits; To identify the effective GSM PLMN code of a mobile user, it consists of 2 or 3 digits; MNC and MSIN together form the National Mobile Subscriber Identity (National Mobile Subscriber Identity, hereinafter referred to as: NMSI).

IMEI的结构可以如图6所示,其包括表示移动终端设备的机型的设备型号核准号码TAC,表示终端设备的产地的工厂装配码FAC,表示生产顺序号的串号SNR,以及校验码SP。The structure of the IMEI can be shown in Figure 6, which includes the device model approval number TAC representing the model of the mobile terminal device, the factory assembly code FAC representing the origin of the terminal device, the serial number SNR representing the production sequence number, and the check code sp.

在上述的数据获取装置获取协议解析数据后,将其发送给数据汇聚装置,数据汇聚装置根据接收到的各个数据获取装置反馈的协议解析数据生成各类型终端的终端分布信息。图7为本发明终端分布信息获取方法实施例二的流程示意图,如图7所示,该方法包括如下的步骤:After the above-mentioned data acquisition device acquires the protocol analysis data, it sends it to the data convergence device, and the data convergence device generates terminal distribution information of various types of terminals according to the received protocol analysis data fed back by each data acquisition device. FIG. 7 is a schematic flow diagram ofEmbodiment 2 of the method for obtaining terminal distribution information of the present invention. As shown in FIG. 7, the method includes the following steps:

步骤401、接收数据获取装置发送的携带对数据报文解析获得的协议解析数据的通知消息,所述协议解析数据包括发送所述数据报文的终端的类型标识、所述数据报文的协议类型以及对应该协议类型的业务流量值;Step 401: Receive the notification message sent by the data acquisition device and carry the protocol analysis data obtained by analyzing the data message, the protocol analysis data includes the type identifier of the terminal sending the data message, the protocol type of the data message and the service flow value corresponding to the protocol type;

步骤402、根据接收到的各个数据获取装置反馈的所述协议解析数据汇聚生成各类型终端的终端分布信息,所述终端分布信息包括各类型终端及其对应的特定时间段内的流量统计值。Step 402: Collect and generate terminal distribution information of various types of terminals according to the received protocol analysis data fed back by each data acquisition device. The terminal distribution information includes various types of terminals and their corresponding traffic statistics within a specific time period.

本发明上述实施例中,通过对接收到的各个数据获取装置反馈的协议解析数据进行汇聚,获得各类型终端的终端分布信息,即获取各类型终端及其在对应的特定时间段内的流量统计值,能够提高对终端分布信息的统计效率,同时提供统计结果的准确性。In the above-mentioned embodiments of the present invention, by converging the received protocol analysis data fed back by each data acquisition device, the terminal distribution information of various types of terminals is obtained, that is, the flow statistics of various types of terminals and their corresponding specific time periods are obtained. value, which can improve the statistical efficiency of the terminal distribution information, and at the same time provide the accuracy of the statistical results.

具体的上述实施例中,对于协议解析数据中的终端的类型标识可以是IMEI中的TAC码,也可以是根据TAC码获取的移动终端型号,在上述的终端的类型标识为TAC码时,本实施例中可以将其转换为移动终端型号。In the specific above-mentioned embodiments, the type identification of the terminal in the protocol analysis data can be the TAC code in the IMEI, or the mobile terminal model obtained according to the TAC code. When the type identification of the above-mentioned terminal is a TAC code, this In the embodiment, it can be converted into a mobile terminal model.

在发送给数据汇聚装置的协议解析数据中,除可以包括上述的终端的类型标识、数据报文的协议类型以及对应该协议类型的业务流量值外,还可以包括IMSI(即手机号码),或者是包括与上述的数据报文相关的网站/服务器等内容,上述的信息可以是以UDP数据包的形式发送到BI系统的数据收集模块DRM,该模块是数据汇聚装置的一部分,DRM将收到UDP数据包转换为CSV文件,该CSV文件为一种用来存储数据的纯文本,英文全称为:Comma Separated Values,并写在硬盘上。同时,对于“所处地域信息”和“用户详细信息”,也可以通过手机号码关联到运营商内部业务支撑系统获得,以CSV文件的形式保存到硬盘上。In the protocol analysis data sent to the data convergence device, in addition to the above-mentioned type identification of the terminal, the protocol type of the data message, and the service flow value corresponding to the protocol type, it may also include IMSI (i.e. mobile phone number), or It includes the website/server and other content related to the above-mentioned data message. The above-mentioned information can be sent to the data collection module DRM of the BI system in the form of UDP data packets. This module is a part of the data aggregation device, and the DRM will receive The UDP data packet is converted into a CSV file. The CSV file is a plain text used to store data. The full name in English is: Comma Separated Values, and it is written on the hard disk. At the same time, the "regional information" and "user detailed information" can also be obtained by associating the mobile phone number with the operator's internal business support system, and saved to the hard disk in the form of a CSV file.

CSV文件解析组件定时解析过滤CSV文件数据到缓冲表(ETL表),再由内存和ORACLE存储过程的将数据从缓冲表(ETL表)按照一定要求放置到元数据表中。BI系统ETL(数据处理模块)模块将读取硬盘上的CSV文件并将记录插入到Oracle后台数据库里相应的表中。每条原始记录包括流量统计值(具体可以包括上行流量信息和下行流量信息),通过终端类型来对记录进行分组汇总求和,得出某种终端的总流量大小。The CSV file parsing component regularly parses and filters the CSV file data to the buffer table (ETL table), and then puts the data from the buffer table (ETL table) into the metadata table according to certain requirements by the memory and ORACLE stored procedure. The BI system ETL (data processing module) module will read the CSV file on the hard disk and insert the record into the corresponding table in the Oracle background database. Each original record includes traffic statistics (specifically, uplink traffic information and downlink traffic information), and the records are grouped and summed by terminal type to obtain the total traffic volume of a certain terminal.

通过汇聚任务对元数据表数据进行汇聚至汇聚表,即可在BI系统中形成基于各种维度的分布统计报表,分析引擎(Analysis Engine)根据需求远程创建并管理多维数据集Cube,分析师通过HTTP接口与报表系统进行基于各种维度信息进行交互,具体的生成的分布统计报表可以如下所示:Through the aggregation task, the metadata table data is aggregated to the aggregation table, and the distribution statistics report based on various dimensions can be formed in the BI system. The analysis engine (Analysis Engine) remotely creates and manages the multi-dimensional data set Cube according to the demand. The HTTP interface interacts with the report system based on information of various dimensions, and the specific generated distribution statistics report can be shown as follows:

  等级level  手机型号 Phone model  流量大小flow size  1 1  AA  10001000  2 2  BB  900900  33  CC  800800  44  DD  700700  55  EE  600600

在本发明实施例中,由系统将自动采集数据并生成报表,相对于现有技术中利用人工方式进行数据统计,数据的统计效率高。另外,本发明实施例中还是一种基于用户真实通信消费记录的数据统计,其精确度高,且本发明实施例可以基于分钟、小时、天、周、月或任何时间粒度期限进行统计,同时也可以根据IMSI标识获取地域位置信息,实现对特定地区进行统计,或者从网络管理系统获取归属用户,对属于同一用户进行统计。本发明上述实施例中,根据反馈的协议解析数据汇聚生成各类型终端的分布信息,在针对不同粒度的数据进行汇聚时,具体的可以是:In the embodiment of the present invention, the system will automatically collect data and generate a report. Compared with the prior art that uses manual methods for data statistics, the statistical efficiency of data is high. In addition, the embodiment of the present invention is also a kind of data statistics based on the user's real communication consumption records, which has high accuracy, and the embodiment of the present invention can perform statistics based on minutes, hours, days, weeks, months or any time granularity period, while The geographic location information can also be obtained according to the IMSI identifier, so as to realize the statistics of a specific region, or the belonging users can be obtained from the network management system, so as to make statistics of the same users. In the above-mentioned embodiments of the present invention, the distribution information of various types of terminals is generated according to the aggregation of the feedback protocol analysis data. When the data of different granularities are aggregated, it may be specifically:

根据各个数据获取装置反馈的协议解析数据进行内存聚合,汇聚生成分钟粒度的各类型终端的终端分布信息和/或小时粒度的各类型终端的终端分布信息;以及Perform memory aggregation according to the protocol analysis data fed back by each data acquisition device, and aggregate and generate terminal distribution information of various types of terminals at minute granularity and/or terminal distribution information of various types of terminals at hour granularity; and

根据各个数据获取装置反馈的协议解析数据进行数据库聚合,汇聚生成天粒度的各类型终端的终端分布信息和/或月粒度的各类型终端的终端分布信息。Database aggregation is performed according to the protocol analysis data fed back by each data acquisition device, and terminal distribution information of various types of terminals at a day granularity and/or terminal distribution information of various types of terminals at a monthly granularity are generated by aggregation.

具体的如图8所示,通过读本地文件的方式,使用HashMap结构在内存中对元数据进行聚合操作,将文件一次性读写到内存中,供所有的聚合器使用,减少磁盘IO操作,并提升处理性能。对于一次聚合过程,具体的可以是将缓冲表中同一类型终端(terminal)、同一网站(website)或同一用户(subscriber)下的明细记录,按照某种规则如时间字段取并集,数据字段去和,明细记录条数作为访问次数等汇总成一条记录并写入到聚合表中。具体的可以是将数据量大的分钟粒度和小时粒度聚合在内存中完成,后通过CSV写操作器(CSV Writer)将数据转换为CSV文件(CSV file),然后将上述的CSV文件通过数据入库模块(ETL)转发到数据库中,分别存储为分钟粒度数据和小时粒度数据,可将上述的分钟粒度数据和小时粒度数据进一步的聚合形成天粒度数据和月粒度数据,第二次的聚合过程可以在数据库中实现。Specifically, as shown in Figure 8, by reading local files, the HashMap structure is used to aggregate metadata in memory, and the files are read and written into memory at one time for use by all aggregators, reducing disk IO operations. and improve processing performance. For an aggregation process, specifically, the detailed records under the same type of terminal (terminal), the same website (website) or the same user (subscriber) in the buffer table can be combined according to certain rules, such as the time field, and the data field. And, the number of detailed records is aggregated into one record as the number of visits and written into the aggregation table. Specifically, the minute granularity and hour granularity with a large amount of data can be aggregated in the memory, and then the data is converted into a CSV file (CSV file) through the CSV Writer (CSV Writer), and then the above CSV file is input into the The library module (ETL) forwards it to the database and stores it as minute granularity data and hour granularity data respectively. The above minute granularity data and hour granularity data can be further aggregated to form day granularity data and monthly granular data. The second aggregation process Can be implemented in the database.

图9为本发明数据获取装置实施例的结构示意图,如图9所示,该装置包括第一发送模块11、第一接收模块12和第二发送模块13,其中第一发送模块11用于向深度数据包检测装置发送携带预解析的数据报文的请求消息,所述请求消息用于指示深度数据包检测装置对所述数据报文进行协议解析;第一接收模块12用于接收所述深度数据包检测装置返回的携带协议解析数据的响应消息,所述协议解析数据包括发送所述数据报文的终端的类型标识、所述数据报文的协议类型以及对应该协议类型的业务流量值;第二发送模块13用于向数据汇聚装置发送携带所述协议解析数据的通知消息,以使所述数据处理模块根据所述协议解析数据汇聚生成各类型终端的终端分布信息。Figure 9 is a schematic structural diagram of an embodiment of the data acquisition device of the present invention, as shown in Figure 9, the device includes afirst sending module 11, afirst receiving module 12 and asecond sending module 13, wherein thefirst sending module 11 is used to send The deep data packet detection device sends a request message carrying a pre-analyzed data message, and the request message is used to instruct the deep data packet detection device to perform protocol analysis on the data message; thefirst receiving module 12 is used to receive the depth A response message carrying protocol analysis data returned by the data packet detection device, the protocol analysis data including the type identifier of the terminal sending the data message, the protocol type of the data message, and the service flow value corresponding to the protocol type; Thesecond sending module 13 is configured to send a notification message carrying the protocol analysis data to the data aggregation device, so that the data processing module aggregates and generates terminal distribution information of various types of terminals according to the protocol analysis data.

本发明上述实施例中提供的数据获取装置,能够通过向深度数据包检测装置发送请求消息,使其对数据报文进行解析以获取协议解析数据,该协议解析数据包括发送上述数据报文的终端的类型标识、上述数据报文的协议类型以及对应该协议类型的业务流量值,并将上述的协议解析数据发送给数据汇聚装置进行汇聚,以得到各类型终端的终端分布信息,能够提高对终端分布信息的统计效率,并获得精确度更高的统计结果。本发明上述实施例中的数据获取装置,还可以进一步的包括第一获取模块14,该第一获取模块14用于在所述终端的类型标识为国际移动设备标识码中的设备型号核准号码,根据所述设备型号核准号码以及所述设备型号核准号码与移动终端型号对应关系表,获取对应的移动终端型号;且上述第二发送模块13发送的通知消息中携带的协议解析数据包括发送所述数据报文的移动终端型号、所述数据报文的协议类型以及对应该协议类型的业务流量值。The data acquisition device provided in the above-mentioned embodiments of the present invention can analyze the data message to obtain the protocol analysis data by sending a request message to the deep data packet detection device, and the protocol analysis data includes the terminal sending the above data message type identification, the protocol type of the above-mentioned data message, and the service flow value corresponding to the protocol type, and send the above-mentioned protocol analysis data to the data aggregation device for aggregation, so as to obtain terminal distribution information of various types of terminals, which can improve the terminal Statistical efficiency of distribution information, and obtain statistical results with higher accuracy. The data acquisition device in the above embodiments of the present invention may further include afirst acquisition module 14, which is used to identify the type of the terminal as the equipment model approval number in the International Mobile Equipment Identity Code, According to the device model approval number and the correspondence table between the device model approval number and the mobile terminal model, the corresponding mobile terminal model is obtained; and the protocol analysis data carried in the notification message sent by thesecond sending module 13 includes sending the The mobile terminal model of the data message, the protocol type of the data message, and the service flow value corresponding to the protocol type.

本发明上述实施例中的数据获取装置可以是设置在GGSN中,而其中的深度数据包检测装置既可以是设置在GGSN中,也可以是单独设置的形式。The data acquisition device in the above embodiments of the present invention may be set in the GGSN, and the deep data packet detection device therein may be set in the GGSN, or may be set separately.

本发明实施例还提供了一种数据汇聚装置,图10为本发明数据汇聚装置实施例的结构示意图,如图10所示,该装置包括第二接收模块21和第二获取模块22,其中第二接收模块21用于接收数据获取装置发送的对数据报文解析获得的携带协议解析数据的通知消息,所述协议解析数据包括发送所述数据报文的终端的类型标识、所述数据报文的协议类型以及对应该协议类型的业务流量值;第二获取模块22用于根据各个数据获取装置反馈的所述协议解析数据汇聚生成各类型终端的终端分布信息,所述终端分布信息包括终端类型及其对应的特定时间段内的流量统计值。The embodiment of the present invention also provides a data aggregation device. FIG. 10 is a schematic structural diagram of an embodiment of the data aggregation device of the present invention. As shown in FIG. 10, the device includes asecond receiving module 21 and a second acquiringmodule 22, wherein the first Thesecond receiving module 21 is used to receive the notification message carrying the protocol analysis data obtained by analyzing the data message sent by the data acquisition device, and the protocol analysis data includes the type identification of the terminal sending the data message, the data message protocol type and the service flow value corresponding to the protocol type; thesecond acquisition module 22 is used to aggregate and generate terminal distribution information of various types of terminals according to the protocol analysis data fed back by each data acquisition device, and the terminal distribution information includes terminal type and its corresponding traffic statistics in a specific time period.

本实施例提供的技术方案中,其中的数据汇聚装置根据各个数据获取装置获取到的协议解析数据汇聚生成终端分布信息,相对于现有技术中通过人工采集的方式获取终端分布信息,能够提高对终端分布信息的统计效率,同时也能够提高统计结果的精确度。In the technical solution provided by this embodiment, the data aggregation device generates terminal distribution information according to the protocol analysis data obtained by each data acquisition device. Compared with the manual acquisition of terminal distribution information in the prior art, it can improve The statistical efficiency of terminal distribution information can also improve the accuracy of statistical results.

本发明实施例还提供了一种通信系统,该通信系统包括设置了上述数据获取装置的GGSN和设置了上述的数据获取装置的商务智能系统。另外,进一步的,还可以将深度数据包检测装置设置在GGSN中;或者独立设置的方式将深度数据包检测装置设置在通信网络中。本领域普通技术人员可以理解:实现上述方法实施例的全部或部分步骤可以通过程序指令相关的硬件来完成,前述的程序可以存储于一计算机可读取存储介质中,该程序在执行时,执行包括上述方法实施例的步骤;而前述的存储介质包括:ROM、RAM、磁碟或者光盘等各种可以存储程序代码的介质。An embodiment of the present invention also provides a communication system, which includes a GGSN provided with the above-mentioned data acquisition device and a business intelligence system provided with the above-mentioned data acquisition device. In addition, further, the deep data packet inspection device can also be set in the GGSN; or the deep data packet inspection device can be set in the communication network in an independent setting manner. Those of ordinary skill in the art can understand that all or part of the steps for realizing the above-mentioned method embodiments can be completed by hardware related to program instructions, and the aforementioned program can be stored in a computer-readable storage medium. When the program is executed, the It includes the steps of the above method embodiments; and the aforementioned storage medium includes: ROM, RAM, magnetic disk or optical disk and other various media that can store program codes.

最后应说明的是:以上实施例仅用以说明本发明的技术方案,而非对其限制;尽管参照前述实施例对本发明进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本发明各实施例技术方案的范围。Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: it can still be Modifications are made to the technical solutions described in the foregoing embodiments, or equivalent replacements are made to some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.

Claims (10)

Translated fromChinese
1.一种终端分布信息获取方法,其特征在于,包括:1. A terminal distribution information acquisition method, characterized in that, comprising:向深度数据包检测装置发送携带预解析的数据报文的请求消息,所述请求消息用于指示深度数据包检测装置对所述数据报文进行协议解析;Sending a request message carrying a pre-analyzed data packet to the deep packet inspection device, where the request message is used to instruct the deep packet inspection device to perform protocol analysis on the data packet;接收所述深度数据包检测装置返回的携带协议解析数据的响应消息,所述协议解析数据包括发送所述数据报文的终端的类型标识、所述数据报文的协议类型以及对应该协议类型的业务流量值;Receiving a response message carrying protocol analysis data returned by the deep packet inspection device, the protocol analysis data including the type identifier of the terminal sending the data message, the protocol type of the data message, and the corresponding protocol type Business flow value;向数据汇聚装置发送携带所述协议解析数据的通知消息,以使所述数据处理模块根据所述协议解析数据汇聚生成各类型终端的终端分布信息,所述终端分布信息包括各类型终端及其对应的特定时间段内的流量统计值。Sending a notification message carrying the protocol analysis data to the data aggregation device, so that the data processing module generates terminal distribution information of various types of terminals according to the aggregation of the protocol analysis data, and the terminal distribution information includes various types of terminals and their corresponding terminals. Traffic statistics for a specific period of time.2.根据权利要求1所述的终端分布信息获取方法,其特征在于,所述预解析的数据报文为完整数据报文或非完整数据报文,且在所述预解析的数据报文为非完整数据报文,所述向深度数据包检测装置发送携带预解析的数据报文的请求消息包括:2. The terminal distribution information acquisition method according to claim 1, wherein the pre-analyzed data message is a complete data message or an incomplete data message, and the pre-analyzed data message is An incomplete data message, the request message sending the pre-analyzed data message to the deep packet detection device includes:至少两次向所述深度数据包检测装置发送携带预解析的非完整数据报文的请求消息;Sending a request message carrying a pre-parsed incomplete data packet to the deep packet inspection device at least twice;所述接收所述深度数据包检测装置返回的所述数据报文的协议解析数据包括:The receiving the protocol analysis data of the data message returned by the deep packet inspection device includes:接收深度数据包检测装置返回的根据至少两个非完整数据报文进行解析获取的协议解析数据。receiving the protocol analysis data obtained by analyzing at least two incomplete data packets returned by the deep packet inspection device.3.根据权利要求1所述的终端分布信息获取方法,其特征在于,所述终端的类型标识为国际移动设备标识码中的设备型号核准号码,在接收所述深度数据包检测装置返回的携带协议解析数据的响应消息之后还包括:3. The method for obtaining terminal distribution information according to claim 1, wherein the type identification of the terminal is the equipment model approval number in the International Mobile Equipment Identity Code, and when receiving the return information carried by the deep data packet detection device After the response message of the protocol analysis data, it also includes:根据所述设备型号核准号码以及设备型号核准号码与移动终端型号对应关系表,获取对应的移动终端型号;Obtain the corresponding mobile terminal model according to the equipment model approval number and the corresponding relationship table between the equipment model approval number and the mobile terminal model;则向数据汇聚装置发送的通知消息中携带的协议解析数据包括发送所述数据报文的移动终端型号、所述数据报文的协议类型以及对应该协议类型的业务流量值。The protocol analysis data carried in the notification message sent to the data aggregation device includes the mobile terminal model sending the data message, the protocol type of the data message, and the service flow value corresponding to the protocol type.4.一种终端分布信息获取方法,其特征在于,包括:4. A method for acquiring terminal distribution information, comprising:接收数据获取装置发送的携带对数据报文解析获得的协议解析数据的通知消息,所述协议解析数据包括发送所述数据报文的终端的类型标识、所述数据报文的协议类型以及对应该协议类型的业务流量值;receiving the notification message sent by the data acquisition device and carrying the protocol analysis data obtained by parsing the data message, the protocol analysis data including the type identifier of the terminal sending the data message, the protocol type of the data message and the corresponding The business flow value of the protocol type;根据接收到的各个数据获取装置反馈的所述协议解析数据汇聚生成各类型终端的终端分布信息,所述终端分布信息包括各类型终端及其对应的特定时间段内的流量统计值。Terminal distribution information of various types of terminals is aggregated and generated according to the received protocol analysis data fed back by each data acquisition device, and the terminal distribution information includes various types of terminals and their corresponding traffic statistics within a specific time period.5.根据权利要求4所述的终端分布信息获取方法,其特征在于,所述终端的类型标识为移动终端型号。5. The method for obtaining terminal distribution information according to claim 4, wherein the type identifier of the terminal is a mobile terminal model.6.根据权利要求4所述的终端分布信息获取方法,其特征在于,所述根据接收到的各个数据获取装置反馈的协议解析数据汇聚生成各类型终端的终端分布信息包括:6. The method for obtaining terminal distribution information according to claim 4, wherein said gathering and generating terminal distribution information of various types of terminals according to the received protocol analysis data fed back by each data acquisition device comprises:根据各个数据获取装置反馈的协议解析数据进行内存聚合,汇聚生成分钟粒度的各类型终端的终端分布信息和/或小时粒度的各类型终端的终端分布信息;以及Perform memory aggregation according to the protocol analysis data fed back by each data acquisition device, and aggregate and generate terminal distribution information of various types of terminals at minute granularity and/or terminal distribution information of various types of terminals at hour granularity; and根据各个数据获取装置反馈的协议解析数据进行数据库聚合,汇聚生成天粒度的各类型终端的终端分布信息和/或月粒度的各类型终端的终端分布信息。Database aggregation is performed according to the protocol analysis data fed back by each data acquisition device, and terminal distribution information of various types of terminals at a day granularity and/or terminal distribution information of various types of terminals at a monthly granularity are generated by aggregation.7.一种数据获取装置,其特征在于,包括:7. A data acquisition device, characterized in that it comprises:第一发送模块,用于向深度数据包检测装置发送携带预解析的数据报文的请求消息,所述请求消息用于指示深度数据包检测装置对所述数据报文进行协议解析;The first sending module is configured to send a request message carrying a pre-analyzed data message to the deep data packet inspection device, and the request message is used to instruct the deep data packet inspection device to perform protocol analysis on the data message;第一接收模块,用于接收所述深度数据包检测装置返回的携带协议解析数据的响应消息,所述协议解析数据包括发送所述数据报文的终端的类型标识、所述数据报文的协议类型以及对应该协议类型的业务流量值;A first receiving module, configured to receive a response message carrying protocol analysis data returned by the deep packet inspection device, the protocol analysis data including the type identifier of the terminal sending the data message, the protocol of the data message type and the service flow value corresponding to the protocol type;第二发送模块,用于向数据汇聚装置发送携带所述协议解析数据的通知消息,以使所述数据处理模块根据所述协议解析数据汇聚生成各类型终端的终端分布信息。The second sending module is configured to send a notification message carrying the protocol analysis data to the data aggregation device, so that the data processing module aggregates and generates terminal distribution information of various types of terminals according to the protocol analysis data.8.根据权利要求7所述的数据获取装置,其特征在于,还包括:8. The data acquisition device according to claim 7, further comprising:第一获取装置,用于在所述终端的类型标识为国际移动设备标识码中的设备型号核准号码,根据所述设备型号核准号码以及所述设备型号核准号码与移动终端型号对应关系表,获取对应的移动终端型号;The first obtaining means is used to obtain the equipment model approval number in the International Mobile Equipment Identity Code according to the equipment model approval number and the correspondence table between the equipment model approval number and the mobile terminal model when the type of the terminal is identified as The corresponding mobile terminal model;且所述第二发送模块发送的通知消息中携带的协议解析数据包括发送所述数据报文的移动终端型号、所述数据报文的协议类型以及对应该协议类型的业务流量值。And the protocol analysis data carried in the notification message sent by the second sending module includes the mobile terminal model sending the data message, the protocol type of the data message, and the service flow value corresponding to the protocol type.9.一种数据汇聚装置,其特征在于,包括:9. A data aggregation device, characterized in that it comprises:第二接收模块,用于接收数据获取装置发送的对数据报文解析获得的携带协议解析数据的通知消息,所述协议解析数据包括发送所述数据报文的终端的类型标识、所述数据报文的协议类型以及对应该协议类型的业务流量值;The second receiving module is configured to receive a notification message carrying protocol analysis data obtained by analyzing the data message sent by the data acquisition device, and the protocol analysis data includes the type identifier of the terminal sending the data message, the data message The protocol type of the document and the service flow value corresponding to the protocol type;第二获取模块,用于根据各个数据获取装置反馈的所述协议解析数据汇聚生成各类型终端的终端分布信息,所述终端分布信息包括终端类型及其对应的特定时间段内的流量统计值。The second acquisition module is configured to aggregate and generate terminal distribution information of various types of terminals according to the protocol analysis data fed back by each data acquisition device, and the terminal distribution information includes terminal types and their corresponding traffic statistics within a specific time period.10.一种通信系统,其特征在于,包括设置有权利要求7或8所述的数据获取装置的服务GRPS支持节点和设置有权利要求9所述的数据汇聚装置的商务智能系统。10. A communication system, characterized in that it comprises a service GRPS support node provided with the data acquisition device as claimed in claim 7 or 8, and a business intelligence system provided with the data aggregation device as claimed in claim 9.
CN2011800015266A2011-07-012011-07-01 Terminal distribution information acquisition method, data acquisition device and communication systemPendingCN102301764A (en)

Applications Claiming Priority (1)

Application NumberPriority DateFiling DateTitle
PCT/CN2011/076762WO2012106861A1 (en)2011-07-012011-07-01Terminal distribution information acquisition method, data acquisition device and communication system

Publications (1)

Publication NumberPublication Date
CN102301764Atrue CN102301764A (en)2011-12-28

Family

ID=45360545

Family Applications (1)

Application NumberTitlePriority DateFiling Date
CN2011800015266APendingCN102301764A (en)2011-07-012011-07-01 Terminal distribution information acquisition method, data acquisition device and communication system

Country Status (2)

CountryLink
CN (1)CN102301764A (en)
WO (1)WO2012106861A1 (en)

Cited By (14)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
WO2014029088A1 (en)*2012-08-222014-02-27华为技术有限公司Deep packet inspection parsing result sharing/acquiring method, system, and corresponding device thereof
CN103853838A (en)*2014-03-172014-06-11中国联合网络通信集团有限公司Data processing method and device
CN103906094A (en)*2012-12-242014-07-02中国电信股份有限公司Method and system for acquiring EVDO control channel resource occupation
WO2015085500A1 (en)*2013-12-112015-06-18华为技术有限公司Control device in wireless local area network, network system and service processing method
CN105681271A (en)*2014-12-082016-06-15三星电子株式会社Method and apparatus for providing integrity check data
CN106664224A (en)*2014-08-202017-05-10华为技术有限公司System and method for metadata enhanced inventory management of a communications system
CN107239542A (en)*2017-06-022017-10-10福建中金在线信息科技有限公司A kind of data statistical approach, device, server and storage medium
CN107831842A (en)*2017-12-102018-03-23夏烬楚Intelligent information capture systems based on big data
CN107864068A (en)*2017-10-232018-03-30北京中创信测科技股份有限公司A kind of application identification system and method based on DPI technologies
CN110121175A (en)*2019-04-122019-08-13国家计算机网络与信息安全管理中心It is a kind of for moving the data monitoring method and system of Intelligent terminal for Internet of things
CN111988271A (en)*2020-06-302020-11-24联想(北京)有限公司Communication flow processing method and device
CN112671721A (en)*2020-12-112021-04-16浙江万胜智能科技股份有限公司Message analysis method of intelligent electric energy meter
CN112838960A (en)*2019-11-222021-05-25中兴通讯股份有限公司Communication data cleaning method, device, network equipment and storage medium
CN113923716A (en)*2021-12-132022-01-11北京赋乐科技有限公司User information acquisition method and device and electronic equipment

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN112866973B (en)*2019-11-282022-11-11上海华为技术有限公司Method for counting distribution condition of terminal equipment and related device
CN114328664A (en)*2021-12-282022-04-12苏州亿为新能源科技有限公司Charging station operation and maintenance data acquisition method and system, electronic equipment and storage medium
CN115250297A (en)*2022-06-282022-10-28合肥移顺信息技术有限公司Data analysis method, device, terminal, medium and program product for digital subscriber line network
CN116132474A (en)*2022-12-312023-05-16武汉中海庭数据技术有限公司Internet of vehicles terminal access system based on multi-protocol fusion

Citations (5)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
US20100054231A1 (en)*2008-08-282010-03-04Alcatel LucentDpi-triggered application-aware dormancy timer adjustment for mobile data bearers
CN101715182A (en)*2009-11-302010-05-26中国移动通信集团浙江有限公司Method, system and device for controlling traffic
CN101729308A (en)*2009-06-012010-06-09中兴通讯股份有限公司Method and device for controlling strategy
US20100235877A1 (en)*2009-03-122010-09-16At&T Mobility Ii LlcPolicy-based privacy protection in converged communication networks
KR20110072527A (en)*2009-12-232011-06-29주식회사 케이티 Apparatus and method for managing service state of subscriber station

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN101141418B (en)*2006-09-082010-04-21中国电信股份有限公司Strategy based family network service identifying system and method
CN101925101A (en)*2009-06-092010-12-22中兴通讯股份有限公司Method and device for information collection and statistic analysis in process of user calling
EP2315392A1 (en)*2009-10-212011-04-27Nederlandse Organisatie voor toegepast -natuurwetenschappelijk onderzoek TNOTelecommunication quality of service control

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
US20100054231A1 (en)*2008-08-282010-03-04Alcatel LucentDpi-triggered application-aware dormancy timer adjustment for mobile data bearers
US20100235877A1 (en)*2009-03-122010-09-16At&T Mobility Ii LlcPolicy-based privacy protection in converged communication networks
CN101729308A (en)*2009-06-012010-06-09中兴通讯股份有限公司Method and device for controlling strategy
CN101715182A (en)*2009-11-302010-05-26中国移动通信集团浙江有限公司Method, system and device for controlling traffic
KR20110072527A (en)*2009-12-232011-06-29주식회사 케이티 Apparatus and method for managing service state of subscriber station

Cited By (23)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN104041095B (en)*2012-08-222018-05-11华为技术有限公司Deep message detection analysis result shares/acquisition methods, system and its relevant device
CN104041095A (en)*2012-08-222014-09-10华为技术有限公司 Method, system, and corresponding equipment for sharing acquisition of deep message detection and analysis results
WO2014029088A1 (en)*2012-08-222014-02-27华为技术有限公司Deep packet inspection parsing result sharing/acquiring method, system, and corresponding device thereof
CN103906094A (en)*2012-12-242014-07-02中国电信股份有限公司Method and system for acquiring EVDO control channel resource occupation
CN103906094B (en)*2012-12-242017-10-17中国电信股份有限公司EVDO control channel resource occupation acquisition methods and system
WO2015085500A1 (en)*2013-12-112015-06-18华为技术有限公司Control device in wireless local area network, network system and service processing method
CN103853838A (en)*2014-03-172014-06-11中国联合网络通信集团有限公司Data processing method and device
CN106664224A (en)*2014-08-202017-05-10华为技术有限公司System and method for metadata enhanced inventory management of a communications system
CN106664224B (en)*2014-08-202020-04-28华为技术有限公司 Method and system for metadata-enhanced inventory management of communication systems
CN105681271A (en)*2014-12-082016-06-15三星电子株式会社Method and apparatus for providing integrity check data
CN105681271B (en)*2014-12-082019-03-29三星电子株式会社The method and apparatus of integrity checking data is provided
US10516677B2 (en)2014-12-082019-12-24Samsung Electronics Co., Ltd.Method and apparatus for providing integrity check data
CN107239542A (en)*2017-06-022017-10-10福建中金在线信息科技有限公司A kind of data statistical approach, device, server and storage medium
CN107864068B (en)*2017-10-232020-11-24北京中创信测科技股份有限公司Application identification system and method based on DPI technology
CN107864068A (en)*2017-10-232018-03-30北京中创信测科技股份有限公司A kind of application identification system and method based on DPI technologies
CN107831842A (en)*2017-12-102018-03-23夏烬楚Intelligent information capture systems based on big data
CN110121175A (en)*2019-04-122019-08-13国家计算机网络与信息安全管理中心It is a kind of for moving the data monitoring method and system of Intelligent terminal for Internet of things
CN112838960A (en)*2019-11-222021-05-25中兴通讯股份有限公司Communication data cleaning method, device, network equipment and storage medium
CN112838960B (en)*2019-11-222024-03-12中兴通讯股份有限公司Communication data cleaning method, device, network equipment and storage medium
CN111988271A (en)*2020-06-302020-11-24联想(北京)有限公司Communication flow processing method and device
CN111988271B (en)*2020-06-302021-11-16联想(北京)有限公司Communication flow processing method and device
CN112671721A (en)*2020-12-112021-04-16浙江万胜智能科技股份有限公司Message analysis method of intelligent electric energy meter
CN113923716A (en)*2021-12-132022-01-11北京赋乐科技有限公司User information acquisition method and device and electronic equipment

Also Published As

Publication numberPublication date
WO2012106861A1 (en)2012-08-16

Similar Documents

PublicationPublication DateTitle
CN102301764A (en) Terminal distribution information acquisition method, data acquisition device and communication system
CN102469435B (en)Method for raising terminal model identification accuracy of mobile terminal and apparatus thereof
CN101754253B (en)General packet radio service (GPRS) end-to-end performance analysis method and system
CN103379136B (en)Compression method and decompression method of log acquisition data, compression apparatus and decompression apparatus of log acquisition data
US20150295807A1 (en)Manipulation of streams of monitoring data
CN102469460B (en) A method and device for identifying illegal international mobile equipment identification codes
US8897745B2 (en)Method and apparatus for optimizing delivery of network usage and billing data
CN102857917B (en)Method for identifying internet access of mobile phone through personal computer (PC) based on signaling analysis
CN105828376A (en)Service quality monitoring method and equipment based on user perception
CN103235793A (en)On-line data processing method, equipment and system
US11075989B2 (en)Cellular network hierarchical operational data storage
CN103729479A (en)Web page content statistical method and system based on distributed file storage
CN101741608A (en)Traffic characteristic-based P2P application identification system and method
CN104506394B (en)A kind of mobile Internet flow statistical method and system
CN101527895B (en)Method and device for obtaining service state information
US10079943B2 (en)Method and system for detecting anomalies in consumption of data and charging of data services
CN105338208B (en)Unified bill charging method and system
CN108322354B (en) A method and device for identifying a sneak traffic account
CN106878965B (en) A method and device for evaluating mobile terminal performance
CN112448911B (en)K-Means-based normal Server IP white list mining method
CN101764761A (en)Method for limiting transmission flow capacity of service provider interfaces and multi-media service gateway
WO2022001480A1 (en)Popular application identification method, network system, network device and storage medium
CN104065490B (en)The system and method for analog transceiver equipment signaling is realized based on online charging environment
CN118118234A (en)Correlation degree distribution measuring method, correlation method and correlation device for anonymous network traffic
CN108616415B (en)Data association method and device

Legal Events

DateCodeTitleDescription
C06Publication
PB01Publication
C10Entry into substantive examination
SE01Entry into force of request for substantive examination
C12Rejection of a patent application after its publication
RJ01Rejection of invention patent application after publication

Application publication date:20111228


[8]ページ先頭

©2009-2025 Movatter.jp