Disclosure of Invention
In view of the foregoing, it is necessary to provide an application service topology generation method, which aims to solve the problems of slow application service topology generation speed and inaccuracy.
An application service topology generation method applied to bypassing a probe collector deployed on a core server, the probe collector in communication with a data analyzer, the application service topology generation method comprising:
In response to an application service topology generation instruction, bypass crawling each network data packet that interacts with an application service on the core server;
Acquiring a process name and a process controller of an upper-layer application service of a home terminal server corresponding to each network data packet by using a netstat command;
Reconstructing each network data packet according to the process name and the process controller of the upper application service of the local end server corresponding to each network data packet to obtain an updated network data packet;
The updated network data packet is sent to a corresponding opposite-end server;
Detecting whether the update network data packets are grabbed or not, and determining each grabbed update network data packet as each target data packet;
analyzing each target data packet to obtain application service information of the opposite terminal server corresponding to each target data packet;
acquiring application service information of the core server, and constructing each reporting group according to the application service information of the core server and the application service information of the opposite end server corresponding to each target data packet;
calculating network quality parameters among each reporting group;
And reporting the network quality parameters among each reporting group, the application service information of the core server and the application service information of the opposite end server corresponding to each target data packet to the data analyzer so as to enable the data analyzer to generate an application service topology.
According to a preferred embodiment of the present invention, the reconstructing each network data packet according to the process name and the process controller of the upper layer application service of the home server corresponding to the each network data packet, to obtain an updated network data packet includes:
acquiring the IP of a local server corresponding to each network data packet;
injecting the IP of the local end server corresponding to each network data packet, the process name and the process control symbol of the upper layer application service of the local end server corresponding to each network data packet into the appointed field of each corresponding network data packet by utilizing libnet functions to obtain the updated network data packet;
Wherein the specified field includes an option field or a payload field.
According to a preferred embodiment of the present invention, after the bypass grabs each network packet interacting with the application service on the core server, the method further comprises:
And analyzing each network data packet by using a deep data packet detection technology to obtain the application service type of the opposite end server corresponding to each network data packet.
According to a preferred embodiment of the present invention, after the parsing of each target data packet, the method further includes:
When detecting that the target data packet does not obtain the corresponding application service information of the opposite terminal server, determining the detected target data packet as a current data packet;
Acquiring an application service type of an opposite end server corresponding to the current data packet as a current application service type;
and constructing a corresponding reporting group by using the current application service type to replace the application service information of the opposite-end server corresponding to the current data packet.
According to a preferred embodiment of the invention:
the network quality parameters include one or a combination of the following: packet loss rate, delay, jitter, high delay reporting rate, and congestion;
The application service information includes one or more of the following combinations: the process name of the application service of the affiliated server, the process controller of the application service of the affiliated server, the IP of the affiliated server and the port of the affiliated server.
An application service topology generation method applied to a data analyzer in communication with a probe collector deployed on a core server in a bypass, the application service topology generation method comprising:
receiving network quality parameters among each reporting group, application service information of the core server and application service information of an opposite end server corresponding to each target data packet from the probe collector by using kafka flow as reporting data;
Preprocessing the reported data to obtain data to be processed;
and generating an application service topology by using the data to be processed.
According to a preferred embodiment of the present invention, before the kafka flow is used to receive, from the probe collector, the network quality parameters between each reporting group, the application service information of the core server, and the application service information of the peer server corresponding to each target data packet as the reporting data, the method further includes:
Detecting whether the data reported by the probe collector is correct or not through a request Body of a spring framework;
And refusing to receive the detected data when detecting that incorrect data exists in the data reported by the probe collector.
According to a preferred embodiment of the present invention, the preprocessing the reported data to obtain data to be processed includes:
Starting a preset number of threads to sequentially read the report data from the kafka stream;
Converting the reported data read by each thread into a preset format to obtain first data; wherein the preset format is a data structure which is easy to store into a topology;
And denoising the first data to obtain the data to be processed.
According to a preferred embodiment of the present invention, the generating an application service topology using the pending data includes:
Extracting a process name from the application service information of the data to be processed;
determining each application service according to the extracted process name, and determining the interaction relation between each application service according to each reporting group of the data to be processed;
each application service is taken as a node, and each node is connected by utilizing the interaction relation among each application service, so that an initial topology is obtained;
Acquiring network quality parameters among each reporting group from the data to be processed;
calculating network quality data of each two application services in interaction according to the network quality parameters among each reporting group;
and adding the network quality data of every two application service interactions to the corresponding two nodes in the initial topology to obtain the application service topology.
According to a preferred embodiment of the present invention, the calculating network quality data when each two application services interact according to the network quality parameters between each reporting group includes:
Acquiring a configured calculation period;
and obtaining the average value of each index in the network quality parameters in the calculation period from the network quality parameters among each reporting group to obtain the network quality data when every two application services interact.
A computer device, the computer device comprising:
A memory storing at least one instruction; and
And the processor executes the instructions stored in the memory to realize the application service topology generation method.
A computer-readable storage medium having stored therein at least one instruction for execution by a processor in a computer device to implement the application service topology generation method.
According to the technical scheme, the probe collector bypass arranged on the core server can bypass and capture each network data packet interacted with the application service on the core server, and analyze and reconstruct each network data packet so as to acquire the application service information of the upper end and the lower end corresponding to each network data packet, construct each reporting group according to the application service information of the upper end and the lower end corresponding to each network data packet, calculate the network quality parameters among each reporting group, and report the application service information and the network quality parameters together to the data analyzer for the data analyzer to generate an application service topology, so that the system resource consumption is lower in a bypass capturing and analyzing mode, and the problem of inaccurate generation of the application service topology caused by IP conversion and internal and external network mapping is effectively solved.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention will be described in detail with reference to the accompanying drawings and specific embodiments.
Fig. 1 is a flowchart of a preferred embodiment of the application service topology generation method of the present invention. The order of the steps in the flowchart may be changed and some steps may be omitted according to various needs.
The Application service topology generation method is applied to one or more computer devices, wherein the computer device is a device capable of automatically performing numerical calculation and/or information processing according to preset or stored instructions, and the hardware of the computer device comprises, but is not limited to, a microprocessor, an Application SPECIFIC INTEGRATED Circuit (ASIC), a Programmable gate array (Field-Programmable GATE ARRAY, FPGA), a digital Processor (DIGITAL SIGNAL Processor, DSP), an embedded device and the like.
The computer device may be any electronic product that can interact with a user in a human-computer manner, such as a Personal computer, a tablet computer, a smart phone, a Personal digital assistant (Personal DIGITAL ASSISTANT, PDA), a game console, an interactive internet protocol television (Internet Protocol Television, IPTV), a smart wearable device, etc.
The computer device may also include a network device and/or a user device. Wherein the network device includes, but is not limited to, a single network server, a server group composed of a plurality of network servers, or a Cloud based Cloud Computing (Cloud Computing) composed of a large number of hosts or network servers.
The server may be an independent server, or may be a cloud server that provides cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (Content Delivery Network, CDN), and basic cloud computing services such as big data and artificial intelligence platforms.
Wherein artificial intelligence (ARTIFICIAL INTELLIGENCE, AI) is the theory, method, technique, and application system that uses a digital computer or a digital computer-controlled machine to simulate, extend, and expand human intelligence, sense the environment, acquire knowledge, and use knowledge to obtain optimal results.
Artificial intelligence infrastructure technologies generally include technologies such as sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing technologies, operation/interaction systems, mechatronics, and the like. The artificial intelligence software technology mainly comprises a computer vision technology, a robot technology, a biological recognition technology, a voice processing technology, a natural language processing technology, machine learning/deep learning and other directions.
The network in which the computer device is located includes, but is not limited to, the internet, a wide area network, a metropolitan area network, a local area network, a virtual private network (Virtual Private Network, VPN), and the like.
The application service topology generation method is applied to a probe collector which bypasses a core server and is communicated with a data analyzer, and comprises the following steps:
and S10, responding to an application service topology generation instruction, and bypassing to capture each network data packet interacted with the application service on the core server.
The application service topology generation instruction can be triggered periodically or by related staff according to actual requirements, and the invention is not limited.
The core server may be a server providing a core application service.
In this embodiment, after the bypass grabs each network packet that interacts with the application service on the core server, the method further includes:
And analyzing each network data packet by using a deep data packet Inspection technology (DEEP PACKET Inspection, DPI) to obtain the application service type of the opposite end server corresponding to each network data packet.
Wherein, the application service type may include, but is not limited to: java service type, HTTP (Hypertext Transfer Protocol ) service type, etc.
In the above embodiment, the application service type can be quickly and safely determined by the deep packet inspection technology.
S11, obtaining a process name and a process controller (Process Identifier, PID) of an upper layer application service of a home terminal server corresponding to each network data packet by using a netstat command.
Wherein the netstat command is a tool for displaying network connection status, routing table and network interface information, which can help the user to understand and monitor the network connection.
S12, reconstructing each network data packet according to the process name and the process control symbol of the upper application service of the local end server corresponding to each network data packet, and obtaining an updated network data packet.
In this embodiment, the reconstructing each network data packet according to the process name and the process controller of the upper layer application service of the home server corresponding to each network data packet, and obtaining the updated network data packet includes:
acquiring the IP of a local server corresponding to each network data packet;
injecting the IP of the local end server corresponding to each network data packet, the process name and the process control symbol of the upper layer application service of the local end server corresponding to each network data packet into the appointed field of each corresponding network data packet by utilizing libnet functions to obtain the updated network data packet;
Wherein the specified field includes an option field or a payload field.
In the above embodiment, by using libnet bypass injection process related information, the network can be penetrated to reach the terminal, the problem that the terminal cannot be reached in application service topology discovery is solved, and the data packet injected in the above manner does not have any influence on the actual service, and the bandwidth occupation is small.
And S13, the updated network data packet is sent to a corresponding opposite-end server.
In the above embodiment, after the reconstructed data packet is sent to the corresponding peer server, the reconstructed data packet may be parsed by the probe collector of the peer.
S14, detecting whether the update network data packets are grabbed, and determining each grabbed update network data packet as each target data packet.
In the above embodiment, whether the update network packet is grabbed may be detected by scanning.
And S15, analyzing each target data packet to obtain application service information of the opposite terminal server corresponding to each target data packet.
Wherein the application service information may include, but is not limited to, one or more of the following:
The process name of the application service of the affiliated server, the process controller of the application service of the affiliated server, the IP of the affiliated server and the port of the affiliated server.
S16, acquiring application service information of the core server, and constructing each reporting group according to the application service information of the core server and the application service information of the opposite end server corresponding to each target data packet.
For example: one report group may include: the system comprises the core server and an opposite end server which is interacted with the core server.
In this embodiment, after the parsing of each target data packet, the method further includes:
When detecting that the target data packet does not obtain the corresponding application service information of the opposite terminal server, determining the detected target data packet as a current data packet;
Acquiring an application service type of an opposite end server corresponding to the current data packet as a current application service type;
and constructing a corresponding reporting group by using the current application service type to replace the application service information of the opposite-end server corresponding to the current data packet.
Through the above embodiment, when it is detected that the target data packet does not obtain the application service information of the corresponding peer server, the application service type of the peer server corresponding to each network data packet analyzed by using the deep data packet detection technology is substituted for the corresponding application service information, so as to avoid affecting the normal construction of the reporting group.
S17, calculating network quality parameters among each reporting group.
In this embodiment, the network quality parameters may include, but are not limited to, one or more of the following:
Packet loss rate, delay, jitter, high delay reporting rate, and congestion.
And S18, reporting the network quality parameters among each reporting group, the application service information of the core server and the application service information of the opposite end server corresponding to each target data packet to the data analyzer so as to enable the data analyzer to generate an application service topology.
For example: the data reported to the data analyzer corresponding to a reporting group may include: the method comprises the steps of processing names of application services of a core server, processing controllers of the application services of the core server, IP of the core server, ports of the core server, processing names of the application services of any opposite end server, processing controllers of the application services of any opposite end server, IP of any opposite end server, ports of any opposite end server, and network quality parameters such as packet loss rate, delay, jitter, high delay reporting rate, congestion and the like between the application services of the core server and the application services of any opposite end server.
According to the embodiment, the upstream and downstream services can be found only by deploying the probe collector at the key node (namely the core server), and a complete application service topology is generated rapidly, so that the labor cost is reduced effectively, the real-time updating can be realized, and meanwhile, the problem that the end-to-end service cannot be corresponding due to the IP conversion problem and the intranet-extranet problem is solved.
According to the technical scheme, the probe collector bypass arranged on the core server can bypass and capture each network data packet interacted with the application service on the core server, and analyze and reconstruct each network data packet so as to acquire the application service information of the upper end and the lower end corresponding to each network data packet, construct each reporting group according to the application service information of the upper end and the lower end corresponding to each network data packet, calculate the network quality parameters among each reporting group, and report the application service information and the network quality parameters together to the data analyzer for the data analyzer to generate an application service topology, so that the system resource consumption is lower in a bypass capturing and analyzing mode, and the problem of inaccurate generation of the application service topology caused by IP conversion and internal and external network mapping is effectively solved.
Fig. 2 is a flow chart of another preferred embodiment of the application service topology generation method of the present invention.
The application service topology generation method is applied to a data analyzer in communication with a probe collector that is bypassed on a core server, comprising:
s20, the kafka flow is adopted to receive the network quality parameters among each reporting group, the application service information of the core server and the application service information of the opposite end server corresponding to each target data packet from the probe collector as reporting data.
In this embodiment, before the kafka flow is used to receive, from the probe collector, the network quality parameters between each reporting group, the application service information of the core server, and the application service information of the peer server corresponding to each target data packet as the reporting data, the method further includes:
Detecting whether the data reported by the probe collector is correct or not through a request Body of a spring framework;
And refusing to receive the detected data when detecting that incorrect data exists in the data reported by the probe collector.
Through the embodiment, the data reported by the probe collector can be filtered before the data is stored in the kafka stream, so that incomplete or erroneous invalid data packets are prevented from being received, and the accuracy of subsequent analysis is further ensured.
S21, preprocessing the reported data to obtain data to be processed.
In this embodiment, the preprocessing the reported data to obtain the data to be processed includes:
Starting a preset number of threads to sequentially read the report data from the kafka stream;
Converting the reported data read by each thread into a preset format to obtain first data; wherein the preset format is a data structure which is easy to store into a topology;
And denoising the first data to obtain the data to be processed.
In the above embodiments, the combination of multithreading and kafka streams enables low latency, high throughput of the processing procedure; meanwhile, the received data can be standardized by preprocessing, so that the accuracy of subsequent analysis is improved.
S22, generating an application service topology by using the data to be processed.
In this embodiment, the generating an application service topology using the data to be processed includes:
Extracting a process name from the application service information of the data to be processed;
determining each application service according to the extracted process name, and determining the interaction relation between each application service according to each reporting group of the data to be processed;
each application service is taken as a node, and each node is connected by utilizing the interaction relation among each application service, so that an initial topology is obtained;
Acquiring network quality parameters among each reporting group from the data to be processed;
calculating network quality data of each two application services in interaction according to the network quality parameters among each reporting group;
and adding the network quality data of every two application service interactions to the corresponding two nodes in the initial topology to obtain the application service topology.
The determining the interaction relationship between each application service according to each report group of the data to be processed comprises the following steps:
and extracting interaction parties from each reporting group, and determining the interaction relation between each application service according to the interaction parties.
The calculating the network quality data when each two application services interact according to the network quality parameters between each reporting group comprises:
Acquiring a configured calculation period;
and obtaining the average value of each index in the network quality parameters in the calculation period from the network quality parameters among each reporting group to obtain the network quality data when every two application services interact.
For example: taking the delay in the network quality parameter as an example, when the calculation period is 6 seconds and the reporting frequency is reporting once every 3 seconds, two delays are shared in the calculation period within 6 seconds, and the average delay of the two delays needs to be calculated, and other indexes are similar and are not repeated herein.
Of course, the calculation period may be configured according to actual requirements, such as a day, an hour, and the like.
The application service topology established in the mode not only comprises the interaction paths (comprising application service nodes, calling relations among application services and the like) among the application services, but also can reflect the network quality during interaction, and provides an intuitive network performance view for users.
In this embodiment, each target data packet may be further parsed to obtain an application service identifier, and the application service identifier may be added to the established application service topology, so as to further enrich the information content of the topology map. For example: each target data packet can identify the application service, and each target data packet can comprise the source process ID and the source process name of the two interactive servers, and the destination process ID and the destination process name.
In this embodiment, the interaction data and the network quality parameters between the application services may also be reported to the operation and maintenance server in the form of a report, so as to monitor the network state and alarm the performance. Specifically, when the network quality is lower than a certain threshold, an alarm mechanism is triggered, and an operation and maintenance team can be timely informed in a mail, a short message or a system notification mode, so that adverse effects caused by network abnormality are avoided.
In this embodiment, the generated application service topology may be displayed on a specified user interface, so that a user may easily browse and understand the application service topology, including service nodes, inter-service dependencies, network quality parameters, and the like. The user interface may also support interactive operations, such as zooming in, zooming out, dragging views, etc., to enable a user to more conveniently operate on the application service topology.
In this embodiment, in order to keep the generated application service topology in the latest state, the earliest data (such as data before cleaning for one month) may be deleted at regular intervals, and the current application service topology is backed up, so as to ensure the stability of the system and the security of the data.
In this embodiment, the application service topology may be updated in regular increments, where nodes and interaction paths (i.e., connection relationships between nodes) not included in the application service topology are updated to the application service topology, and network quality parameters during interaction between every two nodes are updated, so that the application service topology is more and more complete through continuous updating.
According to the method and the system for generating the application service topology, the interaction relation between the application services can be established through the generated application service topology, the interaction condition between the application services and middleware such as database services and redis services can be expanded, the network interaction condition among all components of the service cluster is monitored in real time, namely, the network condition among the application services is monitored in real time, and network fault points are quickly and early-warned and quickly positioned, so that an automatic discovery, monitoring and warning process is formed, the labor cost is effectively reduced, and the complexity and inaccuracy of manually establishing the application service topology are solved.
According to the technical scheme, the kafka flow can be adopted to receive the network quality parameters among each reporting group, the application service information of the core server and the application service information of the opposite end server corresponding to each target data packet from the probe collector as the reporting data, so that the flow processing capacity of the data is improved; preprocessing the reported data to obtain data to be processed, and because the data are subjected to standardized processing, the accuracy of subsequent analysis can be ensured; and generating an application service topology by utilizing the data to be processed, and no manual operation is needed, so that the generation efficiency is improved.
Fig. 3 is a functional block diagram of a preferred embodiment of the application service topology generation apparatus of the present invention. The application service topology generating device 11 includes a grasping unit 110, an acquiring unit 111, a constructing unit 112, a transmitting unit 113, a detecting unit 114, an analyzing unit 115, a constructing unit 116, a calculating unit 117, and a reporting unit 118. The module/unit referred to in the present invention refers to a series of computer program segments, which are stored in a memory, capable of being executed by a processor and of performing a fixed function. In the present embodiment, the functions of the respective modules/units will be described in detail in the following embodiments.
The application service topology generation device 11 operates to bypass a probe collector deployed on a core server, the probe collector being in communication with a data analyzer, comprising:
the crawling unit 110 is configured to bypass crawling each network data packet interacted with an application service on the core server in response to an application service topology generation instruction;
The obtaining unit 111 is configured to obtain a process name and a process controller of an upper layer application service of a home server corresponding to each network data packet by using a netstat command;
The constructing unit 112 is configured to reconstruct each network data packet according to the process name and the process controller of the upper layer application service of the home server corresponding to each network data packet, so as to obtain an updated network data packet;
the sending unit 113 is configured to send the update network data packet to a corresponding peer server;
The detecting unit 114 is configured to detect whether the update network data packets are grabbed, and determine each grabbed update network data packet as each target data packet;
The parsing unit 115 is configured to parse each target data packet to obtain application service information of the peer server corresponding to each target data packet;
The construction unit 116 is configured to obtain application service information of the core server, and construct each reporting group according to the application service information of the core server and application service information of the peer server corresponding to each target data packet;
the calculating unit 117 is configured to calculate a network quality parameter between each reporting group;
The reporting unit 118 is configured to report the network quality parameters between each reporting group, the application service information of the core server, and the application service information of the peer server corresponding to each target data packet to the data analyzer, so that the data analyzer generates an application service topology.
According to the technical scheme, the probe collector bypass arranged on the core server can bypass and capture each network data packet interacted with the application service on the core server, and analyze and reconstruct each network data packet so as to acquire the application service information of the upper end and the lower end corresponding to each network data packet, construct each reporting group according to the application service information of the upper end and the lower end corresponding to each network data packet, calculate the network quality parameters among each reporting group, and report the application service information and the network quality parameters together to the data analyzer for the data analyzer to generate an application service topology, so that the system resource consumption is lower in a bypass capturing and analyzing mode, and the problem of inaccurate generation of the application service topology caused by IP conversion and internal and external network mapping is effectively solved.
FIG. 4 is a functional block diagram of a preferred embodiment of the application service topology generation system of the present invention. The application service topology generation system 22 comprises a receiving module 220, a preprocessing module 221, and a generating module 222. The module/unit referred to in the present invention refers to a series of computer program segments, which are stored in a memory, capable of being executed by a processor and of performing a fixed function. In the present embodiment, the functions of the respective modules/units will be described in detail in the following embodiments.
The application service topology generation system 22 operates on a data analyzer in communication with a probe collector deployed on a core server in bypass, comprising:
the receiving module 220 is configured to receive, from the probe collector, network quality parameters between each reporting group, application service information of the core server, and application service information of an opposite end server corresponding to each target data packet as reporting data by using a kafka flow;
The preprocessing module 221 is configured to preprocess the reported data to obtain data to be processed;
the generating module 222 is configured to generate an application service topology using the data to be processed.
According to the technical scheme, the kafka flow can be adopted to receive the network quality parameters among each reporting group, the application service information of the core server and the application service information of the opposite end server corresponding to each target data packet from the probe collector as the reporting data, so that the flow processing capacity of the data is improved; preprocessing the reported data to obtain data to be processed, and because the data are subjected to standardized processing, the accuracy of subsequent analysis can be ensured; and generating an application service topology by utilizing the data to be processed, and no manual operation is needed, so that the generation efficiency is improved.
Fig. 5 is a schematic structural diagram of a computer device according to a preferred embodiment of the present invention for implementing the application service topology generation method.
The computer device 1 may comprise a memory 12, a processor 13 and a bus, and may further comprise a computer program, such as an application service topology generation program, stored in the memory 12 and executable on the processor 13.
It will be appreciated by those skilled in the art that the schematic diagram is merely an example of the computer device 1 and does not constitute a limitation of the computer device 1, the computer device 1 may be a bus type structure, a star type structure, the computer device 1 may further comprise more or less other hardware or software than illustrated, or a different arrangement of components, for example, the computer device 1 may further comprise an input-output device, a network access device, etc.
It should be noted that the computer device 1 is only used as an example, and other electronic products that may be present in the present invention or may be present in the future are also included in the scope of the present invention by way of reference.
The memory 12 includes at least one type of readable storage medium including flash memory, a removable hard disk, a multimedia card, a card memory (e.g., SD or DX memory, etc.), a magnetic memory, a magnetic disk, an optical disk, etc. The memory 12 may in some embodiments be an internal storage unit of the computer device 1, such as a removable hard disk of the computer device 1. The memory 12 may also be an external storage device of the computer device 1 in other embodiments, such as a plug-in mobile hard disk, a smart memory card (SMART MEDIA CARD, SMC), a Secure Digital (SD) card, a flash memory card (FLASH CARD) or the like, which are provided on the computer device 1. Further, the memory 12 may also include both an internal storage unit and an external storage device of the computer device 1. The memory 12 may be used not only for storing application software installed in the computer device 1 and various types of data, such as code of an application service topology generation program, but also for temporarily storing data that has been output or is to be output.
The processor 13 may be comprised of integrated circuits in some embodiments, for example, a single packaged integrated circuit, or may be comprised of multiple integrated circuits packaged with the same or different functions, including one or more central processing units (Central Processing unit, CPU), microprocessors, digital processing chips, graphics processors, various control chips, and the like. The processor 13 is a Control Unit (Control Unit) of the computer device 1, connects the respective components of the entire computer device 1 using various interfaces and lines, executes or executes programs or modules (for example, executes an application service topology generation program or the like) stored in the memory 12, and invokes data stored in the memory 12 to perform various functions of the computer device 1 and process data.
The processor 13 executes the operating system of the computer device 1 and various types of applications installed. The processor 13 executes the application program to implement the steps of the various application service topology generation method embodiments described above, such as the steps shown in fig. 1-2.
Illustratively, the computer program may be partitioned into one or more modules/units that are stored in the memory 12 and executed by the processor 13 to complete the present invention. The one or more modules/units may be a series of computer readable instruction segments capable of performing the specified functions, which instruction segments describe the execution of the computer program in the computer device 1. For example, the computer program may be divided into a grabbing unit 110, an obtaining unit 111, a constructing unit 112, a sending unit 113, a detecting unit 114, a parsing unit 115, a constructing unit 116, a calculating unit 117, a reporting unit 118, and/or a receiving module 220, a preprocessing module 221, a generating module 222.
The integrated units implemented in the form of software functional modules described above may be stored in a computer readable storage medium. The software functional module is stored in a storage medium, and includes several instructions for causing a computer device (which may be a personal computer, a computer device, or a network device, etc.) or a processor (processor) to execute portions of the application service topology generation method according to the embodiments of the present invention.
The modules/units integrated in the computer device 1 may be stored in a computer readable storage medium if implemented in the form of software functional units and sold or used as separate products. Based on this understanding, the present invention may also be implemented by a computer program for instructing a relevant hardware device to implement all or part of the procedures of the above-mentioned embodiment method, where the computer program may be stored in a computer readable storage medium and the computer program may be executed by a processor to implement the steps of each of the above-mentioned method embodiments.
Wherein the computer program comprises computer program code which may be in source code form, object code form, executable file or some intermediate form etc. The computer readable medium may include: any entity or device capable of carrying the computer program code, a recording medium, a U disk, a removable hard disk, a magnetic disk, an optical disk, a computer Memory, a Read-Only Memory (ROM), a random access Memory, or the like.
Further, the computer-readable storage medium may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function, and the like; the storage data area may store data created from the use of blockchain nodes, and the like.
The blockchain is a novel application mode of computer technologies such as distributed data storage, point-to-point transmission, consensus mechanism, encryption algorithm and the like. The blockchain (Blockchain), essentially a de-centralized database, is a string of data blocks that are generated in association using cryptographic methods, each of which contains information from a batch of network transactions for verifying the validity (anti-counterfeit) of its information and generating the next block. The blockchain may include a blockchain underlying platform, a platform product services layer, an application services layer, and the like.
The bus may be a peripheral component interconnect standard (PERIPHERAL COMPONENT INTERCONNECT, PCI) bus, or an extended industry standard architecture (extended industry standard architecture, EISA) bus, among others. The bus may be classified as an address bus, a data bus, a control bus, etc. For ease of illustration, only one straight line is shown in fig. 5, but not only one bus or one type of bus. The bus is arranged to enable a connection communication between the memory 12 and at least one processor 13 or the like.
Although not shown, the computer device 1 may further comprise a power source (such as a battery) for powering the various components, preferably the power source may be logically connected to the at least one processor 13 via a power management means, whereby the functions of charge management, discharge management, and power consumption management are achieved by the power management means. The power supply may also include one or more of any of a direct current or alternating current power supply, recharging device, power failure detection circuit, power converter or inverter, power status indicator, etc. The computer device 1 may further include various sensors, bluetooth modules, wi-Fi modules, etc., which will not be described in detail herein.
Further, the computer device 1 may also comprise a network interface, optionally comprising a wired interface and/or a wireless interface (e.g. WI-FI interface, bluetooth interface, etc.), typically used for establishing a communication connection between the computer device 1 and other computer devices.
The computer device 1 may optionally further comprise a user interface, which may be a Display, an input unit, such as a Keyboard (Keyboard), or a standard wired interface, a wireless interface. Alternatively, in some embodiments, the display may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, an OLED (Organic Light-Emitting Diode) touch, or the like. The display may also be referred to as a display screen or display unit, as appropriate, for displaying information processed in the computer device 1 and for displaying a visual user interface.
It should be understood that the embodiments described are for illustrative purposes only and are not limited to this configuration in the scope of the patent application.
Fig. 5 shows only a computer device 1 with components 12-13, it will be understood by those skilled in the art that the structure shown in fig. 5 is not limiting of the computer device 1 and may include fewer or more components than shown, or may combine certain components, or a different arrangement of components.
In connection with fig. 1, the memory 12 in the computer device 1 stores a plurality of instructions to implement an application service topology generation method, the processor 13 being executable to implement:
In response to an application service topology generation instruction, bypass crawling each network data packet that interacts with an application service on the core server;
Acquiring a process name and a process controller of an upper-layer application service of a home terminal server corresponding to each network data packet by using a netstat command;
Reconstructing each network data packet according to the process name and the process controller of the upper application service of the local end server corresponding to each network data packet to obtain an updated network data packet;
The updated network data packet is sent to a corresponding opposite-end server;
Detecting whether the update network data packets are grabbed or not, and determining each grabbed update network data packet as each target data packet;
analyzing each target data packet to obtain application service information of the opposite terminal server corresponding to each target data packet;
acquiring application service information of the core server, and constructing each reporting group according to the application service information of the core server and the application service information of the opposite end server corresponding to each target data packet;
calculating network quality parameters among each reporting group;
And reporting the network quality parameters among each reporting group, the application service information of the core server and the application service information of the opposite end server corresponding to each target data packet to the data analyzer so as to enable the data analyzer to generate an application service topology.
In connection with fig. 2, the memory 12 in the computer device 1 stores a plurality of instructions to implement an application service topology generation method, the processor 13 being executable to implement:
receiving network quality parameters among each reporting group, application service information of the core server and application service information of an opposite end server corresponding to each target data packet from the probe collector by using kafka flow as reporting data;
Preprocessing the reported data to obtain data to be processed;
and generating an application service topology by using the data to be processed.
In particular, the specific implementation method of the above instructions by the processor 13 may refer to the description of the relevant steps in the corresponding embodiment of fig. 1-2, which is not repeated herein.
The data in this case were obtained legally.
In the several embodiments provided in the present invention, it should be understood that the disclosed systems, devices, and methods may be implemented in other manners. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the modules is merely a logical function division, and there may be other manners of division when actually implemented.
The invention is operational with numerous general purpose or special purpose computer system environments or configurations. For example: personal computers, server computers, hand-held or portable devices, tablet devices, multiprocessor systems, microprocessor-based systems, set top boxes, programmable consumer electronics, network PCs, minicomputers, mainframe computers, distributed computing environments that include any of the above systems or devices, and the like. The invention may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. The invention may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.
The modules described as separate components may or may not be physically separate, and components shown as modules may or may not be physical units, may be located in one place, or may be distributed over multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional module in the embodiments of the present invention may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units can be realized in a form of hardware or a form of hardware and a form of software functional modules.
It will be evident to those skilled in the art that the invention is not limited to the details of the foregoing illustrative embodiments, and that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof.
The present embodiments are, therefore, to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference signs in the claims shall not be construed as limiting the claim concerned.
Furthermore, it is evident that the word "comprising" does not exclude other elements or steps, and that the singular does not exclude a plurality. The units or means stated in the invention may also be implemented by one unit or means, either by software or hardware. The terms first, second, etc. are used to denote a name, but not any particular order.
Finally, it should be noted that the above-mentioned embodiments are merely for illustrating the technical solution of the present invention and not for limiting the same, and although the present invention has been described in detail with reference to the preferred embodiments, it should be understood by those skilled in the art that modifications and equivalents may be made to the technical solution of the present invention without departing from the spirit and scope of the technical solution of the present invention.