In this embodiment, a response parameter of a corresponding type and a corresponding level is obtained from the preset baseline data, a difference between the response parameter of the corresponding type and the corresponding level in the log output by the distributed file system to be monitored and the preset baseline data of the corresponding type and the corresponding level is calculated, and the deviation value is equal to an absolute value of the difference divided by the second average response parameter of the type and the corresponding level corresponding to the log in the preset baseline data.

Illustratively, the response parameter Y is obtained, Y represents an average response parameter of a first level of the uploading operation, a second average response parameter a of the corresponding first level of the uploading operation in the preset baseline data is obtained, and a deviation value Z of the monitoring data and the preset baseline data is ═ Y-a | ÷ a.

S17: and judging whether each deviation value is within a preset deviation threshold value range.

In this embodiment, a deviation threshold may be preset, for example, the preset deviation threshold is set to 10%, each calculated deviation value is compared with the preset deviation threshold, and whether each deviation value is within a preset deviation value threshold range is determined.

In this embodiment, by calculating the deviation values of the response parameters of different levels in different types and the preset baseline data, the deviation values of the response parameters of the log output by the distributed file system to be monitored in the same operation type and the response parameters of the same type-level corresponding to the historical log can be determined at the first time, and whether the deviation values are within the preset deviation threshold range or not is determined, so that whether the data in the specific level corresponding to the specific operation type is abnormal or not can be rapidly determined, the operation and maintenance efficiency is improved, and the operation stability of the distributed file system is ensured.

When it is determined that each deviation value satisfies within the preset deviation threshold range, performing step S18; when it is determined that at least one deviation value is not within the preset deviation threshold range, step S19 is performed.

S18: and outputting the result that the distributed file system operates normally.

In this embodiment, when each deviation value of the log output by the distributed file system to be monitored is within the preset deviation threshold range, it is determined that each deviation value of the data of the log output by the distributed file system to be monitored meets the requirement, and no abnormal data appears, and a result that the distributed file system operates normally is output.

S19: and outputting the abnormal operation result of the distributed file system.

In this embodiment, when one of the deviation values of the logs output by the distributed file system to be monitored is not within the preset deviation threshold range, it is determined that the data in the log corresponding to the deviation value which is not within the preset deviation threshold range is abnormal, which causes the distributed file system to operate abnormally, and the abnormal result is output.

Further, after the outputting the result of the distributed file system running exception, the method further includes:

and sending alarm information to an administrator.

In this embodiment, after the distributed file system outputs a result of an abnormal operation, the alarm information carrying the abnormal result is sent to an administrator, where the alarm information includes a specific operation type of abnormal data and a specific level corresponding to the specific operation type of the abnormal data.

Further, after sending the alarm information to the administrator, the method further includes:

In the embodiment, the alarm information is sent to the administrator to inform the administrator that the data in the specific grade in the specific operation type is abnormal and identify the abnormal data in the log output by the distributed file system to be monitored, so that the administrator can directly position the abnormal data and perform later maintenance conveniently, the time for checking the abnormal data is shortened, the operation and maintenance efficiency is improved, and meanwhile, the operation stability of the distributed file system is improved, the user experience is improved, and the operation stability of the distributed file system is ensured.

In summary, in the monitoring method for the distributed file system according to the present invention, the log output by the distributed file system to be monitored is obtained; identifying the operation type of each row of data in the log; classifying the data in the log according to the operation type; dividing data of the same operation type into different grades; calculating the response parameter of each grade in the same operation type; calculating deviation values of the response parameters and corresponding preset baseline data; judging whether each deviation value is within a preset deviation threshold range; when each deviation value is determined to be within a preset deviation threshold value range, outputting a result that the distributed file system normally operates; and when one deviation value is determined not to be within the preset deviation threshold value range, outputting the result of abnormal operation of the distributed file system. According to the method and the device, the deviation value of the response parameter of different levels in different types and the preset baseline data is calculated, whether each deviation value meets the preset threshold range or not is judged, the log in the specific level corresponding to the specific operation type can be quickly determined to be abnormal, the time for troubleshooting abnormal data is shortened, the operation and maintenance efficiency is improved, the user experience is improved, and the operation stability of the distributed file system is ensured.

Example two

In some embodiments, the monitoring device 20 of the distributed file system may comprise a plurality of functional modules consisting of program code segments. The program code of the various program segments in the monitoring means 20 of the distributed file system may be stored in a memory of the terminal and executed by the at least one processor to perform (see detailed description of fig. 1) the monitoring of the presence of the distributed file system.

In this embodiment, the monitoring apparatus 20 of the distributed file system may be divided into a plurality of functional modules according to the functions executed by the monitoring apparatus. The functional module may include: the system comprises anacquisition module 201, arecognition module 202, aclassification module 203, adivision module 204, afirst calculation module 205, asecond calculation module 206, acreation module 207, ajudgment module 208, anoutput module 209, a sendingmodule 210 and anidentification module 211. The module referred to herein is a series of computer program segments capable of being executed by at least one processor and capable of performing a fixed function and is stored in memory. In the present embodiment, the functions of the modules will be described in detail in the following embodiments.

The acquisition module 201: the method is used for acquiring the log output by the distributed file system to be monitored.

The identification module 202: for identifying the type of operation of each line of data in the log.

The classification module 203: the operation type is used for classifying the data in the log according to the operation type.

The dividing module 204: for dividing data of the same operation type into different levels.

In this embodiment, the level may be set according to a size range of data or a type of the data, where the type of the data may include: text files, video files, audio files, picture files, and the like. In other embodiments, the division of the levels may also be defined according to actual situations, and the invention is not limited herein.

The first calculation module 205: for calculating the response parameters for each step in the same operation type.

Preferably, the calculating the response parameter of each level in the same operation type by thefirst calculating module 205 includes:

The second calculation module 206: and the deviation value of the response parameter and the corresponding preset baseline data is calculated.

Preferably, before thesecond calculating module 206 calculates the deviation value between the response parameter of different levels of the different types and the preset baseline data, the monitoring apparatus of the distributed file system further includes:

the creation module 207: for pre-creating baseline data.

Preferably, the process of creating the preset baseline data by the creatingmodule 207 includes:

acquiring a historical log in a preset time period;

identifying the operation type of each row of data in each sub-history log;

classifying the data in each sub-history log according to the operation type;

In this embodiment, a time period may be preset, a history log in a preset time period is obtained, the history log is equally divided into n parts according to time information carried by the history log, for example, the preset time period is 30 days, and the history log of each day is divided into 30 parts according to the time carried by the history log. And identifying the operation type in each sub-history log, dividing the same operation type according to different grades, and calculating a first average response parameter of each sub-history log with the same grade in the same operation type. And calculating a second average response parameter of each sub-historical log in a preset time period according to the first average response parameter to obtain preset baseline data of the historical log response parameters.

First calculation of a first average response parameter

TABLE II calculates second average response parameter

Preferably, the calculating, by thesecond calculating module 206, the deviation value between the response parameter and the corresponding preset baseline data includes:

acquiring preset baseline data of a corresponding type-grade;

In this embodiment, the target preset baseline data refers to response parameters of the same type and the same level corresponding to the type and the level in the log, a difference between the response parameters of the same level in the same operation type in the log output by the distributed file system to be monitored and the target preset baseline data corresponding to the type and the level is calculated, and the difference is equal to an absolute value of the difference divided by the second average response parameter of the type-level corresponding to the log in the preset baseline data.

The judging module 208: and the deviation value judging module is used for judging whether each deviation value is within a preset deviation threshold value range.

The output module 209: when the judgingmodule 208 determines that each deviation value meets the preset deviation threshold range, outputting a result that the distributed file system operates normally.

In this embodiment, when each deviation value of the log output by the distributed file system to be monitored is within the preset deviation threshold range, it is determined that each deviation value in the data of the log output by the distributed file system to be monitored meets the requirement, no abnormal data occurs, and a result that the distributed file system operates normally is output.

The output module 209: and is further configured to output a result of abnormal operation of the distributed file system when the determiningmodule 208 determines that at least one deviation value does not meet the preset deviation threshold range.

Further, after theoutput module 209 outputs the result of the abnormal operation of the distributed file system, the monitoring apparatus of the distributed file system further includes:

the sending module 210: for sending alarm information to the administrator.

Further, after the sendingmodule 210 sends the warning message to the administrator, the monitoring apparatus of the distributed file system further includes:

the identification module 211: the method is used for identifying abnormal data in the log output by the distributed file system to be monitored.

In summary, the monitoring device for a distributed file system according to the present invention obtains the log output by the distributed file system to be monitored; identifying the operation type of each row of data in the log; classifying the data in the log according to the operation type; dividing data of the same operation type into different grades; calculating the response parameter of each grade in the same operation type; calculating deviation values of the response parameters and corresponding preset baseline data; judging whether each deviation value is within a preset deviation threshold range; when each deviation value is determined to be within a preset deviation threshold value range, outputting a result that the distributed file system normally operates; and when one deviation value is determined not to be within the preset deviation threshold value range, outputting the result of abnormal operation of the distributed file system. According to the method and the device, the deviation value of the response parameter of different levels in different types and the preset baseline data is calculated, whether each deviation value meets the preset threshold range is judged, the log in the specific level corresponding to the specific operation type can be quickly determined to be abnormal, the time for troubleshooting abnormal data is shortened, the operation and maintenance efficiency is improved, the user experience is improved, and the operation stability of the distributed file system is ensured.

EXAMPLE III

Fig. 3 is a schematic structural diagram of a terminal according to a third embodiment of the present invention. In the preferred embodiment of the present invention, theterminal 3 includes amemory 31, at least oneprocessor 32, at least onecommunication bus 33, and atransceiver 34.

It will be appreciated by those skilled in the art that the configuration of the terminal shown in fig. 3 is not limiting to the embodiments of the present invention, and may be a bus-type configuration or a star-type configuration, and theterminal 3 may include more or less hardware or software than those shown, or a different arrangement of components.

In some embodiments, theterminal 3 is a terminal capable of automatically performing numerical calculation and/or information processing according to preset or stored instructions, and the hardware includes but is not limited to a microprocessor, an application specific integrated circuit, a programmable gate array, a digital processor, an embedded device, and the like. Theterminal 3 may further include a client device, which includes, but is not limited to, any electronic product capable of performing human-computer interaction with a client through a keyboard, a mouse, a remote controller, a touch panel, or a voice control device, for example, a personal computer, a tablet computer, a smart phone, a digital camera, and the like.

It should be noted that theterminal 3 is only an example, and other existing or future electronic products, such as those that can be adapted to the present invention, should also be included in the scope of the present invention, and are included herein by reference.

In some embodiments, thememory 31 is used for storing program codes and various data, such as the monitoring device 20 of the distributed file system installed in theterminal 3, and realizes high-speed and automatic access to programs or data during the operation of theterminal 3. TheMemory 31 includes a Read-Only Memory (ROM), a Programmable Read-Only Memory (PROM), an Erasable Programmable Read-Only Memory (EPROM), a One-time Programmable Read-Only Memory (OTPROM), an Electrically Erasable rewritable Read-Only Memory (EEPROM), and a compact disc Read-Only Memory (CD-ROM). In addition, thememory 31 may also include a non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), at least one magnetic disk storage device, or other non-volatile solid state storage device.

In some embodiments, the at least oneprocessor 32 may be composed of an integrated circuit, for example, a single packaged integrated circuit, or may be composed of a plurality of integrated circuits packaged with the same or different functions, including one or more Central Processing Units (CPUs), microprocessors, digital Processing chips, graphics processors, and combinations of various control chips. The at least oneprocessor 32 is a Control Unit (Control Unit) of theterminal 3, connects various components of theentire terminal 3 by using various interfaces and lines, and executes various functions of theterminal 3 and processes data, such as monitoring of a distributed file system, by running or executing programs or modules stored in thememory 31 and calling data stored in thememory 31.

In some embodiments, the at least onecommunication bus 33 is arranged to enable connection communication between thememory 31 and the at least oneprocessor 32 or the like.

Although not shown, theterminal 3 may further include a power supply (such as a battery) for supplying power to various components, and preferably, the power supply may be logically connected to the at least oneprocessor 32 through a power management device, so as to implement functions of managing charging, discharging, and power consumption through the power management device. The power supply may also include any component of one or more dc or ac power sources, recharging devices, power failure detection circuitry, power converters or inverters, power status indicators, and the like. Theterminal 3 may further include various sensors, a bluetooth module, a Wi-Fi module, and the like, which are not described herein again.

It is to be understood that the described embodiments are for purposes of illustration only and that the scope of the appended claims is not limited to such structures.

The integrated unit implemented in the form of a software functional module may be stored in a computer-readable storage medium. The software functional module is stored in a storage medium and includes several instructions to enable a computer device (which may be a personal computer, a terminal, or a network device) or a processor (processor) to execute parts of the methods according to the embodiments of the present invention.

In a further embodiment, in conjunction with fig. 2, the at least oneprocessor 32 may execute operating means of theterminal 3 and various installed application programs (such as the monitoring means 20 of the distributed file system), program code, etc., such as the respective modules described above.

Thememory 31 has program code stored therein, and the at least oneprocessor 32 can call the program code stored in thememory 31 to perform related functions. For example, the modules illustrated in fig. 2 are program code stored in thememory 31 and executed by the at least oneprocessor 32, so as to implement the functions of the modules for the purpose of monitoring the distributed file system.

In one embodiment of the invention, thememory 31 stores a plurality of instructions that are executed by the at least oneprocessor 32 to enable monitoring of a distributed file system.

Specifically, the at least oneprocessor 32 may refer to the description of the relevant steps in the embodiment corresponding to fig. 1, and details are not repeated here.

Example four

An embodiment of the present invention further provides a computer-readable storage medium, where computer-executable instructions are stored on the computer-readable storage medium, and when executed by a processor of a computer device, the instructions implement a monitoring method for a distributed file system, where the monitoring method for the distributed file system includes:

acquiring a log output by a distributed file system to be monitored;

identifying the operation type of each row of data in the log;

classifying the data in the log according to the operation type;

dividing data of the same operation type into different grades;

calculating the response parameter of each grade in the same operation type;

Specifically, the instructions executed by the processor to implement the monitoring of the distributed file system may refer to the description of the relevant steps in the embodiment corresponding to fig. 1, which is not repeated herein.

In the embodiments provided in the present invention, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the modules is only one logical functional division, and other divisions may be realized in practice.

The modules described as separate parts may or may not be physically separate, and parts displayed as modules may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment.

In addition, functional modules in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional module.

It will be evident to those skilled in the art that the invention is not limited to the details of the foregoing illustrative embodiments, and that the present invention may be embodied in other specific forms without departing from the spirit or essential attributes thereof. The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein. Any reference sign in a claim should not be construed as limiting the claim concerned. Furthermore, it is obvious that the word "comprising" does not exclude other elements or that the singular does not exclude the plural. A plurality of units or means recited in the apparatus claims may also be implemented by one unit or means in software or hardware. The terms first, second, etc. are used to denote names, but not any particular order.

Finally, it should be noted that the above embodiments are only for illustrating the technical solutions of the present invention and not for limiting, and although the present invention is described in detail with reference to the preferred embodiments, it should be understood by those skilled in the art that modifications or equivalent substitutions may be made on the technical solutions of the present invention without departing from the spirit and scope of the technical solutions of the present invention.

Claims

1. A method for monitoring a distributed file system, the method comprising:

acquiring a log output by a distributed file system to be monitored;

identifying the operation type of each row of data in the log;

classifying the data in the log according to the operation type;

dividing data of the same operation type into different grades;

calculating the response parameter of each grade in the same operation type;

2. The method of claim 1, wherein calculating the response parameter for each profile in the same operation type comprises:

3. The method of claim 1, wherein the creation of the pre-set baseline data comprises:

acquiring a historical log in a preset time period;

identifying the operation type of each row of data in each sub-history log;

classifying the data in each sub-history log according to the operation type;

4. The method of claim 1, wherein calculating deviation values for the response parameters from corresponding pre-set baseline data comprises:

acquiring preset baseline data of a corresponding type-grade;

5. The method of any one of claims 1 to 4, further comprising:

6. The method of claim 5, wherein after said outputting the result of the distributed file system operation exception, the method further comprises:

and sending alarm information to an administrator.

7. The method of claim 6, wherein after said sending alert information to an administrator, the method further comprises:

8. A monitoring apparatus for a distributed file system, the apparatus comprising:

9. A terminal, characterized in that the terminal comprises a processor for implementing a method of monitoring a distributed file system according to any of claims 1 to 7 when executing a computer program stored in a memory.

10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out a method of monitoring a distributed file system according to any one of claims 1 to 7.