Detailed Description
The embodiment of the invention provides a remote auditing method and system, which can improve the efficiency of remote auditing work.
In order to make the objects, features and advantages of the present invention more obvious and understandable, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is obvious that the embodiments described below are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, a first remote auditing method according to an embodiment of the present invention is applied to an auditing system including a risk monitoring platform, an auditing model scheduling platform, and an auditing model management platform based on a hadoop architecture, and includes:
101. the risk monitoring platform acquires a control instruction for scheduling an audit model and sends the acquired control instruction to the audit model scheduling platform;
in the embodiment of the invention, the traditional remote auditing system is divided into 3 systems, namely a risk monitoring platform, an auditing model scheduling platform and an auditing model management platform, and the auditing and monitoring functions of the original auditing system are completed through the mutual cooperation of the 3 systems. The risk monitoring platform is a platform interacting with each user, and after the user logs in the remote audit system, the user can upload the audit model developed by the user to the risk monitoring platform, and the operation result of the audit model can be obtained through the risk monitoring platform. The audit model management platform is based on a hadoop framework and is mainly used for storing each audit model, operating the audit model under the scheduling of the audit model scheduling platform and sending the audit result obtained by operation to the risk monitoring platform. The audit model scheduling platform is mainly used for scheduling the audit models stored in the audit model management platform and triggering the operation of the audit models. Instep 101, a user may log in the audit system, and send a control instruction for scheduling an audit model through the risk monitoring platform, and after obtaining the control instruction, the risk monitoring platform sends the control instruction to the audit model scheduling platform.
102. After receiving the control instruction, the audit model scheduling platform schedules a target audit model corresponding to the control instruction and stored in the audit model management platform;
and after receiving the control instruction, the audit model scheduling platform schedules a target audit model corresponding to the control instruction and stored in the audit model management platform, so as to trigger the operation of the target audit model. The target audit model is determined according to a control instruction sent by a user, the control instruction points to one or more audit models, and the audit models are the target audit models. And each audit model stored in the audit model management platform is issued and synchronously updated through the risk monitoring platform, namely, the audit model is acquired through the risk monitoring platform and issued to the audit model management platform, and if the audit model needs to be updated, the update script is also acquired through the risk monitoring platform and issued to the audit model management platform.
Further, the audit model stored in the audit model management platform can be released through the following steps:
(1.1) the risk monitoring platform acquires an audit model uploaded by a user;
(1.2) the risk monitoring platform sets scheduling parameters for the obtained audit model, and issues the audit model and the scheduling parameters to the audit model management platform;
and (1.3) after receiving the audit model and the scheduling parameters, the audit model management platform stores the audit model under the storage path.
For the step (1.1), the risk monitoring platform acquires the audit model uploaded by the user, the user can be any user logging in the audit system, namely, all the persons participating in the audit work can independently develop the audit model of the user, and then the audit model is uploaded to the risk monitoring platform.
For the step (1.2), the risk monitoring platform sets scheduling parameters for the obtained audit model, and issues the audit model and the scheduling parameters to the audit model management platform, wherein the scheduling parameters include a storage path of the audit model on the audit model management platform.
For the step (1.3), after receiving the audit model and the scheduling parameters, the audit model management platform stores the audit model to a specified directory, namely, under the storage path according to the scheduling parameters.
Further, after the step (1.2), the method may further include: and the risk monitoring platform sends the scheduling parameters to the audit model scheduling platform. In order to facilitate the audit model scheduling platform to schedule the audit model, the risk monitoring platform can inform the audit model scheduling platform of scheduling parameters corresponding to the audit model which is issued to the audit model management platform. By such configuration, instep 102, the audit model scheduling platform may schedule the target audit model from the audit model management platform according to the scheduling parameter corresponding to the target audit model.
Further, the audit model stored in the audit model management platform can be updated synchronously through the following steps:
(2.1) calling a script synchronization tool by adopting a synchronization task executed at regular time to scan the risk monitoring platform;
(2.2) if an audit model update script which is not issued to the audit model management platform is scanned, issuing the audit model update script to the audit model management platform by using the script synchronization tool;
and (2.3) after receiving the audit model update script, the audit model management platform synchronously updates the audit model corresponding to the audit model update script.
And (3) for the step (2.1), calling a script synchronization tool by adopting a synchronization task executed at regular time, and scanning the risk monitoring platform. The synchronous task is preset by using a workflow engine, for example, a regularly executed task oozie-jobcan be constructed by using a Hadoop component-oozie workflow engine, and a script synchronization tool is regularly called through the oozie-joba to scan the risk monitoring platform. Various existing script synchronization tools may be employed, such as FileSync or GoodSync, among others.
And (3) for the step (2.2), if the audit model update script which is not issued to the audit model management platform is scanned, issuing the audit model update script to the audit model management platform by using the script synchronization tool. Specifically, the file of the update script can be synchronized to the HDSF storage directory specified by the hadoop.
And (3) after receiving the audit model update script, the audit model management platform synchronously updates the audit model corresponding to the audit model update script, so as to complete the update operation of the audit model.
Further, after the step (2.3), the method may further include:
(2.4) if the synchronous updating is successful, the audit model management platform feeds back the information of the successful synchronous updating to the risk monitoring platform;
and (2.5) if the synchronous updating fails, the audit model management platform feeds back the information of the synchronous updating failure to the risk monitoring platform, the risk monitoring platform triggers the script synchronization tool, and the audit model of the synchronous updating failure is synchronously updated again.
For the steps (2.4) and (2.5), the audit model management platform can feed the synchronous updating result of the audit model back to the risk monitoring platform, so that the risk monitoring platform feeds the result back to the user. In addition, if the synchronous updating fails, the user can trigger the script synchronization tool again through the risk monitoring platform according to actual needs, and synchronously update the audit model with the failed synchronous updating again until the synchronous updating is successful or the synchronous updating reaches the preset times.
103. The audit model management platform operates the target audit model to obtain an audit result and sends the audit result to the risk monitoring platform;
and under the scheduling of the audit model scheduling platform, the audit model management platform operates the target audit model to obtain an audit result and sends the audit result to the risk monitoring platform. Specifically, a model operation task and an audit result pushing task can be constructed in hadoop, and the model operation task obtains and operates a target audit model under the scheduling of the audit model scheduling platform to obtain an audit result; and the audit result pushing task is responsible for sending the audit result to the risk monitoring platform.
104. And the risk monitoring platform outputs the audit result after receiving the audit result.
And after receiving the audit result, the risk monitoring platform outputs the audit result, and related users can obtain the audit result through the risk monitoring platform.
The remote auditing method provided by the embodiment of the invention is applied to an auditing system comprising a risk monitoring platform, an auditing model scheduling platform and an auditing model management platform based on a hadoop framework, and comprises the following steps: the risk monitoring platform acquires a control instruction for scheduling an audit model and sends the acquired control instruction to the audit model scheduling platform; after receiving the control instruction, the audit model scheduling platform schedules a target audit model corresponding to the control instruction and stored in the audit model management platform, and each audit model stored in the audit model management platform is issued and updated synchronously through the risk monitoring platform; the audit model management platform operates the target audit model to obtain an audit result and sends the audit result to the risk monitoring platform; and the risk monitoring platform outputs the audit result after receiving the audit result. According to the scheme, the audit system is split into a risk monitoring platform, an audit model management platform and an audit model scheduling platform, and the audit and monitoring functions of the audit system are completed through the mutual cooperation of the three systems. The risk monitoring platform supports each user to independently develop an audit model and issues the audit model to the audit model management platform; and the audit model management platform stores each audit model, schedules each audit model under the control of the audit model scheduling platform, obtains an audit result through the operation of the audit model, and finally returns the audit result to the risk monitoring platform for output. When the audit model needs to be updated, the publisher of the audit model can use the risk monitoring platform to update the audit model synchronously, and all the persons participating in the remote audit work can obtain each audit model after the synchronous update by logging in the audit system without the need that the publisher of the audit model notifies one by one and publishes the updated audit model to all the persons participating in the audit work, so that the process of the remote audit work is effectively simplified, and the work efficiency is improved.
Referring to fig. 2, a second remote auditing method according to an embodiment of the present invention is applied to an auditing system including a risk monitoring platform, an auditing model scheduling platform, and an auditing model management platform based on a hadoop architecture, and includes:
201. the risk monitoring platform acquires a control instruction for scheduling an audit model and sends the acquired control instruction to the audit model scheduling platform;
202. after receiving the control instruction, the audit model scheduling platform schedules a target audit model corresponding to the control instruction and stored in the audit model management platform;
203. the audit model management platform operates the target audit model to obtain an audit result;
steps 201 to 203 are the same assteps 101 to 103, and specific reference may be made to the related description ofsteps 101 to 103.
204. The audit model management platform sends the audit result to a hive interface preset by hadoop;
because the data formats of the audit results obtained by the user-defined audit model are different, and the audit results may have some data formats which cannot be identified by an audit system, the audit results can be sent to a hive interface preset by hadoop to identify and convert the data formats, so that the audit result data can smoothly enter the risk monitoring platform.
205. The hive interface processes the audit result to obtain data in a specific markup language format;
and after receiving the audit result, the hive interface processes the audit result to obtain data in a specific markup language format. According to the actual requirement of the auditing system for the data format, the data in the specific mark language format such as xml, xhtml, json and the like can be generated.
Further,step 205 may include:
(1) replacing json sensitive characters in the audit result with non-json sensitive characters according to a preset rule to obtain desensitized result data;
(2) and processing the desensitized result data into data in a json format.
json is a lightweight data exchange format, adopts a text format completely independent of a programming language to store and represent data, and has a concise and clear hierarchical structure. However, when data is converted into json format, some sensitive characters need to be filtered, otherwise, system crash and other problems may occur when data is subsequently analyzed. In the steps (1) to (2), json sensitive characters in the audit result are replaced by non-json sensitive characters according to a preset rule, and result data after desensitization is obtained. For example, "{ }" is replaced with "[", "[ ]" is replaced with "[ margarita ], and the like. After the data is desensitized, the desensitized result data can be processed into data in json format.
206. The audit model management platform sends the data in the specific markup language format to the risk monitoring platform at regular time;
specifically, a data pushing task can be constructed in hadoop, and data in a specific markup language format obtained by data conversion is sent to the risk monitoring platform at regular time through the task.
207. The risk monitoring platform receives and outputs the data in the specific markup language format.
And after receiving the result data in the specific markup language format, the risk monitoring platform can output the data, and relevant users can obtain the data through the risk detection platform.
The remote auditing method provided by the embodiment of the invention is applied to an auditing system comprising a risk monitoring platform, an auditing model scheduling platform and an auditing model management platform based on a hadoop framework, and comprises the following steps: the risk monitoring platform acquires a control instruction for scheduling an audit model and sends the acquired control instruction to the audit model scheduling platform; after receiving the control instruction, the audit model scheduling platform schedules a target audit model corresponding to the control instruction and stored in the audit model management platform; the audit model management platform operates the target audit model to obtain an audit result; the audit model management platform sends the audit result to a hive interface preset by hadoop; the hive interface processes the audit result to obtain data in a specific markup language format; the audit model management platform sends the data in the specific markup language format to the risk monitoring platform at regular time; the risk monitoring platform receives and outputs the data in the specific markup language format. According to the embodiment, the auditing system is divided into a risk monitoring platform, an auditing model management platform and an auditing model scheduling platform, and the auditing and monitoring functions of the auditing system are completed through the mutual cooperation of the three systems. The risk monitoring platform supports each user to independently develop an audit model and issues the audit model to the audit model management platform; and the audit model management platform stores each audit model, schedules each audit model under the control of the audit model scheduling platform, obtains an audit result through the operation of the audit model, and finally returns the audit result to the risk monitoring platform for output. When the audit model needs to be updated, the publisher of the audit model can use the risk monitoring platform to update the audit model synchronously, and all the persons participating in the remote audit work can obtain each audit model after the synchronous update by logging in the audit system without the need that the publisher of the audit model notifies one by one and publishes the updated audit model to all the persons participating in the audit work, so that the process of the remote audit work is effectively simplified, and the work efficiency is improved. In addition, the data format of the audit result data is converted to obtain the data in the specific markup language format, so that the data can be smoothly transmitted in the audit system.
It should be understood that, the sequence numbers of the steps in the foregoing embodiments do not imply an execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present invention.
The above mainly describes a remote auditing method, and a remote auditing system is described below.
Referring to fig. 3, an embodiment of a remote audit system according to an embodiment of the present invention includes:
therisk monitoring platform 301 is used for acquiring a control instruction for scheduling the audit model and sending the acquired control instruction to the audit model scheduling platform; after receiving an audit result sent by an audit model management platform, outputting the audit result;
the auditmodel scheduling platform 302 is used for scheduling a target audit model which is stored in an audit model management platform and corresponds to the control instruction after receiving the control instruction, and each audit model stored in the audit model management platform is issued and updated synchronously through the risk monitoring platform;
and the auditmodel management platform 303 is based on a hadoop framework, and is used for operating the target audit model to obtain an audit result and sending the audit result to the risk monitoring platform.
Further, therisk monitoring platform 301 may also be configured to:
obtaining an audit model uploaded by a user;
setting scheduling parameters for the obtained audit model, and issuing the audit model and the scheduling parameters to the audit model management platform, wherein the scheduling parameters comprise a storage path of the audit model on the audit model management platform;
the auditmodel management platform 303 may also be configured to:
and after receiving the audit model and the scheduling parameters, storing the audit model under the storage path.
Further, therisk monitoring platform 301 may also be configured to:
sending the scheduling parameters to the audit model scheduling platform;
the scheduling of the target audit model by the auditmodel scheduling platform 302 may specifically be:
and the audit model scheduling platform schedules the target audit model from the audit model management platform according to the scheduling parameters corresponding to the target audit model.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
The above-mentioned embodiments are only used for illustrating the technical solutions of the present invention, and not for limiting the same; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.