Specific embodiment
An embodiment of the present invention provides a kind of remote auditing method and systems, can improve the efficiency of remote auditing work.
In order to make the invention's purpose, features and advantages of the invention more obvious and easy to understand, below in conjunction with the present inventionAttached drawing in embodiment is clearly and completely described the technical solution in the embodiment of the present invention, it is clear that disclosed belowEmbodiment be only part of the embodiment of the present invention, and not all embodiment.Based on the embodiments of the present invention, this fieldAll other embodiment that those of ordinary skill is obtained without making creative work, belongs to protection of the present inventionRange.
Referring to Fig. 1, the first remote auditing method of the embodiment of the present invention is applied to include Risk Monitoring platform, auditThe auditing system of module scheduling platform and audit model management platform based on hadoop frameworks, the remote auditing method packetIt includes：
101st, the Risk Monitoring platform obtains to dispatch the control instruction of audit model, and referring to the control got intoOrder is sent to the audit model dispatching platform；
In embodiments of the present invention, traditional remote auditing system is split into Risk Monitoring platform, audit model is dispatched3 systems of platform and audit model management platform complete the audit of first trial meter systems by the mutual cooperation between this 3 systemsAnd monitoring function.Risk Monitoring platform is the platform interacted with each user, and user can incite somebody to action after remote auditing system is logged inThe audit model of oneself exploitation uploads to Risk Monitoring platform, and the operation of audit model can also be obtained by Risk Monitoring platformAs a result.Audit model management platform is based on hadoop frameworks, is mainly used for storing each audit model, and dispatch in audit modelAudit model is run under the scheduling of platform, the auditing result that operation obtains is sent to Risk Monitoring platform.Audit model is dispatchedPlatform is mainly used for being scheduled the audit model preserved in audit model management platform, triggers the operation of audit model.In step 101, user can log in auditing system, sent out by Risk Monitoring platform and referred to for dispatching the control of audit modelIt enables, Risk Monitoring platform is sent to audit model dispatching platform after the control instruction is got, by the control instruction.
102nd, the audit model dispatching platform is after the control instruction is received, to the audit model management platformThe target audit model corresponding with the control instruction of middle preservation is scheduled；
The audit model dispatching platform is after the control instruction is received, to being protected in the audit model management platformThe target audit model corresponding with the control instruction deposited is scheduled, so as to trigger the operation of target audit model.TargetAudit model is determined according to the control instruction that user sends out, which is directed toward one or more audit models, theseAudit model is target audit model.The each audit model preserved in the audit model management platform passes through the riskMonitoring platform publication and synchronized update obtain audit model and are published to audit model management and put down by Risk Monitoring platformPlatform if audit model needs to update, obtains the concurrent cloth of more new script again by Risk Monitoring platform and is put down to audit model managementPlatform.
Further, the audit model preserved in the audit model management platform can be issued by following steps：
(1.1) the Risk Monitoring platform obtains the audit model that user uploads；
(1.2) the Risk Monitoring platform is the audit model setting scheduling parameter got, and by the audit modelThe audit model management platform is distributed to the scheduling parameter；
(1.3) the audit model management platform is after the audit model and the scheduling parameter is received, by described inAudit model is stored to the store path.
For above-mentioned steps (1.1), the Risk Monitoring platform obtains the audit model that user uploads, and user here canBe log in auditing system arbitrary user, that is, participate in audit work all parties can stand-alone development oneself audit mouldThen audit model is uploaded to Risk Monitoring platform by type.
For above-mentioned steps (1.2), the Risk Monitoring platform is the audit model setting scheduling parameter got, and willThe audit model and the scheduling parameter are distributed to the audit model management platform, and scheduling parameter here includes described examineCount store path of the model in the audit model management platform.
For above-mentioned steps (1.3), the audit model management platform is receiving the audit model and the schedulingAfter parameter, the audit model is stored according to scheduling parameter to specified catalogue, i.e., under described store path.
Further, after above-mentioned steps (1.2), can also include：The Risk Monitoring platform is by the schedulingParameter is sent to the audit model dispatching platform.Audit model is scheduled for the ease of audit model dispatching platform, windThe corresponding scheduling parameter of the audit model for being distributed to audit model management platform can be informed audit model by dangerous monitoring platformDispatching platform.It sets in this way, in a step 102, the audit model dispatching platform can be according to target audit mouldThe corresponding scheduling parameter of type dispatches the target audit model from the audit model management platform.
Further, the audit model preserved in the audit model management platform can be synchronized more by following stepsNewly：
(2.1) script synchronization tool is called using the synchronous task that timing performs, the Risk Monitoring platform is sweptIt retouches；
(2.2) if scanning utilizes institute to the audit model more new script for not being distributed to the audit model management platformIt states script synchronization tool and the audit model more new script is distributed to the audit model management platform；
(2.3) the audit model management platform is after the audit model more new script is received, synchronized update and instituteState the corresponding audit model of audit model more new script.
For above-mentioned steps (2.1), script synchronization tool is called using the synchronous task that timing performs, the risk is supervisedPlatform is surveyed to be scanned.The synchronous task is pre-set using workflow engine, for example, can using hadoop component-Oozie workflow engines build the task oozie-job that a timing performs, and call script same by oozie-job timingsStep tool is scanned the Risk Monitoring platform.Existing various script synchronization tools, such as FileSync may be usedOr GoodSync etc..
For above-mentioned steps (2.2), if scanning is updated to the audit model for not being distributed to the audit model management platformThe audit model more new script is then distributed to the audit model management platform by script using the script synchronization tool.Specifically, can will be under HDSF storage catalogues that the file synchronization of more new script to hadoop is specified.
For above-mentioned steps (2.3), the audit model management platform after the audit model more new script is received,Synchronized update audit model corresponding with the audit model more new script, so as to complete the update of audit model operation.
Further, after above-mentioned steps (2.3), can also include：
(2.4) if synchronized update success, the audit model management platform feed back to the successful information of synchronized updateThe Risk Monitoring platform；
(2.5) if synchronized update fails, the audit model management platform feeds back to the information of synchronized update failureThe Risk Monitoring platform, and the script synchronization tool is triggered by the Risk Monitoring platform, fail to the synchronized updateAudit model synchronize update again.
For above-mentioned steps (2.4) and (2.5), audit model management platform can be by the synchronized update result of audit modelRisk Monitoring platform is fed back to, result is fed back to user by Risk Monitoring platform.If in addition, synchronized update failure, userIt can also be failed according to actual needs by the Risk Monitoring platform retriggered script synchronization tool to the synchronized updateAudit model synchronize update again, until synchronized update success or synchronized update reach preset number.
103rd, the audit model management platform runs the target audit model, obtains auditing result, and examine describedMeter result is sent to the Risk Monitoring platform；
Under the scheduling of the audit model dispatching platform, the audit model management platform runs the target audit mouldType obtains auditing result, and the auditing result is sent to the Risk Monitoring platform.It specifically, can be in hadoopA model running task and an auditing result push task are built, model running task is in the audit model dispatching platformScheduling under obtain and operational objective audit model, obtain auditing result；Auditing result push task is then responsible for auditing resultIt is sent to the Risk Monitoring platform.
104th, the Risk Monitoring platform exports the auditing result after the auditing result is received.
The Risk Monitoring platform exports the auditing result after the auditing result is received, relevant userCan the auditing result be obtained by the risk supervision platform.
The remote auditing method that the embodiment of the present invention proposes is applied to include Risk Monitoring platform, audit model dispatching platformWith the auditing system of the audit model management platform based on hadoop frameworks, the remote auditing method includes：The risk prisonPlatform is surveyed to obtain to dispatch the control instruction of audit model, and the control instruction got is sent to the audit model tuneSpend platform；The audit model dispatching platform is after the control instruction is received, to being protected in the audit model management platformThe target audit model corresponding with the control instruction deposited is scheduled, and is preserved in the audit model management platform eachAudit model passes through Risk Monitoring platform publication and synchronized update；The audit model management platform runs the target and examinesModel is counted, obtains auditing result, and the auditing result is sent to the Risk Monitoring platform；The Risk Monitoring platform existsAfter receiving the auditing result, the auditing result is exported.This programme is put down by the way that auditing system is split as Risk MonitoringThree platform, audit model management platform and audit model dispatching platform systems cooperate to complete by three systemsThe audit of auditing system, monitoring function.Wherein, Risk Monitoring platform is supported each user's stand-alone development audit model and is distributed toAudit model management platform；Audit model management platform preserves each audit model, and in the control of audit model dispatching platformUnder each audit model is scheduled, auditing result is obtained by the operation of audit model, finally returns to auditing resultRisk Monitoring platform exports.When audit model needs update, the publisher of audit model can utilize the Risk Monitoring platformUpdate is synchronized to audit model, as long as all parties for participating in remote auditing work log in the auditing system and can getEach audit model after synchronized update, the publisher without audit model notify and send out updated audit model one by oneCloth is effectively simplified the flow of remote auditing work, improves work efficiency to each personnel for participating in audit work.
Referring to Fig. 2, second of remote auditing method of the embodiment of the present invention is applied to include Risk Monitoring platform, auditThe auditing system of module scheduling platform and audit model management platform based on hadoop frameworks, the remote auditing method packetIt includes：
201st, the Risk Monitoring platform obtains to dispatch the control instruction of audit model, and referring to the control got intoOrder is sent to the audit model dispatching platform；
202nd, the audit model dispatching platform is after the control instruction is received, to the audit model management platformThe target audit model corresponding with the control instruction of middle preservation is scheduled；
203rd, the audit model management platform runs the target audit model, obtains auditing result；
Step 201 to 203 with step 101 to 103 identical, specifically can refer to the related description of step 101 to 103.
204th, the auditing result is sent in the preset hive interfaces of hadoop by the audit model management platform；
Since the data format of auditing result that user-defined audit model obtains is different, these auditing results mayThere are the data formats of certain auditing system None- identifieds, therefore, auditing result can be sent to the preset hive of hadoopInterface, to carry out the identification of data format and conversion so that audit result data can smoothly enter the Risk Monitoring platform.
205th, the hive interfaces handle the auditing result, obtain the data of specific markers language format；
The hive interfaces handle the auditing result, obtain specific markers after the auditing result is receivedThe data of language format.According to actual demand of the auditing system for data format, the spies such as xml, xhtml, json can be generatedDetermine the data of markup language.
Further, step 205 can include：
(1) the json sensitivities character in the auditing result is substituted for the word of non-json sensitivities according to default ruleSymbol, the result data after being desensitized；
(2) result data after the desensitization is processed into the data of json forms.
Json is a kind of data interchange format of lightweight, is stored using the text formatting for being totally independent of programming languageWith represent data, there is succinct and clearly hierarchical structure.However, when converting the data into json forms, need to someSensitive character is filtered, otherwise subsequently carry out data parsing when may generation system collapse the problems such as.In above-mentioned steps(1) to the word that the json sensitivities character in the auditing result in (2), is substituted for non-json sensitivities according to default ruleSymbol, the result data after being desensitized.For example, " { } " is replaced with "【】", " [] " replaces with " " " " etc..After data desensitization,Result data after desensitization can be processed into the data of json forms.
206th, the data of the specific markers language format are sent to the wind by the audit model management platform timingDangerous monitoring platform；
Specifically, a data-pushing task can be built in hadoop, data conversion is obtained by task timingTo the data of specific markers language format be sent to the Risk Monitoring platform.
207th, the Risk Monitoring platform receives and exports the data of the specific markers language format.
The Risk Monitoring platform is after the result data for receiving the specific markers language format, you can counts theseAccording to output, associated user obtains these data by the risk supervision platform.
The remote auditing method that the embodiment of the present invention proposes is applied to include Risk Monitoring platform, audit model dispatching platformWith the auditing system of the audit model management platform based on hadoop frameworks, the remote auditing method includes：The risk prisonPlatform is surveyed to obtain to dispatch the control instruction of audit model, and the control instruction got is sent to the audit model tuneSpend platform；The audit model dispatching platform is after the control instruction is received, to being protected in the audit model management platformThe target audit model corresponding with the control instruction deposited is scheduled；The audit model management platform runs the targetAudit model obtains auditing result；It is preset that the auditing result is sent to hadoop by the audit model management platformIn hive interfaces；The hive interfaces handle the auditing result, obtain the data of specific markers language format；It is describedThe data of the specific markers language format are sent to the Risk Monitoring platform by the timing of audit model management platform；The windDangerous monitoring platform receives and exports the data of the specific markers language format.The present embodiment by auditing system by being split as windThree dangerous monitoring platform, audit model management platform and audit model dispatching platform systems, pass through the phase interworking of three systemsClose audit, the monitoring function to complete auditing system.Wherein, Risk Monitoring platform supports each user's stand-alone development audit modelAnd it is distributed to audit model management platform；Audit model management platform preserves each audit model, and flat in audit model schedulingEach audit model is scheduled under the control of platform, auditing result is obtained by the operation of audit model, finally ties auditFruit returns to the output of Risk Monitoring platform.When audit model needs update, the publisher of audit model can utilize the riskMonitoring platform synchronizes audit model update, as long as all parties for participating in remote auditing work log in the auditing system i.e.Each audit model after synchronized update can be got, the publisher without audit model notifies and examined updated one by oneMeter model is distributed to each personnel for participating in audit work, is effectively simplified the flow of remote auditing work, improves work effectRate.In addition, the present embodiment is also converted the data format of audit result data, the number of specific markers language format is obtainedAccording to so that the data can be transmitted successfully in auditing system.
It should be understood that the size of the serial number of each step is not meant to the priority of execution sequence, each process in above-described embodimentExecution sequence should determine that the implementation process without coping with the embodiment of the present invention forms any limit with its function and internal logicIt is fixed.
A kind of remote auditing method is essentially described above, a kind of remote auditing system will be described below.
Referring to Fig. 3, a kind of one embodiment of remote auditing system includes in the embodiment of the present invention：
Risk Monitoring platform 301 for obtaining the control instruction of scheduling audit model, and the control instruction got is sent outIt send to audit model dispatching platform；After the auditing result for receiving the transmission of audit model management platform, by the auditing resultOutput；
Audit model dispatching platform 302, for after the control instruction is received, to being protected in audit model management platformThe target audit model corresponding with the control instruction deposited is scheduled, and is preserved in the audit model management platform eachAudit model passes through Risk Monitoring platform publication and synchronized update；
Audit model management platform 303 based on hadoop frameworks, for running the target audit model, is auditedAs a result, and the auditing result is sent to the Risk Monitoring platform.
Further, the Risk Monitoring platform 301 can be also used for：
Obtain the audit model that user uploads；
Audit model to get sets scheduling parameter, and the audit model and the scheduling parameter are distributed to instituteState audit model management platform, the scheduling parameter, which includes, the audit model storage in the audit model management platformPath；
The audit model management platform 303 can be also used for：
After the audit model and the scheduling parameter is received, the audit model is stored to the store pathUnder.
Further, the Risk Monitoring platform 301 can be also used for：
The scheduling parameter is sent to the audit model dispatching platform；
The audit model dispatching platform 302, which is scheduled the target audit model, to be specifically as follows：
The audit model dispatching platform is according to the corresponding scheduling parameter of the target audit model from the audit modelThe target audit model is dispatched in management platform.
It is apparent to those skilled in the art that for convenience and simplicity of description, the system of foregoing description,The specific work process of device and unit can refer to the corresponding process in preceding method embodiment, and details are not described herein.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, it can alsoThat each unit is individually physically present, can also two or more units integrate in a unit.Above-mentioned integrated listThe form that hardware had both may be used in member is realized, can also be realized in the form of SFU software functional unit.
If the integrated unit is realized in the form of SFU software functional unit and is independent product sale or usesWhen, it can be stored in a computer read/write memory medium.Based on such understanding, technical scheme of the present invention is substantiallyThe part to contribute in other words to the prior art or all or part of the technical solution can be in the form of software productsIt embodies, which is stored in a storage medium, is used including some instructions so that a computerEquipment (can be personal computer, server or the network equipment etc.) performs the complete of each embodiment the method for the present inventionPortion or part steps.And aforementioned storage medium includes：USB flash disk, mobile hard disk, read-only memory (ROM, Read-OnlyMemory), random access memory (RAM, Random Access Memory), magnetic disc or CD etc. are various can store journeyThe medium of sequence code.
The above, the above embodiments are merely illustrative of the technical solutions of the present invention, rather than its limitations；Although with reference to beforeEmbodiment is stated the present invention is described in detail, it will be understood by those of ordinary skill in the art that：It still can be to precedingThe technical solution recorded in each embodiment is stated to modify or carry out equivalent replacement to which part technical characteristic；And theseModification is replaced, the spirit and scope for various embodiments of the present invention technical solution that it does not separate the essence of the corresponding technical solution.