Specific embodiment
Hereinafter, will be described with reference to the accompanying drawings embodiment of the disclosure.However, it should be understood that these descriptions are only exemplary, and it is not intended to limit the scope of the present disclosure.In the following detailed description, to elaborate many specific thin convenient for explainingSection is to provide the comprehensive understanding to the embodiment of the present disclosure.It may be evident, however, that one or more embodiments are not having these specific thinIt can also be carried out in the case where section.In addition, in the following description, descriptions of well-known structures and technologies are omitted, to avoidUnnecessarily obscure the concept of the disclosure.
Term as used herein is not intended to limit the disclosure just for the sake of description specific embodiment.It uses hereinThe terms "include", "comprise" etc. show the presence of the feature, step, operation and/or component, but it is not excluded that in the presence ofOr add other one or more features, step, operation or component.
There are all terms (including technical and scientific term) as used herein those skilled in the art to be generally understoodMeaning, unless otherwise defined.It should be noted that term used herein should be interpreted that with consistent with the context of this specificationMeaning, without that should be explained with idealization or excessively mechanical mode.
It, in general should be according to this using statement as " at least one in A, B and C etc. " is similar toField technical staff is generally understood the meaning of the statement to make an explanation (for example, " system at least one in A, B and C "Should include but is not limited to individually with A, individually with B, individually with C, with A and B, with A and C, have B and C, and/orSystem etc. with A, B, C).Using statement as " at least one in A, B or C etc. " is similar to, generally comeSaying be generally understood the meaning of the statement according to those skilled in the art to make an explanation (for example, " having in A, B or C at leastOne system " should include but is not limited to individually with A, individually with B, individually with C, with A and B, have A and C, haveB and C, and/or the system with A, B, C etc.).
Shown in the drawings of some block diagrams and/or flow chart.It should be understood that some sides in block diagram and/or flow chartFrame or combinations thereof can be realized by computer program instructions.These computer program instructions can be supplied to general purpose computer,The processor of special purpose computer or other programmable data processing units, so that these instructions are when executed by this processor can be withCreation is for realizing function/operation device illustrated in these block diagrams and/or flow chart.The technology of the disclosure can be hardThe form of part and/or software (including firmware, microcode etc.) is realized.In addition, the technology of the disclosure, which can be taken, is stored with fingerThe form of computer program product on the computer readable storage medium of order, the computer program product is for instruction execution systemSystem uses or instruction execution system is combined to use.
Embodiment of the disclosure provides a kind of monitoring information processing method and system.This method includes that model library obtainedJourney, monitoring information receive process, model choose process, treatment process and response process.In model library acquisition process, it is deployed on clientEdge calculations (edge computing) node in local area network where holding is obtained from the computation model library of server.SoAfterwards in monitoring information receive process, the monitoring information from the client is received.Process is chosen into model, from calculating mouldComputation model corresponding with the monitoring information is chosen in type library.Treatment process is subsequently entered, selected computation model pair is utilizedAbove-mentioned monitoring information is handled, and the response results for above-mentioned monitoring information are obtained.Response process is finally carried out, by the responseAs a result it is sent to client, so that client is based on the response results and executes corresponding operating.
Fig. 1 schematically shows the applied field of the monitoring information processing method and system of embodiment according to the present inventionScape.It may include terminal device 101,102,103, edge calculations node 104 and server in application scenarios shown in Fig. 1105、106、107。
Edge calculations node 104 can be deployed in the local area network of terminal device 101,102,103, can be based on local officeDomain net is communicated with terminal device 101,102,103.Edge calculations node 104 can based on internet and server 105,106, it 107 is communicated.
Terminal device 101,102,103 can be various electronic equipments, including but not limited to smart phone, tablet computer,Pocket computer on knee and desktop computer etc..Support various businesses can be installed on terminal device 101,102,103The client application of function, such as tool-class application, social category application, shopping class application, web browser applications, searching class are answeredWith equal (merely illustrative).
Server 105,106,107 can be to provide the server of various business services, such as be set to user using terminalStandby 101,102,103 websites browsed provide the back-stage management server (merely illustrative) supported.
It should be noted that monitoring information processing method provided by the embodiment of the present disclosure generally can be by edge calculations sectionPoint 104 executes.Correspondingly, monitoring information processing system provided by the embodiment of the present disclosure generally can be set in edge calculations sectionIn point 104.
It should be understood that the number of terminal device, edge calculations node and server in Fig. 1 is only schematical.RootAccording to actual needs, any number of terminal device, edge calculations node and server can have.
Fig. 2 diagrammatically illustrates the flow chart of the monitoring information processing method according to the embodiment of the present disclosure.This method is by extremelyAn edge calculations node in a few edge calculations node executes, at least one above-mentioned edge calculations node deployment is in clientIn local area network where holding.
As shown in Fig. 2, this method may include operation S201~S205.
In operation S201, obtain from the computation model library of server.
Wherein, computation model library includes preparatory trained various types of computation models, and different computation models hasDifferent calculating targets.Edge calculations node refers to that the calculating basis close to data source (client in such as the present embodiment) is setThe various equipment with computing capability such as apply, such as can be base station, gateway, controller, computer.It is deployed in same local area networkIn multiple edge calculations nodes can be identical equipment, be also possible to different equipment, herein with no restrictions.
In operation S202, the monitoring information from client is received.
Wherein, client has the function of acquiring monitoring information.Due to currently executing the edge of monitoring information processing methodCalculate node (hereinafter referred to as this edge calculations node) is deployed in the LAN environment where client, is received from clientThe fast speed of the monitoring information at end can be realized and more receive and handle in real time.
In operation S203, computation model corresponding with monitoring information is chosen from computation model library.
In operation S204, monitoring information is handled using selected computation model, is obtained for monitoring informationResponse results.
In operation S205, the response results are sent to client, so that client is executed based on the response resultsCorresponding operating.
It will be appreciated by those of skill in the art that monitoring information processing method shown in Fig. 2 is in the local area network of clientOne or more edge calculations nodes are set, and client is transferred to neighbouring after collecting monitoring information, by the monitoring informationEdge calculations equipment carries out processing analysis, without monitoring information to be transferred to server (such as data far apart from clientCenter) it is focused on, i.e., it replaces cloud server to carry out the calculation processing for monitoring information with edge calculations node, passesDefeated speed is fast, delay is low, can be analyzed and be put into operation immediately, and the response effect for monitoring information is greatly improvedRate.
In one embodiment of the present disclosure, process of the above-mentioned acquisition from the computation model library of server can wrapInclude: this edge calculations node sends certification request to server, and certification request includes the status information of this edge calculations node, withServer is set to verify the legitimacy of this edge calculations node based on the status information, and when verification result is legal to this edgeCalculate node return is originally stored in computation model library in server, including a plurality of types of computation models.
Illustratively, the status information of an edge calculations node may include at least one of following: software information, hardwareInformation and the network information.
In one embodiment of the present disclosure, the acquired monitoring information of client for example may include the life of client acquisitionObject characteristic information.It on this basis, can also include: edge calculations section according to the monitoring information processing method of the embodiment of the present disclosurePoint is also obtained from the legal biological information library of server when obtaining computation model library from server.Legal biologyIt include the various types of biological informations for having already passed through multiple users of certification in characteristic information library.And then it is above-mentioned from calculatingThe process that computation model corresponding with monitoring information is chosen in model library may is that edge calculations node is selected from computation model libraryTake the feature identification model for client biological information collected.Also, it is above-mentioned to utilize selected computation modelMonitoring information is handled, obtaining, which may is that for the process of the response results of the monitoring information, utilizes selected featureIdentification model calculates the matching degree between client biological information collected and legal biological information library.IfIt is greater than predetermined threshold with degree, then obtains passing through the response results of verifying for characterizing the biological information.If matching degreeLess than or equal to predetermined threshold, then obtain for characterizing the unverified response results of the biological information.
Illustratively, the biological information of client acquisition may include at least one of following；The facial image of user,Finger print information, the finger venous information of user and the iris information of user of user.
Further, to improve the safety that edge calculations node is monitored information processing, in a reality of the disclosureIt applies in example, safety chip, such as SE (Secure Element) safety chip is provided in edge calculations node, is equivalent to onePlatform microcomputer realizes the function such as data safety storage, encryption and decryption operation by safety chip and chip operating system (COS)Energy.Safety chip can be packaged into various forms.It can will be from server according to the monitoring information processing method of the embodiment of the present disclosureThe legal biological information inventory obtained is stored in the safety chip of edge calculations node, to avoid legal biological informationThe information for being related to privacy of user in library is stolen.
In one embodiment of the present disclosure, the acquired monitoring information of client for example may include the prison of client acquisitionControl video.It is above-mentioned that corresponding with monitoring information computation model is chosen from computation model library includes: edge calculations node from calculatingSelecting video analysis model in model library, for being analyzed and processed to above-mentioned monitor video.Therefore, above-mentioned to utilize calculating mouldThe monitoring information that type acquires client is handled, and obtains including: to utilize video point for the response results of the monitoring informationWhether include predefined action feature, if it is, obtaining for characterizing if analysing in model identification client monitor video collectedThe response results of security threat prompt.
It illustratively, can also include: in response in server according to the monitoring information processing method of the embodiment of the present disclosureThe update in computation model library is obtained from the updated computation model library of server.Additionally or alternatively, monitoring is executedOne edge calculations node of information process and at least one the edge calculations node being deployed in the local area network of clientIn other edge calculations nodes between carry out load balancing.That is, when there is multiple edge calculations node deployments in clientWhen in the local area network at end, any edge calculate node can obtain computation model library from server.Client is collecting prisonAfter measurement information, an edge calculations node is selected to be monitored information from multiple edge calculations nodes according to load balancing principleTransmission, to realize the processing for the monitoring information in the edge calculations node.
Below with reference to Fig. 3~Fig. 5, in conjunction with specific embodiments to according to the monitoring information processing method of the embodiment of the present disclosure intoExplanation is illustratively unfolded in row.
For example, client may include various information acquisition sensor device, such as image as front-end information acquisition deviceHead, fingerprint instrument refer to vein instrument, iris capturing instrument etc..Wherein, camera is for acquiring face information, real-time video monitoring informationDeng.Fingerprint instrument is used to acquire the finger print information of people.Refer to that vein instrument is used to acquire the finger venous information of people.Iris capturing instrument is for adoptingCollect the iris information of people.Therefore it is defeated by the sensor device of client to can be user for the scene of client acquisition monitoring informationEnter such as facial image, finger print information, refer to venous information, iris information biological information, it is special that client acquires these biologiesReference breath, the authentication of user is carried out by the calculation processing of edge calculations node.Or it is also possible to client and passes throughCamera obtains the video information in certain time, and being handled by the analysis of edge calculations node to identify in the certain time isIt is no that specific event occurs, and then safety early warning etc. can be carried out.In addition, client can also include output equipment, such asIt shows output device, instantaneous speech power etc., is exported with the response results for edge calculations node to be calculated to user.
Edge calculations node can for undertaking the analytical calculation task of local area network as real-time detection identification deviceMultiple edge calculations nodes are existed simultaneously, to cooperate.Fig. 3 diagrammatically illustrates the edge according to the embodiment of the present disclosureThe example schematic diagram of calculate node.As shown in figure 3, left side is the front appearance figure of edge calculations node in this example, right side is thisThe back appearance figure of edge calculations node in example.For example, edge calculations node front may include power supply instruction from the point of view of appearance(pwr), internet connection instruction (wan), LAN connection instruction (1an), disk operation instruction (disk), power switch, USBInterface, microphone (MIC) interface etc..The back side may include thermovent, restore key (RST), HDMI interface etc..It can be according to needIt is configured herein with no restrictions.
It illustratively, may include SE safety chip, computation model library, network management module and meter in edge calculations nodeCalculate module.Wherein, SE safety chip is for protecting important private data, such as face characteristic value, fingerprint base.It uses in computation model libraryIn providing the computation model of all kinds of analytical calculation required by task, when such as carrying out recognition of face, model library provides human face recognition modelRecognition of face contrast conting is carried out for computing unit.Network management module is for establishing between client and edge calculations nodeCommunication link (local area network communication link), and for establishing (the interconnection of the communication link between edge calculations node and serverNetwork Communication link).Computing module is for calculating task needed for completing all kinds of business using different computation models.
Server is synchronous with data for being managed to each edge calculations node as cloud managing device, such asIt may include device node management module and model database management module.Wherein, device node management module is used for each edgeCalculate node is attached authorization and equipment management, such as equipment state is collected.Model database management module is for updating, synchronizing sideThe computation model library of edge calculate node.
Fig. 4 diagrammatically illustrates the interactive process between client and edge calculations node according to the embodiment of the present disclosureSchematic diagram.
As shown in figure 4, the interactive process between client and edge calculations node may include S401~S409.
In operation S401, client and edge calculations node establish connection.
In operation S402, client acquires the monitoring informations such as picture, video, audio.
In operation S403, determine whether monitoring information is sensitive information, is to execute operation S404, otherwise executes operationS405。
In operation S404, local area network encrypted transmission.
In operation S405, local area network high-speed transfer.
In operation S406, edge calculations node tune plays computing module.
In operation S407, computing module loads respective algorithms model from algorithm model library.
In operation S408, recognition result is calculated in computing module.
In operation S409, edge calculations node returns to recognition result to client, and client shows recognition result.
Fig. 5 diagrammatically illustrates the interactive process between edge calculations node and server according to the embodiment of the present disclosureSchematic diagram.
As shown in figure 5, the interactive process between edge calculations node and server may include S501~S508.
In operation S501, server is initialized.
In operation S502, edge calculations node and server establish secure connection.
In operation S503, it is determined whether be successfully established connection, be, execute operation S504, otherwise execute operation S505.
In operation S504, server collects the status information of edge calculations node.
In operation S505, reconnection after the waiting n second.
In operation S506, determines whether the state of edge calculations node is abnormal, be to execute operation S507, otherwise execute behaviourMake S508.
In operation S507, server carries out abnormality alarming.
In operation S508, server issues the computation model of latest edition to edge calculations node.
It can be seen from the above, being acquired for existing system by front-end information, the existing real-time of backend information calculating is poor, canBy the problems such as property is low, bandwidth occupancy is high, personal secrets are poor, the monitoring information processing method based on edge calculations is proposed.IntoWhen the tasks such as the real-time discriminance analysis of row object, personnel identity certification, information collection is carried out by headend equipment, through local area networkIt is transferred to edge calculations node and is localized calculating, calculated result is directly returned to front end, realizes that analysis is anti-with result in real timeFeedback, avoids the network bandwidth consumption for being sent to background data center and network delay, inspection can be locally provided network interruptionIdentification service is surveyed, real-time, the reliability of business are effectively improved, the response time is improved, reduces bandwidth demand and guarantee quickFeel the local security of information.May include at least one of following beneficial effect:
(1) real time response speed of the business such as video analysis, personnel identity certification is improved.By the way that computing capability is sunkTo edge side, network delay when can reduce data transmission improves service response speed.
(2) safety of sensitive information is improved.Individual is belonged to for biological information (such as fingerprint base, face database)Sensitive information, legacy system need to transfer information to remote data center by internet when carrying out personnel identity identificationBackground system, there are biggish disclosure risks.Realize that local real-time analytical calculation, privacy of user data are not necessarily to by edge calculationsIt uploads, reduces information leakage risk.
(3) system reliability is improved.For some networking analytical calculation tasks, the exception of network be will lead in serviceOnly, it is analyzed using the local computing that edge calculations are realized, even if being also capable of providing analytical calculation service in Network Abnormal.
Fig. 6 diagrammatically illustrates the block diagram of monitoring information processing system according to an embodiment of the present disclosure.
As shown in fig. 6, monitoring information processing system 600 may include: client 610, server 620 and at least one sideEdge calculate node 630.
At least one edge calculations node 630 is deployed in the local area network at 610 place of client.
Server 620 is used to send computation model library to edge calculations node 630.
Client 610 is used to send monitoring information to edge calculations node 630.
Edge calculations node 630 is used to choose calculating mould corresponding with the monitoring information from the computation model libraryType, and the monitoring information being handled using the computation model, obtain for the monitoring information response results simultaneouslyIt is sent to the client 610.
Client 610 is also used to execute corresponding operating based on the response results.
It should be noted that in device section Example each module/unit/subelement etc. embodiment, the skill of solutionArt problem, the function of realization and the technical effect reached respectively with the implementation of corresponding step each in method section ExampleMode, the technical issues of solving, the function of realization and the technical effect that reaches are same or like, and details are not described herein.
It is module according to an embodiment of the present disclosure, submodule, unit, any number of or in which any more in subelementA at least partly function can be realized in a module.It is single according to the module of the embodiment of the present disclosure, submodule, unit, sonAny one or more in member can be split into multiple modules to realize.According to the module of the embodiment of the present disclosure, submodule,Any one or more in unit, subelement can at least be implemented partly as hardware circuit, such as field programmable gateArray (FPGA), programmable logic array (PLA), system on chip, the system on substrate, the system in encapsulation, dedicated integrated electricityRoad (ASIC), or can be by the hardware or firmware for any other rational method for integrate or encapsulate to circuit come realShow, or with any one in three kinds of software, hardware and firmware implementations or with wherein any several appropriately combined next realityIt is existing.Alternatively, can be at least by part according to one or more of the module of the embodiment of the present disclosure, submodule, unit, subelementGround is embodied as computer program module, when the computer program module is run, can execute corresponding function.
Fig. 7 is diagrammatically illustrated according to the computer system for being adapted for carrying out method as described above of the embodiment of the present disclosureBlock diagram.Computer system shown in Fig. 7 is only an example, should not function to the embodiment of the present disclosure and use scope bringAny restrictions.
As shown in fig. 7, include processor 701 according to the computer system 700 of the embodiment of the present disclosure, it can be according to storageIt is loaded into random access storage device (RAM) 703 in the program in read-only memory (ROM) 702 or from storage section 708Program and execute various movements appropriate and processing.Processor 701 for example may include general purpose microprocessor (such as CPU), refer toEnable set processor and/or related chip group and/or special microprocessor (for example, specific integrated circuit (ASIC)), etc..ProcessingDevice 701 can also include the onboard storage device for caching purposes.Processor 701 may include for executing according to disclosure realityApply single treatment unit either multiple processing units of the different movements of the method flow of example.
In RAM 703, it is stored with system 700 and operates required various programs and data.Processor 701, ROM 702 withAnd RAM 703 is connected with each other by bus 704.Processor 701 is held by executing the program in ROM 702 and/or RAM 703The various operations gone according to the method flow of the embodiment of the present disclosure.It is noted that described program also can store except ROM 702In one or more memories other than RAM 703.Processor 701 can also be stored in one or more of by executionProgram in memory executes the various operations of the method flow according to the embodiment of the present disclosure.
In accordance with an embodiment of the present disclosure, system 700 can also include input/output (I/O) interface 705, input/output(I/O) interface 705 is also connected to bus 704.System 700 can also include be connected to I/O interface 705 with one in lower componentItem is multinomial: the importation 706 including keyboard, mouse etc.；Including such as cathode-ray tube (CRT), liquid crystal display (LCD)Deng and loudspeaker etc. output par, c 707；Storage section 708 including hard disk etc.；And including such as LAN card, modulatedemodulateAdjust the communications portion 709 of the network interface card of device etc..Communications portion 709 executes communication process via the network of such as internet.Driver 710 is also connected to I/O interface 705 as needed.Detachable media 711, such as disk, CD, magneto-optic disk, semiconductorMemory etc. is mounted on as needed on driver 710, in order to be pacified as needed from the computer program read thereonIt is packed into storage section 708.
In accordance with an embodiment of the present disclosure, computer software journey may be implemented as according to the method flow of the embodiment of the present disclosureSequence.For example, embodiment of the disclosure includes a kind of computer program product comprising be carried on computer readable storage mediumComputer program, which includes the program code for method shown in execution flow chart.In such implementationIn example, which can be downloaded and installed from network by communications portion 709, and/or from detachable media 711It is mounted.When the computer program is executed by processor 701, the above-mentioned function limited in the system of the embodiment of the present disclosure is executedEnergy.In accordance with an embodiment of the present disclosure, system as described above, unit, module, unit etc. can pass through computer programModule is realized.
The disclosure additionally provides a kind of computer readable storage medium, which can be above-mentioned realityIt applies included in equipment/device/system described in example；Be also possible to individualism, and without be incorporated the equipment/device/In system.Above-mentioned computer readable storage medium carries one or more program, when said one or multiple program quiltsWhen execution, the method according to the embodiment of the present disclosure is realized.
Flow chart and block diagram in attached drawing are illustrated according to the system of the various embodiments of the disclosure, method and computer journeyThe architecture, function and operation in the cards of sequence product.In this regard, each box in flowchart or block diagram can generationA part of one module, program segment or code of table, a part of above-mentioned module, program segment or code include one or moreExecutable instruction for implementing the specified logical function.It should also be noted that in some implementations as replacements, institute in boxThe function of mark can also occur in a different order than that indicated in the drawings.For example, two boxes succeedingly indicated are practicalOn can be basically executed in parallel, they can also be executed in the opposite order sometimes, and this depends on the function involved.Also it wantsIt is noted that the combination of each box in block diagram or flow chart and the box in block diagram or flow chart, can use and execute ruleThe dedicated hardware based systems of fixed functions or operations is realized, or can use the group of specialized hardware and computer instructionIt closes to realize.
It will be understood by those skilled in the art that although showing and describing referring to the certain exemplary embodiments of the disclosureThe disclosure, it will be appreciated by those skilled in the art that in this public affairs limited without departing substantially from the following claims and their equivalentsIn the case where the spirit and scope opened, a variety of changes in form and details can be carried out to the disclosure.Therefore, the model of the disclosureIt encloses and should not necessarily be limited by above-described embodiment, but should be not only determined by appended claims, also by appended claimsEquivalent be defined.