Movatterモバイル変換


[0]ホーム

URL:


CN113849663B - Fault monitoring method, system and computer medium for camera collaborative knowledge map - Google Patents

Fault monitoring method, system and computer medium for camera collaborative knowledge map
Download PDF

Info

Publication number
CN113849663B
CN113849663BCN202111438715.1ACN202111438715ACN113849663BCN 113849663 BCN113849663 BCN 113849663BCN 202111438715 ACN202111438715 ACN 202111438715ACN 113849663 BCN113849663 BCN 113849663B
Authority
CN
China
Prior art keywords
image
entity
knowledge graph
component
conclusion
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202111438715.1A
Other languages
Chinese (zh)
Other versions
CN113849663A (en
Inventor
夏东
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hunan Lebo Technology Co ltd
Original Assignee
Hunan Lebo Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hunan Lebo Technology Co ltdfiledCriticalHunan Lebo Technology Co ltd
Priority to CN202111438715.1ApriorityCriticalpatent/CN113849663B/en
Publication of CN113849663ApublicationCriticalpatent/CN113849663A/en
Application grantedgrantedCritical
Publication of CN113849663BpublicationCriticalpatent/CN113849663B/en
Activelegal-statusCriticalCurrent
Anticipated expirationlegal-statusCritical

Links

Images

Classifications

Landscapes

Abstract

The invention discloses a fault monitoring method and system of a camera collaborative knowledge graph and a computer medium. The method comprises the steps of monitoring and shooting a plurality of parts of the equipment by using a plurality of cameras, generating part images, monitoring and shooting one part of the equipment by each camera, comparing the part images with a second image entity in a knowledge graph, and obtaining a corresponding conclusion entity according to a comparison result, wherein the knowledge graph comprises entities and relations, the knowledge graph is a network-shaped image knowledge graph formed by the entities through the relations, and the entities comprise a first image entity, a second image entity and a conclusion entity.

Description

Fault monitoring method, system and computer medium for camera collaborative knowledge map
Technical Field
The invention relates to the field of industrial equipment management, in particular to a fault monitoring method, a system and a computer medium for a camera collaborative knowledge graph.
Background
Large equipment (such as cranes, bridge cranes and gantry cranes) are widely applied to ports, construction sites, industrial production workshops and the like, are very important for monitoring the state of the large equipment, and are core elements in safe production and safe construction. The existing monitoring technology aiming at the running state and the fault of the large-scale equipment is mainly to deploy various sensors, such as a vibration sensor, a temperature and humidity sensor and the like, collect the running state of the large-scale equipment and transmit the running state back to a background, deploy a fault analysis knowledge graph at the background, provide fault analysis or fault reasons according to the current state of the equipment in a mode of leading by a domain expert and assisting by the knowledge graph, and provide data support for maintenance personnel to make a fault maintenance plan.
At present, a maintainer utilizes a knowledge graph to analyze a fault mainly by utilizing text information to search, and the purpose of the method is how to utilize the knowledge graph to quickly check possible reasons causing the fault when the fault occurs.
Therefore, it is highly desirable to provide a method for monitoring a fault that can implement automatic fault warning and can implement a fault.
Disclosure of Invention
The invention provides a fault monitoring method, a system and a computer medium for a camera collaborative knowledge graph, which are used for solving the technical problem that the traditional knowledge graph in the prior art cannot realize automatic fault early warning.
In order to solve the technical problems, the technical scheme provided by the invention is as follows: the fault monitoring method of the camera collaborative knowledge graph comprises the following steps:
s1 monitoring and shooting a plurality of components of the equipment by using a plurality of cameras and generating component images, wherein each camera monitors one component of the shooting equipment;
s2, comparing the part image with a second image entity in the knowledge graph, and obtaining a corresponding conclusion entity according to the comparison result;
the knowledge graph comprises entities and relations, and is a network-shaped image knowledge graph formed by the entities through the relations; the entities comprise a first image entity, a second image entity and a conclusion entity;
the first image entity is a component image of the component in a normal state; the second image entity is a component image when the running state of the component changes; the conclusion entity comprises fault types corresponding to the component images when the running state of the component changes and information of treatment opinions;
preferably, the relationship includes a first relationship between the first image entity and the second image entity and a second relationship between the second image entity and the conclusion entity, the first relationship represents a change reason of the change of the operating state of the component, and the second relationship represents a pointing relationship from the second image entity to the conclusion entity when the change of the operating state of the component may cause a fault.
Preferably, the construction of the knowledge-graph comprises the following steps:
collecting data, wherein collecting data comprises collecting part images and video data of each part of the monitored equipment in different operating states and using description materials of the monitored equipment;
sorting out the sequence and the change reason of the image change of each component in various running states according to the materials, and giving out corresponding fault types and treatment opinions after the corresponding running states of each component;
generating a first image entity, a second image entity and a first relation according to the sequence of component image changes of each component in various running states and the change reasons; giving out corresponding fault types and processing opinions according to corresponding running states of all the parts to generate a second relation and a conclusion entity;
and constructing and storing an initial knowledge graph of the equipment according to the generated first image entity, the second image entity, the conclusion entity, the first relation and the second relation.
Preferably, the constructing of the knowledge-graph further comprises updating the knowledge-graph, and the updating the knowledge-graph comprises the following steps:
each camera monitors a component of the shooting device;
the part image of the part shot by the camera
Figure 493170DEST_PATH_IMAGE001
With the last part image
Figure 315501DEST_PATH_IMAGE002
Comparing, if the part image is
Figure 612621DEST_PATH_IMAGE001
Image feature vector of
Figure 940834DEST_PATH_IMAGE003
And the last part image
Figure 698138DEST_PATH_IMAGE002
Image feature vector of
Figure 137210DEST_PATH_IMAGE004
Is a distance of
Figure 554416DEST_PATH_IMAGE005
Greater than a first threshold
Figure 53530DEST_PATH_IMAGE006
The part image of this time
Figure 805455DEST_PATH_IMAGE007
Comparing the image feature vector with the feature vectors of all second image entities of the component in the knowledge graph, and if not, ending updating the knowledge graph;
if the part image is present
Figure 48217DEST_PATH_IMAGE001
Image feature vector of
Figure 585509DEST_PATH_IMAGE003
The maximum of the distances to the feature vectors of all second image entities of the component in the knowledge-graph is larger than a second threshold
Figure 255525DEST_PATH_IMAGE008
The current part image
Figure 996210DEST_PATH_IMAGE001
Adding a knowledge graph as a second image entity, establishing a relationship and a corresponding conclusion entity, and if not, finishing updating the knowledge graph;
and storing the updated knowledge graph.
Preferably, the method further comprises the steps of judging whether the component image is compared with a second image entity in the knowledge graph, and obtaining a corresponding conclusion entity according to the comparison result, wherein the judging process comprises the following steps:
the part image of this time
Figure 42663DEST_PATH_IMAGE009
With the last part image
Figure 434461DEST_PATH_IMAGE010
Comparing, if the part image is
Figure 275378DEST_PATH_IMAGE009
Feature vector of
Figure 814944DEST_PATH_IMAGE011
With the last part image
Figure 524143DEST_PATH_IMAGE010
Feature vector of
Figure 895081DEST_PATH_IMAGE012
Is a distance of
Figure 47845DEST_PATH_IMAGE013
Greater than a third threshold
Figure 137024DEST_PATH_IMAGE006
Comparing the part image with a second image entity in the knowledge graph, and obtaining a corresponding conclusion entity according to a comparison result; otherwise, the comparison is not performed.
Preferably, comparing the component image with a second image entity in the knowledge graph, and obtaining a corresponding conclusion entity according to the comparison result includes:
each camera
Figure 882870DEST_PATH_IMAGE014
Part of monitoring shooting equipment
Figure 373894DEST_PATH_IMAGE015
The part image of the part shot by the camera
Figure 759876DEST_PATH_IMAGE009
And the parts in the knowledge map
Figure 946138DEST_PATH_IMAGE015
Comparing all second image entities to obtain the current part image
Figure 872505DEST_PATH_IMAGE009
Feature vector of
Figure 608249DEST_PATH_IMAGE011
And the parts in the knowledge map
Figure 961870DEST_PATH_IMAGE015
The distance minimum value of the feature vector relative ratio of all the second image entities is obtained to obtain the second image entity corresponding to the distance minimum value
Figure 635428DEST_PATH_IMAGE016
And a second image entity
Figure 568749DEST_PATH_IMAGE016
Feature vector of
Figure 768786DEST_PATH_IMAGE017
If the part image is present
Figure 919407DEST_PATH_IMAGE009
Feature vector of
Figure 470474DEST_PATH_IMAGE011
With the second image entity
Figure 879590DEST_PATH_IMAGE016
The feature vector of
Figure 934133DEST_PATH_IMAGE017
Is less than a fourth threshold value
Figure 832819DEST_PATH_IMAGE018
Then the second image entity corresponding to the minimum distance value is determined
Figure 730237DEST_PATH_IMAGE016
Marking as
Figure 802098DEST_PATH_IMAGE019
And judging the second image entity corresponding to the minimum distance value
Figure 852094DEST_PATH_IMAGE016
Whether connected to a concluding entity, if so, checking a second map of other components connected to the entity's conclusionWhether or not the image entities are all marked
Figure 983998DEST_PATH_IMAGE019
Otherwise, ending; if the second image entities of other components connected to the entity conclusion are all marked as
Figure 607527DEST_PATH_IMAGE019
And outputting a conclusion entity, otherwise, ending.
The embodiment of the present invention further provides a computer system, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and when the processor executes the computer program, the steps of the method are implemented.
Embodiments of the present invention also provide a computer medium, on which a computer program is stored, and when the program is executed by a processor, the steps in the above method are implemented.
The invention has the following beneficial effects:
1. the fault monitoring method of the camera collaborative knowledge graph uses a plurality of cameras to monitor and shoot a plurality of components of equipment and generate component images, each camera monitors one component of the shooting equipment, then the component images are compared with second image entities in the knowledge graph, corresponding conclusion entities are obtained according to comparison results, wherein the knowledge graph comprises entities and relations, the knowledge graph is a network-shaped image knowledge graph formed by the entities through the relations, the entities comprise a first image entity, a second image entity and conclusion entities, fault early warning can be given before or when a fault occurs, and meanwhile, the conclusion entities are obtained to provide reference for the assignment of a fault component maintenance plan so as to avoid the loss of the equipment on production operation caused by the fault.
2. According to the invention, the current part image and the last part image shot by a certain part are compared by the camera, whether the current part image is compared with the second image entity in the knowledge map is judged, and if the comparison result of the current part image and the last part image is smaller than the third threshold value, the next comparison is not carried out, so that the calculation steps of the method can be greatly simplified, and the efficiency of fault monitoring and prediction is improved.
3. According to the method, the image knowledge graph is adopted, the second entity image is compared with the component image shot by the camera, the defect that ambiguity may exist in named entities in the text knowledge graph can be avoided, in addition, a large amount of text information is needed for constructing the text knowledge graph, the construction steps are complex, and the image knowledge graph is easy to construct.
In addition to the objects, features and advantages described above, other objects, features and advantages of the present invention are also provided. The present invention will be described in further detail below with reference to the accompanying drawings.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this application, illustrate embodiments of the invention and, together with the description, serve to explain the invention and not to limit the invention. In the drawings:
fig. 1 is a schematic diagram of a fault monitoring method of a camera collaborative knowledge graph according to a preferred embodiment of the present invention.
Detailed Description
The embodiments of the invention will be described in detail below with reference to the drawings, but the invention can be implemented in many different ways as defined and covered by the claims.
Referring to fig. 1, the method for monitoring the fault of the camera collaborative knowledge graph includes:
s1 monitoring and shooting a plurality of components of the equipment by using a plurality of cameras and generating component images, wherein each camera monitors one component of the shooting equipment;
s2, comparing the part image with a second image entity in the knowledge graph, and obtaining a corresponding conclusion entity according to the comparison result;
the knowledge graph comprises entities and relations, and is a network-shaped image knowledge graph formed by the entities through the relations; the entities include a first image entity, a second image entity and a conclusion entity.
It should be noted that the knowledge graph of the invention is different from the traditional text knowledge graph in that the knowledge graph of the invention is an image knowledge graph, and named entities in the text knowledge graph may have the disadvantage of ambiguity.
The first image entity is a component image of the component in a normal state; the second image entity is a component image when the running state of the component changes; the conclusion entity comprises fault types corresponding to the component images when the running state of the component changes and information of treatment opinions; in practice, the conclusion entity also includes information about what component operating state has changed, i.e., the cause of the fault.
In this embodiment, the relationship includes a first relationship between the first image entity and the second image entity and a second relationship between the second image entity and the conclusion entity, the first relationship represents a change reason of the change of the operating state of the component, and the second relationship represents a pointing relationship from the second image entity to the conclusion entity when the change of the operating state of the component may cause a fault.
Optionally, the constructing of the knowledge graph comprises the following steps:
collecting data, wherein the collecting data comprises collecting data such as part images, videos and the like of each part of the monitored equipment in different running states and using description materials of the monitored equipment;
sorting out the sequence and the change reason of the image change of each component in various running states according to the materials, and giving out corresponding fault types and treatment opinions after the corresponding running states of each component;
generating a first image entity, a second image entity and a first relation according to the sequence of component image changes of each component in various running states and the change reasons; giving out corresponding fault types and processing opinions according to corresponding running states of all the parts to generate a second relation and a conclusion entity;
and constructing and storing an initial knowledge graph of the equipment according to the generated first image entity, the second image entity, the conclusion entity, the first relation and the second relation.
Optionally, the constructing the knowledge graph further includes updating the knowledge graph, and the updating the knowledge graph includes the following steps:
each camera monitors a component of the shooting device;
the part image of the part shot by the camera
Figure 483079DEST_PATH_IMAGE001
With the last part image
Figure 449898DEST_PATH_IMAGE002
Comparing, if the part image is
Figure 628070DEST_PATH_IMAGE001
Image feature vector of
Figure 109867DEST_PATH_IMAGE003
And the last part image
Figure 913743DEST_PATH_IMAGE002
Image feature vector of
Figure 797386DEST_PATH_IMAGE004
Is a distance of
Figure 146459DEST_PATH_IMAGE005
Greater than a first threshold
Figure 115552DEST_PATH_IMAGE006
The part image of this time
Figure 536169DEST_PATH_IMAGE007
Comparing the image feature vector with the feature vectors of all second image entities of the component in the knowledge graph, and if not, ending updating the knowledge graph;
if the part image is present
Figure 900416DEST_PATH_IMAGE001
Image feature vector of
Figure 810603DEST_PATH_IMAGE003
The maximum of the distances to the feature vectors of all second image entities of the component in the knowledge-graph is larger than a second threshold
Figure 142359DEST_PATH_IMAGE008
The current part image
Figure 897825DEST_PATH_IMAGE001
Adding a knowledge graph as a second image entity, establishing a relationship and a corresponding conclusion entity, and if not, finishing updating the knowledge graph;
and storing the updated knowledge graph.
In an optional implementation manner of this embodiment, the method further includes determining whether to compare the component image with a second image entity in the knowledge graph, and obtaining a corresponding conclusion entity according to a comparison result, where the determining process includes the following steps:
the part image of this time
Figure 880694DEST_PATH_IMAGE009
With the last part image
Figure 633886DEST_PATH_IMAGE010
Comparing, if the part image is
Figure 577571DEST_PATH_IMAGE009
Feature vector of
Figure 277674DEST_PATH_IMAGE011
With the last part image
Figure 990415DEST_PATH_IMAGE010
Feature vector of
Figure 599995DEST_PATH_IMAGE012
Is a distance of
Figure 765397DEST_PATH_IMAGE013
Greater than a third threshold
Figure 738032DEST_PATH_IMAGE006
Comparing the part image with a second image entity in the knowledge graph, and obtaining a corresponding conclusion entity according to a comparison result; otherwise, the comparison is not performed.
Wherein, comparing the component image with a second image entity in the knowledge graph, and obtaining a corresponding conclusion entity according to the comparison result comprises:
each camera
Figure 774121DEST_PATH_IMAGE014
Part of monitoring shooting equipment
Figure 931433DEST_PATH_IMAGE015
The part image of the part shot by the camera
Figure 974344DEST_PATH_IMAGE009
And the parts in the knowledge map
Figure 875304DEST_PATH_IMAGE015
Comparing all second image entities to obtain the current part image
Figure 438003DEST_PATH_IMAGE009
Feature vector of
Figure 766217DEST_PATH_IMAGE011
And the parts in the knowledge map
Figure 109473DEST_PATH_IMAGE015
The distance minimum value of the feature vector relative ratio of all the second image entities is obtained to obtain the second image entity corresponding to the distance minimum value
Figure 174644DEST_PATH_IMAGE016
And a second image entity
Figure 716483DEST_PATH_IMAGE016
Feature vector of
Figure 356543DEST_PATH_IMAGE017
If the part image is present
Figure 983834DEST_PATH_IMAGE009
Feature vector of
Figure 351230DEST_PATH_IMAGE011
With the second image entity
Figure 950839DEST_PATH_IMAGE016
The feature vector of
Figure 620854DEST_PATH_IMAGE017
Is less than a fourth threshold value
Figure 610807DEST_PATH_IMAGE018
Then the second image entity corresponding to the minimum distance value is determined
Figure 922840DEST_PATH_IMAGE016
Marking as
Figure 626939DEST_PATH_IMAGE019
And judging the second image entity corresponding to the minimum distance value
Figure 467857DEST_PATH_IMAGE016
If the second image entities of the other components connected with the entity conclusion are all marked as being connected with the conclusion entity or not, if so, checking whether the second image entities of the other components connected with the entity conclusion are all marked as being connected with the conclusion entity
Figure 945105DEST_PATH_IMAGE019
Otherwise, ending; if the second image entities of other components linked to the entity conclusion are all marked as
Figure 732933DEST_PATH_IMAGE019
Then the conclusion entity is output, otherwise, the process is finished.
It should be noted that the equipment failure may cause the change of the operation status of a plurality of components at the same time, so that the above scheme needs to check whether the second image entities of other components connected to the conclusion of the entity are all marked as being all the same
Figure 103871DEST_PATH_IMAGE019
If the second image entity of only one component is marked as
Figure 505903DEST_PATH_IMAGE019
It may be a change in operating state due to an accidental situation, where the device is deemed to have failed, if the second image entities of the other components connected to the entity conclusion are all marked as such
Figure 595081DEST_PATH_IMAGE019
At this point, the device may be deemed to be malfunctioning and the conclusion entity may be output.
Further, it goes to the step "when checking whether the second image entities of the other components connected to the entity conclusion are all marked as being all marked as" when checking "whether the second image entities are all marked as" when checking "the second image entities of the other components connected to the entity conclusion
Figure 593124DEST_PATH_IMAGE019
When there is one or more marks in the second image entity of the other component
Figure 818569DEST_PATH_IMAGE019
Can also be based on the label
Figure 470131DEST_PATH_IMAGE019
The number of second image entities of (a) makes a failure prediction on the degree of device failure.
Further, the distances between the feature vectors of all the second image entities connected to the entity conclusion and the corresponding feature vectors of the first image entities can be calculated, a plurality of groups of distances are obtained at the moment, and the plurality of groups of distances are weighted and summed according to different importance of corresponding components in the equipment so as to predict the fault degree of the equipment.
Example 2:
a computer system comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the steps of the method of embodiment 1 when executing the computer program.
Example 3:
a computer medium on which a computer program is stored which, when being executed by a processor, carries out the steps of the method of embodiment 1.
The fault monitoring method of the camera collaborative knowledge graph comprises the steps of monitoring and shooting a plurality of components of equipment by using a plurality of cameras, generating component images, monitoring and shooting one component of the equipment by each camera, comparing the component images with a second image entity in the knowledge graph, and obtaining a corresponding conclusion entity according to a comparison result, wherein the knowledge graph comprises an entity and a relation, the knowledge graph is a network-shaped image knowledge graph formed by the entity and the entity through the relation, the entity comprises a first image entity, a second image entity and a conclusion entity, fault early warning can be given before or when a fault occurs, and the conclusion entity is obtained to provide reference for the specification of a fault component maintenance plan so as to avoid the loss of production operation caused by the fault of the equipment. And the camera is used for comparing the part image shot by a certain part with the last part image, judging whether the part image is compared with a second image entity in the knowledge graph or not, if the comparison result of the part image and the last part image is smaller than a third threshold value, the next comparison is not carried out, the calculation steps of fault monitoring can be greatly simplified, and the efficiency of fault monitoring and prediction is improved.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims (7)

1. A fault monitoring method based on a camera collaborative knowledge graph is characterized by comprising the following steps:
monitoring and shooting a plurality of components of equipment by using a plurality of cameras, and generating component images, wherein each camera monitors and shoots one component of the equipment;
comparing the component image with a second image entity in the knowledge graph, and obtaining a corresponding conclusion entity according to a comparison result;
the knowledge graph comprises entities and relations, and the knowledge graph is a network-shaped image knowledge graph formed by the relations between the entities; the entities comprise a first image entity, a second image entity and a conclusion entity;
the step of comparing the component image with the second image entity in the knowledge graph and obtaining a corresponding conclusion entity according to the comparison result comprises the following steps:
each camera
Figure DEST_PATH_IMAGE001
Monitoring and shooting a component of the device
Figure 205268DEST_PATH_IMAGE002
The part image of the part shot by the camera is taken
Figure DEST_PATH_IMAGE003
And the parts in the knowledge map
Figure 150091DEST_PATH_IMAGE002
Comparing all second image entities to obtain the current part image
Figure 705837DEST_PATH_IMAGE003
Feature vector of
Figure 241861DEST_PATH_IMAGE004
And the parts in the knowledge map
Figure 945374DEST_PATH_IMAGE002
The distance minimum value of the feature vector relative ratio of all the second image entities is obtained to obtain the second image entity corresponding to the distance minimum value
Figure DEST_PATH_IMAGE005
And a second image entity
Figure 162729DEST_PATH_IMAGE005
Feature vector of
Figure 104140DEST_PATH_IMAGE006
If the part image is present
Figure 811065DEST_PATH_IMAGE003
Feature vector of
Figure 1875DEST_PATH_IMAGE004
With the second image entity
Figure 695024DEST_PATH_IMAGE005
The feature vector of
Figure 84418DEST_PATH_IMAGE006
Is less than a fourth threshold value
Figure DEST_PATH_IMAGE007
Then the second image entity corresponding to the minimum distance value is determined
Figure 103189DEST_PATH_IMAGE005
Marking as
Figure 109191DEST_PATH_IMAGE008
And judging the second image entity corresponding to the minimum distance value
Figure 606032DEST_PATH_IMAGE005
Whether the second image entities of the other components connected with the entity conclusion are all marked as being connected with the conclusion entity or not is checked
Figure 115510DEST_PATH_IMAGE008
Otherwise, ending; if the second image entities of other components connected with the entity conclusion are all marked as
Figure 774025DEST_PATH_IMAGE008
And outputting the conclusion entity, otherwise, ending.
2. The camera-based collaborative knowledge graph fault monitoring method according to claim 1, wherein the first image entity is a component image of the component in a normal state; the second image entity is a component image when the running state of the component changes; the conclusion entity comprises fault types corresponding to the component images when the running state of the component changes and information of treatment opinions;
the relationship comprises a first relationship between a first image entity and a second relationship between the second image entity and a conclusion entity, the first relationship represents a change reason of the change of the component operation state, and the second relationship represents a pointing relationship from the second image entity to the conclusion entity when the component operation state changes to cause a fault.
3. The camera-based collaborative knowledge graph fault monitoring method according to claim 2, wherein constructing the knowledge graph comprises the steps of:
collecting data, wherein the collecting data comprises collecting part images and video data of each part of the monitored equipment in different operating states and use instruction materials of the monitored equipment;
sorting out the sequence and the change reason of the image change of each component in various running states according to the material, and giving out corresponding fault types and treatment opinions after the corresponding running states of each component;
generating a first image entity, a second image entity and a first relation according to the sequence of component image changes of each component in various running states and the change reasons; giving out corresponding fault types and processing opinions according to corresponding running states of all the parts to generate a second relation and a conclusion entity;
and constructing and storing an initial knowledge graph of the equipment according to the generated first image entity, second image entity, conclusion entity, first relation and second relation.
4. The camera-based collaborative knowledge graph fault monitoring method of claim 2, wherein constructing a knowledge graph further comprises updating the knowledge graph, wherein updating the knowledge graph comprises the steps of:
each camera monitors and shoots one component of the equipment;
the part image of the part shot by the camera is taken
Figure DEST_PATH_IMAGE009
With the last part image
Figure 535832DEST_PATH_IMAGE010
Comparing, if the part image is
Figure 570784DEST_PATH_IMAGE009
Image feature vector of
Figure DEST_PATH_IMAGE011
And the last part image
Figure 669190DEST_PATH_IMAGE010
Image feature vector of
Figure DEST_PATH_IMAGE013
Is a distance of
Figure 888819DEST_PATH_IMAGE014
Greater than a first threshold
Figure DEST_PATH_IMAGE015
The part image of this time
Figure 72676DEST_PATH_IMAGE016
Comparing the image feature vectors with the feature vectors of all second image entities of the component in the knowledge graph, and if not, ending updating the knowledge graph;
if the part image is present
Figure 911319DEST_PATH_IMAGE009
Image feature vector of
Figure 67493DEST_PATH_IMAGE011
The maximum of the distances to the feature vectors of all second image entities of the component in the knowledge-graph is larger than a second threshold
Figure DEST_PATH_IMAGE017
The current part image
Figure 661286DEST_PATH_IMAGE009
Adding the knowledge graph as a second image entity, establishing a relationship and a corresponding conclusion entity, and if not, finishing updating the knowledge graph;
and storing the updated knowledge graph.
5. The camera-based collaborative knowledge graph fault monitoring method according to claim 1, further comprising determining whether to compare the component image with a second image entity in the knowledge graph, and obtaining a corresponding conclusion entity according to a comparison result, wherein the determining process comprises the following steps:
the part image of this time
Figure 863597DEST_PATH_IMAGE003
With the last part image
Figure 505931DEST_PATH_IMAGE018
Comparing, if the part image is
Figure 782191DEST_PATH_IMAGE003
Feature vector of
Figure 343623DEST_PATH_IMAGE004
With the last part image
Figure 643017DEST_PATH_IMAGE018
Feature vector of
Figure DEST_PATH_IMAGE019
Is a distance of
Figure 416938DEST_PATH_IMAGE020
Greater than a third threshold
Figure 547705DEST_PATH_IMAGE015
Comparing the part image with a second image entity in the knowledge graph, and obtaining a corresponding conclusion entity according to a comparison result; otherwise, the comparison is not performed.
6. A computer system comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the steps of the method of any one of claims 1 to 5 are performed when the computer program is executed by the processor.
7. A computer medium having a computer program stored thereon, wherein the program is adapted to perform the steps of the method of any of the preceding claims 1 to 5 when executed by a processor.
CN202111438715.1A2021-11-292021-11-29Fault monitoring method, system and computer medium for camera collaborative knowledge mapActiveCN113849663B (en)

Priority Applications (1)

Application NumberPriority DateFiling DateTitle
CN202111438715.1ACN113849663B (en)2021-11-292021-11-29Fault monitoring method, system and computer medium for camera collaborative knowledge map

Applications Claiming Priority (1)

Application NumberPriority DateFiling DateTitle
CN202111438715.1ACN113849663B (en)2021-11-292021-11-29Fault monitoring method, system and computer medium for camera collaborative knowledge map

Publications (2)

Publication NumberPublication Date
CN113849663A CN113849663A (en)2021-12-28
CN113849663Btrue CN113849663B (en)2022-04-01

Family

ID=78982468

Family Applications (1)

Application NumberTitlePriority DateFiling Date
CN202111438715.1AActiveCN113849663B (en)2021-11-292021-11-29Fault monitoring method, system and computer medium for camera collaborative knowledge map

Country Status (1)

CountryLink
CN (1)CN113849663B (en)

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication numberPriority datePublication dateAssigneeTitle
CN110825885B (en)*2019-11-132022-06-17南方电网科学研究院有限责任公司 A power equipment knowledge graph application system
CN111156655A (en)*2019-12-242020-05-15珠海格力电器股份有限公司Air conditioner main control board fault self-detection method and air conditioner
CN112307218B (en)*2020-10-212022-08-05浙江大学 Construction method of fault diagnosis knowledge base for typical equipment of intelligent power plant based on knowledge graph
CN112801313A (en)*2021-01-272021-05-14西安重装配套技术服务有限公司Fully mechanized mining face fault judgment method based on big data technology
CN113312499B (en)*2021-06-152022-10-04合肥工业大学 A power safety early warning method and system based on knowledge graph

Also Published As

Publication numberPublication date
CN113849663A (en)2021-12-28

Similar Documents

PublicationPublication DateTitle
Schlegel et al.Towards a rigorous evaluation of XAI methods on time series
KR102025556B1 (en)Processing apparatus, trace unit and diagnostic apparatus
US10901834B2 (en)Interactive troubleshooting assistant
CN111552646B (en)Method and apparatus for regression testing
Zhang et al.Few-shot bearing anomaly detection via model-agnostic meta-learning
KR102252189B1 (en)Fault diagnosis management system and method using machine learning
CN112584135A (en)Monitoring equipment fault identification method, device, equipment and storage medium
JP2021032042A (en) Deterioration state diagnosis method for structures
CN116490933A (en)Device and method for tracking abnormal state judgment basis by using neural network model
JP7181257B2 (en) Cause analysis system and method
CN115168868B (en)Business vulnerability analysis method and server applied to artificial intelligence
CN114116286B (en) Offline fault diagnosis method, device and electronic equipment for Internet of Things equipment
CN116381419A (en)Transmission line fault processing method, device, computer equipment and storage medium
US11562227B2 (en)Interactive assistant
CN113849663B (en)Fault monitoring method, system and computer medium for camera collaborative knowledge map
CN118967684B (en)Power equipment detection method and system based on image recognition
CN114492005B (en) A mission success prediction method for ship mission systems
JP7205644B2 (en) Determination method, determination program and information processing device
Ghazel et al.A monitoring approach for discrete event systems based on a time Petri net model
CN113114987A (en)Hadoop-based power system inspection method and system
JP7296152B2 (en) Program inspection device, program inspection method and program inspection program
CN114286086B (en)Camera detection method and related device
JP7524824B2 (en) Inference Device
GuoResearch on surface defect detection and fault diagnosis of mechanical gear based on R‐CNN
Benatia et al.An algorithm to diagnose manufacturing hybrid systems

Legal Events

DateCodeTitleDescription
PB01Publication
PB01Publication
SE01Entry into force of request for substantive examination
SE01Entry into force of request for substantive examination
GR01Patent grant
GR01Patent grant

[8]ページ先頭

©2009-2025 Movatter.jp