Detailed Description
In order to make the technical solutions of the present application better understood, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The terms "first," "second," and the like in the description and claims of the present application and in the above-described drawings are used for distinguishing between different objects and not for describing a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, software, product or apparatus that comprises a list of steps or elements is not limited to those listed but may alternatively include other steps or elements not listed or inherent to such process, method, product or apparatus.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments. The embodiments of the present application will be described in detail below with reference to the accompanying drawings.
First, referring to fig. 1A, a system architecture of a method for displaying engineering drawings in an embodiment of the present application is described, where the system architecture 100 includes aserver 110 and a User Equipment 120, where theserver 110 is connected to the User Equipment 120 through a local area network, theserver 110 may be a cloud server, a database server, an application server, etc., a built-in database related to engineering drawings includes information such as drawing dimension specifications and drawing common sense, the User Equipment 120 may be an electronic device with a communication capability, and the electronic device may include various handheld devices, vehicle-mounted devices, wearable devices, computing devices or other processing devices connected to a wireless modem with a wireless communication function, and various forms of User Equipment (UE), a Mobile Station (Mobile Station, MS), terminal equipment (terminal device), and the like.
TheServer 110 and theuser equipment 120 may adopt a Server/Client (C/S) architecture, that is, a front-end program of the image examination platform is pre-installed on theuser equipment 120, and a back-end program of the image examination platform is pre-installed on theServer 110; theuser equipment 120 uploads the engineering drawing to be checked to a front-end program, theserver 110 obtains the engineering drawing to be checked from the front-end program and identifies and processes the engineering drawing through a back-end program, the identification and processing can depend on an artificial intelligence unit in theserver 110, theserver 110 can receive target checking requirement information of a checker, then the processed engineering drawing generates map-checking information in a form meeting the target checking requirement information and sends the map-checking information to theuser equipment 120, theuser equipment 120 can display the map-checking information, and the map-checking information can include information such as abnormal area pictures and abnormal labels of the engineering drawing. Theserver 110 may receive the auditing requirements of the engineering drawings of multiple pieces ofuser equipment 120 at the same time.
By the positioning method of the engineering drawing executed by the CS framework, the interaction speed of the user equipment and the server can be greatly improved, and the drawing examination efficiency is improved.
Next, a system architecture of another method for displaying engineering drawings in the embodiment of the present application is described with reference to fig. 1B, where fig. 1B is a system architecture diagram of another method for displaying engineering drawings provided in the embodiment of the present application.
The system architecture adopts a Browser/Server (B/S) architecture, and comprises aServer 110,user equipment 120 and a picture-viewingweb page platform 130, wherein theServer 110 can comprise a network Server and a database Server, the network Server and the database Server are connected with each other, and the picture-viewingweb page platform 130 has only simple input and output functions and processes a few parts of business logic. Theserver 110 and theuser equipment 120 are connected to each other through a wide area network.
Under the B/S architecture, theserver 110 executes most of work such as identification, auditing and the like through an artificial intelligence unit, and theuser equipment 120 is only used for displaying the processed engineering drawings and sending an engineering drawing auditing request.
The B/S framework has the advantages of low cost, convenience in maintenance, strong distributivity and simplicity in development, can be operated at any place without installing any special software, and improves the convenience of image examination.
It should be noted that, in the embodiment of the present application, the C/S architecture and the B/S architecture of fig. 1A and fig. 1B may be implemented by being combined, for example, an artificial intelligence image-reviewing applet loaded in an applet, an artificial intelligence image-reviewing quick application of a quick application center, and the like, which is not limited herein.
In one possible embodiment, a local device architecture mode may also be adopted, for example, a network-independent artificial intelligence image scanner installed on theuser device 120, where the artificial intelligence image scanner may run a lightweight graphics engine, and may be specifically implemented by an artificial intelligence processing chip architecture on theuser device 120, where the artificial intelligence processing chip architecture may include a central processing unit CPU and at least one neural network processor NPU, the CPU is connected with the at least one NPU, and the at least one NPU may process part or all of data processing logic in the artificial intelligence image scanner.
Further, an electronic device in the embodiment of the present application is described in detail below with reference to fig. 2, where fig. 2 is a schematic structural diagram of an electronic device provided in the embodiment of the present application, and theelectronic device 200 may include one or more of the following components: aprocessor 210, amemory 220, and an input-output device 230.
Processor 210 may include one or more processing cores. Theprocessor 210 connects various parts within the overallelectronic device 200 using various interfaces and lines, and performs various functions of theelectronic device 200 and processes data by executing or executing instructions, programs, code sets, or instruction sets stored in thememory 220 and calling data stored in thememory 220.Processor 210 may include one or more processing units, such as: theprocessor 210 may include a Central Processing Unit (CPU), an Application Processor (AP), a modem processor, a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a controller, a video codec, a Digital Signal Processor (DSP), a baseband processor, and/or a neural-Network Processing Unit (NPU), etc. The controller may be, among other things, a neural center and a command center of theelectronic device 200. The controller can generate an operation control signal according to the instruction operation code and the timing signal to complete the control of instruction fetching and instruction execution. The CPU mainly processes an operating system, a user interface, an application program and the like; the GPU is used for rendering and drawing display content; the modem is used to handle wireless communications. The digital signal processor is used for processing digital signals, and can process digital image signals and other digital signals. Video codecs are used to compress or decompress digital video. Theelectronic device 200 may support one or more video codecs. In this way, theelectronic device 200 may play or record video in a variety of encoding formats, such as: moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, and the like. The NPU is a neural-network (NN) computing processor that processes input information quickly by using a biological neural network structure, for example, by using a transfer mode between neurons of a human brain, and can also learn by itself continuously. The NPU can implement applications such as intelligent recognition of theelectronic device 200, for example: image recognition, face recognition, speech recognition, text understanding, and the like.
A memory may be provided inprocessor 210 for storing instructions and data. In some embodiments, the memory in theprocessor 210 is a cache memory. The memory may hold instructions or data that have just been used or recycled byprocessor 210. If theprocessor 210 needs to use the instruction or data again, it can be called directly from the memory. Avoiding repeated accesses, reducing the latency of theprocessor 210 and increasing system efficiency.
Theprocessor 210 may include one or more interfaces, such as an integrated circuit (I2C) interface, an integrated circuit built-in audio (I2S) interface, a Pulse Code Modulation (PCM) interface, a universal asynchronous receiver/transmitter (UART) interface, a Mobile Industry Processor Interface (MIPI), a general-purpose input/output (GPIO) interface, a Subscriber Identity Module (SIM) interface, and/or a Universal Serial Bus (USB) interface, etc.
It is to be understood that theprocessor 210 may be mapped to a System On Chip (SOC) in an actual product, and the processing unit and/or the interface may not be integrated into theprocessor 210, and the corresponding functions may be implemented by a communication Chip or an electronic component alone. The above-described interface connection relationship between the modules is merely illustrative, and does not constitute a unique limitation on the structure of theelectronic apparatus 200.
TheMemory 220 may include a Random Access Memory (RAM) or a Read-Only Memory (Read-Only Memory). Optionally, thememory 220 includes a non-transitory computer-readable medium. Thememory 220 may be used to store instructions, programs, code, sets of codes, or sets of instructions. Thememory 120 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playing function, an image playing function, etc.), instructions for implementing various method embodiments described below, and the like, and the operating system may be an Android (Android) system (including a system based on Android system depth development), an IOS system developed by apple inc (including a system based on IOS system depth development), or other systems. The storage data area may also store data created by the terminal 100 in use, such as a phonebook, audio-video data, chat log data, and the like.
The input andoutput device 230 may include a touch display screen for receiving a touch operation of a user on or near the touch display screen using a finger, a touch pen, or any other suitable object, and displaying a user interface of each application. The touch display screen is generally provided on the front panel of theelectronic device 200. The touch display screen may be designed as a full-screen, a curved screen, or a shaped screen. The touch display screen can also be designed to be a combination of a full-face screen and a curved-face screen, and a combination of a special-shaped screen and a curved-face screen, which is not limited in the embodiment of the present application.
The hardware architecture in the embodiment of the present application is introduced above, and a method for displaying an engineering drawing in the embodiment of the present application is described below with reference to fig. 3, where fig. 3 is a schematic flow chart of the method for displaying an engineering drawing provided in the embodiment of the present application, and specifically includes the following steps:
step 301, identifying an abnormal area on the target engineering drawing and generating abnormal marking information.
The abnormal area is used for representing an area which does not accord with a preset drawing specification; the preset drawing specifications may include standard rules in the engineering drawing field such as marking specifications, size specifications, color specifications, and the like.
The target engineering drawing can be identified through a trained drawing identification model to determine the target area, the trained drawing identification model can be a deep neural network model, and abnormal areas which do not accord with the preset drawing rule in the target engineering drawing can be accurately identified through training of a large number of marked engineering drawings; optionally, in addition to the drawing recognition model, a recognition program may be compiled in combination with the preset drawing rule to recognize the target engineering drawing, which is not specifically limited herein.
Specifically, the target engineering drawing may be preprocessed, for example, relevant information such as the size and the resolution of the target engineering drawing may be obtained first, and if the size of the target engineering drawing is smaller than or equal to a preset size, or the resolution of the target engineering drawing is smaller than or equal to a preset resolution, the whole drawing of the target engineering drawing is directly preprocessed; if the size of the target engineering drawing is larger than a preset size, or the resolution of the target engineering drawing is larger than a preset resolution, the target engineering drawing is cut into a plurality of grids for respective preprocessing, the cutting can cut the target engineering drawing into a plurality of grids with the same size, or can be divided into a plurality of grids with different sizes according to the structure of the target engineering drawing, and the method is not particularly limited herein. The preprocessing comprises graying, geometric transformation, image enhancement and the like, and in the aspect of graying, a component method, a maximum value method, an average value method and a weighted average method can be adopted to graying the target engineering drawing; in the aspect of geometric transformation, the geometric transformation of the target engineering drawing can be completed by adopting nearest neighbor interpolation, bilinear interpolation, bicubic interpolation and the like; in the aspect of image enhancement, a spatial domain-based algorithm and a frequency domain-based algorithm can be adopted to process the target engineering drawing.
After the preprocessing, the problem coordinates of the preprocessed target engineering drawing, which do not conform to the preset drawing specification, may be obtained, for example, problems such as wrong marks, wrong structures, and the like may occur in the target engineering drawing, and the target area may be divided according to a preset area division rule with the wrong coordinates as the problem coordinates. The preset area division rule can perform area division for the structure according to the problem coordinate, for example, when other structures do not exist around the problem coordinate, the problem area can be divided according to a first area range at the moment, when the structure around the problem coordinate is complex, the problem area needs to be divided according to a second area range at the moment, and other normal structures are prevented from being drawn into the target area, wherein the first area range is larger than the second area range.
Therefore, by identifying the abnormal area on the target engineering drawing and generating the abnormal marking information, the accuracy and the efficiency of checking the engineering drawing can be improved.
Step 302, generating at least one abnormal viewpoint picture corresponding to the abnormal labeling information according to the abnormal area.
The abnormal viewpoint picture is used for displaying the abnormal area, various types of abnormalities may exist in the target engineering drawing, the abnormal type of the abnormal area may be obtained first, and the abnormal type may include connection abnormality, structure deficiency, structure redundancy, annotation abnormality, and the like. The method comprises the following steps that connection abnormity, namely component connection drawing error, structural deficiency, namely drawing deficiency, of key components, structural redundancy, namely component redundancy in drawing, and labeling abnormity can cause errors for related labels; then, determining a picture generation rule of the abnormal region according to the abnormal type, where the picture generation rule may include a display number rule and a display scale rule; finally, the abnormal viewpoint picture can be generated according to the display quantity rule and the display scale rule, the quantity of the abnormal viewpoint picture conforms to the display quantity rule, and the scaling of the abnormal viewpoint picture conforms to the display scale rule. For example, when the anomaly type is identified as a connection anomaly, a first number of abnormal viewpoint pictures at a first scaling rate may be generated, when the anomaly type is identified as a structural deficiency, a second number of abnormal viewpoint pictures at a second scaling rate may be generated, when the anomaly type is identified as a structural excess, a third number of abnormal viewpoint pictures at a third scaling rate may be generated, when the anomaly type is identified as a marked anomaly, a fourth number of abnormal viewpoint pictures at a fourth scaling rate may be generated, the first number. The values of the second number, the third number and the fourth number may be set according to the requirements of the auditor.
Therefore, at least one abnormal viewpoint picture corresponding to the abnormal labeling information is generated according to the abnormal area, and a corresponding number of abnormal viewpoint pictures can be generated according to different abnormal types, so that the auditing efficiency and accuracy are greatly improved.
And 303, generating and displaying examination picture information according to the target examination demand information, the abnormal marking information and the abnormal viewpoint picture.
The target audit requirement information can comprise single abnormal audit and a plurality of abnormal audits;
when the target audit demand information is single abnormal audit, generating a single audit interface according to an operation instruction of a first abnormal label in the abnormal label information, wherein the single audit interface comprises the first abnormal label and a first abnormal viewpoint picture in the abnormal viewpoint pictures corresponding to the first abnormal label;
and when the target audit demand information is a plurality of abnormal audits, generating a plurality of audit interfaces according to the operation instruction of a first abnormal label in the abnormal label information, wherein the plurality of audit interfaces comprise the first abnormal label and a second abnormal label set approximate to the first abnormal label, and the first abnormal viewpoint picture and a second abnormal viewpoint picture set corresponding to the second abnormal label set.
For example, when the first abnormal label is clicked by the auditor and the audit requirement is single audit, a single audit interface can be generated on the current interface, the single audit interface only displays the first abnormal label and the abnormal viewpoint picture corresponding to the first abnormal label, and the abnormal viewpoint picture can be displayed by combining one character label with the thumbnail; when the first abnormal label is clicked by the auditor and the audit requirement is a plurality of audits, a plurality of audit interfaces can be generated on the current interface, and the plurality of audit interfaces can include the first abnormal label and a second abnormal label set similar to the problem type of the first abnormal label, and the first abnormal viewpoint picture and a second abnormal viewpoint picture set corresponding to the second abnormal label set can be displayed through a plurality of text labels and thumbnails of all the text labels.
In an optional embodiment, the target audit requirement information may be determined by collecting identity characteristic information of a current auditor, specifically, the identity characteristic information may include iris characteristics, fingerprint characteristics, vein fingerprint characteristics, voiceprint characteristics, and the like, and the history audit requirement information having a mapping relationship with the identity characteristic information may be obtained from a history audit requirement database, and the history audit requirement information is used as the target audit requirement information. The historical audit requirement database stores the identity characteristic information of different auditors and the corresponding data of audit requirement habits.
Therefore, the automation degree of the audit can be improved, and the workload of auditors is reduced.
Next, a description is given to another method for displaying engineering drawings in the embodiment of the present application with reference to fig. 4, where fig. 4 is a schematic flow chart of another method for displaying engineering drawings provided in the embodiment of the present application, and the method specifically includes the following steps:
step 401, identifying an abnormal area on the target engineering drawing, and generating abnormal labeling information.
Step 402, obtaining the abnormal type of the abnormal area.
Step 403, determining a picture generation rule of the abnormal area according to the abnormal type.
And step 404, generating the abnormal viewpoint picture according to a display quantity rule and a display proportion rule.
Step 405, obtaining target audit requirement information.
And 406, when the target audit demand information is a single abnormal audit, generating a single audit interface according to the operation instruction of the first abnormal label in the abnormal label information.
Step 407, when the target audit demand information is a plurality of abnormal audits, generating a plurality of audit interfaces according to the operation instruction of the first abnormal label in the abnormal label information.
And step 408, generating a drawing modification suggestion according to the abnormal type.
The drawing modification suggestion includes a historical modification scheme corresponding to the abnormal type, and a solution of the abnormal type similar to the current abnormal type can be obtained by combining artificial intelligence with big data for analysis, and the drawing modification suggestion can be any one of characters, pictures, videos and sounds or any combination form thereof, and is not limited specifically here.
Therefore, modification suggestion reference according with the current abnormal type can be automatically provided for the auditors, and the efficiency of modifying the engineering drawing is improved.
Instep 409, the drawing modification suggestion is displayed in a preset form in a preset area.
The preset area may be set on the review information through an extensible interface, for example, the drawing modification suggestion may be set as a pop-up button on the review information, and an auditor expands the interface of the drawing modification suggestion when clicking or floating a cursor on the pop-up button.
The steps not described in detail above can be referred to the description of part or all of the method in fig. 3, and are not described again here.
By the method, abnormal areas in the engineering drawings can be automatically identified through artificial intelligence, and corresponding auditing information is generated and displayed, so that the efficiency of auditing the engineering drawings and the auditing experience of auditors are greatly improved.
The above description has introduced the solution of the embodiment of the present application mainly from the perspective of the method-side implementation process. It is understood that the electronic device comprises corresponding hardware structures and/or software modules for performing the respective functions in order to realize the above-mentioned functions. Those of skill in the art will readily appreciate that the present application is capable of hardware or a combination of hardware and computer software implementing the various illustrative elements and algorithm steps described in connection with the embodiments provided herein. Whether a function is performed as hardware or computer software drives hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
In the embodiment of the present application, the electronic device may be divided into the functional units according to the method example, for example, each functional unit may be divided corresponding to each function, or two or more functions may be integrated into one processing unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit. It should be noted that the division of the unit in the embodiment of the present application is schematic, and is only a logic function division, and there may be another division manner in actual implementation.
Fig. 5 is a block diagram showing a functional unit composition of a display device of an engineering drawing according to the above embodiment, in a case where each functional module is divided according to each function. As shown in fig. 5, thedisplay device 500 of the engineering drawing includes:
ananomaly identification unit 510, configured to identify an anomaly region on the target engineering drawing, and generate anomaly labeling information, where the anomaly region is used to represent a region that does not meet a preset drawing specification;
apicture generating unit 520, configured to generate at least one abnormal viewpoint picture corresponding to the abnormal labeling information according to the abnormal region, where the abnormal viewpoint picture is used to display the abnormal region;
and anexception display unit 530, configured to generate and display examination image information according to the target examination requirement information, the exception annotation information, and the exception viewpoint picture.
In the case of using an integrated unit, fig. 6 shows a functional unit composition block diagram of a display device of engineering drawings related to one of the above embodiments. As shown in fig. 6, thedisplay device 600 of the engineering drawing includes aprocessing unit 601 and acommunication unit 602, where theprocessing unit 601 is configured to execute any step in the above method embodiments, and when data transmission such as sending is performed, thecommunication unit 602 is optionally called to complete corresponding operations.
Thedisplay device 600 of the engineering drawing may further include astorage unit 603 for storing program codes and data of the electronic device. Theprocessing unit 601 may be a central processing unit, thecommunication unit 602 may be a radio frequency module, and thestorage unit 603 may be a memory.
It can be understood that, since the method embodiment and the apparatus embodiment are different presentation forms of the same technical concept, the content of the method embodiment portion in the present application should be synchronously adapted to the apparatus embodiment portion, and is not described herein again.
Embodiments of the present application also provide a computer storage medium, where the computer storage medium stores a computer program for electronic data exchange, the computer program enabling a computer to execute part or all of the steps of any one of the methods described in the above method embodiments, and the computer includes an electronic device.
Embodiments of the present application also provide a computer program product comprising a non-transitory computer readable storage medium storing a computer program operable to cause a computer to perform some or all of the steps of any of the methods as described in the above method embodiments. The computer program product may be a software installation package, the computer comprising an electronic device.
It should be noted that, for simplicity of description, the above-mentioned method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present application is not limited by the order of acts described, as some steps may occur in other orders or concurrently depending on the application. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required in this application.
In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus may be implemented in other manners. For example, the above-described embodiments of the apparatus are merely illustrative, and for example, the above-described division of the units is only one type of division of logical functions, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of some interfaces, devices or units, and may be an electric or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit may be stored in a computer readable memory if it is implemented in the form of a software functional unit and sold or used as a stand-alone product. Based on such understanding, the technical solution of the present application may be substantially implemented or a part of or all or part of the technical solution contributing to the prior art may be embodied in the form of a software product stored in a memory, and including several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the above-mentioned method of the embodiments of the present application. And the aforementioned memory comprises: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.
Those skilled in the art will appreciate that all or part of the steps in the methods of the above embodiments may be implemented by associated hardware instructed by a program, which may be stored in a computer-readable memory, which may include: flash Memory disks, Read-Only memories (ROMs), Random Access Memories (RAMs), magnetic or optical disks, and the like.
The foregoing detailed description of the embodiments of the present application has been presented to illustrate the principles and implementations of the present application, and the above description of the embodiments is only provided to help understand the method and the core concept of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.