Disclosure of Invention
Therefore, the technical problem to be solved by the invention is to overcome the defect of low efficiency in the prior art, and provide a method, a system and a device for monitoring urban civilized construction based on artificial intelligence.
According to a first aspect, the embodiment of the invention discloses a city civilization construction monitoring method, which comprises the steps of obtaining data collected by a plurality of city data collecting devices within a target time length; analyzing the acquired data by using a pre-trained urban civilization analysis model to obtain an urban civilization analysis result; and responding to the monitoring operation of the city civilization according to the city civilization analysis result.
Optionally, the city data collecting device includes: video acquisition equipment and voice acquisition equipment.
Optionally, the city civilization analysis model includes an intelligent semantic recognition model and an intelligent contextual recognition model; the analyzing the collected data by utilizing the pre-trained urban civilization analysis model to obtain the urban civilization analysis result comprises the following steps: analyzing the voice data acquired by the voice acquisition equipment by using a pre-trained intelligent semantic recognition model to obtain a semantic analysis result; when the existence of the non-civilized behavior is determined according to the semantic analysis result, analyzing video data acquired by target video acquisition equipment by using a pre-trained intelligent context recognition model to obtain a context analysis result, wherein the target video acquisition equipment and the voice acquisition equipment corresponding to the voice analysis result with the non-civilized behavior are in the same scene; and obtaining the urban civilization analysis result according to the semantic analysis result and the contextual analysis result.
Optionally, responding to the operation of monitoring the city culture according to the result of the city culture analysis includes: responding to the abnormal behavior alarm operation when the existence of the non-civilized behavior is determined according to the urban civilization analysis result; and generating an abnormal behavior analysis report, and sending the abnormal behavior analysis report to a user side.
Optionally, the method further comprises: generating a plurality of city civilization development reports according to the city civilization analysis result; and adjusting the urban civilization development report according to the requirements of different types of user terminals, and then sending the urban civilization development report to the corresponding user terminals.
Optionally, the acquiring data acquired by a plurality of city data acquisition devices within the target duration includes: carrying out region division on a city to be monitored according to preset division conditions, and taking each divided region as a grid; and acquiring data acquired by urban data acquisition equipment in each grid within the target time length.
According to a second aspect, the embodiment of the present invention further discloses an artificial intelligence-based city civilization monitoring system, which includes: the city data acquisition equipment is used for acquiring data; the data storage equipment is in communication connection with the urban data acquisition equipment and is used for storing data; an intelligent data analysis platform, communicatively connected to the data storage device, for performing the steps of the artificial intelligence based city culture monitoring method as described in the first aspect or the optional embodiment of the first aspect; and the user side is in communication connection with the intelligent data analysis platform and is used for acquiring an urban civilization analysis result.
Optionally, the system further comprises: and the test equipment is used for generating city civilization test data and testing the performance of the intelligent data analysis platform through the city civilization test data.
Optionally, the system further comprises: and the information filling equipment is used for receiving the judgment standard data of the urban civilization behaviors.
According to the third aspect, the embodiment of the invention also discloses an artificial intelligence-based city civilization monitoring device, which comprises: the acquisition module is used for acquiring data acquired by a plurality of urban data acquisition devices within a target time length; the analysis module is used for analyzing the acquired data by utilizing a pre-trained urban civilization analysis model to obtain an urban civilization analysis result; and the monitoring module is used for responding to the monitoring operation of the city civilization according to the city civilization analysis result.
According to a fourth aspect, an embodiment of the present invention further discloses an electronic device, including: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to cause the at least one processor to perform the steps of the civilized city construction method of the first aspect or any one of the optional embodiments of the first aspect.
According to a fifth aspect, the present invention further discloses a computer-readable storage medium, on which a computer program is stored, which, when executed by a processor, implements the steps of the civilized city construction method according to the first aspect or any one of the optional embodiments of the first aspect.
The technical scheme of the invention has the following advantages:
according to the civilized city monitoring method, the system and the device based on artificial intelligence, data collected by a plurality of city data collection devices in a target time length are obtained, a pre-trained city civilization analysis model is used for analyzing the collected data to obtain a city civilization analysis result, and monitoring operation on city civilization is responded according to the city civilization analysis result. The data collected by the urban data collection equipment are analyzed by adopting an artificial intelligence technology to obtain an urban civilization analysis result, the urban civilization development state can be judged more accurately, the urban civilization precision and efficient supervision and management are realized, and the urban civilization level is improved.
Detailed Description
The technical solutions of the present invention will be described clearly and completely with reference to the accompanying drawings, and it should be understood that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In the description of the present invention, it should be noted that the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", etc., indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings, and are only for convenience of description and simplicity of description, but do not indicate or imply that the device or element being referred to must have a particular orientation, be constructed and operated in a particular orientation, and thus, should not be construed as limiting the present invention. Furthermore, the terms "first," "second," and "third" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance.
In the description of the present invention, it should be noted that, unless otherwise explicitly specified or limited, the terms "mounted," "connected," and "connected" are to be construed broadly, e.g., as meaning either a fixed connection, a removable connection, or an integral connection; can be mechanically or electrically connected; the two elements may be directly connected or indirectly connected through an intermediate medium, or may be communicated with each other inside the two elements, or may be wirelessly connected or wired connected. The specific meanings of the above terms in the present invention can be understood in specific cases to those skilled in the art.
In addition, the technical features involved in the different embodiments of the present invention described below may be combined with each other as long as they do not conflict with each other.
The embodiment of the invention discloses an artificial intelligence-based city civilization monitoring method, which comprises the following steps of:
step 101, data collected by a plurality of urban data collection devices within a target time length are obtained.
The target time duration may be a specified time interval, for example, according to minutes, hours, days, months, and the target time duration is not limited by the embodiment of the present invention and may be determined by one skilled in the art according to actual needs. The city data acquisition equipment can comprise any one or more of video acquisition equipment, voice acquisition equipment and various internet of things sensor equipment for sensing city environment data. The video acquisition equipment can be, for example, monitoring equipment arranged in a road, monitoring equipment of roadside shops, monitoring equipment of communities and the like, so as to acquire pedestrian road-passing data, pedestrian dog walking data and vehicle driving/parking data; the voice acquisition equipment can acquire audio data in a specific occasion, such as voice monitoring of a specific place, voice information acquisition of a recording studio and the like; the internet of things sensor for sensing urban environment data can comprise a temperature sensor, a humidity sensor, a ponding depth sensor and the like which are installed at a specific place. Data collected through the sensor equipment of the Internet of things can be used for identifying data such as temperature, humidity, accumulated water and air quality of key areas of the city, and further identifying city states in an auxiliary mode. Whether the collected data such as temperature, humidity, accumulated water, air quality and the like are the same as the normal numerical values of the city or not can be judged, and if the data are not the same, the parameters of the region are marked so as to be convenient for follow-up analysis and use.
The data collected by the city data collecting device may include multi-aspect collection of one type of data, or may be collected by multiple data types, for example, multiple pieces of video information collected by video collecting devices arranged at multiple locations (such as streets and communities) in a city may be collected, or different types of data in a city may be collected by sensors of multiple different types, for example, video data collected by a video collecting device and audio data collected by a voice collecting device may be obtained simultaneously. The embodiment of the invention does not limit the type and the mode of data acquisition, and a person skilled in the art can determine the type and the mode according to actual needs.
As an alternative embodiment of the present invention,step 101 includes: carrying out region division on a city to be monitored according to preset division conditions, and taking each divided region as a grid; and acquiring data acquired by urban data acquisition equipment in each grid within the target time length.
Illustratively, the standard for dividing the area of the city to be monitored may be dividing according to the community, or dividing according to a single set monitoring area and the total area of the city to be monitored, or dividing according to the area managed by a traditional manual grid manager, so that the divided area covers the whole city to be monitored, each divided area is used as a grid, and data acquisition is performed on each grid by using a city data acquisition device. The method comprises the steps that data collected in each grid are analyzed and processed through an artificial intelligence algorithm, monitoring operation of each grid is achieved, and compared with the traditional mode that each grid is supervised and monitored through artificial grid workers, the scheme recorded in the embodiment of the application can achieve accurate and efficient city civilization supervision and management through intelligent analysis processing of the obtained data in each grid.
And 102, analyzing the acquired data by using a pre-trained urban civilization analysis model to obtain an urban civilization analysis result.
Exemplarily, analyzing and identifying the collected data in a pre-designed urban civilization analysis model, and judging which behaviors are civilized behaviors and which are non-civilized behaviors, for example, judging pedestrians passing through a road in a red light time range as the non-civilized behaviors, and judging the pedestrians passing through the road in a green light time range as the civilized behaviors; or the citizen behavior data acquired by the video acquisition equipment is that the citizen does not cross the road at the zebra crossing position, and the urban environment data acquired by the water accumulation depth sensor is that water exists at the current zebra crossing position, so that the urban civilization analysis model can judge that the behavior that the citizen does not cross the road at the zebra crossing position at the moment is the non-civilized behavior. By sensing and judging the important ponding road sections, the influence of potential adverse environmental factors on the judgment result of urban civilized behaviors is reduced.
And 103, responding to the monitoring operation of the city civilization according to the city civilization analysis result.
For example, after determining the city civilization analysis result corresponding to the corresponding data, behavior subject persons, related regulatory units, government departments, and the like related to the civilization behavior may respond to corresponding scheme improvement operations according to the city civilization analysis result, for example, an analysis report shows that there are a large number of red light running persons and is specifically concentrated in a certain time period, and corresponding traffic control departments may appropriately adjust the rules and time of traffic lights, and the like, so as to reduce and solve the occurrence of the corresponding non-civilization behavior.
The response mode of the monitoring operation of the city civilization can also be triggering the city civilization linkage system, when the non-civilization behavior occurs, the non-civilization behavior is corrected in time through the city civilization linkage system, if the non-civilization behavior can be collected regularly, different monitoring departments can be compared, and meanwhile, the correction result can be verified in time. The correcting mode can be that when the non-civilization behavior occurs, the non-civilization behavior is shout and stopped in time by using other warning devices such as external sound boxes in the area where the non-civilization behavior occurs, and the urban non-civilization behavior is corrected in time. By fusing multi-dimensional information, the island phenomenon among different types of urban data is broken, urban civilization features can be organically linked, multi-department linkage is realized, and actions such as on-site correction reminding and the like can be carried out in real time.
According to the urban civilization construction monitoring method, data collected by a plurality of urban data collection devices in a target time length are obtained, a pre-trained urban civilization analysis model is used for analyzing the collected data to obtain an urban civilization analysis result, and monitoring operation on urban civilization is responded according to the urban civilization analysis result. The data collected by the urban data collection equipment are analyzed by adopting an artificial intelligence technology to obtain an urban civilization analysis result, the urban civilization development state can be judged more accurately, the urban civilization precision and efficient supervision and management are realized, and the urban civilization level is improved.
As an optional embodiment of the present invention, the city civilization analysis model includes an intelligent semantic recognition model and an intelligent context recognition model;step 102, comprising:
analyzing the voice data acquired by the voice acquisition equipment by using a pre-trained intelligent semantic recognition model to obtain a semantic analysis result; when the existence of the non-civilized behavior is determined according to the semantic analysis result, analyzing video data acquired by target video acquisition equipment by using a pre-trained intelligent context recognition model to obtain a context analysis result, wherein the target video acquisition equipment and the voice acquisition equipment corresponding to the voice analysis result with the non-civilized behavior are in the same scene; and obtaining the urban civilization analysis result according to the semantic analysis result and the contextual analysis result.
Illustratively, when the pre-trained intelligent semantic recognition model is used for analyzing the acquired voice data acquired by the semantic acquisition equipment, and the acquired voice analysis result is that an unlawful behavior exists, the intelligent contextual recognition model is further combined to perform intelligent analysis on the video data acquired by the target video acquisition equipment in the same scene, and a final urban civilization analysis result is determined according to the acquired semantic analysis result and the contextual analysis result so as to improve the accuracy of the urban civilization analysis result.
The mode of acquiring the target video acquisition equipment in the same scene with the voice acquisition equipment can be that the acquired voice data is identified in a pre-trained model to judge which scene the currently acquired voice data occurs in, then the target video acquisition equipment capable of acquiring the scene is determined according to scene information, and the acquired video data of the target video acquisition equipment, which is in the same time period with the audio data, is used for urban civilization analysis.
As an alternative embodiment of the present invention,step 103 includes: responding to the abnormal behavior alarm operation when the existence of the non-civilized behavior is determined according to the urban civilization analysis result; and generating an abnormal behavior analysis report, and sending the abnormal behavior analysis report to a user side.
Exemplarily, the response mode of the behavior abnormity warning operation may be to perform warning operation on the non-civilized dangerous behavior, so that a relevant supervision unit can intervene in time to ensure the safety of the non-civilized behavior main body, further ensure the safety and the healthy development of a city, and simultaneously send warning information to a user side where the non-civilized behavior main body is located, and timely stop the implementation of the non-civilized behavior; the response mode of the abnormal behavior warning operation can also be that warning and punishing operations are performed on the main body making the illegal behavior through related supervision departments, for example, the main body is implemented to drive a vehicle to have a red light running behavior, a red light running person can be educated, a main body supervision unit can carry out deduction and punishment processing on the vehicle, meanwhile, a large amount of data can be analyzed, corresponding policy adjustment is carried out, and the like.
As an optional embodiment of the present invention, the method further comprises: generating a plurality of city civilization development reports according to the city civilization analysis result; and adjusting the urban civilization development report according to the requirements of different types of user terminals, and then sending the urban civilization development report to the corresponding user terminals.
Illustratively, the city civilization development report may include a ratio of the civilization behaviors to the non-civilization behaviors in the same location, occurrence probabilities of the same non-civilization behaviors in different locations, and the like, and the city civilization development report is formed to be sent to the corresponding user terminal. The city civilization development report in the embodiment of the application can comprise a city civilization quantitative analysis report and a city civilization development characteristic report. The urban civilization quantitative analysis report can be subjected to data statistics according to time intervals, days, months, streets, communities and the like, and urban quantitative analysis results can be given, wherein the urban quantitative analysis results can comprise the number of people running red light every day/ten thousand, the number of illegal times of every day/thousand vehicles and the like; the urban civilization development characteristic report can be fused with professional evaluation and evaluation systems of urban civilization development characteristics, urban health states and the like, so that the conditions of characteristics, characteristics and the like of urban civilization can be analyzed more comprehensively and deeply, and a more scientific and objective urban civilization characteristic development report can be further provided. The type of the civilized analysis report in the embodiment of the present invention is not limited, and can be determined by those skilled in the art according to actual needs. The user end and the corresponding adjustment method are referred to in the above embodiments, and are not described herein again.
The embodiment of the invention also discloses an artificial intelligence-based city civilization monitoring system, which comprises the following parts as shown in figure 2:
and the city data acquisition equipment 201 is used for acquiring data. For specific types of the city data acquisition devices, reference may be made to the above method embodiments, which are not described herein again.
And the data storage device 202 is in communication connection with the city data acquisition device and is used for storing data.
For example, the data information may be collected continuously for a long time, and the data collected by the city data collecting device is stored by the data storage device for subsequent analysis and use. The communication mode of the urban data acquisition equipment and the data storage equipment can be that the acquisition and transmission of end data are realized through optical fiber/network cable, 4G/5G, NB-IoT and other modes, the data are collected to a data center or a machine room in a unified mode, and the initial collection of the data is realized. For example, a WiFi module or a mobile network module may be preset in a city data acquisition device, and the acquired data is sent to a data storage device in real time, for example, the data storage device may be a data receiving and storing device with a WiFi module or a computer connected to a network.
And the intelligent data analysis platform 203 is in communication connection with the data storage device and is used for executing the steps of the artificial intelligence-based city culture monitoring method according to any one of the above embodiments. The intelligent data analysis platform gathers multidimensional data and long-time accumulated data by performing intelligent video analysis, voice analysis, Internet of things perception analysis and the like, analyzes the civilization state and development characteristics of a city, provides timely linkage suggestions for each ministry and committee for the city, and performs non-civilization behavior reminding in real time by combining with systems such as on-site voice broadcasting and the like. By analyzing the civilized and non-civilized behaviors of the behavior main body in the city, the method can assist relevant departments to more comprehensively know information such as civilized states, development characteristics and the like of the city, and simultaneously gives an alarm/early warning to dangerous behaviors and abnormal behaviors, thereby ensuring the safe and healthy development of the city.
And the user side 204 is in communication connection with the intelligent data analysis platform and is used for acquiring an urban civilization analysis result.
Illustratively, the user side may be an action subject person, a relevant supervision unit, a government department, and the like, the action subject person in the embodiment of the present invention does not limit the monitoring operation mode and the relevant execution subject, the action subject may warn the future action and reduce the occurrence of the non-civilized action after obtaining the analysis report, the relevant management department may adjust the corresponding management mode and method for the analysis report, thereby reducing the civilized action of promoting the city, the embodiment of the present invention does not limit the user side category and the user side corresponding measure, a skilled person in the art may determine according to the actual need, for example, fig. 3 and fig. 4 are the specific functional module structure composition of one embodiment of the present invention, and the operation efficiency of the system is improved by modularly designing the city civilized monitoring system.
As an optional embodiment of the present invention, the system further comprises: and the test equipment is used for generating city civilization test data and testing the performance of the intelligent data analysis platform through the city civilization test data.
Illustratively, the test equipment is used for simulating and testing the performance of the intelligent data analysis platform, and the test equipment can test the performance of the intelligent data analysis platform according to the known data information and the corresponding relation whether the behavior corresponding to the data information is civilized, judge whether the accuracy and/or the analysis efficiency of the current intelligent data analysis platform meet the requirements, and if not, acquire the data again or adjust the data again to train the intelligent data analysis platform, so that the analysis performance of the intelligent data analysis platform is optimized, and the city civilization monitoring accuracy and the monitoring efficiency are improved.
As an optional embodiment of the present invention, the system further comprises: and the information filling equipment is used for receiving the judgment standard data of the urban civilization behaviors.
Illustratively, the information filling device can be defined by civilization and non-civilization of various behaviors in a questionnaire or mass problem feedback mode and the like of a relevant management department, for example, the behaviors of eating breakfast with pungent taste, running red light and the like on a closed subway bus are non-civilized behaviors, and the behaviors of walking dog tie and cleaning pet excrement in time are civilized behaviors. The information filling equipment can automatically form related reports and data analysis charts and can assist related management departments in filling materials.
The embodiment of the invention also discloses an artificial intelligence-based city civilization monitoring device, as shown in fig. 5, the device comprises:
the acquiring module 501 is configured to acquire data acquired by multiple urban data acquisition devices within a target duration;
an analysis module 502, configured to analyze the acquired data by using a pre-trained city civilization analysis model to obtain a city civilization analysis result;
and the monitoring module 503 is configured to respond to the monitoring operation on the city civilization according to the city civilization analysis result.
According to the artificial intelligence-based city civilization monitoring device, data collected by a plurality of city data collection devices in a target time length are obtained, a pre-trained city civilization analysis model is used for analyzing the collected data to obtain a city civilization analysis result, and monitoring operation on city civilization is responded according to the city civilization analysis result. The data collected by the urban data collection equipment are analyzed by adopting an artificial intelligence technology to obtain an urban civilization analysis result, the urban civilization development state can be judged more accurately, the urban civilization precision and efficient supervision and management are realized, and the urban civilization level is improved.
As an optional embodiment of the present invention, the city data collecting apparatus includes: video acquisition equipment and voice acquisition equipment.
As an optional embodiment of the invention, the city civilization analysis module comprises an intelligent semantic recognition module and an intelligent contextual recognition module; an analysis module 502, comprising: the first analysis module is used for analyzing the voice data acquired by the voice acquisition equipment by using a pre-trained intelligent semantic recognition model to obtain a semantic analysis result; the second analysis module is used for analyzing the video data acquired by the target video acquisition equipment by using a pre-trained intelligent context recognition model when the existence of the non-civilized behavior is determined according to the semantic analysis result to obtain a context analysis result, wherein the target video acquisition equipment and the voice acquisition equipment corresponding to the voice analysis result with the non-civilized behavior are in the same scene; and the result acquisition module is used for acquiring the urban civilization analysis result according to the semantic analysis result and the contextual analysis result.
As an optional embodiment of the present invention, the monitoring module 503 includes: the warning module is used for responding to the abnormal behavior warning operation when the existence of the non-civilized behavior is determined according to the urban civilization analysis result; the first sending module is used for generating an abnormal behavior analysis report and sending the abnormal behavior analysis report to the user side.
As an optional embodiment of the present invention, the apparatus further comprises: the report generation module is used for generating various city civilization development reports according to the city civilization analysis result; and the second sending module is used for adjusting the urban civilization development report according to the requirements of different types of user sides and then sending the urban civilization development report to the corresponding user sides.
As an optional embodiment of the present invention, the obtaining module 501 includes: the division submodule is used for carrying out region division on the city to be monitored according to preset division conditions, and each divided region is used as a grid; and the acquisition submodule is used for acquiring the data acquired by the urban data acquisition equipment in each grid within the target duration.
An embodiment of the present invention further provides an electronic device, as shown in fig. 6, the electronic device may include aprocessor 601 and amemory 602, where theprocessor 601 and thememory 602 may be connected by a bus or in another manner, and fig. 6 illustrates an example of a connection by a bus.
Processor 601 may be a Central Processing Unit (CPU). TheProcessor 601 may also be other general purpose processors, Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components, or combinations thereof.
Thememory 602, which is a non-transitory computer readable storage medium, may be used to store non-transitory software programs, non-transitory computer executable programs, and modules, such as program instructions/modules corresponding to the artificial intelligence based city culture monitoring method in the embodiments of the present invention. Theprocessor 601 executes various functional applications and data processing of the processor by running non-transitory software programs, instructions and modules stored in thememory 602, that is, implementing the artificial intelligence based city civilization monitoring method in the above method embodiments.
Thememory 602 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created by theprocessor 601, and the like. Further, thememory 602 may include high speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, thememory 602 may optionally include memory located remotely from theprocessor 601, which may be connected to theprocessor 601 through a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The one or more modules are stored in thememory 602 and, when executed by theprocessor 601, perform an artificial intelligence based city culture monitoring method as in the embodiment shown in fig. 1.
The details of the electronic device may be understood with reference to the corresponding related description and effects in the embodiment shown in fig. 1, and are not described herein again.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic Disk, an optical Disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a Flash Memory (Flash Memory), a Hard Disk (Hard Disk Drive, abbreviated as HDD) or a Solid State Drive (SSD), etc.; the storage medium may also comprise a combination of memories of the kind described above.
Although the embodiments of the present invention have been described in conjunction with the accompanying drawings, those skilled in the art may make various modifications and variations without departing from the spirit and scope of the invention, and such modifications and variations fall within the scope defined by the appended claims.