Disclosure of Invention
The embodiment of the invention provides a vehicle monitoring method and device and a vehicle, which can predict the dangerous condition of the vehicle and guarantee the safety of the vehicle before the danger occurs.
In a first aspect, an embodiment of the present invention provides a vehicle monitoring method, including:
extracting pedestrian characteristic information outside a vehicle according to external image data of the vehicle;
judging whether the pedestrian is a stranger or not according to the pedestrian characteristic information;
if the pedestrian is judged to be a stranger, acquiring the staying time information of the pedestrian near the vehicle;
and if the stay time information is larger than the preset time threshold information, controlling the vehicle to start an anti-theft mode.
Optionally, the vehicle monitoring method further includes:
if the residence time is larger than a preset time threshold, outputting danger warning information to a user terminal;
wherein the hazard warning information includes the pedestrian characteristic information and the stay time information.
Optionally, the vehicle monitoring method further includes:
receiving an alarm mode activation instruction;
and controlling the vehicle to start an alarm mode according to the alarm mode activation instruction.
Optionally, the vehicle monitoring method further includes:
receiving an anti-theft mode release instruction;
and controlling the vehicle to release the anti-theft mode according to the anti-theft mode release instruction.
Optionally, the obtaining the information of the staying time of the pedestrian near the vehicle includes:
if the pedestrian is judged to be a stranger, timing is started;
and acquiring timing time information after judging that the pedestrian is a stranger, namely the information of the staying time of the pedestrian near the vehicle.
Optionally, the vehicle monitoring method further includes:
acquiring panoramic image information of the vehicle according to the external image data;
and outputting the panoramic image information to a user terminal.
Optionally, the alarm mode includes turning on an in-vehicle monitoring camera and a vehicle-mounted buzzer of the vehicle.
In a second aspect, an embodiment of the present invention further provides a vehicle monitoring apparatus, including:
the characteristic extraction module is used for extracting pedestrian characteristic information outside the vehicle according to external image data of the vehicle;
the stranger judgment module is used for judging whether the pedestrian is a stranger or not according to the pedestrian characteristic information;
the time acquisition module is used for acquiring the stay time information of the pedestrian near the vehicle;
and the control module is used for controlling the vehicle to start the anti-theft mode.
In a third aspect, an embodiment of the present invention further provides a vehicle, including: a plurality of external cameras and a control unit;
the external cameras are arranged on the periphery of the vehicle and electrically connected with the control unit; the external camera is used for acquiring and outputting external image data of the vehicle;
the control unit is used for realizing the vehicle monitoring method according to any embodiment of the invention.
Optionally, the system further comprises a vehicle-mounted internet terminal, a vehicle-mounted monitoring camera and a vehicle-mounted buzzer;
the vehicle-mounted internet terminal is in communication connection with the control unit and the cloud background system respectively; the vehicle-mounted internet terminal is used for receiving the danger warning information output by the control unit, transmitting the danger warning information to the user terminal through the cloud background system, and transmitting an alarm mode activation instruction or an anti-theft mode release instruction output by the user terminal to the control unit through the cloud background system;
the in-vehicle monitoring camera and the vehicle-mounted buzzer are both electrically connected with the control unit; the control unit is used for respectively controlling the in-vehicle monitoring camera to acquire behavior actions of a stranger entering the vehicle and the vehicle-mounted buzzer to send out alarm sound according to the alarm mode activation instruction.
The embodiment of the invention provides a vehicle monitoring method, a vehicle monitoring device and a vehicle, wherein the method comprises the steps of judging whether a pedestrian is a stranger or not by acquiring external image data of the vehicle, and predicting potential risks nearby the vehicle; judging whether the vehicle is in a dangerous environment or not according to the staying time information and the preset time threshold information near the stranger vehicle, and timely starting an anti-theft mode of the vehicle when the vehicle is in the dangerous environment; by adopting the method, the dangerous condition near the vehicle can be predicted, the vehicle can enter the anti-theft mode in advance before being stolen, the vehicle safety is guaranteed before the danger occurs, and the loss is reduced to the maximum extent.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.
Before discussing exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart may describe the steps as a sequential process, many of the steps can be performed in parallel, concurrently or simultaneously. In addition, the order of the steps may be rearranged. The process may be terminated when its operations are completed, but may have additional steps not included in the figure. The processes may correspond to methods, functions, procedures, subroutines, and the like.
An embodiment of the present invention provides a vehicle monitoring method, and fig. 1 is a flowchart of the vehicle monitoring method provided in the embodiment of the present invention, where the embodiment is applicable to a vehicle, the method may be executed by a vehicle monitoring device, and the device may be implemented by software and/or hardware, and the method includes:
s1001, pedestrian feature information outside the vehicle is extracted according to the external image data of the vehicle.
The pedestrian feature information includes, but is not limited to, facial feature information of a pedestrian. Specifically, the external image data acquired by the external camera in real time is analyzed and processed, and pedestrian characteristic information in the external image data is extracted. Illustratively, the acquired external image data is converted into image data of one frame by one frame, and then facial feature information of a pedestrian in the image is extracted.
And S1002, judging whether the pedestrian is a stranger or not according to the pedestrian characteristic information.
The stranger refers to a person other than the user or a person other than the relatives and friends database. Specifically, the extracted pedestrian characteristic information is compared with the characteristic information of the user or the characteristic information of the people in the relatives and friends database, and whether the pedestrian is a stranger or not can be known according to the comparison result.
Optionally, if the pedestrian is judged not to be a stranger according to the pedestrian characteristic information, the next step is not executed, the step of extracting the pedestrian characteristic information outside the vehicle according to the external image data of the vehicle is executed, and whether other pedestrians are strangers or not is continuously judged.
And S1003, if the pedestrian is judged to be a stranger, acquiring the staying time information of the pedestrian near the vehicle.
The residence time information of the pedestrian in the vicinity of the vehicle includes the time for extracting the same pedestrian feature information, for example, from the first extraction of the pedestrian feature information to the last extraction of the pedestrian feature information. Specifically, after the pedestrian is judged to be a stranger, the staying time information of the pedestrian near the vehicle is acquired.
Optionally, if the pedestrian is judged to be a stranger, timing is started; and acquiring timing time information after judging that the pedestrian is a stranger, namely the information of the staying time of the pedestrian near the vehicle.
Optionally, the time point when the pedestrian characteristic information is extracted for the first time and the time point when the pedestrian characteristic information is extracted for the last time may be used to perform difference calculation, so as to obtain the staying time information of the pedestrian near the vehicle.
And S1004, if the stay time information is larger than the preset time threshold information, controlling the vehicle to start the anti-theft mode.
The preset time threshold information is a time range within which the user allows a stranger to stay near the vehicle, and is generally 5-10 minutes. The anti-theft mode includes operation enabling such as turning off ignition, engaging gear, locking door of the vehicle, etc. Specifically, if the stay time information of a stranger near the vehicle is larger than the preset time threshold information, the vehicle is judged to be in a dangerous environment, and the anti-theft mode of the vehicle is automatically started.
Optionally, if the stay time information is less than or equal to the preset time threshold information, it can be considered that the pedestrian just passes by, and there is no potential danger near the vehicle, and the vehicle does not need to be controlled to start the anti-theft mode.
Illustratively, a user visits relatives and friends or transacts business, a vehicle is temporarily parked in a roadside parking area, after the user leaves the vehicle, the vehicle monitoring device can receive external image data output by an external camera in real time, convert the external image data into image data of one frame and one frame, and extract facial feature information of pedestrians by using an image processing technology; judging whether the pedestrian is a stranger or not by using a face recognition technology according to the facial feature information; if the pedestrian is judged to be a stranger, timing is started, and the staying time information of the pedestrian near the vehicle is obtained; the information of the staying time of the pedestrian near the vehicle is compared with the preset time threshold information, if the staying time information is larger than the preset time threshold information, the vehicle is judged to be in a dangerous environment, the vehicle is controlled to enter an anti-theft mode, and the vehicle and articles in the vehicle are prevented from being stolen when a user forgets to lock a door, forgets to flameout or does not return to the vehicle for a long time.
According to the embodiment of the invention, whether the pedestrian is a stranger is judged by acquiring the external image data of the vehicle, so that the potential danger nearby the vehicle can be predicted; judging whether the vehicle is in a dangerous environment or not according to the staying time information and preset time threshold information near the stranger vehicle, and timely starting an anti-theft mode of the vehicle when the vehicle is in the dangerous environment; by adopting the method, the dangerous condition near the vehicle can be predicted, the vehicle can enter the anti-theft mode in advance before being stolen, the vehicle safety is guaranteed before the danger occurs, and the loss is reduced to the maximum extent.
Optionally, fig. 2 is a flowchart of another vehicle monitoring method according to an embodiment of the present invention. As shown in fig. 2, the method includes:
s2001, pedestrian feature information outside the vehicle is extracted from the external image data of the vehicle.
And S2002, judging whether the pedestrian is a stranger or not according to the pedestrian characteristic information.
And S2003, if the pedestrian is judged to be a stranger, acquiring the staying time information of the pedestrian near the vehicle.
And S2004, if the stay time information is larger than the preset time threshold information, controlling the vehicle to start the anti-theft mode.
And S2005, outputting danger warning information to the user terminal.
Wherein the hazard warning information includes pedestrian characteristic information and stay time information of the pedestrian in the vicinity of the vehicle. The user terminal includes, but is not limited to, a mobile phone terminal, a computer terminal, a smart watch terminal, and the like of the user. Specifically, after the information of the staying time of the pedestrian near the vehicle accessory is judged to be larger than the preset time threshold value information, the danger warning information is output to the user terminal, and the user can know the pedestrian characteristic information of the pedestrian near the vehicle and the staying time information of the pedestrian near the vehicle through the user terminal. It can be understood that outputting the danger warning information to the user terminal and controlling the vehicle to start the anti-theft mode may be performed simultaneously, or the order may be changed, which is not specifically limited in the embodiment of the present invention.
For example, after the vehicle monitoring device judges that the vehicle is in a dangerous environment, the vehicle monitoring device can simultaneously start an anti-theft mode of the vehicle and send danger early warning information to a mobile terminal of a user to remind the user of abnormal conditions of vehicle accessories and ensure the safety of the vehicle in advance; the user can acquire the vehicle state information through the mobile phone, abnormal conditions can be processed in time, and flexibility of vehicle state control is improved.
It should be noted that the vehicle monitoring device may directly or indirectly output the danger warning information to the user terminal, and the embodiment of the present invention does not limit the form and path of the transmission of the danger warning information.
Optionally, fig. 3 is a flowchart of another vehicle monitoring method according to an embodiment of the present invention. As shown in fig. 3, the method includes:
s3001, extracting pedestrian characteristic information outside the vehicle according to the external image data of the vehicle.
And S3002, judging whether the pedestrian is a stranger or not according to the pedestrian characteristic information.
And S3003, if the pedestrian is judged to be a stranger, acquiring the staying time information of the pedestrian near the vehicle.
And S3004, if the stay time information is larger than the preset time threshold value information, controlling the vehicle to start the anti-theft mode.
And S3005, acquiring the panoramic image information of the vehicle according to the external image data.
And S3006, outputting the panoramic image information to the user terminal.
The panoramic image information refers to timely image information (bird's-eye view) with 360-degree panoramic fusion, ultra-wide viewing angle and seamless splicing, fig. 4 is a schematic view of the panoramic image information of the vehicle provided by the embodiment of the invention, and the information around the vehicle can be clearly known through the panoramic image information.
Illustratively, when the vehicle monitoring device judges that the vehicle is in a dangerous environment, external image data collected by an external camera is converted into image data of one frame and one frame, the image data at the moment is spliced into a picture (aerial view), and the picture is finally sent to a mobile phone end of a user through some terminals and background systems, so that the user is reminded of timely handling abnormal conditions, and the vehicle safety is guaranteed in advance.
Optionally, fig. 5 is a flowchart of another vehicle monitoring method according to an embodiment of the present invention. As shown in fig. 5, the method includes:
s5001, extracting pedestrian characteristic information outside the vehicle according to the external image data of the vehicle.
S5002, judging whether the pedestrian is a stranger according to the pedestrian characteristic information.
S5003, if the pedestrian is judged to be a stranger, obtaining the staying time information of the pedestrian near the vehicle.
S5004, if the stay time information is larger than the preset time threshold information, controlling the vehicle to start the anti-theft mode.
S5005, outputting danger warning information to the user terminal.
S5006, receiving an alarm mode activation instruction.
S5007, controlling the vehicle to start the alarm mode according to the alarm mode activation instruction.
Optionally, the alarm mode includes turning on an in-vehicle monitoring camera and a vehicle-mounted buzzer of the vehicle.
Illustratively, the vehicle monitoring device user terminal receives the vehicle monitoring device and judges that the vehicle is in a dangerous environment, controls the vehicle to enter an anti-theft mode, and simultaneously sends danger warning information to a mobile phone terminal of the user. If the user judges that the current scene is in a stolen dangerous state, the vehicle can be remotely controlled through the mobile phone terminal, the alarm mode is selected to be activated, the mobile phone terminal sends an alarm mode activation instruction and finally transmits the alarm mode activation instruction to the vehicle monitoring device, the vehicle monitoring device controls the vehicle to start the vehicle-mounted buzzer and the in-vehicle monitoring camera, on one hand, behavior actions of strangers are collected through the indoor camera, on the other hand, the strangers are deterred through vehicle-mounted alarm sound, and attention of pedestrians around the vehicle is attracted. By adopting the method, the vehicle can be controlled to enter the anti-theft mode and the alarm mode in advance before the vehicle is in danger of being stolen, and loss is reduced to the greatest extent.
Optionally, after the alarm mode is activated, the alarm mode and the working states of the vehicle-mounted buzzer and the in-vehicle monitoring camera can be closed only by actively removing the alarm mode by a user or actively unlocking the vehicle, the vehicle or identifying the digital key by the vehicle, and the alarm mode can not be removed due to violent damage, so that the safety of the vehicle is improved.
Optionally, fig. 6 is a flowchart of another vehicle monitoring method according to an embodiment of the present invention. As shown in fig. 6, the method includes:
s6001, pedestrian feature information outside the vehicle is extracted according to the external image data of the vehicle.
And S6002, judging whether the pedestrian is a stranger according to the pedestrian characteristic information.
And S6003, if the pedestrian is judged to be a stranger, acquiring the staying time information of the pedestrian near the vehicle.
And S6004, if the stay time information is larger than the preset time threshold information, controlling the vehicle to start the anti-theft mode.
And S6005, outputting danger warning information to the user terminal.
S6006, receiving an anti-theft mode release instruction;
and S6007, controlling the vehicle to release the anti-theft mode according to the anti-theft mode release command.
Illustratively, the vehicle monitoring device user terminal receives the vehicle monitoring device and judges that the vehicle is in a dangerous environment, controls the vehicle to enter an anti-theft mode, and simultaneously sends danger warning information to a mobile phone terminal of the user. If the user judges that the current scene is in a safe state, the vehicle can be remotely controlled through the mobile phone end, the anti-theft mode is selected to be removed, the mobile phone end sends an anti-theft mode removing instruction and finally transmits the anti-theft mode removing instruction to the vehicle monitoring device, the vehicle monitoring device removes enabling limitation of operations such as vehicle ignition and gear shifting, and flexibility of vehicle state control is improved.
Based on the same inventive concept, an embodiment of the present invention further provides a vehicle monitoring apparatus, and fig. 7 is a block diagram of a vehicle monitoring apparatus provided in an embodiment of the present invention, which may be implemented by software and/or hardware and is generally integrated in a vehicle. As shown in fig. 7, the apparatus may include:
thefeature extraction module 710 is configured to extract pedestrian feature information outside a vehicle according to external image data of the vehicle;
astranger judgment module 720, configured to judge whether the pedestrian is a stranger according to the pedestrian characteristic information;
thetime acquisition module 730 is used for acquiring the stay time information of the pedestrian near the vehicle;
and acontrol module 740 for controlling the vehicle to turn on the anti-theft mode.
The embodiment of the invention provides a vehicle monitoring device, which can realize parallel execution of the vehicle monitoring method in any embodiment of the invention, can predict the dangerous condition near a vehicle, can enter an anti-theft mode in advance before the vehicle is stolen, ensures the safety of the vehicle before the danger occurs, and reduces the loss to the maximum extent.
Of course, the vehicle monitoring device provided in the embodiment of the present invention includes modules that are not limited to the modules of the vehicle monitoring device described above, and may also include related device structures in vehicle monitoring provided in any embodiment of the present invention.
Based on the same inventive concept, the embodiment of the invention also provides a vehicle, which comprises a plurality of external cameras and a control unit. For example, fig. 8 is a block diagram of a vehicle according to an embodiment of the present invention, and the vehicle includes four external cameras for illustration. As shown in fig. 8, the vehicle includes fourexternal cameras 800 and acontrol unit 810. Theexternal cameras 800 are disposed around the vehicle and electrically connected to thecontrol unit 810. Theexternal camera 800 is configured to acquire and output external image data of the vehicle; thecontrol unit 810 is adapted to implement any of the vehicle monitoring methods of the present invention.
Optionally, fig. 9 is a structural block diagram of another vehicle according to an embodiment of the present invention, and as shown in fig. 9, the vehicle further includes a vehicle-mountedinternet access terminal 820, a vehicle-mounted monitoring camera 830, and a vehicle-mountedbuzzer 840.
The vehicle-mountedinternet terminal 820 is in communication connection with thecontrol unit 810 and the cloud background system respectively; the on-vehicle internet terminal 820 is configured to receive the danger warning information output by thecontrol unit 810, transmit the danger warning information to the user terminal through the cloud backend system, and transmit an alarm mode activation instruction or an anti-theft mode release instruction output by the user terminal to thecontrol unit 810 through the cloud backend system.
The in-vehicle monitoring camera 830 and the vehicle-mountedbuzzer 840 are both electrically connected with thecontrol unit 810; thecontrol unit 810 is used for controlling the in-vehicle monitoring camera 830 to collect behavior after a stranger enters the vehicle and the vehicle-mountedbuzzer 840 to send out an alarm sound according to the alarm mode activation instruction.
Optionally, fig. 10 is a block diagram of a structure of another vehicle according to an embodiment of the present invention, and as shown in fig. 10, thecontrol unit 810 includes animage analysis unit 811 and a vehiclebody control unit 812. Theexternal camera 800 is electrically connected with theimage analysis unit 811, theimage analysis unit 811 is in communication connection with the vehiclebody control unit 812, the vehiclebody control unit 812 is electrically connected with the in-vehicle monitoring camera 830 and the vehicle-mountedbuzzer 840, and the vehicle-mountedinternet terminal 820 is in communication connection with theimage analysis unit 811 and the vehiclebody control unit 812, respectively.
Theimage analysis unit 811 is configured to extract pedestrian feature information outside the vehicle according to external image data of the vehicle; judging whether the pedestrian is a stranger or not according to the pedestrian characteristic information; if the pedestrian is judged to be a stranger, acquiring the staying time information of the pedestrian near the vehicle; if the stay time information is larger than the preset time threshold information, outputting anti-theft early warning information to a vehiclebody control unit 812 and outputting danger warning information to a user terminal; and the system can also be used for acquiring the panoramic image information of the vehicle according to the external image data and outputting the panoramic image information to a user terminal. The vehiclebody control unit 812 is used for controlling the vehicle to start an anti-theft mode; receiving an alarm mode activation instruction, and controlling the vehicle to start an alarm mode according to the alarm mode activation instruction; and receiving an anti-theft mode releasing instruction, and controlling the vehicle to release the anti-theft mode according to the anti-theft mode releasing instruction.
Of course, the executable instructions of the vehicle provided by the embodiment of the present invention are not limited to the operations of the vehicle monitoring method described above, and may also execute the relevant operations in the vehicle monitoring method provided by any embodiment of the present invention.
It should be understood that the illustrated vehicle is merely an example, and that the vehicle may have more or fewer components than shown in the figures, may combine two or more components, or may have a different configuration of components.
The vehicle provided by the embodiment of the invention can realize parallel execution of the operation in the vehicle monitoring method provided by any embodiment of the invention, can predict the dangerous condition near the vehicle, can enter an anti-theft mode in advance before the vehicle is stolen, ensures the safety of the vehicle before the danger occurs, and reduces the loss to the maximum extent.
The vehicle monitoring device and the vehicle provided in the above embodiments can execute the vehicle monitoring method provided in any embodiment of the present invention, and have corresponding functional modules and beneficial effects for executing the method. For technical details that are not described in detail in the above embodiments, reference may be made to a vehicle monitoring method provided in any embodiment of the present invention.
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.