Disclosure of Invention
The invention aims to provide a vehicle-mounted identity recognition method and a vehicle-mounted identity recognition system, which improve the safety of the vehicle-mounted identity recognition system and overcome the problem of the conventional vehicle-mounted identity authentication system by comprehensively utilizing various traditional technologies.
In order to achieve the above object, the present invention provides a vehicle-mounted identity recognition method, which is applied to a vehicle-mounted identity recognition system, wherein the vehicle-mounted identity recognition system comprises: the system comprises a vehicle-mounted communication module, a face recognition module, an iris recognition module, a voiceprint recognition module and a central processing module, wherein the central processing module is respectively in communication connection with the vehicle-mounted communication module, the face recognition module, the iris recognition module and the voiceprint recognition module, and the method comprises the following steps:
the vehicle-mounted communication module is communicated with the mobile terminal identity recognition APP of the user after the user logs in the mobile terminal identity recognition APP, identifies the user and outputs first identification information;
the face recognition module recognizes a face and outputs second recognition information;
the iris recognition module recognizes the special iris of the person and outputs third recognition information;
the voiceprint recognition module recognizes a unique voiceprint of a person and outputs fourth recognition information;
the central processing module starts APP identity recognition according to the first recognition information, and starts face recognition according to the second recognition information; starting iris recognition according to the third recognition information; starting voiceprint recognition according to the fourth recognition information; and when all the identifications meet the preset condition, judging that the vehicle-mounted identity identification passes through.
Wherein, the vehicle-mounted identity recognition system further comprises: the LED is connected with the central processing module, and the vehicle-mounted identity recognition method further comprises the following steps:
the central processing module acquires automobile headlamp information, judges whether the automobile headlamp belongs to a day mode or a night mode at present, and starts the LED if the automobile headlamp belongs to the night mode, so that the face recognition module and the iris recognition module can correspondingly recognize faces and irises of human eyes in a place with dark light.
The vehicle-mounted communication module comprises a mobile communication part and a Bluetooth communication part, the user mobile terminal identity recognition APP authorizes the prior mobile communication to issue an authorization command, and if the mobile communication signals are poor, the Bluetooth communication is adopted in a close range to issue the authorization command, so that the vehicle-mounted communication module identifies the authorized user according to the authorization command and outputs first identification information.
The invention also provides a vehicle-mounted identity recognition system, which comprises: vehicle-mounted communication module, face recognition module, iris recognition module, voiceprint recognition module, identification module and central processing module, central processing module respectively with vehicle-mounted communication module, face recognition module, iris recognition module, voiceprint recognition module communication connection, wherein:
the vehicle-mounted communication module is used for communicating with the mobile terminal identity recognition APP of the user after the user logs in the mobile terminal identity recognition APP, identifying the identity of the user and outputting first identification information;
the face recognition module is used for recognizing a face and outputting second recognition information;
the iris identification module is used for identifying the specific iris of a person and outputting third identification information;
the voiceprint recognition module is used for recognizing a unique voiceprint of a person and outputting fourth recognition information;
the central processing module is used for starting APP identity recognition according to the first recognition information and starting face recognition according to the second recognition information; starting iris recognition according to the third recognition information; starting voiceprint recognition according to the fourth recognition information; and when all the identifications meet the preset condition, judging that the vehicle-mounted identity identification passes through.
Wherein, the vehicle-mounted identity recognition system further comprises: the LED is connected with the central processing module; the central processing module is also used for acquiring automobile headlamp information, judging whether the automobile headlamp belongs to a day mode or a night mode at present, and if the automobile headlamp belongs to the night mode, starting the LED so that the face recognition module and the iris recognition module can correspondingly recognize faces and irises of human eyes in a place with dark light.
The central processing module is further used for acquiring automobile headlamp information through a CAN bus.
The face recognition module and the iris recognition module are connected with a camera, and the face recognition module acquires original image information of a face part through the camera, recognizes a face and outputs second recognition information; the iris recognition module acquires original image information of human eyes through the camera, recognizes the human eyes iris and outputs third recognition information.
Compared with the traditional vehicle-mounted field identity recognition system which generally adopts a method of combining single or certain two of face recognition, iris recognition and voiceprint recognition, the vehicle-mounted identity recognition method and system provided by the invention adopt a method of combining a plurality of modes of mobile phone APP, face recognition, iris recognition and voiceprint recognition, and improve the safety of the vehicle-mounted identity authentication system. In addition, aiming at the conditions of poor light and poor signals, the recognition rate is improved by adopting light and a Bluetooth short-distance communication mode, the problem of control authorization when no signal exists in an underground parking lot is solved, and the actions of blinking, shaking head and opening mouth are added in face recognition, so that the safety of identity recognition is improved.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
The main solution of the embodiment of the invention is as follows: the safety of the vehicle-mounted identity authentication system is improved by adopting a method combining various modes of mobile phone APP, face recognition, iris recognition and voiceprint recognition. In addition, aiming at the conditions of poor light and poor signals, the recognition rate is improved by adopting light and a Bluetooth short-distance communication mode, the problem of control authorization when no signal exists in an underground parking lot is solved, and the actions of blinking, shaking head and opening mouth are added in face recognition, so that the safety of identity recognition is improved.
Traditional vehicle-mounted identity recognition systems generally employ a variety of approaches:
1. the face recognition technology is to collect the face image through a camera, extract the face feature through the computer graphic processing technology and compare and match the known face feature data, thereby carrying out the identity recognition;
2. iris recognition technology, which is to collect human eye images through a camera, extract iris characteristics through computer graphic processing technology and compare and match the iris characteristics with known iris characteristic data, thereby carrying out identity recognition;
3. voiceprint recognition is to collect the voiceprint features through a microphone, extract the voiceprint features through a computer processing technology, compare and match the voiceprint features with known voiceprint feature data, and then identify.
4. Authorize the user through cell-phone APP mode and carry out on-vehicle identification, the user is through logging in cell-phone APP, through the on-vehicle end of wireless mode notice, can carry out user identification.
However, the prior art has the following defects:
1. for the face recognition technology, the accuracy of face recognition and iris recognition can be reduced due to the factors of human face similarity, light, makeup, face-lifting and the like;
2. for the iris recognition technology, the iris recognition accuracy of human eyes can be reduced due to the human eye similarity, light, makeup, face-lifting and other factors;
3. for voiceprint recognition, once the personal voice is recorded secretly, the voiceprint recognition is cracked by other people at any time;
4. by means of the mobile phone APP, once the mobile phone is stolen by others, the identity recognition system can be easily cracked by others.
The vehicle-mounted identity identification method and system provided by the invention adopt a method combining a plurality of modes of mobile phone APP, face identification, iris identification and voiceprint identification, and improve the safety of the vehicle-mounted identity authentication system. In addition, aiming at the conditions of poor light and poor signals, the recognition rate is improved by adopting light and a Bluetooth short-distance communication mode, the problem of control authorization when no signal exists in an underground parking lot is solved, and the actions of blinking, shaking head and opening mouth are added in face recognition, so that the safety of identity recognition is improved.
Specifically, referring to fig. 1, fig. 1 is a schematic flow chart of an embodiment of a vehicle-mounted identity recognition method according to the present invention.
As shown in fig. 1, an embodiment of the present invention provides a vehicle-mounted identity recognition method, and in particular, a method based on vehicle-mounted mobile terminal identity recognition APP, face recognition, iris recognition, and voiceprint recognition, where the method is applied to a vehicle-mounted identity recognition system, and as shown in fig. 2, the vehicle-mounted identity recognition system includes: the system comprises a vehicle-mounted communication module, a face recognition module, an iris recognition module, a voiceprint recognition module and a central processing module, wherein the central processing module is respectively in communication connection with the vehicle-mounted communication module, the face recognition module, the iris recognition module and the voiceprint recognition module, and the method comprises the following steps:
step S10, after the user logs in the mobile terminal identification APP, the vehicle-mounted communication module is in communication connection with the mobile terminal identification APP, identifies the user and outputs first identification information;
step S20, the face recognition module recognizes a face and outputs second recognition information;
the face recognition module is connected with a camera, and acquires original image information of a face part through the camera, recognizes a face and outputs second recognition information.
Step S30, the iris recognition module recognizes the special iris of the person and outputs third recognition information;
the iris recognition module is connected with a camera, acquires original image information of human eyes through the camera, recognizes the human eyes iris, and outputs third recognition information.
Step S40, the voiceprint recognition module recognizes a unique voiceprint of a person and outputs fourth recognition information;
step S50, the central processing module starts APP identity recognition according to the first recognition information, and starts face recognition according to the second recognition information; starting iris recognition according to the third recognition information; starting voiceprint recognition according to the fourth recognition information; and when all the identifications meet the preset condition, judging that the vehicle-mounted identity identification passes through.
As an implementation mode, the identification information output by the vehicle-mounted communication module, the face recognition module, the iris recognition module and the voiceprint recognition module comprises a recognition result of vehicle-mounted identity recognition comparison verification, namely the comparison verification process is completed by the corresponding vehicle-mounted communication module, the face recognition module, the iris recognition module and the voiceprint recognition module, the central processing module judges whether the vehicle-mounted identity recognition passes or not according to the recognition result, if all the recognition meets the preset condition, the vehicle-mounted identity recognition is judged to pass, and if one of the recognition results is incorrect, the vehicle-mounted identity recognition is judged not to pass.
Specifically, in this embodiment, to cell-phone identification APP, the user has installed identification APP through the cell-phone of oneself, and the user authorizes at first on identification APP, just can carry out on-vehicle identification on next step, and backstage communication such as APP and high in the clouds binds the back with car frame number, cell-phone number, and the user directly authorizes on-vehicle identification on cell-phone APP, sends the control signal of authorizing and gives on-vehicle communication module.
When vehicle-mounted identity recognition is carried out, a user firstly logs in an identity recognition APP, the identity recognition APP is communicated with a vehicle-mounted communication module in a wireless mode, if the user is an authorized user, the vehicle-mounted communication module acquires an identity recognition result through identity recognition and outputs first recognition information, and the first recognition information comprises a recognition result of whether the user passes the identity recognition or not;
and the face recognition module is used for recognizing the face and outputting second recognition information.
In this embodiment, the face recognition module acquires a face image or a video stream through the camera, recognizes the input face image or video stream, determines whether a face exists, further extracts a face feature value in each face, compares the face feature value with a known face feature value, thereby recognizing the identity of each face, and outputs second recognition information according to the recognition result. In addition, the blinking, mouth opening and head shaking motion recognition is added, and the safety of vehicle-mounted identity recognition is improved.
The iris recognition module is used for recognizing the unique iris of the person and outputting third recognition information.
In this embodiment, the iris recognition module collects a human eye image or a video stream through the camera, recognizes the input human eye image or the video stream, extracts an iris characteristic value of each person, and compares the iris characteristic value with a known iris characteristic value, thereby recognizing the iris identity of each person and simultaneously sending out a third recognition signal.
And the voiceprint recognition module is used for recognizing the unique voiceprint of the person and outputting fourth recognition information.
In this embodiment, the voiceprint recognition module is connected to a microphone, the voiceprint stream of the user is collected by the microphone, the input voiceprint stream is recognized, a voiceprint characteristic value of each person is extracted and compared with a known voiceprint characteristic value, so that the voiceprint identity of each person is recognized, and then fourth recognition information is output according to a recognition result, wherein the known voiceprint characteristic value can be collected by the user in advance and stored on the vehicle-mounted terminal, and if the voiceprint characteristic value currently recognized by the voiceprint recognition module is consistent with the known voiceprint characteristic value, the current voiceprint identity is recognized to be legal, and the fourth recognition information with the legal identity is output.
The central processing module is connected with the plurality of relevant modules, starts APP identity recognition according to the first recognition information, and starts face recognition according to the second recognition information; starting iris recognition according to the third recognition information; starting voiceprint recognition according to the fourth recognition information; and if all the recognition results meet the preset conditions, namely the four recognition results are correct, judging that the vehicle-mounted identity recognition is passed, and otherwise, judging that the recognition is failed.
It should be noted that, the above-mentioned multiple identity identification manners of mobile phone APP, face identification, iris identification, and voiceprint identification may not be in sequence, and may be mobile phone APP, face identification, iris identification, and voiceprint identification in sequence, for example, as shown in fig. 3, or in other sequences, and this embodiment is not limited specifically herein.
As another embodiment, the identification information output by the vehicle-mounted communication module, the face recognition module, the iris recognition module and the voiceprint recognition module may only include identification of information features, but does not include a vehicle-mounted identification verification comparison result, the central processing module compares the received identification information with a preset password for verification, that is, the comparison verification process is completed by the central processing module, the central processing module judges whether the vehicle-mounted identification passes according to the identification comparison result, if all the identifications meet the preset condition, it is judged that the vehicle-mounted identification passes, and if one of the identifications is incorrect, it is judged that the vehicle-mounted identification does not pass.
Further, the vehicle-mounted identity recognition system further comprises: the LED is connected with the central processing module, and the vehicle-mounted identity recognition method further comprises the following steps:
the central processing module acquires automobile headlamp information, judges whether the automobile headlamp belongs to a day mode or a night mode at present, and if the automobile headlamp belongs to the night mode, the LED is started to illuminate a human face, so that the human face recognition module and the iris recognition module can correspondingly recognize the human face and the iris of human eyes in a place with dark light. The specific flow can be referred to fig. 3.
In the embodiment, the vehicle-mounted communication module comprises two parts of mobile communication and Bluetooth communication, the user mobile terminal identity recognition APP authorizes the prior mobile communication to issue the authorization command, and if the mobile communication signals are poor, the Bluetooth communication is adopted in a close range to issue the authorization command, so that the vehicle-mounted communication module identifies the authorized user according to the authorization command and outputs first identification information.
That is to say, when monitoring that no bluetooth signal exists in a long distance, the mobile phone mobile terminal issues a control signal by mobile communication, and when the mobile phone mobile terminal is in a short distance, the control signal is issued by bluetooth communication, so that the wireless communication module outputs the first identification information, and the situation that vehicle-mounted identity identification cannot be authorized when no signal or interference exists in the mobile communication is avoided.
Compared with the traditional vehicle-mounted field identity recognition system which generally adopts a method of single or combined human face, iris or voiceprint recognition, the vehicle-mounted identity recognition method and system provided by the invention adopt a method of combining a plurality of modes of mobile phone APP, human face recognition, iris recognition and voiceprint recognition, and the safety of the vehicle-mounted identity authentication system is improved. In addition, aiming at the conditions of poor light and poor signals, the recognition rate is improved by adopting light and a Bluetooth short-distance communication mode, the problem of control authorization when no signal exists in an underground parking lot is solved, and the actions of blinking, shaking head and opening mouth are added in face recognition, so that the safety of identity recognition is improved.
In addition, as shown in fig. 2, an embodiment of the present invention further provides a vehicle-mounted identity recognition system, where the vehicle-mounted identity recognition system includes: vehicle-mounted communication module, face recognition module, iris recognition module, voiceprint recognition module and central processing module, central processing module respectively with vehicle-mounted communication module, face recognition module, iris recognition module, voiceprint recognition module communication connection, wherein:
the vehicle-mounted communication module is used for being in communication connection with the mobile terminal identity recognition APP after a user logs in the mobile terminal identity recognition APP, and outputting first recognition information to an authorized user through identity recognition;
the face recognition module is used for recognizing a face and outputting second recognition information;
the iris identification module is used for identifying the specific iris of the person and outputting third identification information;
the voiceprint recognition module is used for recognizing a unique voiceprint of a person and outputting fourth recognition information;
the central processing module is used for starting APP identity recognition according to the first recognition information and starting face recognition according to the second recognition information; starting iris recognition according to the third recognition information; starting voiceprint recognition according to the fourth recognition information; and when all the identifications meet the preset condition, judging that the vehicle-mounted identity identification passes through.
The face recognition module is connected with a camera, and acquires original image information of a face part through the camera, recognizes a face and outputs second recognition information.
The iris recognition module is connected with a camera, acquires original image information of human eyes through the camera, recognizes the human eyes iris, and outputs third recognition information.
The voiceprint recognition module is connected with a microphone, collects voice streams of the user through the microphone, recognizes the input voice streams, and outputs fourth recognition information.
Further, the vehicle-mounted identity recognition system further comprises: the LED is connected with the central processing module; the central processing module is also used for acquiring automobile headlamp information, judging whether the automobile headlamp belongs to a day mode or a night mode at present, and if the automobile headlamp belongs to the night mode, starting the LED so that the face recognition module and the iris recognition module can correspondingly recognize faces and irises of human eyes in a place with dark light. The specific flow can be referred to fig. 3.
The central processing module acquires automobile headlamp information through a CAN bus.
As an implementation mode, the identification information output by the vehicle-mounted communication module, the face recognition module, the iris recognition module, the voiceprint recognition module and the recognition module comprises a recognition result of vehicle-mounted identity recognition comparison verification, namely the comparison verification process is completed by the corresponding vehicle-mounted communication module, the face recognition module, the iris recognition module and the voiceprint recognition module, the central processing module judges whether the vehicle-mounted identity recognition passes or not according to the recognition result, if all the recognition meets a preset condition, the vehicle-mounted identity recognition is judged to pass, and if one recognition result is incorrect, the vehicle-mounted identity recognition is judged not to pass.
Specifically, in this embodiment, to cell-phone identification APP, the user has installed identification APP through the cell-phone of oneself, and the user authorizes at first on identification APP, just can carry out on-vehicle identification on next step, and backstage communication such as APP and high in the clouds binds the back with car frame number, cell-phone number, and the user directly authorizes on-vehicle identification on cell-phone APP, sends the control signal of authorizing and gives on-vehicle communication module.
When vehicle-mounted identity recognition is carried out, a user firstly logs in an identity recognition APP, the identity recognition APP is communicated with a vehicle-mounted communication module in a wireless mode, if the user is an authorized user, the vehicle-mounted communication module acquires an identity recognition result through identity recognition and outputs first recognition information, and the first recognition information comprises a recognition result of whether the user passes the identity recognition or not;
and the face recognition module is used for recognizing the face and outputting second recognition information.
In this embodiment, the face recognition module acquires a face image or a video stream through the camera, recognizes the input face image or video stream, determines whether a face exists, further extracts a face feature value in each face, compares the face feature value with a known face feature value, thereby recognizing the identity of each face, and outputs second recognition information according to the recognition result. In addition, the blinking, mouth opening and head shaking motion recognition is added, and the safety of vehicle-mounted identity recognition is improved.
The iris recognition module is used for recognizing the unique iris of the person and outputting third recognition information.
In this embodiment, the iris recognition module collects a human eye image or a video stream through the camera, recognizes the input human eye image or the video stream, extracts an iris characteristic value of each person, and compares the iris characteristic value with a known iris characteristic value, thereby recognizing the iris identity of each person and simultaneously sending out a third recognition signal.
And the voiceprint recognition module is used for recognizing the unique voiceprint of the person and outputting fourth recognition information.
In this embodiment, the voiceprint recognition module is connected to a microphone, the voiceprint stream of the user is collected by the microphone, the input voiceprint stream is recognized, a voiceprint characteristic value of each person is extracted and compared with a known voiceprint characteristic value, so that the voiceprint identity of each person is recognized, and then fourth recognition information is output according to a recognition result, wherein the known voiceprint characteristic value can be collected by the user in advance and stored on the vehicle-mounted terminal, and if the voiceprint characteristic value currently recognized by the voiceprint recognition module is consistent with the known voiceprint characteristic value, the current voiceprint identity is recognized to be legal, and the fourth recognition information with the legal identity is output.
The central processing module is connected with the plurality of relevant modules, starts APP identity recognition according to the first recognition information, and starts face recognition according to the second recognition information; starting iris recognition according to the third recognition information; starting voiceprint recognition according to the fourth recognition information; and if all the recognition results meet the preset conditions, namely the four recognition results are correct, judging that the vehicle-mounted identity recognition is passed, and otherwise, judging that the recognition is failed.
It should be noted that, the above-mentioned multiple identity identification manners of mobile phone APP, face identification, iris identification, and voiceprint identification may not be in sequence, and may be mobile phone APP, face identification, iris identification, and voiceprint identification in sequence, for example, as shown in fig. 3, or in other sequences, and this embodiment is not limited specifically herein.
Further, the vehicle-mounted identity recognition system further comprises: the LED is connected with the central processing module, and the vehicle-mounted identity recognition method further comprises the following steps:
the central processing module acquires automobile headlamp information, judges whether the automobile headlamp belongs to a day mode or a night mode at present, and if the automobile headlamp belongs to the night mode, the LED is started to illuminate a human face, so that the human face recognition module and the iris recognition module can correspondingly recognize the human face and the iris of human eyes in a place with dark light. The specific flow can be referred to fig. 3.
In the embodiment, the vehicle-mounted communication module comprises two parts of mobile communication and Bluetooth communication, the user mobile terminal identity recognition APP authorizes the prior mobile communication to issue the authorization command, and if the mobile communication signals are poor, the Bluetooth communication is adopted in a close range to issue the authorization command, so that the vehicle-mounted communication module identifies the authorized user according to the authorization command and outputs first identification information.
That is to say, when monitoring that no bluetooth signal exists in a long distance, the mobile phone mobile terminal issues a control signal by mobile communication, and when the mobile phone mobile terminal is in a short distance, the control signal is issued by bluetooth communication, so that the wireless communication module outputs the first identification information, and the situation that vehicle-mounted identity identification cannot be authorized when no signal or interference exists in the mobile communication is avoided.
Therefore, the safety of the vehicle-mounted identity authentication system is improved by adopting a method combining a plurality of modes of mobile phone APP, face recognition, iris recognition and voiceprint recognition. In addition, aiming at the conditions of poor light and poor signals, the recognition rate is improved by adopting light and a Bluetooth short-distance communication mode, the problem of control authorization when no signal exists in an underground parking lot is solved, and the actions of blinking, shaking head and opening mouth are added in face recognition, so that the safety of identity recognition is improved.
It should be noted that the above-mentioned numbers of the embodiments of the present invention are merely for description, and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of software products, which are stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and include instructions for enabling a terminal device (such as a mobile phone, a television, a computer, etc.) to execute the methods according to the embodiments of the present invention.
The above description is only for the preferred embodiment of the present invention and is not intended to limit the scope of the present invention, and all equivalent structures or flow transformations made by the present specification and drawings, or applied directly or indirectly to other related arts, are included in the scope of the present invention.