Disclosure of Invention
The invention mainly solves the problem that the prior art has potential safety hazard for driving when wearing AR glasses; a wearable AR head-up display system for a vehicle is provided.
The technical problems of the invention are mainly solved by the following technical proposal: the wearable AR head-up display system for the vehicle comprises a data acquisition unit, a display unit and a display unit, wherein the data acquisition unit is used for acquiring environment information and vehicle information; the vehicle-mounted controller processes the environmental information and the vehicle information acquired by the data acquisition unit and transmits the processed environmental information and the processed vehicle information to the communication module; the communication module is used for connecting the intelligent AR glasses with the vehicle-mounted controller, the mobile terminal equipment or the cloud platform and carrying out data transmission; the intelligent AR glasses are worn on a driver and are used for AR projection display according to information transmitted by the communication module. The display information is displayed in a region mode through a visual angle field of safe driving of the automobile, wherein the display region comprises a main information display region, a dynamic information display region, a beyond-the-horizon information display region and an auxiliary information display region; and the display area division is set by integrating the optimal visual angle of human eyes and the arrangement requirement of the whole vehicle visual field. The environment information, the vehicle running information, the communication information and the like are highly integrated through the virtual reality technology, and the AR glasses are used for integrated display, so that a driver can keep higher concentration in driving; through information regional display, information display distribution is reasonable and orderly, and meanwhile, dynamic early warning is implemented on potential risks in the driving process, so that driving safety is further improved; for example, the dynamic display area is used as an area for a driver to observe traffic information in a real environment, when pedestrians or other vehicles pass in front of the vehicles and potential safety risks exist, the system can sense the positions of the pedestrians through the sensor, mark the pedestrians, display early warning information in a superposition mode of the dynamic mark at the position where the area coincides with the real pedestrians through the AR glasses, prompt the driver to pay attention to observe and avoid the pedestrians, and avoid accidents.
Preferably, the vehicle-mounted controller is connected with the vehicle-mounted actuator.
Preferably, the intelligent AR glasses comprise a voice interaction module, wherein the voice interaction module comprises a microphone and a voice output module, the microphone is arranged on the intelligent AR glasses and is used for receiving voice instruction information of a driver, the voice output module is connected with a vehicle-mounted controller, and the vehicle-mounted controller controls the voice output module to output audio according to the voice instruction information, transmits display information to the intelligent AR glasses to display or controls the vehicle-mounted executor to complete execution of a function corresponding to the voice instruction according to the instruction information. Based on the voice interaction module, information interaction between a driver and a vehicle is realized, and driving comfort is improved. Compared with the traditional vehicle-mounted microphone, the voice interaction module is closer to the position of a driver, and the voice definition and recognition accuracy of the collected voice command are higher.
Preferably, the gesture interaction module comprises a 3D depth camera and a gesture analysis module, wherein the 3D depth camera is arranged on the AR glasses and used for recognizing gestures of a driver, and the 3D depth camera is connected with the gesture analysis module; the gesture analysis module is used for analyzing gestures transmitted by the 3D depth camera into gesture instructions and transmitting the gesture instructions to the vehicle-mounted controller. Based on the gesture interaction module, the information interaction between the driver and the vehicle is realized, and the convenience and concentration of driving are improved. And the mobile phone terminal is used as a third party for information interaction, so that the information interaction is more diversified.
Preferably, the vehicle-mounted controller transmits the processed data information to the mobile terminal device through the communication module, and the mobile terminal device transmits the processed data information to the intelligent AR glasses through the communication module. And the mobile terminal equipment is used as a third party for information interaction, so that the information interaction is more diversified.
Preferably, the vehicle-mounted system and the intelligent AR glasses are connected with the cloud platform through the communication module to realize data transmission and operation, and data operation results are transmitted to the intelligent glasses. And setting a cloud platform, and forwarding and storing the data after the data passes through the cloud platform, so that the safety and traceability of the data are ensured.
Preferably, the data acquisition unit includes an AR glasses-mounted sensor and a vehicle-mounted sensor for acquiring environmental information, vehicle information and driver information. For example, the vehicle radar and the camera can be used for acquiring the information around the vehicle in real time, the real-time relative position and speed are calculated according to the acquired information, and when the potential running risk exists, the corresponding risk position and graphic information are displayed in the intelligent AR glasses, so that the driving safety is improved; for example, real-time data are collected through a vehicle speed sensor, a battery electric quantity sensor, an in-vehicle temperature sensor and the like and are displayed in an auxiliary information area of the AR glasses in a concentrated mode, so that a driver is not influenced to pay attention to observe a real-time environment, the running state of the vehicle can be mastered in real time through glancing under the condition of no head falling, and driving safety is improved.
Preferably, each display area is vertically divided by 10 ° and 4 ° below the ellipsoids, and the horizontal direction is divided by 10 ° left and right, and dynamic information display areas are arranged between 10 ° above the ellipsoids and 4 ° below the ellipsoids, and the above 10 ° above the ellipsoids are main information display areas and auxiliary information display areas below the ellipsoids.
The beneficial effects of the invention are as follows: the method comprises the steps that information of a vehicle, an environment and a driver is collected through a data collection unit, navigation information, driving early warning information, vehicle information, communication information and other areas required by driving are displayed on intelligent AR glasses through calculation of a controller in the system, and a wearable vehicle-mounted head-up display system based on a virtual reality technology is constructed; for a driver, the system can effectively improve driving safety and driving convenience; for automobile development and use, the system provides a brand new man-machine interaction which comprises virtual reality, voice, gesture, display and touch.
Detailed Description
Other advantages and effects of the present invention will become apparent to those skilled in the art from the following disclosure, which describes the embodiments of the present invention with reference to specific examples. The invention may be practiced or carried out in other embodiments that depart from the specific details, and the details of the present description may be modified or varied from the spirit and scope of the present invention. It should be noted that the following embodiments and features in the embodiments may be combined with each other without conflict.
In the following description, reference is made to the accompanying drawings, which illustrate several embodiments of the invention. It is to be understood that other embodiments may be utilized and that mechanical, structural, electrical, and operational changes may be made without departing from the spirit and scope of the present invention. The following detailed description is not to be taken in a limiting sense, and the scope of embodiments of the present invention is defined only by the claims of the issued patent. The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. Spatially relative terms, such as "upper," "lower," "left," "right," "lower," "upper," and the like, may be used herein to facilitate a description of one element or feature as illustrated in the figures as being related to another element or feature.
In the present invention, unless explicitly specified and limited otherwise, the terms "mounted," "connected," "secured," "held," and the like are to be construed broadly, and may be, for example, fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; can be directly connected or indirectly connected through an intermediate medium, and can be communication between two elements. The specific meaning of the above terms in the present invention can be understood by those of ordinary skill in the art according to the specific circumstances.
Furthermore, as used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context indicates otherwise. The terms "first," "second," "third," "fourth" and the like in the description and in the claims and in the above drawings, if any, are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments described herein may be implemented in other sequences than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," "includes," and/or "including" specify the presence of stated features, operations, elements, components, items, categories, and/or groups, but do not preclude the presence, presence or addition of one or more other features, operations, elements, components, items, categories, and/or groups. It will be further understood that the terms "or" and/or "as used herein are to be interpreted as inclusive, or meaning any one or any combination. Thus, "A, B or C" or "A, B and/or C" means "any of the following: a, A is as follows; b, a step of preparing a composite material; c, performing operation; a and B; a and C; b and C; A. b and C). An exception to this definition will occur only when a combination of elements, functions or operations are in some way inherently mutually exclusive.
In order to make the objects, technical solutions and advantages of the present invention more apparent, further detailed description of the technical solutions in the embodiments of the present invention will be given by the following examples with reference to the accompanying drawings. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
Example 1:
1-2, the wearable AR head-up display system for the vehicle comprises a data acquisition unit 1, a vehicle-mounted controller 2, a vehicle-mounted actuator 3, a communication module 4 and intelligent AR glasses 5, wherein the data acquisition unit is used for acquiring environment information and vehicle information and is connected with the vehicle-mounted controller; the vehicle-mounted controller processes the environmental information and the vehicle information acquired by the data acquisition unit and transmits the processed environmental information and the processed vehicle information to the communication module; the communication module is used for connecting the intelligent AR glasses with the vehicle-mounted controller and transmitting data; the intelligent AR glasses are worn on a driver, AR projection display is carried out according to information transmitted by the communication module, display information is displayed in a region mode through a visual angle field of safe driving of an automobile, the display region comprises a main information display region, a dynamic information display region, an over-the-horizon information display region and an auxiliary information display region, the display region is divided into an optimal visual angle of a human eye and the arrangement requirement of the whole automobile visual field, the vertical direction of each display region is divided into an eye ellipse by 10 DEG and a lower 4 DEG, the horizontal direction is divided into a left eye and a right eye by 10 DEG respectively, the dynamic information display region is arranged between the eye ellipse by 10 DEG and the lower 4 DEG, the over-the-horizon information display region is arranged on the eye ellipse by more than 10 DEG, and the main information display region and the auxiliary information display region are arranged below the eye ellipse.
The data acquisition unit comprises a sensor carried by the AR glasses and a vehicle-mounted sensor, wherein the vehicle-mounted sensor comprises one or more of a vehicle-mounted radar, a camera, a vehicle speed sensor, a GPS positioning module, a battery electric quantity sensor and a temperature sensor, for example, the vehicle-mounted radar and the camera can be used for acquiring the information around the vehicle in real time, the calculation of the real-time relative position and the speed is carried out according to the acquired information, and when potential running risks exist, the corresponding risk position and the corresponding graphic information are displayed in the intelligent AR glasses, so that the driving safety is improved; for example, real-time data are collected through a vehicle speed sensor, a battery electric quantity sensor, an in-vehicle temperature sensor and the like and are displayed in an auxiliary information area of the AR glasses in a concentrated mode, so that a driver is not influenced to pay attention to observe a real-time environment, the running state of the vehicle can be mastered in real time through glancing under the condition of no head falling, and driving safety is improved.
In this embodiment, the communication module is any one or more of 4G communication, 5G communication, serial communication, wifi communication, bluetooth communication, and usb communication.
In this embodiment, when the intelligent AR glasses perform information display, different information is displayed in a partitioned manner, an over-the-horizon information display area is set above the entire AR display area, a dynamic information display area is set in the middle part, and a main information display area is set below the entire AR display area, wherein the over-the-horizon information display area is mainly used for displaying road information, location information and the like; the dynamic information display area is mainly used for displaying real-time prompt information and safety early warning information of scenes and comprises a front road surface and road conditions on two sides; the main information display area is mainly used for displaying real-time navigation information, such as turning information and ground road condition information; the auxiliary information display area is mainly used for driving auxiliary display information such as vehicle running information, map navigation information, side rear early warning prompt information, voice interaction assistance, rearview mirror visual information, other display interface integrated display windows and the like.
In this embodiment, intelligent AR glasses include the glasses body, set up image capture camera on the glasses body, eye sensor, the light source module, external information acquisition sensor, audio output module, the microphone, the touch pad, CPU, connecting module, battery and direction sensor, wherein, the image capture camera is 3D depth camera, be provided with gesture analysis module in the CPU, 3D depth camera is used for discernment driver's gesture, gesture analysis module is used for resolving into gesture instruction with the gesture of 3D depth camera transmission and passes through connecting module and pass for on-vehicle controller, eye sensor has eyeball tracking and iris recognition function, external information acquisition sensor includes high definition digtal camera, fisheye camera, infrared sensor, millimeter wave radar and laser radar, audio output module is the interface, the speaker or bone conduction speaker, connecting module is one of usb, bluetooth, wifi or wide area network, direction sensor includes the gyroscope, accelerometer and GPS.
Example 2:
The difference between the present embodiment and embodiment 1 is that the sound output module in the voice interaction module of the present embodiment is the sound of the vehicle itself, the sound output module is connected with the vehicle-mounted controller, and the vehicle-mounted controller controls the sound output module to output audio according to the voice command information, transmits display information to the intelligent AR glasses for display, or controls the vehicle-mounted executor to complete the execution of the corresponding function of the voice command according to the command information.
For example, when a driver sends a command of playing music or playing a song, a microphone acquires the command and transmits the command to a vehicle-mounted audio-visual system, the vehicle-mounted audio-visual system analyzes the command content and plays audio through a sound output module, when the driver sends a command of closing a vehicle door, the microphone acquires the command and transmits the command to the vehicle-mounted audio-visual system, the vehicle-mounted audio-visual system analyzes the command content and transmits the analyzed command to a BCM system, the BCM system judges whether the command is legal or not, if the command is legal, the command is executed, the BCM system controls the vehicle door to close, otherwise, alarm feedback is carried out, for example, the vehicle is in a driving process, the driver sends a command of opening the vehicle door, the BCM system acquires the vehicle speed information transmitted by an ESP system, and judges that the command of opening the vehicle door is illegal in the driving process, and the command false alarm prompt is carried out.
Example 3:
The difference between the embodiment and the embodiment 2 is that the mobile phone terminal is added as a connecting tie between the intelligent AR glasses and the vehicle system, the vehicle-mounted audio-visual system is connected with the mobile phone terminal through a usb data line, the processed data information is transmitted to the mobile phone terminal, the mobile phone terminal transmits the processed data information to the intelligent AR glasses through a Bluetooth module, the mobile phone terminal is used as a connecting torsion strap, a driver encounters a telephone incoming call when driving the vehicle, and the mobile phone call can be carried out through a microphone, so that the driving safety is improved.
Example 4:
According to the embodiment, the cloud platform is added, the vehicle-mounted system and the intelligent AR glasses are connected with the cloud platform through the communication module, and data forwarding, data operation, data pushing and storage are performed through the cloud platform, so that the safety and traceability of data are guaranteed.
Example 5:
The intelligent AR glasses in this embodiment include picture frame, AR lens, first mirror leg, the second mirror leg, first function module and second function module, the AR lens sets up in the picture frame, first mirror leg and second mirror leg all rotate with the picture frame and are connected, the AR lens is provided with the image source, first function module demountable installation is at the side of first mirror leg, first function module is provided with the first contact that is connected with the image source, first function module installs when the side of first mirror leg, first function module is connected with the image source circular telegram, second function module demountable installation is at the side of second mirror leg, second function module is provided with the second contact of being connected with the image source, second function module installs when the side of second mirror leg, second function module is connected with the image source circular telegram, first function module is basically unanimous in the appearance with the second function module, the difference lies in that first function module is provided with the interface that charges.
The first functional module comprises a shell, a battery and a communication unit, wherein the battery and the communication unit are arranged in the shell, when the communication unit is arranged to be in RS485 communication or usb communication, a charging interface of the communication unit is connected with wires, a vehicle is connected with the intelligent AR glasses through a data wire, and the charging interface of the communication unit has the functions of power supply and data transmission; when the communication unit sets wifi communication or bluetooth communication, the vehicle passes through wireless connection mode with data transfer for intelligent AR glasses to show through the imaging source.
The second functional module comprises a base body, a projection positioning camera and a microprocessor, wherein the projection positioning camera and the microprocessor are arranged in the base body, the projection positioning camera is used for simulating human eye vision, acquiring image data of human eye horizontal perception visual angles and human eye vertical perception visual angles, transmitting acquired data information to the microprocessor, and the microprocessor sets an imaging position of an imaging source according to the information transmitted by the projection positioning camera.
The shell is connected with the first glasses leg, and the base body is connected with the second glasses leg in a detachable mode through the existing magnet adsorption mode.
When first function module is installed, the imaging source of intelligent AR glasses circular telegram work, image formation display is carried out according to the data display of communication unit transmission, when second function module was not installed, image formation position is carried out according to the imaging position when predetermineeing the position or last use and is shown, when second function module was installed, the battery simultaneously for imaging source, projection location camera and microprocessor power supply, image formation position readjust according to user's sight, after the imaging position adjustment, the second function module can be dismantled, image formation position remains, effectively alleviate intelligent AR glasses's weight.
When the first functional module and the second functional module are not installed, the intelligent AR glasses can be used as common glasses.
The above-described embodiment is only a preferred embodiment of the present invention, and is not limited in any way, and other variations and modifications may be made without departing from the technical aspects set forth in the claims.