Detailed Description
Embodiments of the present application will be described in detail below with reference to the accompanying drawings.
Other advantages and effects of the present application will become apparent to those skilled in the art from the following disclosure, which describes the embodiments of the present application with reference to specific examples. It will be apparent that the described embodiments are only some, but not all, embodiments of the application. The application may be practiced or carried out in other embodiments that depart from the specific details, and the details of the present description may be modified or varied from the spirit and scope of the present application. It should be noted that the following embodiments and features in the embodiments may be combined with each other without conflict. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application.
It is noted that various aspects of the embodiments are described below within the scope of the following claims. It should be apparent that the aspects described herein may be embodied in a wide variety of forms and that any specific structure and/or function described herein is merely illustrative. Based on the present disclosure, one skilled in the art will appreciate that one aspect described herein may be implemented independently of any other aspect, and that two or more of these aspects may be combined in various ways. For example, apparatus may be implemented and/or methods practiced using any number and aspects set forth herein. In addition, such apparatus may be implemented and/or such methods practiced using other structure and/or functionality in addition to one or more of the aspects set forth herein.
It should also be noted that the illustrations provided in the following embodiments merely illustrate the basic concept of the present application by way of illustration, and only the components related to the present application are shown in the drawings and are not drawn according to the number, shape and size of the components in actual implementation, and the form, number and proportion of the components in actual implementation may be arbitrarily changed, and the layout of the components may be more complicated.
In addition, in the following description, specific details are provided in order to provide a thorough understanding of the examples. However, it will be understood by those skilled in the art that the present application may be practiced without these specific details.
Various illumination environments are met in the vehicle-mounted process, and although the brightness of the display screen can be automatically adjusted, the requirement that the display screen is properly adjusted to meet the comfort of human eyes cannot be met. For example, when the vehicle is carried at a high speed, the discomfort such as dizziness and the like caused by the adjustment of the pupil of the human eye due to the short-time brightness of the environment light and the display screen, or accidents and the like caused by the fact that the human eye cannot perceive due to the short-time brightness adjustment are caused.
Although ambient brightness may currently be collected by a photosensor or may need to be collected exclusively with a conventional rgb image sensor. These methods all require additional hardware support, not only increasing engineering complexity, but also increasing adjustment costs. In addition, the photoelectric sensor can only locally sense light, can not accurately obtain the ambient brightness, and the common rgb image sensor has poor precision when light is dark, is extremely easy to be blocked by mistake, further causes inaccuracy of brightness adjustment, and can not make corresponding display screen brightness adjustment according to whether a driver wears a sunglasses or not.
Based on this, the embodiment of the present specification proposes a display screen brightness adjustment scheme: the shot image and the current ambient illuminance obtained by calibrating the ambient illuminance are unified in illumination basis, and specifically, the current ambient illuminance of the space environment can be accurately obtained through the association of the image pixels, the adjustment of the stepless display screen is realized, no matter any illumination environment is faced, the accurate guiding significance can be provided for the subsequent adjustment of the display screen brightness based on the unified illumination basis, and the more accurate display screen brightness adjustment is realized. Especially, the adjusting precision when the ambient light is darker is improved, and the brightness adjusting precision of the display screen is improved. If the driver wears the sunglasses, the filtering of the sunglasses to light is effectively solved, the adjusting precision of the dark ambient light is improved, and the brightness adjusting precision of the display screen is improved. Hardware equipment is not required to be additionally arranged, the complexity of adjusting the display screen is reduced, and the adjusting cost is saved.
The following describes the technical scheme provided by each embodiment of the present application with reference to the accompanying drawings.
The arrangement of the vehicle-mounted hardware in the embodiment of the present specification is shown in fig. 1. The intelligent cabin includes the most basic driver monitoring system (DMS, driver Monitor System), passenger monitoring system (OMS, occupancy Monitoring System). The video camera of the DMS is arranged at the right front of the driver, and the state of the driver is detected and analyzed in real time. The video camera of OMS is installed to the upper position of B post to dispose a wide-angle lens, when making it play the control passenger, utilize big FOV, angle regulation makes and includes well accuse screen region, and occupy the proportion of more than 15%.
In some embodiments, a Driver Monitoring System (DMS) is used to detect whether a space environment driver is wearing sunglasses. The passenger monitoring system (OMS) is used for determining target brightness of the display screen according to the space environment illumination state and obtaining final brightness corresponding to the display screen by combining the state of wearing sunglasses in the space environment.
As shown in fig. 2, the embodiment of the present disclosure provides a method for adjusting brightness of a display screen, which may include steps S210 to S220. Step S210, obtaining the space environment illumination state; the space environment illuminance state comprises a shooting image obtained by image processing and the current environment illuminance obtained by calibrating the environment illuminance according to the shooting image bronze drum. Step S220, determining target brightness of the display screen according to the current ambient illuminance.
Step S210, acquiring the space environment illumination state; the space environment illumination state comprises a shooting image obtained through image processing and current environment illumination obtained through calibrating the environment illumination according to the shooting image.
Specifically, the space environment illuminance state assists in determining the brightness of a display screen in the space environment, and the brightness comprises a shooting image obtained through image processing and the current environment illuminance obtained through calibrating the environment illuminance according to the shooting image. Wherein the current ambient illuminance is used to determine the brightness of the display screen. The shooting image and the current ambient illuminance are respectively corresponding to a shooting module for collecting the ambient illuminance and a calibration module for calibrating the ambient illuminance.
In some embodiments, the capture module includes an OMS video camera and employs an rgb ir image sensor that can receive both visible and infrared light.
In some embodiments, the calibration module for calibrating the ambient illuminance mainly includes an integrating sphere light source, a sensor module, a camera image collector, a PC, etc., see fig. 4.
According to the embodiment of the specification, the space environment illumination state is obtained, the shooting module is used for carrying out image processing to obtain shooting images, the shooting modes are distinguished according to the environment light in the process of obtaining the shooting images, therefore, shooting images which are closer to the environment illumination are obtained, the calibration mode of the environment illumination calibration is distinguished according to the shooting images based on the process of obtaining the current environment illumination through calibrating the environment illumination, the calibration mode and the shooting mode are divided based on the application of illumination spectrums, when the calibration mode is consistent with the shooting mode, the shooting images and the current environment illumination obtained through calibrating the environment illumination have a unified illumination basis, and therefore, the current environment illumination of the space environment can be accurately obtained based on the obtained space environment illumination state, accurate guiding significance is provided for subsequent adjustment of the brightness of a display screen, and therefore, more accurate brightness adjustment of the display screen is achieved.
Step S220, determining target brightness of the display screen according to the current ambient illuminance.
In combination with the above embodiment, the unification of the illumination basis in the current ambient illuminance process is obtained based on the image capturing process and the calibration of the ambient illuminance, and the target brightness Dt of the display screen is determined by using the obtained current ambient illuminance Bc.
According to the embodiment of the specification, the shot image and the current ambient illuminance obtained by calibrating the ambient illuminance have a unified illumination basis, the current ambient illuminance of the space environment can be accurately obtained, the adjustment of the stepless display screen is realized, no matter any illumination environment is faced, the accurate guiding significance can be provided for the subsequent adjustment of the display screen brightness based on the unified illumination basis, and the more accurate display screen brightness adjustment is realized. Especially, the adjusting precision when the ambient light is darker is improved, and the brightness adjusting precision of the display screen is improved. The display screen brightness accurate adjustment of the embodiment of the specification can be realized without adding hardware equipment, such as OMS, DMS and other video image processing systems of the intelligent cabin of the vehicle, equipment cost is saved, and adjustment difficulty and complexity are reduced.
In some embodiments, the image processing to obtain a captured image includes obtaining a captured pattern from spatially ambient visible light and obtaining the captured image from the captured pattern; wherein the photographing mode includes a black-and-white mode and a color mode.
Specifically, the OMS video camera adopts an rgb image sensor, the sensor can receive visible light and also can receive infrared light, the sensing curve of the sensor is shown in a sixth diagram, the working state of the sensor can be divided into two modes, as shown in fig. 3, the illumination condition of the visible light in a certain wavelength range is good, and the video image can better detect and identify the passenger state in the cabin in a color mode. In this mode, image data is acquired after the ir (Infrared Radiation) infrared component of the image has been removed by the combination algorithm. I.e. the mode is a color mode. In order to increase the photosensitivity, the infrared led is turned on to supplement light, and the OMS video camera operates to acquire image data, and the mode is a black-and-white mode.
According to the embodiment, when the space environment image is acquired, the image is respectively set to be in a black-and-white mode or a color mode according to different environment background basic light rays, so that the environment background basic illumination intensity can be unified with the subsequent environment cursor timing based on the image pixel values, the shooting image corresponding to the space environment can be acquired more accurately, and more accurate display screen brightness adjustment is realized. Some embodiments include a cabin environment.
In some embodiments, the display screen brightness adjustment method further includes calibrating ambient illuminance to obtain a calibration mode, where the calibration mode includes a black-and-white mode and a color mode and corresponds to a calibration curve with calibration parameters; and determining a corresponding target shooting image and a target calibration curve when the calibration mode is consistent with the shooting mode.
The calibration module is specifically used for calibrating the ambient illuminance. The sensor works under the condition of preset integrating sphere ambient illuminance to record a recorded brightness value (B) of the brightness meter, and the recorded brightness value (B) is collected through a camera image collector, such as an image average pixel value (P), and corresponding calibration parameters of exposure time (T), gain (G) and the like of a camera sensor. The standard grading value L can be calculated by adopting a formula I.
Formula l=p/(t×g) one
In some embodiments, a calibration evaluation value is obtained according to the calibration parameters, and a calibration mode is obtained based on the calibration evaluation value and the calibration record brightness value. Specifically, by adjusting the illuminance in the integrating sphere, a series of corresponding data can be obtained, and the recorded brightness value B and the calibration evaluation value L of the ambient illuminance are fitted to form a relative calibration curve, as shown in fig. 5. The background illumination corresponding to the image in the shooting cabin is obtained through a large amount of data research, the working modes can be divided into two working modes through the fitting of B and L, and the calibration modes are further divided into a color mode and a black-and-white mode, and the two calibration modes respectively correspond to a B-L calibration curve.
Therefore, as shown in fig. 3 in combination with the above embodiment, when the shooting mode is consistent with the calibration mode, unified background illumination can be established to obtain a target shooting image and a target calibration curve corresponding to the calibration process. Not only improves the accuracy of the image shot by the space environment in the shooting process, but also improves the accuracy of the illumination calibration of the space environment, and further improves the accuracy of the brightness adjustment of the display screen in the space environment.
In some embodiments, obtaining the current ambient illuminance from the captured image by calibrating the ambient illuminance includes:
and according to the target shooting image, combining the calibration parameters in a target calibration curve to obtain the current ambient illuminance.
Specifically, the current ambient illuminance Bc is obtained according to the above formula one and the target calibration curve. Wherein the average pixel value (P) is calculated by taking the display screen area in OMS image data as the ROI (region of interest ). According to the exposure time (T) and the gain setting (G) of the OMS camera, an absolute calibration evaluation value Lc is further calculated according to a formula I, and the current ambient illuminance Bc is obtained through a target calibration curve under a corresponding calibration mode.
In some embodiments, the display screen brightness adjustment method further includes: detecting whether a driver in the space environment wears a sunglasses or not; if the space environment has the state of wearing the sunglasses, the final brightness is obtained based on the target brightness allocation.
Specifically, the video camera of the DMS detects and analyzes the state of the driver in real time against the driver through an AI algorithm, including whether the driver wears a sunglasses, whether the driver is tired, whether attention is concentrated, and the like. The DMS video camera according to the above embodiment is used for detecting and analyzing whether the driver wears the sunglasses, if the driver wears the sunglasses, when the vehicle is traveling with a short change in ambient illuminance and a fast vehicle traveling speed, in order to ensure comfort of eyes of the driver and prevent accidents, the ambient illuminance needs to be accurately identified, and a display screen light with appropriate brightness is provided for the driver.
In some embodiments, if the change time of the ambient illuminance is very short, if the change time is smaller than the change such as shrinkage of the through hole of the human eye, etc., the brightness adjustment method of the display screen according to any technical scheme of the present disclosure needs to be adopted to ensure the comfort level and driving safety of the human eye, etc.
In this embodiment, if the current ambient illuminance is low and the person wears the sunglasses, the target brightness of the display screen needs to be further adjusted according to the sunglasses so as to adapt to the state of wearing the sunglasses, especially, the adjustment accuracy when the ambient light is dark is improved, and the accuracy of adjusting the brightness of the display screen is improved.
In some embodiments the blending to obtain the final luminance based on the target luminance includes: and correcting the target brightness according to the filtering parameters of the sunglasses to obtain final brightness.
Specifically, whether the driver wears the sunglasses or not is combined, an adjustable coefficient alpha (for example, when the driver does not wear the sunglasses, the alpha is 1, and when the driver wears the sunglasses, the alpha is greater than 1) can be superimposed on the corresponding target brightness Dt of the display screen, particularly, the filter index of the sunglasses to light rays is adapted aiming at the condition of wearing the sunglasses, the final brightness Df of the display screen is finally obtained, and the screen brightness is regulated step by step and smoothly to the final brightness Df.
In some embodiments, the display screen may further include electronic devices held by the passenger, and if the user wears the sunglasses to perform the interaction process through the display screen of the electronic devices, the brightness adjustment method of the display screen is also required to ensure the comfort level of human eyes.
Some embodiments referring to fig. 7, the adjustment of the brightness of the display screen is realized by adopting an OMS and DMS system of the intelligent cabin of the vehicle, specifically, a shooting image is obtained through an OMS camera; acquiring current ambient illuminance, and determining the current ambient illuminance based on calibration parameters such as an average pixel value of a shot image; and further obtaining the corrected display screen corresponding target brightness according to the current ambient illuminance. And (3) identifying whether the driver wears the sunglasses or not through the DMS, and if the driver wears the sunglasses, adjusting the final brightness of the display screen according to a preset system, and further smoothly adjusting the final brightness step by step to enable the display screen to present the final brightness.
As shown in fig. 8, the display screen brightness adjustment device 80 of the embodiment of the present specification may include: an obtaining module 81, configured to obtain a space environment illuminance state; the space environment illumination state comprises a shooting image obtained by image processing and the current environment illumination obtained by calibrating the environment illumination according to the shooting image;
and the determining module 82 is configured to determine a target brightness of the display screen according to the current ambient illuminance.
The apparatus of the embodiment shown in fig. 8 may be correspondingly used to perform the steps in the embodiment of the method shown in fig. 2, and the implementation principle and technical effects are similar, and are not repeated here.
In connection with the above embodiments, as shown in fig. 9, the data acquisition system 90 includes: a processor 91, a memory 92 and a computer program; wherein the method comprises the steps of
A memory 92 for storing the computer program, which may also be a flash memory (flash). Such as application programs, functional modules, etc. implementing the methods described above.
A processor 91 for executing the computer program stored in the memory to implement the steps executed by the apparatus in the above method. Reference may be made in particular to the description of the embodiments of the method described above.
Alternatively, the memory 92 may be separate or integrated with the processor 91.
When the memory 92 is a device separate from the processor 91, the apparatus may further include:
a bus 93 for connecting the memory 92 and the processor 91.
The present application also provides a readable storage medium having stored therein a computer program for implementing the methods provided by the various embodiments described above when executed by a processor.
The readable storage medium may be a computer storage medium or a communication medium. Communication media includes any medium that facilitates transfer of a computer program from one place to another. Computer storage media can be any available media that can be accessed by a general purpose or special purpose computer. For example, a readable storage medium is coupled to the processor such that the processor can read information from, and write information to, the readable storage medium. In the alternative, the readable storage medium may be integral to the processor. The processor and the readable storage medium may reside in an application specific integrated circuit (Application Specific Integrated Circuits, ASIC for short). In addition, the ASIC may reside in a user device. The processor and the readable storage medium may reside as discrete components in a communication device. The readable storage medium may be read-only memory (ROM), random-access memory (RAM), CD-ROMs, magnetic tape, floppy disk, optical data storage device, etc.
The present application also provides a program product comprising execution instructions stored in a readable storage medium. The at least one processor of the device may read the execution instructions from the readable storage medium, the execution instructions being executed by the at least one processor to cause the device to implement the methods provided by the various embodiments described above.
In the above embodiment of the apparatus, it should be understood that the processor may be a central processing unit (english: central Processing Unit, abbreviated as CPU), or may be other general purpose processors, digital signal processors (english: digital Signal Processor, abbreviated as DSP), application specific integrated circuits (english: application Specific Integrated Circuit, abbreviated as ASIC), or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of a method disclosed in connection with the present application may be embodied directly in a hardware processor for execution, or in a combination of hardware and software modules in a processor for execution.
In this specification, each embodiment is described in a progressive manner, and identical and similar parts of each embodiment are all referred to each other, and each embodiment focuses on differences from other embodiments. In particular, for the product embodiments described later, since they correspond to the methods, the description is relatively simple, and reference is made to the description of parts of the system embodiments.
The foregoing is merely illustrative of the present application, and the present application is not limited thereto, and any changes or substitutions easily contemplated by those skilled in the art within the scope of the present application should be included in the present application. Therefore, the protection scope of the application is subject to the protection scope of the claims.