CN108900782B - Exposure control method, device, and electronic device - Google Patents
Exposure control method, device, and electronic deviceDownload PDFInfo
- Publication number
- CN108900782B CN108900782BCN201810963320.5ACN201810963320ACN108900782BCN 108900782 BCN108900782 BCN 108900782BCN 201810963320 ACN201810963320 ACN 201810963320ACN 108900782 BCN108900782 BCN 108900782B
- Authority
- CN
- China
- Prior art keywords
- exposure
- frame
- duration
- image
- collected
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Classifications
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/71—Circuitry for evaluating the brightness variation
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/73—Circuitry for compensating brightness variation in the scene by influencing the exposure time
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
Abstract
Description
Translated fromChinese技术领域technical field
本申请涉及成像技术领域，尤其涉及一种曝光控制方法、装置以及电子设备。The present application relates to the field of imaging technologies, and in particular, to an exposure control method, an apparatus, and an electronic device.
背景技术Background technique
随着智能终端技术的发展，移动终端设备(如智能手机、平板电脑等)的使用越来越普及。绝大多数移动终端设备都内置有摄像头，并且随着移动终端处理能力的增强以及摄像头技术的发展，内置摄像头的性能越来越强大，拍摄图像的质量也越来越高。如今，移动终端设备均操作简单又便于携带，在日常生活中越来越多的用户使用智能手机、平板电脑等移动终端设备拍照。With the development of smart terminal technology, the use of mobile terminal devices (such as smart phones, tablet computers, etc.) is becoming more and more popular. Most mobile terminal devices have built-in cameras, and with the enhancement of processing capabilities of mobile terminals and the development of camera technology, the performance of built-in cameras is becoming more and more powerful, and the quality of captured images is also getting higher and higher. Nowadays, mobile terminal devices are easy to operate and easy to carry. More and more users use mobile terminal devices such as smartphones and tablet computers to take pictures in daily life.
智能移动终端在给人们的日常拍照带来便捷的同时，人们对拍摄的图像质量的要求也越来越高。然而，由于专业水平限制，人们不知如何根据拍摄场景设置合适的拍摄参数，因此很难拍出与专业相机效果一样好的图像，尤其在夜景这一特殊场景中，图像质量较低。While the intelligent mobile terminal brings convenience to people's daily photography, people have higher and higher requirements for the quality of the captured images. However, due to the limitation of professional level, people do not know how to set appropriate shooting parameters according to the shooting scene, so it is difficult to take pictures as good as professional cameras, especially in the special scene of night scene, the image quality is low.
发明内容SUMMARY OF THE INVENTION
本申请旨在至少在一定程度上解决相关技术中的技术问题之一。The present application aims to solve one of the technical problems in the related art at least to a certain extent.
为此，本申请提出一种曝光控制方法、装置电子设备以及计算机可读存储介质，以解决相关技术中，在拍摄画面偏亮的夜景场景中，由于测光失误导致拍摄的图像动态范围以及周围亮度低，噪声水平高，影响用户体验的技术问题。To this end, the present application proposes an exposure control method, device electronic device, and computer-readable storage medium to solve the problem in the related art that, in a night scene with a bright shot, the dynamic range of the shot image and surrounding Low brightness, high noise levels, technical issues that affect the user experience.
本申请一方面实施例提出了一种曝光控制方法，包括：An embodiment of the present application provides an exposure control method, including:
测光以确定各帧待采集图像的目标曝光量；Metering to determine the target exposure for each frame of images to be captured;
根据各帧待采集图像的目标曝光量和各帧待采集图像预设的感光度，确定各帧待采集图像的曝光时长；Determine the exposure duration of each frame of the to-be-captured image according to the target exposure of each frame of the to-be-captured image and the preset sensitivity of each frame of the to-be-captured image;
若至少一帧待采集图像的曝光时长小于时长下限，根据所述时长下限，更新所述至少一帧待采集图像的曝光时长；If the exposure duration of the at least one frame of the to-be-captured image is less than the lower duration limit, updating the exposure duration of the at least one frame of the to-be-captured image according to the duration lower limit;
根据各帧待采集图像的曝光时长和感光度，进行曝光控制。Exposure control is performed according to the exposure duration and sensitivity of each frame of images to be collected.
本申请实施例的曝光控制方法，通过测光以确定各帧待采集图像的目标曝光量；根据各帧待采集图像的目标曝光量和各帧待采集图像预设的感光度，确定各帧待采集图像的曝光时长，若至少一帧待采集图像的曝光时长小于时长下限，根据时长下限，更新至少一帧待采集图像的曝光时长，最终根据各帧待采集图像的曝光时长和感光度，进行曝光控制。由此，通过根据成像设备的抖动程度和当前拍摄场景的环境光亮度，确定了各帧待采集图像的曝光时长，进而根据时长下限更新至少一帧待采集图像的曝光时长，最终根据更新后的各帧待采集图像的曝光时长和感光度，进行曝光控制，进而成像，不仅提升了夜景拍摄模式下拍摄图像的动态范围和整体亮度，有效抑制了拍摄图像中的噪声，提高了夜景拍摄图像的质量，改善了用户体验。In the exposure control method of the embodiment of the present application, the target exposure amount of each frame of images to be collected is determined by photometry; The exposure duration of the captured image, if the exposure duration of at least one frame of the image to be captured is less than the lower limit of the duration, update the exposure duration of at least one frame of the image to be captured according to the lower duration limit, and finally perform the process according to the exposure duration and sensitivity of each frame of the image to be captured. Exposure control. In this way, the exposure duration of each frame of images to be captured is determined according to the degree of shaking of the imaging device and the ambient light brightness of the current shooting scene, and then the exposure duration of at least one frame of images to be captured is updated according to the lower limit of the duration, and finally according to the updated The exposure time and sensitivity of each frame of the image to be collected are controlled by exposure control and imaging, which not only improves the dynamic range and overall brightness of the image captured in the night scene shooting mode, but also effectively suppresses the noise in the captured image and improves the image quality of the night scene shooting. quality, improved user experience.
本申请又一方面实施例提出了一种曝光控制装置，包括：Another aspect of the present application provides an exposure control device, including:
测光模块，用于测光以确定各帧待采集图像的目标曝光量；A light metering module, used for light metering to determine the target exposure of each frame of images to be collected;
确定模块，用于根据各帧待采集图像的目标曝光量和各帧待采集图像预设的感光度，确定各帧待采集图像的曝光时长；a determining module, configured to determine the exposure duration of each frame of the to-be-captured image according to the target exposure amount of each frame of the to-be-captured image and the preset sensitivity of each frame of the to-be-captured image;
更新模块，用于若至少一帧待采集图像的曝光时长小于时长下限，根据所述时长下限，更新所述至少一帧待采集图像的曝光时长；an update module, configured to update the exposure duration of the at least one frame of the image to be collected according to the lower limit of the duration if the exposure duration of the at least one frame of the image to be collected is less than the lower limit of the duration;
控制模块，用于根据各帧待采集图像的曝光时长和感光度，进行曝光控制。The control module is configured to perform exposure control according to the exposure duration and sensitivity of each frame of images to be collected.
本申请实施例的曝光控制装置，通过测光以确定各帧待采集图像的目标曝光量；根据各帧待采集图像的目标曝光量和各帧待采集图像预设的感光度，确定各帧待采集图像的曝光时长，若至少一帧待采集图像的曝光时长小于时长下限，根据时长下限，更新至少一帧待采集图像的曝光时长，最终根据各帧待采集图像的曝光时长和感光度，进行曝光控制。由此，通过根据成像设备的抖动程度和当前拍摄场景的环境光亮度，确定了各帧待采集图像的曝光时长，进而根据时长下限更新至少一帧待采集图像的曝光时长，最终根据更新后的各帧待采集图像的曝光时长和感光度，进行曝光控制，进而成像，不仅提升了夜景拍摄模式下拍摄图像的动态范围和整体亮度，有效抑制了拍摄图像中的噪声，提高了夜景拍摄图像的质量，改善了用户体验。In the exposure control device of the embodiment of the present application, the target exposure amount of each frame of images to be collected is determined by photometry; The exposure duration of the captured image, if the exposure duration of at least one frame of the image to be captured is less than the lower limit of the duration, update the exposure duration of at least one frame of the image to be captured according to the lower duration limit, and finally perform the process according to the exposure duration and sensitivity of each frame of the image to be captured. Exposure control. In this way, the exposure duration of each frame of images to be captured is determined according to the degree of shaking of the imaging device and the ambient light brightness of the current shooting scene, and then the exposure duration of at least one frame of images to be captured is updated according to the lower limit of the duration, and finally according to the updated The exposure time and sensitivity of each frame of the image to be collected are controlled by exposure control and imaging, which not only improves the dynamic range and overall brightness of the image captured in the night scene shooting mode, but also effectively suppresses the noise in the captured image and improves the image quality of the night scene shooting. quality, improved user experience.
本申请又一方面实施例提出了一个或多个包含计算机可执行指令的非易失性计算机可读存储介质，其上存储有计算机程序，其特征在于，该程序被处理器执行时实现如上述实施例所述的曝光控制方法。Another aspect of the present application provides one or more non-volatile computer-readable storage media containing computer-executable instructions, on which a computer program is stored, characterized in that, when the program is executed by a processor, the above-mentioned implementation is achieved The exposure control method described in the embodiment.
本申请又一方面实施例提出了一种电子设备，包括存储器及处理器，所述存储器中储存有计算机可读指令，所述处理器执行所述程序时，实现如上述实施例所述的曝光控制方法。Another aspect of the present application provides an electronic device, including a memory and a processor, where computer-readable instructions are stored in the memory, and when the processor executes the program, the exposure as described in the foregoing embodiments is implemented. Control Method.
本申请附加的方面和优点将在下面的描述中部分给出，部分将从下面的描述中变得明显，或通过本申请的实践了解到。Additional aspects and advantages of the present application will be set forth, in part, in the following description, and in part will be apparent from the following description, or learned by practice of the present application.
附图说明Description of drawings
本申请上述的和/或附加的方面和优点从下面结合附图对实施例的描述中将变得明显和容易理解，其中：The above and/or additional aspects and advantages of the present application will become apparent and readily understood from the following description of embodiments taken in conjunction with the accompanying drawings, wherein:
图1为本申请实施例所提供的一种曝光控制方法的流程示意图；1 is a schematic flowchart of an exposure control method provided by an embodiment of the present application;
图2为本申请实施例所提供的一种确定各帧待采集图像预设的曝光补偿值的流程示意图；FIG. 2 is a schematic flowchart of determining a preset exposure compensation value of each frame of images to be collected according to an embodiment of the present application;
图3为本申请实施例所提供的另一种曝光控制方法的流程示意图；3 is a schematic flowchart of another exposure control method provided by an embodiment of the present application;
图4为本申请实施例所提供的一种曝光控制装置的结构示意图；4 is a schematic structural diagram of an exposure control device provided by an embodiment of the application;
图5为本申请某些实施方式的电子设备的模块示意图；5 is a schematic block diagram of an electronic device according to some embodiments of the present application;
图6为本申请某些实施方式的图像处理电路的模块示意图。FIG. 6 is a schematic block diagram of an image processing circuit according to some embodiments of the present application.
具体实施方式Detailed ways
下面详细描述本申请的实施例，所述实施例的示例在附图中示出，其中自始至终相同或类似的标号表示相同或类似的元件或具有相同或类似功能的元件。下面通过参考附图描述的实施例是示例性的，旨在用于解释本申请，而不能理解为对本申请的限制。The following describes in detail the embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein the same or similar reference numerals refer to the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary, and are intended to be used to explain the present application, but should not be construed as a limitation to the present application.
相关技术在夜景拍摄场景中，由于光照条件差，为了提高拍摄质量，在拍摄过程中，人们习惯将拍摄主体放在画面中间位置，分别进行长曝光、中曝光和短曝光，再将不同的曝光度下获得的图像合成后输出成像，以改善图像的成像效果。但是，这种拍摄方式在夜景拍摄场景下，拍摄得到的图像动态范围不够宽，图像的整体亮度也比较低，拍摄过程中也可能会引入噪点。Related Art In the night scene shooting scene, due to poor lighting conditions, in order to improve the shooting quality, during the shooting process, people are accustomed to placing the subject in the middle of the screen, respectively performing long exposure, medium exposure and short exposure, and then different exposures. The images obtained at low degrees are synthesized and output for imaging to improve the imaging effect of the images. However, in the night scene shooting scene, the dynamic range of the captured image is not wide enough, the overall brightness of the image is relatively low, and noise may also be introduced during the shooting process.
本申请实施例针对相关技术中，在夜景场景中拍摄图像时，当拍摄场景中间范围比较亮时导致测光失误，使得拍摄得到的图像的动态范围以及周围暗区亮度都较低，噪声水平高，影响用户体验的问题，提出一种曝光控制方法。The embodiments of the present application are aimed at the related art. When shooting an image in a night scene, when the middle range of the shooting scene is relatively bright, a metering error is caused, so that the dynamic range of the shot image and the brightness of the surrounding dark area are low, and the noise level is high. , which affects the user experience, and proposes an exposure control method.
本申请实施例提供的曝光控制方法，通过测光以确定各帧待采集图像的目标曝光量；根据各帧待采集图像的目标曝光量和各帧待采集图像预设的感光度，确定各帧待采集图像的曝光时长，若至少一帧待采集图像的曝光时长小于时长下限，根据时长下限，更新至少一帧待采集图像的曝光时长，最终根据各帧待采集图像的曝光时长和感光度，进行曝光控制。In the exposure control method provided by the embodiment of the present application, the target exposure amount of each frame of images to be collected is determined by photometry; each frame is determined according to the target exposure amount of each frame of the to-be-collected image and the preset sensitivity of each frame of the to-be-collected image The exposure duration of the to-be-captured image, if the exposure duration of at least one frame of the to-be-captured image is less than the lower limit of the duration, update the exposure duration of at least one frame of the to-be-captured image according to the lower duration limit, and finally, according to the exposure duration and sensitivity of each frame of the to-be-captured image, Perform exposure control.
下面参考附图描述本申请实施例的曝光控制方法和装置。The exposure control method and device according to the embodiments of the present application will be described below with reference to the accompanying drawings.
图1为本申请实施例所提供的一种曝光控制方法的流程示意图。FIG. 1 is a schematic flowchart of an exposure control method provided by an embodiment of the present application.
本申请实施例的曝光控制方法，应用于电子设备，该电子设备可以为手机、平板电脑、个人数字助理、穿戴式设备等具有各种操作系统、成像设备的硬件设备。The exposure control methods in the embodiments of the present application are applied to electronic devices, which may be hardware devices with various operating systems and imaging devices, such as mobile phones, tablet computers, personal digital assistants, and wearable devices.
如图1所示，该曝光控制方法包括以下步骤：As shown in Figure 1, the exposure control method includes the following steps:
步骤101，测光以确定各帧待采集图像的目标曝光量。
其中，曝光量，是指成像设备中的感光器件在曝光时长内接受到光的多少，曝光量与光圈、曝光时长和感光度有关。其中，光圈也就是通光口径，决定单位时间内光线通过的数量；曝光时长，是指光线通过镜头的时间；感光度，又称为ISO值，是衡量底片对于光的灵敏程度的指标，用于表示感光元件的感光速度，ISO数值越高就说明该感光元器件的感光能力越强。Among them, the exposure amount refers to the amount of light received by the photosensitive device in the imaging device during the exposure duration, and the exposure amount is related to the aperture, exposure duration and sensitivity. Among them, the aperture is the aperture of light, which determines the amount of light passing through the unit time; the exposure time refers to the time for the light to pass through the lens; the sensitivity, also known as the ISO value, is an indicator to measure the sensitivity of the film to light. In expressing the photosensitive speed of the photosensitive element, the higher the ISO value, the stronger the photosensitive ability of the photosensitive element.
需要说明的是，当成像设备的感光度较低时，需要曝光更长的时间以达到跟感光度较高时相同的成像效果。数码相机的感光度是一种类似于胶卷感光度的一种指标，数码相机的ISO值可以通过调整感光器件的灵敏度或者合并感光点来调整，也就是说，可以通过提升感光器件的光线敏感度或者合并几个相邻的感光点来达到提升ISO值的目的。当然，为了减少曝光时间，使用相对较高的感光度通常会引入较多的噪声，从而会导致图像质量降低。因此，在夜景场景下，为了得到较佳的噪声抑制效果，希望设置较低的感光度，例如100ISO或200ISO等，同时，由于手机等电子设备的光圈通常采用固定值，从而需要相应提高曝光时长，即快门时长。It should be noted that when the sensitivity of the imaging device is low, the exposure time is longer to achieve the same imaging effect as when the sensitivity is high. The sensitivity of a digital camera is an indicator similar to the sensitivity of a film. The ISO value of a digital camera can be adjusted by adjusting the sensitivity of the photosensitive device or combining the photosensitive points, that is, by improving the light sensitivity of the photosensitive device. Or combine several adjacent photosensitive points to achieve the purpose of increasing the ISO value. Of course, in order to reduce exposure time, using relatively high sensitivities usually introduces more noise, which can result in lower image quality. Therefore, in the night scene, in order to obtain a better noise suppression effect, it is desirable to set a lower sensitivity, such as 100ISO or 200ISO. At the same time, since the aperture of electronic devices such as mobile phones usually adopts a fixed value, it is necessary to increase the exposure time accordingly. , which is the shutter time.
具体地，通过成像设备获取当前拍摄场景的预览图像，进一步的通过感光器件测量得到预览图像各区域的环境光亮度，进而根据预览图像的亮度信息，确定基准曝光量。其中，在光圈固定的情况下，基准曝光量具体可以包括基准曝光时长和基准感光度。Specifically, a preview image of the current shooting scene is acquired by an imaging device, and the ambient light brightness of each area of the preview image is further measured by a photosensitive device, and then the reference exposure amount is determined according to the brightness information of the preview image. Wherein, when the aperture is fixed, the reference exposure amount may specifically include a reference exposure duration and a reference sensitivity.
本申请实施例中，基准曝光量，是指通过对预览图像进行测光获取的当前环境的亮度信息，确定的与当前环境的亮度信息相适应的曝光量，基准曝光量的取值可以是基准感光度与基准曝光时长之间的乘积。In the embodiment of the present application, the reference exposure refers to the brightness information of the current environment obtained by performing light metering on the preview image, and the exposure that is determined to suit the brightness information of the current environment, and the value of the reference exposure may be the reference The product of the sensitivity and the base exposure duration.
其中，基准感光度，可以是根据成像设备当前的抖动程度，确定的与当前的抖动程度相适应的感光度，还可以是通过测光得到的感光度，本实施例中对此不作限定。可以理解的是，由于曝光量与感光度会影响到整体的拍摄时长，拍摄时长过长，可能会导致手持拍摄时成像设备的抖动程度加剧，从而影响图像质量。因此，在根据成像设备当前的抖动程度，确定基准感光度时，应当使得拍摄时长控制在合适的范围内。The reference sensitivity may be a sensitivity determined according to the current shaking degree of the imaging device and adapted to the current shaking degree, or may be a sensitivity obtained by light metering, which is not limited in this embodiment. It is understandable that since the exposure and sensitivity will affect the overall shooting time, if the shooting time is too long, the shaking of the imaging device during handheld shooting may be aggravated, thereby affecting the image quality. Therefore, when the reference sensitivity is determined according to the current shaking degree of the imaging device, the shooting duration should be controlled within an appropriate range.
具体来说，由于曝光量与光圈、曝光时长和感光度有关，当光圈的大小固定时，可根据基准曝光量以及基准感光度，确定出基准曝光时长。将基准曝光时长作为EV0，根据各帧待采集图像预设的曝光补偿值，可确定各帧待采集图像的目标曝光量。Specifically, since the exposure amount is related to the aperture, the exposure duration and the sensitivity, when the aperture size is fixed, the reference exposure duration can be determined according to the reference exposure amount and the reference sensitivity. Taking the reference exposure duration as EV0, and according to the preset exposure compensation value of each frame of the to-be-captured image, the target exposure amount of each frame of the to-be-captured image can be determined.
其中，预设的曝光补偿值，是指根据当前拍摄场景的环境光亮度预先设定的曝光值(Exposure Value,EV)。在曝光值最初的定义中，曝光值并不是指一个准确的数值，而是指“能够给出统一的曝光量的所有相机光圈与曝光时长的组合”。感光度、光圈和曝光时长确定了相机的曝光量，不同的参数组合可以产生相等的曝光量，即这些不同组合的EV值是一样的，比如，在感光度相同的情况下，使用1/125秒曝光时长和f11的光圈组合，与使用1/250秒曝光时间与f8快门的组合，获得的曝光量是相同的，即EV值是相同的。EV值为0时，是指感光度为100、光圈系数为f1、曝光时长为1秒时获得的曝光量；曝光量增加一档，即曝光时长增加一倍，或者感光度增加一倍，或者光圈增加一档，EV值增加1，也就是说，EV1对应的曝光量是EV0对应的曝光量的两倍。The preset exposure compensation value refers to an exposure value (Exposure Value, EV) preset according to the ambient light brightness of the current shooting scene. In the original definition of exposure value, exposure value does not refer to an exact value, but refers to "all combinations of camera apertures and exposure durations that give a uniform exposure". Sensitivity, aperture and exposure time determine the exposure of the camera. Different parameter combinations can produce equal exposure, that is, the EV values of these different combinations are the same, for example, in the case of the same sensitivity, use 1/125 The combination of the exposure time in seconds and the aperture of f11, and the combination of the exposure time of 1/250 second and the shutter of f8, the exposure amount obtained is the same, that is, the EV value is the same. When the EV value is 0, it refers to the exposure obtained when the sensitivity is 100, the aperture factor is f1, and the exposure time is 1 second; if the exposure is increased by one stop, the exposure time is doubled, or the sensitivity is doubled, or When the aperture is increased by one stop, the EV value is increased by 1, that is to say, the exposure amount corresponding to EV1 is twice the exposure amount corresponding to EV0.
作为一种示例，假如成像设备根据测量得到的预览图像的亮度信息，确定各帧待采集图像的基准曝光量为400，此时基准感光度ISO值为100，则基准曝光时长为4s。如果各帧待采集图像预设的曝光补偿值均为EV+1，可确定此时的目标曝光量均为800。其中，EV+1的曝光补偿是指相对于成像设备测光数据对应的曝光量增加一档曝光，即实际曝光量为测光数据对应的曝光量的两倍。As an example, if the imaging device determines, according to the measured brightness information of the preview image, the reference exposure of each frame of images to be captured is 400, and the reference ISO value is 100, the reference exposure duration is 4s. If the preset exposure compensation value of each frame of images to be captured is EV+1, it can be determined that the target exposure at this time is all 800. Among them, the exposure compensation of EV+1 means that the exposure amount corresponding to the metering data of the imaging device is increased by one level of exposure, that is, the actual exposure amount is twice the exposure amount corresponding to the metering data.
在本申请实施例中，预设曝光补偿值时，可以将确定的基准曝光量对应的EV值预设为0，EV+1是指增加一档曝光，即曝光量为基准曝光量的2倍，EV+2是指增加两档曝光，即曝光量为基准曝光量的4倍，EV-1是指减少一档曝光，即曝光量为基准曝光量的0.5倍等等。In the embodiment of the present application, when the exposure compensation value is preset, the EV value corresponding to the determined reference exposure amount may be preset to 0, and EV+1 means to increase the exposure by one level, that is, the exposure amount is 2 times the reference exposure amount , EV+2 means to increase the exposure by two stops, that is, the exposure is 4 times the base exposure, EV-1 means to reduce the exposure by one stop, that is, the exposure is 0.5 times the base exposure, and so on.
举例来说，若待采集的图像数量为7帧，则对应的预设曝光补偿值EV值可以是[+1,+1,+1,+1,0,-3,-6]。其中，预设曝光补偿值为EV+1的帧，可以解决噪声问题，通过亮度比较高的帧进行时域降噪，在提升暗部细节的同时抑制噪声；预设曝光补偿值为EV-6的帧，可以解决高光过曝的问题，保留高光区域的细节；预设曝光补偿值为EV0和EV-3的帧，则可以用于保持高光到暗区之间的过渡，保持较好的明暗过渡的效果。For example, if the number of images to be captured is 7 frames, the corresponding preset exposure compensation value EV value may be [+1,+1,+1,+1,0,-3,-6]. Among them, the frame with the preset exposure compensation value of EV+1 can solve the noise problem, and the temporal noise reduction is performed by the frame with relatively high brightness, which can improve the details of the dark part while suppressing the noise; the preset exposure compensation value is EV-6. frame, which can solve the problem of overexposure of highlights and preserve the details of highlight areas; frames with preset exposure compensation values of EV0 and EV-3 can be used to maintain the transition between highlights and dark areas, and maintain a good transition between light and dark Effect.
步骤102，根据各帧待采集图像的目标曝光量和各帧待采集图像预设的感光度，确定各帧待采集图像的曝光时长。Step 102: Determine the exposure duration of each frame of the to-be-captured image according to the target exposure of each frame of the to-be-captured image and the preset sensitivity of each frame of the to-be-captured image.
本申请实施例中，作为一种可能的实现方式，当各帧待采集图像预设的感光度相同时，可以根据拍摄场景的环境光亮度，确定各帧待采集图像预设的感光度。在拍摄场景光线比较暗的情况下，提高感光度，可以使快门的速度加快，从而减少画面抖动。In the embodiment of the present application, as a possible implementation manner, when the preset sensitivity of each frame of images to be collected is the same, the preset sensitivity of each frame of images to be collected may be determined according to the ambient light brightness of the shooting scene. In the case of shooting scenes with low light, increasing the sensitivity can speed up the shutter speed, thereby reducing the image shake.
作为另一种可能的实现方式，当各帧待采集图像预设的感光度相同时，可以根据抖动程度，确定各帧待采集图像预设的感光度。As another possible implementation manner, when the preset sensitivity of each frame of images to be collected is the same, the preset sensitivity of each frame of images to be collected may be determined according to the degree of shaking.
具体地，为了确定抖动程度，可以根据成像设备中设置的位移传感器，采集位移信息，进而，根据采集到的成像设备的位移信息，确定成像设备的抖动程度。当成像设备的抖动程度大于或等于抖动阈值时，确定当前拍摄场景中各帧待采集图像预设的感光度取值为第一感光值；当成像设备的抖动程度小于抖动阈值时，确定当前拍摄场景中各帧待采集图像预设的感光度取值为第二感光值。其中，抖动阈值，为成像设备中预先设定的用于确定预设感光度取值的抖动值。Specifically, in order to determine the degree of shaking, displacement information may be collected according to a displacement sensor provided in the imaging device, and then, the degree of shaking of the imaging device may be determined according to the collected displacement information of the imaging device. When the shaking degree of the imaging device is greater than or equal to the shaking threshold, it is determined that the preset sensitivity value of each frame to be captured in the current shooting scene is the first sensitivity value; when the shaking degree of the imaging device is less than the shaking threshold, it is determined that the current shooting The preset sensitivity value of each frame of the image to be collected in the scene is the second sensitivity value. The jitter threshold is a jitter value preset in the imaging device and used to determine a preset sensitivity value.
其中，第一感光值大于第二感光值，第一感光值为第二感光值的预设倍数，预设倍数的取值大于等于2。作为一种可能的实现方式，为了获得较低的噪声，第二感光值可以为成像设备的最小感光度，即第二感光值的取值为100ISO，相应地，第一感光值的取值范围可以为200、400、800或者更高。Wherein, the first photosensitive value is greater than the second photosensitive value, the first photosensitive value is a preset multiple of the second photosensitive value, and the value of the preset multiple is greater than or equal to 2. As a possible implementation manner, in order to obtain lower noise, the second sensitivity value may be the minimum sensitivity of the imaging device, that is, the value of the second sensitivity value is 100 ISO, and correspondingly, the value range of the first sensitivity value Can be 200, 400, 800 or higher.
由于曝光量等于感光度乘以曝光时长，因此，本申请实施例中，根据各帧待采集图像的目标曝光量和各帧待采集图像预设的感光度，可以确定各帧待采集图像的曝光时长。Since the exposure amount is equal to the sensitivity multiplied by the exposure duration, in this embodiment of the present application, the exposure of each frame of the to-be-collected image can be determined according to the target exposure amount of each frame of the to-be-collected image and the preset sensitivity of each frame of the to-be-collected image duration.
作为一种示例，假如测光确定的一帧待采集图像的目标曝光量为800，确定的该帧待采集图像预设的感光度为400ISO，此时采集该帧图像的曝光时长则为2s。通过此方法，可确定各帧待采集图像的曝光时长。As an example, if the target exposure of a frame of images to be captured determined by photometry is 800, the predetermined sensitivity of the frame of images to be captured is determined to be 400 ISO, and the exposure duration for capturing this frame of images is 2s. Through this method, the exposure duration of each frame of images to be collected can be determined.
步骤103，若至少一帧待采集图像的曝光时长小于时长下限，根据时长下限，更新至少一帧待采集图像的曝光时长。
其中，曝光时长的时长下限大于或等于10ms。基于实验测得曝光时长在10ms以内时，会出现噪声的恶化，同时，对于一些设备还存在可设置的最小曝光时长为10ms的情况，因此，这里综合考虑以上情况设置时长下限大于或等于10ms。The lower limit of the exposure duration is greater than or equal to 10ms. Based on the experimental measurement, when the exposure duration is within 10ms, the noise will deteriorate. At the same time, for some devices, the minimum exposure duration that can be set is 10ms. Therefore, the lower limit of the set duration is greater than or equal to 10ms based on the above conditions.
本申请实施例中，当至少一帧待采集图像的曝光时长小于曝光时长下限，此时，将该至少一帧待采集图像的曝光时长设定为时长下限。进而，根据至少一帧待采集图像的目标曝光量和时长下限，以及曝光量与感光度和曝光时长的关系，更新该至少一帧待采集图像的感光度。进而根据曝光时长下限，更新该至少一帧待采集图像的曝光时长。In this embodiment of the present application, when the exposure duration of at least one frame of images to be captured is less than the lower limit of exposure duration, in this case, the exposure duration of the at least one frame of images to be captured is set as the lower duration limit. Further, according to the target exposure amount and the lower limit of the duration of the at least one frame of the image to be captured, and the relationship between the exposure amount, the sensitivity and the exposure duration, the sensitivity of the at least one frame of the to-be-captured image is updated. Further, the exposure duration of the at least one frame of the image to be collected is updated according to the lower limit of the exposure duration.
作为一种示例，假设曝光时长下限为10ms，各帧待采集图像的预设感光度相同均为100ISO，待采集图像为4帧，预设的曝光补偿值EV值可以是[-6、-5、-4、0]。若EV0为100ms、100ISO，则预设的曝光补偿值为EV-6时，采集一帧待采集图像的曝光时长为1.5ms、感光度为100ISO，此时该帧图像的曝光时长1.5ms小于时长下限10ms，则将该帧待采集图像的曝光时长设定为时长下限10ms，进而该帧待采集图像感光度取值为100ISO。可见，通过对该帧待采集图像的曝光时长进行更新，提亮了图像亮度，该帧的目标曝光量从1.5ms×100ISO提高至10ms×100ISO，目标曝光量为更新前的20/3倍。As an example, assuming that the lower limit of the exposure time is 10ms, the preset sensitivity of each frame of images to be captured is the same as 100ISO, the images to be captured are 4 frames, the preset exposure compensation value EV value can be [-6, -5 , -4, 0]. If EV0 is 100ms, 100ISO, and the preset exposure compensation value is EV-6, the exposure duration of a frame to be captured is 1.5ms and the sensitivity is 100ISO. At this time, the exposure duration of this frame of image is 1.5ms less than the duration If the lower limit is 10ms, the exposure duration of the frame to be captured is set to the lower duration limit of 10ms, and the sensitivity of the frame to be captured is 100ISO. It can be seen that by updating the exposure duration of the image to be collected in this frame, the brightness of the image is brightened. The target exposure of this frame is increased from 1.5ms×100ISO to 10ms×100ISO, and the target exposure is 20/3 times that before the update.
进一步地，为了使得各帧曝光过渡自然，暗光区域和亮光区域均能够得到较佳的曝光，还可以对其余各帧进行同步提亮。仍参考前述示例，对EV-6图像帧，目标曝光量为更新前的20/3倍，其余各帧目标曝光量也同步为更新前的20/3倍。具体可以通过提高曝光时长，或者通过提高ISO来实现，本实施例中对此不作限定。Further, in order to make the exposure transition of each frame natural, both the dark light area and the bright light area can obtain better exposure, and the remaining frames can also be synchronously brightened. Still referring to the previous example, for the EV-6 image frame, the target exposure is 20/3 times before the update, and the target exposure for the remaining frames is also 20/3 times before the update. Specifically, it can be achieved by increasing the exposure time or by increasing the ISO, which is not limited in this embodiment.
步骤104，根据各帧待采集图像的曝光时长和感光度，进行曝光控制。In
本申请实施例中，成像设备可以根据确定的各帧待采集图像的曝光时长和感光度，进行曝光控制，进而成像。In the embodiment of the present application, the imaging device may perform exposure control according to the determined exposure duration and sensitivity of each frame of the image to be collected, and then perform imaging.
本申请实施例的曝光控制方法，通过测光以确定各帧待采集图像的目标曝光量；根据各帧待采集图像的目标曝光量和各帧待采集图像预设的感光度，确定各帧待采集图像的曝光时长，若至少一帧待采集图像的曝光时长小于时长下限，根据时长下限，更新至少一帧待采集图像的曝光时长，最终根据各帧待采集图像的曝光时长和感光度，进行曝光控制。由此，通过根据成像设备的抖动程度和当前拍摄场景的环境光亮度，确定了各帧待采集图像的曝光时长，进而根据时长下限更新至少一帧待采集图像的曝光时长，最终根据更新后的各帧待采集图像的曝光时长和感光度，进行曝光控制，进而成像，不仅提升了夜景拍摄模式下拍摄图像的动态范围和整体亮度，而且有效抑制了拍摄图像中的噪声，提高了夜景拍摄图像的质量，改善了用户体验。In the exposure control method of the embodiment of the present application, the target exposure amount of each frame of images to be collected is determined by photometry; The exposure duration of the captured image, if the exposure duration of at least one frame of the image to be captured is less than the lower limit of the duration, update the exposure duration of at least one frame of the image to be captured according to the lower duration limit, and finally perform the process according to the exposure duration and sensitivity of each frame of the image to be captured. Exposure control. In this way, the exposure duration of each frame of images to be captured is determined according to the degree of shaking of the imaging device and the ambient light brightness of the current shooting scene, and then the exposure duration of at least one frame of images to be captured is updated according to the lower limit of the duration, and finally according to the updated The exposure time and sensitivity of each frame of the image to be collected are controlled for exposure and then imaging, which not only improves the dynamic range and overall brightness of the image captured in the night scene shooting mode, but also effectively suppresses the noise in the captured image, improving the night scene shooting image. quality, improving the user experience.
作为一种可能的实现方式，本申请实施例中，根据基准曝光量和各帧待采集图像预设的曝光补偿值，确定各帧待采集图像的目标曝光量之前，首先要确定各帧待采集图像预设的曝光补偿值，参见图2，具体可以包括以下步骤：As a possible implementation manner, in this embodiment of the present application, before determining the target exposure amount of each frame of the to-be-captured image according to the reference exposure amount and the preset exposure compensation value of each frame of the to-be-captured image, first determine the to-be-captured image of each frame See Figure 2 for the preset exposure compensation value of the image, which may include the following steps:
步骤201，获取预览画面。Step 201, obtaining a preview image.
本申请实施例中，可以通过成像设备获取当前拍摄场景的预览画面，用于确定当前拍摄场景是否属于夜景场景。In this embodiment of the present application, a preview image of the current shooting scene may be acquired through an imaging device, so as to determine whether the current shooting scene belongs to a night scene scene.
步骤202，根据预览画面的画面内容，确定当前拍摄场景属于夜景场景。Step 202 , according to the picture content of the preview picture, it is determined that the current shooting scene belongs to the night scene scene.
具体地，由于不同场景下环境亮度值不同，预览画面内容也不相同，根据当前拍摄场景预览画面的画面内容以及各区域的环境亮度值，判断当前拍摄场景是否属于夜景场景。Specifically, since the ambient brightness values in different scenes are different, the content of the preview image is also different. According to the image content of the preview image of the current shooting scene and the ambient brightness value of each area, it is determined whether the current shooting scene belongs to a night scene scene.
例如，预览画面的画面内容包括夜晚天空或者夜景灯源等，或者预览画面的各区域中环境亮度值符合夜景环境下图像的亮度分布特性，即可确定当前拍摄场景属于夜景场景。For example, if the content of the preview screen includes the night sky or night scene light sources, or the ambient brightness value in each area of the preview screen conforms to the brightness distribution characteristics of the image in the night scene environment, it can be determined that the current shooting scene belongs to the night scene scene.
步骤203，根据成像设备的抖动程度和/或预览画面是否包含人脸，识别当前拍摄场景适用的夜景模式。Step 203: Identify a night scene mode applicable to the current shooting scene according to the degree of shaking of the imaging device and/or whether the preview image contains a human face.
在本申请实施例中，可以通过成像设备设置的位移传感器，采集得到成像设备在拍摄过程中的位移信息，进而根据获取的位移信息确定成像设备当前的抖动程度。由此，可通过成像设备的抖动程度判断使用者是将成像设备固定在脚架上进行拍摄还是通过手持模式拍摄。进而，根据成像设备当前的抖动程度，识别当前拍摄场景适用的夜景模式。In this embodiment of the present application, displacement information of the imaging device during the shooting process can be acquired by using a displacement sensor provided by the imaging device, and then the current shaking degree of the imaging device can be determined according to the acquired displacement information. In this way, it can be determined whether the user fixes the imaging device on the tripod for shooting or shoots in the handheld mode according to the degree of shaking of the imaging device. Further, according to the current shaking degree of the imaging device, a night scene mode applicable to the current shooting scene is identified.
作为一种示例，可以通过获取电子设备当前的陀螺仪(Gyro-sensor)信息，确定成像设备当前的抖动程度。As an example, the current shaking degree of the imaging device may be determined by acquiring current gyroscope (Gyro-sensor) information of the electronic device.
其中，陀螺仪又叫角速度传感器，可以测量物理量偏转、倾斜时的转动角速度。在成像设备中，陀螺仪可以很好的测量转动、偏转的动作，从而可以精确分析判断出使用者的实际动作。电子设备的陀螺仪信息(gyro信息)可以包括成像设备在三维空间中三个维度方向上的运动信息，三维空间的三个维度可以分别表示为X轴、Y轴、Z轴三个方向，其中，X轴、Y轴、Z轴为两两垂直关系。Among them, the gyroscope is also called the angular velocity sensor, which can measure the rotational angular velocity when the physical quantity is deflected and tilted. In the imaging device, the gyroscope can measure the movement of rotation and deflection well, so that the actual movement of the user can be accurately analyzed and judged. The gyroscope information (gyro information) of the electronic device may include the motion information of the imaging device in the three-dimensional directions in the three-dimensional space, and the three dimensions of the three-dimensional space may be respectively expressed as the three directions of the X axis, the Y axis, and the Z axis, wherein , the X-axis, Y-axis, and Z-axis are perpendicular to each other.
由此，本申请实施例中，可以根据电子设备当前的gyro信息，确定成像设备当前的抖动程度。电子设备在三个方向上的gyro运动的绝对值越大，则成像设备的抖动程度越大。具体的，可以预设在三个方向上gyro运动的绝对值阈值，并根据获取到的当前在三个方向上的gyro运动的绝对值之和，与预设的阈值的关系，确定成像设备的当前的抖动程度。Therefore, in this embodiment of the present application, the current shaking degree of the imaging device can be determined according to the current gyro information of the electronic device. The greater the absolute value of the gyro motion of the electronic device in the three directions, the greater the degree of shaking of the imaging device. Specifically, the absolute value thresholds of gyro motion in three directions can be preset, and according to the relationship between the obtained sum of absolute values of gyro motion in three directions and the preset threshold value, the threshold value of the imaging device can be determined. The current level of jitter.
举例来说，假设预设的阈值为第一阈值A、第二阈值B、第三阈值C，且A<B<C，当前获取到的在三个方向上gyro运动的绝对值之和为S。若S<A，则确定成像设备当前的抖动程度为“无抖动”；若A<S<B，则可以确定成像设备当前的抖动程度为“轻微抖动”；若B<S<C，则可以确定成像设备当前的抖动程度为“小抖动”；若S>C，则可以确定成像设备当前的抖动程度为“大抖动”。For example, assuming that the preset thresholds are the first threshold A, the second threshold B, and the third threshold C, and A<B<C, the sum of the absolute values of the currently acquired gyro motion in the three directions is S . If S<A, it is determined that the current shaking degree of the imaging device is "no shaking"; if A<S<B, it can be determined that the current shaking degree of the imaging device is "slight shaking"; if B<S<C, it can be It is determined that the current shaking degree of the imaging device is "small shaking"; if S>C, it can be determined that the current shaking degree of the imaging device is "large shaking".
需要说明的是，上述举例仅为示例性的，不能视为对本申请的限制。实际使用时，可以根据实际需要预设阈值的数量和各阈值的具体数值，以及根据gyro信息与各阈值的关系，预设gyro信息与成像设备抖动程度的映射关系。It should be noted that, the above examples are only exemplary and should not be regarded as limitations of the present application. In actual use, the number of thresholds and the specific value of each threshold can be preset according to actual needs, and the mapping relationship between gyro information and the degree of shaking of the imaging device can be preset according to the relationship between gyro information and each threshold.
作为另一种可能的实现方式，可通过确定成像设备的预览画面是够包含人脸，进而识别当前拍摄场景适用的夜景模式。As another possible implementation manner, the night scene mode applicable to the current shooting scene can be identified by determining whether the preview image of the imaging device contains enough faces.
在本申请实施例中，预览画面是否包含人脸可通过人脸识别技术来确定。人脸识别技术，是通过分析比较人脸视觉特征信息进行身份鉴别，它属于生物特征识别技术，是对生物体(一般特指人)本身的生物特征来区分生物体个体。目前，人脸识别技术已应用在众多领域当中，例如，数码相机人脸自动对焦和笑脸快门技术；企业、住宅安全和管理；门禁系统；摄像监视系统等。常用的人脸识别算法包括：基于人脸特征点的识别算法(Feature-based recognition algorithms)、基于整幅人脸图像的识别算法(Appearance-basedrecognition algorithms)、基于模板的识别算法(Template-based recognitionalgorithms)、利用神经网络进行识别的算法(Recognition algorithms using neuralnetwork)等等。In this embodiment of the present application, whether the preview image contains a human face may be determined by using a face recognition technology. The face recognition technology is to identify the identity by analyzing and comparing the visual feature information of the face. It belongs to the biometric recognition technology, which is to distinguish the biological characteristics of the organism (generally refers to the person) itself. At present, face recognition technology has been applied in many fields, such as digital camera face auto focus and smile shutter technology; enterprise, residential security and management; access control system; camera surveillance system, etc. Commonly used face recognition algorithms include: Feature-based recognition algorithms, Appearance-based recognition algorithms based on whole face images, Template-based recognition algorithms ), Recognition algorithms using neuralnetwork, etc.
需要说明的是，当检测到预览画面包含人脸时，成像设备的测光模块会自动以人脸区域为主进行测光，并根据人脸区域的测光结果确定基准曝光量。然而，在夜景场景中，人脸区域的光照度通常较低，从而导致确定的基准曝光量，与未包含人脸时确定的基准曝光量相比较高，若在包含人脸时仍然采集过多的过曝帧，则容易导致人脸区域过曝，从而导致采集图像的成像效果较差。因此，对于相同的抖动程度，预览画面中包含人脸与未包含人脸时相比，采用的夜景模式不相同。It should be noted that when it is detected that the preview image contains a human face, the light metering module of the imaging device will automatically perform light metering mainly on the face area, and determine the reference exposure amount according to the metering result of the face area. However, in night scenes, the illuminance of the face area is usually low, resulting in a determined baseline exposure that is higher than the baseline exposure determined when no faces are included. If faces are included, too many Over-exposed frames will easily lead to over-exposure of the face area, resulting in poor imaging effects of the captured images. Therefore, for the same degree of shaking, the night scene mode adopted is different when the preview screen contains human faces and does not contain human faces.
步骤204，根据夜景模式，确定各帧待采集图像预设的曝光补偿值。Step 204 , according to the night scene mode, determine a preset exposure compensation value of each frame of the image to be collected.
作为一种可能的实现方式，成像设备的抖动程度不同，适用当前拍摄场景的夜景模式也不相同，因此，确定出的各帧待采集的图像预设的曝光补偿值也不相同。在本申请实施例中，可以预设成像设备的抖动程度与曝光补偿值之间的映射关系，以根据成像设备的抖动程度，确定出当前各帧待采集的图像预设的曝光补偿值。As a possible implementation manner, the degree of shaking of the imaging device is different, and the night scene mode applicable to the current shooting scene is also different. Therefore, the determined preset exposure compensation values of each frame of the image to be collected are also different. In this embodiment of the present application, the mapping relationship between the degree of shaking of the imaging device and the exposure compensation value may be preset, so as to determine the preset exposure compensation value of each current frame of images to be collected according to the degree of shaking of the imaging device.
例如，可以将成像设备的抖动程度为“无抖动”时，各帧待采集的图像对应的曝光补偿值的EV值范围预设为-6～2，且相邻的EV值之间的差值为0.5；将成像设备的抖动程度为“轻微抖动”，各帧待采集的图像对应的曝光补偿值的EV值范围预设为-5～1，且相邻的EV值之间的差值为1，等等。For example, when the degree of shaking of the imaging device is "no shake", the EV value range of the exposure compensation value corresponding to each frame of images to be captured can be preset to -6 to 2, and the difference between adjacent EV values is 0.5; the degree of shaking of the imaging device is set to "slight shaking", the EV value range of the exposure compensation value corresponding to each frame of images to be captured is preset to -5 to 1, and the difference between adjacent EV values is 1, and so on.
作为另一种可能的实现形式，检测成像设备的预览画面是否包含人脸，预览画面中包含人脸与不包含人脸时，适用当前拍摄场景的夜景模式不相同，由此确定的各帧待采集图像预设的曝光补偿值也不相同。As another possible implementation form, it is detected whether the preview image of the imaging device contains human faces. When the preview image contains human faces and does not contain human faces, the night scene modes applicable to the current shooting scene are different. The exposure compensation values for the captured image presets are also different.
作为另一种可能的实现方式，对于相同的抖动程度，可以根据预览画面中是否包含人脸，确定各帧待采集图像采用不同的曝光补偿值。因此，对于相同的抖动程度，可以对应于多个曝光补偿值。比如，成像设备的抖动程度为“轻微抖动”，各帧待采集图像预设的曝光补偿值有包含人脸和不含人脸两种情况。As another possible implementation manner, for the same degree of shaking, it may be determined that each frame of images to be collected adopts different exposure compensation values according to whether the preview image contains a human face. Therefore, for the same degree of shaking, a plurality of exposure compensation values may correspond. For example, the degree of shaking of the imaging device is "slight shaking", and the preset exposure compensation value of each frame of images to be collected includes a face or does not contain a face.
在夜景模式中，当待采集图像中包含人脸时，人脸区域的光照强度通常较低，从而导致确定的基准曝光量，与未包含人脸时确定的基准曝光量相比较高，若在包含人脸时仍然采集过多的过曝帧，则容易导致人脸区域过曝，从而导致采集图像的成像效果较差，其对应的曝光补偿模式需要具有较低的曝光补偿范围。因此，对于相同的抖动程度，预览画面中包含人脸与未包含人脸时相比，在确定了成像设备当前的抖动程度，以及预览画面是否包含人脸之后，即可确定出与当前的实际情况相符的预设的曝光补偿值。In night scene mode, when a face is included in the image to be captured, the light intensity in the face area is usually low, resulting in a higher baseline exposure than the baseline exposure determined when no face is included. If too many overexposure frames are still collected when including faces, it is easy to cause overexposure of the face area, resulting in poor imaging effect of the collected images, and the corresponding exposure compensation mode needs to have a lower exposure compensation range. Therefore, for the same degree of shaking, compared with the case where the preview image contains a human face and does not contain a human face, after determining the current degree of shaking of the imaging device and whether the preview image contains a human face, it can be determined that the current actual The preset exposure compensation value that matches the situation.
本申请实施例的曝光控制方法，通过获取预览画面，根据预览画面的画面内容，确定当前拍摄场景属于夜景场景，根据成像设备的抖动程度和/或预览画面是否包含人脸，识别当前拍摄场景适用的夜景模式，进而，根据夜景模式，确定各帧待采集图像预设的曝光补偿值。由此，根据成像设备的抖动程度和/或预览画面是否包含人脸，确定该拍摄场景下的夜景模式，进而确定各帧待采集图像预设的曝光补偿值，进一步的用于确定各帧待采集图像的曝光时长，根据时长下限更新至少一帧待采集图像的曝光时长，最终根据更新后的各帧待采集图像的曝光时长和感光度，进行曝光控制，进而成像，不仅提升了夜景拍摄模式下拍摄图像的动态范围和整体亮度，而且有效抑制了拍摄图像中的噪声，提高了夜景拍摄图像的质量，改善了用户体验。The exposure control method of the embodiment of the present application determines that the current shooting scene belongs to the night scene scene by acquiring the preview screen and according to the screen content of the preview screen, and according to the degree of shaking of the imaging device and/or whether the preview screen contains a human face, it is suitable for identifying the current shooting scene. The night scene mode is selected, and further, according to the night scene mode, the preset exposure compensation value of each frame of images to be collected is determined. Thus, according to the degree of shaking of the imaging device and/or whether the preview screen contains a human face, the night scene mode in the shooting scene is determined, and then the preset exposure compensation value of each frame of images to be captured is determined, which is further used to determine each frame to be captured. The exposure duration of the captured images, update the exposure duration of at least one frame of images to be captured according to the lower limit of duration, and finally control the exposure according to the updated exposure duration and sensitivity of each frame of images to be captured, and then image, not only improves the night scene shooting mode It can improve the dynamic range and overall brightness of the captured image, effectively suppress the noise in the captured image, improve the quality of the captured image at night, and improve the user experience.
为了清楚说明上一实施例，本实施例提供了另一种曝光控制方法，图3为本申请实施例所提供的另一种曝光控制方法的流程示意图。In order to clearly illustrate the previous embodiment, this embodiment provides another exposure control method, and FIG. 3 is a schematic flowchart of another exposure control method provided by the embodiment of the present application.
如图3所示，该曝光控制方法可以包括以下步骤：As shown in Figure 3, the exposure control method may include the following steps:
步骤301，测光以确定各帧待采集图像的目标曝光量。
步骤302，根据各帧待采集图像的目标曝光量和各帧待采集图像预设的感光度，确定各帧待采集图像的曝光时长。Step 302: Determine the exposure duration of each frame of the to-be-captured image according to the target exposure amount of each frame of the to-be-captured image and the preset sensitivity of each frame of the to-be-captured image.
步骤303，若至少一帧待采集图像的曝光时长小于时长下限，根据时长下限，更新至少一帧待采集图像的曝光时长。
本申请实施例中，上述步骤301-303的具体实现过程及原理，如前述实施例中的步骤101-103中所述，在此不再赘述。In this embodiment of the present application, the specific implementation process and principle of the foregoing steps 301-303 are as described in the steps 101-103 in the foregoing embodiment, and details are not described herein again.
步骤304，对曝光时长大于时长上限的待采集图像，根据对应的目标曝光量和时长上限，更新感光度；以及根据时长上限，更新曝光时长大于时长上限的待采集图像的曝光时长。
其中，曝光时长上限，为预先设定的曝光时长值。The upper limit of the exposure duration is a preset exposure duration value.
具体地，对于曝光时长大于时长上限的待采集图像，将待采集图像的曝光时长设定为时长上限，由于曝光量为感光度与曝光时长的乘积，因此，根据对应的目标曝光量和时长上限，更新待采集图像的感光度为目标曝光量与时长上限之间的比值。Specifically, for an image to be collected whose exposure duration is greater than the upper limit of the duration, the exposure duration of the image to be collected is set as the upper limit of the duration. Since the exposure is the product of the sensitivity and the exposure duration, according to the corresponding target exposure and upper limit , and update the sensitivity of the image to be collected as the ratio between the target exposure amount and the upper limit of the duration.
需要说明的是，待采集图像的曝光时长大于时长上限时，如果采用该曝光时长进行曝光，由于曝光时长过长会导致画面抖动，因此将曝光时长大于时长上限的待采集图像的曝光时长更新为时长上限。It should be noted that when the exposure duration of the image to be captured is greater than the upper limit of the duration, if the exposure duration is used for exposure, the image will shake if the exposure duration is too long. Therefore, the exposure duration of the image to be captured whose exposure duration is longer than the upper limit of the duration is updated to Time limit.
步骤305，对曝光时长大于或等于时长下限的其余各帧待采集图像，根据比值，更新其余各帧待采集图像的感光度。
具体地，对于曝光时长大于或等于时长下限的其余各帧待采集图像，首先确定小于时长下限的待采集图像更新后的曝光时长与更新前的曝光时长之间的比值，再将该比值与其余各帧待采集图像更新前的感光度或曝光时长乘积，作为其余各帧待采集图像更新后的感光度或曝光时长。Specifically, for the remaining frames of images to be collected whose exposure duration is greater than or equal to the lower limit of the duration, first determine the ratio between the exposure duration after updating and the exposure duration before the update for the images to be captured that are less than the lower limit of duration, and then compare the ratio with the remaining exposure duration. The product of the sensitivity or exposure duration of each frame of images to be captured before updating is used as the sensitivity or exposure duration of the remaining frames to be captured after being updated.
作为一种示例，假如曝光时长大于或等于时长下限的待采集图像为4帧，根据成像设备的抖动程度确定各帧预设的感光度值均为100ISO，且4帧待采集图像的曝光时长分别为100ms、200ms、400ms和800ms。鉴于小于时长下限的待采集图像更新后的曝光时长与更新前的曝光时长之间的比值为10ms/1.5ms，即20/3，由此，确定这4帧待采集图像的曝光时长扩大为原来100ms、200ms、400ms和800ms的20/3倍。As an example, if there are 4 frames of images to be captured whose exposure duration is greater than or equal to the lower limit of the duration, it is determined that the preset sensitivity value of each frame is 100 ISO according to the degree of shaking of the imaging device, and the exposure durations of the 4 frames of images to be captured are respectively 100ms, 200ms, 400ms and 800ms. Considering that the ratio between the exposure duration after updating and the exposure duration before the update of the images to be captured that is less than the lower limit of duration is 10ms/1.5ms, that is, 20/3, therefore, it is determined that the exposure durations of the four frames to be captured are expanded to the original ones. 20/3 times of 100ms, 200ms, 400ms and 800ms.
对感光度的更新方式与曝光时长的更新方式类似，仅需要将曝光时长替换为感光度即可，但需要注意的是，仅可根据前述小于时长下限的待采集图像更新后的曝光时长与更新前的曝光时长之间的比值，更新曝光时长和感光度中的一个，若需要对曝光时长和感光度同时更新，则需要依权重对该比值进行分配后，进行更新。例如：对曝光时长和感光度各占一半权重，若前述小于时长下限的待采集图像更新后的曝光时长与更新前的曝光时长之间的比值为R，将曝光时长扩大为原来的R/2倍，将感光度扩大为原来的R/2倍。The update method of the sensitivity is similar to the update method of the exposure duration. It is only necessary to replace the exposure duration with the sensitivity. However, it should be noted that the exposure duration and update can only be updated according to the above-mentioned images to be collected that are less than the lower limit of the duration. The ratio between the previous exposure durations, and one of the exposure duration and the sensitivity is updated. If the exposure duration and the sensitivity need to be updated at the same time, the ratio needs to be allocated according to the weight, and then updated. For example, the exposure duration and the sensitivity are each given half of the weight. If the ratio between the updated exposure duration and the exposure duration before the update of the to-be-captured image that is less than the lower limit of duration is R, the exposure duration will be expanded to the original R/2 times, the sensitivity is enlarged to the original R/2 times.
步骤306，根据各帧待采集图像的曝光时长和感光度，进行曝光控制。In
本申请实施例中，成像设备可以根据确定的各帧待采集图像的曝光时长和感光度，进行曝光控制，进而成像。In the embodiment of the present application, the imaging device may perform exposure control according to the determined exposure duration and sensitivity of each frame of the image to be collected, and then perform imaging.
本申请实施例的曝光控制方法，通过测光以确定各帧待采集图像的目标曝光量；根据各帧待采集图像的目标曝光量和各帧待采集图像预设的感光度，确定各帧待采集图像的曝光时长，若至少一帧待采集图像的曝光时长小于时长下限，根据时长下限，更新至少一帧待采集图像的曝光时长；对曝光时长大于时长上限的待采集图像，根据对应的目标曝光量和时长上限，更新感光度；以及根据时长上限，更新曝光时长大于时长上限的待采集图像的曝光时长，最终根据各帧待采集图像的曝光时长和感光度，进行曝光控制。由此，通过根据成像设备的抖动程度和当前拍摄场景的环境光亮度，确定了各帧待采集图像的曝光时长，进而根据曝光时长下限与时长上限更新各帧待采集图像的感光度，最终根据更新后的各帧待采集图像的曝光时长和感光度，进行曝光控制，进而成像，不仅提升了夜景拍摄模式下拍摄图像的动态范围和整体亮度，而且有效抑制了拍摄图像中的噪声，提高了夜景拍摄图像的质量，改善了用户体验。In the exposure control method of the embodiment of the present application, the target exposure amount of each frame of images to be collected is determined by photometry; The exposure duration of the captured image, if the exposure duration of at least one frame of the image to be captured is less than the lower limit of the duration, update the exposure duration of at least one frame of the image to be captured according to the lower duration limit; for images to be captured whose exposure duration is greater than the upper limit of the duration, the corresponding target The exposure amount and the upper limit of the duration, update the sensitivity; and according to the upper limit of the duration, update the exposure duration of the to-be-captured images whose exposure duration is greater than the upper limit of the duration, and finally perform exposure control according to the exposure duration and sensitivity of each frame of the to-be-captured image. In this way, the exposure duration of each frame of the image to be captured is determined according to the degree of shaking of the imaging device and the ambient light brightness of the current shooting scene, and then the sensitivity of each frame of the image to be captured is updated according to the lower limit and upper limit of the exposure duration, and finally according to After updating the exposure duration and sensitivity of the images to be captured in each frame, exposure control is performed, and then imaging is performed, which not only improves the dynamic range and overall brightness of the images captured in the night scene shooting mode, but also effectively suppresses the noise in the captured images. The quality of the night shot images improves the user experience.
为了实现上述实施例，本申请还提出一种曝光控制装置。In order to realize the above embodiments, the present application also proposes an exposure control device.
图4为本申请实施例提供的一种曝光控制装置的结构示意图。FIG. 4 is a schematic structural diagram of an exposure control device according to an embodiment of the present application.
如图4所示，该曝光控制装置100包括：测光模块110、确定模块120、更新模块130以及控制模块140。As shown in FIG. 4 , the exposure control apparatus 100 includes: a photometric module 110 , a determination module 120 , an update module 130 and a control module 140 .
测光模块110，用于测光以确定各帧待采集图像的目标曝光量。The light metering module 110 is used for light metering to determine the target exposure of each frame of images to be collected.
确定模块120，用于根据各帧待采集图像的目标曝光量和各帧待采集图像预设的感光度，确定各帧待采集图像的曝光时长。The determining module 120 is configured to determine the exposure duration of each frame of the to-be-captured image according to the target exposure of each frame of the to-be-captured image and the preset sensitivity of each frame of the to-be-captured image.
更新模块130，用于若至少一帧待采集图像的曝光时长小于时长下限，根据时长下限，更新至少一帧待采集图像的曝光时长。其中，时长下限大于或等于10ms。The updating module 130 is configured to update the exposure duration of the at least one frame of the image to be captured according to the lower limit of the duration if the exposure duration of the at least one frame of the image to be captured is less than the lower duration limit. The lower limit of the duration is greater than or equal to 10ms.
控制模块140，用于根据各帧待采集图像的曝光时长和感光度，进行曝光控制。The control module 140 is configured to perform exposure control according to the exposure duration and sensitivity of each frame of images to be collected.
作为另一种可能的实现方式，该曝光控制装置100，还包括：As another possible implementation manner, the exposure control device 100 further includes:
第一确定模块，用于根据抖动程度，确定各帧待采集图像所述预设的感光度。The first determining module is configured to determine the preset sensitivity of each frame of images to be collected according to the degree of shaking.
作为另一种可能的实现方式，第一确定模块，还可以具体用于As another possible implementation manner, the first determining module may also be specifically used for
从成像设备设置的传感器，获取采集到的位移信息；Obtain the collected displacement information from the sensor set by the imaging device;
根据位移信息，确定成像设备的抖动程度；According to the displacement information, determine the degree of shaking of the imaging device;
若抖动程度大于或等于抖动阈值，确定预设的感光度取值为第一感光值；If the degree of shaking is greater than or equal to the shaking threshold, determine that the preset sensitivity value is the first sensitivity value;
若抖动程度小于抖动阈值，确定预设的感光度取值为第二感光值；其中，第一感光值大于第二感光值。If the degree of shaking is less than the shaking threshold, it is determined that the preset sensitivity value is the second sensitivity value; wherein the first sensitivity value is greater than the second sensitivity value.
其中，第一感光值为第二感光值的预设倍数，并且预设倍数取值大于等于2；第二感光值为成像设备的最小感光度。Wherein, the first sensitivity value is a preset multiple of the second sensitivity value, and the preset multiple value is greater than or equal to 2; the second sensitivity value is the minimum sensitivity of the imaging device.
作为另一种可能的实现方式，测光模块110，还可以具体用于：As another possible implementation manner, the light metering module 110 can also be specifically used for:
根据预览图像的亮度信息，确定基准曝光量；基准曝光量包括基准曝光时长和基准感光度；According to the brightness information of the preview image, the reference exposure amount is determined; the reference exposure amount includes the reference exposure duration and the reference sensitivity;
根据基准曝光量和各帧待采集图像预设的曝光补偿值，确定各帧待采集图像的目标曝光量。According to the reference exposure amount and the preset exposure compensation value of each frame of the to-be-captured image, the target exposure of each frame of the to-be-captured image is determined.
作为另一种可能的实现方式，测光模块110，还包括：As another possible implementation manner, the light metering module 110 further includes:
获取单元，用于获取预览画面。The acquisition unit is used to acquire the preview screen.
第一确定单元，用于根据预览画面的画面内容，确定当前拍摄场景属于夜景场景。The first determining unit is configured to determine that the current shooting scene belongs to the night scene scene according to the screen content of the preview screen.
识别单元，用于根据成像设备的抖动程度和/或预览画面是否包含人脸，识别当前拍摄场景适用的夜景模式。The identification unit is configured to identify the night scene mode applicable to the current shooting scene according to the degree of shaking of the imaging device and/or whether the preview image contains a human face.
第二确定单元，根据夜景模式，确定各帧待采集图像预设的曝光补偿值。The second determining unit determines, according to the night scene mode, a preset exposure compensation value of each frame of images to be collected.
作为另一种可能的实现方式，该曝光控制装置100，还包括：As another possible implementation manner, the exposure control device 100 further includes:
第二确定模块，用于确定至少一帧待采集图像更新后的曝光时长与更新前的曝光时长之间的比值。The second determination module is configured to determine the ratio between the exposure duration after the update of the at least one frame of the image to be collected and the exposure duration before the update.
第一更新模块，用于对曝光时长大于或等于时长下限的其余各帧待采集图像，根据比值，更新其余各帧待采集图像的感光度或曝光时长。The first updating module is used for updating the sensitivity or exposure duration of the remaining frames of the images to be collected according to the ratio of the remaining frames whose exposure duration is greater than or equal to the lower limit of the duration.
作为另一种可能的实现方式，第一更新模块，还用于：As another possible implementation, the first update module is also used to:
将比值与其余各帧待采集图像更新前的感光度乘积，作为其余各帧待采集图像更新后的感光度。The product of the ratio and the sensitivities of the remaining frames to be collected before updating is taken as the updated sensitivities of the remaining frames to be collected.
或者，将比值与其余各帧待采集图像更新前的曝光时长乘积，作为其余各帧待采集图像更新后的曝光时长。Alternatively, the product of the ratio and the exposure durations of the remaining frames to be collected before updating is used as the exposure durations of the remaining frames after the images to be collected are updated.
作为另一种可能的实现方式，该曝光控制装置100，还包括：As another possible implementation manner, the exposure control device 100 further includes:
第二更新模块，用于对曝光时长大于时长上限的待采集图像，根据对应的目标曝光量和时长上限，更新感光度；以及The second update module is configured to update the sensitivity according to the corresponding target exposure amount and the upper limit of the duration of the images to be collected whose exposure duration is greater than the duration upper limit; and
根据时长上限，更新曝光时长大于时长上限的待采集图像的曝光时长。According to the upper limit of the duration, the exposure duration of the images to be collected whose exposure duration is greater than the upper limit of the duration is updated.
本申请实施例的曝光控制装置，通过测光以确定各帧待采集图像的目标曝光量；根据各帧待采集图像的目标曝光量和各帧待采集图像预设的感光度，确定各帧待采集图像的曝光时长，若至少一帧待采集图像的曝光时长小于时长下限，根据时长下限，更新至少一帧待采集图像的曝光时长，最终根据各帧待采集图像的曝光时长和感光度，进行曝光控制。由此，通过根据成像设备的抖动程度和当前拍摄场景的环境光亮度，确定了各帧待采集图像的曝光时长，进而根据时长下限更新至少一帧待采集图像的曝光时长，最终根据更新后的各帧待采集图像的曝光时长和感光度，进行曝光控制，进而成像，不仅提升了夜景拍摄模式下拍摄图像的动态范围和整体亮度，而且有效抑制了拍摄图像中的噪声，提高了夜景拍摄图像的质量，改善了用户体验。In the exposure control device of the embodiment of the present application, the target exposure amount of each frame of images to be collected is determined by photometry; The exposure duration of the captured image, if the exposure duration of at least one frame of the image to be captured is less than the lower limit of the duration, update the exposure duration of at least one frame of the image to be captured according to the lower duration limit, and finally perform the process according to the exposure duration and sensitivity of each frame of the image to be captured. Exposure control. In this way, the exposure duration of each frame of images to be captured is determined according to the degree of shaking of the imaging device and the ambient light brightness of the current shooting scene, and then the exposure duration of at least one frame of images to be captured is updated according to the lower limit of the duration, and finally according to the updated The exposure time and sensitivity of each frame of the image to be collected are controlled for exposure and then imaging, which not only improves the dynamic range and overall brightness of the image captured in the night scene shooting mode, but also effectively suppresses the noise in the captured image, improving the night scene shooting image. quality, improving the user experience.
需要说明的是，前述对曝光控制方法实施例的解释说明也适用于该实施例的曝光控制装置，此处不再赘述。It should be noted that, the foregoing explanations of the embodiment of the exposure control method are also applicable to the exposure control device of this embodiment, and are not repeated here.
为了实现上述实施例，本申请实施例还提供了一种计算机可读存储介质。一个或多个包含计算机可执行指令的非易失性计算机可读存储介质，当所述计算机可执行指令被一个或多个处理器执行时，使得所述处理器执行以下步骤：In order to implement the above embodiments, the embodiments of the present application further provide a computer-readable storage medium. One or more non-volatile computer-readable storage media containing computer-executable instructions that, when executed by one or more processors, cause the processors to perform the following steps:
测光以确定各帧待采集图像的目标曝光量；Metering to determine the target exposure for each frame of images to be captured;
根据各帧待采集图像的目标曝光量和各帧待采集图像预设的感光度，确定各帧待采集图像的曝光时长；Determine the exposure duration of each frame of the to-be-captured image according to the target exposure of each frame of the to-be-captured image and the preset sensitivity of each frame of the to-be-captured image;
若至少一帧待采集图像的曝光时长小于时长下限，根据所述至少一帧待采集图像的目标曝光量和所述时长下限，更新所述至少一帧待采集图像的感光度，以及根据所述时长下限，更新所述至少一帧待采集图像的曝光时长；If the exposure duration of the at least one frame of the image to be captured is less than the lower limit of the duration, update the sensitivity of the at least one frame of the image to be captured according to the target exposure amount of the at least one frame of the image to be captured and the lower duration limit, and according to the The lower limit of the duration, updating the exposure duration of the at least one frame of the image to be collected;
根据各帧待采集图像的曝光时长和感光度，进行曝光控制。Exposure control is performed according to the exposure duration and sensitivity of each frame of images to be collected.
为了实现上述实施例，本申请还提出一种电子设备，包括：存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序，所述处理器执行所述程序时，实现如上述实施例所述的曝光控制方法。In order to implement the above embodiments, the present application also proposes an electronic device, including: a memory, a processor, and a computer program stored in the memory and running on the processor, when the processor executes the program, the above-mentioned computer program is implemented. The exposure control method described in the embodiment.
请参阅图5，本申请还提供另一种电子设备200。电子设备200包括存储器50和处理器60。存储器50中存储有计算机可读指令。计算机可读指令被存储器50执行时，使得处理器60执行上述任一实施方式的曝光控制方法。Referring to FIG. 5 , the present application further provides another
图5为一个实施例中电子设备200的内部结构示意图。该电子设备200包括通过系统总线81连接的处理器60、存储器50(例如为非易失性存储介质)、内存储器82、显示屏83和输入装置84。其中，电子设备200的存储器50存储有操作系统和计算机可读指令。该计算机可读指令可被处理器60执行，以实现本申请实施方式的曝光控制方法。该处理器60用于提供计算和控制能力，支撑整个电子设备200的运行。电子设备200的内存储器50为存储器52中的计算机可读指令的运行提供环境。电子设备200的显示屏83可以是液晶显示屏或者电子墨水显示屏等，输入装置84可以是显示屏83上覆盖的触摸层，也可以是电子设备200外壳上设置的按键、轨迹球或触控板，也可以是外接的键盘、触控板或鼠标等。该电子设备200可以是手机、平板电脑、笔记本电脑、个人数字助理或穿戴式设备(例如智能手环、智能手表、智能头盔、智能眼镜)等。本领域技术人员可以理解，图5中示出的结构，仅仅是与本申请方案相关的部分结构的示意图，并不构成对本申请方案所应用于其上的电子设备200的限定，具体的电子设备200可以包括比图中所示更多或更少的部件，或者组合某些部件，或者具有不同的部件布置。FIG. 5 is a schematic diagram of the internal structure of the
请参阅图6，本申请实施例的电子设备200中包括图像处理电路90，图像处理电路90可利用硬件和/或软件组件实现，包括定义ISP(Image Signal Processing，图像信号处理)管线的各种处理单元。图6为一个实施例中图像处理电路90的示意图。如图6所示，为便于说明，仅示出与本申请实施例相关的图像处理技术的各个方面。Referring to FIG. 6, the
如图6所示，图像处理电路90包括ISP处理器91(ISP处理器91可为处理器60)和控制逻辑器92。摄像头93捕捉的图像数据首先由ISP处理器91处理，ISP处理器91对图像数据进行分析以捕捉可用于确定摄像头93的一个或多个控制参数的图像统计信息。摄像头93可包括一个或多个透镜932和图像传感器934。图像传感器934可包括色彩滤镜阵列(如Bayer滤镜)，图像传感器934可获取每个成像像素捕捉的光强度和波长信息，并提供可由ISP处理器91处理的一组原始图像数据。传感器94(如陀螺仪)可基于传感器94接口类型把采集的图像处理的参数(如防抖参数)提供给ISP处理器91。传感器94接口可以为SMIA(StandardMobile Imaging Architecture，标准移动成像架构)接口、其它串行或并行照相机接口或上述接口的组合。As shown in FIG. 6 , the image processing circuit 90 includes an ISP processor 91 (the ISP processor 91 may be the processor 60 ) and a control logic 92 . Image data captured by camera 93 is first processed by ISP processor 91 , which analyzes the image data to capture image statistics that can be used to determine one or more control parameters of camera 93 . Camera 93 may include one or more lenses 932 and image sensor 934 . Image sensor 934 , which may include an array of color filters (eg, Bayer filters), may obtain light intensity and wavelength information captured by each imaging pixel and provide a set of raw image data that may be processed by ISP processor 91 . The sensor 94 (eg, a gyroscope) may provide the acquired image processing parameters (eg, anti-shake parameters) to the ISP processor 91 based on the sensor 94 interface type. The sensor 94 interface may be an SMIA (Standard Mobile Imaging Architecture) interface, other serial or parallel camera interfaces, or a combination of the above interfaces.
此外，图像传感器934也可将原始图像数据发送给传感器94，传感器94可基于传感器94接口类型把原始图像数据提供给ISP处理器91，或者传感器94将原始图像数据存储到图像存储器95中。In addition, image sensor 934 may also send raw image data to sensor 94, which may provide raw image data to ISP processor 91 based on sensor 94 interface type, or sensor 94 may store raw image data in image memory 95.
ISP处理器91按多种格式逐个像素地处理原始图像数据。例如，每个图像像素可具有8、10、12或14比特的位深度，ISP处理器91可对原始图像数据进行一个或多个图像处理操作、收集关于图像数据的统计信息。其中，图像处理操作可按相同或不同的位深度精度进行。The ISP processor 91 processes raw image data pixel by pixel in various formats. For example, each image pixel may have a bit depth of 8, 10, 12, or 14 bits, and the ISP processor 91 may perform one or more image processing operations on the raw image data, collecting statistical information about the image data. Among them, the image processing operations can be performed with the same or different bit depth precision.
ISP处理器91还可从图像存储器95接收图像数据。例如，传感器94接口将原始图像数据发送给图像存储器95，图像存储器95中的原始图像数据再提供给ISP处理器91以供处理。图像存储器95可为存储器50、存储器50的一部分、存储设备、或电子设备内的独立的专用存储器，并可包括DMA(Direct Memory Access，直接直接存储器存取)特征。ISP processor 91 may also receive image data from image memory 95 . For example, the sensor 94 interface sends the raw image data to the image memory 95, and the raw image data in the image memory 95 is provided to the ISP processor 91 for processing. The image memory 95 may be the
当接收到来自图像传感器934接口或来自传感器94接口或来自图像存储器95的原始图像数据时，ISP处理器91可进行一个或多个图像处理操作，如时域滤波。处理后的图像数据可发送给图像存储器95，以便在被显示之前进行另外的处理。ISP处理器91从图像存储器95接收处理数据，并对处理数据进行原始域中以及RGB和YCbCr颜色空间中的图像数据处理。ISP处理器91处理后的图像数据可输出给显示器97(显示器97可包括显示屏83)，以供用户观看和/或由图形引擎或GPU(Graphics Processing Unit，图形处理器)进一步处理。此外，ISP处理器91的输出还可发送给图像存储器95，且显示器97可从图像存储器95读取图像数据。在一个实施例中，图像存储器95可被配置为实现一个或多个帧缓冲器。此外，ISP处理器91的输出可发送给编码器/解码器96，以便编码/解码图像数据。编码的图像数据可被保存，并在显示于显示器97设备上之前解压缩。编码器/解码器96可由CPU或GPU或协处理器实现。When receiving raw image data from the image sensor 934 interface or from the sensor 94 interface or from the image memory 95, the ISP processor 91 may perform one or more image processing operations, such as temporal filtering. The processed image data may be sent to image memory 95 for additional processing before being displayed. The ISP processor 91 receives the processed data from the image memory 95 and performs image data processing in the original domain and in the RGB and YCbCr color spaces on the processed data. The image data processed by the ISP processor 91 may be output to a display 97 (the display 97 may include a display screen 83 ) for viewing by a user and/or further processing by a graphics engine or a GPU (Graphics Processing Unit). In addition, the output of the ISP processor 91 can also be sent to the image memory 95, and the display 97 can read the image data from the image memory 95. In one embodiment, image memory 95 may be configured to implement one or more frame buffers. In addition, the output of ISP processor 91 may be sent to encoder/decoder 96 for encoding/decoding image data. The encoded image data can be saved and decompressed prior to display on the display 97 device. The encoder/decoder 96 may be implemented by a CPU or GPU or a co-processor.
ISP处理器91确定的统计数据可发送给控制逻辑器92单元。例如，统计数据可包括自动曝光、自动白平衡、自动聚焦、闪烁检测、黑电平补偿、透镜932阴影校正等图像传感器934统计信息。控制逻辑器92可包括执行一个或多个例程(如固件)的处理元件和/或微控制器，一个或多个例程可根据接收的统计数据，确定摄像头93的控制参数及ISP处理器91的控制参数。例如，摄像头93的控制参数可包括传感器94控制参数(例如增益、曝光控制的积分时间、防抖参数等)、照相机闪光控制参数、透镜932控制参数(例如聚焦或变焦用焦距)、或这些参数的组合。ISP控制参数可包括用于自动白平衡和颜色调整(例如，在RGB处理期间)的增益水平和色彩校正矩阵，以及透镜932阴影校正参数。Statistics determined by the ISP processor 91 may be sent to the control logic 92 unit. For example, the statistics may include image sensor 934 statistics such as auto exposure, auto white balance, auto focus, flicker detection, black level compensation, lens 932 shading correction, and the like. Control logic 92 may include a processing element and/or a microcontroller that executes one or more routines (eg, firmware) that may determine control parameters for camera 93 and an ISP processor based on received statistics 91 control parameters. For example, camera 93 control parameters may include sensor 94 control parameters (eg, gain, integration time for exposure control, stabilization parameters, etc.), camera flash control parameters, lens 932 control parameters (eg, focal length for focusing or zooming), or these parameters The combination. ISP control parameters may include gain levels and color correction matrices for automatic white balance and color adjustment (eg, during RGB processing), and lens 932 shading correction parameters.
以下为运用图6中图像处理技术实现曝光控制方法的步骤：The following are the steps of using the image processing technology in FIG. 6 to realize the exposure control method:
测光以确定各帧待采集图像的目标曝光量；Metering to determine the target exposure for each frame of images to be captured;
根据各帧待采集图像的目标曝光量和各帧待采集图像预设的感光度，确定各帧待采集图像的曝光时长；Determine the exposure duration of each frame of the to-be-captured image according to the target exposure of each frame of the to-be-captured image and the preset sensitivity of each frame of the to-be-captured image;
若至少一帧待采集图像的曝光时长小于时长下限，根据所述至少一帧待采集图像的目标曝光量和所述时长下限，更新所述至少一帧待采集图像的感光度，以及根据所述时长下限，更新所述至少一帧待采集图像的曝光时长；If the exposure duration of the at least one frame of the image to be captured is less than the lower limit of the duration, update the sensitivity of the at least one frame of the image to be captured according to the target exposure amount of the at least one frame of the image to be captured and the lower duration limit, and according to the The lower limit of the duration, updating the exposure duration of the at least one frame of the image to be collected;
根据各帧待采集图像的曝光时长和感光度，进行曝光控制。Exposure control is performed according to the exposure duration and sensitivity of each frame of images to be collected.
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程，是可以通过计算机程序来指令相关的硬件来完成，所述的程序可存储于一非易失性计算机可读取存储介质中，该程序在执行时，可包括如上述各方法的实施例的流程。其中，所述的存储介质可为磁碟、光盘、只读存储记忆体(Read-Only Memory，ROM)等。Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be implemented by instructing relevant hardware through a computer program, and the program can be stored in a non-volatile computer-readable storage medium , when the program is executed, it may include the flow of the above-mentioned method embodiments. The storage medium may be a magnetic disk, an optical disk, a read-only memory (Read-Only Memory, ROM), or the like.
以上所述实施例仅表达了本发明的几种实施方式，其描述较为具体和详细，但并不能因此而理解为对本发明专利范围的限制。应当指出的是，对于本领域的普通技术人员来说，在不脱离本发明构思的前提下，还可以做出若干变形和改进，这些都属于本发明的保护范围。因此，本发明专利的保护范围应以所附权利要求为准。The above-mentioned embodiments only represent several embodiments of the present invention, and the descriptions thereof are specific and detailed, but should not be construed as a limitation on the scope of the patent of the present invention. It should be pointed out that for those of ordinary skill in the art, without departing from the concept of the present invention, several modifications and improvements can also be made, which all belong to the protection scope of the present invention. Therefore, the protection scope of the patent of the present invention should be subject to the appended claims.
Claims (11)
Translated fromChinesePriority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810963320.5ACN108900782B (en) | 2018-08-22 | 2018-08-22 | Exposure control method, device, and electronic device |
| PCT/CN2019/090627WO2020038074A1 (en) | 2018-08-22 | 2019-06-11 | Exposure control method and apparatus, and electronic device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810963320.5ACN108900782B (en) | 2018-08-22 | 2018-08-22 | Exposure control method, device, and electronic device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108900782A CN108900782A (en) | 2018-11-27 |
| CN108900782Btrue CN108900782B (en) | 2020-01-24 |
Family
ID=64358327
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810963320.5AExpired - Fee RelatedCN108900782B (en) | 2018-08-22 | 2018-08-22 | Exposure control method, device, and electronic device |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN108900782B (en) |
| WO (1) | WO2020038074A1 (en) |
Families Citing this family (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108900782B (en)* | 2018-08-22 | 2020-01-24 | Oppo广东移动通信有限公司 | Exposure control method, device, and electronic device |
| CN109547703B (en)* | 2018-12-28 | 2021-04-13 | 北京旷视科技有限公司 | Shooting method and device of camera equipment, electronic equipment and medium |
| CN111435971B (en)* | 2019-01-15 | 2022-04-08 | 阿里巴巴集团控股有限公司 | Image acquisition parameter configuration method and device, terminal and readable storage medium |
| CN109756681A (en)* | 2019-01-30 | 2019-05-14 | Oppo广东移动通信有限公司 | Image synthesis method, apparatus, electronic device and readable storage medium |
| CN109788207B (en)* | 2019-01-30 | 2021-03-23 | Oppo广东移动通信有限公司 | Image synthesis method and device, electronic equipment and readable storage medium |
| CN109756680B (en)* | 2019-01-30 | 2021-05-14 | Oppo广东移动通信有限公司 | Image synthesis method, apparatus, electronic device and readable storage medium |
| CN109919116B (en)* | 2019-03-14 | 2022-05-17 | Oppo广东移动通信有限公司 | Scene recognition method, device, electronic device and storage medium |
| CN111757015B (en)* | 2019-03-28 | 2021-12-03 | 杭州海康威视数字技术股份有限公司 | Exposure control method and device and electronic equipment |
| CN110072052B (en)* | 2019-04-09 | 2021-08-27 | Oppo广东移动通信有限公司 | Image processing method and device based on multi-frame image and electronic equipment |
| CN110142972B (en)* | 2019-05-06 | 2021-08-06 | 上海天马微电子有限公司 | 3D printing method and 3D printing device |
| CN110166711B (en)* | 2019-06-13 | 2021-07-13 | Oppo广东移动通信有限公司 | Image processing method, device, electronic device, and storage medium |
| CN110166709B (en)* | 2019-06-13 | 2022-03-18 | Oppo广东移动通信有限公司 | Night scene image processing method and device, electronic equipment and storage medium |
| CN110113539A (en)* | 2019-06-13 | 2019-08-09 | Oppo广东移动通信有限公司 | Exposure control method, exposure control device, electronic apparatus, and storage medium |
| CN111866390B (en)* | 2020-07-29 | 2022-09-30 | 浙江立元科技有限公司 | Image shooting control method and device, computer equipment and storage medium |
| CN116437222B (en)* | 2021-12-29 | 2024-04-19 | 荣耀终端有限公司 | Image processing method and electronic device |
| CN115297269B (en)* | 2022-09-27 | 2023-04-07 | 荣耀终端有限公司 | Exposure parameter determination method and electronic equipment |
| CN116485660B (en)* | 2022-11-22 | 2023-11-17 | 北京迁移科技有限公司 | Image acquisition method and three-dimensional reconstruction method |
| CN117119318B (en)* | 2023-02-20 | 2024-08-20 | 荣耀终端有限公司 | Image processing method and device |
| CN116704934A (en)* | 2023-06-09 | 2023-09-05 | 维沃移动通信有限公司 | Image display method, device, electronic device and readable storage medium |
| CN117252886B (en)* | 2023-09-11 | 2024-11-05 | 广东源恒软件科技有限公司 | Invoice identification method and system based on image segmentation |
| CN119233098B (en)* | 2024-11-29 | 2025-03-18 | 浙江大华技术股份有限公司 | Image acquisition method, camera, computer device, and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101359148A (en)* | 2007-08-03 | 2009-02-04 | 深圳艾科创新微电子有限公司 | Method for automatic exposure regulation and control system |
| CN107071292A (en)* | 2017-03-10 | 2017-08-18 | 深圳市金立通信设备有限公司 | A kind of light compensation method and terminal |
| CN108419025A (en)* | 2018-05-30 | 2018-08-17 | 北京图森未来科技有限公司 | A method, device and readable medium for adjusting exposure parameters |
| CN108419026A (en)* | 2018-05-31 | 2018-08-17 | 歌尔股份有限公司 | Camera exposure time adjustment method, device and equipment |
Family Cites Families (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101261422B (en)* | 2007-03-08 | 2010-04-14 | 亚洲光学股份有限公司 | Automatic Exposure Correction Method and System |
| CN101729665B (en)* | 2009-12-11 | 2013-10-02 | 惠州Tcl移动通信有限公司 | Camera cellphone with tremble prevention function and tremble prevention method in photographing process thereof |
| US9143679B2 (en)* | 2012-01-26 | 2015-09-22 | Canon Kabushiki Kaisha | Electronic apparatus, electronic apparatus control method, and storage medium |
| CN103841324A (en)* | 2014-02-20 | 2014-06-04 | 小米科技有限责任公司 | Shooting processing method and device and terminal device |
| US9204048B2 (en)* | 2014-03-27 | 2015-12-01 | Facebook, Inc. | Stabilization of low-light video |
| CN105450936B (en)* | 2014-05-30 | 2019-02-15 | 杭州海康威视数字技术股份有限公司 | Intelligent adjusting method and its device when video camera automatic exposure |
| CN105306830B (en)* | 2015-12-08 | 2018-05-29 | 广东欧珀移动通信有限公司 | A kind of camera control method and device |
| CN105635597B (en)* | 2015-12-21 | 2018-07-27 | 湖北工业大学 | The automatic explosion method and system of in-vehicle camera |
| CN106657805A (en)* | 2017-01-13 | 2017-05-10 | 广东欧珀移动通信有限公司 | Shooting method in motion and mobile terminal |
| CN108419022A (en)* | 2018-03-06 | 2018-08-17 | 广东欧珀移动通信有限公司 | Control method, control device, computer-readable storage medium, and computer apparatus |
| CN108900782B (en)* | 2018-08-22 | 2020-01-24 | Oppo广东移动通信有限公司 | Exposure control method, device, and electronic device |
- 2018
- 2018-08-22CNCN201810963320.5Apatent/CN108900782B/ennot_activeExpired - Fee Related
- 2019
- 2019-06-11WOPCT/CN2019/090627patent/WO2020038074A1/ennot_activeCeased
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101359148A (en)* | 2007-08-03 | 2009-02-04 | 深圳艾科创新微电子有限公司 | Method for automatic exposure regulation and control system |
| CN107071292A (en)* | 2017-03-10 | 2017-08-18 | 深圳市金立通信设备有限公司 | A kind of light compensation method and terminal |
| CN108419025A (en)* | 2018-05-30 | 2018-08-17 | 北京图森未来科技有限公司 | A method, device and readable medium for adjusting exposure parameters |
| CN108419026A (en)* | 2018-05-31 | 2018-08-17 | 歌尔股份有限公司 | Camera exposure time adjustment method, device and equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2020038074A1 (en) | 2020-02-27 |
| CN108900782A (en) | 2018-11-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108900782B (en) | Exposure control method, device, and electronic device | |
| JP7371081B2 (en) | Night view photography methods, devices, electronic devices and storage media | |
| CN109788207B (en) | Image synthesis method and device, electronic equipment and readable storage medium | |
| CN109151333B (en) | Exposure control method, exposure control device and electronic equipment | |
| CN110072051B (en) | Image processing method and device based on multi-frame images | |
| CN110072052B (en) | Image processing method and device based on multi-frame image and electronic equipment | |
| CN109194882B (en) | Image processing method, image processing device, electronic equipment and storage medium | |
| CN109005369B (en) | Exposure control method, exposure control device, electronic apparatus, and computer-readable storage medium | |
| CN110166708B (en) | Night scene image processing method and device, electronic equipment and storage medium | |
| CN110290289A (en) | Image noise reduction method and device, electronic equipment and storage medium | |
| CN110166707B (en) | Image processing method, device, electronic device, and storage medium | |
| CN109348088B (en) | Image noise reduction method and device, electronic equipment and computer readable storage medium | |
| CN110191291B (en) | Image processing method and device based on multi-frame images | |
| WO2020034737A1 (en) | Imaging control method, apparatus, electronic device, and computer-readable storage medium | |
| WO2020038087A1 (en) | Method and apparatus for photographic control in super night scene mode and electronic device | |
| CN110264420B (en) | Image processing method and device based on multi-frame images | |
| CN110166706B (en) | Image processing method, image processing apparatus, electronic device, and storage medium | |
| WO2020207261A1 (en) | Image processing method and apparatus based on multiple frames of images, and electronic device | |
| CN110248106A (en) | Image noise reduction method, device, electronic device and storage medium | |
| CN109756680B (en) | Image synthesis method, apparatus, electronic device and readable storage medium | |
| CN110166709A (en) | Night scene image processing method and device, electronic equipment and storage medium | |
| CN110113539A (en) | Exposure control method, exposure control device, electronic apparatus, and storage medium | |
| HK40001704B (en) | Exposure control method and device and electronic equipment | |
| HK40001704A (en) | Exposure control method and device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | Granted publication date:20200124 | |
| CF01 | Termination of patent right due to non-payment of annual fee |