CN106851097A - A kind of terminal device and its depth of field control method - Google Patents

Abstract

Translated fromChinese

本发明公开了一种终端设备及其景深控制方法，所述景深控制方法包括：A、设置一设备类型来注册用于辅助景深效果的光感器；B、生成节点文件并将预设的环境光亮度范围保存至节点文件中；C、光感器检测当前的环境光亮度值，判断环境光亮度值在环境光亮度范围时执行景深算法。本发明通过使用一个光感器来替代现有技术中增加的相机来进行物体遮挡检测，无需使用支持双ISP通道的CPU，从而降低了终端设备的CPU成本和软件复杂度，减小了双ISP数据处理对系统造成的较高负载，提高了景深运行速度和效果。

The present invention discloses a terminal device and its depth-of-field control method. The depth-of-field control method includes: A. setting a device type to register a light sensor for assisting the depth-of-field effect; B. generating a node file and setting the preset environment The brightness range is saved to the node file; C. The light sensor detects the current ambient brightness value, and executes the depth-of-field algorithm when judging that the ambient brightness value is within the ambient brightness range. The present invention uses a light sensor to replace the camera added in the prior art to perform object occlusion detection, without using a CPU supporting dual ISP channels, thereby reducing the CPU cost and software complexity of the terminal device, and reducing the number of dual ISPs. The higher load on the system caused by data processing improves the speed and effect of depth-of-field operation.

Description

Translated fromChinese

一种终端设备及其景深控制方法A terminal device and its depth-of-field control method

技术领域technical field

本发明涉及终端设备技术领域，特别涉及一种终端设备及其景深控制方法。The present invention relates to the technical field of terminal equipment, in particular to a terminal equipment and a method for controlling the depth of field thereof.

背景技术Background technique

目前手机也能拍出景深效果。所谓景深，就是当焦距对准某一点时，其前后都仍可清晰的范围；它能决定是把背景模糊化来突出拍摄对象，还是拍出清晰的背景。现有技术中需要在手机内设置两个后置camera（相机），即在现有一个后置camera的基础上增加一个新的后置camera来检测是否有物体遮挡，根据遮挡情况来判断是否启动景深虚化效果。由于这两个后置camera需同时工作，这样对手机的CPU（Central Processing Unit，中央处理单元）有一定要求，即CPU必须能支持双ISP（Image Signal Processor，图像处理器）通道，这样成本较高且导致软件复杂度明显增加。同时，双ISP数据处理对系统造成较高负载，应用景深算法后使系统运行速度较慢。At present, mobile phones can also take pictures with depth of field effects. The so-called depth of field is when the focus is on a certain point, the front and back are still clear; it can decide whether to blur the background to highlight the subject, or to take a clear background. In the prior art, two rear cameras (cameras) need to be installed in the mobile phone, that is, a new rear camera is added on the basis of the existing rear camera to detect whether there is an object occlusion, and judge whether to start it according to the occlusion situation. Depth of field blur effect. Since these two rear cameras need to work at the same time, there are certain requirements for the CPU (Central Processing Unit, central processing unit) of the mobile phone, that is, the CPU must be able to support dual ISP (Image Signal Processor, image processor) channels, so the cost is relatively low. High and lead to a significant increase in software complexity. At the same time, the dual ISP data processing causes a high load on the system, and the application of the depth of field algorithm makes the system run at a slower speed.

因而现有技术还有待改进和提高。Thereby prior art still needs to improve and improve.

发明内容Contents of the invention

鉴于上述现有技术的不足之处，本发明的目的在于提供一种终端设备及其景深控制方法，以解决现有终端设备采用支持双ISP通道的CPU实现景深效果导致成本较高、系统运行速度较慢的问题。In view of the shortcomings of the above-mentioned prior art, the purpose of the present invention is to provide a terminal device and its depth-of-field control method to solve the problem of high cost and low system operating speed caused by the existing terminal device adopting a CPU supporting dual ISP channels to achieve the depth-of-field effect. slower problem.

为了达到上述目的，本发明采取了以下技术方案：In order to achieve the above object, the present invention has taken the following technical solutions:

一种终端设备的景深控制方法，其包括：A method for controlling depth of field of a terminal device, comprising:

步骤A、设置一设备类型来注册用于辅助景深效果的光感器；Step A, set a device type to register the light sensor used to assist the depth of field effect;

步骤B、生成节点文件并将预设的环境光亮度范围保存至节点文件中；Step B, generating a node file and saving the preset ambient light brightness range into the node file;

步骤C、光感器检测当前的环境光亮度值，判断环境光亮度值在环境光亮度范围时执行景深算法。Step C, the light sensor detects the current ambient light brightness value, and executes the depth-of-field algorithm when it is judged that the ambient light brightness value is within the ambient light brightness range.

所述的终端设备的景深控制方法中，在所述步骤A中，注册用于辅助景深效果的光感器的设备类型为misc device ，系统已设置的默认光感器的设备类型为android alsdevice。In the method for controlling the depth of field of the terminal device, in the step A, the device type of the light sensor registered to assist the depth of field effect is misc device, and the device type of the default light sensor set by the system is android alsdevice.

所述的终端设备的景深控制方法中，所述步骤B具体包括：In the method for controlling the depth of field of the terminal device, the step B specifically includes:

步骤B1、生成节点文件并对相应模块设置读取访问该节点文件的权限；Step B1, generating a node file and setting the permission to read and access the node file for the corresponding module;

步骤B2、封装show store读写，将环境光亮度范围保存至节点文件中。Step B2, encapsulating the read and write of the show store, and saving the ambient light brightness range to the node file.

所述的终端设备的景深控制方法中，所述步骤C具体包括：In the method for controlling the depth of field of the terminal device, the step C specifically includes:

步骤C1、检测景深效果被启动时，开启光感器检测当前的环境光亮度值；Step C1, when the effect of detecting the depth of field is activated, turn on the light sensor to detect the current ambient light brightness value;

步骤C2、读取节点文件中的预设的环境光亮度范围；；Step C2, reading the preset ambient light brightness range in the node file;

步骤C3、判断环境光亮度值是否在环境光亮度范围内：是则执行景深算法，进行景深虚化处理；否则提示无法启动虚化效果，是否执行相机效果。Step C3. Determine whether the ambient light brightness value is within the ambient light brightness range: if yes, execute the depth-of-field algorithm to perform depth-of-field blur processing; otherwise, prompt that the blur effect cannot be activated, and whether to execute the camera effect.

所述的终端设备的景深控制方法中，所述步骤C3中，提示无法启动虚化效果，是否执行相机效果的步骤之后，还包括：In the method for controlling the depth of field of the terminal device, in the step C3, after prompting that the blur effect cannot be started, and whether to perform the camera effect, it also includes:

步骤C31、当检测选择不执行相机效果时，控制光感器再次检测当前的环境光亮度值；Step C31, when the detection option is not to execute the camera effect, control the light sensor to detect the current ambient light brightness value again;

步骤C32、返回所述步骤C2。Step C32, return to the step C2.

一种实现所述的景深控制方法的终端设备，其包括光感器、设置模块、节点模块和处理模块；A terminal device for implementing the depth-of-field control method, which includes a photosensor, a setting module, a node module, and a processing module;

所述设置模块设置一设备类型来注册用于辅助景深效果的光感器，节点模块生成节点文件并将预设的环境光亮度范围保存至节点文件中，光感器检测当前的环境光亮度值，处理模块判断环境光亮度值在环境光亮度范围时执行景深算法。The setting module sets a device type to register the light sensor used to assist the depth of field effect, the node module generates a node file and saves the preset ambient light brightness range to the node file, and the light sensor detects the current ambient light brightness value , the processing module executes the depth-of-field algorithm when judging that the ambient light brightness value is within the ambient light brightness range.

所述的终端设备中，所述光感器为光线传感器或环境光传感器。In the terminal device, the light sensor is a light sensor or an ambient light sensor.

相较于现有技术，本发明提供的终端设备及其景深控制方法，通过设置一设备类型来注册用于辅助景深效果的光感器；生成节点文件并将预设的环境光亮度范围保存至节点文件中；光感器检测当前的环境光亮度值，判断环境光亮度值在环境光亮度范围时执行景深算法。通过使用一个光感器来替代现有技术中增加的相机来进行物体遮挡检测，无需使用支持双ISP通道的CPU，从而降低了终端设备的CPU成本和软件复杂度，减小了双ISP数据处理对系统造成的较高负载，提高了景深运行速度和效果。Compared with the prior art, the terminal device and its depth-of-field control method provided by the present invention register a light sensor used to assist the depth-of-field effect by setting a device type; generate a node file and save the preset ambient light brightness range to In the node file; the light sensor detects the current ambient light brightness value, and executes the depth-of-field algorithm when the ambient light brightness value is judged to be within the ambient light brightness range. By using a light sensor to replace the camera added in the prior art for object occlusion detection, there is no need to use a CPU that supports dual ISP channels, thereby reducing the CPU cost and software complexity of the terminal device, and reducing the dual ISP data processing The higher load on the system improves the speed and effect of depth of field operation.

附图说明Description of drawings

图1为本发明提供的终端设备的景深控制方法流程图。FIG. 1 is a flowchart of a method for controlling depth of field of a terminal device provided by the present invention.

图2为本发明提供的终端设备的结构框图。Fig. 2 is a structural block diagram of a terminal device provided by the present invention.

具体实施方式detailed description

本发明提供一种终端设备及其景深控制方法，通过使用一个光感器来替代新增的camera进行物体遮挡检测，从而降低终端设备的CPU成本，提高景深运行速度和效果。为使本发明的目的、技术方案及效果更加清楚、明确，以下参照附图并举实施例对本发明进一步详细说明。应当理解，此处所描述的具体实施例仅用以解释本发明，并不用于限定本发明。The present invention provides a terminal device and a depth-of-field control method thereof. By using a light sensor instead of a newly added camera for object occlusion detection, the CPU cost of the terminal device is reduced, and the operating speed and effect of the depth-of-field are improved. In order to make the object, technical solution and effect of the present invention more clear and definite, the present invention will be further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

请参阅图1，本发明提供的终端设备的景深控制方法包括：Please refer to FIG. 1, the method for controlling the depth of field of a terminal device provided by the present invention includes:

S100、设置一设备类型来注册用于辅助景深效果的光感器；S100. Set a device type to register a light sensor for assisting the depth of field effect;

S200、生成节点文件并将预设的环境光亮度范围保存至节点文件中；S200. Generate a node file and save the preset ambient light brightness range into the node file;

S300、光感器检测当前的环境光亮度值，判断环境光亮度值在环境光亮度范围时执行景深算法。S300. The light sensor detects the current ambient light brightness value, and executes a depth-of-field algorithm when it is judged that the ambient light brightness value is within the ambient light brightness range.

基于现有的具有拍照功能的系统（如android ）架构只有一个标准的光感器设备类型，被设置的光感器（现有技术中通常为光线传感器）所占用。为进行区分，已设置的光感器也叫默认光感器。本实施例若增加一个光感器，则会占用默认光感器的设备类型，影响默认光感器的使用。为了能同时驱动两个光感器，本实施例在步骤S100中设置一个新的设备类型来注册增加的用于辅助景深效果的光感器。这样每个光感器都有对应的设备类型，两者使用时就不会相互影响或冲突。Based on the architecture of the existing system with camera function (such as android), there is only one standard light sensor device type, which is occupied by the set light sensor (usually a light sensor in the prior art). For distinction, the photosensor that has been set is also called the default photosensor. In this embodiment, if a light sensor is added, the device type of the default light sensor will be occupied, which will affect the use of the default light sensor. In order to drive two light sensors at the same time, this embodiment sets a new device type in step S100 to register the added light sensor used to assist the depth of field effect. In this way, each light sensor has a corresponding device type, and the two will not affect or conflict with each other when used.

所述设备类型为内核建立一个统一的设备模型，从而又一个对系统结构的一般性抽象描述。换句话说，Linux设备模型提取了设备操作的共同属性，进行抽象，并将这部分共同的属性在内核中实现，而为需要新添加设备或驱动提供一般性的统一接口。The device type establishes a unified device model for the kernel, thereby providing a general abstract description of the system structure. In other words, the Linux device model extracts the common attributes of device operations, abstracts them, and implements these common attributes in the kernel, and provides a general unified interface for newly added devices or drivers.

在所述步骤S100中，通过Kernel（操作系统内核）注册辅助的光感器的设备类型为misc device ，系统已有的默认光感器的设备类型为标准 android als device。In the step S100, the device type of the auxiliary light sensor registered through the Kernel (operating system kernel) is misc device, and the device type of the default light sensor existing in the system is the standard android als device.

之后，在所述步骤S200中，生成linux sys节点文件(/sys/bus/platform/drivers/als_ps1/als) 并对相应模块设置读取访问该节点文件的权限，可通过linuxkernel标准的sys节点文件(/sys/bus/platform/drivers/als_ps1/als)给camera app提供读取访问功能。然后封装show store读写、即通过show store 封装实现读写接口将实际的环境光亮度范围保存至节点文件（/sys/bus/platform/drivers/als_ps1/als）中。Afterwards, in the step S200, generate the linux sys node file (/sys/bus/platform/drivers/als_ps1/als) and set the authority to read and access the node file for the corresponding module, which can be passed through the sys node file of the linuxkernel standard (/sys/bus/platform/drivers/als_ps1/als) provides read access to the camera app. Then encapsulate the show store to read and write, that is, realize the read and write interface through the show store encapsulation, and save the actual ambient light brightness range to the node file (/sys/bus/platform/drivers/als_ps1/als).

在所述步骤S300中，camera app（应用） 在判断是否允许执行景深算法时，即检测景深效果被用户启动时，开启光感器检测当前的环境光亮度值，判断环境光亮度值是在一个合理的范围内。即读取节点文件中的预设的环境光亮度范围（如5~2048），并判断环境光亮度值是否在环境光亮度范围内，是才执行景深算法，进行景深虚化处理。In the step S300, when the camera app (application) judges whether to allow the execution of the depth of field algorithm, that is, when the effect of detecting the depth of field is activated by the user, it turns on the light sensor to detect the current ambient light brightness value, and judges that the ambient light brightness value is within a within a reasonable range. That is to read the preset ambient light brightness range (such as 5~2048) in the node file, and judge whether the ambient light brightness value is within the ambient light brightness range, and then execute the depth-of-field algorithm to perform depth-of-field blurring.

若不在环境光亮度范围内，如小于5则认为光感器被遮挡，camera app给出提示，光感器被遮挡无法启动虚化效果，是否执行普通的相机效果。若用户需要执行普通的相机效果，则选择是。若用户仍需要执行景深算法，则选择否。当检测选择不执行相机效果时，终端设备会再次控制光感器检测当前的环境光亮度值，继续判断能否进行景深算法。If it is not within the range of ambient light brightness, if it is less than 5, it is considered that the light sensor is blocked, and the camera app will give a prompt that the light sensor is blocked and the blur effect cannot be activated. Whether to perform ordinary camera effects. Select Yes if the user needs to perform normal camera effects. If the user still needs to execute the depth-of-field algorithm, select No. When the detection option is not to implement the camera effect, the terminal device will control the light sensor to detect the current ambient light brightness value again, and continue to judge whether the depth of field algorithm can be performed.

需要理解的是，不同的结构装配（如光感器的位置不同和材质不同，会影响透光率和进光的强度）会影响节点文件中存储的环境光亮度范围。因此，对于不同的结构装配，需要调整环境光亮度范围来适配产品。It should be understood that different structural assemblies (such as different positions and materials of light sensors, which will affect the light transmittance and the intensity of incoming light) will affect the range of ambient light brightness stored in the node file. Therefore, for different structural assemblies, the ambient light brightness range needs to be adjusted to suit the product.

基于上述的终端设备的景深控制方法，本发明实施例还提供一种景深控制方法的终端设备，请参阅图2，所述终端设备包括光感器10、设置模块20、节点模块30和处理模块40；所述光感器10连接设置模块20和处理模块40，处理模块40连接设置模块20和节点模块30。所述设置模块20设置一设备类型来注册用于辅助景深效果的光感器10。节点模块30生成节点文件并将预设的环境光亮度范围保存至节点文件中。光感器10检测当前的环境光亮度值并传输给处理模块40。处理模块40从节点模块30中读取环境光亮度范围，并判断环境光亮度值在环境光亮度范围时执行景深算法。Based on the above-mentioned depth-of-field control method for a terminal device, an embodiment of the present invention also provides a terminal device for a depth-of-field control method, please refer to FIG. 2 , the terminal device includes a photosensor 10, a setting module 20, a node module 30 and a processing module 40 ; the photosensor 10 is connected to the setting module 20 and the processing module 40 , and the processing module 40 is connected to the setting module 20 and the node module 30 . The setting module 20 sets a device type to register the light sensor 10 for assisting the depth of field effect. The node module 30 generates a node file and saves the preset ambient light brightness range into the node file. The light sensor 10 detects the current ambient light brightness value and transmits it to the processing module 40 . The processing module 40 reads the ambient light brightness range from the node module 30, and executes the depth-of-field algorithm when it determines that the ambient light brightness value is within the ambient light brightness range.

需要理解的是，上述设置模块20、节点模块30和处理模块40是在终端设备中安装camera app（应用）后对应产生的模块。光感器10可采用光线传感器或环境光传感器等器件。处理模块40根据设置模块20中的设备类型来区分增加的光感器和默认光感器。It should be understood that the above setting module 20, node module 30 and processing module 40 are corresponding modules generated after the camera app (application) is installed in the terminal device. The light sensor 10 can be a light sensor or an ambient light sensor and other devices. The processing module 40 distinguishes the added light sensor and the default light sensor according to the device type in the setting module 20 .

综上所述，本发明通过使用一个光线传感器或环境光传感器替代现有技术中的后置camera来实现景深方案，无需使用支持双ISP通道的CPU，从而降低了终端设备的CPU成本和软件复杂度，减小了双ISP数据处理对系统造成的较高负载，提高了景深运行速度和效果。In summary, the present invention realizes the depth-of-field solution by replacing the rear camera in the prior art with a light sensor or ambient light sensor, without using a CPU supporting dual ISP channels, thereby reducing the CPU cost and software complexity of the terminal device It reduces the high load on the system caused by dual ISP data processing, and improves the speed and effect of depth of field operation.

上述功能模块的划分仅用以举例说明，在实际应用中，可以根据需要将上述功能分配由不同的功能模块来完成，即划分成不同的功能模块，来完成上述描述的全部或部分功能。The division of the above functional modules is only for illustration. In practical applications, the above function allocation can be completed by different functional modules according to the needs, that is, divided into different functional modules to complete all or part of the functions described above.

可以理解的是，对本领域普通技术人员来说，可以根据本发明的技术方案及其发明构思加以等同替换或改变，而所有这些改变或替换都应属于本发明所附的权利要求的保护范围。It can be understood that those skilled in the art can make equivalent replacements or changes according to the technical solutions and inventive concepts of the present invention, and all these changes or replacements should belong to the protection scope of the appended claims of the present invention.

Claims (7)

1. the depth of field control method of a kind of terminal device, it is characterised in that including：

Step A, a device type is set registers the optical flame detector for aiding in Deep Canvas；

Step B, generation node file are simultaneously preserved into node file default environmental light brightness scope；

Step C, optical flame detector detect current environment bright angle value, judge that environment bright angle value is performed in environmental light brightness scopeDepth of field algorithm.

2. the depth of field control method of terminal device according to claim 1, it is characterised in that in the step A, registrationDevice type for aiding in the optical flame detector of Deep Canvas is misc device, the equipment of the acquiescence optical flame detector that system has been setType is android als device.

3. the depth of field control method of terminal device according to claim 1, it is characterised in that the step B is specifically included：

Step B1, the authority for generating node file and the read access node file being set to corresponding module；

Step B2, encapsulation show store read-writes, environmental light brightness scope is preserved into node file.

4. the depth of field control method of terminal device according to claim 1, it is characterised in that the step C is specifically included：

When step C1, detection Deep Canvas are activated, open optical flame detector and detect current environment bright angle value；

Step C2, the default environmental light brightness scope read in node file；；

Step C3, judge environment bright angle value whether in the range of environmental light brightness：It is then to perform depth of field algorithm, carries out the depth of field emptyChange is processed；Otherwise prompting cannot start virtualization effect, if perform camera effect.

5. the depth of field control method of terminal device according to claim 4, it is characterised in that in the step C3, points outVirtualization effect cannot be started, if after the step of performing camera effect, also include：

Step C31, when detection selection do not perform camera effect when, control optical flame detector detect current environment bright angle value again；

Step C32, the return step C2.

6. a kind of terminal device of the depth of field control method realized described in claim 1, it is characterised in that including optical flame detector, setPut module, node module and processing module；

The setup module sets a device type to register the optical flame detector for aiding in Deep Canvas, node module generation nodeFile is simultaneously preserved into node file default environmental light brightness scope, and optical flame detector detects current environment bright angle value, placeReason module judges that environment bright angle value performs depth of field algorithm in environmental light brightness scope.

7. terminal device according to claim 6, it is characterised in that the optical flame detector is that light sensor or ambient light are passedSensor.