技术领域technical field
本申请主张以在2014年5月21日提出申请的日本专利申请特愿2014-105383为基础的优先权，并将该基础申请的内容全部援引至本申请。This application claims priority based on Japanese Patent Application Japanese Patent Application No. 2014-105383 for which it applied on May 21, 2014, and uses all the content of this basic application for this application.
本发明涉及检测装置以及检测方法。The invention relates to a detection device and a detection method.
背景技术Background technique
一直以来为了从摄像图像中检测物体的移动而使用摄像图像的亮度信息的技术被广泛使用。然而，存在仅使用摄像图像的亮度信息会造成误识别的情况，为了防止误识别来提高精度，公开了一种如同日本特开平9-186988号公报所记载的技术那样的、基于亮度的变化和色相的变化的两者来进行检测的技术。Conventionally, a technique of using luminance information of a captured image in order to detect movement of an object from the captured image has been widely used. However, there are cases where misrecognition is caused by using only brightness information of a captured image. In order to prevent misrecognition and improve accuracy, a technique based on changes in brightness and A technology that detects both changes in hue.
但是，始终计算亮度的变化和色相的变化这两者的处理负荷高，因此存在对摄像图像中的物体的移动进行的检测耗时这样的问题。另外，在像从室内移动至室外的情况那样，拍摄条件变化较大，因此还存在不能以相同的检测条件来适当地进行物体的移动的检测这样的另一问题。However, since the processing load of always calculating both the change in brightness and the change in hue is high, there is a problem that it takes time to detect the movement of an object in a captured image. In addition, as in the case of moving from indoors to outdoors, imaging conditions change greatly, and therefore there is another problem that the movement of an object cannot be appropriately detected under the same detection conditions.
发明内容Contents of the invention
本发明鉴于这样的状况而提出，其目的在于，在摄像图像中更适当地检测物体的移动。The present invention has been made in view of such a situation, and an object of the present invention is to more appropriately detect movement of an object in a captured image.
本发明的第1观点所涉及的检测装置从摄像图像中检测给定的物体的移动，具备：获取部，其从由摄像部以帧为单位所连续摄像的所述摄像图像中获取与亮度有关的亮度信息以及与颜色有关的颜色信息；判别部，其基于获取到的所述亮度信息以及所述颜色信息，判别是使用所述亮度信息以及所述颜色信息当中的一方还是双方来检测所述给定的物体的移动；和检测部，其基于判别出的结果，使用所述亮度信息以及所述颜色信息当中的一方或者双方，来检测所述给定的物体的移动。The detection device according to the first aspect of the present invention detects the movement of a given object from a captured image, and includes an acquisition unit that acquires information related to brightness from the captured images continuously captured by the imaging unit in units of frames. luminance information and color information related to the color; and a judging unit that judges, based on the acquired luminance information and the color information, whether to use one or both of the luminance information and the color information to detect the a movement of a predetermined object; and a detection unit that detects the movement of the predetermined object by using one or both of the luminance information and the color information based on a result of discrimination.
本发明的第2观点所涉及的检测装置从摄像图像中检测给定的物体的移动，具备：获取部，其从由摄像部以帧为单位所连续摄像的所述摄像图像中获取与亮度有关的亮度信息；检测阈值设置部，其设置与所述亮度信息相关的检测亮度阈值；检测部，其使用已设置的所述检测亮度阈值、以及所获取的所述亮度信息来检测所述给定的物体的移动；和重新设置控制部，其在满足给定的条件的情况下，使所述检测阈值设置部执行所述检测亮度阈值的重新设置。The detection device according to the second aspect of the present invention detects the movement of a given object from a captured image, and includes an acquisition unit that acquires information related to brightness from the captured images continuously captured by the imaging unit in units of frames. luminance information; a detection threshold setting section, which sets a detection luminance threshold related to the luminance information; a detection section, which uses the set detection luminance threshold and the acquired luminance information to detect the given movement of the object; and a resetting control section that causes the detection threshold setting section to perform resetting of the detection luminance threshold when a given condition is satisfied.
本发明的第3观点所涉及的检测方法由从摄像图像中检测给定的物体的移动的检测装置执行，包含：获取处理，从由摄像部以帧为单位所连续摄像的所述摄像图像中获取与亮度有关的亮度信息以及与颜色有关的颜色信息；判别处理，基于获取到的所述亮度信息以及所述颜色信息，判别是使用所述亮度信息以及所述颜色信息当中的一方还是双方来检测所述给定的物体的移动；和检测处理，基于判别出的结果，使用所述亮度信息以及所述颜色信息当中的一方或者双方，来检测所述给定的物体的移动。The detection method according to the third aspect of the present invention is performed by a detection device that detects the movement of a given object from captured images, and includes: acquisition processing, from the captured images continuously captured by the imaging unit in units of frames Acquiring brightness information related to brightness and color information related to color; determining whether to use one or both of the brightness information and the color information based on the acquired brightness information and the color information detecting movement of the given object; and detection processing of detecting movement of the given object using one or both of the luminance information and the color information based on a result of discrimination.
本发明的第4观点所涉及的检测方法由从摄像图像中检测给定的物体的移动的检测装置执行，包含：获取处理，从由摄像部以帧为单位所连续摄像的所述摄像图像中获取与亮度有关的亮度信息；检测阈值设置处理，设置与所述亮度信息相关的检测亮度阈值；检测处理，使用已设置的所述检测亮度阈值、以及所获取的所述亮度信息来检测所述给定的物体的移动；和重新设置控制处理，在满足给定的条件的情况下，执行所述检测亮度阈值的重新设置。The detection method according to the fourth aspect of the present invention is performed by a detection device that detects the movement of a given object from captured images, and includes: acquisition processing, from the captured images continuously captured by the imaging unit in units of frames Acquiring brightness information related to brightness; detection threshold setting processing, setting a detection brightness threshold related to the brightness information; detection processing, using the set detection brightness threshold and the acquired brightness information to detect the The movement of the given object; and reset control processing, in the case of satisfying the given condition, execute the reset of the detection brightness threshold.
关于上述和进一步的说明以及本发明的新颖性的特征，通过阅读以下结合附图所进行的详细描述将会更加清楚。但应该明确地理解，这些附图只是为了说明的目的，不能定义本发明的技术范围。The foregoing and further descriptions and novel features of the present invention will become more apparent upon reading the following detailed description in conjunction with the accompanying drawings. However, it should be clearly understood that these drawings are for illustrative purposes only and cannot define the technical scope of the present invention.
附图说明Description of drawings
若结合以下的附图来思考下面的描述，会对本发明有更深的理解。If the following description is considered in conjunction with the following drawings, the present invention will be better understood.
图1是表示本发明的一实施方式所涉及的检测装置的硬件的构成的框图。FIG. 1 is a block diagram showing a hardware configuration of a detection device according to an embodiment of the present invention.
图2是表示图1的检测装置的功能性构成当中用于执行运动快门拍摄处理的功能性构成的功能框图。FIG. 2 is a functional block diagram showing a functional configuration for performing motion shutter imaging processing among the functional configurations of the detection device of FIG. 1 .
图3A是表示在摄像图像中设置有检测区域的状态的示意图，是表示检测区域的亮度分量中难以出现差值的图。3A is a schematic diagram showing a state where a detection area is provided in a captured image, and is a diagram showing that a difference hardly occurs in luminance components of the detection area.
图3B是表示在摄像图像中设置了检测区域的状态的示意图，是表示检测区域的色差分量中难以出现差值的图。FIG. 3B is a schematic diagram showing a state where a detection area is set in a captured image, and is a diagram showing that a difference hardly occurs in color difference components of the detection area.
图4是表示具有图2的功能性构成的图1的检测装置所执行的运动快门拍摄处理的流程的流程图。FIG. 4 is a flowchart showing the flow of motion shutter imaging processing executed by the detection device of FIG. 1 having the functional configuration of FIG. 2 .
图5是表示作为运动快门拍摄处理的子流程而被执行的阈值设置处理的流程的流程图。5 is a flowchart showing the flow of threshold value setting processing executed as a subroutine of the motion shutter shooting processing.
图6是表示作为运动快门拍摄处理的子流程而被执行的检测方法判别处理的流程的流程图。FIG. 6 is a flowchart showing the flow of detection method determination processing executed as a subroutine of the moving shutter imaging processing.
图7是表示作为运动快门拍摄处理的子流程而被执行的检测处理的流程的流程图。FIG. 7 is a flowchart showing the flow of detection processing executed as a subroutine of the motion shutter imaging processing.
具体实施方式Detailed ways
以下，使用附图来说明本发明的实施方式。Embodiments of the present invention will be described below using the drawings.
图1是表示本发明的一实施方式所涉及的检测装置的硬件的构成的框图。FIG. 1 is a block diagram showing a hardware configuration of a detection device according to an embodiment of the present invention.
检测装置1例如作为数码相机而构成。The detection device 1 is configured as a digital camera, for example.
检测装置1具备：CPU(CentralProcessingUnit)11、ROM(ReadOnlyMemory)12、RAM(RandomAccessMemory)13、总线14、输入输出接口15、摄像部16、传感器部17、输入部18、输出部19、存储部20、通信部21以及驱动器22。The detection device 1 includes: a CPU (Central Processing Unit) 11, a ROM (ReadOnlyMemory) 12, a RAM (RandomAccessMemory) 13, a bus 14, an input/output interface 15, an imaging unit 16, a sensor unit 17, an input unit 18, an output unit 19, and a storage unit 20 , the communication unit 21 and the driver 22 .
CPU11遵照ROM12中所记录的程序或从存储部20加载至RAM13的程序来执行各种处理。CPU 11 executes various processes in accordance with programs recorded in ROM 12 or programs loaded from storage unit 20 to RAM 13 .
在RAM13中还酌情存储CPU11执行各种处理所需的数据等。Data and the like necessary for the CPU 11 to execute various processes are also stored in the RAM 13 as appropriate.
CPU11、ROM12以及RAM13经由总线14而相互连接。该总线1另外还连接着输入输出接口15。在输入输出接口15，连接有：摄像部16、传感器部17、输入部18、输出部19、存储部20、通信部21以及驱动器22。CPU 11 , ROM 12 , and RAM 13 are connected to each other via bus 14 . The bus 1 is also connected to an input/output interface 15 . An imaging unit 16 , a sensor unit 17 , an input unit 18 , an output unit 19 , a storage unit 20 , a communication unit 21 , and a driver 22 are connected to the input/output interface 15 .
摄像部16具备未图示的光学透镜部以及图像传感器。The imaging unit 16 includes an optical lens unit and an image sensor, not shown.
光学透镜部由为了拍摄被摄体而汇聚光的透镜、例如聚焦透镜、变焦透镜等构成。The optical lens unit is composed of a lens that condenses light to capture a subject, for example, a focus lens, a zoom lens, and the like.
聚焦透镜是使被摄体像成像于图像传感器的受光面的透镜。变焦透镜是使焦距在一定的范围内自由变化的透镜。The focus lens is a lens that forms a subject image on the light-receiving surface of the image sensor. A zoom lens is a lens that can freely change the focal length within a certain range.
还根据需要在光学透镜部设置对焦点、曝光、白平衡等的设置参数进行调整的周边电路。Peripheral circuits for adjusting setting parameters such as focusing point, exposure, and white balance are also provided in the optical lens part as required.
图像传感器由光电变换元件、AFE(AnalogFrontEnd，模拟前端)等构成。The image sensor is composed of a photoelectric conversion element, an AFE (Analog Front End, analog front end), and the like.
光电变换元件例如由CMOS(ComplementaryMetalOxideSemiconductor，互补金属氧化物半导体)型的光电变换元件等构成。被摄体像从光学透镜部入射至光电变换元件。为此，光电变换元件对被摄体像进行光电变换(摄像)并将图像信号蓄存一段时间，且将蓄存的图像信号作为模拟信号而依次提供给AFE。The photoelectric conversion element is constituted by, for example, a CMOS (Complementary Metal Oxide Semiconductor, Complementary Metal Oxide Semiconductor) type photoelectric conversion element or the like. The subject image enters the photoelectric conversion element from the optical lens unit. For this purpose, the photoelectric conversion element performs photoelectric conversion (imaging) of the subject image, stores the image signal for a certain period of time, and sequentially supplies the stored image signal as an analog signal to the AFE.
AFE对该模拟的图像信号执行A/D(模拟/数字)变换处理等各种信号处理。通过各种信号处理来生成数字信号，并作为摄像部16的输出信号而输出。The AFE performs various signal processing such as A/D (analog/digital) conversion processing on the analog image signal. A digital signal is generated through various signal processing, and is output as an output signal of the imaging unit 16 .
以下，将这样的摄像部16的输出信号称为“摄像图像”。摄像图像是用于后述的运动检测的图像，作为实时取景图像或者记录用的图像等而被获取，并被适当提供给CPU11等。Hereinafter, such an output signal of the imaging unit 16 is referred to as a "captured image". The captured image is an image used for motion detection described later, is acquired as a live view image, an image for recording, or the like, and is provided to the CPU 11 or the like as appropriate.
传感器部17对检测装置1的相对位置、角度进行测量。在本实施方式中，传感器部17包含由GPS接收装置构成的位置传感器、3轴加速度传感器等的各种传感器。The sensor unit 17 measures the relative position and angle of the detection device 1 . In the present embodiment, the sensor unit 17 includes various sensors such as a position sensor including a GPS receiver, a triaxial acceleration sensor, and the like.
输入部18由麦克风或各种按钮等构成，根据用户的操作来输入声音、信息等。The input unit 18 is constituted by a microphone, various buttons, etc., and inputs voice, information, and the like in accordance with user operations.
输出部19由显示器、扬声器等构成，输出图像、声音。The output unit 19 is composed of a display, a speaker, and the like, and outputs images and sounds.
存储部20由硬盘或者DRAM(DynamicRandomAccessMemory)等构成，存储各种图像的数据。The storage unit 20 is composed of a hard disk, DRAM (Dynamic Random Access Memory), or the like, and stores various image data.
通信部21对经由包含因特网在内的网络而与其他的装置(未图示)之间进行的通信进行控制。The communication unit 21 controls communication with other devices (not shown) via a network including the Internet.
对驱动器22适当安装由磁盘、光盘、光磁盘或者半导体存储器等构成的可移动介质31。由驱动器22从可移动介质31读出的程序根据需要被安装至存储部20。另外，可移动介质31还与存储部20同样地存储存储部20中所存储的图像的数据等各种数据。A removable medium 31 composed of a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory is appropriately mounted on the drive 22 . The program read from the removable medium 31 by the drive 22 is installed in the storage unit 20 as necessary. In addition, the removable medium 31 also stores various data such as image data stored in the storage unit 20 in the same manner as the storage unit 20 .
如上构成的检测装置1具有执行关于进行移动的物体(例如，手等被摄体的一部分)已进入摄像图像的特定区域(检测区域)的检测(运动检测)并自动按下快门的功能(以下，将“运动快门功能、使用“运动快门功能”来进行拍摄的处理称为“运动快门拍摄处理”。)。此外，“进行移动的物体”为了简化记载，也酌情仅记载为“物体”。The detection device 1 configured as above has a function of performing detection (motion detection) that a moving object (for example, a part of a subject such as a hand) has entered a specific area (detection area) of a captured image and automatically pressing the shutter (hereinafter , the "moving shutter function" and the processing of taking pictures using the "moving shutter function" are referred to as "moving shutter shooting processing". In addition, "moving object" is also described as "object" as appropriate for the sake of simplification.
然后，检测装置1针对摄像图像的亮度分量以及色差分量，各自设置用于进行运动检测的检测阈值，并使用它们的一方或双方来进行运动检测。进而，检测装置1为了判别使用摄像图像的亮度分量以及色差分量的一方或双方的检测阈值的哪一者来进行运动检测(运动检测的模式)，针对摄像图像的亮度分量以及色差分量各自设置判别阈值。检测装置1针对摄像图像的亮度分量以及色差分量，进行连续的摄像图像中的检测区域的差值与判别阈值的比较，并根据该比较结果来判别使用摄像图像的亮度分量以及色差分量的一方或双方的检测阈值的哪一者来进行运动检测(即，运动检测的模式)。另外，检测装置1针对摄像图像中的检测区域的亮度分量以及色差分量各自设置重新设置的阈值。检测装置1进行摄像图像整体的亮度分量以及色差分量各自的平均值与重新设置的阈值之间的比较。然后，检测装置1根据该比较结果检测出拍摄环境已较大变化，并对阈值进行重新设置。Then, the detection device 1 sets a detection threshold for motion detection for each of the luminance component and the color difference component of the captured image, and performs motion detection using one or both of them. Furthermore, in order to determine which one or both of the detection thresholds of the luminance component and the color difference component of the captured image is used for motion detection (mode of motion detection), the detection device 1 sets a discrimination threshold for each of the luminance component and the color difference component of the captured image. threshold. The detection device 1 compares the difference between detection regions in consecutive captured images with a discrimination threshold for the luminance component and the color difference component of the captured image, and determines whether to use the luminance component or the color difference component of the captured image or the color difference component based on the comparison result. Which one of the two detection thresholds is used for motion detection (that is, the mode of motion detection). In addition, the detection device 1 sets reset threshold values for each of the luminance component and the color difference component of the detection area in the captured image. The detection device 1 compares the respective average values of the luminance component and the color difference component of the entire captured image with a newly set threshold. Then, the detection device 1 detects that the shooting environment has changed greatly according to the comparison result, and resets the threshold.
根据具有这样的构成的检测装置1，能在摄像图像中更适当地检测物体的移动。According to the detection device 1 having such a configuration, it is possible to more appropriately detect movement of an object in a captured image.
此外，在本实施方式中，以使用YUV颜色空间的亮度分量以及色差分量作为摄像图像的与亮度相关的亮度信息以及与颜色相关的颜色信息来进行各种处理的情况为例进行说明。但作为摄像图像的与亮度相关的亮度信息以及与颜色相关的颜色信息，还能使用各种颜色空间中所表征的亮度信息以及颜色信息(例如，HSV颜色空间的明度和色相等)。In addition, in this embodiment, a case where various processes are performed using the luminance component and the color difference component of the YUV color space as luminance information related to luminance and color information related to color of a captured image will be described as an example. However, luminance information and color information represented in various color spaces (for example, lightness and hue in HSV color space) can also be used as luminance information related to luminance and color information related to color of a captured image.
图2是表示这样的检测装置1的功能性构成当中用于执行运动快门拍摄处理的功能性构成的功能框图。FIG. 2 is a functional block diagram showing a functional configuration for performing motion shutter imaging processing among the functional configurations of such a detection device 1 .
另外，图3是表示在摄像图像中设置有检测区域的状态的示意图，图3A是表示检测区域的亮度分量中难以出现差值的状态的图，图3B是表示检测区域的色差分量中难以出现差值的状态的图。In addition, FIG. 3 is a schematic diagram showing a state where a detection area is provided in a captured image, FIG. 3A is a diagram showing a state where a difference hardly occurs in the luminance component of the detection area, and FIG. 3B shows a state where a difference hardly occurs in the color difference component of the detection area. A graph of the state of the difference.
运动快门拍摄处理是指，根据连续的摄像图像中的检测区域的差值与判别用阈值之间的比较结果，使用摄像图像的亮度分量以及色差分量的一方或双方的检测阈值的任一者来进行运动检测，并进行拍摄的一系列的处理。The motion shutter imaging process refers to using either one or both of the detection thresholds of the luminance component and the color difference component of the captured image based on the comparison result between the difference value of the detection area in the continuous captured image and the threshold value for discrimination. Perform motion detection and perform a series of processing for shooting.
另外，在运动快门拍摄处理中，包含：根据连续的摄像图像中的检测区域的差值来设置亮度分量以及色差分量的判别用阈值以及检测用阈值的阈值设置处理、判别使用摄像图像的亮度分量以及色差分量的一方或双方的检测阈值的哪一者来进行运动检测的检测方法判别处理、以及进行运动检测的检测处理的各种处理。In addition, the motion shutter shooting process includes: threshold value setting processing of setting a threshold value for discrimination of a brightness component and a color difference component and a threshold value for detection based on the difference value of the detection area in consecutive captured images; Depending on which one of the detection thresholds of one or both of the color difference components is used, the detection method discrimination process of motion detection and the detection process of motion detection are performed.
以下，酌情参照图3的示意图来说明检测装置1的功能性构成。Hereinafter, the functional configuration of the detection device 1 will be described with reference to the schematic diagram of FIG. 3 as appropriate.
在执行运动快门拍摄处理的情况下，如图2所示，在CPU11中，拍摄控制部51、平均值计算部52、阈值重新设置判别部53、阈值设置部54、检测方法判别部55以及运动检测部56发挥功能。In the case of performing motion shutter shooting processing, as shown in FIG. The detection unit 56 functions.
另外，在存储部20的一区域，形成阈值存储部71以及图像存储部72。In addition, a threshold value storage unit 71 and an image storage unit 72 are formed in a region of the storage unit 20 .
在阈值存储部71中存储后述的亮度分量以及色差分量的判别阈值、检测阈值以及重新设置阈值。In the threshold storage unit 71 , discrimination thresholds, detection thresholds, and reset thresholds of luminance components and color difference components, which will be described later, are stored.
另外，在图像存储部72中，存储预先设置的数量的最新的摄像图像、记录用的摄像图像等的图像数据。Also, in the image storage unit 72 , image data such as the latest captured images and captured images for recording are stored in a preset number.
拍摄控制部51进行检测装置1中的拍摄的控制。具体而言，在通过运动快门功能或者快门按钮的操作而自动或者手动地按下了快门的情况下，拍摄控制部51进行使摄像部16获取记录用的摄像图像的控制等。通过拍摄控制部51的控制而获取到的摄像图像的数据被存储至图像存储部72。The imaging control unit 51 controls imaging in the detection device 1 . Specifically, when the shutter is automatically or manually pressed by the motion shutter function or the operation of the shutter button, the imaging control unit 51 controls the imaging unit 16 to acquire a captured image for recording, and the like. The data of the captured image acquired under the control of the imaging control unit 51 is stored in the image storage unit 72 .
另外，拍摄控制部51以帧为单位来获取从摄像部16连续输出的摄像图像，并作为实时取景图像而依次显示于输出部19的显示器。In addition, the imaging control unit 51 acquires captured images continuously output from the imaging unit 16 in units of frames, and sequentially displays them as live view images on the display of the output unit 19 .
平均值计算部52针对摄像图像整体以及检测区域(参照图3)内的像素，计算亮度分量以及色差分量的平均值。检测区域内的像素的亮度分量以及色差分量的平均值用于检测阈值以及判别阈值的设置、检测区域内的运动检测以及运动检测的模式的判别。另一方面，摄像图像整体的亮度分量以及色差分量的平均值用于检测拍摄环境已较大变化的情况。此外，在本实施方式中，使用摄像图像整体或者检测区域内的像素的平均值，但只要成为表征图像的内容的指标，例如也可以使用摄像图像整体或者检测区域内的像素的总计值。The average value calculation unit 52 calculates the average value of the luminance component and the color difference component for the entire captured image and the pixels in the detection area (see FIG. 3 ). The average value of the luminance component and the color difference component of the pixels in the detection area is used for the setting of the detection threshold and the discrimination threshold, the motion detection in the detection area and the discrimination of the motion detection mode. On the other hand, the average value of the luminance component and the color difference component of the entire captured image is used to detect that the shooting environment has changed significantly. In addition, in this embodiment, the average value of the entire captured image or the pixels in the detection area is used, but as long as it becomes an index representing the content of the image, for example, the total value of the pixels in the entire captured image or in the detection area may be used.
阈值重新设置判别部53对由平均值计算部52计算出的摄像图像整体的像素的亮度分量以及色差分量的平均值、与针对亮度分量以及色差分量各自而设置的重新设置阈值进行比较。然后，在摄像图像整体的亮度分量以及色差分量的任一者的平均值大于亮度分量以及色差分量各自的重新设置阈值的情况下，阈值重新设置判别部53检测出拍摄环境发生较大变化，并对阈值设置部54输出用于对检测阈值进行重新设置的指示(以下，称为“阈值重新设置指示”。)。The threshold reset determination unit 53 compares the average value of the luminance component and the color difference component of the pixels of the entire captured image calculated by the average value calculation unit 52 with the reset threshold set for each of the luminance component and the color difference component. Then, when the average value of any one of the luminance component and the color difference component of the entire captured image is greater than the respective resetting thresholds of the luminance component and the color difference component, the threshold resetting judging section 53 detects a large change in the shooting environment, and An instruction to reset the detection threshold (hereinafter referred to as “threshold reset instruction”) is output to the threshold setting unit 54 .
阈值设置部54根据连续的2个摄像图像中的检测区域的差值，设置用于运动检测的模式的判别阈值。具体而言，阈值设置部54针对连续的摄像图像的检测区域的各区域，获取由平均值计算部52计算出的亮度分量以及色差分量各自的平均值的差值。然后，阈值设置部54针对亮度分量以及色差分量各自，将判别阈值设置为比获取到的平均值的差值更大的给定比例的值(例如获取到的平均值的差值的120％)。The threshold setting unit 54 sets a discrimination threshold for a motion detection mode based on a difference between detection areas in two consecutive captured images. Specifically, the threshold value setting unit 54 acquires the difference between the average values of the luminance component and the color difference component calculated by the average value calculation unit 52 for each detection area of consecutive captured images. Then, the threshold value setting section 54 sets the discrimination threshold value to a value of a given ratio (for example, 120% of the obtained average value difference value) larger than the obtained average value difference value for each of the luminance component and the color difference component. .
另外，阈值设置部54根据判别阈值的设置中用到的连续的2个摄像图像中的检测区域的差值，设置用于进行运动检测的检测阈值。具体而言，阈值设置部54针对亮度分量以及色差分量各自，针对判别阈值的设置中用到的连续的摄像图像的检测区域各自，将检测阈值设置为比获取到的平均值的差值更大、比判别阈值更大的给定比例的值(例如获取到的平均值的差值的150％)。但作为判别阈值以及检测阈值，也可以设置亮度分量以及色差分量各自的绝对值。例如，在判别阈值的设置中用到的摄像图像的检测区域的平均值的差值以255级来表征的情况下，若该差值为100，则能将判别阈值设置为“差值(100)+20”，将检测阈值设置为“差值(100)+50”。此外，作为这些检测阈值以及判别阈值的绝对值或者给定比例，能根据实验或者模拟等的结果来任意设置。In addition, the threshold setting unit 54 sets a detection threshold for motion detection based on the difference between the detection areas in two consecutive captured images used for setting the discrimination threshold. Specifically, the threshold setting unit 54 sets the detection threshold to be larger than the difference of the acquired average value for each of the luminance component and the color difference component, and for each of the detection areas of the continuous captured images used for setting the discrimination threshold. , a value of a given proportion that is greater than the discrimination threshold (for example, 150% of the difference of the obtained mean values). However, absolute values of the luminance component and the color difference component may be set as the discrimination threshold and the detection threshold. For example, in the case where the difference of the average value of the detection area of the captured image used in the setting of the discrimination threshold is characterized by 255 levels, if the difference is 100, the discrimination threshold can be set to "difference (100 )+20", set the detection threshold as "difference(100)+50". In addition, the absolute values or predetermined ratios of these detection thresholds and discrimination thresholds can be set arbitrarily based on the results of experiments or simulations.
进而，阈值设置部54基于判别阈值的设置中用到的摄像图像整体的平均值，来设置用于判别是否需要检测阈值的重新设置的重新设置阈值。具体而言，阈值设置部54针对亮度分量以及色差分量各自，基于判别阈值的设置中用到的摄像图像整体的平均值，来设置亮度分量以及色差分量各自的重新设置阈值。此时，对于判别阈值的设置中用到的连续的2个摄像图像整体或其一方的摄像图像整体的亮度分量以及色差分量各自的平均值，将表征给定比例(例如30％)的数值设置为重新设置阈值。在将给定比例的数值设置为重新设置阈值的情况下，对判别阈值的设置中用到的摄像图像整体的平均值(亮度分量以及色差分量的平均值)进行存储。然后，在判别是否需要检测阈值的重新设置之际，对于所存储的平均值，判定作为比较对象的摄像图像整体的平均值(亮度分量以及色差分量的平均值)的变化是否大于重新设置阈值。但作为重新设置阈值，也可以设置亮度分量以及色差分量各自的绝对值。在此情况下，例如，若判别阈值的设置中用到的摄像图像整体的平均值为255级当中的100，则按照将上侧的阈值设为130(100+30)以及将下侧的阈值设为70(100-30)的方式来设置重新设置的阈值。此外，作为这些重新设置的阈值的绝对值或者给定比例，能根据实验或者模拟等的结果来任意设置。Furthermore, the threshold setting unit 54 sets a resetting threshold for judging whether or not resetting of the detection threshold is necessary based on the average value of the entire captured image used for setting the discrimination threshold. Specifically, the threshold setting unit 54 sets reset thresholds for each of the brightness component and the color difference component based on the average value of the entire captured image used for setting the discrimination threshold. At this time, for the respective average values of the luminance component and the color difference component of the entire two consecutive captured images or one of the entire captured images used in the setting of the discrimination threshold, a numerical value representing a given ratio (for example, 30%) is set. to reset the threshold. When a numerical value of a predetermined ratio is set as the resetting threshold, the average value (average value of the luminance component and the color difference component) of the entire captured image used for setting the discrimination threshold is stored. Then, when judging whether to reset the detection threshold, it is judged whether the change in the average value (the average value of the luminance component and the color difference component) of the entire captured image to be compared is greater than the reset threshold value for the stored average value. However, it is also possible to set the respective absolute values of the luminance component and the color difference component as resetting the threshold. In this case, for example, if the average value of the entire captured image used in the setting of the discrimination threshold is 100 out of 255 levels, the upper threshold is set to 130 (100+30) and the lower threshold is set to 130 (100+30). Set to 70 (100-30) to set the reset threshold. In addition, the absolute values or predetermined ratios of these reset thresholds can be set arbitrarily according to the results of experiments or simulations.
另外，阈值设置部54在从阈值重新设置判别部53输入了阈值重新设置指示的情况下，根据连续的2个摄像图像中的检测区域的差值来新设置检测阈值。由此，在拍摄环境较大变化的情况下，能将检测阈值更新为更适当的值。此外，可以与检测阈值的重新设置一起对判别阈值进行重新设置。In addition, the threshold setting unit 54 newly sets the detection threshold based on the difference between the detection areas in two consecutive captured images when a threshold reset instruction is input from the threshold reset determination unit 53 . Accordingly, when the imaging environment changes greatly, the detection threshold can be updated to a more appropriate value. Furthermore, the discrimination threshold can be reset together with the resetting of the detection threshold.
检测方法判别部55对由阈值设置部54设置的判别阈值、与连续的摄像图像的亮度分量以及色差分量的差值进行比较，并设置与比较结果相应的运动检测的模式。具体而言，检测方法判别部55在判别为连续的摄像图像的亮度分量的差值大于判别阈值的情况下，设置为使用亮度分量的检测阈值来进行摄像图像的运动检测的模式(第1检测模式)。由此，如图3B所示，背景是接近肤色的墙壁，在检测已进入检测区域的人的手等情况下，即使是在色差分量的差值难以出现的摄像图像中进行运动检测时，也能更适当地检测进行移动的物体已进入检测区域。The detection method determination section 55 compares the discrimination threshold set by the threshold setting section 54 with the difference between the luminance component and the color difference component of consecutive captured images, and sets a motion detection mode according to the comparison result. Specifically, when it is determined that the difference between the luminance components of consecutive captured images is greater than the discrimination threshold, the detection method determination unit 55 sets a mode in which motion detection of the captured images is performed using the detection threshold of the luminance components (the first detection method). model). Therefore, as shown in FIG. 3B , the background is a wall close to the skin color, and when detecting the hand of a person who has entered the detection area, etc., even when motion detection is performed in a captured image in which the difference in color difference components hardly appears, it is easy to detect motion. It is possible to more properly detect that a moving object has entered the detection area.
另外，检测方法判别部55判别为在连续的摄像图像的亮度分量的差值为判别阈值以下、且色差分量的差值大于判别阈值的情况下，设置为使用色差分量的检测阈值来进行摄像图像的运动检测的模式(第2检测模式)。如此，如图3A所示，在背景是无纹理的墙壁、且检测到已进入检测区域的复印纸等情况下，即使是在亮度分量的差值难以呈现的摄像图像中进行运动检测时，也能更适当地检测进行移动的物体已进入检测区域。In addition, the detection method judging unit 55 judges that when the difference between the luminance components of consecutive captured images is less than or equal to the discrimination threshold and the difference of the color difference components is greater than the discrimination threshold, it is set to use the detection threshold of the color difference component to perform the captured image detection. The motion detection mode (2nd detection mode). In this way, as shown in FIG. 3A , when the background is a textureless wall and copy paper that has entered the detection area is detected, even when motion detection is performed in a captured image where differences in luminance components are difficult to appear, it is possible to detect motion. It is possible to more properly detect that a moving object has entered the detection area.
进而，检测方法判别部55在判别为连续的摄像图像的亮度分量以及色差分量的差值均为判别阈值以下的情况下，设置为使用亮度分量以及色差分量双方的检测阈值来进行摄像图像的运动检测的模式(第3检测模式)。由此，即使是在亮度分量以及色差分量的任一者中差值均难以明确出现的摄像图像中进行运动检测时，也能更适当地检测进行移动的物体已进入检测区域。Furthermore, the detection method judging unit 55 is configured to use the detection thresholds for both the brightness component and the color difference component to perform motion of the captured image when it is judged that the difference between the luminance component and the color difference component of consecutive captured images is equal to or less than the discrimination threshold. Detection mode (3rd detection mode). Accordingly, even when motion detection is performed in a captured image in which a difference in any of the luminance component and the color difference component hardly appears clearly, it is possible to more appropriately detect that a moving object has entered the detection area.
运动检测部56对连续的摄像图像中的检测区域的差值与检测阈值进行比较，并基于比较结果来检测进行移动的物体已进入检测区域。运动检测部56若检测到摄像图像中所含的进行移动的物体已进入检测区域，则作为运动快门功能，而对拍摄控制部51指示快门的按下(即，拍摄的执行)。The motion detection unit 56 compares the difference between detection areas in consecutive captured images with a detection threshold, and detects that a moving object has entered the detection area based on the comparison result. When the motion detection unit 56 detects that a moving object included in the captured image has entered the detection area, it functions as a motion shutter and instructs the imaging control unit 51 to press the shutter (that is, execute imaging).
具体而言，在运动检测的模式被设置为第1检测模式的情况下，运动检测部56判定连续的摄像图像中的检测区域的亮度分量的差值是否大于针对亮度分量所设置的检测阈值。然后，在连续的摄像图像中的检测区域的亮度分量的差值大于针对亮度分量所设置的检测阈值的情况下，运动检测部56判别为进行移动的物体已进入检测区域。另一方面，在连续的摄像图像中的检测区域的亮度分量的差值为针对亮度分量所设置的检测阈值以下的情况下，运动检测部56判别为进行移动的物体未进入检测区域。Specifically, when the motion detection mode is set to the first detection mode, the motion detection unit 56 determines whether the difference in luminance components of detection areas in consecutive captured images is greater than a detection threshold set for the luminance components. Then, the motion detection unit 56 determines that a moving object has entered the detection area when the difference between the luminance components of the detection areas in consecutive captured images is larger than the detection threshold set for the luminance components. On the other hand, when the difference in the luminance components of the detection areas in consecutive captured images is equal to or less than the detection threshold set for the luminance components, the motion detection unit 56 determines that a moving object has not entered the detection area.
另外，在运动检测的模式被设置为第2检测模式的情况下，运动检测部56判别连续的摄像图像中的检测区域的色差分量的差值是否大于针对色差分量所设置的检测阈值。然后，在连续的摄像图像中的检测区域的色差分量的差值大于针对色差分量所设置的检测阈值的情况下，运动检测部56判别为进行移动的物体已进入检测区域。另一方面，在连续的摄像图像中的检测区域的色差分量的差值为针对色差分量所设置的检测阈值以下的情况下，运动检测部56判别为进行移动的物体未进入检测区域。Also, when the motion detection mode is set to the second detection mode, the motion detection unit 56 determines whether the difference in color difference components in detection areas in consecutive captured images is greater than a detection threshold set for the color difference components. Then, the motion detection unit 56 judges that a moving object has entered the detection area when the difference between the color difference components of the detection area in consecutive captured images is larger than the detection threshold set for the color difference component. On the other hand, the motion detection unit 56 determines that a moving object has not entered the detection area when the difference value of the color difference components in the detection area in consecutive captured images is equal to or less than the detection threshold set for the color difference component.
进而，在运动检测的模式被设置为第3检测模式的情况下，运动检测部56判别连续的摄像图像中的检测区域的亮度分量以及色差分量各自的差值是否大于针对亮度分量以及色差分量的各自所设置的检测阈值。然后，在连续的摄像图像中的检测区域的亮度分量以及色差分量的差值的任一者大于针对亮度分量以及色差分量的各自所设置的检测阈值的情况下，运动检测部56判别为进行移动的物体已进入检测区域。另一方面，在连续的摄像图像中的检测区域的亮度分量以及色差分量的差值均为针对亮度分量以及色差分量的各自所设置的检测阈值以下的情况下，运动检测部56判别为进行移动的物体未进入检测区域。Furthermore, when the mode of motion detection is set to the third detection mode, the motion detection unit 56 determines whether the respective difference values of the luminance component and the color difference component of the detection area in the continuous captured image are larger than the difference values for the luminance component and the color difference component. The respective detection thresholds are set. Then, when any one of the differences between the luminance component and the color difference component of the detection area in the continuous captured image is greater than the detection threshold set for each of the luminance component and the color difference component, the motion detection unit 56 determines that the movement is performed. The object has entered the detection area. On the other hand, when the difference between the luminance component and the color difference component of the detection area in the continuous captured image is equal to or less than the detection threshold value set for each of the luminance component and the color difference component, the motion detection unit 56 determines that the movement is performed. The object does not enter the detection area.
接下来说明动作。Next, the action will be described.
图4是表示具有图2的功能性构成的图1的检测装置1所执行的运动快门拍摄处理的流程的流程图。FIG. 4 is a flowchart showing the flow of motion shutter imaging processing executed by the detection device 1 of FIG. 1 having the functional configuration of FIG. 2 .
运动快门拍摄处理对应于经由输入部18来指示运动快门拍摄处理的开始的操作被执行而开始。The motion shutter imaging process is started in response to an operation for instructing the start of the motion shutter imaging process via the input unit 18 .
在步骤S1中，拍摄控制部51转移至拍摄的待机状态(通过快门按钮的自动按下而能执行拍摄的状态)。在拍摄的待机状态下，连续获取摄像图像。In step S1 , the shooting control unit 51 transitions to a shooting standby state (a state in which shooting can be performed by automatically pressing the shutter button). In the shooting standby state, captured images are continuously acquired.
在步骤S2中，平均值计算部52针对摄像图像整体以及检测区域内的像素，计算亮度分量以及色差分量的平均值。In step S2 , the average value calculation unit 52 calculates the average value of the luminance component and the color difference component for the entire captured image and the pixels in the detection area.
在步骤S3中，阈值重新设置判别部53判别由平均值计算部52计算出的摄像图像整体的像素的亮度分量以及色差分量的任一者的平均值是否变化得大于亮度分量以及色差分量各自的重新设置阈值。In step S3, the threshold value reset judging section 53 judges whether the average value of any one of the luminance component and the color difference component of the pixels of the entire captured image calculated by the average value calculating section 52 has changed more than the respective values of the luminance component and the color difference component. Reset the threshold.
在步骤S3中，在判别为摄像图像整体的像素的亮度分量以及色差分量的任一者的平均值变化得大于亮度分量以及色差分量各自的重新设置阈值(是)的情况下，处理转移至步骤S4。In step S3, when it is determined that the average value of any one of the luminance component and the color difference component of the pixels of the entire captured image has changed more than the respective reset thresholds of the luminance component and the color difference component (Yes), the process proceeds to step S3. S4.
另一方面，在步骤S3中，在判别为摄像图像整体的像素的亮度分量以及色差分量的任一者的平均值均未变化得大于亮度分量以及色差分量各自的重新设置阈值(否)的情况下，处理转移至步骤S5。On the other hand, in step S3, when it is judged that the average value of any of the luminance component and the color difference component of the pixels of the entire captured image has not changed more than the respective reset thresholds of the luminance component and the color difference component (No). Next, the process shifts to step S5.
在步骤S4中，阈值设置部54通过执行后述的阈值设置处理，从而根据连续的2个摄像图像中的检测区域的差值来设置用于进行运动检测的检测阈值。In step S4 , the threshold setting unit 54 sets a detection threshold for motion detection based on a difference between detection areas in two consecutive captured images by executing threshold setting processing described later.
在步骤S5中，检测方法判别部55通过执行后述的检测方法判别处理，从而对由阈值设置部54设置的判别阈值、与连续的摄像图像的亮度分量以及色差分量的差值进行比较，并设置与比较结果相应的运动检测的模式。In step S5, the detection method judging section 55 compares the difference between the discrimination threshold set by the threshold setting section 54 and the luminance component and color difference component of consecutive captured images by executing the detection method judging process described later, and Sets the mode of motion detection corresponding to the comparison result.
在步骤S6中，运动检测部56向对连续的摄像图像中的检测区域的差值与检测阈值进行比较的检测状态转移。In step S6 , the motion detection unit 56 transitions to a detection state where the difference between detection areas in consecutive captured images is compared with a detection threshold.
在步骤S7中，运动检测部56通过执行后述的检测处理来进行被摄体的运动检测。In step S7 , the motion detection unit 56 detects the motion of the subject by performing detection processing described later.
在步骤S8中，拍摄控制部51通过对应于运动检测的结果来自动地按下快门按钮从而执行拍摄。In step S8, the photographing control section 51 executes photographing by automatically pressing the shutter button corresponding to the result of the motion detection.
在步骤S9中，拍摄控制部51判别是否进行了经由输入部18来指示运动快门拍摄处理的结束的操作。In step S9 , the imaging control unit 51 determines whether an operation to instruct the end of the motion shutter imaging process via the input unit 18 has been performed.
在步骤S9中，在判别为进行了经由输入部18来指示运动快门拍摄处理的结束的操作(是)的情况下，处理结束。In step S9 , when it is determined that an operation to instruct the end of the motion shutter imaging process via the input unit 18 has been performed (Yes), the process ends.
另一方面，在步骤S9中，在判别为未进行经由输入部18来指示运动快门拍摄处理的结束的操作(否)的情况下，处理转移至步骤S1，继续运动快门拍摄处理。On the other hand, in step S9, when it is determined that an operation to instruct the end of the motion shutter imaging process via the input unit 18 has not been performed (No), the process proceeds to step S1, and the motion shutter imaging process is continued.
接下来，说明在运动快门拍摄处理的步骤S4中所执行的阈值设置处理。Next, the threshold value setting process executed in step S4 of the motion shutter shooting process will be described.
图5是表示作为运动快门拍摄处理的子流程而执行的阈值设置处理的流程的流程图。5 is a flowchart showing the flow of threshold setting processing executed as a subroutine of the motion shutter shooting processing.
在步骤S21中，阈值设置部54获取连续的2个摄像图像。In step S21 , the threshold setting unit 54 acquires two consecutive captured images.
在步骤S22中，阈值设置部54根据所获取的连续的2个摄像图像中的检测区域的差值，来设置用于判别运动检测的模式的判别阈值。In step S22 , the threshold setting unit 54 sets a discrimination threshold for discriminating the motion detection mode based on the difference between the detection areas in the acquired two consecutive captured images.
在步骤S23中，阈值设置部54根据获取到的连续的2个摄像图像中的检测区域的差值来设置用于进行运动检测的检测阈值。此外，步骤S23中的检测阈值的设置也可以作为检测方法判别处理之中的步骤(例如，后述的步骤S32接下来的步骤)来进行。In step S23 , the threshold setting unit 54 sets a detection threshold for motion detection based on the difference between the detection areas in the acquired two consecutive captured images. In addition, setting of the detection threshold in step S23 may also be performed as a step in the detection method discrimination process (for example, a step subsequent to step S32 described later).
在步骤S24中，阈值设置部54基于获取到的连续的2个摄像图像整体的平均值(亮度分量以及色差分量的平均值)，来设置用于判别是否需要检测阈值的重新设置的重新设置阈值。此外，在步骤S24中，重新设置阈值的设置中用到的摄像图像整体的亮度分量以及色差分量的平均值被存储至阈值存储部71。In step S24, the threshold setting unit 54 sets a resetting threshold for judging whether resetting of the detection threshold is necessary based on the average value (average value of the luminance component and the color difference component) of the entire acquired two consecutive captured images. . In addition, in step S24 , the average value of the luminance component and the color difference component of the entire captured image used for setting the reset threshold is stored in the threshold storage unit 71 .
在步骤S24之后，处理返回至图4的运动快门拍摄处理。After step S24, the process returns to the motion shutter shooting process of FIG. 4 .
此外，在阈值设置处理中，将设置判别阈值以及检测阈值之际使用的连续的摄像图像的数量设为了2个，但也可以根据连续的3个以上的摄像图像中的检测区域的差值来设置判别阈值以及检测阈值。在此情况下，作为判别阈值以及检测阈值，分别设置上侧的阈值和下侧的阈值，在运动检测的模式判别以及运动检测的判别之际，能设置相对于亮度分量以及色差分量的差值的变化方向的滞后来进行判别。In addition, in the threshold setting process, the number of consecutive captured images used when setting the discrimination threshold and the detection threshold is set to two, but it may be determined based on the difference between detection regions in three or more consecutive captured images. Set the discrimination threshold and detection threshold. In this case, an upper threshold and a lower threshold are respectively set as the discrimination threshold and the detection threshold, and a difference value with respect to the luminance component and the color difference component can be set at the mode discrimination of the motion detection and the discrimination of the motion detection The hysteresis of the direction of change is used for discrimination.
接下来，针对运动快门拍摄处理的步骤S5中所执行的检测方法判别处理进行说明。Next, the detection method determination process executed in step S5 of the motion shutter imaging process will be described.
图6是表示作为运动快门拍摄处理的子流程而被执行的检测方法判别处理的流程的流程图。FIG. 6 is a flowchart showing the flow of detection method determination processing executed as a subroutine of the moving shutter imaging processing.
在步骤S31中，检测方法判别部55获取连续的2个摄像图像。In step S31 , the detection method determination unit 55 acquires two consecutive captured images.
在步骤S32中，检测方法判别部55计算所获取的连续的2个摄像图像的检测区域的亮度分量以及色差分量的差值。In step S32 , the detection method determination unit 55 calculates the difference between the luminance component and the color difference component of the detection area of the acquired two consecutive captured images.
在步骤S33中，检测方法判别部55判别计算出的检测区域的亮度分量的差值是否大于针对亮度分量所设置的判别阈值。In step S33 , the detection method judging section 55 judges whether or not the calculated difference value of the luminance component of the detection area is larger than a discrimination threshold set for the luminance component.
在步骤S33中，在判别为计算出的检测区域的亮度分量的差值大于针对亮度分量所设置的判别阈值(是)的情况下，处理转移至步骤S34。In step S33, when it is judged that the calculated difference value of the luminance component of the detection area is larger than the discrimination threshold set for the luminance component (Yes), the process proceeds to step S34.
另一方面，在步骤S33中，在判别为计算出的检测区域的亮度分量的差值为针对亮度分量所设置的判别阈值以下(否)的情况下，处理转移至步骤S35。On the other hand, when it is judged in step S33 that the calculated difference of the luminance component of the detection area is equal to or less than the discrimination threshold set for the luminance component (No), the process proceeds to step S35.
在步骤S34中，检测方法判别部55将运动检测的模式设为第1检测模式，设为使用亮度分量的检测阈值来进行运动检测的设置。In step S34 , the detection method determination unit 55 sets the motion detection mode to the first detection mode, and sets motion detection using the detection threshold of the luminance component.
在步骤S35中，检测方法判别部55判别计算出的检测区域的色差分量的差值是否大于针对色差分量所设置的判别阈值。In step S35 , the detection method judging section 55 judges whether or not the calculated difference value of the color difference components of the detection area is larger than a judgment threshold set for the color difference components.
在步骤S35中，在判别为计算出的检测区域的色差分量的差值大于针对色差分量所设置的判别阈值(是)的情况下，处理转移至步骤S36。In step S35, when it is judged that the calculated difference value of the color difference components of the detection area is larger than the discrimination threshold value set for the color difference components (Yes), the process proceeds to step S36.
另一方面，在步骤S35中，在判别为计算出的检测区域的色差分量的差值为针对色差分量所设置的判别阈值以下(否)的情况下，处理转移至步骤S37。On the other hand, when it is determined in step S35 that the calculated difference value of the color difference components of the detection area is equal to or less than the determination threshold set for the color difference components (No), the process proceeds to step S37.
在步骤S36中，检测方法判别部55将运动检测的模式设为第2检测模式，设为使用色差分量的检测阈值来进行运动检测的设置。In step S36 , the detection method determination unit 55 sets the motion detection mode to the second detection mode, and sets motion detection using the detection threshold of the color difference component.
在步骤S37中，检测方法判别部55将运动检测的模式设为第3检测模式，设为使用亮度分量以及色差分量的检测阈值来进行运动检测的设置。In step S37 , the detection method determination unit 55 sets the motion detection mode to the third detection mode, and sets motion detection using detection thresholds of the luminance component and the color difference component.
在步骤S34、步骤S36以及步骤S37之后，处理返回至图4的运动快门拍摄处理。After step S34 , step S36 , and step S37 , the process returns to the motion shutter shooting process of FIG. 4 .
接下来，针对在运动快门拍摄处理的步骤S7中所执行的检测处理进行说明。Next, detection processing executed in step S7 of the motion shutter imaging processing will be described.
图7是表示作为运动快门拍摄处理的子流程而被执行的检测处理的流程的流程图。FIG. 7 is a flowchart showing the flow of detection processing executed as a subroutine of the motion shutter imaging processing.
在步骤S41中，运动检测部56判别运动检测的模式是哪种模式。In step S41 , the motion detection unit 56 determines which mode is the motion detection mode.
在步骤S41中，在判定为运动检测的模式是第1检测模式的情况下，处理转移至步骤S42。In step S41, when it is determined that the motion detection mode is the first detection mode, the process proceeds to step S42.
在步骤S41中，在判定为运动检测的模式是第2检测模式的情况下，处理转移至步骤S44。In step S41, when it is determined that the motion detection mode is the second detection mode, the process proceeds to step S44.
在步骤S41中，在判定为运动检测的模式是第3检测模式的情况下，处理转移至步骤S46。In step S41 , when it is determined that the motion detection mode is the third detection mode, the process proceeds to step S46 .
在步骤S42中，运动检测部56计算连续的摄像图像中的检测区域的亮度分量的差值。In step S42 , the motion detection unit 56 calculates a difference in brightness components of detection areas in consecutive captured images.
在步骤S43中，运动检测部56判别计算出的检测区域中的亮度分量的差值是否大于针对亮度分量所设置的检测阈值。In step S43 , the motion detection section 56 discriminates whether or not the calculated difference of the luminance components in the detection area is larger than the detection threshold set for the luminance components.
在步骤S43中，在判别为计算出的检测区域中的亮度分量的差值大于针对亮度分量所设置的检测阈值(是)的情况下，处理返回至图4的运动快门拍摄处理。In step S43 , when it is determined that the calculated difference of the luminance components in the detection area is larger than the detection threshold set for the luminance components (Yes), the process returns to the motion shutter shooting process of FIG. 4 .
另一方面，在步骤S43中，在判定为计算出的检测区域中的亮度分量的差值为针对亮度分量所设置的检测阈值以下(否)的情况下，处理转移至步骤S42，继续检测处理。On the other hand, in step S43, when it is determined that the calculated difference of the luminance component in the detection area is equal to or less than the detection threshold value set for the luminance component (No), the process shifts to step S42, and the detection process is continued. .
在步骤S44中，运动检测部56计算连续的摄像图像中的检测区域的色差分量的差值。In step S44 , the motion detection unit 56 calculates the difference value of the color difference component of the detection area in the consecutive captured images.
在步骤S45中，运动检测部56判别计算出的检测区域中的色差分量的差值是否大于针对色差分量所设置的检测阈值。In step S45 , the motion detection section 56 discriminates whether or not the calculated difference of the color difference components in the detection area is larger than the detection threshold set for the color difference components.
在步骤S45中，在判别为计算出的检测区域中的色差分量的差值大于针对色差分量所设置的检测阈值(是)的情况下，处理返回至图4的运动快门拍摄处理。In step S45, when it is determined that the calculated difference of the color difference components in the detection area is larger than the detection threshold set for the color difference components (Yes), the process returns to the motion shutter shooting process of FIG. 4 .
另一方面，在步骤S45中，在判定为计算出的检测区域中的色差分量的差值为针对色差分量所设置的检测阈值以下(否)的情况下，处理转移至步骤S44，继续检测处理。On the other hand, in step S45, when it is determined that the calculated difference value of the color difference component in the detection area is equal to or less than the detection threshold value set for the color difference component (No), the process shifts to step S44, and the detection process is continued. .
在步骤S46中，运动检测部56计算连续的摄像图像中的检测区域的亮度分量以及色差分量的差值。In step S46 , the motion detection unit 56 calculates the difference between the luminance component and the color difference component of the detection area in consecutive captured images.
在步骤S47中，运动检测部56判别计算出的检测区域中的亮度分量以及色差分量的差值的任一者是否大于针对亮度分量以及色差分量各自所设置的检测阈值。In step S47 , the motion detection unit 56 determines whether any of the calculated differences between the luminance component and the color difference component in the detection area is larger than the detection thresholds set for each of the luminance component and the color difference component.
在步骤S47中，在判别为计算出的检测区域中的亮度分量以及色差分量的差值的任一者大于针对亮度分量以及色差分量各自所设置的检测阈值(是)的情况下，处理返回至图4的运动快门拍摄处理。In step S47, when it is judged that any one of the calculated differences between the luminance component and the color difference component in the detection area is greater than the detection threshold set for each of the luminance component and the color difference component (Yes), the process returns to Figure 4. Motion shutter shooting process.
另一方面，在步骤S47中，在判定为计算出的检测区域中的亮度分量以及色差分量的差值的任一者均为针对亮度分量以及色差分量各自所设置的检测阈值以下(否)的情况下，处理转移至步骤S46，继续检测处理。On the other hand, in step S47, when it is determined that any of the difference values of the luminance component and the color difference component in the calculated detection area is equal to or less than the detection threshold value set for each of the luminance component and the color difference component (No). In this case, the process shifts to step S46, and the detection process is continued.
如上构成的检测装置1具备：平均值计算部52、检测方法判别部55以及运动检测部56。The detection device 1 configured as above includes an average value calculation unit 52 , a detection method determination unit 55 , and a motion detection unit 56 .
平均值计算部52从由摄像部16以帧为单位所连续摄像的摄像图像中获取与亮度相关的亮度信息以及与颜色相关的颜色信息。The average calculation unit 52 acquires luminance information related to luminance and color information related to color from captured images continuously captured by the imaging unit 16 in units of frames.
检测方法判别部55基于获取到的亮度信息以及颜色信息，判别是使用亮度信息以及颜色信息当中的哪一者来检测给定的物体的移动。The detection method determination unit 55 determines which of the brightness information and the color information is used to detect the movement of a given object based on the acquired brightness information and color information.
运动检测部56基于判别出的结果，使用亮度信息以及颜色信息当中的任一者来检测给定的物体的移动。Based on the determined result, the motion detection unit 56 detects the movement of a given object using either luminance information or color information.
由此，在检测装置1中能判别是使用摄像图像的亮度分量以及色差分量的哪一者来检测物体的移动。This enables the detection device 1 to determine which of the luminance component and the color difference component of the captured image is used to detect the movement of the object.
因此，在摄像图像等的摄像图像中能更适当地检测物体的移动。Therefore, it is possible to more appropriately detect movement of an object in a captured image such as a captured image.
另外，检测装置1还具备阈值设置部54。In addition, the detection device 1 further includes a threshold value setting unit 54 .
阈值设置部54设置：与连续的多帧间的亮度信息的差值之间的比较中使用的判别阈值；以及与连续的多帧间的颜色信息的差值之间的比较中使用的判别阈值。The threshold setting unit 54 sets: a discrimination threshold used in comparison with a difference in brightness information between consecutive frames; and a discrimination threshold used in comparison with a difference in color information between consecutive frames .
检测方法判别部55根据所设置的亮度信息的判别阈值和颜色信息的判别阈值、以及所获取的亮度信息的差值和颜色信息的差值，来判别是使用亮度信息以及颜色信息当中的哪一者来检测给定的物体的移动。The detection method judging section 55 judges which of the brightness information and the color information to use based on the set discrimination threshold of the brightness information and the judgment threshold of the color information, and the acquired difference between the brightness information and the color information. or to detect the movement of a given object.
由此，能按亮度信息以及颜色信息的每一个来设置适当的判别阈值，能判别使用亮度信息以及颜色信息当中的哪一者。Thereby, an appropriate discrimination threshold can be set for each of the luminance information and the color information, and it can be determined which of the luminance information and the color information is used.
另外，平均值计算部52，作为亮度信息，获取摄像图像的每个像素的亮度分量的值来作为亮度值，且作为颜色信息，获取根据每个像素的色差分量的值所计算的值来作为色相值。In addition, the average value calculation unit 52 acquires, as luminance information, a value of a luminance component of each pixel of a captured image as a luminance value, and as color information, a value calculated from a value of a color difference component of each pixel as a value. Hue value.
阈值设置部54将比连续的多个摄像图像间的每个像素的亮度值的差值大的值设置为亮度信息的判别阈值，并将比每个像素的色相值的差值大的值设置为颜色信息的判别阈值。The threshold value setting unit 54 sets a value larger than the difference in brightness value for each pixel among a plurality of continuous captured images as the discrimination threshold value of the brightness information, and sets a value larger than the difference value of the hue value for each pixel. is the discrimination threshold of color information.
由此，能根据摄像图像的亮度值以及色差分量来设置适当的判别阈值。Thereby, an appropriate discrimination threshold can be set according to the luminance value and the color difference component of the captured image.
另外，在阈值设置部54进行设置后的连续的多个摄像图像间的每个像素的亮度值的差值为已设置的亮度信息的判别阈值以下的情况下，检测方法判别部55判别为在给定物体的检测中使用颜色信息(色相值)。In addition, when the difference in luminance value of each pixel among a plurality of consecutive captured images set by the threshold value setting unit 54 is equal to or less than the set luminance information discrimination threshold, the detection method determination unit 55 determines that it is Color information (hue value) is used in the detection of a given object.
由此，例如，在背景为无纹理的墙壁、且将复印纸作为进行移动的物体进行检测等情况下，即使在亮度信息的差值难以出现的摄像图像中进行物体的移动的检测的情况下，也能更适当地检测物体的移动。Thus, for example, when the background is a textureless wall and copy paper is detected as a moving object, even when the movement of the object is detected in a captured image in which a difference in luminance information hardly appears. , can also detect the movement of the object more appropriately.
另外，在阈值设置部54进行设置后的连续的多个摄像图像间的每个像素的颜色信息(色相值)的差值为已设置的颜色信息的判别阈值以下的情况下，检测方法判别部55判别为在给定物体的检测中使用亮度信息(亮度值)。In addition, when the difference in color information (hue value) per pixel between the plurality of consecutive captured images set by the threshold value setting unit 54 is equal to or less than the set discrimination threshold value of the color information, the detection method determination unit 55 determines that brightness information (brightness value) is used in the detection of a given object.
由此，在背景是接近肤色的墙壁、且将人的手作为进行移动的物体进行检测等情况下，即使在颜色信息的差值难以出现的摄像图像中进行物体的移动的检测的情况下，也能更适当地检测进行移动的物体。Thus, even when the background is a wall close to the skin color and a human hand is detected as a moving object, even when the movement of the object is detected in a captured image where the difference in color information hardly appears, Objects that are moving can also be detected more appropriately.
另外，在阈值设置部54进行设置后的连续的多个摄像图像间的每个像素的亮度值的差值为已设置的亮度信息的判别阈值以下、且阈值设置部54进行设置后的连续的多个摄像图像间的每个像素的颜色信息(色相值)的差值为已设置的颜色信息的判别阈值以下的情况下，检测方法判别部55进一步判别为使用亮度信息以及颜色信息的双方。In addition, the difference in the luminance value of each pixel between the plurality of continuous captured images set by the threshold value setting unit 54 is equal to or less than the discrimination threshold value of the set luminance information, and the continuous luminance values set by the threshold value setting unit 54 When the difference in color information (hue value) per pixel between a plurality of captured images is equal to or less than a set color information discrimination threshold, the detection method determination unit 55 further determines whether to use both luminance information and color information.
作为判别结果，在判别为使用双方来的情况下，运动检测部56使用亮度信息以及颜色信息当中的双方来检测给定的物体的移动。As a result of the determination, when it is determined that both are used, the motion detection unit 56 detects the movement of a given object using both of the luminance information and the color information.
由此，例如，即使在亮度信息以及颜色信息的任一者中均难以明确地出现差值的摄像图像中进行物体的移动的检测的情况下，也能更适当地检测物体的移动。Thereby, for example, even when the movement of the object is detected in a captured image in which it is difficult to clearly show a difference in either the luminance information or the color information, the movement of the object can be detected more appropriately.
另外，阈值设置部54设置比亮度信息的判别阈值大的、亮度信息的检测阈值、以及比颜色信息的判别阈值大的、亮度信息的检测阈值。In addition, the threshold setting section 54 sets a detection threshold of luminance information that is larger than a discrimination threshold of luminance information, and a detection threshold of luminance information that is larger than a discrimination threshold of color information.
运动检测部56使用所设置的亮度信息的检测阈值以及颜色信息的检测阈值的任一者来检测给定的物体的移动。The motion detection section 56 detects the movement of a given object using any one of the set detection threshold of the brightness information and the detection threshold of the color information.
由此，能针对亮度信息以及颜色信息各自，设置适当的大小的判别阈值以及检测阈值，来进行物体的移动的检测。Accordingly, it is possible to detect the movement of an object by setting a judgment threshold and a detection threshold of appropriate magnitudes for each of the luminance information and the color information.
平均值计算部52，作为亮度信息，获取摄像图像的每个像素的亮度分量的值来作为亮度值，且作为颜色信息，获取根据每个像素的色差分量的值所计算的值来作为色相值。The average calculation unit 52 acquires, as brightness information, a value of a brightness component of each pixel of the captured image as a brightness value, and as color information, a value calculated from a value of a color difference component of each pixel, as a hue value. .
阈值设置部54将比连续的多个摄像图像间的每个像素的亮度值的差值大的值设置为亮度信息的检测阈值，并将比每个像素的色相值的差值大的值设置为颜色信息的检测阈值。The threshold setting unit 54 sets a value larger than the difference in brightness value for each pixel among a plurality of consecutive captured images as the detection threshold of brightness information, and sets a value larger than the difference in hue value for each pixel. is the detection threshold of color information.
由此，能根据摄像图像的亮度值以及色差分量来设置适当的检测阈值。Thereby, an appropriate detection threshold can be set according to the luminance value and the color difference component of the captured image.
运动检测部56基于所设置的亮度信息的检测阈值、与阈值设置部54进行设置后的连续的多个摄像图像间的所获取到的每个像素的亮度值的差值的大小关系、以及所设置的颜色信息的检测阈值、与连续的多个摄像图像间的所获取的每个像素的色相值的差值的大小关系的任一者，来检测给定的物体的移动。The motion detection unit 56 is based on the set detection threshold value of the brightness information, the size relationship with the difference in the brightness value of each pixel acquired between a plurality of continuous captured images set by the threshold value setting unit 54, and the The movement of a given object is detected by any one of the set detection threshold value of the color information and the magnitude relationship between the acquired hue value difference of each pixel among multiple consecutive captured images.
由此，能针对亮度信息以及颜色信息各自，通过适当的大小的检测阈值来进行物体的移动的检测。Accordingly, it is possible to detect the movement of an object with a detection threshold of an appropriate size for each of the luminance information and the color information.
另外，检测装置1具备输入部18。In addition, the detection device 1 includes an input unit 18 .
输入部18通过用户操作来对所设置的亮度信息的检测阈值以及颜色信息的检测阈值进行变更。The input unit 18 changes the set detection threshold of brightness information and the detection threshold of color information by user operation.
由此，能根据用户的要求来变更亮度信息的检测阈值以及颜色信息的检测阈值。Thereby, the detection threshold of brightness information and the detection threshold of color information can be changed according to user's request.
另外，平均值计算部52在摄像图像内的检测区域内获取亮度信息以及颜色信息。In addition, the average value calculation unit 52 acquires luminance information and color information within a detection area in a captured image.
检测方法判别部55以在摄像图像内的检测区域内所获取的亮度信息以及颜色信息进行判别。The detection method judging unit 55 makes a judgment based on the luminance information and color information acquired in the detection area in the captured image.
运动检测部56在摄像图像内的检测区域内进行给定的物体的移动的检测。The motion detection unit 56 detects the movement of a given object within a detection area within a captured image.
由此，能在摄像图像内设置检测区域，并以检测区域为对象来进行物体的移动的检测。In this way, it is possible to set a detection area within a captured image, and to detect movement of an object by using the detection area as a target.
另外，检测装置1具备：平均值计算部52、阈值重新设置判别部53、阈值设置部54以及运动检测部56。In addition, the detection device 1 includes an average value calculation unit 52 , a threshold value reset determination unit 53 , a threshold value setting unit 54 , and a motion detection unit 56 .
平均值计算部52从由摄像部16以帧为单位所连续摄像的摄像图像中获取与亮度相关的亮度信息。The average calculation unit 52 acquires luminance information related to luminance from captured images continuously captured by the imaging unit 16 in units of frames.
阈值设置部54设置亮度信息检测阈值。The threshold setting section 54 sets a brightness information detection threshold.
运动检测部56使用所设置的亮度信息的检测阈值、以及所获取的亮度信息，来检测给定的物体的移动。The motion detection section 56 detects the movement of a given object using the set detection threshold of the luminance information, and the acquired luminance information.
阈值重新设置判别部53在满足给定的条件的情况下，使阈值设置部54执行亮度信息的检测阈值的重新设置。The threshold resetting determination unit 53 causes the threshold setting unit 54 to perform resetting of the detection threshold of the luminance information when a predetermined condition is satisfied.
由此，在使用亮度信息的检测阈值来进行物体的移动的检测的情况下，能根据给定的条件来对亮度信息的检测阈值进行重新设置。Thereby, when the detection threshold of the brightness information is used to detect the movement of the object, the detection threshold of the brightness information can be reset according to a given condition.
因此，能使用更适当的亮度信息的检测阈值来进行物体的移动的检测。Therefore, it is possible to detect movement of an object using a more appropriate detection threshold of luminance information.
另外，平均值计算部52从以帧为单位所连续摄像的摄像图像中进一步获取与颜色相关的颜色信息来作为摄像条件。In addition, the average value calculation unit 52 further acquires color information related to colors from captured images continuously captured in units of frames as imaging conditions.
阈值设置部54还设置颜色信息的检测阈值。The threshold setting section 54 also sets a detection threshold of color information.
运动检测部56还使用所设置的颜色信息的检测阈值、以及所获取的颜色信息，来检测给定的物体的移动。The motion detection section 56 also detects the movement of a given object using the set detection threshold of the color information, and the acquired color information.
阈值重新设置判别部53在满足给定的条件的情况下，还使阈值设置部54执行颜色信息的检测阈值的重新设置。The threshold resetting judging section 53 also causes the threshold setting section 54 to execute resetting of the detection threshold of color information when a given condition is satisfied.
由此，在使用颜色信息的检测阈值来进行物体的移动的检测的情况下，能根据给定的条件来对颜色信息的检测阈值进行重新设置。Thereby, when the detection threshold of the color information is used to detect the movement of the object, the detection threshold of the color information can be reset according to a given condition.
因此，能使用更适当的颜色信息的检测阈值来进行物体的移动的检测。Therefore, it is possible to detect movement of an object using a more appropriate detection threshold of color information.
另外，检测装置1还具备阈值存储部71。In addition, the detection device 1 further includes a threshold storage unit 71 .
阈值存储部71对阈值设置部54进行设置时所获取的摄像条件进行存储。The threshold storage unit 71 stores imaging conditions acquired when the threshold setting unit 54 makes settings.
给定的条件是所存储的摄像条件与在摄像待机时所获取的摄像条件的差值超过给定范围的情况。The predetermined condition is a case where the difference between the stored imaging conditions and the imaging conditions acquired during imaging standby exceeds a predetermined range.
由此，能检测摄像条件的变化，进行亮度信息的检测阈值的重新设置。Thereby, it is possible to detect a change in the imaging conditions and reset the detection threshold of the luminance information.
另外，给定的条件是转移至摄像待机状态的情况。In addition, the predetermined condition is a case of shifting to the imaging standby state.
由此，在成为拍摄待机状态的情况下，能进行亮度信息的检测阈值的重新设置。Thereby, when the imaging standby state is entered, the detection threshold value of the luminance information can be reset.
另外，给定的条件是基于用户操作而进行了重新设置的执行指示的情况。In addition, the predetermined condition is a case where a reset execution instruction is given based on a user operation.
由此，能根据用户的要求来进行亮度信息的检测阈值的重新设置。Thereby, the detection threshold value of the luminance information can be reset according to the request of the user.
另外，检测装置1还具备拍摄控制部51。In addition, the detection device 1 further includes an imaging control unit 51 .
在给定的物体的移动被检测出时，拍摄控制部51执行给定的动作。When the movement of a predetermined object is detected, the imaging control unit 51 executes a predetermined operation.
由此，对应于在摄像图像中检测出物体的移动的情况，能使检测装置1执行给定的动作。In this way, the detection device 1 can be caused to execute a predetermined operation in response to detecting the movement of the object in the captured image.
另外，给定的进行移动的物体是人物的部位。In addition, the given moving object is a part of a character.
给定的动作是获取摄像图像来进行给定的拍摄处理的拍摄动作。The predetermined action is an imaging action of acquiring a captured image and performing predetermined imaging processing.
由此，在摄像图像中，对应于将人物的部位作为进行移动的物体进行检测的情况，能使检测装置1进行给定的拍摄处理。This allows the detection device 1 to perform predetermined imaging processing in response to detection of a part of a person as a moving object in a captured image.
此外，本发明不限于上述实施方式，能达成本发明的目的的范围内的变形、改良等也包含在本发明中。In addition, this invention is not limited to the above-mentioned embodiment, The deformation|transformation, improvement, etc. within the range which can achieve the objective of this invention are also included in this invention.
例如，在上述实施方式中，可以预先设置被设想为进行移动的物体的物体亮度信息以及颜色信息(例如，表征人的手的肤色的亮度值以及色相值等)，并基于该物体的亮度信息以及颜色信息与摄像图像的检测区域的差值，来设置亮度信息以及颜色信息的阈值。例如，能针对亮度分量以及色差分量各自将判别阈值(例如，差值的120％)以及检测阈值(例如，差值的150％)设置为比摄像图像与被设想为进行移动的物体的物体亮度值以及色相值的差值更大的给定比例的值。For example, in the above-mentioned embodiments, the object brightness information and color information (for example, the brightness value and hue value representing the skin color of a human hand) of an object that is assumed to be moving can be preset, and based on the brightness information of the object, And the difference between the color information and the detection area of the captured image to set the threshold of the brightness information and the color information. For example, a discrimination threshold (for example, 120% of the difference) and a detection threshold (for example, 150% of the difference) can be set for each of the luminance component and the color difference component to be higher than the object brightness of the captured image and the object assumed to be moving. The value at which the difference between the value and the hue value is greater for a given scale.
另外，在上述实施方式中，可以通过颜色空间变换将摄像图像的色差变换为色相值。另外，可以基于变换后的色相值来对色相值的判别阈值、检测阈值或者重新设置的阈值进行设置，从而进行运动检测。In addition, in the above-described embodiments, the color difference of the captured image may be converted into hue values by color space conversion. In addition, a judgment threshold, a detection threshold, or a reset threshold of the hue value may be set based on the transformed hue value, so as to perform motion detection.
另外，在上述实施方式中，用户可以经由输入部18来对亮度信息以及颜色信息各自的判别阈值以及检测阈值进行变更。In addition, in the above-described embodiment, the user can change the respective discrimination threshold and detection threshold of the luminance information and the color information via the input unit 18 .
另外，在上述实施方式中，用户可以经由输入部18来使阈值设置部54重新设置亮度信息以及颜色信息各自的检测阈值以及判别阈值。In addition, in the above-described embodiment, the user can cause the threshold setting unit 54 to reset the respective detection thresholds and discrimination thresholds of the luminance information and the color information via the input unit 18 .
另外，在上述实施方式中，可以成为拍摄待机状态，每当开始连续的摄像图像的输入时，使阈值设置部54重新设置亮度信息以及颜色信息各自的检测阈值以及判别阈值。In addition, in the above-described embodiment, the shooting standby state may be set, and the threshold setting unit 54 may reset the detection threshold and the discrimination threshold of each of the luminance information and the color information every time input of continuous captured images is started.
另外，在上述实施方式中，以将检测区域设置为摄像图像内的一部分的区域的情况为例来进行了说明，但也可以将检测区域设置为摄像图像的整体。In addition, in the above embodiment, the case where the detection area is set as a part of the captured image has been described as an example, but the detection area may be set as the entire captured image.
另外，在将检测区域设置为摄像图像的一部分的区域的情况下，可以将检测区域设置为摄像图像内的多处。In addition, when the detection area is set as a part of the captured image, the detection area may be set as a plurality of places within the captured image.
另外，在上述实施方式中，以在运动快门功能中应用本发明为例进行了说明，但不限于此。即，运动检测的结果可以是，转移至对拍摄图像进行再生的状态。另外，在对摄像图像内的交通工具、动物等进行移动的物体进行检测的情况下，能应用本发明。进而，运动检测的结果不限于按下快门的情况，还可以进行各种给定的动作(例如，给定的应用的启动、照明的点亮、门的开闭等)。In addition, in the above-mentioned embodiments, an example in which the present invention is applied to the motion shutter function has been described, but it is not limited thereto. That is, as a result of the motion detection, the state may shift to the state of reproducing the captured image. In addition, the present invention can be applied to the detection of moving objects such as vehicles and animals within a captured image. Furthermore, the result of motion detection is not limited to pressing the shutter button, and various predetermined actions (for example, activation of a predetermined application, lighting of lighting, opening and closing of a door, etc.) may be performed.
另外，在上述实施方式中，说明了应用本发明的检测装置1是数码相机的例子，但并不限于此。In addition, in the above-mentioned embodiments, an example in which the detection device 1 to which the present invention is applied is a digital camera has been described, but it is not limited thereto.
例如，本发明还能一般应用于具有运动快门功能的电子设备。具体而言，例如，本发明能应用于笔记本型的个人计算机、摄像机、便携式导航装置、便携式电话机、智能手机、便携式游戏机等。For example, the present invention can also be generally applied to electronic equipment having a motion shutter function. Specifically, for example, the present invention can be applied to notebook-type personal computers, video cameras, portable navigation devices, mobile phones, smart phones, portable game machines, and the like.
上述一系列的处理既可以通过硬件来执行，也可以通过软件来执行。The series of processing described above can be executed by hardware or by software.
换言之，图2的功能性构成只不过是例示，并不特别限定。即，只要在检测装置1中装载能将上述一系列的处理整体执行的功能即可，为了实现该功能而采用何种功能块并不限定于图2的例子。In other words, the functional configuration shown in FIG. 2 is merely an example, and is not particularly limited. That is, it is only necessary to install a function capable of executing the above-described series of processes in the detection device 1 , and what kind of functional blocks are used to realize the function is not limited to the example shown in FIG. 2 .
另外，1个功能块可以由单一硬件构成，也可以由单一软件构成，还可以由它们的组合构成。In addition, one functional block may be constituted by a single hardware, may be constituted by a single software, or may be constituted by a combination thereof.
在通过软件来执行一系列的处理的情况下，构成该软件的程序从网络、记录介质安装至计算机等。When a series of processing is executed by software, a program constituting the software is installed to a computer or the like from a network or a recording medium.
计算机可以是嵌入在专用的硬件中的计算机。另外，计算机可以是通过安装各种程序而能执行各种功能的计算机，例如通用的个人计算机。A computer may be a computer embedded in dedicated hardware. In addition, the computer may be a computer capable of performing various functions by installing various programs, such as a general-purpose personal computer.
包含这样的程序的记录介质不仅由为了对用户提供程序而与装置本体分开发行的图1的可移动介质31构成，还由以预先嵌入至装置本体中的状态提供给用户的记录介质等构成。可移动介质31例如由磁盘(包含软盘)、光盘、或光磁盘等构成。光盘例如由CD-ROM(CompactDisk-ReadOnlyMemory)、DVD(DigitalVersatileDisk)、Blu-ray(注册商标)Disc(蓝光光盘)等构成。光磁盘由MD(Mini-Disk)等构成。另外，以预先嵌入至装置本体中的状态提供给用户的记录介质例如由记录有程序的图1的ROM12、图1的存储部20中包含的硬盘等构成。The recording medium containing such a program includes not only the removable medium 31 in FIG. 1 that is distributed separately from the device body to provide the program to the user, but also a recording medium that is pre-embedded in the device body and provided to the user. The removable medium 31 is constituted by, for example, a magnetic disk (including a flexible disk), an optical disk, or a magneto-optical disk. The optical disk is constituted by, for example, CD-ROM (CompactDisk-ReadOnlyMemory), DVD (DigitalVersatileDisk), Blu-ray (registered trademark) Disc (Blu-ray Disc), and the like. The magneto-optical disk is composed of MD (Mini-Disk) and the like. In addition, the recording medium provided to the user in a state of being embedded in the main body of the device includes, for example, the ROM 12 in FIG. 1 on which the program is recorded, the hard disk included in the storage unit 20 in FIG. 1 , and the like.
此外，在本说明书中，关于对记录介质中所记录的程序进行记述的步骤，当然包含沿其顺序而按时序进行的处理，但也不必是按时序进行处理，还包含并行或者单独执行的处理。In addition, in this specification, the steps described in the program recorded on the recording medium include, of course, processing performed in chronological order along the sequence, but processing not necessarily performed in chronological order, and processing performed in parallel or independently are also included. .
以上说明了本发明的几个实施方式，但这些实施方式只是例示，并不限定本发明的技术范围。本发明能取其他各种实施方式，进而，在不脱离本发明的主旨的范围内能进行省略、置换等各种变更。这些实施方式、其变形落在本说明书等所记载的发明的范围、主旨内，而且也落在权利要求书所记载的发明和其等价的范围内。Several embodiments of the present invention have been described above, but these embodiments are merely examples and do not limit the technical scope of the present invention. The present invention can take other various embodiments, and various changes such as omissions and substitutions can be made without departing from the scope of the present invention. These embodiments and modifications thereof fall within the scope and gist of the inventions described in this specification and the like, and also fall within the inventions described in the claims and their equivalents.
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2014105383AJP5804138B1 (en) | 2014-05-21 | 2014-05-21 | Detection apparatus, detection method, and program |
| JP2014-105383 | 2014-05-21 |
| Publication Number | Publication Date |
|---|---|
| CN105100586Atrue CN105100586A (en) | 2015-11-25 |
| CN105100586B CN105100586B (en) | 2018-11-16 |
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510119306.3AExpired - Fee RelatedCN105100586B (en) | 2014-05-21 | 2015-03-18 | Detection device, detection method and recording medium |
| Country | Link |
|---|---|
| US (2) | US9280707B2 (en) |
| JP (1) | JP5804138B1 (en) |
| CN (1) | CN105100586B (en) |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109151348A (en)* | 2018-09-28 | 2019-01-04 | 维沃移动通信有限公司 | A kind of imaging sensor, image processing method and electronic equipment |
| CN110958398A (en)* | 2018-09-27 | 2020-04-03 | 浙江宇视科技有限公司 | Motion point light source restraining method and device |
| CN112788311A (en)* | 2019-11-01 | 2021-05-11 | 卡西欧计算机株式会社 | Information acquisition method and information acquisition device |
| CN113164007A (en)* | 2018-12-10 | 2021-07-23 | 奥林巴斯株式会社 | Image recording apparatus |
| CN114690783A (en)* | 2022-04-18 | 2022-07-01 | 松灵机器人(深圳)有限公司 | Path planning method of mower and related device |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2011119678A2 (en) | 2010-03-23 | 2011-09-29 | California Institute Of Technology | Super resolution optofluidic microscopes for 2d and 3d imaging |
| US9643184B2 (en) | 2010-10-26 | 2017-05-09 | California Institute Of Technology | e-Petri dishes, devices, and systems having a light detector for sampling a sequence of sub-pixel shifted projection images |
| US9569664B2 (en)* | 2010-10-26 | 2017-02-14 | California Institute Of Technology | Methods for rapid distinction between debris and growing cells |
| US9857453B1 (en)* | 2014-06-30 | 2018-01-02 | Lockheed Martin Corporation | High-frequency indicator phase system and method |
| JP6575083B2 (en)* | 2015-03-18 | 2019-09-18 | 株式会社リコー | Image forming apparatus |
| EP3591576A3 (en)* | 2017-01-20 | 2020-01-15 | Koito Manufacturing Co., Ltd. | Vehicle lamp system, vehicle lamp control apparatus, and vehicle lamp control method |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6125145A (en)* | 1995-12-28 | 2000-09-26 | Sony Corporation | Motion detection apparatus and motion detection method |
| CN101098462A (en)* | 2007-07-12 | 2008-01-02 | 上海交通大学 | Video Moving Object Detection Method Combining Chroma Deviation and Luminance Deviation |
| CN101247471A (en)* | 2007-02-15 | 2008-08-20 | 索尼株式会社 | Motion detecting device, motion detecting method, imaging device, and monitoring system |
| CN102457724A (en)* | 2010-10-22 | 2012-05-16 | Tcl集团股份有限公司 | Image motion detecting system and method |
| US20120154580A1 (en)* | 2010-12-20 | 2012-06-21 | Huang tai-hui | Moving object detection method and image processing system for moving object detection |
| CN102609902A (en)* | 2010-12-10 | 2012-07-25 | 卡西欧计算机株式会社 | Image processing apparatus, image processing method, and storage medium |
| CN103440628A (en)* | 2013-08-27 | 2013-12-11 | 宁波海视智能系统有限公司 | Method for removing shadow interference of moving object in video |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2837925B2 (en)* | 1990-06-06 | 1998-12-16 | 沖電気工業株式会社 | Motion vector detection method of TV converter |
| JPH057372A (en)* | 1991-06-25 | 1993-01-14 | Canon Inc | Motion vector detector |
| JP3143494B2 (en)* | 1991-06-25 | 2001-03-07 | キヤノン株式会社 | Motion vector apparatus and method |
| JPH05191829A (en) | 1992-01-10 | 1993-07-30 | Kenwood Corp | Motion detecting circuit |
| JP3428415B2 (en)* | 1998-01-21 | 2003-07-22 | 三菱電機株式会社 | Motion vector detection device and motion vector detection method |
| JP4283728B2 (en)* | 2004-05-06 | 2009-06-24 | 日本放送協会 | Motion vector detection apparatus and motion vector detection program |
| JP4776324B2 (en)* | 2005-10-05 | 2011-09-21 | 三菱電機株式会社 | Monitoring terminal device |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6125145A (en)* | 1995-12-28 | 2000-09-26 | Sony Corporation | Motion detection apparatus and motion detection method |
| CN101247471A (en)* | 2007-02-15 | 2008-08-20 | 索尼株式会社 | Motion detecting device, motion detecting method, imaging device, and monitoring system |
| CN101098462A (en)* | 2007-07-12 | 2008-01-02 | 上海交通大学 | Video Moving Object Detection Method Combining Chroma Deviation and Luminance Deviation |
| CN102457724A (en)* | 2010-10-22 | 2012-05-16 | Tcl集团股份有限公司 | Image motion detecting system and method |
| CN102609902A (en)* | 2010-12-10 | 2012-07-25 | 卡西欧计算机株式会社 | Image processing apparatus, image processing method, and storage medium |
| US20120154580A1 (en)* | 2010-12-20 | 2012-06-21 | Huang tai-hui | Moving object detection method and image processing system for moving object detection |
| CN103440628A (en)* | 2013-08-27 | 2013-12-11 | 宁波海视智能系统有限公司 | Method for removing shadow interference of moving object in video |
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110958398A (en)* | 2018-09-27 | 2020-04-03 | 浙江宇视科技有限公司 | Motion point light source restraining method and device |
| CN110958398B (en)* | 2018-09-27 | 2021-08-31 | 浙江宇视科技有限公司 | Method and device for suppressing moving point light source |
| CN109151348A (en)* | 2018-09-28 | 2019-01-04 | 维沃移动通信有限公司 | A kind of imaging sensor, image processing method and electronic equipment |
| CN109151348B (en)* | 2018-09-28 | 2021-01-08 | 维沃移动通信有限公司 | Image processing method, electronic equipment and computer readable storage medium |
| CN113164007A (en)* | 2018-12-10 | 2021-07-23 | 奥林巴斯株式会社 | Image recording apparatus |
| CN112788311A (en)* | 2019-11-01 | 2021-05-11 | 卡西欧计算机株式会社 | Information acquisition method and information acquisition device |
| CN114690783A (en)* | 2022-04-18 | 2022-07-01 | 松灵机器人(深圳)有限公司 | Path planning method of mower and related device |
| Publication number | Publication date |
|---|---|
| JP2015220725A (en) | 2015-12-07 |
| CN105100586B (en) | 2018-11-16 |
| US9280707B2 (en) | 2016-03-08 |
| JP5804138B1 (en) | 2015-11-04 |
| US20150339529A1 (en) | 2015-11-26 |
| US20160042231A1 (en) | 2016-02-11 |
| Publication | Publication Date | Title |
|---|---|---|
| CN105100586B (en) | Detection device, detection method and recording medium | |
| JP6049448B2 (en) | Subject area tracking device, control method thereof, and program | |
| KR101051001B1 (en) | Information processing apparatus, eye open / closed degree determination method, recording medium and imaging device | |
| US9779290B2 (en) | Detecting apparatus, detecting method and computer readable recording medium recording program for detecting state in predetermined area within images | |
| US9092659B2 (en) | Subject determination apparatus that determines whether or not subject is specific subject | |
| JP2008219874A (en) | Imaging apparatus, image processing apparatus, control method, and program | |
| JP7223079B2 (en) | IMAGE PROCESSING APPARATUS, CONTROL METHOD THEREOF, AND IMAGING APPARATUS | |
| US10013632B2 (en) | Object tracking apparatus, control method therefor and storage medium | |
| US20140369611A1 (en) | Image processing apparatus and control method thereof | |
| CN105744179A (en) | Image Capture Apparatus Capable of Processing Photographed Images | |
| JP2014007528A (en) | Image processing apparatus and control method thereof | |
| JP2018107741A (en) | Image processing apparatus, image processing method, and program | |
| JP6099973B2 (en) | Subject area tracking device, control method thereof, and program | |
| JP5615012B2 (en) | White balance stable adjustment device and control method thereof, program for white balance stable adjustment | |
| JP2014225763A (en) | Imaging apparatus, control method of the same, program, and storage medium | |
| JP2015222600A (en) | Detection apparatus, detection method, and program | |
| JP2017151562A (en) | Image processing device, imaging device, control method and program therefor | |
| JP6432290B2 (en) | Imaging apparatus, imaging control method, and program | |
| JP5631181B2 (en) | Image processing apparatus, control method therefor, and program | |
| JP6432289B2 (en) | Imaging apparatus, imaging control method, and program | |
| JP2012114678A (en) | Subject detection device, subject detection method and program | |
| JP2015043603A (en) | Image processing apparatus and control method thereof, imaging apparatus and control method thereof, and program |
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee | Granted publication date:20181116 Termination date:20210318 |